Fix cross compiling issue in setup.py, ensure that lib_dirs and inc_dirs are

defined in cross compiling mode, too.