首页 > 新手Scrapy爬虫运行问题

新手Scrapy爬虫运行问题

新人刚开始学习Scrapy,成功安装Scrapy,运行第一个程序还是报错,望高手帮忙解答,感激不尽
错误提示
Traceback (most recent call last):

  File "c:\python27\lib\runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "c:\python27\lib\runpy.py", line 72, in _run_code
    exec code in run_globals
  File "C:\Python27\Scripts\scrapy.exe\__main__.py", line 9, in <module>
  File "c:\python27\lib\site-packages\scrapy\cmdline.py", line 142, in execute
    cmd.crawler_process = CrawlerProcess(settings)
  File "c:\python27\lib\site-packages\scrapy\crawler.py", line 209, in __init__
    super(CrawlerProcess, self).__init__(settings)
  File "c:\python27\lib\site-packages\scrapy\crawler.py", line 115, in __init__
    self.spider_loader = _get_spider_loader(settings)
  File "c:\python27\lib\site-packages\scrapy\crawler.py", line 296, in _get_spider_loader
    return loader_cls.from_settings(settings.frozencopy())
  File "c:\python27\lib\site-packages\scrapy\spiderloader.py", line 30, in from_settings
    return cls(settings)
  File "c:\python27\lib\site-packages\scrapy\spiderloader.py", line 21, in __init__
    for module in walk_modules(name):
  File "c:\python27\lib\site-packages\scrapy\utils\misc.py", line 63, in walk_modules
    mod = import_module(path)
  File "c:\python27\lib\importlib\__init__.py", line 37, in import_module
    __import__(name)
ImportError: No module named Tieba.spiders

按照提示,Tieba应该是题主你创建的scrapy的一个项目吧,而正常的话在spiders目录下应该有__init__.py文件中,虽然这个文件可以不用编辑,但是缺少这个文件也会报ImportError。所以,题主你检查下这个文件是否存在?
还可以参考下这个问题:
python ImportError No module named


Tieba ,你这个SPIDER名称没有定义好,或者没有为你的蜘蛛命好名。


检查一下新建的Spider类,需要继承scrapy.Spider


重新安装了一遍,整理了爬虫放的文件夹位置,是之前爬虫放的文件夹比较混乱,导致scrapy无法找到模块,谢谢大家

【热门文章】
【热门文章】