columbia catalog scraper:哥伦比亚大学课程目录 源码

发展历程 cra草的外壳非常方便: scrapy shell 'https://en.wikipedia.org/w/api.php?action=query&list=search&srsearch=Michael+Collins+Columbia+University&utf8=&format=json' ... >>> import json >>> jsonresponse = json.loads(response.body_as_unicode()) >>> jsonresponse >>> jsonresponse['query'] >>> import html >>> from scrapy.selector import Selector >>> s = Selector(text=html.unescape( jsonresponse['query']['searc