Pinned

1. scrapy/scrapy Public

   Scrapy, a fast high-level web crawling & scraping framework for Python.

   Python 42.7k 9.5k

2. curl/curl Public

   A command line tool and library for transferring data with URL syntax, supporting DICT, FILE, FTP, FTPS, GOPHER, GOPHERS, HTTP, HTTPS, IMAP, IMAPS, LDAP, LDAPS, MQTT, POP3, POP3S, RTMP, RTMPS, RTSP…

   C 23.5k 4.9k

3. scrapinghub/splash Public

   Lightweight, scriptable browser as a service with an HTTP API

   Python 3.5k 475

4. berstend/puppeteer-extra Public

   💯 Teach puppeteer new tricks through plugins.

   JavaScript 3.5k 441

5. scrapinghub/dateparser Public

   python parser for human readable dates

   Python 2k 381

6. scrapy/parsel Public

   Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

   Python 740 110