Create agents that monitor and act on your behalf. Your agents are standing by!
Ruby
Updated Jun 28, 2019
News, full-text, and article metadata extraction in Python 3. Advanced docs:
Python
Updated Jun 10, 2019
Elegant Scraper and Crawler Framework for Golang
Go
Updated Jun 21, 2019
👾 Fast, simple and clean video downloader
Go
Updated Jun 27, 2019
📙 中华新华字典数据库。包括歇后语，成语，词语，汉字。
Python
Updated Apr 23, 2019
Distributed crawler powered by Headless Chrome
JavaScript
Updated Jun 27, 2019
Declarative web scraping
#79 opened 9 months ago by flazx
1
#74 opened 9 months ago by ziflex
3
#54 opened 9 months ago by ziflex
6
Go
Updated Jun 25, 2019
A collection of awesome web crawler,spider in different languages
Updated Apr 18, 2019
🔮 A Node.js scraper for humans.
JavaScript
Updated Mar 14, 2019
Scrapes an instagram user's photos and videos
Python
Updated Jun 24, 2019
Final Weibo Crawler Scrap Anything From Weibo, comments, weibo contents, followers, anything. The Terminator
Python
Updated Jan 5, 2019
🕷 The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
PHP
Updated May 31, 2019
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
Ruby
Updated Nov 28, 2018
YouTube video downloader in javascript.
#420 opened 3 months ago by sunny-lan
3
HTML
Updated Jun 22, 2019
Node.js scraper to get data from Google Play
#283 opened 7 months ago by facundoolano
2
#238 opened about 1 year ago by facundoolano
#212 opened about 1 year ago by dontub
3
JavaScript
Updated Jun 27, 2019
Python爬虫，京东自动登录，在线抢购商品
Python
Updated Jun 15, 2018
Creating Scrapy scrapers via the Django admin interface
Python
Updated Jun 15, 2019
Scrapoxy hides your scraper behind a cloud. It starts a pool of proxies to send your requests. Now, you can crawl wit…
JavaScript
Updated Jan 3, 2019
scrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper
Python
Updated Jun 25, 2019
Geziyor, a fast web crawling & scraping framework for Go
Go
Updated Jun 27, 2019
online port scan scraper
Python
Updated Apr 18, 2019
[Unmaintained] A simple and clean video/music/image downloader 👾
Python
Updated Apr 2, 2018
A high performance web crawler in Elixir.
Elixir
Updated Jun 19, 2019
Download website to local directory (including all css, images, js, etc.)
JavaScript
Updated Jun 28, 2019
A Scala library for scraping content from HTML pages
Scala
Updated Apr 5, 2019
✂️ High performance, multi-threaded image scraper
Python
Updated Jan 4, 2018
IMDbPY is a Python package useful to retrieve and manage the data of the IMDb movie database about movies, people, ch…
#185 opened 9 months ago by OrangutanGaming
1
Python
Updated Jun 22, 2019
Declarative DOM extraction expression evaluator. 👨⚕️
#12 opened over 2 years ago by gajus
JavaScript
Updated Jun 19, 2019
The Zipru scraper developed in the Advanced Web Scraping Tutorial.
Python
Updated Mar 19, 2017
A tiny Node.js microservice to scrape open graph data with joy.
JavaScript
Updated May 27, 2019