Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
Python 2.9k 583
Auto Extractor Module
Python 231 61
Downloader Middleware to support Pyppeteer in Scrapy & Gerapy
Python 130 33
Distribution Support for Scrapy & Gerapy using RabbitMQ
Python 7 1
Distribution Support for Scrapy & Gerapy using Redis
Python 6 1
A package for supporting proxy in Scrapy & Gerapy
Python 9 3
Downloader Middleware to support Playwright in Scrapy & Gerapy
Gerapy Prometheus Exporter
Item Pipeline Components for Gerapy & Scrapy
Downloader Middleware to support Selenium in Scrapy & Gerapy
A package which can simplify your multiprocessing implementation
Loading…