Scrapy Plugins

Plugins for the Scrapy framework

scrapy-playwright Public
🎭 Playwright integration for Scrapy

Python 329 BSD-3-Clause 41 13 0 Updated Oct 9, 2022
scrapy-zyte-api Public
Zyte API integration for Scrapy

Python 8 5 7 1 Updated Sep 27, 2022
scrapy-crawlera-fetch Public
Scrapy Downloader Middleware for Crawlera Fetch API

Python 7 BSD-3-Clause 9 4 5 Updated Sep 8, 2022
scrapy-statsd Public

Python 5 BSD-3-Clause 4 1 3 Updated Sep 8, 2022
scrapy-zyte-smartproxy Public
Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

Python 328 86 6 (1 issue needs help) 1 Updated Aug 5, 2022
scrapy-feedexporter-azure-storage Public

Python 0 2 1 0 Updated Aug 4, 2022
scrapy-feedexporter-google-drive Public

Python 1 1 0 0 Updated Apr 12, 2022
scrapy-dotpersistence Public
A scrapy extension to sync `.scrapy` folder to an S3 bucket

Python 13 BSD-3-Clause 8 2 1 Updated Mar 28, 2022
scrapy-magicfields Public
Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.

Python 47 BSD-3-Clause 7 0 1 Updated Mar 16, 2022
scrapy-pagestorage Public
A scrapy extension to store requests and responses information in storage service

Python 24 BSD-3-Clause 7 2 0 Updated Mar 11, 2022

Popular repositories