Pinned

1. Crawling-Infrastructure

   Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.

   TypeScript 244 22

2. GoogleScraper

   A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.

   HTML 2.3k 694

3. struktur

   Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.

   JavaScript 35 9

4. se-scraper

   Javascript scraping module based on puppeteer for many different search engines...

   HTML 458 113

5. uncaptcha3

   Update of uncaptcha2 from 2019

   Python 113 19

6. zardaxt

   Passive TCP/IP Fingerprinting Tool. Run this on your server and find out what Operating Systems your clients are *really* using.

   Python 50 7