scrapers

source for Open States scrapers

A framework for creating semi-automatic web content extractors

A set of spiders and scrapers to extract location information from places that post their location on the internet.

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

Pastebin OSINT Harvester

Python scripts for building 'Short Jokes' dataset, featured on Kaggle

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

Scraply a simple dom scraper to fetch information from any html based website

Simple library which helps you to retrieve the source of various video streaming sites.

Web based UI to make scraping data from real estate websites super simple

Scraper for Google Maps "Popular Times" for place entries

Library for scraping websites or apis at any scale

An Unofficial Pitchfork Music API client for Node.js

A basic python 3 based web scraper for extracting reviews from Amazon. Built using Selectorlib and requests

CLI OSINT app that can fetch data from Instagram's Web API without authentication.

Using Apache Airflow to schedule web scrapers

📈 A web scraper that let's you scrape anything you want from the web including google search results

📝 Resources for web scraping with node.js

Official source repository for Kodi scraper add-ons

Evaluate JavaScript on a URL through headless Chrome browser.