Here are
526 public repositories
matching this topic...
Web Scraper in Go, similar to BeautifulSoup
a class that uses scraped proxies to make http GET/POST requests (Python requests)
Updated
Jul 4, 2020
Python
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
Updated
Aug 23, 2020
Pascal
An R web crawler and scraper
SQL Based DSL Web Scraper/Screen Scraper
Scrapes g4g and creates PDF
Updated
May 15, 2020
Python
A php crawler that finds emails on the internets
Cryptocurrency Historical Market Data R Package
Python class to scrape data from rightmove.co.uk and return listings in a pandas DataFrame object
Updated
Aug 13, 2020
Python
A command line tool for checking your website for GDPR compliance.
Updated
Feb 11, 2019
JavaScript
A tkinter GUI collating various data
Updated
Jun 14, 2020
Python
Speedy, lightweight web scrapper for Shutterstock.
Updated
May 10, 2020
Python
This Python script will download chapters from novels availaible on wuxiaworld.com saves then into the .epub format
Updated
Nov 2, 2019
Python
Financial Web Scraper & Sentiment Classifier
Updated
Aug 20, 2019
Python
Updated
Jun 19, 2020
JavaScript
An automated, programming-free web scraper for interactive sites
MakeNews is for journalists and newsrooms. It helps you track news from web and social media in real-time.
Updated
Jul 30, 2020
JavaScript
Library packs for google cloud functions
Updated
Oct 22, 2019
Python
A web scraping tool to allow freeCodeCamp campers to download their solutions.
Updated
Nov 12, 2017
HTML
Python script/class to download an entire Imgur album in one go into a folder of your choice.
Updated
Mar 19, 2019
Python
A Linux terminal tool for parsing and scraping Holberton project pages to automate repetitive tasks.
Updated
Mar 9, 2020
Python
Web data extraction tool implemented as chrome extension
Updated
Mar 3, 2020
JavaScript
Yet another Python web scraping application
Updated
Jul 21, 2019
Python
This is an unofficial API for the website pcpartpicker.com.
Updated
Jun 13, 2020
Python
Python client for RealClearPolitics.
Updated
Aug 10, 2020
Python
a java library which scrapes twitter to fetch publicly available info
Updated
Jan 18, 2020
Java
Python implementation of web scraping of TripAdvisor with Selenium in a new 2019 website
Updated
Jul 26, 2020
Jupyter Notebook
[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3
Updated
Mar 8, 2019
Python
Improve this page
Add a description, image, and links to the
webscraper
topic page so that developers can more easily learn about it.
Curate this topic
Add this topic to your repo
To associate your repository with the
webscraper
topic, visit your repo's landing page and select "manage topics."
Learn more
You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session.
You signed out in another tab or window. Reload to refresh your session.
We need more tests. Contributions are welcome!