Web Scraper in Go, similar to BeautifulSoup
-
Updated
May 7, 2020 - Go
#
webscraper
Here are 496 public repositories matching this topic...
a class that uses scraped proxies to make http GET/POST requests (Python requests)
python
http
proxy
proxy-requests
webscraper
proxy-server
http-proxy
python3
recursion
requests
proxy-list
webscraping
python-requests
http-getter
recursion-problem
http-proxy-middleware
http-get
requests-module
webscraper-api
-
Updated
Jul 4, 2020 - Python
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
html
cli
http
json
scraper
web
rest
command-line
curl
xml
webscraper
wget
css-selector
xpath
xquery
data-processing
httpie
webscraping
datascraping
xmlstarlet
-
Updated
Jul 5, 2020 - Pascal
An R web crawler and scraper
-
Updated
May 22, 2020 - R
A php crawler that finds emails on the internets
-
Updated
Jan 24, 2019 - PHP
Cryptocurrency Historical Market Data R Package
cran
crypto
webscraper
financial
kaggle
cryptocurrency
open-data
dataset
market-data
cryptocurrencies
coinmarketcap
rpackage
historical-cryptocurrency-prices
-
Updated
Jan 27, 2020 - R
A command line tool for checking your website for GDPR compliance.
-
Updated
Feb 11, 2019 - JavaScript
Python class to scrape data from rightmove.co.uk and return listings in a pandas DataFrame object
python
data-science
data-mining
csv
pandas-dataframe
webscraper
pandas
python3
data-analysis
rightmove
-
Updated
Jun 25, 2020 - Python
DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c
crawler
csharp
dotnetcore
scraping
crawling
webscraper
scrapy
entity-framework-core
webcrawler
webscraping
scrapy-crawler
ddd-architecture
htmlagilitypack
webcrawling
webcrawler-htmlagilitypack
-
Updated
Nov 13, 2019 - C#
A tkinter GUI collating various data
-
Updated
Jun 14, 2020 - Python
Speedy, lightweight web scrapper for Shutterstock.
-
Updated
May 10, 2020 - Python
This Python script will download chapters from novels availaible on wuxiaworld.com saves then into the .epub format
-
Updated
Nov 2, 2019 - Python
Financial Web Scraper & Sentiment Classifier
-
Updated
Aug 20, 2019 - Python
An automated, programming-free web scraper for interactive sites
-
Updated
May 21, 2020 - HTML
Nunux Keeper core API
-
Updated
Jun 19, 2020 - JavaScript
Open
Add more tests
1
ZoranPandovski
commented
Oct 21, 2018
We need more tests. Contributions are welcome!
swethab184
commented
Jul 3, 2017
Library packs for google cloud functions
chrome
google
cloud
serverless
tensorflow
functions
numpy
selenium
webscraper
gcp
pandas
chromium
serverless-architectures
gcf
gcf-packs
-
Updated
Oct 22, 2019 - Python
JacksonBates
commented
Nov 9, 2017
Since many beginners could use this tool, a help page explaining how to push solutions to a GitHub repo could be a nice gentle introduction for campers.
Python script/class to download an entire Imgur album in one go into a folder of your choice.
-
Updated
Mar 19, 2019 - Python
A Linux terminal tool for parsing and scraping Holberton project pages to automate repetitive tasks.
-
Updated
Mar 9, 2020 - Python
Web data extraction tool implemented as chrome extension
-
Updated
Mar 3, 2020 - JavaScript
This is an unofficial API for the website pcpartpicker.com.
-
Updated
Jun 13, 2020 - Python
Python client for RealClearPolitics.
-
Updated
Jul 6, 2020 - Python
a java library which scrapes twitter to fetch publicly available info
-
Updated
Jan 18, 2020 - Java
Python implementation of web scraping of TripAdvisor with Selenium in a new 2019 website
python
selenium
webscraper
webscraping
tripadvisor
webscraper-website
tripadvisor-scraper
tripadvisorreview
-
Updated
Jul 6, 2020 - Jupyter Notebook
[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3
fun
chrome
downloader
streaming
stream
chrome-devtools
anime
scraping
webscraper
idm
python3
uget
webscraping
anime-downloader
otaku
anime-scraper
stream-url
-
Updated
Mar 8, 2019 - Python
Improve this page
Add a description, image, and links to the webscraper topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the webscraper topic, visit your repo's landing page and select "manage topics."
Code base is to be refactored to follow a directory structure and also use proper naming conventions for variable.
It should also follow PEP8 for better readability.