-
Updated
Jul 11, 2021 - Python
#
scrapper
Here are 486 public repositories matching this topic...
Comic-dl is a command line tool to download manga and comics from various comic and manga sites. Supported sites : readcomiconline.to, mangafox.me, comic naver and many more.
automation
web
debian
phantomjs
scraping
manga
python-script
youtube-dl
comics
scrapping
scrapper
python-support
-
Updated
Apr 15, 2021 - TypeScript
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
web-scraper
web-scraping
newsletter
reuters
bloomberg
futures
web-scrapers
scrapper
financial-data
news-websites
data-scraping
news-scraper
futures-historical-data
data-scraper
sraping
python-web-scraper
financial-times
options-data
wall-street-journal
wallstreetbets
-
Updated
Jun 28, 2021 - Python
Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!
-
Updated
Apr 29, 2021 - Python
Scrapes g4g and creates PDF
-
Updated
May 15, 2020 - Python
simple metadata scrapper for node.js
-
Updated
Jun 12, 2021 - TypeScript
An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
python
scraper
scraping
selenium
scrapy
selenium-webdriver
asp-net
webcrawler
scrapper
scraping-websites
webcrawling
-
Updated
Feb 28, 2019 - Python
Powerful dork searcher and vulnerability scanner for windows platform
crawler
automation
sql
csharp
exploit
hacking
xss
smartthings
vulnerability
crawlers
scrapper
xss-detection
scanners
dork
lfi
lfi-detection
-
Updated
Mar 5, 2021 - C#
Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2021!
python
instagram
scraper
monitor
discord
discordapp
scraping
discord-bot
python3
instagram-scraper
instagram-photos
scrapper
scraping-websites
monitors
discordbot
monitoring-scripts
instagram-bot
instagram-downloader
scraping-python
webhook-discord
-
Updated
Apr 7, 2021 - Python
scrape proxies from more than 5 different sources and check which ones are still alive
http
scraper
checker
proxy
grabber
https-proxy
socks
socks5
proxies
socks-proxy
proxy-list
scrapper
socks5-proxy
socks4
proxy-checker
proxychecker
proxy-scraper
-
Updated
Jul 21, 2021 - Python
Advanced python library to scrap Twitter (tweets, users) from unofficial API, fully covered by integration tests
python
search
api
scraper
twitter
tweets
twitter-api
users
unofficial
crawl
scrape
scrap
user
tweet
scrapper
twint
scrap-tweet
searchrunner
-
Updated
Mar 27, 2021 - Python
A complete nodejs API to extract streaming sites video direct URLs
nodejs
upstream
kodi-addon
scrapper
okru
cloudvideo
vidoza
mixdrop
clipwatching
jetload
jawcloud
gounlimited
uqload
vidlox
vidtodo
uptostream
streamplay
powvideo
doodstream
supervideo
-
Updated
Mar 17, 2021 - JavaScript
fabiodrg
commented
Mar 13, 2021
Although most extractors use jQuery, there is code here and there that uses vanilla JS (my fault, I tend to prefer vanilla Document interface for working with the DOM. At the moment, the Mocha unit tests setup the jQuery context for the HTML sample file under testing. I think it makes sense to set the global document variable as well, ot
-
Updated
Dec 17, 2018 - JavaScript
Proxy List Scrapper
http
crawler
data-mining
https
proxy
socks
socks5
proxies
rotating-proxy
proxypool
proxy-list
crawlers
scrapper
socks4
web-scrapper
web-scrapping
freeproxy
free-proxies
freeproxylist
proxyscrape
-
Updated
Apr 3, 2021 - Python
Text Generation using Markov Chains fed by 4chan APIs
-
Updated
Aug 25, 2018 - Go
This is small project it provide many good api for search ,scrapping ,trending
-
Updated
Jul 4, 2020 - JavaScript
Scrape Algorithm Questions from leetcode and generate html and epub file
scraper
leetcode
scraping
scrapper
scraping-websites
leetcode-questions
leetcode-downloader
leetcode-problems-solutions
leetcode-scrapper
download-leetcode
leetcode-offline
leetcode-pdf
leetcode-epub
leetcode-download
leetcode-save
-
Updated
Mar 1, 2020 - Python
Download de livros para PDF/EPUB - Integrada.minhabiblioteca / vitalsource
electron
nodejs
javascript
pdf
promises
crawler
university
download
convert
scrapper
vitarsource
minhabiblioteca
-
Updated
Feb 21, 2018 - JavaScript
Improve this page
Add a description, image, and links to the scrapper topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the scrapper topic, visit your repo's landing page and select "manage topics."
The idea is to have an option like 3 (Do a Google search, save the Urls found and search the emails), but search a list of phrases.
This list can be in a .txt
The option can ask for number of search results in Google