ProxyGrab
Software to scrap proxies for my web scrapping and other testing purposes.
I made this software to scrap proxies for my web scrapping and other testing purposes. This program just uses aiohttp to get the response from API and return the proxies, also it can scrape proxies from a few sites so that it can be used without using the API.
NOTE: This library isn't designed for production use. It's advised to use your own proxies or purchase a service which provides an API. These are merely free ones that are retrieved from sites and should only be used for development or testing purposes.
Installation
The latest version of proxygrab is available via pip:
pip install --upgrade proxygrabProvided Proxies
| Provider | Proxy Types avaiable | Url |
|---|---|---|
| Proxyscrape | http, https, socks4, socks5 | https://proxyscrape.com/ |
| Proxy-List | http, https, socks4, socks5 | https://www.proxy-list.download/ |
| SSL Proxies | https | https://www.sslproxies.org/ |
| Free Proxy List | http, https | https://free-proxy-list.net/ |
| US Proxies | http, https | https://www.us-proxy.org/ |
| Socks Proxy | socks4, socks5 | https://www.socks-proxy.net/ |
Documentation
Contribuiting
Wanna help and improve this project?
Make sure to follow these before opening a PR:
- Make sure your PR passes the test and is formatted according to pre-commit.
- Make sure the package is working without any issues!
License
This project is licensed under the MIT License - see the LICENSE file for details
Thanks to
- @JaredLGillespie for his proxyscrape library from which I took scrappers!
- Proxy Providers mentioned above
