Skip to content

/ node-crawler

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

21 Open 245 Closed
21 Open 245 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels.
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀
Consideration to ditch Request dependency?
#350 opened May 17, 2020 by sbr2567
1
Crawl error causes skipDuplicates to be set to false
#345 opened May 2, 2020 by villesau
1
Way to add wait handle
#344 opened Apr 10, 2020 by hybmg57
1
CRAWLER Error Error: tunneling socket could not be established
#342 opened Mar 13, 2020 by seven-ex
1
Uncatchable error
#339 opened Jan 27, 2020 by StefanoBichicchi
1
whether supports promise feature?
#332 opened Nov 19, 2019 by tiny09
3
tolerance for unknown/ bad charsets
#320 opened Aug 1, 2019 by cybergaukler
1
Integrate with ProxyCrawl crawler
#316 opened Jun 14, 2019 by rochenka
How can I use Crawler if the website has Cloudflare 5 seconds check ? Question
#308 opened Mar 26, 2019 by NewT74
6
How to disable injectableTypes filter ? Optimization
#299 opened Jan 9, 2019 by ayqy
5
Typescript and types Feature
#297 opened Dec 13, 2018 by chris74a
13
Passing a crt with the proxy Unclear
#295 opened Nov 26, 2018 by kieranheadley
1
Add ciphers into request options
#290 opened Sep 15, 2018 by nmhung109
1
Promise please Feature
#249 opened Dec 7, 2017 by lwyj123
14
pause / resume? Feature Question
#217 opened Jun 7, 2017 by petkovic43
Update documentation to reflect that node-crawler is based on request Documentation
#115 opened Sep 23, 2014 by ghost
JavaScript support or integration of Zombie Feature
#103 opened Jul 23, 2014 by func0der
14
Catch an error: "invalid markup" Feature
#94 opened Mar 29, 2014 by yhostc
1
A way to set maximum number of links to follow Feature
#57 opened Jun 6, 2013 by geekyme
1
robots.txt awareness Feature
#35 opened Dec 9, 2012 by reezer
9
Pluggable cache Feature
#33 opened Dec 8, 2012 by sylvinus
7
ProTip! Exclude everything labeled bug with -label:bug.
You can’t perform that action at this time.