Skip to content

/ node-crawler

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

28 Open 249 Closed
28 Open 249 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels.
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀
Some requests (stream based) never ends and block the queue
#371 opened Dec 20, 2020 by Verhov
3
Returning data from callback
#370 opened Dec 16, 2020 by Anan5a
1
recursive example
#369 opened Dec 12, 2020 by mariusa
2
jsdom.env is not defined
#366 opened Nov 13, 2020 by raphaelsoul
1
Documentation unclear; CRAWLER Error Error: incorrect header check when fetching
#365 opened Oct 26, 2020 by pate313373
node-crawler.org: use HTTPS
#362 opened Oct 1, 2020 by pzmarzly
1
Add support for use a list of proxy
#358 opened Jul 29, 2020 by rafamarts
1
Consideration to ditch Request dependency?
#350 opened May 17, 2020 by sbr2567
1
Crawl error causes skipDuplicates to be set to false
#345 opened May 2, 2020 by villesau
1
Way to add wait handle
#344 opened Apr 10, 2020 by jaekunchoi
1
CRAWLER Error Error: tunneling socket could not be established
#342 opened Mar 13, 2020 by seven-ex
1
Uncatchable error
#339 opened Jan 27, 2020 by StefanoBichicchi
3
whether supports promise feature?
#332 opened Nov 19, 2019 by tiny09
3
tolerance for unknown/ bad charsets
#320 opened Aug 1, 2019 by cybergaukler
1
Integrate with ProxyCrawl crawler
#316 opened Jun 14, 2019 by rochenka
How can I use Crawler if the website has Cloudflare 5 seconds check ? Question
#308 opened Mar 26, 2019 by NewT74
6
How to disable injectableTypes filter ? Optimization
#299 opened Jan 9, 2019 by ayqy
5
Typescript and types Feature
#297 opened Dec 13, 2018 by chris74a
14
Passing a crt with the proxy Unclear
#295 opened Nov 26, 2018 by kieranheadley
1
Add ciphers into request options
#290 opened Sep 15, 2018 by nmhung109
1
Promise please Feature
#249 opened Dec 7, 2017 by lwyj123
14
pause / resume? Feature Question
#217 opened Jun 7, 2017 by petkovic43
Update documentation to reflect that node-crawler is based on request Documentation
#115 opened Sep 23, 2014 by ghost
JavaScript support or integration of Zombie Feature
#103 opened Jul 23, 2014 by func0der
14
Catch an error: "invalid markup" Feature
#94 opened Mar 29, 2014 by yhostc
1
ProTip! Mix and match filters to narrow down what you’re looking for.