Discussions: apify/crawlee

Discussions

• 1 You must be logged in to vote

  💬

  Is Dataset Map and Reduce methods are same as Hadoops MapReduce ?

  margati started Mar 14, 2023 in General

  

  

  2
• 1 You must be logged in to vote

  🙏

  Why CheerioCrawler parsing doesn't return text() for *some* XML keys?

  charnould asked Feb 19, 2023 in Q&A · Unanswered

  

  

  

  

  12
• 1 You must be logged in to vote

  🙏

  What hook can I use to catch net::ERR_EMPTY_RESPONSE errors?

  dyihoon90 asked Mar 8, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Option to exclude certain resource types

  feature Issues that represent new features or improvements to existing features.

  mbledkowski asked Mar 5, 2023 in Q&A · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  💬

  Automatic proxy selection in concurrent requests

  harvetech started Mar 4, 2023 in General

  

  

  1
• 0 You must be logged in to vote

  📝

  docs/examples/playwright-crawler

  giscus bot announced Feb 25, 2023 in Comments

  

  

  1
• 1 You must be logged in to vote

  🙏

  vscode stopped displaying suggestions for page instances

  matrs asked Feb 24, 2023 in Q&A · Answered

  

  

  1
• 0 You must be logged in to vote

  📝

  docs/introduction/setting-up

  giscus bot announced Aug 16, 2022 in Comments

  

  

  

  

  13
• 1 You must be logged in to vote

  💡

  Enrich response handling with POM (Page Object Model)

  WebStrider started Dec 1, 2022 in Ideas

  

  

  1
• 1 You must be logged in to vote

  💬

  How to ignore certain error code?

  mbledkowski started Feb 19, 2023 in General

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  How to re-run - later - 403 responses?

  charnould asked Feb 10, 2023 in Q&A · Answered

  

  

  2
• 0 You must be logged in to vote

  📝

  docs/introduction/saving-data

  giscus bot announced Aug 24, 2022 in Comments

  

  

  3
• 0 You must be logged in to vote

  📝

  docs/guides/scaling-crawlers

  giscus bot announced Aug 28, 2022 in Comments

  

  

  

  

  12
• 1 You must be logged in to vote

  🙏

  Error: connect ECONNREFUSED 0.0.0.0:443

  bug

  5idu asked Aug 29, 2022 in Q&A · Unanswered

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  How to download data from docker, finished scrapped pages?

  pixelkoduje asked Feb 11, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Stop keepAlive crawler after all requests are finished

  uiii asked Feb 5, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  purgeDefaultStorages() doesn't work with express

  soupman99 started Dec 6, 2022 in General

  

  

  

  

  20
• 0 You must be logged in to vote

  📝

  docs/examples/add-data-to-dataset

  giscus bot announced Oct 24, 2022 in Comments

  

  

  2
• 1 You must be logged in to vote

  🙏

  Cannot pass gotoOptions to page.goto()

  bug

  matjaeck asked Oct 26, 2022 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  In PlaywrightCrawler.failedRequestHandler() the error argument contains no information about error

  bug

  stargazer33 asked Jan 25, 2023 in Q&A · Answered

  

  

  2
• 2 You must be logged in to vote

  🙏

  Puppeteer extra usage with crawlee

  nikigan asked Jan 25, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Request without proxy when proxy is set

  galaczi started Oct 25, 2022 in General

  

  

  

  

  18
• 3 You must be logged in to vote

  💡

  Add ability to crawl a single URL with any type of crawler

  nikosson started Nov 18, 2022 in Ideas

  

  

  

  

  2
• 2 You must be logged in to vote

  🙏

  Can I pass custom parameters in the addRequest so that I can use in the router-hander callback function?

  ParadiseWitch asked Nov 23, 2022 in Q&A · Answered

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  How to disable storage directory creation?

  astsu-dev asked Jan 18, 2023 in Q&A · Answered

  

  

  1