Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upAdd Streaming to Crawlbot #5
Open
Assignees
Labels
Comments
|
Client no longer depends on Guzzle. Makes it more versatile and flexible, but brings streams into questions perhaps. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
A crawlbot's job constantly enhances the resultset with new data. Ergo, when fetching the resultset, it's always different unless the job is done or paused.
Since the library depends on Guzzle, perhaps consider using streams?
To keep in mind: stopping the stream if job is paused. Would require re-checking job status? Open for discussion.