Skip to content
#

scrape

Here are 216 public repositories matching this topic...

pielco11
pielco11 commented Aug 14, 2019

The mapping that I use follows the documentation. We have a list of nested JSON objects

It's an issue in the ELK stack, not Twint. Workarounds/solutions are welcome.

What we can do

  • index the list of objects
  • read them in the documents
  • search for documents via Console or REST API (thanks to ieosint for spotting this out)

What we can't do

  • search for documents in Kibana's sear
paras55
paras55 commented Feb 16, 2020

when run with following code :
with MyConnectionScraper(cookie='AQEDAS9oddoAec7fAAABcD_bsSwAAAFwY-g1LFEAR5RwykzJFoxZQ1ZjaMH2vcXgsasLMFb0GwyGbqgh_guqW-K122YvSwg2_zhDnX_gbpdXrYjPqY5Mq9U2o3KmrfQCYbImYSAmUOTVDuPpUoBPkS') as scraper:
connections=scraper.scrape()
people=connections.to_dict()

no such element: Unable to locate element: {"method":"css selector","selector":".mn-connections > h

dan-at-unkubed
dan-at-unkubed commented Nov 22, 2017

I'm pretty impressed with what you have here. However, I've noticed that the new "Featured Snippets" for all search results are being included as the Rank #1 serp (via the provided getOnPagePosition method). There should instead be a custom method for determining whether a Classical result is actually a Featured Snippet (I'm currently seeing this as a Rank #0 result across the web, and the featu

xuebofan
xuebofan commented Jan 14, 2020

Hi, I've been using the library for several month, and since about one month ago I frequently encounter this problem and have to rerun the code and ignore certain posts. Please help to fix this. Thanks!

`Traceback (most recent call last):
File "", line 1, in
File "/data/imgur/scraper.py", line 331, in autoscrape
for post in get_viral_posts_from(date=day):
File "/

Improve this page

Add a description, image, and links to the scrape topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the scrape topic, visit your repo's landing page and select "manage topics."

Learn more

You can’t perform that action at this time.