Skip to content
#

web-crawler

Star

Here are 520 public repositories matching this topic...

Language: All
Filter by language
All 520 Python 232 Java 67 JavaScript 49 Go 35 C# 22 HTML 21 TypeScript 11 Jupyter Notebook 10 PHP 10 Ruby 7
Sort: Best match
Sort options
Best match Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

DigitalPebble / storm-crawler

Star
Open

Add support for shards in SOLR

jnioche
jnioche commented Oct 1, 2018

Just like it's done in ES, we could route the documents in the statusupdaterbolt based on the host / name or IP and in the spouts check that the number of instances is equal to the # of shards and filter the queries per shard accordingly.

At the moment, we can have only one instance of a spout.

https://lucene.apache.org/solr/guide/6_6/shards-and-indexing-data-in-solrcloud.html

Read more
SOLR enhancement good first issue help wanted

Improve this page

Add a description, image, and links to the web-crawler topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the web-crawler topic, visit your repo's landing page and select "manage topics."

Learn more

You can’t perform that action at this time.