How often do I need to run full reindex on SolrCloud? It takes more than 12 hours for full reindex to run and we run it every night but is it really necessary to do it as delta runs correctly. New data comes in at the rate of 2000 documents on every delta per 30 seconds. Total index size : 20GB Solr: 6.5.2
Related Questions in SOLR
- Developing a search and tag heavy website
- How can I integrate Solr5.1.0 with Nutch1.10
- Solr ping taking time during full import
- Indexed data is not displaying on storefront
- Heap size issue on migrating from Solr 5.0.0 to Solr 5.1.0
- Monolithic ETL to distributed/scalable solution and OLAP cube to Elasticsearch/Solr
- Exact word not boosting much Solr
- Solr stopped with Error opening new searcher at org.apache.solr.core
- Data import in solr from multiple entities
- solr reindexing issue for EdgeNgramFilter
Related Questions in SOLRCLOUD
- Solr custom UpdateRequestProcessorFactory fails with "Error Instantiating UpdateRequestProcessorFactory"
- How to manage very large Solr indexes
- solrcloud - choosing cores for update and search requests
- How to add a node to SolrCloud dynamically without SPLITSHARD?
- Unable to Upload Solr Configuration to ZooKeeper
- Solrcloud & data import handler
- SolrCloud index empty after a successful document submission
- SolrCloud: Unable to Create Collection, Locking Issues
- How do I deal with excessive CLOSE_WAIT which are clogging up Solr
- Why are Solr's logs time series stored in different collections based on time instead of different shards based on time
Related Questions in REINDEX
- Reindex a dataframe with duplicate index values
- Magento reindex via script does nothing
- In python pandas, how can I re-sample and interpolate a DataFrame?
- Magento 2.1 re-indexing issue
- Magento reindex url_rewrite is not working anymore
- How to drop datapoints from index
- Magento - Unable to reindex Product Prices - Foreign Key Constraint Fails
- Extracting index from a dataframe and appening to another dataframe
- Elasticsearch reindex API - Not able to reindex large number of documents
- Can i continuous to reindex the process after Elastic search reindex socket timeout
Related Questions in SOLR6
- Select query for search with 2 or more words without double quotes in solr
- How do I import a mySQL database table into Solr 6?
- SolrClient is Working in browser, Not working in terminal Ubuntu 16.04
- SQL Equivalence of Solr Query
- Select query for search with 2 or more words without double quotes against more than one field in solr
- Solr6 fails to add a core, shows following error
- Solr - Suggest Component with 2 different field types
- Searching other fields with Solr hon-lucene-synonyms plugin?
- Solr spellchecking nor returning results for indexes larger than 10k items
- Solr Query for Multiple value data
Related Questions in DELTA-INDEX
- At the time of updating sphinx indexes the load average increase
- cannot get anything from dataimporter.request on updating index
- How can I temporarily disable delta indexing with Thinking Sphinx?
- return the first element with a difference from two lists of lists and stop to compare
- Partition data while writing to delta sink
- Frequency of Full reindex on SolrCloud
- Solr Delta Import
- Solr delta-import across multiple databases
- Solr capacity to handle delta import frequency
- Delta Indexing by timestamp in Sphinx
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Popular Tags
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
If delta runs correctly, there should be no need to run a reindex at all. The exception might be if you do not have disabled any merging while the index is operative; in that case you might end up with a very fragmented index file wise, and the reindex ends up building a complete set as a single index file instead, but isn't usually how Solr is configured, and if it is - it's done for a reason.
So - if your delta is working correctly and you run Solr with fairly standard settings, you can safely skip reindexing unless you're starting over with an empty index (or have a situation where the schema has changed). But be sure that this also includes deletions - a reindex would probably not include deleted elements, so the question then becomes whether your delta import handles deletions as well.
None of our Solr based services reindex at all - everything is done with live updates and a decent merge factor.