Just wondering why elasticsearch still use that simple routing value approach for deciding which shard the data must be stored to. Actually this approach is limiting us to change the number of shards in the future. If elasticsearch uses an approach like consistent hashing (or even better technique), it can give us a chance to change the shard number in the future. Anyone have explanation or idea about this?
Why does elasticsearch still use simple routing value using modulo?
1k views Asked by indraep At
1
There are 1 answers
Related Questions in ELASTICSEARCH
- How does Elasticsearch do attribute filtering during knn (vector-based) retrieval?
- Elastic python to extract last 1hr tracing
- Elastic search not giving result when Hyphen is used in search text
- FluentD / Fluent-Bit: Concatenate multiple lines of log files and generate one JSON record for all key-value from each line
- Elasticsearch functional_score with parameter of type string array as input not working
- Elasticsearch - cascading http inputs from Airflow API
- AWS Opensearch - Restore snapshot - Failed to parse object: unknown field [uuid] found
- cluster block exception for system index of kibana
- What settings are best for elasticsearch query to find full word and half word
- OpenSearch - Bulk inserting Million rows from Pandas dataframe
- unable access to kibana
- PySpark elastic load fail with error SparkContext is stopping with exitCode 0
- How to use query combined to KNN with ElasticSearch?
- Facing logstash compatibility issues
- If the same document is ingested at two different times, how to have the same id in Elasticsearch
Related Questions in SHARDING
- Problems encountered when using _shard_num when querying clickhouse shard sets
- Horizontal scaling strategy with 10,000 shards
- MongoDB movePrimary doesn't work when the primary shard is down
- Assigning a dedicated Primary node for write operations in MongoDB replica set
- Why does Elastic search limit the maximum shard number to 1k per node?
- citus add node --> "fe_sendauth: no password supplied" error
- MongoDB Shard Cluster
- How to select the shard key
- When querying a sharded collection, can I filter on shard keys using an operator?
- How to specify region for shards in MongoDB Atlas. Also how to appropriately set 2 shard for a cluster
- akka.cluster.ddata.Replicator$Internal$DeltaPropagation message from clusterReceptionist replicator is dropped because it exceeds the size limit
- Make shard processes use the same pool
- discord.js v14: how to see the number of pending messages in shards
- Total number of docs on a shard in solr
- sharding-jdbc Forced routing failed
Related Questions in CONSISTENT-HASHING
- How to use consistent hashing across publishers, queues, and consumers
- Is there a design pattern to handle the scaling up/down of an RMQ consumer app consuming messages from queues bound to a consistent hash exchange
- Applying modulo function on MD5 hash
- How cassandra guarantees that a key goes to different nodes when building the different ring nodes?
- What is the lookup time complexity of Consistent Hashing Design?
- Why consistent hashing is better in handing hotspots than simple hashing?
- How to combine sharding and consistent hashing within a distributed system?
- DynamoDB What are coordinator nodes in context of replication?
- Akka Consistent-hashing routing
- consistent hashing where you want a key mapped to multiple servers
- Does a Cassandra node get assigned a new token every time it restarts?
- Using custom hash function with HAProxy LoadBalancer
- Can Rendezvous hashing add a node efficiently?
- How to use consistent hashing to allocate multiple servers for the same key?
- Can I use routing key for binding to exchange when using RabbitMQ consistent hashing?
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
As of Elasticsearch release 6.1.0, index splitting is possible. See release note: https://www.elastic.co/blog/elasticsearch-6-1-0-released.
The Split Index documentation actually explains why Elasticsearch doesn't use Consistent Hashing in more detail.