Can you help me with how to Archive data in Elastic search. That I don't know what is curator and data shrink. I am fresher to elastic search. from where I have to start studying and what all things I have to do.
Data Archival in Elastic Search
900 views Asked by Nikhil Ray At
2
There are 2 answers
0
warkolm
On
you need to look at using ILM for this, it's the replacement for curator and will handle it much cleaner
Related Questions in ELASTICSEARCH
- How does Elasticsearch do attribute filtering during knn (vector-based) retrieval?
- Elastic python to extract last 1hr tracing
- Elastic search not giving result when Hyphen is used in search text
- FluentD / Fluent-Bit: Concatenate multiple lines of log files and generate one JSON record for all key-value from each line
- Elasticsearch functional_score with parameter of type string array as input not working
- Elasticsearch - cascading http inputs from Airflow API
- AWS Opensearch - Restore snapshot - Failed to parse object: unknown field [uuid] found
- cluster block exception for system index of kibana
- What settings are best for elasticsearch query to find full word and half word
- OpenSearch - Bulk inserting Million rows from Pandas dataframe
- unable access to kibana
- PySpark elastic load fail with error SparkContext is stopping with exitCode 0
- How to use query combined to KNN with ElasticSearch?
- Facing logstash compatibility issues
- If the same document is ingested at two different times, how to have the same id in Elasticsearch
Related Questions in ARCHIVE
- nodejs stream s3 objects to an archive
- thunderbird local archive folder missing
- Xcode's archive validation error "Missing Info.plist value" for a "Hello world" project
- .gz archive have the content-type identified wrong?
- flutter/.pub-cache/hosted/pub.dartlang.org/shared_preferences_ios-2.1.1/ios/Classes/FLTSharedPreferencesPlugin.h: No such file or directory
- Archiving folders that contain subfolders with files that are past a certain date
- Could not install [App] The requested app is not available or doesn't exist. in closed trials
- "Hadoop archive -archiveName directoryname.har -p /source/hdfs/path /destination/hdfs/path" doesn't work via spark-submit but working in spark-shell
- Unable to change run order of pre_get_posts hook in between two plugins
- Widget "Archive Posts" doesn't pull posts on the homepage
- Compiling fortran program with archive library results in undefined reference state
- Extract specific folders from tar.gz archive
- Archive error: "Command PhaseScriptExecution failed with a nonzero exit code" xcode 13.4
- using a .dat archive in python tkinter
- Success run iOS App, but got failed when archive to upload in App Store
Related Questions in ELASTICSEARCH-CURATOR
- Elasticsearch curator deletes the whole index rather than deleting logs of 6 days
- Elasticsearch-curator - Daily jobs running from unknown source
- Run ElasticSearch Curator with ApiKey auth - is it possible?
- Data Archival in Elastic Search
- How can I put inside a curator project a suggester field (ElasticSearch)
- Does Elasticsearch curator Rollover action doesn't support Date math in the name?
- Why is Elasticsearch-curator `create_index` dry-run successful but then actual run isn't?
- Schema error: expected dict for dictionary value @ data['actions'] in curator
- Curator not deleting older index
- how to set correct timestring in metricbeat index?
- Elasticsearch delete documents from index
- Difference between curator-cli and curator action files
- Is it possible to take snapshot and restore with elasticsearch-curator without loosing the updates in the destination index?
- Elasticsearch curator delete the whole index instead of older documents
- Curator is not cleaning expired indices which come from CloudWatch
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Popular Tags
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Elastic search is an fulltext index. You can use this technology to index some data to get fast an powerful access to you data.
But, it's an index.
I don't think, elastic search is the right place to archive data. Especially not if the archive is to fulfill certain archival standards. You can archive your data somewhere else and use elastic search to search over your archived data.
If I were you, I would use a specialized tool for storing and archiving data and index this data with Elasticsearch for powerful search.