I need to consume a stream from Jetstream by batch and store bulk in database with acknowledgment after database bulk insert. At this time I use pull consumer, store all messages and commit 1 by 1 on successful bulk insert. Do I need to ack all messages? I saw that I can commit the latest message but for this I need to be in consumer push mode.
whats the best way to consume and commit by batch with NATS Jetstream
1.5k views Asked by erich At
1
There are 1 answers
Related Questions in NATS.IO
- How can I extract the bounds of a bitmap in a canvas from the values in the transformation matrix?
- Rotating a Cube using Quaternions in PyOpenGL
- CTM transforms vs Affine Transforms in iOS (for translate, rotate, scale)
- How to XSLT transform XML nested attribute elements and concatenate name
- Rotation of object with point on object
- Transforming irregular data into usable format in R
- How can I transform XML to HTML using XSL with Java Transformer class
- XQuery XML insert
- QGraphicsItem setShear ? (applicable for single or multiple items)
- Matrix Transformation in R - from aggregate output to outer-like matrix
Related Questions in NATS-JETSTREAM
- How can I extract the bounds of a bitmap in a canvas from the values in the transformation matrix?
- Rotating a Cube using Quaternions in PyOpenGL
- CTM transforms vs Affine Transforms in iOS (for translate, rotate, scale)
- How to XSLT transform XML nested attribute elements and concatenate name
- Rotation of object with point on object
- Transforming irregular data into usable format in R
- How can I transform XML to HTML using XSL with Java Transformer class
- XQuery XML insert
- QGraphicsItem setShear ? (applicable for single or multiple items)
- Matrix Transformation in R - from aggregate output to outer-like matrix
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Popular Tags
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
ConsumerConfiguration.AckWaitis probably what you need.For pull mode, it is required that you ack every message. You could set the
AckWaitto a longer duration, which should give you enough time to make sure your bulk store works and then go back and individually ack the messages.If you use push mode, you could use
AckPolicy.Alland set theAckWaitlonger also. You can then read messages in push mode, (which looks like one message at a time, but the server has actually pushed many messages to the client and the client is buffering them.) Once you've collected the number of messages you want to write to the database, you can write them in bulk, then you can ack the last message when you know the database write has succeeded.