Current flow of the project that I'm working on involves pushing to a local kafka using ruby-kafka gem.
Now the need arose to add producer for the remote kafka, and duplicate also messages there.
And I'm looking for a better way, than calling Kafka.new(...) twice...
Could you please help me, and do you happen to have any ideas?
ruby-kafka: is it possible to publish to two kafka instances at the same time
165 views Asked by Elmor At
1
There are 1 answers
Related Questions in RUBY
- how to integrate cashfree payment gateway in ruby on rails project
- RSpec Capybara throwing Selenium error when trying to click a button with browser confirm
- Duplicate GET requests - Rails & Heroku
- convert csv file with json data inside to a column, rows table in 2nd csv file
- Installing dependencies from a gemspec file
- Verifying Google Identity OAuth2 token with Ruby
- Java code of AES/GCM/NoPadding encryption algorithm with authentication tag
- How to fix error in model with gem lockbox
- Cannot install Ruby Gem on Window
- use logstash filter ,aes gcm encrypted in ruby,but cannot decrypted in java
- In Rails 7, what is the right ActiveRecord callback to use if I need to prevent (or rollback) persistance on error?
- How can I go through an array and still remove elements from it
- Nokogiri only returning 5 results
- How do I get the fullscreen mode in firefox?
- undefined group option when using branch reset group regex in Ruby
Related Questions in APACHE-KAFKA
- No method found for class java.lang.String in Kafka
- How to create beans of the same class for multiple template parameters in Spring
- Troubleshoot .readStream function not working in kafka-spark streaming (pyspark in colab notebook)
- Handling and ignore UNKNOWN_TOPIC_OR_PARTITION error in Kafka Streams
- Connect Apache Flink with Apache kudu as sink using Pyflink
- Embedded Kafka Failed to Start After Spring Starter Parent Version 3.1.10
- Producer Batching Service Bus Vs Kafka
- How to create a docker composer environment where containers can communicate each other?
- Springboot Kafka Consumer unable to maintain connect to kafka cluster brokers
- Kafka integration between two micro service which can respond back to the same function initiated the request
- Configuring Apache Spark's MemoryStream to simulate Kafka stream
- Opentelemetry Surpresses Kafka Produce Message Java
- Kafka: java.lang.NoClassDefFoundError: Could not initialize class org.apache.logging.log4j.core.appender.mom.kafka.KafkaManager
- MassTransit Kafka producers configure to send several events to the same Kafka topic
- NoClassDefFoundError when running JAR file with Apache Kafka dependencies
Related Questions in KAFKA-PRODUCER-API
- Latest Stable offset in Kafka
- Testing Kafka Producer and Consumer
- Kafka Producer is not retrying in Spring Boot Application
- Produce json message with headers via kafka CLI
- AWS MSK Transactions Support
- Kafka data loss
- ruby-kafka idle timeout handler to call deliver_messages
- Spring Cloud Stream Binder Kafka: Cannot perform operation after producer has been closed
- Topic not present in metadata after 60000ms
- Producer Issues -- Apache Kafka, Docker, Python
- kafka - how to check if cluster is not able to receive all the data being sent by producer
- Kafka producer SASL PLAIN Security problems
- kafka-avro-producer throws ClassCastException when serializing timestamp-millis values
- Kafka client with Kerberos Node -1 disconnected
- Kafka producer client is not able to connect to schema registry
Related Questions in RUBY-KAFKA
- ruby-kafka idle timeout handler to call deliver_messages
- Phobos/Ruby-Kafka API call timeout configuration?
- How to produce data to Kafka from Ruby using sync mode with ack=1 or ack=all
- what is connection_builder in ruby-kafka gem?
- Long delays between processing of two consecutive kafka batches (using ruby/karafka consumer)
- Difference between Kafka async and Kafka sync acks=0?
- Wait until value appears in the hash
- Ruby-kafka Read all messages topic and exit
- Racecar not consuming messages written by DeliveryBoy (kafka-ruby)
- How to efficiently use Kafka in place of Sidekiq for background Job in Rails?
- How to check to see if Ruby-Kafka retries works?
- ruby-kafka: is it possible to publish to two kafka instances at the same time
- Kafka producer says "unknown_topic_or_partition"
- could not connect to any of the seed brokers
- Ruby Kafka Uncaught exception: Failed to find group coordinator
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Popular Tags
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Another approach to consider would be writing the data once from your application, and then asynchronously replicating the message from one Kafka cluster to another. There are multiple ways of doing this including Apache Kafka's MirrorMaker, Confluent's Replicator, Uber's uReplicator etc.
Disclaimer: I work for Confluent.