I'd like to know which one is better for below:
- Using one notebook:
- Notebook A: Read from Kafka Topic A, writing to Delta B, C after conditional filtering
- Using multiple notebooks:
- Notebook B: Read from Kafka Topic A, writing to Delta B after conditional filtering
- Notebook C: Read from Kafka Topic A, writing to Delta C after conditional filtering
When I tried in my end, it didn't look so different. Anyone can explain which one is better and what could be best practices when you have many Kafka topics to ingest? Is it better to have one notebook per topic and one notebook per delta table?