I've a glue job that reads from a Kinesis stream and stores the data on a governed table on lake formation.
The issue comes that I have duplicated data. Let's say the user changed is address and now I have two records for the same user when I just want the last one.
How can I achieve this?
Thanks