I'm copying a csv file to Redshift which may come with column values with comma between them. Since the delimiter is ',' Redshift may misunderstand those extra commas which gives rise to extra columns. How to effectively handle this common problem?

Eg:

User,Password

Mike,play!tLoud

Chris,hello*,.!all

As you can see in the second row, we can see an extra comma in the password column. I want to simply log this error to a custom errors table, because this kind of error, I do not think gets logged to the system stl_load_errors table. How to handle this situation?

0 Answers