I am using Spark to write files to S3 in ORC format. Also using Athena to query this data.
I am using the following partition keys:
Once I execute the Glue crawler to run on the bucket everything works as expected except the types of the partitions keys.
The Crawler configures them in the catalog as
String type instead of
Is there a configuration to define the default type of the partition keys ?
I know it can be changed manually later and set the Crawler config to
Add new columns only.