Which one is faster for querying Athena: pyathena or boto3?

2.6k views Asked by At

Which one is faster pyathena or boto3 to query AWS Athena schemas using python script?

Currently I am using pyathena to query Athena schemas but it's quite slow and I know there is another option of boto3 but before starting need some experts advice.

1

There are 1 answers

0
Chris Williams On BEST ANSWER

Looking at the dependencies for PyAthena you can see that it actually have a dependency of boto3.

Unless PyAthena has added a lot of overhead to its library which is unlikely, the best performance improvements you're likely to see will depend on how you're using Athena itself.

There are many performance improvements you can make, Amazon published a blog named Top 10 Performance Tuning Tips for Amazon Athena which will help to improve the performance of your queries.