Check whether user is going towards POI or going away from POI android - Google Directions or Maps API

Question

I wanna check whether User is driving towards to specific POI or User is going away from POI. The scenario is as per below image :

SO how can I track the user's specific direction? Is it possible using Google Directions or Google MAPs API or any other API? Or Can we do any mathematical calculations to achieve this?

Thanks,