I'm thinking of a program in python that can acquire 3D data. When converting a depth image to point cloud data, there are inevitably some missing parts. I think it is possible to convert it to mesh data as it is, but in order to improve the accuracy, it may be necessary to interpolate the missing data. I thought that it is necessary to interpolate the missing data to improve the accuracy of the conversion.
What I don't understand
What kind of algorithm or libraries should I use to interpolate the missing parts of the above image in python?
I have been looking into various literature myself, but I would appreciate it if someone could help me out. Thank you in advance.