I am using Python 3.9.
I have two files, a VRM model and an FBX animation. I want to animate the VRM model using the FBX animation in Python so that I can both display a preview in a GUI and stream the results to a virtual camera using pyvirtualcam.
I have tried using the library Pyrender but since VRMs have extra important information (like the MToon Shader) it has either produced a render with holes in the textures and geometery.
I have found that Pixiv has an official expansion for Three.js but since my project is in Python that doesn't quite seem to work for me. That sucks considering it seems to manage the rendering perfectly.
There is also a library for Swift but again, it's not Python.
I have also managed to extract the extra data from the model using pygltflib but I lack the knowledge to do anything with it.
I am very inexperienced with 3D rendering so I apologise in advance. Any knowledge or ideas about how I could achieve this would be greatly appreciated.