However limitations of Python prevent us from going all the way as we are unable to deterministic builds or ship it with Bitcoin Core.

aren't there projects reimplementing the Python language for verifiable compilation and embedded targets? then folks only need worry about silly things like making sure the correct library functions are linked...