Mediapipe with URScript

Im trying to use mediapipe pose to get the angles of my elbow shoulder and wrist to control the elbow shoulder and wrist 1 of the UR robot. After testing with offline data(non-real-time), the robot arm doesn’t move to the desired location(not similar to my arm). Any tips as to why this is happening?

Do you have more information to share about this?
What is the expected behaviour of the robot and what is it doing instead?