Collaborative Reference Frames For Assistive Robotics

Using Meta Glasses vision stream combined with an actuator camera to build corrective prompts for a VLA. Ran the end-effector using smolVLA and inputs from cameras on the endeffector/manipulator and smart Meta glasses, as well as voice input from the glasses. Used the feedback loop to adjust the prompt and improve the action accuracy. Future work would be to use more of DeepSeek's PPO algorithm to improve the policy for tasks