0
Measuring Robot Data Diversity: Insights from 20,000 Hours of Real-World Data
https://labs.scale.com/blog/measuring-robot-data-diversity(labs.scale.com)A 20,000-hour dataset of real-world robot teleoperation data is analyzed to measure its diversity across four axes: task, object, action, and environment. The analysis reveals long-tail distributions for each axis, with objects demonstrating the highest variety and longest tail. Using embeddings from various AI models, it was found that vision-only models tend to capture the overall scene rather than the specific action being performed. In contrast, a vision-language-action model proved more effective at keeping the action distinct in its embedding space, highlighting the importance of multimodal inputs. This understanding of how models perceive data is presented as a critical step toward building robotics foundation models.
0 points•by hdt•2 hours ago
Comments (0)
No comments yet. Be the first to comment!
Have an account? Log in to join the discussion.