Key Findings
Panasonic Holdings, Panasonic R&D Company of America (PRDCA), and researchers from UC Berkeley, NVIDIA, Stanford University, Roma La Sapienza University, and ItalAI have developed “Tactile-Reactive Dexterous Manipulation” (T-Rex). This AI enables robots to perform complex bimanual operations by responding in real-time to fingertip tactile sensations. In evaluations involving 12 types of tasks requiring delicate force control and the handling of soft objects, T-Rex achieved an average success rate of 65%, which is 30 percentage points higher than existing methods.
Technical Details
T-Rex integrates tactile information into a Vision-Language-Action (VLA) model, which generates robot movements based on visual and linguistic inputs. The architecture combines two distinct processing speeds to ensure precision:
- Action Generation Module: Operates at approximately 5Hz, utilizing vision and language to create the general framework of the movement.
- Action Correction Module: Operates at approximately 20Hz, processing tactile data to capture contact states and perform high-speed, real-time corrections.
The model was trained on a dataset consisting of over 100 hours of bimanual robot operation data, comprising more than 7,700 instances. This dataset combined 22 basic movements with over 200 types of daily necessities. Recorded data includes synchronized natural language instructions, robot states, footage from head and wrist cameras, and force/deformation data from 10 fingertip tactile sensors.
Background & Context
The research findings are scheduled for presentation at the Conference on Robot Learning (CoRL), an international conference on robot learning held in Austin, USA, from November 9 to 12.
Significance & Outlook
Panasonic intends to apply this technology to industrial environments where precise force adjustment and contact-state monitoring are critical. Target applications include the insertion, removal, and tightening of parts in manufacturing, as well as the handling of fragile or flexible items in logistics. The goal is to reduce the burden on human workers and mitigate labor shortages by automating these high-precision tasks.
Source: https://ai.watch.impress.co.jp/docs/news/2153977.html
Get our weekly technology intelligence — free
Receive an infographic that lets you judge at a glance whether each field’s analysis report is worth reading.
Subscribe Free — Weekly Tech Intelligence
By subscribing, you’ll receive Troy-Technical’s weekly technology intelligence newsletter.
- Your email and selected fields are used only to deliver the newsletter.
- We never share your information with third parties.
- You can unsubscribe anytime via the link in each email.
See our Privacy Policy for details.
Takes about a minute · Unsubscribe anytime
