Skip to content

Latest commit

 

History

History
41 lines (26 loc) · 5 KB

Vision_Tactile_Manipulation.md

File metadata and controls

41 lines (26 loc) · 5 KB

Vision Tactile Manipulation

Grasping and Manipulation

  • LeTac-MPC: Learning Model Predictive Control for Tactile-reactive Grasping, T-RO 2024. [Paper] [Code] [Video] [Yu She, Purdue University]

  • Tac-Man: Tactile-Informed Prior-Free Manipulation of Articulated Objects, T-RO 2024. [Paper] [Website] [Code]

  • VITaL Pretraining: Visuo-Tactile Pretraining for Tactile and Non-Tactile Manipulation Policies, arXiv 2024. [Paper] [Website] [Code]

  • simPLE: a visuotactile method learned in simulation to precisely pick, localize, regrasp, and place objects, Science Robotics 2024. [Paper] [Website] [MCube Lab, MIT]

  • RoboPack: Learning Tactile-Informed Dynamics Models for Dense Packing, RSS 2024. [Paper] [Website]

  • 3D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensing, CoRL 2024. [Paper] [Website]

  • Visual–Tactile Fusion for Transparent Object Grasping in Complex Backgrounds, T-RO 2023. [Paper] [Website] [Code]

  • Touch2Touch: Cross-Modal Tactile Generation for Object Manipulation, arXiv 2024. [Paper] [Website] [Code]

Representation and Perception

  • TaRF: Tactile-Augmented Radiance Fields, CVPR 2024. [Paper] [Website] [Code]

  • Tactile DreamFusion: Exploiting Tactile Sensing for 3D Generation, NeurIPS 2024. [Paper] [Website] [Code]

  • Binding Touch to Everything: Learning Unified Multimodal Tactile Representations, CVPR 2024. [Paper] [Website] [Code]

  • TVL: Rethinking Patch Dependence for Masked Autoencoders, ICML 2024 (Oral). [Paper] [Website] [Code]

  • CTTP: Contrastive Touch-to-Touch Pretraining, arXiv 2024. [Paper] [Website] [Code]

  • T3: Transferable Tactile Transformers for Representation Learning Across Diverse Sensors and Tasks, CoRL 2024. [Paper] [Website] [Code]

  • UniT: Unified Tactile Representation for Robot Learning, arXiv 2024. [Paper] [Website] [Code] [Yu She, Purdue University]

  • 🔥 Sparsh: Self-supervised touch representations for vision-based tactile sensing, CoRL 2024. [Paper] [Website] [Code] AI at Meta, FAIR

  • FeelAnyForce: Estimating Contact Force Feedback from Tactile Sensation for Vision-Based Tactile Sensors, arXiv 2024. [Paper] [Website]

  • iFEM2.0: Dense 3D Contact Force Field Reconstruction and Assessment for Vision-Based Tactile Sensors, TRO 2024. [Paper]

  • 🔥 Octopi: Object Property Reasoning with Large Tactile-Language Models, RSS 2024. [Paper] [Code]

  • NeuralFeels with neural fields: Visuotactile perception for in-hand manipulation, Science Robotics 2024. [Paper] [Website] [Code] [CMU]