Research
My research focuses on robot learning for dexterous manipulation. I aim to enhance robotic capabilities under resource constraints by effectively leveraging diverse data sources and available physical resources.
A key emphasis of my work is extending task horizons, enabling robots to perform long-horizon, multi-stage tasks and multitasking, as well as more delicate behaviors such as nonprehensile manipulation. Ultimately, my goal is to advance robotic manipulation toward human-level dexterity, enabling robots to learn, adapt, and interact with the physical world more effectively.
(* indicates equal contribution, † indicates equal advising)
|
|
ICRA
|
Learning Geometry-Aware Nonprehensile Pushing and Pulling
with Dexterous Hands
,
Yiyang Ling,
Gaurav Sukhatme†,
Daniel Seita†
International Conference on Robotics and Automation (ICRA) 2026
arXiv
/
project page
/
video
/
We propose Geometry-aware Dexterous Pushing and Pulling, a method for
nonprehensile manipulation which frames the problem as
synthesizing and learning pre-contact dexterous hand poses that
lead to effective pushing and pulling.
|
|
CoRL
|
Task-Oriented Hierarchical Object Decomposition for Visuomotor Control
Jianing Qian,
,
Bernadette Bucher,
Dinesh Jayaraman
Conference on Robot Learning (CoRL), 2024
arXiv
/
project page
/
video
/
We propose to train a large combinatorial family of representations organized by scene entities. This hierarchical object decomposition for task-oriented representations permits selectively assembling different representations specific to each task while scaling in representational capacity with the complexity of the scene and the task.
|
|
RSS
|
DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset
DROID Dataset Team
Robotics: Science and Systems (RSS), 2024
arXiv
/
project page
/
video
|
|
ICRA
|
Universal Visual Decomposer: Long-Horizon Manipulation Made Easy
Zichen Zhang*,
*,
Osbert Bastani,
Abhishek Gupta,
Dinesh Jayaraman,
Yecheng Jason Ma†,
Luca Weihs†
LEAP worshop @ CoRL 2023 (Oral, Best paper award)
FMDM worshop @ NeurIPS 2023 (Oral, 6/112)
International Conference on Robotics and Automation (ICRA) 2024 (Best Computer Vision Paper Finalist)
arXiv
/
project page
/
video
/
code
|
|
ICRA
|
Open X-Embodiment: Robotic Learning Datasets and RT-X Models
Open X-Embodiment Team
International Conference on Robotics and Automation (ICRA) 2024 (Best Conference Paper Award)
arXiv
/
project page
/
video
/
code
|
|
CoRL
|
Vision-Based Contact Localization Without Touch or Force Sensing
Leon Kim,
,
Michael Posa,
Dinesh Jayaraman
Conference on Robot Learning (CoRL), 2023
arXiv
/
project page
/
video
/
code
We propose a challenging vision-based extrinsic contact localization task: with only a single RGB-D camera view of a robot workspace, identify when and where an object held by the robot contacts the rest of the environment.
|
|
CMPB
|
PEg TRAnsfer Workflow recognition challenge report: Do multimodal data improve recognition?
Arnaud Huaulmé, Kanako Harada, (et al., including ,
Yonghao Long,
Qi Dou)
Computer Methods and Programs in Biomedicine, 2023
arXiv
This is the report paper on Workflow Recognition Challenge in MICCAI 2021. I lead the MedAIR team and rank the first over all the 5 rank method in one sub-challenge on multi-modal (videos and kinematics) workflow recognition of robotic surgery videos.
|
Service
Mentorship:
Conference reviewer: CoRL
Workshop reviewer: NeurIPS, ICRA, RSS
Teaching Assistant at USC: CSCI 103: Introduction to Programming, Fa25.
Teaching Assistant at UPenn: MEAM 5200: Introduction to Robotics, Sp23; CIS 5200: Machine Learning, Fa23; CIS 5190, Applied Machine Learning, Sp24.
: Instructor in Spring 23 at G.W. Carver High School.
|
Awards
----PhD----
USC Viterbi School of Engineering Fellowship, 2024
USC WiSE Graduate Top-Off Award(10k$), 2024
CoRL 2024 Travel Grant, 2024
----Master----
Best Conference Paper Award ICRA, 2024
UPenn MS Outstanding Research Award, 2024
UPenn President Gutmann Leadership Award, 2023
UPenn Summer Internship Award, 2023
Best Paper Award at CoRL LEAP workshop, 2023
CoRL 2023 Travel Grant, 2023
----Undergrad----
Chiang Chen Overseas Graduate Fellowship (10 students each year in mainland China, 50k$), 2022
Outstanding Graduate of Zhejiang Province issued by Department of Education of Zhejiang Province, 2022
National Scholarship issued by the Ministry of Education of PRC, 2021
First Prize Scholarship issued by Zhejiang University, 2018-2021
|
Inspired by the template here.
|
|