Research研究

Multimodal learning for physical robots面向真机的多模态学习

I connect multimodal policy learning with physical robot control, building on research in tactile perception and active exploration. My current focus is VLA fine-tuning and contact-aware manipulation.我将多模态策略学习与真机控制连接起来,以触觉感知和主动探索研究为基础,当前重点是 VLA 微调与接触反馈下的机器人操作。

Embodied AI & robot control具身智能与机器人控制

Tactile feedback for manipulation and inspection操作与检测中的触觉反馈

I adapt VLA policies to use tactile images and work on tactile inspection of composites. This includes multimodal demonstrations, policy fine-tuning and robot-control interfaces.一部分工作是给 VLA 接入触觉图像,另一部分是用触觉检测复合材料缺陷。具体涉及多模态示教、策略微调和机器人控制接口。

01System evaluation · since Jun 2026系统评测中 · 2026 年 6 月至今

Fine-tuning a tactile VLA for real-robot manipulation触觉 VLA 微调与真机操作

How can contact feedback help a VLA policy handle slippery, deformable and contact-sensitive objects?触觉反馈如何帮助 VLA 策略操作易滑、可变形及对接触敏感的物体?

I lead Bristol-VLA and its VLA workstream, using dual-Franka leader–follower demonstrations to adapt π0.5-DROID with paired tactile RGB. Three independent LoRA fine-tuning runs are complete; data consistency checks and episode-level holdouts prepare the work for a shared closed-loop robot comparison.我负责 Bristol-VLA 项目及 VLA 路线,基于双 Franka 主从示教,将双路触觉 RGB 接入 π0.5-DROID。三组独立 LoRA 微调已完成,通过数据一致性检查和 episode 级验证集划分,为统一的真机闭环对比做准备。

02Funded · in progress已获资助 · 正在进行

Tactile inspection for composite manufacturing用触觉检测复合材料缺陷

Can event-based touch detect surface defects in real time on a manufacturing line?事件驱动触觉能不能在制造流程中实时发现复合材料表面缺陷?

I led the seed study and the successful £150k follow-on proposal. Current work combines tactile hardware development with ABB RobotStudio planning, surface-normal tracking and constant-force scanning on ABB robots.我以 PI 身份完成种子研究,并主导后续 15 万英镑项目申请并获批。目前的工作将触觉硬件研发与 ABB RobotStudio 规划、曲面法向跟踪及 ABB 真机恒力扫描结合起来。

Perception & active exploration感知与主动探索

Human and robot texture exploration人类与机器人的纹理探索

I study how movement, speed and contact conditions affect texture perception, using human experiments and neuromorphic tactile sensors.我通过人体实验和神经形态触觉传感器,研究动作、速度和接触条件怎样影响纹理感知。

01Published · Humanoids 2025已发表 · Humanoids 2025

Choosing touch speed from human perception从人的感知出发选择触摸速度

Do people change their preferred touch speed according to how a texture feels?面对不同的纹理感受,人会不会主动改变自己偏好的触摸速度?

I led a human study across natural textures, velocities and contact forces, then modelled how perceptual dimensions predict preferred exploration speed.我设计并完成了自然纹理、不同速度与接触力下的人体实验,再用感知维度预测人偏好的探索速度。

02Published · IROS 2025已发表 · IROS 2025

Choosing an exploratory movement选择合适的探索动作

Which interaction pattern gives a robot the clearest evidence about texture?滑动、旋转或组合动作,哪一种能让机器人获得更清楚的纹理信息?

As co-first author, I compared six individual and compound movements using NeuroTac. This research also spans SCNN development and deployment on SynSense Speck2f, connecting event-stream processing with on-chip texture inference.我以共同一作身份使用 NeuroTac 比较了六种单独或组合动作。这条研究线还包括 SCNN 开发及 SynSense Speck2f 部署,将事件流处理与片上纹理推理连接起来。

03Under review · ICRA 2027 submission审稿中 · 已投 ICRA 2027

Predicting how an unseen texture will feel预测未见纹理的感知维度

Can a robot infer the perceptual dimensions of a texture it has never encountered?面对训练中从未见过的纹理,机器人能不能预测人会从哪些维度感知它?

As first and corresponding author, I built a dataset linking 24,000 NeuroTac interactions across 50 textures with nine human perceptual attributes, then evaluated a CNN–TCN on unseen textures.我以第一作者、通讯作者完成这项研究,将 50 种纹理的 24,000 次 NeuroTac 交互与人的九项感知属性对应,并用 CNN–TCN 评估对未见纹理的预测。

Research base研究环境

Where the work happens这些工作在哪里展开

Affiliation所属机构

School of Engineering Mathematics and Technology, University of Bristol

Bristol Robotics Laboratory · Dexterous Group

Supervision导师

  • Dr Benjamin Ward-Cherrier
  • Prof Nathan Lepora

Funding资助

Fully funded by the China Scholarship Council and the University of Bristol博士阶段由国家留学基金委与布里斯托大学联合全额资助