They See Me Rolling: High-Speed Event Vision-Based Tactile Roller Sensor for Large Surface Inspection

🏆 Accepted in IEEE Transactions on Robotics

Advanced Research & Innovation Center (ARIC)
Khalifa University

Abstract

High-resolution 3D reconstruction of large surfaces, such as aircraft fuselages, is vital for quality control. Vision-based tactile sensors (VBTSs) offer high local resolution but require slow 'press-and-lift' measurements stitched for large areas. Approaches with sliding or roller/belt VBTS designs provide measurements continuity. However, they face significant challenges respectively: sliding struggles with friction/wear and both approaches are speed-limited by conventional camera frame rates and motion blur, making large-area scanning time consuming. Thus, a rapid, continuous, high-resolution method is needed. We introduce a novel tactile sensor integrating a neuromorphic camera in a rolling mechanism to achieve this. Leveraging its high temporal resolution and robustness to motion blur, our system uses a modified event-based multi-view stereo approach for 3D reconstruction. We demonstrate state-of-the-art scanning speeds up to 0.5 m/s, achieving Mean Absolute Error below 100 microns — 11 times faster than prior continuous tactile sensing methods. A multi-reference Bayesian fusion strategy enhances accuracy (reducing MAE by 25.2% compared to EMVS) and mitigates curvature errors. We also validate high-speed feature recognition via Braille reading 2.6 times faster than previous approaches. This work presents the first neuromorphic vision-based tactile roller sensor enabling rapid, high-resolution continuous tactile scanning for efficient large-scale industrial inspection.

High-Speed 3D Reconstruction

Below you can see some of the results for reconstruction accuracy for single objects and large surfaces (complete results in the manuscript). We achieve mean absolute error (MAE) well below 100 microns on a variety of test objects rolling at 0.5 m/s.


Table of reconstruction results and depth map

Video Presentation