They See Me Rolling: High-Speed Event Vision-Based Tactile Roller Sensor for Large Surface Measurements

Advanced Research & Innovation Center (ARIC)
Khalifa University

Abstract

High-resolution 3D reconstruction of large surfaces, such as aircraft fuselages, is vital for quality control. Vision-based tactile sensors (VBTSs) offer high local resolution but require slow 'press-and-lift' measurements stitched for large areas. Approaches with sliding or roller/belt VBTS designs provide measurements continuity. However, they face significant challenges respectively: sliding struggles with friction/wear and both approaches are speed-limited by conventional camera frame rates and motion blur, making large-area scanning time consuming. Thus, a rapid, continuous, high-resolution method is needed. We introduce a novel tactile sensor integrating a neuromorphic camera in a rolling mechanism to achieve this. Leveraging its high temporal resolution and robustness to motion blur, our system uses a modified event-based multi-view stereo approach for 3D reconstruction. We demonstrate state-of-the-art scanning speeds up to 0.5 m/s, achieving Mean Absolute Error below 100 microns — 11 times faster than prior continuous tactile sensing methods. A multi-reference Bayesian fusion strategy enhances accuracy (reducing MAE by 25.2% compared to EMVS) and mitigates curvature errors. We also validate high-speed feature recognition via Braille reading 2.6 times faster than previous approaches. This work presents the first neuromorphic vision-based tactile roller sensor enabling rapid, high-resolution continuous tactile scanning for efficient large-scale industrial inspection.

High-Speed 3D Reconstruction

Below you can see the results for reconstruction accuracy for single objects and large surfaces. We achieve mean absolute error (MAE) well below 100 microns on a variety of test objects rolling at 0.5 m/s.


Table of reconstruction results and depth map

Video Presentation