Speaker:Matthew Gardner

Motion Estimation and Robotic Batting of Objects in Free Flight

Robotic batting of an object to a target is a skillful task that requires accurate perception of the flying object, robust modeling of impact dynamics, and efficient planning of a robotic arm's motion. Leveraging of impact and measuring motion are of great importance in manufacturing, sports, and space robots. To demonstrate the use of impact, we solve the batting problem in two dimensions based on impulse and energetic restitution with friction, flight mechanics incorporating gravity and aerodynamic forces, and trajectory re-planning for the bat-wielding robotic arm. Experiments with different objects show better batting performance than a human with no training.

The component of estimating the pose and motion of an in-flight object is subsequently extended to three dimensions. We present a stereo vision system consisting of two high-speed cameras. A hypothesis-based algorithm is proposed to track the object's varying topology across a sequence of images, and Kalman filtering is employed, one for each active hypothesis, to compete for the estimation of linear and angular motions. A constrained Kalman filter is introduced to handle multiple quadratic constraints from the estimation of quaternions. Aerodynamic forces for a general shape are modeled through computational fluid dynamics, and the constraint of two-view geometry from stereo cameras is considered in measurements from images. Results have been obtained from the flights of varying objects, and compared against calculations based on accelerometer data and image coordinates. 

Committee: Yan-Bin Jia (major professor), Sourabh Bhattacharya, David Fernandez-Baca, Guang Song, Alberto Passalacqua