Direct learning of home vector direction for insect-inspired robot navigation (ICRA’24)

Abstract

Insects have long been recognized for their ability to navigate and return home using visual cues from their nest’s environment. However, the precise mechanism underlying this remarkable homing skill remains a subject of ongoing investigation. Drawing inspiration from the learning flights of honey bees and wasps, we propose a robot navigation method that directly learns the home vector direction from visual percepts during a learning flight in the vicinity of the nest. After learning, the robot will travel away from the nest, come back by means of odometry, and eliminate the resultant drift by inferring the home vector orientation from the currently experienced view. Using a compact convolutional neural network, we demonstrate successful learning in both simulated and real forest environments, as well as successful homing control of a simulated quadrotor. The average errors of the inferred home vectors in general stay well below the 90° required for successful homing, and below 24° if all images contain sufficient texture and illumination. Moreover, we show that the trajectory followed during the initial learning flight has a pronounced impact on the network’s performance. A higher density of sample points in proximity to the nest results in a more consistent return.

Relevant links

Preprint
Code: 1, 2, 3
Data

Michiel V.M. Firlefyn, Jesse J. Hagenaars, Guido C.H.E. De Croon: Direct learning of home vector direction for insect-inspired robot navigation. In: 2024 IEEE International Conference on Robotics and Automation, ICRA 2024, pp. 6022–6028, IEEE, United States, 2024, (Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public. ; 2024 IEEE International Conference on Robotics and Automation, ICRA 2024 ; Conference date: 13-05-2024 Through 17-05-2024).

Publications

M.V.M. Firlefyn: Direct Learning of Home Vector Direction: Incited by Existing Insect-Inspired Approaches for Local Navigation and Wayfinding. TU Delft Aerospace Engineering, 2023, (de Croon, G.C.H.E. (mentor); Hagenaars, J.J. (mentor); Delft University of Technology (degree granting institution); graduation 28-09-2023).