End-to-end Neural Network Based Optimal Quadcopter Control

In collaboration with ESA’s Advanced Concepts Team, we published our work on end-to-end guidance and control networks in the June 2024 issue of Science Robotics.


This review presents the results of training end-to-end neural architectures for interplanetary transfers, planetary landings, and close-proximity operations. To test these architectures on real robotic platforms and boost confidence in their use for future space missions, drone racing is explored as an ideal gym environment. Drone racing shares with spacecraft missions both limited onboard computational capabilities and similar control structures derived from the desired optimality principle. Additionally, it involves different levels of uncertainties, unmodeled effects, and a significantly different dynamical timescale.

The paper summarizes the work at the Micro Air Vehicle Laboratory on end-to-end neural control of quadcopters (see paper list below). In this research, supervised learning and reinforcement learning have been employed to train guidance and control networks (G&CNets) to control the Parrot Bebop drone. A major challenge in bringing these controllers to life is the “reality gap” between the real platform and the training environment. To address this, we combine online identification of the reality gap with pre-trained corrections through a deep neural controller, which is orders of magnitude more efficient than traditional computation of the optimal solution.


2024

Izzo, Dario; Blazquez, Emmanuel; Ferede, Robin; Origer, Sebastien; Wagter, Christophe De; de Croon, Guido C. H. E.

Optimality principles in spacecraft neural guidance and control Journal Article

In: Science Robotics, vol. 9, iss. 91, no. 91, pp. eadi6421, 2024, ISSN: 2470-9476.

Abstract | Links | BibTeX

Ferede, Robin; Croon, Guido; Wagter, Christophe De; Izzo, Dario

End-to-end neural network based optimal quadcopter control Journal Article

In: Robotics and Autonomous Systems, vol. 172, 2024, ISSN: 0921-8890, (Funding Information: This work was supported by the European Space Agency.This research was co-funded under the Discovery programme of, and funded by, the European Space Agency. Funding Information: This work was supported by the European Space Agency . Publisher Copyright: © 2023 The Authors).

Links | BibTeX

2023

Origer, Sebastien; Wagter, Christophe De; Ferede, Robin; Croon, Guido C. H. E.; Izzo, Dario

Guidance & Control Networks for Time-Optimal Quadcopter Flight Miscellaneous

2023.

Links | BibTeX

Ferede, Robin; Wagter, Christophe De; Izzo, Dario; Croon, Guido C. H. E.

End-to-end Reinforcement Learning for Time-Optimal Quadcopter Flight Miscellaneous

2023.

Links | BibTeX