Arthur Louette

Arthur Louette

PhD Researcher · Co-Founder @ Belerion · Robotics

Developing robust RL agents for robotic autonomy in complex, unpredictable environments. Bridging the gap from simulation to reality for dual-use applications.

01

About

PhD Researcher in Robotic Reinforcement Learning at ULiège & Co-founder of Belerion.

My research focuses on deploying RL agents from simulation to reality for autonomous systems that must operate in extreme conditions. I work on problems where decisions need to be fast and robust: high-speed robotic manipulation, autonomous drone navigation, and adversarial counter-UAS scenarios.

Supervisor

Prof. Damien Ernst, Montefiore Institute, University of Liège.

Collaborations

FN Herstal, John Cockerill Defence, and Thales.

Location

B28 Montefiore, Allée de la Découverte 10, Liège, Belgium.

Research Focus

Reinforcement LearningMulti-Agent SystemsSim-to-Real TransferDrone AutonomyCounter-UASDefence ApplicationsRobotic ManipulationNVIDIA Isaac Sim
02

Research Projects

Deploying RL agents from simulation to reality.

ACTIVE
INTERCEPTOR

Pursuit-Evasion Drones

Investigating multi-agent reinforcement learning for autonomous pursuit-evasion. Training adversarial policies in high-fidelity simulation to study robust behaviors and sim-to-real transfer capabilities.

Multi-Agent RLIsaac SimQuadcopter
ACTIVE
SENTINEL

Counter-Drone Systems

Researching robust tracking and control strategies for counter-UAS applications. Focusing on reinforcement learning algorithms that can adapt to dynamic targets and uncertain environments.

Control TheoryRLTrackingIsaac Sim
Delta robot performing high-speed sorting
COMPLETED
DELTA

Delta Robot Sorting

Optimizing robotic sorting efficiency through learned manipulation policies. Studying the application of reinforcement learning to improve pick-and-place performance in waste management contexts.

RoboticsSim-to-RealManipulationOptimization
Watch Video
03

Publications

Peer-reviewed papers and preprints.

2025OpenReview

Existing Gaps In Reinforcement Learning For Drone Warfare

Arthur Louette, Pascal Leroy, Yanis Geurts, Damien Ernst
RLDrone WarfareSurvey First Author
Scholar

Abstract:As warfare becomes increasingly digital and autonomous, Reinforcement Learning (RL) has emerged as a promising technique for developing intelligent and adaptive drone behaviors. This paper identifies several remaining gaps in the current state of RL for drone warfare, focusing on bridging the gap between simulated training and real-world deployment.

2025ORBi

Autonomous Drone Combat: A Mutli-Agent Reinforcement Learning Approach

Julien Hansen(SUPERVISED), Arthur Louette, Pascal Leroy, Damien Ernst
MARLDrone CombatIsaacLab
Scholar

Abstract:This paper presents a multi-agent reinforcement learning environment for drone combat built on IsaacLab. It includes an in-depth comparison between decentralized learning and self-play schemes in competitive settings, confirming the benefits of self-play for autonomous combat.

2024arXiv preprint arXiv:2406.13453 8 CITATIONS

Reinforcement Learning to improve delta robot throws for sorting scrap metal

Arthur Louette, Gaspard Lambrechts, Damien Ernst, Eric Pirard, Godefroid Dislaire
RoboticsSim-to-RealManipulation First Author
Scholar

Abstract:This study proposes a novel approach based on reinforcement learning (RL) to enhance the sorting efficiency of scrap metal using delta robots and a Pick-and-Place (PaP) process. The approach uses a 3D-simulated environment to train an RL agent to perform throws of scrap metal into different bins, significantly improving sorting throughput.

2023Master Thesis, ULiège

Exploiting reinforcement learning to improve robotic throws

Arthur Louette
Master ThesisRobotics First Author
Scholar

Abstract:A study on exploiting reinforcement learning to teach an ABB Flexpicker robot to accurately throw objects into bins using a high-fidelity simulator.

04

News

Recent events and conferences.

Defence expo booth at Paris Air Show
JUNE 2025Paris, France

Paris Air Show — Le Bourget

Live demo of our advancements in autonomous drone interception system at the Paris Air Show.

Watch Demo
Arthur Louette flying drones at Inno4Def hackathon using Liftoff simulator
2025Belgium

Inno4Def Drone Hackathon

Participated in the Inno4Def drone hackathon organized by La Défense. Flying drones in simulation using Liftoff and developing autonomous strategies.

Watch Demo
05

Education

Academic trajectory.

2023 — PRESENT

PhD in Robotic Reinforcement Learning

University of Liège — Montefiore Institute

Research on reinforcement learning for robotic systems with defence applications, supervised by Prof. Damien Ernst.

2021 — 2023

MSc Data Science & Engineering

University of Liège

Specialization in machine learning and artificial intelligence. Thesis on reinforcement learning for robotic control.

2018 — 2021

BSc Engineering

University of Liège

Foundation in mathematics, physics, and computer science.

06

Teaching

2024 — 2026

Teaching Assistant — Reinforcement Learning

INFO0948 · University of Liège

Assisting in the Reinforcement Learning course, including tutorial sessions, student project supervision, and exam preparation. Covering value-based methods, policy gradients, actor-critic architectures, and multi-agent RL.

07

Passions

Beyond the lab.

Football Team
Football

Team Spirit

Playing football with my team is how I disconnect.

FPV Piloting

Free Flight

Building and flying FPV drones allows me to experience flight from a different perspective.

08

Get in Touch

Initiate communication sequence.

guest@belerion:~/contact

Belerion OS [Version 3.0.1]

(c) 2025 Arthur Louette. All rights reserved.


Accessing contact protocols...

>
email
guest@belerion:~$