Student Projects

I actively supervise MSc projects / internships. If you are interested in any of the following topics, or have a general idea of research related to planning / control / estimation of aerial robots, please feel free to contact me at s.sun-2@tudelft.nl.

Please also send with your application an updated CV, a transcript of your current education and indicate a planned start date.

(Open) Multi-Agent Reinforcement Learning for Cooperative Aerial Manipulation

In this project, you will investigate cooperative aerial manipulation methods using multi-agent reinforcement learning. You are expected to set up simulation environments in Isaac Sim, conduct training in simulation using multi-agent RL (such as MAPPO), and carry out real-world demonstrations at the Mobile Robotics Lab.

(Open) Visual-Servoing for an Under-Actuated Aerial Manipulator

In this project, you will explore visual servoing methods for aerial manipulation, developing a comprehensive perception pipeline for the flying robot. This pipeline will include visual-inertial odometry (using an off-the-shelf product) and object pose estimation. You will then combine the perception pipeline with contact-based control and planning algorithms, enabling a full-stack evaluation in real-world experiments.

(Open) Actuator Dynamic Compensator for Incremental Nonlinear Control

In this research, the student will explore a technique known as “command advancing”. Preliminary studies have demonstrated its effectiveness in overcoming the limitations posed by first and second-order dynamic actuators. The student aims to refine and implement this technique on a BLDC (Brushless DC electric) motor and subsequently assess its performance on a quadrotor drone.

(In progress) Whole-body Planning and Control of an Aerial Robotic Manipulator

In this project, you will work on designing whole-body control of aerial manipulators without the quasi-static assumptions. You will have to directly control the torque level of the actuators and jointly account for the multiple DoF kinodynamics of both the manipulator and the base of the drone. As a result, the aerial manipulator is expected to have unprecedented agility and maneuverability compared to state-of-the-art solutions. You will also work closely with the engineer to build and modify the air manipulators in the lab.

(In progress) Contact-based incremental nonlinear control for aerial manipulators

Aerial manipulators are aerial robots that can manipulate the object and physically interact with the environment. In other words, they are also “flying hands” rather than “flying cameras”. An emerging application of aerial manipulators is using them for ultrasonic testing (UT) of infrastructure, such as wind turbine blades to detect their interior flaws. While existing solutions can achieve point detection, it still remains a challenge to smoothly slide on a rough surface because of the unknown frictions. In this project, you will develope and validate planning and control algorithms in this challenging task.

(In progress) Privileged learning for distributed aerial robot control for collaborative object manipulations

In this research, the student will investigate the potential of privileged learning to address multi-agent control problems, focusing on the use of multiple aerial robots for collaborative object manipulation in the air. An existing centralized policy based on nonlinear Model Predictive Control (MPC) will serve as the basis for the teacher policy. Experimental validation of the algorithm is anticipated.