In the last 2 years, LMO and the University of Luxembourg’s Interdisciplinary Centre for Security, Reliability and Trust (SnT) have been working together to bring computer vision-based autonomous technologies from ground up to space.
Why, you may ask? In the last decade, the use of space has grown exponentially, influencing our daily lives in communication, weather monitoring, localisation, and much more. To do this, we launch hundreds of satellites far from the human eye. However, once in space, satellites operate on their own – vulnerable and oblivious to the environment around them.
With this increased footprint in space, so has the amount of trash – known as space debris – and other threats towards satellites. With autonomous technology similar to that used in self-driving cars, LMO is providing the necessary tools for satellites to look around them in space and make autonomous decisions based on this information, without the need for ground segment intervention; tools that are becoming ever more critical as space becomes more congested. At the core of these autonomous tasks are computer vision and artificial intelligence (AI) algorithms.
For its first product, LMO is combining space sensors with novel computer vision techniques into a dedicated single payload (SSA Payload), which can process images in space and provide insights of the surrounding area of a satellite, otherwise known as In-Situ Space Situational Awareness (SSA). The SSA payload will enable satellites to autonomously survey Space Resident Objects (SRO) around them, offering key information such as: “identification, classification, feature recognition , critical to enable safe navigation in space. pose estimation
With the SSA Payload mounted on-board civil and defence satellites, these will be able to:
- Automate collision avoidance manoeuvres
- Offer autonomous surveillance
- Autonomously inspect other objects in space
- Capture and remove space junk
- Dock with other satellites and offer in-orbit services, such as repair and refuelling
- Collaborate with other SROs for in-orbit assembly and manufacturing
Examples of applications enabled by intelligent SSA payloads (Credit ClearSpace SA & Nasa Goddard)
The increased autonomy and collaboration of satellites in space will enable the exponential growth of the in-space economy, enabling such aspirations as large space structures assemblies, deep-space logistics and planetary mining.
To achieve its goal and build from a solid foundation in computer vision expertise, LMO partnered in 2020 with the Computer Vision, Imaging and Machine Intelligence Research Group (CVI2) at SnT, headed by Professor Djamila Aouada, a department with more than 12 years of expertise in the field of computer vision and AI.
LMO and SnT Teams at SnT’s Partnership Day in 2021
The partnership has led to key advances in using computer vision for in-space autonomy, including testing of algorithms in dedicated facilities to simulate rendezvous scenarios and relative navigation, as well as testing of algorithms for image identification, classification and pose estimation in software embedded in space electronics architectures.
SnT Zero-G Facility in Kirchberg with a Oneweb Mock-up, Luxembourg
On the back of this success, LMO, together with SnT, signed a large development contract with ESA for the Development of In-Orbit servicing SSA (DIOSSA) applications. DIOSSA will allow the consortium to validate the performance of its SSA Payload in a dedicated in-orbit servicing facility developed at SnT. The programme is funded by the Luxembourg Government through an ESA Contract in the Luxembourg National Space Programme, LuxIMPULSE.
Muriel Hooghe, Senior Project Manager – Space Safety at LSA “I had the chance to visit LMO’s experimental setup in the 0-G lab, witness the great spirit and dedication of the team and incredible teamwork with SnT. We’re looking forward to hearing about the next steps of this project and seeing it contribute to a safer space.
Michel Poucet, CEO of LMO – “We are proud of the progress our team has made together and with SnT and are grateful for the support received from the LSA in helping us reach our ambitions of bring autonomy to space.”
Marcos Perez, CTO of LMO – “The synergy of both LMO and SnT working together is fuelled not only by sound technical expertise but also by a great enthusiasm and motivation for these enabling space applications. LSA, with its strategic vision and capacity, has created a flourishing environment to tackle these future challenges.”
Djamila Aouada, Head of CVI2, SnT – “It is extremely rewarding to witness how far our respective teams have grown together thanks to a tight collaboration. The support from LSA adds a new dimension to our ongoing joint project. It creates an exciting unique configuration that will allow us to bring our Computer Vision innovations relatively faster to real space deployment through parallel implementation on hardware, and development and testing in the Zero-G Lab at SnT.”
Björn Ottersten, Director of SnT – “The technology being developed within the partnership between LMO and SnT presents an exciting angle of research, which aims to address a pressing challenge affecting the communication infrastructures present in our Earth’s orbit. We are delighted to be working with LMO on this project, and contributing to a more sustainable future.”
The view expressed herein can in no way be taken to reflect the official opinion of the European Space Agency