CORE: FAVE – Think Smart and Analyse Your Data Efficiently!


Surveillance cameras have become a permanent feature in our daily routine. In order to improve the resolution of the acquired images and the results from their automatic analysis, complicated and expensive cameras have always been required until now – More affordable cameras are still limited with regards to automatic detection of flexible and dynamic non-rigid movements.

In the Core-Project FAVE – Fusion Approaches for Visual Systems Enhancement-Security Applications – as part of the SigCom group of  Prof. Björn Ottersten, a computer vision team led by the scientist Dr. Djamila Aouada at the Interdisciplinary Centre for Security, Reliability and Trust (SnT) at the University of Luxemburg has selected an entirely new approach. In partnership with the sensor specialists at IEE, the researchers have developed an algorithm that prepares the data from simple and inexpensive 3D cameras in real time in such a way that high-definition images are produced. But it is not only the quality of the image that increases; for the first time non-rigid movements – for example, a hand reaching into a handbag – can be automatically reconstructed with high precision.

Going back in time – picture by picture

An important factor in this success is Aouada’s scientific background as a specialist in image processing and computer vision: “Even in the data of simple cameras, there is more quality hidden there than one realises at first. One just has to analyse it efficiently”, Aouada says. Her approach: Through the calculation of images that have been produced one after the other, interrelations that are not recognisable in the individual image become visible.

An algorithm that provides access to this information was developed by the SnT team in the context of the FAVE Project – the recursive dynamic multi-frame superresolution-algorithm.

“Our algorithm allows to perform a simple local per-pixel tracking where both depth measurements and deformations are dynamically optimised”, explains Dr. Kassem Al Ismaeil, whose PhD dissertation forms essential parts of the project. “This enables us to appreciably increase the resolution and minimise the disruptive effects, i.e. the signal noise.”

With the aid of the algorithm, the team has thus far been able to -process data from a camera in real time. In the next step, images from several cameras shall then be used as well.

Recognise faces, without the identity of the observed person being known

An important aspect in the project is the topic of privacy. The cryptography specialist Dr. Dalia Khader, who recently moved from SnT as Security Information Analyst to the POST Luxemburg, was involved for this reason. With her support, the team was able to have a pattern recognition algorithm work with encrypted data; it is able to recognise faces, without the identity of the observed person being known.

“Authorized individuals receive a notice – and can then determine who is in the image”, says Djamila Aouada.

The new 3D super-resolution algorithm created quite a splash among professional circles and led to publications in high-level technical journals. Moreover, a patent has secured future economic exploitation of the knowledge, and formation of a company is foreseen. The director of SnT, Professor Björn Ottersten was the Principal Investigator in the FAVE Project.

“Björn Ottersten was highly committed to our project’” says Aouada. “We were able to engender huge benefits thereby. And I have learned a lot from him regarding how to structure a large-scale project and to manage the team.”

This success story is from the 2016 FNR Annual Report. View the Annual Report as PDF or digital version

Prof Björn Ottersten, Director of the Centre for Security, Reliability and Trust (SnT) at the University of Luxembourg, and Principal Investigator in the FAVE project © scienceRELATIONS
Dr Djamila Aouada, scientist at the Centre for Security, Reliability and Trust (SnT) at the University of Luxembourg © scienceRELATIONS

Other success stories from the 2016 FNR Annual Report

PSP Classic: Indiana Jos – in the footsteps of researchers and explorers

Educators of day care centres and youth houses gear up: with training courses and experimental workstations in natural sciences and technology.

POC: Pocket-sized intestines – the HuMiX model enables intestinal flora to be investigated under real conditions

Researchers at the University of Luxembourg have developed a model of the human intestines which simplifies the examination of intestinal bacteria and removes the need for animal experiments.

INTER Mobility: Lack of fibre makes intestinal bacteria aggressive

The globally acknowledged study led by Dr Mahesh Desai shows the potential effects of a lack of fibre on the intestinal flora.

CORE Junior: Colloidal Physics – Concerning Research on Energy Landscapes

Dr Sven Dorosz is a basic researcher: ‘My Junior Core Project has led to basic findings for materials research and generated numerous very good publications.’ The topic that Dorosz was involved with at the University of Luxemburg is called Colloidal Physics, specifically, the ‘statistical mechanics of many-particle systems out of equilibrium’, as Dorosz explains.

ATTRACT: Breakthrough Made in Luxembourg – Cellular Metabolism Research is Here to Stay

Prof Dr Karsten Hiller was awarded an FNR ATTRACT Fellowship in 2010, with which he brought experimental and computational research in cellular metabolism to Luxembourg. The German national set up the Metabolomics Group at the Luxembourg Centre for Systems Biomedicine (LCSB) at the University of Luxembourg and during the 5 years that followed, the group implemented a high-quality mass spectrometry-based profiling platform and applied their expertise to study metabolism in-depth.

PEARL: The Many Sides of Socio-Economic Inequality

Economist Conchita D’Ambrosio and sociologist Louis Chauvel examine the same issue but from different perspectives.

AFR: From cycle racing to the chemistry lab – Pit Losch on the quest for alternatives to fossils fuels

The finite nature of fossil fuels forces us to look for alternatives. For researcher Pit Losch, zeolites play a big role in this search.

This site uses cookies. By continuing to use this site, you agree to the use of cookies for analytics purposes. Find out more in our Privacy Statement