Research
Overall Objectives
The MIRAGES project research activity is oriented towards the development of model-based approaches with feedback. It is the way that MIRAGES has chosen to develop Computer Vision/Computer Graphics collaboration techniques since 1984 when this approach was chosen by the members of the project.Its activity is concentrated on the manipulation of 3D objects in image sequences with an application domain oriented towards new services (related to those 3D objects) which will appear in future communication networks as well as new products for objects customization. Our research activity is carried out in two directions:
First Research Activity: 3D Analysis of Image Sequences
We are interested in the determination of properties such as structure, movement and photometry of 3D objects (especially human beings) in image sequences. Our approach differs from traditional methods as we mainly look for feedback model-based methods to guide the analysis. The main problems we are handling are:
- 3D object tracking in image sequences when the geometry of the object is known but its movement has to be determined. Both rigid, articulated and deformable objects are considered: particularly human body and face tracking.
- Interactive, semi-automatic and automatic camera calibration: Here, we use 3D object models (very often, generic models) as calibration tools, in order to perform calibration. Calibration is necessary for 3D model specification.
- Automatic and semi-automatic object model specification: starting from a generic model of an object(for example a human body or a face) and an image sequence, this task consists in constructing the specific model which will be used for tracking in image sequences (see above).
- Inverse rendering (Computer Graphics denomination corresponding to photometric analysis in Computer Vision): we dispose of input images of a scene and from a 3D geometric model scene. The aim is to compute the photometry of the part of the scene available on those images in such a way that the digital synthesis of the scene model corresponds faithfully to the input images. The main application of this specific research is the creation of advanced tools for audio-visual productions (advertising, films,... )
Collaboration is carried out with AXIATEC (a french company interested in products customization) on face modelling and animation. The Golf-STREAM contract (RIAM funding) started in june 2002 in collaboration with the french Symah Vision production company. The task was to study complete human body 3D tracking and more specifically professional golfers from image sequences in order to allow them to improve their technique and also enrich journalists comments on television broadcasts of professional golf tournements. This task was not entirely accomplished during the period of the contract but we plan on continuing this research with our own funding. We hope to extend this work to other types of applications such as video-surveillance, tele-conferencing, video games, while mixing real and synthetic images.
Realistic Face Reconstruction and 3D Face Tracking
3D Human Body TrackingSecond Research Activity: 3D Garment Simulation
The second research direction is the creation and deformation of soft objects, particularly non linear and hysteretic ones. Presently, our research activity is limited to the 3D simulation of garments. In this research area, we are mainly studying:
- The control of the mechanical properties of soft 2D structures (like textile materials) modelled by mass/spring systems.
- The automatic construction of garments from 2D patterns around a human body modelled as an articulated mechanical system.
Potential applications are the realistic synthesis of 3D garments on 3D numerical mannequins applied to future e-commerce of garments for the textile industry. We put a great effort to build a strong consortium in order to submit a proposal to the ANR. We finally obtained an important funding source for this application.
Garment SimulationMore Information
For more information, please refer to our publications or our activity reports:
2006 research project activity report
2005 research project activity report