Thesis topic proposal
Multimodal registration of visual data across different dimensions


Institute: University of Szeged
computer sciences
PhD School in Computer Science

Thesis supervisor: Zoltán Kató
Location of studies (in Hungarian): SZTE
Abbreviation of location of studies: SZTE

Description of the research topic:

The main goals of the proposed research is to organize the (visual) data coming from various sensors over a long time span. A natural way is a geographical organization of the data, i.e. transform the images into a common geotagged coordinate frame which allows analysing the data in a way required by e.g. precision agriculture. As part of this, the registration of 2D sensory information with 3D terrain models would open new possibilities like modeling flooding or analysing the effect of dry
weathers. Geotagging and registration with 3D models would also help analysing the effect of microclimate changes over time, or modeling the spread of various diseases in order to predict the necessary dose of pesticides or fertilizers and the precise spatial range where these chemicals need to be applied. That would significantly reduce costs and the undesirable impact of chemicals on the natural environment.
Some of the related research problems:
- Building geotagged 3D models (either from the sensory information or using 3D reconstruction techniques on UAV imagery, or aerial lidar data)
- Geometric alignment of the collected multispectral/multimodal image data within the 2D image domain
- Registration of the 2D imagery with the reference 3D surface

Correspondence-less region-based registration algorithms for highly different modalities and/or registration across different dimensions. In particular a 3D surface obtained from sensors or other sources (aerial Lidar or DEM) has no photometric data so the only way to align with image data is a purely geometry-based approach.
When photometric data is available, then correspondence-free linear registration methods for images with covariant radiometric datacan be applied. The big advantage of this case is of course the linear solution allowing real-time solutions. The challange is to define appropriate covariant functions using heterogeneous image sensors.

Potential application areas:
- Combination of UAV data with satellite data with different enlightenment conditions due to weather (cloudy, partly cloudy, sunny) or time of the day (for UAV, it might not be as regular as it is with a satellite).
- Build a very accurate Digital Elevation Model of the field using 3D GPS/RTK data and visual data.

The research work involves active collaboration with researchers from
BGU, Israel and Magellium Ltd., UK.

Registration, multimodal/multispectral imagery, UAV, DEM

Successfull candidate:
Very good knowledge of image processing, good knowledge of geometry and computer vision, basic knowledge of remote sensing, fluent in English.

Number of students who can be accepted: 1

Deadline for application: 2017-03-31

2017. I. 31.
ODT ülés
Az ODT következő ülésére 2017. március 10-én 10.00 órakor kerül sor a Semmelweis Egyetem Szenátusi termében (Bp. Üllői út 26. I. emelet).

All rights reserved © 2007, Hungarian Doctoral Council. Doctoral Council registration number at commissioner for data protection: 02003/0001. Program version: 1.2334 ( 2017. I. 15. )