INP.32888UF+INP.32989UF Robot vision (2 VO+1 KU, SS)

Lecturer: Friedrich Fraundorfer (fraundorfernoSpam@icg.tugraz.at)

Learn about 3D reconstruction from images as well as computer vision methods needed for mobile robotics.

Information for SS 2024

All the lectures are planned to be held on-site in lecture room i11  Recordings of previous lecture topics are available on tube.

The practical is organized as programming assignments which can be carried out from home. The practical is organized as group work in groups of 2. This is important such that you do have the possibility to discuss the topics of the practical with a peer. Assignment handouts will be organized as on-site events.

Course description

The course is organized as a lecture and practical. It is advised to take both of them at the same time. To pass the lecture an exam has to be taken. Exam dates will be published in TUG-Online. The practical part is organized as programming assignments and carried out in groups of 2.

Lecture topics

  • Projective geometry
  • Image formation and camera calibration
  • Geometric algorithms (Fundamental matrix, Essential Matrix, Triangulation)
  • Robust estimation (Ransac)
  • Features and matching
  • SfM
  • Bundle adjustment
  • Stereo matching
  • Multi-view stereo
  • Deep learning for depth estimation
  • Depth cameras

Practical part (INP.32989UF)

The practical consists of programming assignments. The practical will be done as group work in groups of 2 students. There will be 3 assignments to be completed through the semester. The assignments need to be programmed in C/C++ with the help of the OpenCV computer vision library. The first assignment will be about camera calibration. The second assignment will be about feature matching and 2 view geometry estimation. The third assignment will be depth estimation using deep learning and requires Python programming

The assignments will be introduced in handout sessions as on-site events.  A tutor will be available to assist you with the assignments and he will hold on-site Q&A sessions. Each group also will be scheduled for an assignment interview after the submission of an assignment. A schedule for the assignment interviews will be available in the TC. The schedule for the handout, sessions and Q&A sessions can be seen in TUG-online.

 

Assignment schedule:

 

  • Assignment 1
    • Handout:   13.03.2024
    • Deadline:   24.04.2024
    • Interviews: 15.05.2024 / 22.05.2024   (individual slots for groups)
  • Assignment 2
    • Handout:   10.04.2024
    • Deadline:   22.05.2024  
    • Interviews: 05.06.2024 / 12.06.2024  (individual slots for groups)
  • Assignment 3
    • Handout:   24.04.2024  
    • Deadline:   12.06.2024  
    • Interviews: 19.06.2024 / 26.06.2024  (individual slots for groups)
  • Q&A sessions: 20.03.2024, 12.04.2024, 08.05.2024, 29.05.2024        

Grading

Grades for the lecture can be obtained by taking a written exam. Exam dates will be published in TUG-Online. The grades for the practical (INP.32989UF) are independent of the lecture and will be determined based on the submitted programming assignments.

Times and dates:

  • First lecture will be held on-site in i11 on the 5.3.2024 from 14:30-16:00.
  • First event for the practical (RV KU) will be held on-site in Seminar room ICG on 6.3.2024 from 9:15-10:00. The topic will be an introduction to the organization of the practical.
  • The main exam date will be at the time of the last lecture slot 25.6.2024 from 14:30-16:00 as a written exam.

Lecture slides: 

(slides will gradually appear here)

 

Lecture slides 2023:

 

News: 

(website updated on 27.02.2024)