MSc thesis, CTU Prague × valeo.ai, 2026

Visual Question Answering for Autonomous Driving

A vision-language model looks at six camera images around a car and answers perception, prediction, planning and behavior questions about the scene. This demo puts its answers next to the ground truth and to baseline models.

Defended at CTU FEE, June 2026 · Read the thesis

Start here: Scene 3 →

Headline results

DriveLM final score, 0–1, higher is better, on our test split of 3,340 questions.

Links

Models

Score = DriveLM final score (0–1, higher is better) on our test split of 3,340 questions. It combines answer accuracy, a GPT judge, language overlap and object matching. Mini-DA is an external checkpoint released by OpenGVLab; all other fine-tuned models are ours.

Scenes

26 moments from 22 test scenes recorded in Boston and Singapore. Scenes 12–13, 16–17, 18–19, 20–21 are moments from the same drive.

Six camera views of scene 1
Scene 1
8 questions · Boston
078e6d7a3d4a429bba404bf12c7a98f2 · 7b4ac539f491478fba47e53ebaec3c0f
Six camera views of scene 2
Scene 2
7 questions · Boston
0ced08ea43754420a23b2fbec667a763 · ec7a8148031849c7b73ae314fb7f0dc6
Six camera views of scene 3
Scene 3 (main demo)
8 questions · Boston
22daa579e9d54040b3f76a4eeef3a587 · 86c38e5cfafc4ec89c6ab7f6e5b85153
Six camera views of scene 4
Scene 4
7 questions · Boston
2bbae5e654224cbeb5884c471e2ad05e · d2eeab4dc9514ee2bce9800eaadd3c17
Six camera views of scene 5
Scene 5
8 questions · Boston
2c96ff6afc9e4cf7bc8b107fce955c1f · c61f77e2820743f696047eec21d7807a
Six camera views of scene 6
Scene 6
8 questions · Boston
2ffd7e2a1daf4b928464ddb2ed3dca59 · 304da7079b434f44aa7447833de8166a
Six camera views of scene 7
Scene 7
8 questions · Singapore
34a9823fac0d4b9db30898e00b5f9f9c · a4a6771cbd1349e4bc593712d903a05a
Six camera views of scene 8
Scene 8
8 questions · Boston
45275e709d4a4b0592d57850d8e8bd8d · 539e46e59fb943b0a1df493004907c1f
Six camera views of scene 9
Scene 9
8 questions · Boston
59530445fcc04c2090bfaf63f342f794 · 79025431db8a4c8083c4e381d9704e62
Six camera views of scene 10
Scene 10
8 questions · Boston
5b9c64f03f8b4a4f8189a18d74f866c2 · afa2aba2422f453b9e82f2b9238eb471
Six camera views of scene 11
Scene 11
8 questions · Boston
73b16c26a0d24c7a841e4cbe5d0d7878 · 858559433d1e49498c50db548e19cadd
Six camera views of scene 12
Scene 12
8 questions · Boston
7d6006ae9d8f406aa99756156ea4f70a · 0b0758daa8c94fbfabf45d0e24e1e37e
Six camera views of scene 13
Scene 13
8 questions · Boston
7d6006ae9d8f406aa99756156ea4f70a · f7da7dd25696465baadbd241c7c04b0b
Six camera views of scene 14
Scene 14
8 questions · Boston
7ef04cdbd04c4b67a22f59502cb8fac6 · c800555e7f894aeb8460388f33e1bc15
Six camera views of scene 15
Scene 15
8 questions · Boston
c5b36e5275cc4a2285d095e87347c49a · 04de5a1d4f8b45a3a62d6bf0ee07c715
Six camera views of scene 16
Scene 16
8 questions · Singapore
c949ec2cca7047bdb67dce64b6c3586a · 5efb275a2b1343a88e82c6cc08fff267
Six camera views of scene 17
Scene 17
8 questions · Singapore
c949ec2cca7047bdb67dce64b6c3586a · c831ac037c0e4cd2b9fc737b31d5461d
Six camera views of scene 18
Scene 18
8 questions · Boston
cab845a2e8864482993ac62811f879c1 · 37938fd79ce148c19b56c77d3a50b994
Six camera views of scene 19
Scene 19
7 questions · Boston
cab845a2e8864482993ac62811f879c1 · 459d40f4e71940eb930847582b16fd2a
Six camera views of scene 20
Scene 20
8 questions · Singapore
cb3ef7b7ef124983b336c781f134cdfb · 7c36879f3ba04809976c39fd03a8a01c
Six camera views of scene 21
Scene 21
8 questions · Singapore
cb3ef7b7ef124983b336c781f134cdfb · cfd47376746245e899d2223da787fc3d
Six camera views of scene 22
Scene 22
8 questions · Boston
d58468c6097c425e89671a7b3f480acf · 4f2589a2df5c47b292947dd7f76b8c72
Six camera views of scene 23
Scene 23
8 questions · Boston
df8dfada99a04a81bd1b102eeb84e9bc · 3a171478d2d448ba9f8fc44c7df60a5a
Six camera views of scene 24
Scene 24
8 questions · Boston
f7d01e23508040c2aec430e8da13fb76 · 8e2553b1b1184746a85bf2381c050f12
Six camera views of scene 25
Scene 25
8 questions · Singapore
faa975eaad804c85bd8f2da9b30c8d9a · 8228b555abab4995be9a5ac597c2d59c
Six camera views of scene 26
Scene 26
8 questions · Singapore
fcb40dc8514444c49b1fdc06f80a123b · f6754a71377442c59fb8689145f96623