0.25
0.5
0.75
1.25
1.5
1.75
2
Analyzing the Behavior of Deep Visual Question Answering Models
Published on Aug 23, 20166124 Views
Related categories
Chapter list
Analyzing the Behavior of Deep VQA Models00:00
Visual Question Answering (VQA)00:18
Papers using VQA/100:43
Papers using VQA/200:56
VQA Challenge @ CVPR16/101:00
VQA Challenge @ CVPR16/201:08
Observations01:18
Outline/102:20
Outline/202:36
Outline/302:40
Models - Without attention03:02
Models - With attention03:17
Without attention03:36
With attention/104:11
With attention/204:16
With attention/304:22
Do VQA models generalize to novel instances?04:45
Generalization to Novel Instances/104:48
Generalization to Novel Instances/205:00
Generalization to Novel Instances/305:09
Generalization to Novel Instances - test QI pairs are too different from training QI pairs?05:17
Generalization to Novel Instances - Experiment05:24
Generalization to Novel Instances - K-NN Space/105:49
Generalization to Novel Instances - K-NN Space/206:02
Generalization to Novel Instances - K-NN Space/306:05
Generalization to Novel Instances - K-NN Space/406:12
Generalization to Novel Instances - Results/106:27
Generalization to Novel Instances - Results/206:33
Generalization to Novel Instances - Results/306:39
Generalization to Novel Instances - Results/406:45
Generalization to Novel Instances - Results/506:49
Generalization to Novel Instances - Results/606:55
Generalization to Novel Instances - Results/707:11
Generalization to Novel Instances - Results/807:21
Test Sample/107:30
Test Sample/207:35
Test Sample/307:38
Test Sample/407:44
Generalization to Novel Instances - test QI pairs are “familiar” but test labels are too different from training labels?08:00
Generalization to Novel Instances - Experiment08:11
Generalization to Novel Instances - Results/108:36
Generalization to Novel Instances - Results/208:41
Generalization to Novel Instances - Results/308:49
Test Sample/109:12
Test Sample/209:16
Test Sample/309:17
Test Sample/409:22
Do VQA models ‘listen’ to the entire question?10:04
Listening to the Entire Question10:11
Listening to the Entire Question10:24
Listening to the Entire Question - Experiment/110:33
Listening to the Entire Question - Experiment/210:36
Listening to the Entire Question/110:45
Listening to the Entire Question/210:59
Listening to the Entire Question/311:04
Listening to the Entire Question/411:17
Listening to the Entire Question/511:22
Listening to the Entire Question/611:27
Listening to the Entire Question - Results/111:32
Listening to the Entire Question - Results/211:38
Listening to the Entire Question - Results/311:43
Listening to the Entire Question/711:48
Listening to the Entire Question/811:57
Listening to the Entire Question/9 12:06
Listening to the Entire Question/1012:11
Listening to the Entire Question/1112:16
Listening to the Entire Question/1212:19
Correct Response12:23
Incorrect Response/112:37
Incorrect Response/213:19
Incorrect Response/313:27
Do VQA models really ‘look’ at the image?13:38
Looking at the Image/113:43
Looking at the Image/214:02
Looking at the Image - Experiment/114:08
Looking at the Image - Experiment/214:15
Looking at the Image/114:19
Looking at the Image/214:39
Looking at the Image/314:53
Looking at the Image/414:59
Looking at the Image/515:02
Looking at the Image/615:05
Looking at the Image/715:09
Looking at the Image - Results/115:14
Looking at the Image - Results/215:21
Looking at the Image - Results/315:30
Looking at the Image - Results/415:34
Looking at the Image/815:45
Looking at the Image/915:47
Looking at the Image/1015:50
Looking at the Image/1115:52
Looking at the Image/1215:55
Looking at the Image/1315:56
Looking at the Image/1415:59
Looking at the Image/1516:01
Looking at the Image/1616:01
Looking at the Image/1716:03
Looking at the Image/1816:04
Looking at the Image/1916:05
Looking at the Image/2016:06
Looking at the Image/2116:09
Looking at the Image/2216:18
Looking at the Image/2316:19
Looking at the Image/2416:21
Looking at the Image/2516:25
Looking at the Image/2616:27
Looking at the Image/2716:28
Looking at the Image/2816:35
Looking at the Image - All Correct Responses16:39
Looking at the Image - Observations17:00
Looking at the Image - Observations17:06
Conclusion17:09
To be noted17:35
Thanks!18:27