Indoor 67 Heatmaps: Confident Errors

Heatmaps for the most confident errors in the indoor67 dataset. The heatmaps were generated entirely automatically, and show which pixels contributed most to the classification of the image. Click on the heatmaps to see the actual elements that had the most influence on the classification. Note that in the paper the SVM uses a max pooling step, and therefore the heatmaps shown there only highlight the maximal deteciton for a given element within a given region (since that's the only detection that contributes to the SVM score), and hence they appear sparse, especially in texutred regions. In these heatmaps, however, we blend all detections, which looks considerably better even if it's not quite as useful for debugging the SVM performance.


guess (confindence 1.9999):bookstore


ground truth:library


guess (confindence 1.8099):bathroom


ground truth:livingroom


guess (confindence 1.565):classroom


ground truth:office


guess (confindence 1.4513):cloister


ground truth:museum


guess (confindence 1.4281):bathroom


ground truth:bedroom


guess (confindence 1.4173):stairscase


ground truth:corridor


guess (confindence 1.4037):casino


ground truth:concert_hall


guess (confindence 1.3893):concert_hall


ground truth:auditorium


guess (confindence 1.2172):poolinside


ground truth:prisoncell


guess (confindence 1.2087):laundromat


ground truth:toystore


guess (confindence 1.1846):trainstation


ground truth:museum


guess (confindence 1.149):winecellar


ground truth:prisoncell


guess (confindence 1.132):warehouse


ground truth:prisoncell


guess (confindence 1.1073):nursery


ground truth:videostore


guess (confindence 1.1012):restaurant_kitchen


ground truth:buffet


guess (confindence 1.0798):closet


ground truth:laundromat


guess (confindence 1.0353):meeting_room


ground truth:dining_room


guess (confindence 1.0334):buffet


ground truth:bakery


guess (confindence 1.0032):warehouse


ground truth:airport_inside


guess (confindence 0.97863):casino


ground truth:warehouse


guess (confindence 0.97707):shoeshop


ground truth:closet


guess (confindence 0.94709):trainstation


ground truth:airport_inside


guess (confindence 0.93376):buffet


ground truth:bakery


guess (confindence 0.9303):bookstore


ground truth:library


guess (confindence 0.92463):dentaloffice


ground truth:dining_room


guess (confindence 0.91668):pantry


ground truth:grocerystore


guess (confindence 0.90191):movietheater


ground truth:waitingroom


guess (confindence 0.85312):locker_room


ground truth:warehouse


guess (confindence 0.83339):hospitalroom


ground truth:bathroom


guess (confindence 0.81611):buffet


ground truth:greenhouse


guess (confindence 0.79795):classroom


ground truth:computerroom


guess (confindence 0.78884):grocerystore


ground truth:deli


guess (confindence 0.78477):airport_inside


ground truth:waitingroom


guess (confindence 0.78413):bookstore


ground truth:videostore


guess (confindence 0.77132):lobby


ground truth:airport_inside


guess (confindence 0.76903):concert_hall


ground truth:subway


guess (confindence 0.76296):concert_hall


ground truth:auditorium


guess (confindence 0.76088):kindergarden


ground truth:waitingroom


guess (confindence 0.75146):meeting_room


ground truth:airport_inside


guess (confindence 0.74322):computerroom


ground truth:office


guess (confindence 0.73855):elevator


ground truth:winecellar


guess (confindence 0.72667):grocerystore


ground truth:deli


guess (confindence 0.72126):jewelleryshop


ground truth:museum


guess (confindence 0.7191):dining_room


ground truth:bar


guess (confindence 0.71245):casino


ground truth:lobby


guess (confindence 0.70805):greenhouse


ground truth:grocerystore


guess (confindence 0.70615):dentaloffice


ground truth:livingroom


guess (confindence 0.70468):kitchen


ground truth:laundromat


guess (confindence 0.7002):subway


ground truth:poolinside


guess (confindence 0.69784):videostore


ground truth:library


guess (confindence 0.68905):dentaloffice


ground truth:restaurant


guess (confindence 0.68835):waitingroom


ground truth:locker_room


guess (confindence 0.68561):bedroom


ground truth:museum


guess (confindence 0.68499):laboratorywet


ground truth:garage


guess (confindence 0.68371):garage


ground truth:museum


guess (confindence 0.68367):grocerystore


ground truth:museum


guess (confindence 0.68104):elevator


ground truth:locker_room


guess (confindence 0.67892):buffet


ground truth:bathroom


guess (confindence 0.67702):kitchen


ground truth:dentaloffice


guess (confindence 0.66448):buffet


ground truth:bakery


guess (confindence 0.65959):concert_hall


ground truth:auditorium


guess (confindence 0.659):hospitalroom


ground truth:children_room


guess (confindence 0.65395):auditorium


ground truth:movietheater


guess (confindence 0.64977):auditorium


ground truth:church_inside


guess (confindence 0.6453):warehouse


ground truth:garage


guess (confindence 0.63926):pantry


ground truth:children_room


guess (confindence 0.63678):church_inside


ground truth:lobby


guess (confindence 0.63547):prisoncell


ground truth:hospitalroom


guess (confindence 0.62421):warehouse


ground truth:jewelleryshop


guess (confindence 0.62227):cloister


ground truth:corridor


guess (confindence 0.62093):livingroom


ground truth:waitingroom


guess (confindence 0.62053):lobby


ground truth:locker_room


guess (confindence 0.62036):children_room


ground truth:nursery


guess (confindence 0.61981):gym


ground truth:waitingroom


guess (confindence 0.61955):florist


ground truth:pantry


guess (confindence 0.6189):florist


ground truth:deli


guess (confindence 0.61648):movietheater


ground truth:laboratorywet


guess (confindence 0.61431):dentaloffice


ground truth:laboratorywet


guess (confindence 0.60445):restaurant


ground truth:tv_studio


guess (confindence 0.59417):library


ground truth:bar


guess (confindence 0.59376):waitingroom


ground truth:livingroom


guess (confindence 0.59046):library


ground truth:deli


guess (confindence 0.58451):fastfood_restaurant


ground truth:bookstore


guess (confindence 0.57061):bar


ground truth:buffet


guess (confindence 0.56903):lobby


ground truth:gameroom


guess (confindence 0.56884):bathroom


ground truth:operating_room


guess (confindence 0.5681):florist


ground truth:buffet


guess (confindence 0.56475):tv_studio


ground truth:operating_room


guess (confindence 0.55923):concert_hall


ground truth:office


guess (confindence 0.55666):elevator


ground truth:jewelleryshop


guess (confindence 0.55377):fastfood_restaurant


ground truth:artstudio


guess (confindence 0.55245):trainstation


ground truth:mall


guess (confindence 0.55205):dining_room


ground truth:stairscase


guess (confindence 0.55176):deli


ground truth:bakery


guess (confindence 0.5516):bakery


ground truth:deli


guess (confindence 0.54864):fastfood_restaurant


ground truth:shoeshop


guess (confindence 0.54816):winecellar


ground truth:museum


guess (confindence 0.54362):kitchen


ground truth:hairsalon


guess (confindence 0.54187):gym


ground truth:hairsalon


guess (confindence 0.53674):buffet


ground truth:bakery