SoftwareApplication
name: Code underlying the publication: "Humans disagree with the IoU for measuring object detector localization error."
description: Code underlying the publication: "Humans disagree with the IoU for measuring object detector localization error."
description: The localization quality of automatic object detectors is typically evaluated by the Intersection over Union (IoU) score. In this work, we show that humans have a different view on localization quality. To evaluate this, we conduct a survey with more than 70 participants. Results show that for localization errors with the exact same IoU score, humans might not consider that these errors are equal, and express a preference. Our work is the first to evaluate IoU with humans and makes it clear that relying on IoU scores alone to evaluate localization errors might not be sufficient. In this repository, we provide a Jupyter notebook containing the code for our data analysis.
code repository: https://data.4tu.nl/v3/datasets/69828485-f662-4b28-9969-76f7943483ef.git
author: Person
  given name: Ombretta
  family name: Strafforello
  name: Ombretta Strafforello
author: Person
  given name: Osman
  family name: Kayhan
  name: Osman Kayhan
author: https://orcid.org/0000-0002-6913-0482
keywords: Object detection
keywords: Human preference
keywords: Intersection over Union (IoU)
programming language: Jupyter Notebook
programming language: Markdown
programming language: Other
license:
  creative work: creativeWork
    name: CC0-1.0
reference publication: icip46576.2022.9898043

https://orcid.org/0000-0002-6913-0482
type: Person
given name: Jan
family name: van Gemert
name: Jan van Gemert

icip46576.2022.9898043
type: ScholarlyArticle
name: Humans Disagree With the IoU for Measuring Object Detector Localization Error
pagination: 1261-1265
url: https://doi.org/10.1109%2Ficip46576.2022.9898043