3^rd Probabilistic Object Detection (PrOD) Challenge (ECCV)

The Australian Centre for Robotic Vision is pleased be running the third iteration of their first robotic vision challenge on probabilistic object detection. In the probabilistic object detection (PrOD) challenge, participants have to detect objects in video data and provide accurate estimates of spatial and semantic uncertainty. High performing competitors in this iteration of the challenge will be invited to present their work online at our ECCV 2020 Workshop Beyond mAP: Reasessing the Evaluation of Object Detectors and receive a monetary prize.

To compete in the challenge and for the full challenge details, please see our competition website (https://competitions.codalab.org/competitions/20597)

Important Dates

=============

• Final Detection Submissions Due – 14th July 2020 Midnight UTC
• Final Paper Submissions Due – 21st July 2020 Midnight UTC
• Winner Announcements and Workshop Invitations Sent – 28th July 2020
• ECCV Workshop (online) – 28th August 2020

Overview

========

To aid in developing computer vision systems that can be easily applied to a robotics domain, our challenge encourages development of probabilistic object detection systems that provide meaningful estimates of both spatial and semantic uncertainty. This enable object detection to be utilised like any other sensor within already trusted Bayesian fusion frameworks

In contrast to traditional object detection challenges (such as COCO), our challenge evaluates detections using the new probability-based detection quality (PDQ) measure which rewards accurate uncertainty estimates, and penalises both overconfident and underconfident detections. 

Within the challenge, competitors will detect 30 classes of object in over 56,000 images from 18 high-fidelity simulated video sequences spanning 3 unique environments viewed at 3 different simulated robot heights with both day and night lighting conditions.

As well as the ECCV 2020 PrOD challenge, we have a continuous evaluation server available for those who want to develop work in this field of research.

We invite anyone who is interested in object detection and appreciates a good challenge to please participate and compete in the competition so that we may continue to push the state-of-the-art in object detection in directions more suited to robotics applications.

ECCV 2020 PrOD Competition: https://competitions.codalab.org/competitions/20597

Continuous PrOD Challenge: https://competitions.codalab.org/competitions/20595

Contact Details

============

E-mail: contact@roboticvisionchallenge.org

Twitter: @RobVisChallenge

Website: roboticvisionchallenge.org