Mapillary Vistas Object Detection Task ICCV 2019

Organized by Mapillary - Current server time: Sept. 20, 2019, 9:45 a.m. UTC

Previous

validation
Sept. 9, 2019, midnight UTC

Current

test
Sept. 9, 2019, midnight UTC

End

Competition Ends
Oct. 5, 2019, 7:29 a.m. UTC

Mapillary Vistas Object Detection Task

The goal of this task is to provide instance-specific segmentation results for a subset of 37 object classes on MVD. In such a way, results allow to count individual instances of classes like e.g. the number of cars or pedestrians in an image.

The detection task is part of the 2nd Joint COCO and Mapillary Recognition Challenge Workshop - this time co-located with ICCV 2019. Researchers are encouraged to participate in both, the COCO and Mapillary Detection Tasks (the tasks share [almost] identical data formats and the exact same evaluation metrics). The only difference between COCO and Mapillary submission formats is the value type for image_id per detection result, which has to be a string providing the file name without extension for Mapillary Vistas rather than an integer as in COCO. Please make a trial submission using validation data to ensure that your submission format is matching.

[{
"image_id": str,
"category_id": int,
"segmentation": RLE,
"score": float,
}]

The detection task uses all the publicly available Mapillary Vistas Research edition v1.1 images (18.000 train + 2.000 val) with 37 thing categories + 1 void class. There are no overlaps of annotations between different objects of same/different classes. The main performance metric used is Average Precision (AP) computed on the basis of instance-level segmentations per object category and averaged over a range of overlaps 0.5:0.05:0.95 with inclusive start and end. This CodaLab evaluation server provides a platform to measure performance on the val and test sets.

The main performance metric used is Average Precision (AP) computed on the basis of instance-level segmentations per object category and averaged over a range of overlaps 0.5:0.05:0.95 with inclusive start and end, see here for details.

No files have been added for this competition yet.

validation

Start: Sept. 9, 2019, midnight

Description: Development phase with validation data

test

Start: Sept. 9, 2019, midnight

Description: Challenge phase with test data

Competition Ends

Oct. 5, 2019, 7:29 a.m.

You must be logged in to participate in competitions.

Sign In