Mapillary Vistas Semantic Segmentation Task Robust Vision @ ECCV 2020

Organized by Mapillary - Current server time: Oct. 21, 2020, 10:26 a.m. UTC

Previous

validation
June 30, 2020, midnight UTC

Current

test
June 30, 2020, midnight UTC

End

Competition Ends
Never

Mapillary Vistas Semantic Segmentation Task Robust Vision @ ECCV 2020

The goal of this task is to provide pixel-specific segmentation results for the complete set of 65 object classes in MVD. The provided segmentation is class-agnostic, i.e. the resulting labeling does not allow to separate multiple, nearby thing objects like cars or pedestrians in an image.

The semantic segmentation task is part of the Robust Vision Challenge at ECCV 2020. The submission format follows exactly the data format used in the original training data download and we require a submission of a single zip-file holding all segmentation image results (5.000 on the test set, 2.000 on the validation set) in its root folder. As a reminder, the data should be encoded as single-channel, 8-bit png file, where the name matches the corresponding RGB test image file name. Please make sure to not store the result as RGB image. Use only IDs < 65, label indices are zero-based, i.e. "bird" has id 0. The name of the zip file can be chosen arbitrarily. To verify the correctness of your submission format, you can make a trial submission based on validation data.

The semantic segmentation task uses all the publicly available Mapillary Vistas Research edition v1.2 images (18.000 train + 2.000 val). The main performance metric used is mean Intersection-over-Union (mIoU) computed on 65 valid object categories. This CodaLab evaluation server provides a platform to measure performance on the val and test sets.

The main performance metric used for ranking is mean Intersection-over-Union (mIoU), computed on 65 valid object categories. Pixels with void label in the ground truth are ignored during testing.

validation

Start: June 30, 2020, midnight

Description: Development phase with validation data

test

Start: June 30, 2020, midnight

Description: Competition phase with test data

Competition Ends

Never

You must be logged in to participate in competitions.

Sign In
# Username Score
1 morsic 0.4043
2 johnlambert 0.3419