Image and Video Ground Truth Labeling

Interactive image and video labeling for object detection, semantic segmentation, instance segmentation, and image classification

Use the Image Labeler and Video Labeler apps to interactively label ground truth data in a collection of images, a video, or a sequence of images. You can label rectangular regions of interest (ROIs) or polylines for object detection, pixels for semantic segmentation, polygons for instance segmentation, and scenes for image classification. The apps also include computer vision algorithms to automate the labeling of ground truth data for use with detection and tracking algorithms. They also provide an API and workflow that enables you to import your own algorithms to automate the labeling of ground truth data.

Apps

Image Labeler	Label images for computer vision applications
Video Labeler	Label video for computer vision applications

Functions

expand all

Create Labels and Label Definitions

Load Data

`cuboid2img`	Project cuboids from 3-D world coordinates to 2-D image coordinates
`groundTruthDataSource`	Object for storing ground truth data sources
`pixelLabelDatastore`	Datastore for pixel label data
`boxLabelDatastore`	Datastore for bounding box label data
`groundTruth`	Ground truth label data

Create Label Definitions

`labelDefinitionCreator`	Object for storing, modifying and creating label definitions table
`create`	Create label definitions table from the label definition creator object
`info`	Display information about a label, sublabel, or attribute stored in label definition creator object

Add

`addLabel`	Add label to label definition creator object
`addSublabel`	Add sublabel to label in label definition creator object
`addAttribute`	Add attributes to label or sublabel in label definition creator object

Edit

`editLabelGroup`	Modify a label group name
`editGroupName`	Change group name
`editLabelDescription`	Modify description of label or sublabel in label definition creator object
`editAttributeDescription`	Modify description of attribute in label definition creator object

Remove

`removeLabel`	Remove label from label definition creator object
`removeSublabel`	Remove sublabel from label in label definition creator object
`removeAttribute`	Remove attribute from label or sublabel in label definition creator object

Automate Labeling

Action Flags

`initialize`	Initialize state for algorithm execution (optional)
`run`	Run label automation on every frame in interval
`terminate`	Terminate automated algorithm (optional)

Validation

`checkSetup`	Set up validation (optional)
`checkLabelDefinition`	Validate label definition

Algorithm

`vision.labeler.AutomationAlgorithm`	Interface for algorithm automation in ground truth labeling
`settingsDialog`	Display algorithm settings (optional)
`vision.labeler.mixin.Temporal`	Mixin interface for adding temporal context to automation algorithms
`vision.labeler.mixin.BlockedImageAutomation`	Mixin interface for performing blocked image automation
`blockedImageAutomationAlgorithm`	Implements the blocked image automation algorithm
`supportsReverseAutomation`	Set reverse algorithm automation flag

Export and Post-process Labels

Store Data

`groundTruth`	Ground truth label data
`pixelLabelDatastore`	Datastore for pixel label data
`boxLabelDatastore`	Datastore for bounding box label data
`changeFilePaths`	Change file paths in ground truth data
`writeVideoScenes`	Write video sequence to video file
`sceneTimeRanges`	Time ranges of scene labels from ground truth data
`gatherLabelData`	Gather label data from ground truth

Select Labels

`selectLabelsByGroup`	Select ground truth labels by label group
`selectLabelsByType`	Select ground truth labels by label type
`selectLabelsByName`	Select ground truth labels by label name

Enumerate Attribute and Label Types

`attributeType`	Attribute type enumerations for labeling
`labelType`	Label type enumerations for labeling

Create Training Data for Object Detectors

`objectDetectorTrainingData`	Create training data for an object detector
`pixelLabelTrainingData`	Create training data for semantic segmentation from ground truth
`polyToBlockedImage`	Create labeled `blockedImage` object from set of ROIs

Topics

Get Started

Choose an App to Label Ground Truth Data
Decide which app to use to label ground truth data: Image Labeler, Video Labeler, Ground Truth Labeler, Lidar Labeler, Signal Labeler, or Medical Image Labeler.
Get Started with the Image Labeler
Interactively label rectangular ROIs for object detection, pixels for semantic segmentation, polygons for instance segmentation, and scenes for image classification.
Get Started with the Video Labeler
Interactively label rectangular ROIs for object detection, pixels for semantic segmentation, polygons for instance segmentation, and scenes for image classification in a video or image sequence.
Keyboard Shortcuts and Mouse Actions for Image Labeler
Use keyboard shortcuts and mouse actions to increase productivity while using the Image Labeler app.
Keyboard Shortcuts and Mouse Actions for Video Labeler
Use keyboard shortcuts and mouse actions to increase productivity while using the Video Labeler app.

Load Ground Truth Data Sources

Use Custom Image Source Reader for Labeling
Create a reader function to load a custom image data source into the Ground Truth Labeler or Video Labeler.

Label Ground Truth

Label Pixels for Semantic Segmentation
Label pixels for training a semantic segmentation network by using a labeling app.
Label Objects Using Polygons
Label objects using polygons.
Use Sublabels and Attributes to Label Ground Truth Data
Learn how ROI sublabels and attributes work in labeling apps.
View Summary of Ground Truth Labels
View a summary of ROI and scene labels in a labeling app session.
Label Large Images in the Image Labeler
This section describes the differences with using the Image Labeler app with blocked images.

Automate Labeling

Create Automation Algorithm for Labeling
Create a custom automation algorithm to use in a labeling app.
Create Automation Algorithm Function for Labeling
Create a custom automation algorithm function to use in a labeling app.
Temporal Automation Algorithms
Create a time-based custom tracking algorithm to import into a labeling app.
Blocked Image Automation Algorithms
Create a blocked image custom automation algorithm to import into a labeling app.

Use Ground Truth Labels

Share and Store Labeled Ground Truth Data
Share and store labeled ground truth data exported from labeling apps.
How Labeler Apps Store Exported Pixel Labels
Learn how the labeling apps store pixel label data.
Training Data for Object Detection and Semantic Segmentation
Create training data for object detection or semantic segmentation using the Image Labeler or Video Labeler.