Main Content

Detection and Tracking

Object detection, shape fitting, and tracking in lidar point cloud data

Object detection is a technique that identifies and locates objects in a scene. This enables you to detect 3-D objects in a point cloud. Lidar Toolbox™ includes functionality that enables you to detect objects using geometric shape fitting or deep learning with convolutional neural networks.

  • Geometric shape fitting — Detect the 3-D geometry of the objects in the point cloud by using ground segmentation and plane-fitting algorithms. You can detect the location, dimensions and direction of each object. You can use the detected objects for downstream workflows such as tracking, path planning and labeling.

  • Deep learning — A deep learning approach to object detection uses convolutional neural networks to perform object detection. Lidar Toolbox includes object detection workflows that use neural networks such as PointPillars, Voxel R-CNN, and Complex-YOLO v4. You can train a custom object detection model, or use the available pretrained networks and further tune it for your application. The toolbox also supports CUDA® MEX code generation for PointPillars and SqueezeSegV2 networks.

Object tracking is a technique that estimates and tracks the movement of objects across multiple scans of a scene. Object tracking consists of assigning a unique ID to detected objects and tracking their movement across point cloud frames. Lidar Toolbox includes detection and tracking workflows for vehicles, road lanes, and curbs. Most of these workflows use the joint probabilistic data association (JPDA) tracker.

Deep learning-based object detection in lidar point clouds.

Functions

expand all

Shape Fitting

pcfitcuboidFit cuboid over point cloud (Since R2020b)
pcfitplaneFit plane to 3-D point cloud

Geometric Models

planeModelObject for storing parametric plane model
cuboidModelParametric cuboid model (Since R2020b)

Load Training Data

groundTruthGround truth label data
combineCombine data from multiple datastores
fileDatastoreDatastore with custom file reader
boxLabelDatastoreDatastore for bounding box label data

Augment and Preprocess Training Data

randomAffine3dCreate randomized 3-D affine transformation
bboxwarpApply geometric transformation to bounding boxes
pctransformTransform 3-D point cloud

Object Detection

pointPillarsObjectDetectorPointPillars object detector (Since R2021b)
trainPointPillarsObjectDetectorTrain PointPillars object detector (Since R2021b)
voxelRCNNObjectDetectorCreate Voxel R-CNN object detector (Since R2024b)
trainVoxelRCNNObjectDetectorTrain Voxel R-CNN object detector for lidar data (Since R2024b)
lidarLaneDetectorCreate lane detector for lidar data (Since R2023b)
detectDetect objects using PointPillars object detector (Since R2021b)
detectLOAMFeaturesDetect LOAM feature points from 3-D lidar data (Since R2022a)
lidarObjectDetectorTrainingDataCreate training data for lidar object detection (Since R2022a)

Visualize Results

showShapeDisplay shapes on image, video, or point cloud (Since R2020b)
pcshowPlot 3-D point cloud

Evaluate Results

evaluateObjectDetectionEvaluate object detection data set against ground truth (Since R2023b)
objectDetectionMetricsObject detection quality metrics (Since R2023b)
bboxOverlapRatioCompute bounding box overlap ratio

Topics

Featured Examples