SLEAP Toolbox

A toolbox for native MATLAB integration of SLEAP for multi-animal pose tracking.
62 Downloads
Updated 11 Aug 2022

SLEAP Toolbox

View SLEAP Toolbox on File Exchange Open in MATLAB Online

A MATLAB® community toolbox for applying the SLEAP multi-animal pose estimation deep learning framework [1]. This toolbox is intended to make it easy to use SLEAP models natively in MATLAB.

🚧 SLEAP Toolbox is early stage. Interested in using it or helping to create future versions? See contact info below.

👀 See SLEAP Toolbox in action with this live script demo.

About SLEAP

SLEAP is an open source deep-learning based framework for multi-animal pose tracking. It can be used to track any type or number of animals by training neural networks from user-labeled frames.

Visualization of animal pose estimates with SLEAP-based models overlaid on a user data video frame

About SLEAP Toolbox

Currently, SLEAP Toolbox supports inference based on top-down models trained in SLEAP. To use it, you must first train a set of models from the SLEAP GUI (see tutorial).

SLEAP Toolbox supports the following key steps:

  • Import of top-down model components from SLEAP into MATLAB
  • Composition of a single composite top-down model as a DagNetwork object
  • Prediction of animal pose estimates per frame of user data
  • Visualization of animal pose estimates for user data within the MATLAB graphics system

The prediction step is carried out simply, via the function predict in the Deep Learning Toolbox™.

Pretrained models and sample data are included to help get started.

Using SLEAP Toolbox

Usage of SLEAP Toolbox is subject to its license terms.

Requirements

Installation

Installation via the Add-on Explorer is recommended. This will install the latest version from GitHub, adding the SLEAP Toolbox root folder to your MATLAB path.

Note: It is NOT necessary to have SLEAP installed in order to run this toolbox. You can train SLEAP on another machine, and then use this toolbox to predict on new data within MATLAB.

Getting Started

See the demo.

Contact

For support for this toolbox, please open a GitHub issue in this repository.

For general SLEAP support, check out the Official Documentation or the support forums on GitHub.

Please direct other inquiries and interest(❕) to talmo@salk.edu with "SLEAP Toolbox" included in the subject line.

References

[1] T.D. Pereira, N. Tabris, A. Matsliah, D. M. Turner, J. Li, S. Ravindranath, E. S. Papadoyannis, E. Normand, D. S. Deutsch, Z. Y. Wang, G. C. McKenzie-Smith, C. C. Mitelut, M. D. Castro, J. D’Uva, M. Kislin, D. H. Sanes, S. D. Kocher, S. S-H, A. L. Falkner, J. W. Shaevitz, and M. Murthy. SLEAP: A deep learning system for multi-animal pose tracking. Nature Methods, pp.1-10, 2022

Copyright and License Information

Copyright (c) 2019 - 2022 As Indicated Per File.
Distributed under license permitting academic and research use.
For commercial inquiries on using SLEAP for commercial applications, please see the relevant section in the main SLEAP repository.

Cite As

Talmo Pereira (2024). SLEAP Toolbox (https://github.com/talmolab/sleap-matlab/releases/tag/v1.0.2), GitHub. Retrieved .

Pereira, Talmo D., et al. “SLEAP: A Deep Learning System for Multi-Animal Pose Tracking.” Nature Methods, vol. 19, no. 4, Springer Science and Business Media LLC, Apr. 2022, pp. 486–95, doi:10.1038/s41592-022-01426-1.

View more styles
MATLAB Release Compatibility
Created with R2022a
Compatible with R2022a and later releases
Platform Compatibility
Windows macOS Linux
Categories
Find more on Behavior and Psychophysics in Help Center and MATLAB Answers

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

+sleap/+data

+sleap/+image

+sleap/+model

+sleap/+model/+topdown

+sleap/+model/+topdown/+internal

+sleap/+viz

original_demo

original_demo

Version Published Release Notes
1.0.2

See release notes for this release on GitHub: https://github.com/talmolab/sleap-matlab/releases/tag/v1.0.2

1.0.1

See release notes for this release on GitHub: https://github.com/talmolab/sleap-matlab/releases/tag/v1.0.1

1.0.0

See release notes for this release on GitHub: https://github.com/talmolab/sleap-matlab/releases/tag/v1.0.0

To view or report issues in this GitHub add-on, visit the GitHub Repository.
To view or report issues in this GitHub add-on, visit the GitHub Repository.