Resources

Overview

This page provides a curated collection of resources relevant to BBQS projects and working groups. You’ll find software tools and libraries for analysis, pre-trained ML models, multimodal datasets, evaluation benchmarks, academic publications, data platforms, and standards for consistent data sharing. Use the search below to filter resources by keywords, categories, target species, or working groups.

No matching resources found. Try a different search term.

General Tools

Software tools, libraries, or scripts used for analysis, visualization, tracking, etc.

idtracker.ai

Open-source multi-animal tracking software that can identify and track up to 100 unmarked animals in video, maintaining individual identities throughout the recording.

Entity Tracking Multi-Animal

SimBA - Simple Behavioral Analysis

Open-source pipeline and GUI for developing supervised behavioral classifiers. Supports DLC, DeepPoseKit, SLEAP, MARS and others.

Behavioral Analysis Multi-Animal

Bonsai

Visual programming language for synchronizing and processing heterogeneous data streams in real time

Data Collection

LabStreamingLayer (LSL)

Middleware framework for streaming and synchronizing multiple data sources (e.g. EEG, motion tracking, video, etc.) over a network.

Data Collection

Open Ephys

Open-source platform for electrophysiology hardware and software.

Experimental Design Hardware

DeepLabCut

Open-source toolbox for markerless pose estimation of animals using deep learning, allowing high-accuracy tracking of user-defined body parts across species.

Pose Estimation Behavioral Analysis

SLEAP (Social LEAP Estimates Animal Poses)

Open-source multi-animal pose tracking toolkit that uses deep learning to estimate positions of animal body landmarks, enabling tracking of multiple animals without markers.

Pose Estimation Behavioral Analysis

DeepPoseKit

Python toolkit for animal pose estimation using deep learning, providing a user-friendly way to train networks for tracking body landmarks in videos.

Pose Estimation

JAABA (Janelia Automatic Animal Behavior Annotator)

Machine learning-based software for analyzing and classifying animal behaviors from video data; allows users to train classifiers to recognize specific behaviors (originally developed for fruit fly studies).

Behavioral Analysis Fly

MARS (Mouse Action Recognition System)

Deep learning pipeline for automated pose estimation and social behavior classification in mice. MARS tracks multiple mice and identifies behaviors like attack, mounting, and investigation in pairwise interactions.

Behavioral Analysis Mouse

BENTO (Behavior Ensemble and Neural Trajectory Observatory)

Matlab-based interface for synchronizing and visualizing multimodal data streams (video, pose, neural recordings, audio, etc.), allowing researchers to link neural activity with behavioral events.

Data Analysis

Motion Sequencing (MoSeq)

Unsupervised behavior analysis method that decomposes 3D animal motion into sequences of repeatable modules or 'syllables'. Provides tools for depth-video capture and analysis to characterize spontaneous behaviors in mice.

Behavioral Analysis Mouse

OpenPose

Real-time multi-person 2D pose estimation library. OpenPose detects human body, hand, and facial keypoints in video, widely used for analyzing human posture and movements in natural interactions.

Pose Estimation Human

OpenFace

Open-source tool for facial behavior analysis. It can track facial landmarks, head pose, eye gaze, and facial action units, facilitating analysis of expressions and attention in human social interactions.

Facial Analysis Human

DeepSqueak

Deep learning-based software for detecting and analyzing ultrasonic vocalizations. Commonly used to automatically identify rodent calls in audio recordings, aiding studies of communication and affective state.

Audio Analysis Mouse

Anipose

Open-source toolkit for 3D pose estimation from multiple camera views.

Pose Estimation

Models

Pre-trained or reference AI/ML models.

DeepLabCut Model Zoo (Mackenzie Mathis, Hugging Face)

A collection of DeepLabCut pre-trained models for a wide array of animals, maintained by Mackenzie Mathis. Includes models for quadrupeds, mice, birds, humans, macaques, primates, horses, and more. See the Hugging Face profile for the full list and details.

Pose Estimation Model Quadruped Mouse Bird Human Macaque Primate Horse

DeepLabCut Organization (Hugging Face)

The official DeepLabCut organization on Hugging Face, hosting models and demos for animal pose estimation. Supports a wide array of species and provides links to the Model Zoo and related resources.

Pose Estimation Model Quadruped Bird Human

CEBRA: Consistent EmBeddings of high-dimensional Recordings using Auxiliary variables

Machine-learning method that can be used to compress time series in a way that reveals otherwise hidden structures in the variability of the data

Neural Data Data Analysis

Datasets

Collections of behavioral, neural, or multimodal data.

SuperAnimal-Quadruped-80K

Dataset aggregating quadruped animal images.

Dataset Quadruped

SuperAnimal-TopViewMouse-5K

Dataset aggregating top-view mouse images.

Dataset Mouse

Benchmarks

Evaluation suites or tasks used to compare models or methods.

DeepLabCut Benchmarks

Various benchmarks for animal pose estimation including TRI-MOUSE, PARENTING-MOUSE, MARMOSETS, FISH, HORSE-30.

Benchmark Dataset Mouse Marmoset Fish Horse

Animal Pose Estimation Leaderboard

Comparative leaderboard for animal pose estimation methods.

Benchmark Pose Estimation

DeepLabCut Leaderboard

Comparative leaderboard for DLC benchmarks.

Benchmark Pose Estimation

Papers & Protocols

Academic publications, protocols, or documentation for methods.

Using DeepLabCut for 3D Markerless Pose Estimation

Guidance on DLC for 3D pose estimation.

Paper Protocol Pose Estimation

DeepLabCut: Markerless Pose Estimation

Foundational paper on DLC technology.

Paper Pose Estimation

DeeperCut: Multi-person Pose Estimation

High-performance multi-person pose estimation.

Paper Pose Estimation Human

BRAIN Initiative Data Sharing Ecosystem (2024)

Overview and analysis of the NIH BRAIN Initiative's data archive ecosystem, comparing seven major neurodata repositories and discussing challenges in making neuroscience data more FAIR (Findable, Accessible, Interoperable, Reusable).

Data Sharing Paper

Platforms & Archives

Platforms or infrastructures that host, organize, or distribute data/tools.

OpenBehavior

Community-driven repository and blog highlighting open-source neuroscience tools and behavioral research methods. OpenBehavior aggregates resources for tracking, analysis, and hardware across species.

Community Resource

OpenNeuro

Free and open platform for sharing neuroscience data (primarily human brain imaging and electrophysiology) in BIDS format.

Data Repository Human

DANDI Archive

Data archive for neurophysiology and neuroimaging data, supporting the Neurodata Without Borders (NWB) format. DANDI enables sharing and reuse of large multimodal neuroscience datasets, aligning with FAIR data principles.

Data Repository

NIMH Data Archive (NDA)

Central repository for human subjects data (e.g., ABCD study) including behavioral, clinical, and neuroimaging data. NDA operates under controlled access with data use agreements, providing governance for sharing sensitive human data.

Data Repository Human

Standards & Ontologies

Definitions, formats, and ontologies to structure and share data consistently.

Brain Imaging Data Structure (BIDS)

A standard for organizing and describing neuroscience data to facilitate sharing and analysis.

Data Standard Human

Neurodata Without Borders (NWB)

Open standard format for neurophysiology data (neural recordings, behavioral events, etc.) to enhance sharing and integration.

Data Standard

Neuro Behavior Ontology (NBO)

Ontology of human and animal behaviors and behavioral phenotypes.

Ontology

Hierarchical Event Descriptors (HED)

Standardized tagging system for events and metadata in experiments. HED tags provide a consistent way to label events (e.g., stimuli, actions) in neurobehavioral datasets, improving interoperability and analysis.

Ontology

NIH BRAIN Initiative Neuroethics Guiding Principles

Eight principles outlining ethical considerations for brain research, emphasizing safety, autonomy, privacy of neural data, and public engagement.

Ethics and Governance

Open Brain Consent

Initiative providing standardized consent language and tools to facilitate sharing of human brain data.

Ethics and Governance Human

Contribution

To add resources or update existing entries, please reach out to the BBQS team.

Future Plans

We are working on integrating a chatbot that will connect to a database of JSON-organized resources, making it even easier to find the information you need. We are also working on an ingestion tool that will make it easier to add and update entries! Stay tuned for updates.