Repository files navigation

Join our Mailing List! Sign up to stay up-to-date on our latest feature release, community events, blog posts, and more!

The Perception package provides a toolkit for generating large-scale synthetic datasets for computer vision training and validation.

🌟 Perception Synthetic Data Tutorial 🌟
Ideal for those new to either Unity, the Perception package, or synthetic data in general. Detailed instructions covering all the important steps: installing the Unity Editor, creating your first synthetic data generation project, adding domain randomization, visualizing, and analyzing your generated datasets.No prior experience required.

Quick Start Guide
Instructions for adding the Perception package to your existing project. Recommended for users already familiar with Unity and the Perception package. If this is the first time exploring our toolset, we highly recommend briefly going through thePerception Synthetic Data Tutorial below!

Human Pose Labeling and Randomization Tutorial
Step by step instructions for using the keypoint, pose, and animation randomization tools included in the Perception package. We recommend that you complete the Perception Tutorial above before diving into this guide!

Analyzing Datasets with Pysolotools
Introduction to Unity'spysolotools - a python package for parsing, converting, and analyzing a SOLO dataset. Step by step instructions on how to parse a SOLO dataset and look at the dataset statistics in ajupyter notebook.

Visualizing a Dataset with Voxel51 Viewer
We will walk through usingVoxel51 with ourcustom SOLO importer to visualize a dataset.

Converting to COCO
We will usepysolotools to convert a SOLO dataset into theCOCO format.

Check out our FAQ for a list of common questions, tips, tricks, and sample code for common code patterns.

In-depth documentation on specific components of the package. For the full set of feature-based documentation, take a look at theFeatures page.

Head over to theSynthetic Homes repository for a 100K image dataset of annotated synthetic home interiors for the purpose of training computer vision models, as well as a configurable Unity based stand alone application for generating such datasets.

TheSynthetic Humans package gives you the ability to procedurally generate and realistically place diverse groups of synthetic humans in your Unity Computer Vision projects.

PeopleSansPeople is a human-centric privacy-preserving synthetic data generator with highly parametrized domain randomization. This dataset generator contains simulation-ready 3D human assets, a parameterized lighting and camera system, and generates 2D and 3D bounding box, instance and semantic segmentation, and COCO pose labels.

SynthDet is an end-to-end solution for training a 2D object detection model using synthetic data.

TheRobotics Object Pose Estimation project demonstrates pick-and-place with a robot arm in Unity. It includes using ROS with Unity, importing URDF models, collecting labeled training data using the Perception package, and training and deploying a deep learning model.

This project has been discontinued and is no longer supported by Unity. Please use the Github issues page to seek community support.

The Perception package is licensed underApache License Version 2.0. If you find this package useful, consider citing it using:

@misc{unity-perception2022,    title={Unity {P}erception Package},    author={{Unity Technologies}},    howpublished={\url{https://github.com/Unity-Technologies/com.unity.perception}},    year={2020}}