Warning

This repository has been archived as further improvement is needed. The new repository is here.

Feature

Using Mediapipe to track pose in Unity.

Install

Follow the steps below.

1. This repositories clone please.

   https://github.com/NullClone/WebcamPoseTracker.git

2. Open in Unity 6000.0.43f1

Usage

Open the scene from Assets > Scenes > PoseTracking

Warning

If you use a webcam, don't forget to change the SourceType of ImageSource to Webcam and set the device.

Explanation

Inference Runner

Property Name			Description
Image Source			Get the output for the image source.
Performance Level			You can specify the performance level. Lite Full (Default) Heavy Selecting Heavy may slow down operation.
Backend Type			Types of backend uses to execute a neural network. CPU GPUCompute (Default) GPUPixel
Score Threshold			Filter results based on prediction scores.
Filter			You can specify the filter. None Kalman Filter (Default) Low Pass Filter (Default)
-	Kalman Filter		Time Interval Kalman filter time interval. Higher values will result in more agile movement but more jerky movements. Lower values will result in smoother movement but less movement. Noise The noise magnitude of the Kalman filter.
-	Low Pass Filter		Smooth Low Pass Filter smoothness. Changing the value does not affect the processing speed. N Order Enter the number of times to apply the Low Pass Filter.
Keypoints			Keypoints for debugging.

Roadmap

• Implementing Kalman Filter
• Implementing Low Pass Filter
• Multi Person Tracking

Reference

• https://ai.google.dev/edge/mediapipe/solutions/vision/pose_landmarker
• https://digital-standard.com/tdpt/