Hugging Face's logo

qualcomm
/
MediaPipe-Pose-Estimation

Keypoint Detection
PyTorch
TF Lite
ONNX
real_time
android
Model card Files Community
1
bhushans commited on
Commit
0997231
·
verified ·
1 Parent(s): d13b7d8

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +34 -31
README.md CHANGED
@@ -36,32 +36,34 @@ More details on model performance across various devices, can be found
36
 
37
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
38
  |---|---|---|---|---|---|---|---|---|
39
- | MediaPipePoseDetector | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 0.78 ms | 0 - 11 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
40
- | MediaPipePoseDetector | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 1.01 ms | 0 - 4 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.onnx](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.onnx) |
41
- | MediaPipePoseDetector | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 0.56 ms | 0 - 46 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
42
- | MediaPipePoseDetector | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 0.734 ms | 0 - 49 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.onnx](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.onnx) |
43
- | MediaPipePoseDetector | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 0.563 ms | 0 - 24 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
44
- | MediaPipePoseDetector | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 0.757 ms | 0 - 26 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.onnx](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.onnx) |
45
- | MediaPipePoseDetector | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 0.775 ms | 0 - 5 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
46
- | MediaPipePoseDetector | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 0.774 ms | 0 - 1 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
47
- | MediaPipePoseDetector | SA8775 (Proxy) | SA8775P Proxy | TFLITE | 0.776 ms | 0 - 1 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
48
- | MediaPipePoseDetector | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 0.772 ms | 0 - 1 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
49
- | MediaPipePoseDetector | SA8295P ADP | SA8295P | TFLITE | 2.347 ms | 0 - 20 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
50
- | MediaPipePoseDetector | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 1.902 ms | 0 - 41 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
51
- | MediaPipePoseDetector | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.062 ms | 3 - 3 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.onnx](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.onnx) |
52
- | MediaPipePoseLandmarkDetector | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 0.819 ms | 0 - 2 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
53
- | MediaPipePoseLandmarkDetector | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 1.321 ms | 0 - 9 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.onnx](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.onnx) |
54
- | MediaPipePoseLandmarkDetector | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 0.615 ms | 0 - 90 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
55
- | MediaPipePoseLandmarkDetector | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 1.0 ms | 0 - 95 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.onnx](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.onnx) |
56
- | MediaPipePoseLandmarkDetector | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 0.469 ms | 0 - 35 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
57
- | MediaPipePoseLandmarkDetector | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 0.915 ms | 0 - 42 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.onnx](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.onnx) |
58
- | MediaPipePoseLandmarkDetector | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 0.802 ms | 0 - 1 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
59
- | MediaPipePoseLandmarkDetector | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 0.824 ms | 0 - 2 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
60
- | MediaPipePoseLandmarkDetector | SA8775 (Proxy) | SA8775P Proxy | TFLITE | 0.827 ms | 0 - 2 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
61
- | MediaPipePoseLandmarkDetector | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 0.816 ms | 0 - 5 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
62
- | MediaPipePoseLandmarkDetector | SA8295P ADP | SA8295P | TFLITE | 5.116 ms | 0 - 39 MB | FP16 | GPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
63
- | MediaPipePoseLandmarkDetector | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 1.799 ms | 0 - 79 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
64
- | MediaPipePoseLandmarkDetector | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.405 ms | 8 - 8 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.onnx](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.onnx) |
 
 
65
 
66
 
67
 
@@ -126,7 +128,7 @@ MediaPipePoseDetector
126
  Device : Samsung Galaxy S23 (13)
127
  Runtime : TFLITE
128
  Estimated inference time (ms) : 0.8
129
- Estimated peak memory usage (MB): [0, 11]
130
  Total # Ops : 106
131
  Compute Unit(s) : NPU (106 ops)
132
 
@@ -135,7 +137,7 @@ MediaPipePoseLandmarkDetector
135
  Device : Samsung Galaxy S23 (13)
136
  Runtime : TFLITE
137
  Estimated inference time (ms) : 0.8
138
- Estimated peak memory usage (MB): [0, 2]
139
  Total # Ops : 219
140
  Compute Unit(s) : NPU (219 ops)
141
  ```
@@ -156,11 +158,12 @@ in memory using the `jit.trace` and then call the `submit_compile_job` API.
156
  import torch
157
 
158
  import qai_hub as hub
159
- from qai_hub_models.models.mediapipe_pose import MediaPipePoseDetector,MediaPipePoseLandmarkDetector
160
 
161
  # Load the model
162
- pose_detector_model = MediaPipePoseDetector.from_pretrained()
163
- pose_landmark_detector_model = MediaPipePoseLandmarkDetector.from_pretrained()
 
164
 
165
  # Device
166
  device = hub.Device("Samsung Galaxy S23")
 
36
 
37
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
38
  |---|---|---|---|---|---|---|---|---|
39
+ | MediaPipePoseDetector | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 0.777 ms | 0 - 22 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
40
+ | MediaPipePoseDetector | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 0.997 ms | 0 - 4 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.onnx](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.onnx) |
41
+ | MediaPipePoseDetector | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 0.56 ms | 0 - 17 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
42
+ | MediaPipePoseDetector | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 0.744 ms | 0 - 50 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.onnx](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.onnx) |
43
+ | MediaPipePoseDetector | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 0.57 ms | 0 - 12 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
44
+ | MediaPipePoseDetector | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 0.756 ms | 0 - 26 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.onnx](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.onnx) |
45
+ | MediaPipePoseDetector | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 0.77 ms | 0 - 58 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
46
+ | MediaPipePoseDetector | SA7255P ADP | SA7255P | TFLITE | 37.961 ms | 0 - 13 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
47
+ | MediaPipePoseDetector | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 0.772 ms | 0 - 7 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
48
+ | MediaPipePoseDetector | SA8295P ADP | SA8295P | TFLITE | 2.335 ms | 0 - 10 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
49
+ | MediaPipePoseDetector | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 0.772 ms | 0 - 91 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
50
+ | MediaPipePoseDetector | SA8775P ADP | SA8775P | TFLITE | 1.784 ms | 0 - 11 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
51
+ | MediaPipePoseDetector | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 1.9 ms | 0 - 14 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.tflite) |
52
+ | MediaPipePoseDetector | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.073 ms | 4 - 4 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.onnx](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseDetector.onnx) |
53
+ | MediaPipePoseLandmarkDetector | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 0.821 ms | 0 - 44 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
54
+ | MediaPipePoseLandmarkDetector | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 1.309 ms | 0 - 44 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.onnx](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.onnx) |
55
+ | MediaPipePoseLandmarkDetector | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 0.603 ms | 0 - 22 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
56
+ | MediaPipePoseLandmarkDetector | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 0.968 ms | 0 - 98 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.onnx](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.onnx) |
57
+ | MediaPipePoseLandmarkDetector | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 0.553 ms | 0 - 19 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
58
+ | MediaPipePoseLandmarkDetector | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 0.912 ms | 0 - 45 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.onnx](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.onnx) |
59
+ | MediaPipePoseLandmarkDetector | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 0.801 ms | 0 - 44 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
60
+ | MediaPipePoseLandmarkDetector | SA7255P ADP | SA7255P | TFLITE | 17.243 ms | 0 - 19 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
61
+ | MediaPipePoseLandmarkDetector | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 0.803 ms | 0 - 11 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
62
+ | MediaPipePoseLandmarkDetector | SA8295P ADP | SA8295P | TFLITE | 1.417 ms | 0 - 14 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
63
+ | MediaPipePoseLandmarkDetector | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 0.832 ms | 0 - 234 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
64
+ | MediaPipePoseLandmarkDetector | SA8775P ADP | SA8775P | TFLITE | 1.629 ms | 0 - 20 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
65
+ | MediaPipePoseLandmarkDetector | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 1.004 ms | 0 - 17 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.tflite](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.tflite) |
66
+ | MediaPipePoseLandmarkDetector | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.389 ms | 8 - 8 MB | FP16 | NPU | [MediaPipe-Pose-Estimation.onnx](https://huggingface.co/qualcomm/MediaPipe-Pose-Estimation/blob/main/MediaPipePoseLandmarkDetector.onnx) |
67
 
68
 
69
 
 
128
  Device : Samsung Galaxy S23 (13)
129
  Runtime : TFLITE
130
  Estimated inference time (ms) : 0.8
131
+ Estimated peak memory usage (MB): [0, 22]
132
  Total # Ops : 106
133
  Compute Unit(s) : NPU (106 ops)
134
 
 
137
  Device : Samsung Galaxy S23 (13)
138
  Runtime : TFLITE
139
  Estimated inference time (ms) : 0.8
140
+ Estimated peak memory usage (MB): [0, 44]
141
  Total # Ops : 219
142
  Compute Unit(s) : NPU (219 ops)
143
  ```
 
158
  import torch
159
 
160
  import qai_hub as hub
161
+ from qai_hub_models.models.mediapipe_pose import Model
162
 
163
  # Load the model
164
+ model = Model.from_pretrained()
165
+ pose_detector_model = model.pose_detector
166
+ pose_landmark_detector_model = model.pose_landmark_detector
167
 
168
  # Device
169
  device = hub.Device("Samsung Galaxy S23")