Khadas Docs

Amazing Khadas, always amazes you!

User Tools

Site Tools

Home / products / sbc / vim4 / npu / demos / retinaface
products:sbc:vim4:npu:demos:retinaface

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
products:sbc:vim4:npu:demos:retinaface [2023/09/18 01:43]
sravan [Retinaface Pytorch VIM4 Demo - 5] 		products:sbc:vim4:npu:demos:retinaface [2025/06/11 21:51] (current)
louis
Line 1: Line 1:
-~~tag> NPU Retinaface VIM4 Pytorch~~+~~tag> NPU RetinaFace VIM4 PyTorch~~
  
-====== Retinaface PyTorch VIM4 Demo - 5 ======+**Doc for version ddk-3.4.7.7** 
 + 
 +====== RetinaFace PyTorch VIM4 Demo - 5 ======
  
 {{indexmenu_n>5}} {{indexmenu_n>5}}
 +
 +===== Introduction =====
 +
 +RetinaFace is a face detection model. It can draw five key points on each face, including two eyes, nose and two corners of mouth.
 +
 +Inference results on VIM4.
 +
 +{{:products:sbc:vim4:npu:demos:retinaface-demo-output.webp?800|}}
 +
 +**Inference speed test**: USB camera about **78ms** per frame.
 +
 ===== Get source code ===== ===== Get source code =====
 +
 +[[gh>bubbliiiing/retinaface-pytorch]]
  
 ```shell ```shell
Line 32: Line 47:
 Follow Docker official documentation to install Docker: [[https://docs.docker.com/engine/install/ubuntu/|Install Docker Engine on Ubuntu]]. Follow Docker official documentation to install Docker: [[https://docs.docker.com/engine/install/ubuntu/|Install Docker Engine on Ubuntu]].
  
-Then fetch the prebuilt NPU Docker Container and run it.+Follow the script below to get Docker image:
  
 ```shell ```shell
-$ docker pull yanwyb/npu:v1 +docker pull numbqq/npu-vim4
-$ docker run -it --name vim4-npu1 -v $(pwd):/home/khadas/npu \ +
- -v /etc/localtime:/etc/localtime:ro \ +
- -v /etc/timezone:/etc/timezone:ro \ +
- yanwyb/npu:v1+
 ``` ```
  
-==== Get conversion tool ====+==== Get Convert Tool ====
  
-Download Tool from [[gl>khadas/vim4_npu_sdk]].+Download Tool from [[gh>khadas/vim4_npu_sdk]].
  
 ```shell ```shell
-$ git clone https://gitlab.com/khadas/vim4_npu_sdk+$ git lfs install 
 +$ git lfs clone https://github.com/khadas/vim4_npu_sdk 
 +$ cd vim4_npu_sdk 
 +$ ls 
 +adla-toolkit-binary  adla-toolkit-binary-3.1.7.4  convert-in-docker.sh  Dockerfile  docs  README.md
 ``` ```
 +
 +  * ''adla-toolkit-binary/docs'' - SDK documentations
 +  * ''adla-toolkit-binary/bin'' - SDK tools required for model conversion
 +  * ''adla-toolkit-binary/demo'' - Conversion examples
 +
 +<WRAP important>
 +If your kernel is older than 241129, please use branch npu-ddk-1.7.5.5.
 +</WRAP>
  
 ==== Convert ==== ==== Convert ====
  
-After training the model, we should convert the Pytorch model to ONNX model. Create the python conversion script as follows and run.+After training the model, we should convert the PyTorch model into an ONNX model. Create the Python conversion script as follows and run.
  
 ```python export.py ```python export.py
Line 89: Line 112:
         --dtypes "float32" \         --dtypes "float32" \
         --inference-input-type float32 \         --inference-input-type float32 \
- --inference-output-type float32 \+ --inference-output-type float32 \
         --quantize-dtype int8 --outdir onnx_output  \         --quantize-dtype int8 --outdir onnx_output  \
         --channel-mean-value "0,0,0,255"  \         --channel-mean-value "0,0,0,255"  \
Line 98: Line 121:
 ``` ```
  
-Run ''convert_adla.sh'' to generate VIM4 model. The converted model is ''xxx.adla'' in ''onnx_output''.+Run ''convert_adla.sh'' to generate the VIM4 model. The converted model is ''xxx.adla'' in ''onnx_output''.
  
 ```shell ```shell
Line 113: Line 136:
 $ git clone https://github.com/khadas/vim4_npu_applications $ git clone https://github.com/khadas/vim4_npu_applications
 ``` ```
 +
 +<WRAP important>
 +If your kernel is older than 241129, please use version before tag ddk-3.4.7.7.
 +</WRAP>
  
 ==== Install dependencies ==== ==== Install dependencies ====
Line 136: Line 163:
  
 # Run # Run
-$ sudo ./retinaface -m ../data/retinaface_int8.adla -p ../data/timg.jpg+$ ./retinaface -m ../data/retinaface_int8.adla -p ../data/timg.jpg
 ``` ```
  
Line 142: Line 169:
  
 Put ''retinaface_int8.adla'' in ''vim4_npu_applications/retinaface_cap/data/''. Put ''retinaface_int8.adla'' in ''vim4_npu_applications/retinaface_cap/data/''.
 +
 +== Compile ==
  
 ```shell ```shell
-# Compile +$ cd vim4_npu_applications/face_recognition_cap
-$ cd vim4_npu_applications/retinaface_cap+
 $ mkdir build $ mkdir build
 $ cd build $ cd build
 $ cmake .. $ cmake ..
 $ make $ make
 +```
  
-# Run +== Run== 
-$ sudo ./retinaface_cap -m ../data/retinaface_int8.adla -d 0 -w 1920 -h 1080+ 
 +**MIPI Camera** 
 + 
 +``` 
 +$ ./retinaface_cap -m ../data/retinaface_int8.adla -t mipi 
 +``` 
 + 
 +**USB Camera** 
 +``` 
 +$ cd build 
 +$ ./retinaface_cap -m ../data/retinaface_int8.adla -t usb -d 0
 ``` ```
  
-''0'' is camera device index.+**TIP**: Replace 0 as the number for your camera device. Such as ''/dev/video5'', it should be ''-d 5''.
  
Last modified: 2023/09/18 01:43 by sravan

Page Tools

Khadas Site

Khadas Community

Khadas GitHub

Khadas Downloads