Khadas Docs

Amazing Khadas, always amazes you!

User Tools

Site Tools


products:sbc:vim4:npu:demos:densenet

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
products:sbc:vim4:npu:demos:densenet [2024/10/28 21:11]
louis
products:sbc:vim4:npu:demos:densenet [2025/01/08 22:22] (current)
louis
Line 1: Line 1:
 ~~tag> NPU Densenet VIM4 ONNX~~ ~~tag> NPU Densenet VIM4 ONNX~~
-====== DenseNet CTC ONNX Keras VIM4 Demo - 3======+ 
 +**Doc for version ddk-3.4.7.7** 
 + 
 +====== DenseNet CTC ONNX Keras VIM4 Demo - 3 ======
  
 {{indexmenu_n>3}} {{indexmenu_n>3}}
Line 23: Line 26:
 ``` ```
  
-===== Get Convert Tool =====+==== Get the conversion tool ==== 
 + 
 +Download The conversion tool from [[gh>khadas/vim4_npu_sdk]].
  
 ```shell ```shell
-$ git lfs install +$ git clone https://github.com/khadas/vim4_npu_sdk
-$ git lfs clone https://gitlab.com/khadas/vim4_npu_sdk.git+
 $ cd vim4_npu_sdk $ cd vim4_npu_sdk
 +$ git lfs pull
 $ ls $ ls
-adla-toolkit-binary  adla-toolkit-binary-1.2.0. convert-in-docker.sh  Dockerfile  docs  README.md+adla-toolkit-binary  adla-toolkit-binary-3.1.7. convert-in-docker.sh  Dockerfile  docs  README.md
 ``` ```
  
Line 37: Line 42:
   * ''adla-toolkit-binary/demo'' - Conversion examples   * ''adla-toolkit-binary/demo'' - Conversion examples
  
-==== Get the conversion tool ====+<WRAP important> 
 +If your kernel is older than 241129, please use branch npu-ddk-1.7.5.5 
 +</WRAP>
  
-Download The conversion tool from [[gl>khadas/vim4_npu_sdk]]. +==== Convert ====
- +
-```shell +
-$ git clone https://gitlab.com/khadas/vim4_npu_sdk +
-```+
  
 After training the model, run the scripts as follows to modify net input and output and convert the model to ONNX. After training the model, run the scripts as follows to modify net input and output and convert the model to ONNX.
Line 72: Line 75:
 ``` ```
  
-Enter ''vim4_npu_sdk/demo'' and modify ''convert_adla.sh'' as follows. We should quantize the model to **int16** because it is very inaccurate with **int8**.+Enter ''vim4_npu_sdk/demo'' and modify ''convert_adla.sh'' as follows.
  
 ```bash convert_adla.sh ```bash convert_adla.sh
Line 92: Line 95:
         --dtypes "float32" \         --dtypes "float32" \
         --inference-input-type float32 \         --inference-input-type float32 \
- --inference-output-type float32 \ + --inference-output-type float32 \ 
-        --quantize-dtype int16 --outdir onnx_output  \+        --quantize-dtype int8 --outdir onnx_output  \
         --channel-mean-value "0,0,0,255"  \         --channel-mean-value "0,0,0,255"  \
         --source-file ./densenet_ctc_dataset.txt  \         --source-file ./densenet_ctc_dataset.txt  \
Line 116: Line 119:
 $ git clone https://github.com/khadas/vim4_npu_applications $ git clone https://github.com/khadas/vim4_npu_applications
 ``` ```
 +
 +<WRAP important>
 +If your kernel is older than 241129, please use version before tag ddk-3.4.7.7.
 +</WRAP>
  
 ==== Install dependencies ==== ==== Install dependencies ====
Line 128: Line 135:
 === Picture input demo === === Picture input demo ===
  
-Put ''densenet_ctc_int16.adla'' in ''vim4_npu_applications/densenet_ctc/data/''.+Put ''densenet_ctc_int8.adla'' in ''vim4_npu_applications/densenet_ctc/data/''.
  
 ```shell ```shell
Line 139: Line 146:
  
 # Run # Run
-sudo ./densenet_ctc -m ../data/densenet_ctc_int16.adla -p ../data/KhadasTeam.png+$ ./densenet_ctc -m ../data/densenet_ctc_int8.adla -p ../data/KhadasTeam.png
 ``` ```
  
-<WRAP tip >+{{:products:sbc:vim4:npu:demos:khadasteam.webp?400|}} 
 + 
 +{{:products:sbc:vim4:npu:demos:densenet-demo-output.webp?400|}} 
 + 
 +<WRAP tip>
 If your ''densenet_ctc'' - **DenseNet-CTC** model classes are not the same, please change ''data/class_str.txt'' and the ''OBJ_CLASS_NUM'' in ''include/postprocess.h''. If your ''densenet_ctc'' - **DenseNet-CTC** model classes are not the same, please change ''data/class_str.txt'' and the ''OBJ_CLASS_NUM'' in ''include/postprocess.h''.
 </WRAP> </WRAP>
  
Last modified: 2024/10/28 21:11 by louis