Khadas Docs

Amazing Khadas, always amazes you!

User Tools

Site Tools

Home / products / sbc / vim3 / npu / npu-sdk
products:sbc:vim3:npu:npu-sdk

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Last revision Both sides next revision
products:sbc:vim3:npu:npu-sdk [2023/09/15 11:49]
sravan [Conversion Parameters] 		products:sbc:vim3:npu:npu-sdk [2024/04/18 04:34]
nick
Line 1: Line 1:
 ~~tag>VIM3 VIM3L Amlogic NPU SDK tensorflow pytorch~~ ~~tag>VIM3 VIM3L Amlogic NPU SDK tensorflow pytorch~~
  
-====== NPU SDK Usage ======+====== VIM3 NPU SDK Usage ======
  
-Basic information and examples about how to use Amlogic NPU SDK for VIM3 +Basic information and examples about how to use Amlogic NPU SDK for VIM3.
  
-/*===== Introduction =====+===== Build Docker Environment =====
  
-This document is an introduction to the structure of the NPU SDK. +We provided a docker image which contains the required environment to convert the model.
-*/+
  
-===== Get SDK =====+Follow Docker official docs to install Docker: [[https://docs.docker.com/engine/install/ubuntu/|Install Docker Engine on Ubuntu]]. 
 + 
 +Follow the command below to get Docker image: 
 + 
 +```shell 
 +docker pull docker pull numbqq/npu-vim3 
 +``` 
 + 
 +===== Get NPU SDK =====
  
 Get source: [[gh>khadas/aml_npu_sdk]] Get source: [[gh>khadas/aml_npu_sdk]]
  
 ```shell ```shell
-$ mkdir workspace && cd workspace +mkdir workspace && cd workspace 
-$ git clone --recursive https://github.com/khadas/aml_npu_sdk+git clone --recursive https://github.com/khadas/aml_npu_sdk
 ``` ```
  
Line 26: Line 33:
 $ cd aml_npu_sdk $ cd aml_npu_sdk
 $ ls $ ls
-acuity-toolkit  android_sdk  Dockerfile  docs  LICENSE  linux_sdk  README.md+acuity-toolkit  android_sdk  convert-in-docker.sh  Dockerfile  docs  LICENSE  linux_sdk  README.md
 ``` ```
  
Line 46: Line 53:
  
 ```shell ```shell
-$ cd aml_npu_sdk/acuity-toolkit +$ ls acuity-toolkit
-$ ls+
 bin  demo  python  ReadMe.txt  requirements.txt bin  demo  python  ReadMe.txt  requirements.txt
 ``` ```
Line 63: Line 69:
 ``` ```
  
-==== Dependencies Installation ====+===== Convert Model =====
  
-The environment package dependencies required by the conversion tool can be installed directly on the PC or installed through the [[https://docs.python.org/3/library/venv.html | virtual environment]].+Convert the demo model in docker:
  
 ```shell ```shell
-$ cd aml_npu_sdk/acuity-toolkit +./convert-in-docker.sh
-$ cat requirements.txt +
-tensorflow==2.0.0 +
-astor==0.8.0 +
-numpy==1.18.0 +
-scipy==1.1.0 +
-Pillow==5.3.0 +
-protobuf==3.11.2 +
-networkx>=1.11 +
-image==1.5.5 +
-lmdb==0.93 +
-onnx==1.6.0 +
-h5py==2.10.0 +
-flatbuffers==1.10 +
-matplotlib==2.1.0 +
-dill==0.2.8.2 +
-ruamel.yaml==0.15.81 +
-ply==3.11 +
-torch==1.2.0+
 ``` ```
  
-Here, ''tensorflow==2.0.0'' can be replaced by ''tensorflow==2.0.0a0''.+The script ''convert-in-docker.sh'' will enter docker container and then execute the conversion scripts below: 
 +  * acuity-toolkit/demo/0_import_model.sh 
 +  * acuity-toolkit/demo/1_quantize_model.sh 
 +  * acuity-toolkit/demo/2_export_case_code.sh 
  
 ==== Conversion Scripts ==== ==== Conversion Scripts ====
  
-The conversion script is in the ''acuity-toolkit/demo'' directory,+The conversion scripts are in the ''acuity-toolkit/demo'' directory,
  
 ```shell ```shell
-$ cd aml_npu_sdk/acuity-toolkit/demo +$ ls acuity-toolkit/demo/*.sh -1 
-$ ls -1 +acuity-toolkit/demo/0_import_model.sh 
-data +acuity-toolkit/demo/1_quantize_model.sh 
-model +acuity-toolkit/demo/2_export_case_code.sh 
-0_import_model.sh +acuity-toolkit/demo/inference.sh
-1_quantize_model.sh +
-2_export_case_code.sh +
-extractoutput.py +
-inference.sh +
-``` +
- +
-Use these scripts to convert Neural Network models into a format compatible with the VIM3 NPU. +
- +
-```shell +
-$ cd aml_npu_sdk/acuity-toolkit/demo +
-$ bash 0_import_model.sh && bash 1_quantize_model.sh && bash 2_export_case_code.sh +
 ``` ```
  
Line 117: Line 98:
   * ''1_quantize_model.sh'' - Quantize model script. Now, it can quantize model in ''int8'', ''int16'' and ''uint8''.   * ''1_quantize_model.sh'' - Quantize model script. Now, it can quantize model in ''int8'', ''int16'' and ''uint8''.
   * ''2_export_case_code.sh'' - Export model script. If you use ''VIM3'', please set ''optimize'' to ''VIPNANOQI_PID0X88''. If use ''VIM3L'', please set ''optimize'' to ''VIPNANOQI_PID0X99''.   * ''2_export_case_code.sh'' - Export model script. If you use ''VIM3'', please set ''optimize'' to ''VIPNANOQI_PID0X88''. If use ''VIM3L'', please set ''optimize'' to ''VIPNANOQI_PID0X99''.
 +
 +<WRAP tip >
 +If you want to convert your own model, just modify converion scripts ''0_import_model.sh'', ''1_quantize_model.sh'', ''2_export_case_code.sh'' and  then execute ''./convert-in-docker.sh'' to convert your model.
 +</WRAP>
 +
  
 After the conversion is completed, you can see the converted code in the ''xxxx_nbg_unify'' directory. Converted model is ''xxxx.nb''. Here is the built-in model as an example. After the conversion is completed, you can see the converted code in the ''xxxx_nbg_unify'' directory. Converted model is ''xxxx.nb''. Here is the built-in model as an example.
  
 ```shell ```shell
-$ cd aml_npu_sdk/acuity-toolkit/demo/mobilenet_tf_nbg_unify +$ ls acuity-toolkit/demo/mobilenet_tf_nbg_unify
-$ ls+
 BUILD BUILD
 makefile.linux makefile.linux
Last modified: 2024/04/18 04:34 by nick

Page Tools

Khadas Site

Khadas Community

Khadas GitHub

Khadas Downloads