Khadas Docs

Amazing Khadas, always amazes you!

User Tools

Site Tools


products:sbc:vim3:npu:npu-sdk

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
products:sbc:vim3:npu:npu-sdk [2023/09/11 03:48]
hyphop [Conversion Parameters]
products:sbc:vim3:npu:npu-sdk [2023/09/15 11:49]
sravan [Conversion Parameters]
Line 1: Line 1:
-~~tag>VIM3 VIM3L NPU SDK~~+~~tag>VIM3 VIM3L Amlogic NPU SDK tensorflow pytorch~~
  
 ====== NPU SDK Usage ====== ====== NPU SDK Usage ======
  
-===== Introduction =====+Basic information and examples about how to use Amlogic NPU SDK for VIM3 
  
-This document is an introduction to the structure of the NPU SDK.+/*===== Introduction =====
  
 +This document is an introduction to the structure of the NPU SDK.
 +*/
  
 ===== Get SDK ===== ===== Get SDK =====
Line 14: Line 16:
 ```shell ```shell
 $ mkdir workspace && cd workspace $ mkdir workspace && cd workspace
-$ git clone --recursive https://github.com/khadas/aml_npu_sdk.git+$ git clone --recursive https://github.com/khadas/aml_npu_sdk
 ``` ```
  
 ===== SDK Structure ===== ===== SDK Structure =====
  
-Enter the SDK directory,+Enter inside SDK directory ''aml_npu_sdk''
  
 ```shell ```shell
Line 30: Line 32:
  
 ``` ```
-acuity-toolkit    #Conversion tool , used to convert AI models +acuity-toolkit    # Conversion tool, used to convert AI models 
-android_sdk       #Android SDK +android_sdk       # Android SDK 
-docs              #Conversion related documents collection+docs              # Conversion-related documents collection
 ``` ```
  
-<WRAP tip +<WRAP info 
-Since all linux codes have been supports local compiled, host compilation is no longer supported. Therefore, the contents of ''linux_sdk'' have been completely removed.+Since all linux code can now be locally compiled on the device, host compilation is no longer supported. Therefore, the contents of ''linux_sdk'' have been completely removed.
 </WRAP> </WRAP>
  
Line 52: Line 54:
  
 ``` ```
-1. bin                   #Conversion is a collection of various tools used, most of which are not open source. +bin                   # Conversion is a collection of various tools used, most of which are not open source. 
-2. demo                  #Conversion script directory, convert AI model location +demo                  # Conversion script directory, convert AI model location 
-3. demo_hybird           #Mixed Input Conversion Tool +demo_hybird           # Mixed Input Conversion Tool 
-4. mulity_input_demo     #mulity input demo +mulity_input_demo     # mulity input demo 
-5. python                #Used to convert the model and data corresponding to the python API +python                # Used to convert the model and data corresponding to the Python API 
-6. ReadMe.txt            #ReadMe.txt file explains how to convert and use +ReadMe.txt            # ReadMe.txt file explains how to convert and use 
-7. requirements.txt      #Conversion tool dependent environment+requirements.txt      # Conversion tool dependent environment
 ``` ```
  
Line 89: Line 91:
 Here, ''tensorflow==2.0.0'' can be replaced by ''tensorflow==2.0.0a0''. Here, ''tensorflow==2.0.0'' can be replaced by ''tensorflow==2.0.0a0''.
  
-==== Conversion Script ====+==== Conversion Scripts ====
  
 The conversion script is in the ''acuity-toolkit/demo'' directory, The conversion script is in the ''acuity-toolkit/demo'' directory,
Line 105: Line 107:
 ``` ```
  
-Use scripts to convert AI models.+Use these scripts to convert Neural Network models into a format compatible with the VIM3 NPU.
  
 ```shell ```shell
Line 112: Line 114:
 ``` ```
  
-  * ''0_import_model.sh'' - Import model script. Now, it supports loading Tensorflow, Caffe, Tensorflow Lite, Onnx, Keras, Pytorch and Darknet model+  * ''0_import_model.sh'' - Import model script. Now, it supports loading Tensorflow, Caffe, Tensorflow Lite, Onnx, Keras, Pytorchand Darknet models
-  * ''1_quantize_model.sh'' - Quantize model script. Now, it can quantize model in int8, int16 and uint8.+  * ''1_quantize_model.sh'' - Quantize model script. Now, it can quantize model in ''int8''''int16'' and ''uint8''.
   * ''2_export_case_code.sh'' - Export model script. If you use ''VIM3'', please set ''optimize'' to ''VIPNANOQI_PID0X88''. If use ''VIM3L'', please set ''optimize'' to ''VIPNANOQI_PID0X99''.   * ''2_export_case_code.sh'' - Export model script. If you use ''VIM3'', please set ''optimize'' to ''VIPNANOQI_PID0X88''. If use ''VIM3L'', please set ''optimize'' to ''VIPNANOQI_PID0X99''.
  
Line 121: Line 123:
 $ cd aml_npu_sdk/acuity-toolkit/demo/mobilenet_tf_nbg_unify $ cd aml_npu_sdk/acuity-toolkit/demo/mobilenet_tf_nbg_unify
 $ ls $ ls
-BUILD   makefile.linux   mobilenettf.vcxproj  vnn_global.h       vnn_mobilenettf.h   vnn_post_process.h  vnn_pre_process.h +BUILD 
-main.c  mobilenet_tf.nb  nbg_meta.json        vnn_mobilenettf.c  vnn_post_process.c  vnn_pre_process.c+makefile.linux 
 +mobilenettf.vcxproj 
 +main.c 
 +mobilenet_tf.nb 
 +nbg_meta.json 
 +vnn_global.h 
 +vnn_mobilenettf.h 
 +vnn_post_process.h 
 +vnn_pre_process.h 
 +vnn_mobilenettf.c 
 +vnn_post_process.c 
 +vnn_pre_process.c
 ``` ```
  
 <WRAP important > <WRAP important >
-If your model's input is not a three-channel image, please convert input data to npy format.+If your model's input is not a three-channel image, please convert input data to ''npy'' format.
 </WRAP> </WRAP>
  
Line 133: Line 146:
 For the conversion parameters and settings, please refer to: For the conversion parameters and settings, please refer to:
   * [[gh>khadas/aml_npu_sdk/tree/master/docs/en]]   * [[gh>khadas/aml_npu_sdk/tree/master/docs/en]]
-  * [[https://github.com/khadas/aml_npu_sdk/blob/master/docs/en/Model%20Transcoding%20and%20Running%20User%20Guide%20(1.0).pdf|Model Transcoding and Running User Guide]]+  * [[gh>khadas/aml_npu_sdk/blob/master/docs/en/Model Transcoding and Running User Guide (1.0).pdf|Model Transcoding and Running User Guide]]
  
Last modified: 2024/04/18 04:34 by nick