This is an old revision of the document!
Only New VIM4 supports NPU, you can check the version of your VIM4 here: VIM4 Versions
Only supports OpenCV4
$ sudo apt update $ sudo apt install libopencv-dev python3-opencv cmake
You need to download the source code to your VIM4 board and compile on it.
Clone the NPU demo applications to somewhere, e.g. ~/workspace:
$ mkdir ~/workspace $ cd ~/workspace $ git clone https://github.com/khadas/vim4_npu_applications $ cd vim4_npu_applications $ ls mobilenet_v2 nn_sdk yolov3 yolov3_cap yolov7_tiny yolov7_tiny_cap yolov8n yolov8n_cap
mobilenet_v2/yolov3/yolov3_cap/yolov7_tiny/yolov8n: Different demo for VIM4 NPU.nn_sdk: Dependencies required for compilation.
Take mobilenet_v2 as an example, other demos are the same.
$ cd mobilenet_v2 $ mkdir build && cd build $ cmake .. $ make
$ cd mobilenet_v2/build $ sudo ./mobilenetv2 ../data/mobilenetv2_int8.adla ../data/goldfish_224x224.jpg [sudo] password for khadas: 997: 0.273438 886: 0.031250 108: 0.023438 109: 0.019531 127: 0.019531
The demos of the Yolo series only support running under the desktop environment.
It needs to be edited before running, please refer to the compilation method of Mobilenet V2.
Detect picture:
$ cd yolov3/build $ sudo ./yolov3 -p ../data/1080p.bmp -m ../data/det_yolov3_int8.adla
Detection with camera:
$ cd yolov3_cap/build $ sudo ./yolov3_cap -m ../data/det_yolov3_int8.adla -d X -w 1920 -h 1080
x: the number for you camera device. such as /dev/video0, x is 0.
Detect picture:
$ cd yolov7_tiny/build $ sudo ./yolov7_tiny -p ../data/horses.jpg -m ../data/yolov7_tiny_int8.adla
Detection with camera:
$ cd yolov7_tiny_cap/build $ sudo ./yolov7_tiny_cap -m ../data/yolov7_tiny_int8.adla -d X -w 1920 -h 1080
Detect picture:
$ cd yolov8n/build $ sudo ./yolov8n -p ../data/horses.jpg -m ../data/yolov8n_int8.adla
Detection with camera:
$ cd yolov8n_tiny_cap/build $ sudo ./yolov8n_cap -m ../data/yolov8n_int8.adla -d X -w 1920 -h 1080