Only New VIM4 supports NPU, you can check the version of your VIM4 here: VIM4 Versions
Only supports OpenCV4.
You need to download the source code to your VIM4 board and compile on it.
Clone the NPU demo applications to somewhere, e.g. ~/workspace
:
$ mkdir ~/workspace $ cd ~/workspace $ git clone https://github.com/khadas/vim4_npu_applications $ cd vim4_npu_applications $ ls mobilenet_v2 nn_sdk yolov3 yolov3_cap yolov7_tiny yolov7_tiny_cap yolov8n yolov8n_cap
mobilenet_v2
, yolov3
, yolov3_cap
, yolov7_tiny
, yolov8n
- Different demo for VIM4 NPU.nn_sdk
- Dependencies required for compilation.$ sudo apt update $ sudo apt install libopencv-dev python3-opencv cmake
Take mobilenet_v2
as an example, other demos are the same.
$ cd mobilenet_v2 $ mkdir build && cd build $ cmake .. $ make
$ cd mobilenet_v2/build $ sudo ./mobilenetv2 ../data/mobilenetv2_int8.adla ../data/goldfish_224x224.jpg [sudo] password for khadas: 997: 0.273438 886: 0.031250 108: 0.023438 109: 0.019531 127: 0.019531
The demos of the Yolo series only support running under the desktop environment.
Before running, please compile the source code. The compilation method is same as Mobilenet V2
.
Detect picture:
$ cd yolov3/build $ sudo ./yolov3 -p ../data/1080p.bmp -m ../data/det_yolov3_int8.adla
Detection with camera:
$ cd yolov3_cap/build $ sudo ./yolov3_cap -m ../data/det_yolov3_int8.adla -d X -w 1920 -h 1080
x: the number for you camera device. such as /dev/video0
, x
is 0
.