Khadas Docs

Amazing Khadas, always amazes you!

User Tools

Site Tools


products:sbc:vim4:add-ons:os08a10-mipi-camera

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
products:sbc:vim4:add-ons:os08a10-mipi-camera [2023/06/05 05:43]
nick
products:sbc:vim4:add-ons:os08a10-mipi-camera [2023/09/10 01:10] (current)
hyphop
Line 1: Line 1:
 +~~tag> VIM4 MIPI Camera ISP IP~~
 +
 +{{indexmenu_n>30}}
 +
 ====== VIM4 OS08A10 MIPI Camera ====== ====== VIM4 OS08A10 MIPI Camera ======
  
 ===== Introduction ===== ===== Introduction =====
  
-This document mainly introduces [[https://www.khadas.com/product-page/os08a10-8mp-camera | OS08A10 MIPI Camera]]. The document is divided into two parts,The first part of the document describes how to connect. The second part introduces How to record video via Gstreamer and test your camera under Ubuntu.+This document mainly introduces the usage of [[https://www.khadas.com/product-page/os08a10-8mp-camera | OS08A10 MIPI Camera]]. 
  
 ===== Hardware Connection ===== ===== Hardware Connection =====
Line 11: Line 15:
 </WRAP> </WRAP>
  
-{{/products/sbc/vim4/gallery/vim4-camera-os8a10.png?600|docs-vim4-camera-os8a10}}+{{/products/sbc/vim4/gallery/vim4-camera-os8a10.webp?600|docs-vim4-camera-os8a10}}
  
 ===== Identify VIM4 Version ===== ===== Identify VIM4 Version =====
Line 24: Line 28:
 Please check the [[products:sbc:vim4:configurations:identify-version| documentation]] to identify your VIM4 version. Please check the [[products:sbc:vim4:configurations:identify-version| documentation]] to identify your VIM4 version.
  
-===== VIM4 MIPI Camera Usage ===== +===== Upgrade System =====
- +
-==== Video Node ==== +
- +
-The video node for MIPI camera is ''/dev/video50''+
- +
-==== Record Video via Gstreamer ==== +
- +
- +
-=== Install Gstreamer Encoder Plugin === +
-```shell +
-sudo apt update +
-sudo apt install gstreamer-aml +
-``` +
- +
-=== Record Video === +
-```shell +
-gst-launch-1.0 v4l2src device=/dev/video50 io-mode=mmap num-buffers=300 ! video/x-raw,format=NV12 ! amlvenc bitrate=8000 ! h264parse ! qtmux ! filesink location=test_50.mp4 +
-``` +
- +
- +
-==== Record Video with OpenCV ==== +
- +
-=== Install OpenCV === +
- +
-```shell +
-sudo apt update +
-sudo apt install libopencv-dev python3-opencv +
-``` +
- +
-=== C++ === +
- +
- +
-== Get Frame via V4l2 == +
- +
-```c++ mipi-camera.cpp +
-#include <opencv2/highgui/highgui.hpp> +
-#include <opencv2/imgproc/imgproc.hpp> +
-#include <opencv2/core/core.hpp> +
-#include <iostream> +
-#include <string> +
-using +
-namespace  cv; +
- +
-using +
-namespace  std; +
- +
-int main(int argc, char** argv) +
-+
-    int count=100; +
-    string str = argv[1]; +
-    string res=str.substr(10); +
-    VideoCapture capture(stoi(res), CAP_V4L2); +
-    capture.set(CAP_PROP_FOURCC, VideoWriter::fourcc('U','Y','V','Y')); +
-    capture.set(CAP_PROP_FRAME_WIDTH, 1920); +
-    capture.set(CAP_PROP_FRAME_HEIGHT, 1080); +
-    while (count) +
-    { +
-        Mat frame; +
-        capture >> frame; +
- +
-        if (frame.empty()) { +
-            break; +
-        } +
-        int h = frame.rows; +
-        int w = frame.cols; +
-        const char *name = "video"; +
-        namedWindow(name, 0); +
-        imshow(name, frame); +
-        waitKey(30); +
-        count--; +
-    } +
-    return 0; +
-+
- +
-``` +
- +
- +
-== Get Frame via Gstreamer == +
- +
-```c++ mipi-camera.cpp +
-#include <opencv2/highgui/highgui.hpp> +
-#include <opencv2/imgproc/imgproc.hpp> +
-#include <opencv2/core/core.hpp> +
-#include <iostream> +
-#include <string> +
-using +
-namespace  cv; +
- +
-using +
-namespace  std; +
- +
-int main(int argc, char** argv) +
-+
-    int count=100; +
-    string str = argv[1]; +
-    string gstformat = "NV12"; +
-    string gstfile = "v4l2src device=" + str + " ! video/x-raw,format=" + gstformat + ",width=1920,height=1080,framerate=30/1 ! videoconvert ! appsink"; +
-    VideoCapture capture(gstfile); +
- +
-    while (count) +
-    { +
-        Mat frame; +
-        capture >> frame; +
- +
-        if (frame.empty()) { +
-            break; +
-        } +
-        int h = frame.rows; +
-        int w = frame.cols; +
-        const char *name = "video"; +
-        namedWindow(name, 0); +
-        imshow(name, frame); +
-        waitKey(30); +
-        count--; +
-    } +
-    return 0; +
-+
- +
-``` +
- +
-Compile: +
- +
-```shell +
-gcc -o mipi mipi-camera.cpp -lopencv_imgproc -lopencv_core -lopencv_videoio -lopencv_imgcodecs -lopencv_highgui -std=c++11 -std=gnu++11 -Wall -std=c++11 -lstdc++ -I/usr/include/opencv4 +
-``` +
- +
-Test: +
- +
-```shell +
-./mipi /dev/video50 +
-``` +
- +
-===== New VIM4 MIPI Camera Usage ===== +
- +
-==== Enable Overlays ==== +
- +
-If you want to use the OS08A10 MIPI camera, you need to enable it in [[products:sbc:vim4:configurations:device-tree-overlay|overlays]], you need to add ''vim4n-os08a10'' to ''fdt_overlays'' in ''/boot/dtb/amlogic/kvim4.dtb.overlay.env''+
- +
-``` +
-$ cat /boot/dtb/amlogic/kvim4.dtb.overlay.env  +
-fdt_overlays=vim4n-os08a10 +
-``` +
- +
-And then reboot to take effect. +
- +
-==== Video Node ==== +
- +
-The video node is ''/dev/media0'' +
- +
-==== Get Frames via Mediactl API ==== +
- +
-You can get the test source code here: https://github.com/numbqq/v4l2_media_test +
- +
-Download and build the test source code: +
- +
-``` +
-$ git clone https://github.com/numbqq/v4l2_media_test +
-$ cd v4l2_media_test +
-$ g++ v4l2_test_raw.cpp -o v4l2_test_raw  -Wall -Wno-int-to-pointer-cast -Wno-pointer-to-int-cast -pthread -fPIE -lispaml -ldl -lmediaAPI -ltuning -lm -fPIC -D_FORTIFY_SOURCE=2 -O3 +
-$ ls v4l2_test_raw +
-v4l2_test_raw +
-``` +
- +
-Test: +
- +
-``` +
-$ ./v4l2_test_raw -p 0 -n 100 -m /dev/media0 +
-``` +
- +
-It will capture 100 frames to file ''/tmp/dst_mif_0.yuv''.+
  
-Preview the file:+Please follow the [[products:sbc:vim4:configurations:upgrade-system|documentation ]]to upgrade your system to latest version.
  
-``` +===== Camera Usage =====
-$ ffplay -f rawvideo -pixel_format nv21 -video_size 3840x2160 /tmp/dst_mif_0.yuv+
  
-```+  * [[products:sbc:vim4:add-ons:vim4-mipi-camera|]] 
 +  * [[products:sbc:vim4:add-ons:new-vim4-mipi-camera|]]
  
 ===== See Also ===== ===== See Also =====
Line 207: Line 41:
   * [[pp>os08a10-8mp-camera|Buy OS08S10-8MP camera]]   * [[pp>os08a10-8mp-camera|Buy OS08S10-8MP camera]]
   * [[dl>products/add-ons/os08a10/|OS08A10 Hardware Documentations]]   * [[dl>products/add-ons/os08a10/|OS08A10 Hardware Documentations]]
-  
  
Last modified: 2023/06/05 05:43 by nick