[Query] Will this driver works for android as well? #537

Learner379 · 2020-08-04T11:48:40Z

Learner379
Aug 4, 2020

Hi,

I am new to this, Can anybody please share me the exact steps to create the virtual camera device/loop back device in android.

Thank you

umlaeute · 2020-08-09T19:20:18Z

umlaeute
Aug 9, 2020
Maintainer

try it out ;-)
you will need the kernel-headers for the exact version of your target system to compile the module.
also, i'm pretty sure (but have no idea, tbh) that from a security standpoint you cannot just ship a kernel-module and insert it into some stock android image (kernel-space is way beyond sudo; so you need at least a rooted device to be able to load the driver).

apart from that: i don't see any immediate problems (but again: i have no idea)

0 replies

Learner379 · 2021-05-17T06:59:54Z

Learner379
May 17, 2021
Author

Hi @umlaeute

Thanks for your reply.

I tried compiling the v4l2loopback driver on Android, able to load and create virtual camera nodes successfully. But when i try to capture a video from this virtual camera device, below issue is observed. Please find the steps, i am following.

1.insmod v4l2loopback.ko exclusive_caps=1 video_nr=23,24 => This is creating the /dev/video23 and /dev/video24 nodes.
2. ffmpeg -i /dev/video10 -f v4l2 -pix_fmt yuv420p /dev/video23 => using ffmpeg cmd, am feeding USB camera(/dev/video10) on to the virtual camera node.
3. ffmpeg -f v4l2 -i /dev/video23 -vframes 1 /sdcard/test.jpeg => Able to capture the single frame jpeg image from virtual camra node as well.
4. But capturing a video or feeding this virtual camera node on to the another virtual camera node is failing with below error.

ffmpeg -i /dev/video23 -f v4l2 -pix_fmt yuv420p /dev/video24
ffmpeg version n3.0.1 Copyright (c) 2000-2016 the FFmpeg developers
built with gcc 4.8 (GCC)
configuration: --target-os=linux --cross-prefix=/home/vagrant/SourceCode/ffmpeg-android/toolchain-android/bin/arm-linux-androideabi- --arch=arm --cpu=cortex-a8 --enable-runtime-cpudetect --sysroot=/home/vagrant/SourceCode/ffmpeg-android/toolchain-android/sysroot --enable-pic --enable-libx264 --enable-libass --enable-libfreetype --enable-libfribidi --enable-libmp3lame --enable-fontconfig --enable-pthreads --disable-debug --disable-ffserver --enable-version3 --enable-hardcoded-tables --disable-ffplay --disable-ffprobe --enable-gpl --enable-yasm --disable-doc --disable-shared --enable-static --pkg-config=/home/vagrant/SourceCode/ffmpeg-android/ffmpeg-pkg-config --prefix=/home/vagrant/SourceCode/ffmpeg-android/build/armeabi-v7a --extra-cflags='-I/home/vagrant/SourceCode/ffmpeg-android/toolchain-android/include -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -fno-strict-overflow -fstack-protector-all' --extra-ldflags='-L/home/vagrant/SourceCode/ffmpeg-android/toolchain-android/lib -Wl,-z,relro -Wl,-z,now -pie' --extra-libs='-lpng -lexpat -lm' --extra-cxxflags=
libavutil 55. 17.103 / 55. 17.103
libavcodec 57. 24.102 / 57. 24.102
libavformat 57. 25.100 / 57. 25.100
libavdevice 57. 0.101 / 57. 0.101
libavfilter 6. 31.100 / 6. 31.100
libswscale 4. 0.100 / 4. 0.100
libswresample 2. 0.101 / 2. 0.101
libpostproc 54. 0.100 / 54. 0.100
[video4linux2,v4l2 @ 0xeff24000] ioctl(VIDIOC_DQBUF): Invalid argument
Input #0, video4linux2,v4l2, from '/dev/video23':
Duration: N/A, bitrate: 110592 kb/s
Stream #0:0: Video: rawvideo (I420 / 0x30323449), yuv420p, 640x480, 110592 kb/s, 30 fps, 30 tbr, 1000k tbn, 1000k tbc
Output #0, v4l2, to '/dev/video24':
Metadata:
encoder : Lavf57.25.100
Stream #0:0: Video: rawvideo (I420 / 0x30323449), yuv420p, 640x480, q=2-31, 200 kb/s, 30 fps, 30 tbn, 30 tbc
Metadata:
encoder : Lavc57.24.102 rawvideo
Stream mapping:
Stream #0:0 -> #0:0 (rawvideo (native) -> rawvideo (native))
Press [q] to stop, [?] for help
[video4linux2,v4l2 @ 0xeff24000] ioctl(VIDIOC_DQBUF): Invalid argument
/dev/video23: Invalid argument
frame= 1 fps=0.0 q=-0.0 Lsize=N/A time=00:00:00.03 bitrate=N/A speed=0.599x
video:450kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown

Can you please help me in resolving this error.

Thanks.

0 replies

fan3k · 2021-08-01T05:24:05Z

fan3k
Aug 1, 2021

Hey @Learner379 and you make this? How to? I need to replace a photo.

0 replies

Learner379 · 2021-08-05T04:21:27Z

Learner379
Aug 5, 2021
Author

Hey @fan3k ,

Looks like the ffmpeg binary which I was using in android was buggy, as I was not able to stream physical usb camera also. So, I tried adding virtual camera node in to the camerHAL to make it work with the camera applications, but was not succeeded here also.

Please let me know if you have any inputs. And also what is the exact issue which you are facing?

0 replies

Learner379 · 2021-08-05T04:22:32Z

Learner379
Aug 5, 2021
Author

@umlaeute , Did you try to make this repo work on Android?

0 replies

deeox · 2021-09-09T12:46:48Z

deeox
Sep 9, 2021

@Learner379 Can you please provide the steps to took to compile the kernel module for android? Trying to make this work on Pixel 5.

0 replies

rediceli · 2021-09-27T09:37:20Z

rediceli
Sep 27, 2021

@deeox

Build v4l2loopback for android need the kernel source (or headers & symbols) use to build your android image.
A Hard & Hack way I did on my device (The chance of success is small):

Download kernel source which fix your android kernel version. Use vendor's kernel source if you can.
Get the kernel config from device ( /proc/config.gz). If not exists, FAIL & STOP;
Get the boot.img from device: try to find it at /dev/block/by-name. If not found, FAIL & STOP;
Use unboot to get kernel from boot.img (boot.img-kernel), If fail, STOP;
Use extract-symvers to get the 'Module.symvers' which need to build the external module of the kernel. if fail, STOP
Prepare kernel:

cd kernel-source-dir
cat  your_config_gz_dir/config.gz > .config
make silentoldconfig prepare headers_install scripts
cp what_your_module_symvers_is/Module.symvers .

build v4l2loopback:

cd v4l2loopback
make ARCH=arm64 CROSS_COMPILE=aarch64-linux-gnu- M=`pwd` -C <YOUR_KERNEL_SOURCE_DIR> modules

or 

make ARCH=arm CROSS_COMPILE=arm-linux-gnu- M=`pwd` -C <YOUR_KERNEL_SOURCE_DIR> modules

May still fail if the kernel is signed or some symbol not match ( because of vendor's patch or missing files etc.)

I did all upper steps success BUT the Android9 (on my rockchip board) not recognize v4l2loopback virtual camera as a system camera. Another virtual camera solution akvcam work, but not support compress H264 format.

Still working in progress...

0 replies

rediceli · 2021-09-29T03:38:06Z

rediceli
Sep 29, 2021

According to the android souce (hardware/interfaces/camera/device/3.4/default/ExternalCameraDevice.cpp), the V4L2 video device must be act as a VIDEO_CAPTURE device and support V4L2_PIX_FMT_MJPEG or V4L2_PIX_FMT_YUYV once it first connected (and never check again). So, the current v4l2loopback can not support android (to use as a camera).

To fix this, I patch the source with:

Set default video caps to V4L2_PIX_FMT_YUYV;
set keep_format=1 and ready_for_capture=1 by default;

Now, the camera APP detect the virtual device (without crash), but when I write YUYV422 stream, camera read nothing

diff --git a/v4l2loopback.c b/v4l2loopback.c
index 9da2508..e0ec3a6 100644
--- a/v4l2loopback.c
+++ b/v4l2loopback.c
@@ -207,7 +207,7 @@ static const struct v4l2_ctrl_config v4l2loopback_ctrl_keepformat = {
        .min    = 0,
        .max    = 1,
        .step   = 1,
-       .def    = 0,
+       .def    = 1,
        // clang-format on
 };
 static const struct v4l2_ctrl_config v4l2loopback_ctrl_sustainframerate = {
@@ -2030,6 +2030,21 @@ static void timeout_timer_clb(unsigned long nr)
        spin_unlock(&dev->lock);
 }
 
+static int set_default_format(struct v4l2_loopback_device *dev)
+{
+       //const struct v4l2l_format *format = &formats[3]; // V4L2_PIX_FMT_RGB24, 24 bpp RGB, be
+       //const struct v4l2l_format *format = &formats[1]; // V4L2_PIX_FMT_RGB32, 32 bpp RGB, be
+       const struct v4l2l_format *format = &formats[11]; // V4L2_PIX_FMT_YUYV,4:2:2, packed, YUYV
+       struct v4l2_pix_format *pix_fmt = &dev->pix_format;
+
+       pix_fmt->width = 800;
+       pix_fmt->height = 600;
+       pix_format_set_size(pix_fmt, format, 800, 600);
+       pix_fmt->pixelformat = format->fourcc;
+       pix_fmt->colorspace = V4L2_COLORSPACE_SRGB;
+       return 0;
+}
+
 /* init loopback main structure */
 #define DEFAULT_FROM_CONF(confmember, default_condition, default_value)        \
        ((conf) ?                                                              \
@@ -2207,7 +2222,9 @@ v4l2_loopback_add(struct v4l2_loopback_config *conf)
                V4L2_COLORSPACE_SRGB; /* do we need to set this ? */
        dev->pix_format.field = V4L2_FIELD_NONE;
 
+       set_default_format(dev);
        dev->buffer_size = PAGE_ALIGN(dev->pix_format.sizeimage);
+       dev->pix_format.sizeimage = dev->buffer_size;
        dprintk("buffer_size = %ld (=%u)\n", dev->buffer_size,
                dev->pix_format.sizeimage);
        err = allocate_buffers(dev);
@@ -2224,6 +2241,7 @@ v4l2_loopback_add(struct v4l2_loopback_config *conf)
                goto out_free_device;
        }
        v4l2loopback_create_sysfs(dev->vdev);
+       dev->ready_for_capture = 1;
 
        return dev;

0 replies

deeox · 2021-10-01T08:50:15Z

deeox
Oct 1, 2021

@rediceli Thanks a lot for explaining everything clearly, I'll try the above and get back

0 replies

ali6836 · 2022-04-25T17:20:01Z

ali6836
Apr 25, 2022

According to the android souce (hardware/interfaces/camera/device/3.4/default/ExternalCameraDevice.cpp), the V4L2 video device must be act as a VIDEO_CAPTURE device and support V4L2_PIX_FMT_MJPEG or V4L2_PIX_FMT_YUYV once it first connected (and never check again). So, the current v4l2loopback can not support android (to use as a camera).

To fix this, I patch the source with:

Set default video caps to V4L2_PIX_FMT_YUYV;
set keep_format=1 and ready_for_capture=1 by default;

Now, the camera APP detect the virtual device (without crash), but when I write YUYV422 stream, camera read nothing

diff --git a/v4l2loopback.c b/v4l2loopback.c
index 9da2508..e0ec3a6 100644
--- a/v4l2loopback.c
+++ b/v4l2loopback.c
@@ -207,7 +207,7 @@ static const struct v4l2_ctrl_config v4l2loopback_ctrl_keepformat = {
        .min    = 0,
        .max    = 1,
        .step   = 1,
-       .def    = 0,
+       .def    = 1,
        // clang-format on
 };
 static const struct v4l2_ctrl_config v4l2loopback_ctrl_sustainframerate = {
@@ -2030,6 +2030,21 @@ static void timeout_timer_clb(unsigned long nr)
        spin_unlock(&dev->lock);
 }
 
+static int set_default_format(struct v4l2_loopback_device *dev)
+{
+       //const struct v4l2l_format *format = &formats[3]; // V4L2_PIX_FMT_RGB24, 24 bpp RGB, be
+       //const struct v4l2l_format *format = &formats[1]; // V4L2_PIX_FMT_RGB32, 32 bpp RGB, be
+       const struct v4l2l_format *format = &formats[11]; // V4L2_PIX_FMT_YUYV,4:2:2, packed, YUYV
+       struct v4l2_pix_format *pix_fmt = &dev->pix_format;
+
+       pix_fmt->width = 800;
+       pix_fmt->height = 600;
+       pix_format_set_size(pix_fmt, format, 800, 600);
+       pix_fmt->pixelformat = format->fourcc;
+       pix_fmt->colorspace = V4L2_COLORSPACE_SRGB;
+       return 0;
+}
+
 /* init loopback main structure */
 #define DEFAULT_FROM_CONF(confmember, default_condition, default_value)        \
        ((conf) ?                                                              \
@@ -2207,7 +2222,9 @@ v4l2_loopback_add(struct v4l2_loopback_config *conf)
                V4L2_COLORSPACE_SRGB; /* do we need to set this ? */
        dev->pix_format.field = V4L2_FIELD_NONE;
 
+       set_default_format(dev);
        dev->buffer_size = PAGE_ALIGN(dev->pix_format.sizeimage);
+       dev->pix_format.sizeimage = dev->buffer_size;
        dprintk("buffer_size = %ld (=%u)\n", dev->buffer_size,
                dev->pix_format.sizeimage);
        err = allocate_buffers(dev);
@@ -2224,6 +2241,7 @@ v4l2_loopback_add(struct v4l2_loopback_config *conf)
                goto out_free_device;
        }
        v4l2loopback_create_sysfs(dev->vdev);
+       dev->ready_for_capture = 1;
 
        return dev;

Have you attempted to create video nodes, move the original video nodes for the original cameras, and then link the v4l2loopback video nodes to the positions where the original nodes were?
For example, if my back camera was /dev/video0, move it to /dev/video10 and then create a loopback device at /dev/video11 and link it to /dev/video0.

0 replies

vnool · 2023-10-13T17:31:29Z

vnool
Oct 13, 2023

@Learner379 I failed at "insmod v4l2loopback.ko ",,
insmod: failed to load v4l2loopback.ko: No such file or directory

0 replies

vnool · 2023-10-13T17:32:29Z

vnool
Oct 13, 2023

Failed at "insmod v4l2loopback.ko ",,
insmod: failed to load v4l2loopback.ko: No such file or directory

-rw-r--r-- 1 root root 547240 2023-10-10 15:19:20.000000000 +0800 v4l2loopback.ko
-rw-r--r-- 1 root root 197680 2023-10-10 15:19:05.000000000 +0800 flash_ic_sc2703.ko
-rw-r--r-- 1 root root 423560 2023-10-10 15:19:21.000000000 +0800 fpsensor.ko
-rw-r--r-- 1 root root 3286880 2023-10-10 15:19:20.000000000 +0800 ilitek9882x.ko

1 reply

umlaeute Oct 16, 2023
Maintainer

probably try with insmod ./v4l2loopback.ko (assuming that the kernel-module file is in your current directory)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Query] Will this driver works for android as well? #537

{{title}}

Replies: 12 comments 1 reply

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

[Query] Will this driver works for android as well? #537

Replies: 12 comments · 1 reply

umlaeute Aug 9, 2020 Maintainer

Learner379 May 17, 2021 Author

Learner379 Aug 5, 2021 Author

Learner379 Aug 5, 2021 Author

umlaeute Oct 16, 2023 Maintainer

Replies: 12 comments 1 reply

umlaeute
Aug 9, 2020
Maintainer

Learner379
May 17, 2021
Author

Learner379
Aug 5, 2021
Author

Learner379
Aug 5, 2021
Author

umlaeute Oct 16, 2023
Maintainer