= Video capture and encoding on the Raspberry pi

This page is currently a research collection and commands might not work

{{ :hardware:signal-attachment-2020-05-15-153418.jpeg?400|}}

* https://www.raspberrypi.org/documentation/raspbian/applications/camera.md
* https://github.com/thaytan/gst-rpicamsrc
* https://github.com/waveform80/picamera
* https://stamm-wilbrandt.de/en/Raspberry_camera.html

=== gstreamer pipe gen srt mit kaputtem alsasrc-audio vom usb:

  gst-launch-1.0 rpicamsrc inline-headers=true annotation-mode=date+time+frame-number+black-background brightness=60 preview=1 awb-mode=1 bitrate=10000000 exposure-mode=fixedfps sensor-mode=1 keyframe-interval=25 ! 'video/x-h264, width=1920, height=1080, framerate=25/1, profile=high'  ! muxout. alsasrc device=hw:1,0 actual-latency-time=12000 buffer-time=200000  ! audioconvert ! avenc_aac ! aacparse ! muxout. mpegtsmux name=muxout ! queue  ! srtserversink uri='srt://:8888/'`

=== funktionierendes audio mit ffmpeg und ner pipe in das srt-tool "srt-live-transmit":

  ffmpeg -analyzeduration 500000  -probesize 100000 -thread_queue_size 512 -f v4l2 -input_format h264 -video_size 1920x1080 -framerate 30 -i /dev/video0 -thread_queue_size 512 -f alsa -sample_rate 44100 -ac 2 -i hw:1 -map 0:0 -map 1:0 -bufsize 0 -af 'adelay=520|520,volume=0dB' -vcodec copy -acodec aac -f mpegts - | srt-live-transmit -v file://con 'srt://:8888&delay=80' -c 1316

ggf vorher im v4l2 codec parameter setzen:

  v4l2-ctl -c video_bitrate=4000000
  v4l2-ctl -c h264_i_frame_period=25

=== rtmp stream from pi cam
  raspivid -fps 25 -h 1080 -w 1920 -n -t 0 -g 5 -b 5000000 -stm -o - | gst-launch-1.0 -v fdsrc ! h264parse !  flvmux ! rtmpsink location='rtmp://changeme/stream/bla live=1'


=== RTP stream sink and source

  raspivid -fps 25 -h 1080 -w 1920 -n -t 0 -b 5000000 -o - | gst-launch-1.0 -v fdsrc ! h264parse ! rtph264pay config-interval=1 ! gdppay ! tcpserversink host=10.23.42.145 port=5000

  gst-launch-1.0 -v tcpclientsrc host=10.23.42.145 port=5000 ! gdpdepay ! rtph264depay ! decodebin !  autovideosink sync=false

== Capture from UVC capture device and stream rtmp

=== video4linux
  gst-launch-1.0  v4l2src device=/dev/video0 do-timestamp=true ! videoscale !  videorate  ! videoconvert ! video/x-raw,width=1920,height=1080,framerate=25/1  ! omxh264enc control-rate=variable target-bitrate=5000000  !  h264parse ! flvmux ! rtmpsink location='rtmp://<host>/stream/picam live=1'

=== raspivid wrapper
  gst-launch-1.0 rpicamsrc bitrate=5000000  do-timestamp=true ! h264parse ! flvmux ! rtmpsink location='rtmp://<host>/stream/picam'

== read encoded video

=== read encoded video with ffmpeg from the cam
  ffmpeg -f video4linux2 -input_format h264 -video_size 1920x1080 -framerate 30 -i /dev/video0 -vcodec copy -an test.h264

=== read encoded video with gst and provide output via srt server
  gst-launch-1.0 rpicamsrc bitrate=8000000 ! video/x-h264, framerate=25/1, profile=high ! h264parse config-interval=1 !  mpegtsmux ! queue ! srtserversink uri=srt://:10000/



== FFMPEG with SRT support on ubuntu 20.04
<code>
sudo apt build-dep ffmpeg libsrt-dev
git clone https://github.com/FFmpeg/FFmpeg.git 

./configure --prefix=/usr --extra-version=1ubuntu1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-avresample --disable-filter=resample --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librsvg --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-nvenc --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared --enable-libsrt --disable-avio
</code>