Raspberry Pi HDMI to CSI&I2S User Guide

C780A hardware parameters

HDMI input: supports up to 1080P50Hz on raspberry pi(Limited by the number of CSI-2 channels)
HDMI to CSI-2 bridge chip:Toshiba TC358743XBG
2 CSI-2 channels & clock
CSI-2 interface: 15 pin FPC seat, spacing 1.0 mm
Size: 30 x 65 mm (unbroken PCB size); 30 x 45 mm (PCB size after breaking)
Install:6 x M2.5
Power supply:3.3V
Weight: 10g

C780B hardware parameters

HDMI input: supports up to 1080P60Hz on raspberry pi
HDMI to CSI-2 bridge chip:Toshiba TC358743XBG
4 CSI-2 channels & clock
CSI-2 interface: 22 pin FPC seat, spacing 0.5 mm
Size: 30 x 65 mm (unbroken PCB size); 30 x 45 mm (PCB size after breaking)
Install:6 x M2.5
Power supply:3.3V
Weight: 10g

Interface

The wiring of audio part is shown in Figure.

Software demo

The use guide of C790/C780/C779 depends on the official Raspberry Pi OS version you are using. Different versions have different usage methods. If you have some questions, Please contact us, we will provide you with technical services.

To use the kernel drivers, please update your system. There are a few things that have changed with the 5.4 kernel, so these instructions are for 5.4 or later. If “uname -a” reports anything less, then fix this before proceeding.

1. Update & upgrade the raspberry pi system (It will take a long time depend on the different country)

pi@raspberrypi:~ $ uname -a

Linux raspberrypi 5.10.63-v7l+ #1459 SMP Wed Oct 6 16:41:57 BST 2021 armv7l GNU/Linux

2. Enable camera module (the camera is enabled by default in Raspberry pi Bullseys OS)

sudo raspi-config

sudo reboot

Navigate to ‘Interfacing Options’ and hit Enter. Now select the ‘Camera’ option, and hit the Enter key to enable it. Select “Finish” and select to reboot your Raspberry Pi. reboot is important!!

3. Edit /boot/config.txt (that will need sudo)

sudo nano /boot/config.txt

Add the line:

dtoverlay=tc358743

Add the line if your shield support audio like C780 or C790.

dtoverlay=tc358743-audio

please append the If (and only if) you have a device such as the C780 or C790 that supports the 22pin connector with all 4 lanes wired out, and are using a Compute Module with the CAM1 connector that also has all 4 lanes wired up, you can use:

dtoverlay=tc358743,4lane=1

!!! note "4. Check the amount of memory assigned to the CMA heap with “dmesg | grep cma”. The first line should be along the lines of"

pi@raspberrypi:~ $ dmesg | grep cma

[0.000000] cma: Reserved 256 MiB at 0x000000001ec00000

If it reports less than 96MB assigned to CMA, then edit /boot/cmdline.txt and add to the start of the line. Do NOT add any carriage returns.

cma=96M

!!! note "5. Reboot. If all is well you should get a /dev/video0 device, and “v4l2-ctl –list-devices” will tell you that it is provided by Unicam. After connecting all the cables, power on the Raspberry Pi, the C790 indicator light is normally green, and after opening the Raspberry Pi terminal, enter the following command:"

pi@raspberrypi:~ $ ls /dev/video0

/dev/video0

pi@raspberrypi:~ $ v4l2-ctl --list-devices

bcm2835-codec-decode (platform:bcm2835-codec):

/dev/video10

/dev/video11

/dev/video12

/dev/video18

/dev/media1

bcm2835-isp (platform:bcm2835-isp):

/dev/video13

/dev/video14

/dev/video15

/dev/video16

/dev/media0

unicam (platform:fe801000.csi):

/dev/video0

/dev/video1

/dev/media2

!!! note "6. This driver puts all the control in the hands of the user, or the user’s application. By default there is no EDID loaded into the chip to allow it to tell the HDMI source what resolutions are supported. There are EDID editors around. If you create a file edid.txt, then you can push this to the device using" The comment of edid.txt file:

00ffffffffffff005262888800888888

1c150103800000780aEE91A3544C9926

0F505400000001010101010101010101

010101010101011d007251d01e206e28

5500c48e2100001e8c0ad08a20e02d10

103e9600138e2100001e000000fc0054

6f73686962612d4832430a20000000FD

003b3d0f2e0f1e0a2020202020200100

020321434e041303021211012021a23c

3d3e1f2309070766030c00300080E300

7F8c0ad08a20e02d10103e9600c48e21

0000188c0ad08a20e02d10103e960013

8e210000188c0aa01451f01600267c43

00138e21000098000000000000000000

00000000000000000000000000000000

cd ~

sudo nano edid.txt

#copy the above commend in edid.txt, save&exit;

pi@raspberrypi:~ $ v4l2-ctl --set-edid=file=edid.txt --fix-edid-checksums

CTA-861 Header

IT Formats Underscanned: yes

Audio: yes

YCbCr 4:4:4: no

YCbCr 4:2:2: no

HDMI Vendor-Specific Data Block

Physical Address: 3.0.0.0

YCbCr 4:4:4 Deep Color: no

30-bit: no

36-bit: no

48-bit: no

CTA-861 Video Capability Descriptor

RGB Quantization Range: yes

YCC Quantization Range: no

PT: Supports both over- and underscan

IT: Supports both over- and underscan

CE: Supports both over- and underscan

7. The driver does NOT automatically switch to the resolution detected. Use the command:

pi@raspberrypi:~ $ v4l2-ctl --query-dv-timings

Active width: 1280

Active height: 720

Total width: 1650

Total height: 750

Frame format: progressive

Polarities: -vsync -hsync

Pixelclock: 74250000 Hz (60.00 frames per second)

Horizontal frontporch: 0

Horizontal sync: 370

Horizontal backporch: 0

Vertical frontporch: 0

Vertical sync: 30

Vertical backporch: 0

Standards:

Flags:

You MUST set the timings via “v4l2-ctl –set-dv-bt-timings”. You can pass in an index to the detected mode, or use:

v4l2-ctl --set-dv-bt-timings query

to select the currently detected timings.

v4l2-ctl -V

should now reflect the resolution detected.

8. The chip supports two formats – BGR3 (the default) and UYVY. BGR3 is 24bpp, and UYVY is YUV4:2:2 16bpp.

Over the normal 2 CSI-2 lanes the data rate is such that BGR3 can run at a maximum of 1080p30, whilst UYVY will go up to 1080p50. Use the following command to select UYVY, however your application may override that.

v4l2-ctl -v pixelformat=UYVY

9. Check that the audio drivers / card is available to ALSA.

pi@raspberrypi:~ $ arecord -l

**** List of CAPTURE Hardware Devices ****

card 1: tc358743 [tc358743], device 0: bcm2835-i2s-dir-hifi dir-hifi-0 [bcm2835-i2s-dir-hifi dir-hifi-0]

Subdevices: 1/1

Subdevice #0: subdevice #0

Note: card 1 means that the card number for the TC358743XBG is “1” and it might be different.

10. Install GStreamer tool.

sudo apt install gstreamer1.0-tools

Check gstreamer tool version:

pi@raspberrypi:~ $ gst-launch-1.0 --version

gst-launch-1.0 version 1.18.4

GStreamer 1.18.4

http://packages.qa.debian.org/gstreamer1.0

Note: Different versions have different command line parameters, which is very annoying.

11. Use gstreamer to record video and audio

#GStreamer v1.14 command

gst-launch-1.0 v4l2src io-mode=5 ! video/x-raw, format=UYVY, framerate=25/1 ! v4l2h264enc output-io-mode=4 ! video/x-h264,profile=high ! h264parse ! queue ! matroskamux name=mux ! filesink location=foo.mkv alsasrc device=hw:1 ! audio/x-raw,rate=48000,channels=2 ! audioconvert ! avenc_aac bitrate=48000 ! aacparse ! queue ! mux.

foo.mkv is the output file. If your gstreamer is version 1.8 or above, you can try the following test command. In addition, alsasrc device=hw:1 represents the sound card of TC358743, you can use “arecord -l” to query.

#The command to recode a video with audio. (GStreamer 1.18.4)

gst-launch-1.0 -vvv v4l2src ! "video/x-raw,framerate=30/1,format=UYVY" ! v4l2h264enc extra-controls="controls,h264_profile=4,h264_level=13,video_bitrate=256000;" ! "video/x-h264,profile=high, level=(string)4.2" ! h264parse ! queue ! matroskamux name=mux ! filesink location=foo.mkv alsasrc device=hw:1 ! audio/x-raw,rate=48000,channels=2 ! audioconvert ! avenc_aac bitrate=48000 ! aacparse ! queue ! mux.

#The sample command to recode a video without audio. (C779 doesn't support audio)

Press CTRL+C to end recording.

PS: We recommend that you modify the above framerate parameter to the actual frame rate of your HDMI signal, the actual frame rate value is from the result of ‘v4l2-ctl –query-dv-timings’ command.

For the above HDMI device, because the frame rate is 60, so we modify the framerate parameter to 60 like the followint command. Record the video only:

Record the video and audio: (if your shield supports audio also)

gst-launch-1.0 -vvv v4l2src ! "video/x-raw,framerate=60/1,format=UYVY" ! v4l2h264enc extra-controls="controls,h264_profile=4,h264_level=13,video_bitrate=256000;" ! "video/x-h264,profile=high, level=(string)4.2" ! h264parse ! queue ! matroskamux name=mux ! filesink location=foo.mkv alsasrc device=hw:1 ! audio/x-raw,rate=48000,channels=2 ! audioconvert ! avenc_aac bitrate=48000 ! aacparse ! queue ! mux.

Note: alsasrc device=hw:1 – “1” means the audio card number, You must change to correct audio card number. (Query the car number via ‘arecord –l’, refer to step 9)

C780

Interface definition

To：

Dear Customers, There may be a lag of several hours before we could process your order, depending on the time difference between your location and ours. Sincerely hoping your understanding!

Email(support)

services01@spotpear.com

TAG： UART TTL To RS485 C Built-In Protection Circuits 15.6 inch Dual LCD Computer PC Monitor Display Double Secondary Screen Type C Mini HDMI 1080P For Windows/MacOS ESP32 ST7789 configuration IR Thermal Imaging Camera Computer Arducam Raspberry Pi 5 Raspberry Pi 5 4 inch e Paper HAT+ E Ink Spectra E6 Full-Color 600x400 Screen Display For Arduino /Raspberry Pi /Jetson Nano /STM32 0.85inch Screen RV1106 Digital Photo Frames 1.5inch LCD Raspberry Pi 5 Heatsink USB-CAN-B Raspberry Pi 5 PCIe to M.2 NVMe SSD Adapter Board (D) HAT Pi5-2280-2242-2230 Raspberry Pi Pico Raspberry Pi IR Thermal Imagi RS232 to RS422 Raspberry Pi LCD

Raspberry Pi Camera HDMI to CSI 4 CSI channels C780 Support Audio 1080P 60FPS V2 updated Version

TAG： Raspberry Pi 15.6 inch FHD Monitor LCD Capacitive TouchScreen Display Type-C HDMI Computer PC Digital Photo Autofocus Camera Raspberry Pi Pico RP2040 1.69 inch TouchScreen Round LCD Display QMI8658 QST Attitude Gyro Sensor Buzzer RTC PCF85063 Arduino electronic wrist watch Milk V Duo CM4 ADAPTER Interface protection board For Raspberry Pi Compute Module 4 Lite/eMMC ESP32 C3 Zero Raspberry Pi 64MP Camera Industrial USB TO RS485 Raspberry Pi display ESP32-S3 GEEK Development Board ESP32 IR Thermal Imaging Camera Raspberry Pi Camera Raspberry Pi Long Bar Screen Raspber Pi 5 27W Power Raspberry Pi 5 PCIe USB UART HAT RS485 ISO TTL RS232 MPUUART 1.54-inch LCD ornament X1202 Raspberry Pi 5 UPS Jetson Nano PWM Fan SpotPear