Current Server Time: 17:56 (Central Europe)

#apertus IRC Channel Logs

2024/03/25

Timezone: UTC


01:19
BogdanXOR
joined the channel
01:24
BogdanXOR
left the channel
01:30
BogdanXOR
joined the channel
01:38
BogdanXOR
left the channel
01:39
BogdanXOR
joined the channel
01:44
BogdanXOR
left the channel
01:54
BogdanXOR
joined the channel
01:59
BogdanXOR
left the channel
02:09
BogdanXOR
joined the channel
02:14
BogdanXOR
left the channel
02:24
BogdanXOR
joined the channel
02:29
BogdanXOR
left the channel
02:39
BogdanXOR
joined the channel
02:44
BogdanXOR
left the channel
02:54
BogdanXOR
joined the channel
03:04
BogdanXOR
left the channel
03:04
BogdanXOR
joined the channel
03:08
BogdanXOR
left the channel
03:19
BogdanXOR
joined the channel
03:23
BogdanXOR
left the channel
03:24
BogdanXOR
joined the channel
03:29
BogdanXOR
left the channel
03:39
BogdanXOR
joined the channel
03:44
BogdanXOR
left the channel
04:04
BogdanXOR
joined the channel
04:08
BogdanXOR
left the channel
04:15
BogdanXOR
joined the channel
04:23
BogdanXOR
left the channel
04:24
BogdanXOR
joined the channel
04:29
BogdanXOR
left the channel
04:30
BogdanXOR
joined the channel
04:38
BogdanXOR
left the channel
04:39
BogdanXOR
joined the channel
04:44
BogdanXOR
left the channel
04:54
BogdanXOR
joined the channel
04:59
BogdanXOR
left the channel
05:09
BogdanXOR
joined the channel
05:14
BogdanXOR
left the channel
05:54
BogdanXOR
joined the channel
05:59
BogdanXOR
left the channel
06:17
BogdanXOR
joined the channel
06:23
BogdanXOR
left the channel
06:30
BogdanXOR
joined the channel
06:39
BogdanXOR
left the channel
06:39
BogdanXOR
joined the channel
06:44
BogdanXOR
left the channel
06:54
BogdanXOR
joined the channel
06:59
BogdanXOR
left the channel
07:09
BogdanXOR
joined the channel
07:14
BogdanXOR
left the channel
07:24
BogdanXOR
joined the channel
07:29
BogdanXOR
left the channel
07:35
BogdanXOR
joined the channel
07:42
BogdanXOR
left the channel
07:50
BogdanXOR
joined the channel
07:54
BogdanXOR
left the channel
08:00
BogdanXOR
joined the channel
08:09
BogdanXOR
left the channel
08:13
BogdanXOR
joined the channel
08:18
BogdanXOR
left the channel
08:24
BogdanXOR
joined the channel
08:30
BogdanXOR
left the channel
08:39
BogdanXOR
joined the channel
08:44
BogdanXOR
left the channel
08:54
BogdanXOR
joined the channel
08:59
BogdanXOR
left the channel
09:19
BogdanXOR
joined the channel
09:24
BogdanXOR
left the channel
09:36
BogdanXOR
joined the channel
09:41
BogdanXOR
left the channel
09:47
BogdanXOR
joined the channel
09:53
BogdanXOR
left the channel
10:00
BogdanXOR
joined the channel
10:08
paulk
left the channel
10:08
BogdanXOR
left the channel
10:08
paulk
joined the channel
10:09
BogdanXOR
joined the channel
10:14
BogdanXOR
left the channel
10:23
BogdanXOR
joined the channel
10:28
BogdanXOR
left the channel
10:34
BogdanXOR
joined the channel
10:39
BogdanXOR
left the channel
10:45
BogdanXOR
joined the channel
10:53
BogdanXOR
left the channel
10:54
BogdanXOR
joined the channel
13:55
BogdanXOR
left the channel
14:04
BogdanXOR
joined the channel
14:11
BogdanXOR
left the channel
14:17
BogdanXOR
joined the channel
14:23
BogdanXOR
left the channel
14:31
BogdanXOR
joined the channel
16:01
se6astian
MEETING TIME
16:01
se6astian
who is here?
16:01
Bertl
is here
16:01
se6astian
great, any news bertl worth sharing?
16:01
Bertl
Well, there has been a lot of testing on the RPi5 going on
16:02
Bertl
Mainly to see where the performance limits are and it turns out that the MIPI interfaces and data transport from them is definitely not something hitting the limits easily
16:03
Bertl
I've been testing with two 1080p60 channels at once and we managed to transfer more than 100000 frames for each at the same time with roughly 35% cpu usage on two of the four CPUs
16:04
Bertl
And this also included frame verification via a checksum and the checksum algorithm makes up the larger part of the 35%
16:05
Bertl
I've also tested the USB interfaces and while they look relatively independent, they seem to be very limited in write throughput
16:06
Bertl
I tried USB drives (the obvious choice) first but those seem to be limited at around 120MB/s sustained write throughput (and I couldn't find any USB stick which would go beyond that)
16:07
se6astian
did you also try usb nvme ssds (I think you did mention it last week)?
16:07
Bertl
Then I tested with NVMe attached via various USB to NVMe bridges and while the sustained read speed goes up to 380MB/s there, the sustained write speed caps out at 260MB/s on the best option
16:07
Bertl
note here that we need around 355-360MB/s sustained write to save a single MIPI channel at 1080p60
16:08
Bertl
I also tested USB to SATA bridges with fast SSDs but the results are unfortunately similar or worse
16:09
Bertl
I'm not sure what causes USB writes to be so slow but as the bridge solutions perform way better on a Linux PC, I suspect it has to do with the USB driver on the RPi5
16:09
Bertl
Not sure how the hardware (USB Controller) could be to blame, but of course that could be the problem here as well
16:10
Bertl
During the testing I also wrote some C code for the capture and checksum (which uses AARCH64 SIMD instructions) which can be found here
16:11
Bertl
http://vserver.13thfloor.at/Stuff/AXIOM/BETA/RPI5/
16:11
Bertl
There are also some analysis python scripts which verify that we didn't miss a frame and check that the frame checksums are indeed what we expect
16:12
Bertl
If you have any further questions regarding the setup or how to reproduce, feel free to contact me
16:12
Bertl
That's it from my side for this week!
16:12
se6astian
excellent!, many thanks!
16:13
se6astian
quick updates from me: anuejn and me had another hacking session last week and got the axiom raw recorder setup up and running both in software and hardware
16:14
se6astian
we capture a buch a of testclips with/without blackframe subtraction which seems to work rather well directly in the axiom recorder but not well in davinci resolve (nobody knows what the software does to the raw data...
16:14
se6astian
we also tried a clip with black coloumns enabled and a 2048 width image
16:14
se6astian
that also captured fine but we dropped a bunch of frames as its beyond the datarate of 25 FPS throughput
16:15
se6astian
we know it would work with 24fps but didnt bother to set that up as we only captured static shots anyways
16:15
Bertl
what's the limit there?
16:16
se6astian
anuejn will now work on color science more and also check the options to compensate for any row noise
16:16
se6astian
2048x1080@50 FPS is too much for magewell / USB or other part in the chain
16:16
BogdanXOR
left the channel
16:17
Bertl
but we don't know which part?
16:17
se6astian
we also met the new austrian arrow sales rep last week and got a few new leads for sourcing parts or getting quotes
16:18
se6astian
like the toshiba mipi hdmi bridge chip, I just made a request for quote in the myarrow app
16:18
se6astian
no price/availability listed but maybe someone will gather that information for us now
16:19
BogdanXOR
joined the channel
16:19
se6astian
I will check if I find my USB/raw datarate spreadsheet afterwards
16:20
se6astian
I also started preparing the ninja V hdmi test with BogdanXORs device but failed to replace the gateware in FW 2.0 with confusing symlinks and PATHs, anuejn will help me simplify that process at the next tinkering session hopefully
16:21
se6astian
also started cutting cables and preparing parts for the button, fan, dc jack 12V input wiring
16:21
se6astian
thats it from my side I think
16:21
se6astian
anyone else around?
16:22
se6astian
ah I started converting my axiom recorder gui from pysimplegui (which is now a paid software) to dearpygui which anuejn suggested
16:22
se6astian
so far it looks very nice and learning and using it has been fine so far
16:24
Bertl
interesting! good to know!
16:28
BogdanXOR
left the channel
16:29
se6astian
Here is the datarate overview
16:29
se6astian
https://docs.google.com/spreadsheets/d/19xZirSpf07kxxVILlhHQOsJZ7h9U1-2EXnXCbP_7YlE/edit#gid=0
16:29
se6astian
we will test where the bottleneck is
16:29
se6astian
Bertl can you tell with the beta output what the max throughput would be?
16:29
se6astian
the magewell should be fine as it offers that mode without issue
16:30
se6astian
do we have full 5Gbit/s with USB 3.0
16:31
Bertl
the USB limit should be somewhere around 400MB/s in an ideal setup it could get up to 480MB/s
16:31
Bertl
for the magewell I'm not sure where the limit is, but I'd say it should also be around 400MB/s
16:32
Bertl
I'm not sure what you mean with the max throughput on the beta output? the HDMI data rate?
16:33
se6astian
yes HDMI datarate
16:33
se6astian
what is the max the beta could supply?
16:33
se6astian
resolution/framerate
16:35
Bertl
well, with 148.5MHz and the 1080p60 config we have very precisely 60FPS
16:35
BogdanXOR
joined the channel
16:35
Bertl
the 2048x1080p60 mode uses the same timing but is 2048 pixel wide
16:36
Bertl
60*1920*1080*3 = 373248000 so 373.248MB/s
16:36
se6astian
could we go 2048 but more height?
16:36
Bertl
60*2048*1080*3 = 398131200 or 398.131MiB/s
16:37
Bertl
more height requires a different format
16:37
Bertl
both modes fit in the 2200 x 1125 timing frame
16:38
Bertl
so in theory we could add a few more lines vertically and keep the same timing frame
16:38
Bertl
but I'm not sure that's worth the effort and I also do not know how the capture devices will handle the reduced vertical blanking
16:39
se6astian
yeah, the standard formats are enough to keep us busy right now
16:39
Bertl
of course, with the userspace sequencer it is possible to leverage the 60FPS vs 50FPS difference for 50FPS captures
16:40
Bertl
i.e. we could use the 60FPS output but run the capture at 50FPS
16:40
se6astian
anuejn even expressed he was not sure the black coloumns will help much and proper kalman filtering might yield better results
16:40
BogdanXOR
left the channel
16:41
Bertl
that's 20% more data, so instead of 1080p, we get 1296
16:41
se6astian
right
16:42
Bertl
but this all depends on the capture working at those rates
16:42
se6astian
we will report with next tinkering session
16:42
Bertl
I'm pretty sure they worked on the Magewell quad capture card, but no idea about the USB capture
16:42
se6astian
is there a way to tell if the USB interface is getting saturated?
16:43
Bertl
I'd say when the capture device starts dropping frames :)
16:44
Bertl
you probably also want to make sure that there is no audio in the capture as that will needlessly fill up the USB data stream
16:45
Bertl
and of course, the USB bus should be reserved for the capture device, no other devices on the same bus
16:46
se6astian
but how to tell if its not the SSD writing too slow?
16:47
BogdanXOR
joined the channel
16:47
Bertl
simple, do not write to the SSD for verification, just make checksums and check the marker
16:47
se6astian
right, noted
16:47
se6astian
great
16:47
se6astian
MEETING CONCLUDED
16:48
Bertl
thanks for the moderation!
16:51
BogdanXOR
left the channel
17:06
Spirit532
left the channel
20:05
BogdanXOR
joined the channel
20:12
BogdanXOR
left the channel
20:40
BogdanXOR
joined the channel
20:45
BogdanXOR
left the channel
21:32
BogdanXOR
joined the channel
21:39
BogdanXOR
left the channel
21:40
BogdanXOR
joined the channel
21:47
BogdanXOR
left the channel
22:21
BogdanXOR
joined the channel
22:26
BogdanXOR
left the channel
22:57
BogdanXOR
joined the channel