Current Server Time: 22:48 (Central Europe)

#apertus IRC Channel Logs

2024/03/25

Timezone: UTC


02:19
BogdanXOR
joined the channel
02:24
BogdanXOR
left the channel
02:30
BogdanXOR
joined the channel
02:38
BogdanXOR
left the channel
02:39
BogdanXOR
joined the channel
02:44
BogdanXOR
left the channel
02:54
BogdanXOR
joined the channel
02:59
BogdanXOR
left the channel
03:09
BogdanXOR
joined the channel
03:14
BogdanXOR
left the channel
03:24
BogdanXOR
joined the channel
03:29
BogdanXOR
left the channel
03:39
BogdanXOR
joined the channel
03:44
BogdanXOR
left the channel
03:54
BogdanXOR
joined the channel
04:04
BogdanXOR
left the channel
04:04
BogdanXOR
joined the channel
04:08
BogdanXOR
left the channel
04:19
BogdanXOR
joined the channel
04:23
BogdanXOR
left the channel
04:24
BogdanXOR
joined the channel
04:29
BogdanXOR
left the channel
04:39
BogdanXOR
joined the channel
04:44
BogdanXOR
left the channel
05:04
BogdanXOR
joined the channel
05:08
BogdanXOR
left the channel
05:15
BogdanXOR
joined the channel
05:23
BogdanXOR
left the channel
05:24
BogdanXOR
joined the channel
05:29
BogdanXOR
left the channel
05:30
BogdanXOR
joined the channel
05:38
BogdanXOR
left the channel
05:39
BogdanXOR
joined the channel
05:44
BogdanXOR
left the channel
05:54
BogdanXOR
joined the channel
05:59
BogdanXOR
left the channel
06:09
BogdanXOR
joined the channel
06:14
BogdanXOR
left the channel
06:54
BogdanXOR
joined the channel
06:59
BogdanXOR
left the channel
07:17
BogdanXOR
joined the channel
07:23
BogdanXOR
left the channel
07:30
BogdanXOR
joined the channel
07:39
BogdanXOR
left the channel
07:39
BogdanXOR
joined the channel
07:44
BogdanXOR
left the channel
07:54
BogdanXOR
joined the channel
07:59
BogdanXOR
left the channel
08:09
BogdanXOR
joined the channel
08:14
BogdanXOR
left the channel
08:24
BogdanXOR
joined the channel
08:29
BogdanXOR
left the channel
08:35
BogdanXOR
joined the channel
08:42
BogdanXOR
left the channel
08:50
BogdanXOR
joined the channel
08:54
BogdanXOR
left the channel
09:00
BogdanXOR
joined the channel
09:09
BogdanXOR
left the channel
09:13
BogdanXOR
joined the channel
09:18
BogdanXOR
left the channel
09:24
BogdanXOR
joined the channel
09:30
BogdanXOR
left the channel
09:39
BogdanXOR
joined the channel
09:44
BogdanXOR
left the channel
09:54
BogdanXOR
joined the channel
09:59
BogdanXOR
left the channel
10:19
BogdanXOR
joined the channel
10:24
BogdanXOR
left the channel
10:36
BogdanXOR
joined the channel
10:41
BogdanXOR
left the channel
10:47
BogdanXOR
joined the channel
10:53
BogdanXOR
left the channel
11:00
BogdanXOR
joined the channel
11:08
paulk
left the channel
11:08
BogdanXOR
left the channel
11:08
paulk
joined the channel
11:09
BogdanXOR
joined the channel
11:14
BogdanXOR
left the channel
11:23
BogdanXOR
joined the channel
11:28
BogdanXOR
left the channel
11:34
BogdanXOR
joined the channel
11:39
BogdanXOR
left the channel
11:45
BogdanXOR
joined the channel
11:53
BogdanXOR
left the channel
11:54
BogdanXOR
joined the channel
14:55
BogdanXOR
left the channel
15:04
BogdanXOR
joined the channel
15:11
BogdanXOR
left the channel
15:17
BogdanXOR
joined the channel
15:23
BogdanXOR
left the channel
15:31
BogdanXOR
joined the channel
17:01
se6astian
MEETING TIME
17:01
se6astian
who is here?
17:01
Bertl
is here
17:01
se6astian
great, any news bertl worth sharing?
17:01
Bertl
Well, there has been a lot of testing on the RPi5 going on
17:02
Bertl
Mainly to see where the performance limits are and it turns out that the MIPI interfaces and data transport from them is definitely not something hitting the limits easily
17:03
Bertl
I've been testing with two 1080p60 channels at once and we managed to transfer more than 100000 frames for each at the same time with roughly 35% cpu usage on two of the four CPUs
17:04
Bertl
And this also included frame verification via a checksum and the checksum algorithm makes up the larger part of the 35%
17:05
Bertl
I've also tested the USB interfaces and while they look relatively independent, they seem to be very limited in write throughput
17:06
Bertl
I tried USB drives (the obvious choice) first but those seem to be limited at around 120MB/s sustained write throughput (and I couldn't find any USB stick which would go beyond that)
17:07
se6astian
did you also try usb nvme ssds (I think you did mention it last week)?
17:07
Bertl
Then I tested with NVMe attached via various USB to NVMe bridges and while the sustained read speed goes up to 380MB/s there, the sustained write speed caps out at 260MB/s on the best option
17:07
Bertl
note here that we need around 355-360MB/s sustained write to save a single MIPI channel at 1080p60
17:08
Bertl
I also tested USB to SATA bridges with fast SSDs but the results are unfortunately similar or worse
17:09
Bertl
I'm not sure what causes USB writes to be so slow but as the bridge solutions perform way better on a Linux PC, I suspect it has to do with the USB driver on the RPi5
17:09
Bertl
Not sure how the hardware (USB Controller) could be to blame, but of course that could be the problem here as well
17:10
Bertl
During the testing I also wrote some C code for the capture and checksum (which uses AARCH64 SIMD instructions) which can be found here
17:11
Bertl
http://vserver.13thfloor.at/Stuff/AXIOM/BETA/RPI5/
17:11
Bertl
There are also some analysis python scripts which verify that we didn't miss a frame and check that the frame checksums are indeed what we expect
17:12
Bertl
If you have any further questions regarding the setup or how to reproduce, feel free to contact me
17:12
Bertl
That's it from my side for this week!
17:12
se6astian
excellent!, many thanks!
17:13
se6astian
quick updates from me: anuejn and me had another hacking session last week and got the axiom raw recorder setup up and running both in software and hardware
17:14
se6astian
we capture a buch a of testclips with/without blackframe subtraction which seems to work rather well directly in the axiom recorder but not well in davinci resolve (nobody knows what the software does to the raw data...
17:14
se6astian
we also tried a clip with black coloumns enabled and a 2048 width image
17:14
se6astian
that also captured fine but we dropped a bunch of frames as its beyond the datarate of 25 FPS throughput
17:15
se6astian
we know it would work with 24fps but didnt bother to set that up as we only captured static shots anyways
17:15
Bertl
what's the limit there?
17:16
se6astian
anuejn will now work on color science more and also check the options to compensate for any row noise
17:16
se6astian
2048x1080@50 FPS is too much for magewell / USB or other part in the chain
17:16
BogdanXOR
left the channel
17:17
Bertl
but we don't know which part?
17:17
se6astian
we also met the new austrian arrow sales rep last week and got a few new leads for sourcing parts or getting quotes
17:18
se6astian
like the toshiba mipi hdmi bridge chip, I just made a request for quote in the myarrow app
17:18
se6astian
no price/availability listed but maybe someone will gather that information for us now
17:19
BogdanXOR
joined the channel
17:19
se6astian
I will check if I find my USB/raw datarate spreadsheet afterwards
17:20
se6astian
I also started preparing the ninja V hdmi test with BogdanXORs device but failed to replace the gateware in FW 2.0 with confusing symlinks and PATHs, anuejn will help me simplify that process at the next tinkering session hopefully
17:21
se6astian
also started cutting cables and preparing parts for the button, fan, dc jack 12V input wiring
17:21
se6astian
thats it from my side I think
17:21
se6astian
anyone else around?
17:22
se6astian
ah I started converting my axiom recorder gui from pysimplegui (which is now a paid software) to dearpygui which anuejn suggested
17:22
se6astian
so far it looks very nice and learning and using it has been fine so far
17:24
Bertl
interesting! good to know!
17:28
BogdanXOR
left the channel
17:29
se6astian
Here is the datarate overview
17:29
se6astian
https://docs.google.com/spreadsheets/d/19xZirSpf07kxxVILlhHQOsJZ7h9U1-2EXnXCbP_7YlE/edit#gid=0
17:29
se6astian
we will test where the bottleneck is
17:29
se6astian
Bertl can you tell with the beta output what the max throughput would be?
17:29
se6astian
the magewell should be fine as it offers that mode without issue
17:30
se6astian
do we have full 5Gbit/s with USB 3.0
17:31
Bertl
the USB limit should be somewhere around 400MB/s in an ideal setup it could get up to 480MB/s
17:31
Bertl
for the magewell I'm not sure where the limit is, but I'd say it should also be around 400MB/s
17:32
Bertl
I'm not sure what you mean with the max throughput on the beta output? the HDMI data rate?
17:33
se6astian
yes HDMI datarate
17:33
se6astian
what is the max the beta could supply?
17:33
se6astian
resolution/framerate
17:35
Bertl
well, with 148.5MHz and the 1080p60 config we have very precisely 60FPS
17:35
BogdanXOR
joined the channel
17:35
Bertl
the 2048x1080p60 mode uses the same timing but is 2048 pixel wide
17:36
Bertl
60*1920*1080*3 = 373248000 so 373.248MB/s
17:36
se6astian
could we go 2048 but more height?
17:36
Bertl
60*2048*1080*3 = 398131200 or 398.131MiB/s
17:37
Bertl
more height requires a different format
17:37
Bertl
both modes fit in the 2200 x 1125 timing frame
17:38
Bertl
so in theory we could add a few more lines vertically and keep the same timing frame
17:38
Bertl
but I'm not sure that's worth the effort and I also do not know how the capture devices will handle the reduced vertical blanking
17:39
se6astian
yeah, the standard formats are enough to keep us busy right now
17:39
Bertl
of course, with the userspace sequencer it is possible to leverage the 60FPS vs 50FPS difference for 50FPS captures
17:40
Bertl
i.e. we could use the 60FPS output but run the capture at 50FPS
17:40
se6astian
anuejn even expressed he was not sure the black coloumns will help much and proper kalman filtering might yield better results
17:40
BogdanXOR
left the channel
17:41
Bertl
that's 20% more data, so instead of 1080p, we get 1296
17:41
se6astian
right
17:42
Bertl
but this all depends on the capture working at those rates
17:42
se6astian
we will report with next tinkering session
17:42
Bertl
I'm pretty sure they worked on the Magewell quad capture card, but no idea about the USB capture
17:42
se6astian
is there a way to tell if the USB interface is getting saturated?
17:43
Bertl
I'd say when the capture device starts dropping frames :)
17:44
Bertl
you probably also want to make sure that there is no audio in the capture as that will needlessly fill up the USB data stream
17:45
Bertl
and of course, the USB bus should be reserved for the capture device, no other devices on the same bus
17:46
se6astian
but how to tell if its not the SSD writing too slow?
17:47
BogdanXOR
joined the channel
17:47
Bertl
simple, do not write to the SSD for verification, just make checksums and check the marker
17:47
se6astian
right, noted
17:47
se6astian
great
17:47
se6astian
MEETING CONCLUDED
17:48
Bertl
thanks for the moderation!
17:51
BogdanXOR
left the channel
18:06
Spirit532
left the channel
21:05
BogdanXOR
joined the channel
21:12
BogdanXOR
left the channel
21:40
BogdanXOR
joined the channel
21:45
BogdanXOR
left the channel
22:32
BogdanXOR
joined the channel
22:39
BogdanXOR
left the channel
22:40
BogdanXOR
joined the channel
22:47
BogdanXOR
left the channel
23:21
BogdanXOR
joined the channel
23:26
BogdanXOR
left the channel
23:57
BogdanXOR
joined the channel