Current Server Time: 00:29 (Central Europe)

#apertus IRC Channel Logs

2021/11/29

Timezone: UTC


00:13
intrac
left the channel
00:14
intrac
joined the channel
00:50
fredy330
left the channel
00:50
intrac
left the channel
01:03
intrac
joined the channel
01:30
fredy330
joined the channel
03:37
illwieckz
left the channel
04:06
Bertl_oO
off to bed now ... have a good one everyone!
04:06
Bertl_oO
changed nick to: Bertl_zZ
06:12
illwieckz
joined the channel
06:21
illwieckz
left the channel
06:39
illwieckz
joined the channel
07:04
Spirit532
left the channel
07:32
se6astian
good day
07:40
Spirit532
joined the channel
10:22
intrac
left the channel
10:22
intrac
joined the channel
11:08
Bertl_zZ
changed nick to: Bertl
11:08
Bertl
morning folks!
13:14
se6astian
lattepanda now has a small touch screen attached
13:14
se6astian
I can go from recording there to playback of the same clip in a few seconds
13:14
se6astian
works very well
13:15
se6astian
this means we now have a self contained camera/recorder system!
13:15
se6astian
battery for lattepanda is also ordered
13:15
se6astian
standard USB/PD power brick should do
13:15
se6astian
and can also power the beta via dual USB power
13:15
se6astian
so entirely self contained and entirely mobile power supply!
13:15
se6astian
great day!
13:23
vup
nice
13:23
vup
now only the live preview while recording is missing :P
13:23
se6astian
true
13:23
se6astian
but we have two hdmi outputs on the beta
13:23
se6astian
one for recording one for viewing
13:24
vup
true, but at some point we want to use both for recording right?
13:24
vup
(and a shield for preview?)
13:24
se6astian
it would double FPS yes
13:24
se6astian
and remove the need for 2 monitors
13:24
se6astian
where 1 would be enough
13:24
vup
yeah that aswell
13:26
se6astian
now the question for me is how/where to control camera parameters
13:26
se6astian
on the recorder screen?
13:26
se6astian
or on a smartphone?
13:29
se6astian
or the axiom remote as well of course
13:30
se6astian
so all those are possible obviously but the question for me is what we want to have read first
13:30
se6astian
the remote will take more time
13:30
se6astian
but smartphone control over wifi works right now
13:30
se6astian
so would the recorder (small addition)
13:31
se6astian
what is most convenient though as first step?
14:00
se6astian
*ready first
14:18
vup
Well i guess the recorder so you have just a single device is probably most convenient?
14:19
vup
(Down the line we of course also want controls in the rust recorder as fourth option)
14:21
vup
se6astian: Oh also could you do a run of https://zsmith.co/bandwidth.php#download on the latte panda and upload the resulting bmp somewhere?
15:09
se6astian
will do
15:10
se6astian
hmm, does that website resolve for you currently?
15:11
vup
yes it does
15:12
vup
https://files.niemo.de/bandwidth-1.11.1.tar.gz
15:20
se6astian
thanks
15:32
se6astian
running
15:33
se6astian
does it test CPU only or also the M.2 SSD?
15:34
vup
its a memory bandwidth tester, so CPU only
15:34
vup
or rather combination of CPU and DRAM
15:35
se6astian
right
15:39
vup
Bertl: do you by chance know if there is a way to force eagle to overwrite the file when using `WRITE`, if a file with the same name already exists?
16:00
se6astian
MEETING TIME, who is here?
16:01
vup
is here
16:02
se6astian
any news vup? :)
16:02
vup
a bit, nothing mayor
16:03
se6astian
please do
16:04
vup
Well, motivated by the openmoko oui id application I started going through many of the files in axiom-firmware, nctrl and webui and added proper license information
16:04
vup
(to the individual files)
16:04
vup
there a still a few files missing information, but those I can't do myself, as I need information about the license and copyright
16:05
vup
there is a list of outstanding files here: https://github.com/apertus-open-source-cinema/axiom-firmware/pull/194
16:05
se6astian
I suspect Bertl is the author of the missing ones
16:05
se6astian
Bertl: can you confirm?
16:06
vup
furthermore I also started working on automation to generate schematic pdfs, gerbers and more from all the various pcb schemaics and board files
16:07
vup
the ideas here is instead of manually generating all the pdfs and gerbers to start putting the `.sch` and `.brd` files in a git repo and then automatically generate all the artifacts
16:08
vup
and then finally generate a website where one can easily find all the files and download them
16:08
vup
finally anuejn and I also continued a bit with the rust recorder and narui
16:08
vup
first we tested them on MacOS
16:09
vup
the recorder works flawlessly (apart from the `Display` node) on MacOS
16:09
vup
and we finally fixed the problem in `narui` that made it hang after rendering the first few frames on MacOS
16:10
vup
so `narui` is now also working well on MacOS
16:10
se6astian
wonderful!
16:10
vup
(this currently needs this fix for the vulkan abstraction library we are using: https://github.com/vulkano-rs/vulkano/pull/1766) otherwise you will hang / crash your GPU on MacOS and also on linux when using a intel GPU :)
16:11
vup
second, I looked at the cpu bitdepth conversion again and figured out how to bring the rust compiler to properly generate vectorized code: https://github.com/apertus-open-source-cinema/axiom-recorder/pull/20
16:12
vup
this brought the (single threaded) bitdepth conversion from about 70fps to about 350fps for 3072x4096 raw12 frames on my laptop
16:12
se6astian
amazing!
16:12
vup
with this optimization it is now also very clear that we are hitting the maximum memory bandwidth available on most consumer devices very quickly
16:13
vup
the maximum fps I can get on my laptop seems to be about 600fps, that maxes out the available memory bandwidth
16:14
vup
so in the future we will probably have to think about combining processing steps to do more computation per byte
16:15
vup
but this is a topic for the future, for now anuejn and I designed the new processing system for the recorder that finally makes things possible like combining two frames into one, which will finally make it possible to use the recorder for the hdmi based raw recording
16:15
se6astian
hurray!
16:16
vup
this is not implemented yet, but anuejn and I are quite fond of the design we came up with, lets see how long it takes us to implement it :)
16:16
se6astian
fingers crossed
16:16
vup
I think thats it from me this week :)
16:16
se6astian
how can you switch which 2 frames you get?
16:16
se6astian
in case its not the matching A+B pair?
16:18
vup
ah we havent thought about cases like this in depth, we mostly thought about the general framework that allows a node based processing graph with different input and output rates for the nodes, which does multi-threading and dropping frames under load
16:19
se6astian
ok
16:19
se6astian
quick updates from me: I worked more on the raw hdmi recording scripts/tools and documentation
16:20
se6astian
today I managed to go from recording on the lattepanda to viewing the same clip in a matter of a few seconds (for a short clip though)
16:20
se6astian
so the general process works
16:20
se6astian
(read more about it in the log from a bit earlier today)
16:20
se6astian
my chaos communication congress talk got accepted and will be prerecorded in december
16:21
se6astian
I am now starting to design a 3d print enclosure to put lattepanda, monitor, battery, etc. onto the back of the CP enclosure
16:21
se6astian
so we should soon have a full self contained camera with batteries
16:21
se6astian
for this purpose I wanted to discuss audio recording
16:21
se6astian
should we ignore it for now
16:22
se6astian
or simply plug a USB audio device into the lattepanda
16:22
se6astian
the sync between video and audio is the big topic...
16:22
vup
the sync is usually does in the postprocessing anyways, right?
16:23
se6astian
well, the film clap method yes
16:23
se6astian
but then there is no point in recording audio in the camera
16:23
se6astian
as it can be done externally anyways
16:24
vup
yeah
16:24
se6astian
sometimes its convenient to have matching audio for the video though
16:24
vup
how good does the sync usually need to be? How many ms difference are acceptable?
16:24
se6astian
without extra effort (extra devices, extra manual sync steps)
16:25
se6astian
we should aim for 1fps accuracy IMO, so 40ms with 25 fps
16:26
vup
hmm
16:26
vup
thats quite a lot
16:26
se6astian
yeah we humans are quite tolerant there :)
16:26
se6astian
I think I read somewhere that the 5-6 fps out of sync range is where it becomes generally noticeable
16:27
vup
I wonder if we could achive 40ms relatively easily with a simple USB audio device
16:27
se6astian
my question is how we can "sync" in theory on the recorder side at all
16:27
se6astian
or do we just record both and measure where we are?
16:28
se6astian
would the system time become the timestamp for both audio and video?
16:28
vup
yeah thats what I am trying to figure out aswell
16:29
vup
if there was some kind of hardware timestamp from the audio device or something similar it should be quite doable
16:31
se6astian
it means though that we need to write a system timestamp into the HDMI raw frames we capture as well somehow
16:31
se6astian
or maybe ffmpeg can do that already somehow
16:31
vup
well
16:31
vup
we probably want to do that on the beta itself
16:32
se6astian
then we need to sync time between beta and recorder though
16:32
vup
or record audio on the beta :P
16:33
se6astian
also possible but would require HDMI audio signal then to recorder
16:33
vup
but timestamping the frames on the recorder has the problem that we don't really know the latency between the frame capture and it being received by ffmpeg
16:33
se6astian
correct
16:34
se6astian
this would need testing
16:34
vup
se6astian: well we could also stream it over ssh, the recorder is currently connected over ssh aswell anyways, right?
16:34
se6astian
yes
16:34
se6astian
true
16:34
se6astian
its not much data
16:34
vup
(or not even ssh, but just tcp)
16:35
se6astian
anyways, audio is not an important topic, but if we can achieve it with little effort it would have a real world benefit easily
16:35
se6astian
right thats it from my side I think
16:36
se6astian
Bertl: are you with us?
16:37
se6astian
right, anyone else who wants to report anything?
16:39
se6astian
ok then, many thanks vup & anuejn!
16:39
se6astian
MEETING CONCLUDED
16:40
se6astian
bandwidth tool is still running
16:40
se6astian
result is a bmp at the end?
16:41
vup
yeah it produces a bandwidth.bmp in the folder you are running in in the end
16:42
vup
afk for now
16:49
Bertl
sorry, had an emergency ...
16:49
Bertl
but nothing to report here this week either
17:02
se6astian
tahnks
17:02
se6astian
thanks
17:02
intrac
left the channel
17:06
intrac
joined the channel
17:07
Bertl
off for now ... bbl
17:08
Bertl
changed nick to: Bertl_oO
17:09
se6astian
vup: done: https://paste.pics/0c69502e289512a02fdea0ba4f248757
18:45
danieel
left the channel
18:47
danieel
joined the channel
19:03
elafon
left the channel
19:04
elafon
joined the channel
20:39
elafon
left the channel
20:39
danieel
left the channel
20:39
intrac
left the channel
20:39
Spirit532
left the channel
20:39
lexano
left the channel
20:39
balrog
left the channel
20:39
kbeckmann
left the channel
20:39
tpw_rules
left the channel
20:44
elafon
joined the channel
20:44
danieel
joined the channel
20:44
intrac
joined the channel
20:44
Spirit532
joined the channel
20:44
lexano
joined the channel
20:44
balrog
joined the channel
20:44
kbeckmann
joined the channel
20:44
tpw_rules
joined the channel
21:27
vup
se6astian: wow very interesting
21:28
vup
can you upload it somewhere without lossy compression?
21:29
se6astian
Will do tomorrow
21:29
vup
awesome, no rush
21:34
se6astian
Are the results surprising?
21:39
vup
well partly atleast
21:40
vup
on this you can very cleanly see the three cache levels
21:41
vup
but on my laptop for example its much more noisy and one can only really see two cache levels?
21:41
vup
(https://files.niemo.de/bandwidth.bmp)
21:43
vup
and also the cache seems to be a lot faster
21:43
vup
but then the actual memory bandwidth lower?