Current Server Time: 04:53 (Central Europe)

#apertus IRC Channel Logs

2022/10/11

Timezone: UTC


00:06
Spirit532
left the channel
00:06
Spirit532
joined the channel
00:09
polyrhythm
really cool experiments with the deriving of the sensor calibration with the spectral charts off the sensor page.
00:09
polyrhythm
i think we can get it closer with the color chart calibration, but it seems like an interesting idea. of course, the best would be spectrally profiling the sensor as discussed previously...
00:11
polyrhythm
regarding going with a linear transformation 3x3 vs a fancier thing, this is mostly a limitation of CinemaDNG and the ecosystem of software available to people working with media files for cinema.
00:11
polyrhythm
CinemaDNG only supports a 3x3 calibration matrix (and optional "forward matrix" which I won't get too into the weeds here, but basically another linear tranasform)
00:13
polyrhythm
if we want to try supporting more advanced calibration cases beyond a 3x3 into XYZ space, we pretty much have to write our own software but also ask that users only use that software to process the CinemaDNG files, which is pretty much not going to happen.
00:13
polyrhythm
which then means we have to consider creating our own raw format that does not conform to CinemaDNG spec but we caan do whatever we want with and provide processing software for
00:14
polyrhythm
for now I think the straight-ahead path is to see how far we can get with a linear 3x3 calibration and conforming to CinemaDNG spec and then putting a lot of effort into the color science after the calibration step: establishing a "native" gamut, the log curve, etc., all of which can be used without issue in industry standard software provided we make the LUTs and/or shader/DCTL files
00:16
aombk2
left the channel
00:16
polyrhythm
there might be something I am not considering so let me know if I am missing a piece of the puzzle :)
00:17
aombk
joined the channel
00:22
polyrhythm
I suppose the only other option I can think of is providing a pass-through calibration matrix in the DNG metadata and providing a LUT derived from our secret-sauce calibration that the user can use to bring the camera from "native" space to some useful intermediary to begin grading
00:24
polyrhythm
one other thing, kind of tangential to all of this, is that blackmagic has stopped developing support for CinemaDNG, so sooner or later our hands might be forced into stepping away from that format anyway. it is generally being dumped by camera manufacturers in the past year because RED has been suing everybody for using it
00:24
polyrhythm
despite being open source they appear to have some legal reason to be throwing out litigation to any companies which are using the format
01:01
aombk2
joined the channel
01:01
aombk
left the channel
02:10
aombk
joined the channel
02:12
aombk2
left the channel
02:22
aombk2
joined the channel
02:23
aombk
left the channel
02:33
aombk
joined the channel
02:34
aombk2
left the channel
02:36
freestyles
joined the channel
02:38
aombk2
joined the channel
02:40
aombk
left the channel
03:12
aombk2
left the channel
03:13
aombk
joined the channel
05:40
freestyles
left the channel
06:58
se6astian
anuejn: yes, samples here: https://cloud.apertus.org/index.php/s/Pg5N59pGNGFcyND
07:05
se6astian
polyrhythm: we could consider writing pure raw12 sequences and putting all the "color science" and processing we come up with into the software that translates those raw12 files to DNGs (it doesn't need to hapen in realtime while recording) - could be a frameserver
07:06
polyrhythm
hmm...maybe, but a DNG is supposed to be pure raw data coming in, and pure raw data coming out, with the responsible party for altering the image for the purposes of calibration coming later in the pipeline
07:08
polyrhythm
like, in the CinemaDNG flow, Resolve reads the raw data, reads the matrix in the metadata, and then maps the data from XYZ -> whatever working space the user has selected using those calibration matrices. I think if you tried to "pre-calibrate" the data directly in the DNG, that might have unforeseen consequences
07:09
polyrhythm
but I don't know how cases like ArriRAW and other proprietary flows are handled. they might be closer to what we are talking about
07:11
polyrhythm
I can be more confident that I'm thinking about this the right way with a little more reading o the DNG spec and looking up how calibration is done
07:13
se6astian
yes, we do not have to decide now, just keep an eye open for the option
07:14
se6astian
I know that other raw image vendors are preprocessing their raws for the same reasons
07:28
polyrhythm
let me know if you know any specific companies or have come across any published papers regarding this space...I think Arri has published papers on their raw format
07:30
mustafa_
left the channel
07:30
polyrhythm
https://ieeexplore.ieee.org/document/7289958
07:30
polyrhythm
https://ieeexplore.ieee.org/document/7289691
07:30
polyrhythm
those are Arri's papers. unfortunatley I'm not affiliated with an academic institute so I can't access them
08:48
mustafa_
joined the channel
09:58
mustafa_
left the channel
10:14
mustafa_
joined the channel
10:15
vup
what color spaces does dng support?
10:16
vup
maybe a linear transform into a color space that is a nonlinear transform of XYZ can improve things aswell
10:31
aombk2
joined the channel
10:33
aombk
left the channel
11:09
mustafa_
left the channel
11:42
anuejn
polyrhythm: DNG does in fact support nonlinear transform if I understand it correctly
11:42
anuejn
via the Hue/Saturation/Value Mapping Table
11:42
anuejn
for this, see p. 82 of the DNG v1.4 spec
11:43
anuejn
Bertl: thats unfortunate :(
11:44
anuejn
polyrhythm: also, at this stage I would not hesitate to just try to squeeze out the best possible thing and then see if we can map that to CinemaDNG and with what sacrifices
13:14
mustafa_
joined the channel
13:22
mustafa_
left the channel
14:20
se6astian
left the channel
14:20
vup
left the channel
14:24
bluez
left the channel
14:24
BAndiT1983
left the channel
14:24
polyrhythm
left the channel
14:24
eppisai
left the channel
14:24
anuejn
left the channel
14:53
mustafa_
joined the channel
14:54
bluez
joined the channel
14:54
BAndiT1983
joined the channel
14:54
anuejn
joined the channel
14:54
eppisai
joined the channel
14:54
polyrhythm
joined the channel
14:54
se6astian
joined the channel
14:54
vup
joined the channel
14:55
mustafa_
left the channel
15:24
se6astian
left the channel
15:24
vup
left the channel
15:25
anuejn
left the channel
15:25
bluez
left the channel
15:28
polyrhythm
left the channel
15:28
BAndiT1983
left the channel
15:29
eppisai
left the channel
15:58
bluez
joined the channel
15:58
eppisai
joined the channel
15:58
anuejn
joined the channel
15:58
se6astian
joined the channel
15:58
polyrhythm
joined the channel
15:58
BAndiT1983
joined the channel
15:58
vup
joined the channel
16:24
mustafa_
joined the channel
16:42
mustafa_
left the channel
16:48
mustafa__
joined the channel
16:55
mustafa_
joined the channel
16:56
mustafa__
left the channel
16:56
mustafa_
left the channel
16:57
mustafa_
joined the channel
17:49
aombk
joined the channel
17:51
aombk2
left the channel
19:34
aombk2
joined the channel
19:35
aombk
left the channel
19:57
aombk
joined the channel
19:58
aombk2
left the channel
21:19
se6astian
left the channel
21:19
vup
left the channel
21:20
bluez
left the channel
21:23
anuejn
left the channel
21:23
polyrhythm
left the channel
21:23
eppisai
left the channel
21:23
BAndiT1983
left the channel
21:35
mustafa__
joined the channel
22:44
BAndiT1983
joined the channel
22:44
bluez
joined the channel
22:44
se6astian
joined the channel
22:44
polyrhythm
joined the channel
22:45
anuejn
joined the channel
22:45
vup
joined the channel
22:45
eppisai
joined the channel
22:48
polyrhythm
vup: DNG does't explicitly support any particular color space because DNG represents raw data, which is not encoded into a color space. whatever software processes the DNG has control over what color space is supported...in the case of resolve, Rec. 709, DCI-P3, and Blackmagic Film is supported for DNG
22:51
polyrhythm
anuejn: regarding the HSV mapping, Resolve doesn't support that metadata field :(
22:51
polyrhythm
you might find it off why I seem to be harping on Resolve so much but the reality is that film people overwhelmingly use Resolve to do color correction or turning DNG/raw files into an intermediate that is later used in the edit, so whatever it does is kind of important
22:52
polyrhythm
https://forum.blackmagicdesign.com/viewtopic.php?f=21&t=165986
22:53
polyrhythm
also the intent of the HSV mapping is basically gamut mapping: support of out-of-gamut colors to be mapped back into gamut space. I suppose it could also provide non-linear precision-enhancing potential to a standard in-gamut case as well?
22:58
polyrhythm
i look forward to receiving the test chart shots so we can compare results and see how best to proceed