Current Server Time: 19:23 (Central Europe)

#apertus IRC Channel Logs

2018/06/05

Timezone: UTC


00:35
rton
left the channel
00:51
BAndiT1983
changed nick to: BAndiT1983|away
01:05
aombk
joined the channel
01:55
TofuLynx
left the channel
02:05
fredy
left the channel
02:06
fredy__
joined the channel
02:15
jucar
joined the channel
02:23
Bertl
off to bed now ... have a good one everyone!
02:23
Bertl
changed nick to: Bertl_zZ
02:31
jucar
left the channel
04:39
ymc98_1
joined the channel
05:20
niemand
joined the channel
05:20
niemand
left the channel
05:20
niemand
joined the channel
06:03
g3gg0
joined the channel
06:43
se6astian|away
changed nick to: se6astian
06:44
niemand
left the channel
07:09
ymc98_1
left the channel
07:10
ymc98_1
joined the channel
07:15
ymc98_1
left the channel
07:27
ymc98
joined the channel
07:44
sebix
joined the channel
07:44
sebix
left the channel
07:44
sebix
joined the channel
07:47
fredy__
changed nick to: fredy
07:48
BAndiT1983|away
changed nick to: BAndiT1983
08:12
ymc98
left the channel
08:22
ymc98
joined the channel
08:30
rton
joined the channel
09:11
aombk2
joined the channel
09:14
aombk
left the channel
09:18
Bertl_zZ
changed nick to: Bertl
09:18
Bertl
morning folks!
11:30
danieeel
joined the channel
11:32
danieeeel
joined the channel
11:32
danieel
left the channel
11:36
danieeel
left the channel
12:40
RexOrCine|away
changed nick to: RexOrCine
13:17
g3gg0-afk
joined the channel
13:17
g3gg0-afk
left the channel
13:18
g3gg0-mobile
joined the channel
13:18
g3gg0-mobile
Hi
13:23
Bertl
hey
13:25
supragya
joined the channel
13:25
supragya
hi g3gg0 g3gg0-mobile BAndiT1983
13:26
g3gg0-mobile
Hi supragya
13:26
supragya
you asked for mlv file?
13:26
g3gg0-mobile
Yeah
13:26
g3gg0-mobile
Are you on limited bandwidth?
13:26
supragya
well, you could generate one by running the emulator at your end :)
13:27
supragya
yes, limited bandwidth
13:27
g3gg0-mobile
Okay, will y
13:27
supragya
however, I could do a small mlv with a couple of frames
13:27
g3gg0-mobile
Will usr your generator then
13:27
supragya
generator splits the files in two right now: meta and frames
13:27
supragya
will need to join those
13:28
supragya
currently fuse based system is taken out, had some issues with it
13:28
supragya
best is to clone locally and run ./setup.sh
13:28
supragya
that will do everything for you
13:28
supragya
axiom.mlv
13:29
supragya
btw, how are we proceeding now? I understood little on the direction we need to take
13:29
g3gg0-mobile
Okay will do this tonight
13:30
g3gg0-mobile
Whats planned for Phase 1 evaluation?
13:30
supragya
according to proposal?
13:32
g3gg0-mobile
Yep. Cannot acccess it right now as i am in a Workshop
13:32
supragya
Evaluation period​: Analysis phase ends: report findings and suitability of each
13:32
supragya
container format. Report if custom containers are feasible.
13:32
supragya
This is evaluation 2:
13:32
supragya
Evaluation period​:​Provide a functional and working system that can
13:32
supragya
encode/decode the decided video container format.
13:32
supragya
Preparation: ​Provide evidence with respect to where and how any performance
13:32
supragya
improvements can be made.
13:33
g3gg0-mobile
We have to be totally clear what the workflow should look like
13:34
supragya
okay... where do you say we should work on then?
13:34
supragya
design?
13:35
g3gg0-mobile
Workflow yeah
13:36
g3gg0-mobile
I thought we initially committed on writing cdng with a cache file inbetween
13:36
supragya
well, buffers are a problem for sure yes
13:37
supragya
also, mlv2cdng need to be implemented next?
13:37
g3gg0-mobile
Mlvfs already does this step
13:37
danieeeel
changed nick to: danieel
13:37
g3gg0-mobile
Hi
13:38
supragya
Am i missing the hiccup?
13:39
supragya
if current recorder is able to encode mlv, and mlv2cdng can be done, it only needs modification for example when PLR or dualexpo is added to the stream
13:39
g3gg0-mobile
Can you sketch the exact scenario of shooting a video, and whwre cdng comes into play?
13:39
supragya
Okay
13:39
supragya
From my perpective, this was what i thought from day one:
13:40
supragya
Person A goes, fires up the axiom and the recorder, and records the mlv
13:40
supragya
comes home, saves the mlv somewhere and then does post production
13:40
supragya
1st step in post production is mlv->CDNG and then everything else
13:40
BAndiT1983
there is something missing -> backup to multiple disks onb-set
13:40
BAndiT1983
*on-set
13:41
supragya
backup to multiple disks?
13:41
supragya
like a hot backup?
13:41
BAndiT1983
yep, so the data is not lost, just a thing which people always pointing at when speaking about using axiom on set
13:41
se6astian
backup is optional but good practice indeed
13:42
supragya
biggest thing is to solve the buffer issue
13:42
supragya
and how to make sure that we write to disk as fast as the stream
13:42
supragya
so we don't lose data
13:43
BAndiT1983
you cannot write as fast as the stream as the disk also needs some time
13:43
supragya
also a minor thing: current system does not split mlv into m00, m01 etc
13:43
BAndiT1983
and there are some components in betwtween whcih also require their time
13:43
BAndiT1983
buffering in ram and then writing is only usable thing at the moment
13:43
supragya
BAndiT1983, then over time ram will fill up and how do we act on bufferoverflows etc?
13:44
g3gg0-mobile
left the channel
13:44
supragya
stream is pushed to us, more like UDP that's the problem. Take it or leave it thing
13:45
BAndiT1983
?
13:45
BAndiT1983
you get data in ram, when some amount is there, then write to disk, plain and simple
13:47
supragya
seems okay, and the only option
13:47
g3gg0-mobile
joined the channel
13:47
g3gg0-mobile
Annoying -.-
13:47
supragya
btw, is there anything we are not clear about how the system should work?
13:48
supragya
g3gg0-mobile, need your thoughts on this please.
13:48
ymc98_1
joined the channel
13:49
ymc98
left the channel
13:50
g3gg0-mobile
We talked about that the system shall convert to cdng while recording and later
13:51
g3gg0-mobile
One thread is writing frames into a cache file(mlv)
13:51
BAndiT1983
nope, not while recording, it can leave to lost data on-set
13:51
BAndiT1983
*it can lead to
13:51
BAndiT1983
record mlv and nothing else, otherwise there are too many risks of lost data and wasted money
13:53
BAndiT1983
when the shoot is over and sd-card or whatever is backuped, then the user can decide to convert the data, but only then
13:53
g3gg0-mobile2
joined the channel
13:53
g3gg0-mobile2
Okay
13:53
supragya
I am sure, I have been living under this assumption (that BAndiT1983 put forth) since the day we had chat on how system should look like
13:53
supragya
hence the emulator
13:53
g3gg0-mobile2
Then its fine
13:54
BAndiT1983
supragya, you can implement conversion and we can add it to OC later, or so, to show the workflow to the people
13:54
BAndiT1983
also had trouble with raw2dng lately and it has to be reviewe after long time
13:54
BAndiT1983
*reviewed
13:55
g3gg0-mobile2
Then look into converting the mlv to cdng using e.g. mlvfs
13:55
BAndiT1983
what is the advantage to go over FUSE while converting?
13:55
g3gg0-mobile
left the channel
13:56
supragya
hmm, yes
13:56
g3gg0-mobile2
It already produces proper cdng and allows either on-demand conversion (quite effortless)
13:56
BAndiT1983
MLV reader in OC gets the data directly from the file and could be used for conversion?
13:56
supragya
maybe because it is already giving correct cdng
13:56
BAndiT1983
then you can use it
13:57
BAndiT1983
just wondering about performance of it
13:57
supragya
shouldn't be a big overhead
13:57
supragya
however, since on demand can be done
13:57
supragya
why not take it down and make it a program that converts it without fuse
13:58
g3gg0-mobile2
If we can pass through raw12 plr wothiut conversion it should be very inexpensive
13:58
supragya
that way, we have a strong starting point to add plr specific changes
13:58
g3gg0-mobile2
Sure, could be ported to OC
13:58
g3gg0-mobile2
Would support this idea
13:59
supragya
looked into dng specific methods on bitbucket (not sure if they are mlv2cdng) but, much of it is canon specific details, am i wrong?
14:00
g3gg0-mobile2
Matrices probably, yes
14:01
g3gg0-mobile2
Most likely there is even more
14:01
g3gg0-mobile2
iirc mlv2cdng was used as basis for mlvfs
14:01
supragya
can you point me to a starting point?
14:02
g3gg0-mobile2
https://www.magiclantern.fm/forum/index.php?topic=13152.0
14:03
supragya
just to be clear, I will try to take FUSE out for our specific system.
14:03
supragya
is that okay?
14:03
supragya
FUSE complicates a little (for starting point)
14:05
BAndiT1983
now you are at the point where i was wondering about fuse for it at first place
14:05
g3gg0-mobile2
You mean for camera emulation? Yeah
14:05
BAndiT1983
if you have useful interface, then any system can be used with it
14:06
supragya
BAndiT1983, did not get you... are you thinking about FUSE for mlv2dng?
14:06
supragya
*cdng
14:06
BAndiT1983
it was the idea of g3gg0, my point was, that you should access the MLV data directly first and try to convert it
14:07
g3gg0-mobile2
My plan was to reuse mlvfs
14:08
g3gg0-mobile2
Provides already proper mlv parsing, preview code and cdng generation
14:08
supragya
can you think of what changes would be needed in mlvfs (for our mlv till now, without PLR etc)?
14:09
supragya
*grammar
14:09
supragya
(mine)
14:10
g3gg0-mobile2
According to danieel, cdng does 1:1 accept our payload and adding a tag for the linearization table should be enough
14:10
g3gg0-mobile2
Comparable for what mlvfs does for jp92 (compressed mlv)
14:10
g3gg0-mobile2
Id say thats a week of effort
14:14
g3gg0-mobile2
BAndiT1983, is it okay for you if supragya spends a week on this?
14:15
g3gg0-mobile2
Then we have one possible workflow which allows CDNG being produced with reasonable effort
14:16
BAndiT1983
he can try, although i'm not sure about the performance
14:17
supragya
I am sorry, but what does linearisation table do exactly?
14:17
BAndiT1983
some google search brings varying results using fuse, with major slowdowns
14:17
supragya
are we not going from 12bit to 12bit raw from mlv to cdng
14:17
danieel
g3gg0: i was not sure if it is 1:1, but if you pack the bits corretly, then yes
14:17
BAndiT1983
i'Ve posted a paper on that before
14:18
BAndiT1983
http://www.rcsumner.net/raw_guide/
14:18
supragya
BAndiT1983, on linearisation?
14:19
BAndiT1983
yes
14:19
BAndiT1983
same paper is linked on the page
14:19
BAndiT1983
usually it was conversion from 12bit to 16 bit linear data, but this varies
14:20
BAndiT1983
page 7 in the pdf is about linearization
14:21
ymc98_1
left the channel
14:22
g3gg0-mobile2
We had two options: convert raw12-plr to raw16-lin during conversion
14:22
g3gg0-mobile2
This was the first choice
14:23
g3gg0-mobile2
The other one, discussed yesterday, was to simply pass the raw12-plr
14:23
g3gg0-mobile2
And provide a lut for linearization
14:24
danieel
i have the 12bit bit order snippet, can I paste?
14:24
supragya
so the problem statement is to make a LUT for conversion from raw12-plr to raw16-lin?
14:25
g3gg0-mobile2
A) convert by hand to raw16-lin using probably a per-pixel-lut as alex proposed
14:26
g3gg0-mobile2
B) just pass raw12-plr and provide the cdng tag for the lut
14:27
g3gg0-mobile2
Who votes for which option? I prefer B) if it is possible
14:27
supragya
B seems better
14:27
Bertl
off for now ... bbl
14:27
Bertl
changed nick to: Bertl_oO
14:28
danieel
C) convert to 16bit in per pixel and apply a global lut/curve to reduce data to 12 bit
14:29
supragya
wont that mean 12bitPLR is linearisable in 12bits itself?
14:29
g3gg0-mobile2
Hehe
14:29
danieel
you can compare all - and see if the psnr is above the rounding erros :)
14:30
danieel
hard to tell if the sensor is that bad in doing plr, that it needs per pixel correction
14:30
supragya
PSNR -> Peak signal to noise ratio?
14:30
g3gg0-mobile2
C) is like A) ;)
14:31
danieel
just 3/4 of the storage/bandwidth
14:31
g3gg0-mobile2
Yep. Preferrable
14:31
supragya
aren't we losing details in C ?
14:31
supragya
or some other things?
14:31
g3gg0-mobile2
Probably noise
14:32
BAndiT1983
what about dark frame?
14:34
g3gg0-mobile2
Id say not scope yet
14:34
danieel
either burn-in into raw data, or match with the reel number / camera model
14:34
danieel
(& camera sn)
14:35
g3gg0-mobile2
Tool support is quite bad iirc
14:35
g3gg0-mobile2
So id put it into cdng conversion
14:35
danieel
yes, i can remember the still tools have dark frame / flat field correction which is matched by that
14:36
supragya
well, I may start missing things which are necessary this way :)
14:36
danieel
if you burn this in, then there is a question wheter to mask and interpolate the hot pixels :)
14:36
supragya
g3gg0-mobile2, am I to implement B ?
14:36
BAndiT1983
implement conversion first, as the discussion is drifting off a lot
14:37
BAndiT1983
we should walk step by step
14:37
danieel
because the bad pixel list feature is also a problematic feature of the tools
14:38
g3gg0-mobile2
Supragya look into efforts required for B) or C)
14:39
danieel
these things could have a configuration option, generalized as: ignore/reference/embed/apply , for the various levels of processing
14:39
g3gg0-mobile2
Assume A) is similar to C)
14:40
supragya
se6astian, ping!
14:43
supragya
g3gg0-mobile2, analysing B and C (using tools like matlab)?
14:43
supragya
or scilab?
14:43
g3gg0-mobile2
You decide
14:44
supragya
okay!
14:44
g3gg0-mobile2
What do you want to Analyse exactly?
14:45
danieel
on a real world plr shot or artificially generated one? so that the sensor "shittiness" can be adjusted
14:45
g3gg0-mobile2
Do we have a sensor model?
14:45
supragya
real world plr would be good to test experimentally
14:46
supragya
artificial generation would be mathematical
14:46
BAndiT1983
is it in the scope of gsoc?
14:47
supragya
as far as I wrote in proposal (to make an emulation) (eval 2), no. But I really never knew what i was writing for during proposal submission
14:48
supragya
this may well be a part of gsoc
14:48
supragya
if we consider we are chosing a raw container for AXIOM Beta specifically
14:48
BAndiT1983
but is it really important at the moment?
14:49
supragya
it is really upto you, BAndiT1983 and g3gg0-mobile2 to choose the direction
14:49
BAndiT1983
can'T you just create some useful curve and test with it? as the task was about container for axiom and not all the processing and bits
14:49
danieel
but back to the question - if one (alex) thinks there *IS* a need of per pixel curve, then he must have the proof/measurement/simulation already in place
14:50
supragya
if we think raw12 is without plr, it does not need a LUT since it is linear (am I wrong)?
14:50
supragya
if plr is introduced, there are additional blocks for it in mlv system which would not be a big problem to add in current emulation
14:50
danieel
i would definitely start with A, to dont block the whole thing.. and when the proper 16bit linearizaton is implemented, then packing it with a lut/curve to 12 bit is trivial (C)
14:50
g3gg0-mobile2
Supragya look into efforts required for B) or C)
14:51
g3gg0-mobile2
Wait. First check efforts.
14:51
supragya
after that BAndiT1983, yes when mlv2cdng conversion is to be done, this discussion would crop up eventually
14:51
supragya
how to account for plr in cdng
14:52
danieel
then also check meaningfullness, if the perpixel plr relies on some unusual calibration step which is not developed, it makes no sense to implement B/C
14:53
supragya
g3gg0-mobile2, sure... will do some research, and get back to you within a few days with some thoughts on it
14:53
supragya
things are blurry for me now... but will sort it out with communications in this week
14:56
g3gg0-mobile2
Please ask if things are unclear
14:57
supragya
sure
14:58
g3gg0-mobile2
Gtg. Continue per mail please
14:58
supragya
Going away now. Thanks for time, all of you, BAndiT1983 g3gg0-mobile2, danieel.
14:58
g3gg0-mobile2
Ok cu
14:58
se6astian
changed nick to: se6astian|away
15:01
danieel
np, off for shopping too
15:01
supragya
left the channel
15:05
g3gg0-mobile2
left the channel
15:26
g3gg0-mobile
joined the channel
16:02
supragya
joined the channel
16:26
supragya
left the channel
17:10
se6astian|away
changed nick to: se6astian
17:34
g3gg0-mobile
left the channel
17:44
TofuLynx
joined the channel
17:48
TofuLynx
Good Afternoon!
17:49
BAndiT1983
hi TofuLynx
17:51
g3gg0-mobile
joined the channel
17:56
g3gg0-mobile
left the channel
18:22
TofuLynx
BAndiT1983:
18:23
TofuLynx
I added the manual paths on ProcessingTest Cmakelist
18:23
TofuLynx
and it still says undefined reference to
18:24
BAndiT1983
pastebin your cmakelists.txt please
18:25
TofuLynx
https://pastebin.com/kSV2dRiA
18:25
TofuLynx
Here is it
18:26
BAndiT1983
have you executed cmake ..
18:26
BAndiT1983
?
18:26
TofuLynx
yup
18:27
TofuLynx
I mean
18:27
TofuLynx
Qt Creator auto compiles the cmake
18:27
TofuLynx
Running "/usr/bin/cmake /home/claubit/opencine '-GCodeBlocks - Unix Makefiles'" in /home/claubit/Source/build-opencine-Desktop_Qt_5_10_1_GCC_64bit-Debug.
18:27
BAndiT1983
then commit to your fork and i will try to adjust it
18:27
TofuLynx
ok!
18:28
TofuLynx
Do I commit the 3rd party too_
18:28
TofuLynx
?
18:28
BAndiT1983
yes, please
18:28
TofuLynx
I have a problem
18:29
TofuLynx
the lodepng.cpp doesnt appear on Qt Creator, so it doesnt appear on the modified files list to commit
18:31
BAndiT1983
do you use qtcreator for git?
18:31
TofuLynx
Yep
18:31
BAndiT1983
never worked for me well
18:32
BAndiT1983
i suggest gitkraken or smartgit, more comfortable
18:32
TofuLynx
i think the problem is Qt not detecting the .cpp file
18:33
BAndiT1983
is cmake finishing without errors?
18:33
TofuLynx
yeah
18:33
TofuLynx
also, I will commit now using the terminal
18:33
TofuLynx
so you can adjust
18:36
TofuLynx
Done
18:36
TofuLynx
Can you check it?
18:36
BAndiT1983
give me a moment, have to prepare some things for it first
18:42
TofuLynx
Is it neccesary to add a CMakeLists.txt to lodepng folder?
18:43
aombk2
left the channel
18:43
BAndiT1983
nope
18:44
BAndiT1983
cmakelists is for modules which should build something, but this files will be added statically
18:44
BAndiT1983
alternatively you could copy them to the folder where you need them
18:45
TofuLynx
Ok! :/ This issue is really making me frustrated
18:45
TofuLynx
I will wait for your try :)
18:57
TofuLynx
brb, Dinner time
18:58
BAndiT1983
enjoy your meal
19:21
BAndiT1983
TofuLynx: another thing which is occuring to me, your cmakelists are not up to date with main repo, as my cmake complains about QT5_USE_MODULES which is obsolete
19:33
BAndiT1983
replace your paths to lodepng with this ->
19:33
BAndiT1983
"${CMAKE_SOURCE_DIR}/3rdParty/lodepng/lodepng.cpp"
19:33
BAndiT1983
"${CMAKE_SOURCE_DIR}/3rdParty/lodepng/lodepng.h"
20:15
TofuLynx
Back
20:16
TofuLynx
Let me try it
20:19
TofuLynx
It worked! :D
20:19
TofuLynx
Thanks!
20:25
BAndiT1983
no problem
20:25
TofuLynx
Ok
20:25
TofuLynx
I think SHOODAK2 is now good
20:26
TofuLynx
But I can't really confirm
20:26
TofuLynx
I will send a example to lab chat
20:32
TofuLynx
Sent :)
20:54
BAndiT1983
shoodak2 has more fuzz on the edges or brighter areas
20:55
BAndiT1983
i like gedi more
20:56
BAndiT1983
will you send Stephan also some samples?
20:56
TofuLynx
Yeh I will be
20:56
TofuLynx
I will send*
21:25
TofuLynx
Well, finally I can compare the different algorithms with GIMP
21:25
TofuLynx
It's a great addition :)
21:25
TofuLynx
Now, as I said yesterday, I will review the code and document it.
21:26
TofuLynx
I have to go now, Sleep time :)
21:26
TofuLynx
Good Night Folks!
21:27
TofuLynx
left the channel
21:30
BAndiT1983
changed nick to: BAndiT1983|away
21:34
se6astian
changed nick to: se6astian|away
22:19
RexOrCine
changed nick to: RexOrCine|away
22:29
Bertl_oO
off to bed now ... have a good one everyone!
22:29
Bertl_oO
changed nick to: Bertl_zZ