Current Server Time: 00:02 (Central Europe)

#apertus IRC Channel Logs

2022/04/08

Timezone: UTC


04:15
Bertl_oO
off to bed now ... have a good one everyone!
04:15
Bertl_oO
changed nick to: Bertl_zZ
07:56
se6astian
good day
09:13
vup
some more darkframe analysis
09:13
vup
I captured some series ouf ~50 darkframes from ~.9ms to (1000/24)ms exposure time
09:16
vup
each averaged over 1024 frames up to ~30ms exposure time, 512 frames above that
09:17
vup
the general goal is to find a way to use a single / a few darkframes for the darkframe calibration and not need a specific darkframe for each exposure time
09:18
vup
previously this was done by using a model linear in the exposure time
09:20
vup
so using two reference frames, one (`b`) that is basically the extrapolation of a darkframe at 0ms exposure time and a frame (`m`) that represents the exposure dependent part, so that the final darkframes for a exposure time of `n` ms is calculated as `n * m + b`
09:21
vup
so this is what I started out with aswell and tried to reproduce
09:21
vup
b and m are just determined by a per pixel linear regression over the 51 averaged darkframes I captured
09:22
vup
to evaluate this model, I calculated the per pixel residual for each of the darkframes
09:23
vup
(for the darkframes `real_df` with exposure time `n` ms, this is just `real_df - m * n - b`)
09:23
vup
this is visualized in this plot: https://files.niemo.de/darkframe_residual_linear_model.pdf
09:23
vup
which is just the histogram of these residuals for each of the darkframes I captured
09:24
vup
(note that the colors are log normalized)
09:25
vup
(so the actual variance of the residuals is visually vastly overstated)
09:27
vup
(https://files.niemo.de/darkframe_residual_linear_model_norm_linear_norm.pdf is a version that uses a linear norm)
09:34
vup
a few examples that show the residuals for some specific darkframes: https://files.niemo.de/darkframe_residual_examples.pdf
09:34
vup
so these are not really randomly distributed, but show patterns, which could probably be visible in "real" images aswell
09:35
littlebobeep
left the channel
09:35
vup
so some general questions: which exposure time range would be absolutely necessary to cover? 0ms to 1000/24ms seems like a obvious choice for me, but maybe we can cutoff earlier?
09:36
vup
any ideas for better models?, ill try some high degree polynomials next, but going higher than maybe second or third degree seems like arbitrary overfitting very quickly
09:36
vup
any idea where these pattern come from?
09:38
vup
any opinions on how flatfield correction will interact with this? maybe we want to "flatfield correct the `m * n` term"?
09:38
vup
oh also, this was all for 1x gain, ill calculate it for 2x, 3x and 4x is a sec
09:59
vup
so this is for 4x gain: https://files.niemo.de/darkframe_4.0x_residual_linear_model.pdf
09:59
vup
https://files.niemo.de/darkframe_4.0x_residual_examples.pdf
09:59
vup
interestingly, the residuals do not match up completely
10:09
se6astian
very interesting vup
10:10
se6astian
currently we cannot expose as long as the frame period
10:10
se6astian
as you asked about limiting the exposure range
10:10
vup
yeah, but I expect that this should some day be the case, right?
10:10
se6astian
I hope so yes :)
10:10
se6astian
very short exposures like 1/8000s might be interesting
10:11
se6astian
but thats probably the lower limit
10:11
vup
well they don't work currently :P
10:11
se6astian
ah
10:11
se6astian
what is the low end currently?
10:11
vup
~.89ms was the lower limit of where I got matching a and b frames over the raw hdmi
10:11
se6astian
ok
10:12
vup
(is this a know problem?)
10:12
se6astian
but that sounds like an issue that might be gone with the sequences/generator decoupling that Bertl is currently implementing
10:12
vup
right
10:13
vup
oh another question: how often do we expect longer exposure times to be interesting? (100ms to tens of seconds), are we fine with expecting people to capture specific darkframes for these ranges?
10:14
se6astian
I think for long exposure times we can expect people to run calibrations
10:14
se6astian
if the process is somehow guided through in the camera itself
10:15
se6astian
did you find any relation between sensor temperature and noise levels?
10:17
vup
not yet, I just though about that aswell, but forgot to include capturing the temperature while capturing the darkframes
10:17
vup
(also forgot to enable dark columns, but I guess thats what I get for starting it at 4:30 am :P)
10:17
se6astian
its in the sensor registers if you captured raw12s as well
10:17
se6astian
:P
10:17
vup
nope I did not
10:17
se6astian
ok
10:18
se6astian
one thing I would also find an interesting check is if the fpn can be assumed constant for a particular combination of settings
10:18
vup
I wanted to maximize the time available for the darkframes (only to figure out after sleeping, that it just worked for about 1.5h and then broke, because I suck at python :))
10:18
se6astian
so if you capture the same darkframe set one day and the same set again a week later
10:18
vup
se6astian: you mean, while varying temperature?
10:18
se6astian
will the pattern match up perfectly
10:19
vup
ah, or temporal, right
10:19
se6astian
but also with temperature yes
10:19
vup
I expect the supply voltages so have some kind of effect aswell
10:19
vup
but these should hopefully be somewhat temperature independent, if they use a "good" voltage reference
10:19
vup
(and the resistors are not that temperature sensitive)
10:20
vup
so it might be interesting to capture those aswell
10:20
vup
I think I have some darkframes taken with very similar settings from much earlier, ill see if I find some that are close enough to compare
10:20
se6astian
can you capture the voltage information that is visible during the lvds training process (or was it another command) with the darkframes as metadata?
10:21
vup
sure
10:22
vup
that should be trivial pretty much
10:22
vup
(well when I am home again, I captured the darkframes to have something to do while taking a train :P)
10:22
se6astian
great
10:50
Bertl_zZ
changed nick to: Bertl
10:51
Bertl
morning folks!
11:34
vup
morning :)
12:29
aombk2
joined the channel
12:31
aombk3
joined the channel
12:32
aombk
left the channel
12:35
aombk2
left the channel
13:00
littlebobeep
joined the channel
13:45
Bertl
vup: excellent work!
16:09
Bertl
off for now ... bbl
16:10
Bertl
changed nick to: Bertl_oO
19:35
se6astian
https://twitter.com/NASA/status/1512449836511121415?ref_src=twsrc%5Etfw%7Ctwcamp%5Etweetembed%7Ctwterm%5E1512449836511121415%7Ctwgr%5E%7Ctwcon%5Es1_&ref_url=https%3A%2F%2Fwww.derstandard.de%2Fstory%2F2000134800475%2Fstart-geglueckt-erste-private-crew-ist-unterwegs-zur-iss
19:35
se6astian
sorry for long link
19:35
se6astian
https://twitter.com/NASA/status/1512449836511121415
19:35
se6astian
the AXIOM Space mission is on its way to the ISS
19:36
se6astian
@Axiom_Space
19:36
se6astian
Creating a thriving home in space that benefits every human, everywhere.
19:36
Bertl_oO
yay! *G*
23:00
ShinyCyril
joined the channel
23:47
ShinyCyril
left the channel