Current Server Time: 02:53 (Central Europe)

#apertus IRC Channel Logs

2022/04/08

Timezone: UTC


03:15
Bertl_oO
off to bed now ... have a good one everyone!
03:15
Bertl_oO
changed nick to: Bertl_zZ
06:56
se6astian
good day
08:13
vup
some more darkframe analysis
08:13
vup
I captured some series ouf ~50 darkframes from ~.9ms to (1000/24)ms exposure time
08:16
vup
each averaged over 1024 frames up to ~30ms exposure time, 512 frames above that
08:17
vup
the general goal is to find a way to use a single / a few darkframes for the darkframe calibration and not need a specific darkframe for each exposure time
08:18
vup
previously this was done by using a model linear in the exposure time
08:20
vup
so using two reference frames, one (`b`) that is basically the extrapolation of a darkframe at 0ms exposure time and a frame (`m`) that represents the exposure dependent part, so that the final darkframes for a exposure time of `n` ms is calculated as `n * m + b`
08:21
vup
so this is what I started out with aswell and tried to reproduce
08:21
vup
b and m are just determined by a per pixel linear regression over the 51 averaged darkframes I captured
08:22
vup
to evaluate this model, I calculated the per pixel residual for each of the darkframes
08:23
vup
(for the darkframes `real_df` with exposure time `n` ms, this is just `real_df - m * n - b`)
08:23
vup
this is visualized in this plot: https://files.niemo.de/darkframe_residual_linear_model.pdf
08:23
vup
which is just the histogram of these residuals for each of the darkframes I captured
08:24
vup
(note that the colors are log normalized)
08:25
vup
(so the actual variance of the residuals is visually vastly overstated)
08:27
vup
(https://files.niemo.de/darkframe_residual_linear_model_norm_linear_norm.pdf is a version that uses a linear norm)
08:34
vup
a few examples that show the residuals for some specific darkframes: https://files.niemo.de/darkframe_residual_examples.pdf
08:34
vup
so these are not really randomly distributed, but show patterns, which could probably be visible in "real" images aswell
08:35
littlebobeep
left the channel
08:35
vup
so some general questions: which exposure time range would be absolutely necessary to cover? 0ms to 1000/24ms seems like a obvious choice for me, but maybe we can cutoff earlier?
08:36
vup
any ideas for better models?, ill try some high degree polynomials next, but going higher than maybe second or third degree seems like arbitrary overfitting very quickly
08:36
vup
any idea where these pattern come from?
08:38
vup
any opinions on how flatfield correction will interact with this? maybe we want to "flatfield correct the `m * n` term"?
08:38
vup
oh also, this was all for 1x gain, ill calculate it for 2x, 3x and 4x is a sec
08:59
vup
so this is for 4x gain: https://files.niemo.de/darkframe_4.0x_residual_linear_model.pdf
08:59
vup
https://files.niemo.de/darkframe_4.0x_residual_examples.pdf
08:59
vup
interestingly, the residuals do not match up completely
09:09
se6astian
very interesting vup
09:10
se6astian
currently we cannot expose as long as the frame period
09:10
se6astian
as you asked about limiting the exposure range
09:10
vup
yeah, but I expect that this should some day be the case, right?
09:10
se6astian
I hope so yes :)
09:10
se6astian
very short exposures like 1/8000s might be interesting
09:11
se6astian
but thats probably the lower limit
09:11
vup
well they don't work currently :P
09:11
se6astian
ah
09:11
se6astian
what is the low end currently?
09:11
vup
~.89ms was the lower limit of where I got matching a and b frames over the raw hdmi
09:11
se6astian
ok
09:12
vup
(is this a know problem?)
09:12
se6astian
but that sounds like an issue that might be gone with the sequences/generator decoupling that Bertl is currently implementing
09:12
vup
right
09:13
vup
oh another question: how often do we expect longer exposure times to be interesting? (100ms to tens of seconds), are we fine with expecting people to capture specific darkframes for these ranges?
09:14
se6astian
I think for long exposure times we can expect people to run calibrations
09:14
se6astian
if the process is somehow guided through in the camera itself
09:15
se6astian
did you find any relation between sensor temperature and noise levels?
09:17
vup
not yet, I just though about that aswell, but forgot to include capturing the temperature while capturing the darkframes
09:17
vup
(also forgot to enable dark columns, but I guess thats what I get for starting it at 4:30 am :P)
09:17
se6astian
its in the sensor registers if you captured raw12s as well
09:17
se6astian
:P
09:17
vup
nope I did not
09:17
se6astian
ok
09:18
se6astian
one thing I would also find an interesting check is if the fpn can be assumed constant for a particular combination of settings
09:18
vup
I wanted to maximize the time available for the darkframes (only to figure out after sleeping, that it just worked for about 1.5h and then broke, because I suck at python :))
09:18
se6astian
so if you capture the same darkframe set one day and the same set again a week later
09:18
vup
se6astian: you mean, while varying temperature?
09:18
se6astian
will the pattern match up perfectly
09:19
vup
ah, or temporal, right
09:19
se6astian
but also with temperature yes
09:19
vup
I expect the supply voltages so have some kind of effect aswell
09:19
vup
but these should hopefully be somewhat temperature independent, if they use a "good" voltage reference
09:19
vup
(and the resistors are not that temperature sensitive)
09:20
vup
so it might be interesting to capture those aswell
09:20
vup
I think I have some darkframes taken with very similar settings from much earlier, ill see if I find some that are close enough to compare
09:20
se6astian
can you capture the voltage information that is visible during the lvds training process (or was it another command) with the darkframes as metadata?
09:21
vup
sure
09:22
vup
that should be trivial pretty much
09:22
vup
(well when I am home again, I captured the darkframes to have something to do while taking a train :P)
09:22
se6astian
great
09:50
Bertl_zZ
changed nick to: Bertl
09:51
Bertl
morning folks!
10:34
vup
morning :)
11:29
aombk2
joined the channel
11:31
aombk3
joined the channel
11:32
aombk
left the channel
11:35
aombk2
left the channel
12:00
littlebobeep
joined the channel
12:45
Bertl
vup: excellent work!
15:09
Bertl
off for now ... bbl
15:10
Bertl
changed nick to: Bertl_oO
18:35
se6astian
https://twitter.com/NASA/status/1512449836511121415?ref_src=twsrc%5Etfw%7Ctwcamp%5Etweetembed%7Ctwterm%5E1512449836511121415%7Ctwgr%5E%7Ctwcon%5Es1_&ref_url=https%3A%2F%2Fwww.derstandard.de%2Fstory%2F2000134800475%2Fstart-geglueckt-erste-private-crew-ist-unterwegs-zur-iss
18:35
se6astian
sorry for long link
18:35
se6astian
https://twitter.com/NASA/status/1512449836511121415
18:35
se6astian
the AXIOM Space mission is on its way to the ISS
18:36
se6astian
@Axiom_Space
18:36
se6astian
Creating a thriving home in space that benefits every human, everywhere.
18:36
Bertl_oO
yay! *G*
22:00
ShinyCyril
joined the channel
22:47
ShinyCyril
left the channel