04:15 | Bertl_oO | off to bed now ... have a good one everyone!
| |
04:15 | Bertl_oO | changed nick to: Bertl_zZ
| |
07:56 | se6astian | good day
| |
09:13 | vup | some more darkframe analysis
| |
09:13 | vup | I captured some series ouf ~50 darkframes from ~.9ms to (1000/24)ms exposure time
| |
09:16 | vup | each averaged over 1024 frames up to ~30ms exposure time, 512 frames above that
| |
09:17 | vup | the general goal is to find a way to use a single / a few darkframes for the darkframe calibration and not need a specific darkframe for each exposure time
| |
09:18 | vup | previously this was done by using a model linear in the exposure time
| |
09:20 | vup | so using two reference frames, one (`b`) that is basically the extrapolation of a darkframe at 0ms exposure time and a frame (`m`) that represents the exposure dependent part, so that the final darkframes for a exposure time of `n` ms is calculated as `n * m + b`
| |
09:21 | vup | so this is what I started out with aswell and tried to reproduce
| |
09:21 | vup | b and m are just determined by a per pixel linear regression over the 51 averaged darkframes I captured
| |
09:22 | vup | to evaluate this model, I calculated the per pixel residual for each of the darkframes
| |
09:23 | vup | (for the darkframes `real_df` with exposure time `n` ms, this is just `real_df - m * n - b`)
| |
09:23 | vup | this is visualized in this plot: https://files.niemo.de/darkframe_residual_linear_model.pdf
| |
09:23 | vup | which is just the histogram of these residuals for each of the darkframes I captured
| |
09:24 | vup | (note that the colors are log normalized)
| |
09:25 | vup | (so the actual variance of the residuals is visually vastly overstated)
| |
09:27 | vup | (https://files.niemo.de/darkframe_residual_linear_model_norm_linear_norm.pdf is a version that uses a linear norm)
| |
09:34 | vup | a few examples that show the residuals for some specific darkframes: https://files.niemo.de/darkframe_residual_examples.pdf
| |
09:34 | vup | so these are not really randomly distributed, but show patterns, which could probably be visible in "real" images aswell
| |
09:35 | littlebobeep | left the channel | |
09:35 | vup | so some general questions: which exposure time range would be absolutely necessary to cover? 0ms to 1000/24ms seems like a obvious choice for me, but maybe we can cutoff earlier?
| |
09:36 | vup | any ideas for better models?, ill try some high degree polynomials next, but going higher than maybe second or third degree seems like arbitrary overfitting very quickly
| |
09:36 | vup | any idea where these pattern come from?
| |
09:38 | vup | any opinions on how flatfield correction will interact with this? maybe we want to "flatfield correct the `m * n` term"?
| |
09:38 | vup | oh also, this was all for 1x gain, ill calculate it for 2x, 3x and 4x is a sec
| |
09:59 | vup | so this is for 4x gain: https://files.niemo.de/darkframe_4.0x_residual_linear_model.pdf
| |
09:59 | vup | https://files.niemo.de/darkframe_4.0x_residual_examples.pdf
| |
09:59 | vup | interestingly, the residuals do not match up completely
| |
10:09 | se6astian | very interesting vup
| |
10:10 | se6astian | currently we cannot expose as long as the frame period
| |
10:10 | se6astian | as you asked about limiting the exposure range
| |
10:10 | vup | yeah, but I expect that this should some day be the case, right?
| |
10:10 | se6astian | I hope so yes :)
| |
10:10 | se6astian | very short exposures like 1/8000s might be interesting
| |
10:11 | se6astian | but thats probably the lower limit
| |
10:11 | vup | well they don't work currently :P
| |
10:11 | se6astian | ah
| |
10:11 | se6astian | what is the low end currently?
| |
10:11 | vup | ~.89ms was the lower limit of where I got matching a and b frames over the raw hdmi
| |
10:11 | se6astian | ok
| |
10:12 | vup | (is this a know problem?)
| |
10:12 | se6astian | but that sounds like an issue that might be gone with the sequences/generator decoupling that Bertl is currently implementing
| |
10:12 | vup | right
| |
10:13 | vup | oh another question: how often do we expect longer exposure times to be interesting? (100ms to tens of seconds), are we fine with expecting people to capture specific darkframes for these ranges?
| |
10:14 | se6astian | I think for long exposure times we can expect people to run calibrations
| |
10:14 | se6astian | if the process is somehow guided through in the camera itself
| |
10:15 | se6astian | did you find any relation between sensor temperature and noise levels?
| |
10:17 | vup | not yet, I just though about that aswell, but forgot to include capturing the temperature while capturing the darkframes
| |
10:17 | vup | (also forgot to enable dark columns, but I guess thats what I get for starting it at 4:30 am :P)
| |
10:17 | se6astian | its in the sensor registers if you captured raw12s as well
| |
10:17 | se6astian | :P
| |
10:17 | vup | nope I did not
| |
10:17 | se6astian | ok
| |
10:18 | se6astian | one thing I would also find an interesting check is if the fpn can be assumed constant for a particular combination of settings
| |
10:18 | vup | I wanted to maximize the time available for the darkframes (only to figure out after sleeping, that it just worked for about 1.5h and then broke, because I suck at python :))
| |
10:18 | se6astian | so if you capture the same darkframe set one day and the same set again a week later
| |
10:18 | vup | se6astian: you mean, while varying temperature?
| |
10:18 | se6astian | will the pattern match up perfectly
| |
10:19 | vup | ah, or temporal, right
| |
10:19 | se6astian | but also with temperature yes
| |
10:19 | vup | I expect the supply voltages so have some kind of effect aswell
| |
10:19 | vup | but these should hopefully be somewhat temperature independent, if they use a "good" voltage reference
| |
10:19 | vup | (and the resistors are not that temperature sensitive)
| |
10:20 | vup | so it might be interesting to capture those aswell
| |
10:20 | vup | I think I have some darkframes taken with very similar settings from much earlier, ill see if I find some that are close enough to compare
| |
10:20 | se6astian | can you capture the voltage information that is visible during the lvds training process (or was it another command) with the darkframes as metadata?
| |
10:21 | vup | sure
| |
10:22 | vup | that should be trivial pretty much
| |
10:22 | vup | (well when I am home again, I captured the darkframes to have something to do while taking a train :P)
| |
10:22 | se6astian | great
| |
10:50 | Bertl_zZ | changed nick to: Bertl
| |
10:51 | Bertl | morning folks!
| |
11:34 | vup | morning :)
| |
12:29 | aombk2 | joined the channel | |
12:31 | aombk3 | joined the channel | |
12:32 | aombk | left the channel | |
12:35 | aombk2 | left the channel | |
13:00 | littlebobeep | joined the channel | |
13:45 | Bertl | vup: excellent work!
| |
16:09 | Bertl | off for now ... bbl
| |
16:10 | Bertl | changed nick to: Bertl_oO
| |
19:35 | se6astian | https://twitter.com/NASA/status/1512449836511121415?ref_src=twsrc%5Etfw%7Ctwcamp%5Etweetembed%7Ctwterm%5E1512449836511121415%7Ctwgr%5E%7Ctwcon%5Es1_&ref_url=https%3A%2F%2Fwww.derstandard.de%2Fstory%2F2000134800475%2Fstart-geglueckt-erste-private-crew-ist-unterwegs-zur-iss
| |
19:35 | se6astian | sorry for long link
| |
19:35 | se6astian | https://twitter.com/NASA/status/1512449836511121415
| |
19:35 | se6astian | the AXIOM Space mission is on its way to the ISS
| |
19:36 | se6astian | @Axiom_Space
| |
19:36 | se6astian | Creating a thriving home in space that benefits every human, everywhere.
| |
19:36 | Bertl_oO | yay! *G*
| |
23:00 | ShinyCyril | joined the channel | |
23:47 | ShinyCyril | left the channel |