22:05 | Sasha_C | joined the channel | |
22:46 | gcolburn | joined the channel | |
22:49 | FergusL | rexbron: the debayering script ?
| |
22:49 | FergusL | It's utterly slow... Has yet to fully debayer a 4k raw picture
| |
23:39 | gcolburn | left the channel | |
01:11 | dmj_nova | Bertl: think the prototype would be usable by say April?
| |
01:12 | dmj_nova | FergusL: How long has the debayering script taken?
| |
01:16 | Bertl | dmj_nova: you mean the axiom prototype? or axiom alpha?
| |
01:17 | dmj_nova | actually I'm not entirely particular on that
| |
01:17 | dmj_nova | But something functional and fairly compelling.
| |
01:17 | dmj_nova | that can act like a camera and output quality images to a PC
| |
01:18 | Bertl | well, the axiom alpha should be able to work as camera and output HDMI next month
| |
01:19 | Bertl | it will be limited to full HD, because there is no interface with more bandwidth available on the zedboard
| |
01:19 | dmj_nova | ah
| |
01:20 | Bertl | (but you should know that, IIRC, you have one, no?)
| |
01:20 | dmj_nova | Yeah, I've got a zedboard
| |
01:21 | dmj_nova | Do you think DNG at 24fps is realistic by april?
| |
01:22 | Bertl | I doubt that we will have a working axiom prototype in april
| |
01:22 | dmj_nova | ok
| |
01:22 | Bertl | the crowd funding itself will take some time
| |
01:22 | Bertl | then the hardware development and testing
| |
01:23 | Bertl | I'd say june is more realistic
| |
01:24 | dmj_nova | hmm
| |
01:27 | FergusL | dmj_nova: how long what ? It took me like 5 days, but I'm slow. And a full 4k debayering from raw to any format you like should be like 1h and 10 minute
| |
01:27 | Bertl | wow, that is quite some time :)
| |
01:30 | dmj_nova | FergusL: this is with python?
| |
01:32 | FergusL | Yes but it's not python's fault that it is that slow
| |
01:33 | FergusL | It's terribly stupid, it's doing the same calculation up to 4 time
| |
01:33 | FergusL | Totally wasting time
| |
01:33 | FergusL | Is it of any interest to people here that I improve it ?
| |
01:33 | FergusL | I assumed the dng converter was doing the job well
| |
01:34 | Bertl | unrelated, the dng writer does not do debayering
| |
01:38 | FergusL | Yes, I assumed that was better for you lot
| |
01:38 | Bertl | well, investigating different debayering algorithms is something which will come handy at some point
| |
01:38 | FergusL | Yes
| |
01:39 | FergusL | But dcraw has the one I implemented
| |
01:39 | FergusL | Though I realise, dcraw needs a profile for the camera which we don't habd
| |
01:39 | FergusL | Have
| |
01:39 | Bertl | working on that would probably be a good idea as well :)
| |
01:40 | FergusL | Yes, and to profile we need a debayered image
| |
01:41 | Bertl | which you can get in at least three different ways by now
| |
01:41 | Bertl | 1) with your python script
| |
01:42 | Bertl | 2) with a tool called bayer2rgb
| |
01:42 | Bertl | 3) with display by splitting up the planes and simply combining them
| |
01:42 | dmj_nova | FergusL: why is it doing the same calculation 4 times, why not avoid that by altering the algorithm?
| |
01:42 | Bertl | all three methods should be more than sufficient for the profile adjustments
| |
01:57 | FergusL | dmj_nova: because I was just a bit stupid and overlooked how it could make my script that slower! It's actually unusable indeed atm so yes I need to rewrite some part of it
| |
01:58 | Bertl | doesn't matter if it runs two hours once, if you get the properly debayered image for the IT8, does it?
| |
01:58 | FergusL | I need a maths tool called a graph
| |
01:58 | FergusL | Absolutely, I can try to do that that night, or tomorrow morning
| |
03:56 | Bertl | off to bed now ... have a good one everyone!
| |
05:53 | Sasha_C | left the channel | |
08:49 | se6astian | joined the channel | |
09:09 | [1]se6astian | joined the channel | |
09:10 | se6astian | left the channel | |
09:10 | [1]se6astian | changed nick to: se6astian
| |
11:54 | se6astian | left the channel | |
12:14 | se6astian | joined the channel | |
12:24 | rexbron | left the channel | |
12:25 | rexbron | joined the channel | |
12:25 | troy_s | left the channel | |
12:27 | troy_s | joined the channel | |
12:27 | Bertl | morning everyone!
| |
13:02 | mars_ | i have a bunch of prime and fast telelenses for the nikon f mount
| |
13:10 | Bertl | cool
| |
13:18 | se6astian | hello
| |
13:18 | se6astian | fantastic!
| |
13:21 | mars_ | i'm on my phone, talk to you later..
| |
13:24 | se6astian | see you
| |
14:33 | intracube | joined the channel | |
17:33 | aPinky | joined the channel | |
17:34 | Bertl | welcome aPinky
| |
17:38 | aPinky | left the channel | |
17:41 | aPinky | joined the channel | |
17:41 | Bertl | wb aPinky!
| |
17:42 | aPinky | left the channel | |
17:43 | aPinky | joined the channel | |
17:45 | aPinky | left the channel | |
17:46 | aPinky | joined the channel | |
17:50 | Bertl | off for now ... bbl
| |
17:59 | se6astian | ah hello pinky, you must be our new robotic friend to log the channel
| |
19:11 | gcolburn | joined the channel | |
19:14 | Bertl | back now ...
| |
19:19 | gcolburn | hi Bertl. I just got my HDMI->DVI adapter though I thought I would test out the HDMI on the zedboard
| |
19:20 | Bertl | okay, note that you need to adjust the scripts to handle DVI out
| |
19:21 | Bertl | (I presume it is a passive adapter)
| |
19:21 | gcolburn | yes
| |
19:21 | gcolburn | its passive
| |
19:22 | gcolburn | the base HDMI test that ships with the zed board and displays a default image worked fine
| |
19:23 | Bertl | that's a good start
| |
19:25 | troy_s | in
| |
19:26 | troy_s | intracube: All Bayers are 422 :)
| |
19:28 | Bertl | I disagree, for example the X-Trans pattern is 522
| |
19:28 | troy_s | Bertl: You with your nerd knowledge
| |
19:28 | Bertl | nah, just google power :)
| |
19:29 | troy_s | Bertl: How about â99% of Bayers are 4:2:2â
| |
19:29 | troy_s | Bertl: Odd... so it samples from a block of five pixels?
| |
19:29 | Bertl | it seems that it has 9 pixels with 5 green, yes
| |
19:29 | troy_s | Slightly worse scaled chroma. I cannot imagine that nightmare when it gets into macroblock compression.
| |
19:30 | troy_s | (IIRC all frequency based algos are almost universally mod 8)
| |
19:30 | Bertl | actually wikipedia says it is 6x6
| |
19:31 | Bertl | (because the R and B values switch as well)
| |
19:31 | troy_s | Bertl: I intend to actually try and hammer on the image when I get home, but sadly am also on six day weeks currently.
| |
19:31 | troy_s | Bertl: Quite sure I can fumble through the profiling aspect as well as maybe generate a debayering tool.
| |
19:32 | troy_s | I wish DNG were in OIIO. That factoid makes it hard for me to be behind DNG currently. It makes integration a nightmare.
| |
19:32 | Bertl | as I said, for crude debayering, I guess we already have the tools at hand
| |
19:33 | Bertl | regarding DNG, it is one option atm, I'm not sure that deep color tiff isn't a better one for test images
| |
19:33 | Bertl | (but I haven't tested anything in this regard)
| |
19:34 | troy_s | DNG certainly seems almost appropriate for the "one format to rule them all"
| |
19:34 | troy_s | and given that BMC does a dump matching realtime, it is plausible
| |
19:34 | troy_s | TIFF not so much
| |
19:35 | troy_s | I think the choice should be between the canonical and venerable DPX and DNG.
| |
19:35 | troy_s | And DNG certainly seems more appropriate for dumping Bayers.
| |
19:36 | troy_s | My only regret currently is DNG in OIIO, but perhaps someone can make a post to see if they can get it integrated into OIIO. I suspect that Mr. Gritz would pull it.
| |
19:36 | gcolburn | for fast debayering on the CMV12000 images I've just been running dcraw on the DNG
| |
19:36 | troy_s | gcolburn: Greets. Any progress?
| |
19:36 | gcolburn | sort of
| |
19:37 | gcolburn | parts of the tutorial gave errors. I tried directions straight from the documentation and made further progress
| |
19:37 | troy_s | gcolburn: You can easily scale and crop that IT8 if need be. Just be sure that whatever app isn't mangling - and that isn't easy.
| |
19:37 | troy_s | gcolburn: Ah good.
| |
19:37 | troy_s | I worry that the image is slightly underexposed
| |
19:38 | Bertl | hmm, dpx seems to be a good choice actually, as it is supported by imagemagick as write format
| |
19:38 | troy_s | exposure is important on IT8 work as the saturations of the wider colors is inherently part of luminance - which in simple terms means that the color may not be reached without sufficiently intensity.
| |
19:39 | troy_s | Bertl: There are only two real formats in post
| |
19:39 | troy_s | Bertl: OpenEXR (intra pipeline) and DPX (between or to print)
| |
19:40 | troy_s | Bertl: But DPX isn't quite idealized for Bayers - something DNG seems almost perfect for, as well as unencumbered in all ways.
| |
19:40 | Bertl | yeah, not talking bayer pattern images, more talking debayered here
| |
19:41 | Bertl | that's why I consider tiff a good choice
| |
19:41 | gcolburn | if I don't have much luck with that open source package for the calibration I was thinking of implementing this algorithm here: http://www.cs.sfu.ca/~funt/AIC2012_Funt+Bastani_IntensityIndependentColourCalibrationAsPublished.pdf
| |
19:41 | troy_s | gcolburn: Unadvisable
| |
19:41 | troy_s | gcolburn: Wiser is to simply get to Argyll working, which is assured and vastly more reliable.
| |
19:42 | troy_s | Bertl: TIFF is sub optimal.
| |
19:42 | Bertl | maybe troy_s can help with the error on argyll?
| |
19:42 | troy_s | Bertl: DPX for debayers as it includes a TRC.
| |
19:42 | Bertl | yeah, no problem with dpx there, as it is supported
| |
19:43 | gcolburn | troy_s: have you used Argyll before?
| |
19:43 | troy_s | gcolburn: Oh yes.
| |
19:43 | gcolburn | troy_s: Okay, you might be able to get it working faster then
| |
19:43 | troy_s | gcolburn: I use it to generate 3D LUTs for display profile transforms
| |
19:44 | troy_s | gcolburn: As I said, I would do this but I am busy as crap at the moment sadly, and worse, about a continent away from my computer.
| |
19:45 | troy_s | Bertl: It is in the best interest to limit the file choice. Make it as focused and streamlined as possible. As much as I am pro DPX, it is a layer of abstraction upon a lower level format like DNG.
| |
19:46 | troy_s | Bertl: So given reflection, I am leaning towards rexbron's suggestion. Only thing that would make it an idealized choice is if we can find a dev to get OIIO support proper. That would be a huge asset.
| |
19:46 | troy_s | (and the BMC folks would also likely find a supporter or two)
| |
19:47 | troy_s | Bertl: The (tremendous) advantage to this support would be that OIIO then allows everyone to "one stop shop" transformations from DNG to EXR and DPX via OIIO.
| |
19:47 | troy_s | And that pretty much wraps up every postproduction pipeline out there.
| |
19:48 | troy_s | Editorially it is much more complex.
| |
19:48 | troy_s | As both DNxHD and ProRes are encumbered IIRC. (The latter certainly, the former almost certainly)
| |
19:49 | troy_s | And given that they are the two defacto formats, with the latter the larger target, editorial becomes much more complex. I suspect a stubbed "glue" app to go to either is the most optimal solution.
| |
19:50 | troy_s | IE: A standalone GUI / CLI application that allows for a DNG to ProRes / DNxHD transfer with a one-light baked in optionally.
| |
19:51 | troy_s | (via FFMPEG or the more robust FFMBC)
| |
19:51 | troy_s | gcolburn: What issue are you having exactly sir?
| |
19:56 | troy_s | Bertl: Is the IT8 a Wolf?
| |
19:56 | troy_s | Bertl: gcolburn will need the data files.
| |
19:57 | Bertl | troy_s: yup, http://vserver.13thfloor.at/Stuff/AXIOM/RAW/IT8_incand.png
| |
19:58 | Bertl | change .png to .raw16 for the bayer images
| |
19:58 | Bertl | -s
| |
19:58 | Bertl | actually .raw16.xz (i.e. compressed)
| |
19:59 | troy_s | Bertl: There should be a spectro text file as well
| |
19:59 | troy_s | Rxxxxxx.txt
| |
20:00 | Bertl | se6astian: any Rxxxxxx.txt files?
| |
20:01 | Bertl | https://github.com/hughsie/shared-color-targets/tree/master/targets/wolf_faust/reflective
| |
20:01 | Bertl | seems to have them or at least something related
| |
20:01 | Bertl | https://github.com/hughsie/shared-color-targets/blob/master/targets/wolf_faust/reflective/R100604.it8
| |
20:02 | Bertl | https://github.com/hughsie/shared-color-targets/raw/master/targets/wolf_faust/reflective/R100604.it8 (as raw file)
| |
20:03 | troy_s | Bertl: Shipped per IT8
| |
20:03 | troy_s | they are the spectro readings of the specific print you received
| |
20:04 | troy_s | (rather like the profile for a specific monitor)
| |
20:04 | troy_s | Generics are junk
| |
20:04 | Bertl | as the number matches the one on the IT8 chart?
| |
20:04 | Bertl | (the Rxxxxxx)
| |
20:04 | troy_s | and are worthless as the knowledge people that suggest they are useful.
| |
20:04 | se6astian | I will check at the university
| |
20:05 | troy_s | I believe the Rxxxxxx.txt file is specific to the IT8.
| |
20:06 | se6astian | I found the chart in some pile of documents, I doubt anyone still knows if there ever was a file that came with it let alone know then where that file could be by now....
| |
20:07 | Bertl | anyway, I think the R100604.it8 is at least a close approximation, as it seems to originate from Wolf Faust and has the same numer as on the IT8 chart I have here :)
| |
20:07 | Bertl | *number
| |
20:09 | Bertl | or if you mistrust the person on github, maybe this here is the better source: http://www.targets.coloraid.de/
| |
20:09 | gcolburn | that's where I downloaded from
| |
20:10 | gcolburn | for my testing thus far
| |
20:11 | Bertl | I think that those are the original files anyway, i.e. the zip contains the .txt troy_s was referring to
| |
20:13 | troy_s | Bertl: They ship per chart sadly
| |
20:13 | troy_s | but anyways...
| |
20:13 | Bertl | I'm not sure they exist per chart though
| |
20:14 | Bertl | i.e. I'm not convinced that they differ in the same charge
| |
20:14 | gcolburn | "The individually measured target reference files and OEM target files are only available on request by email "
| |
20:15 | gcolburn | I think the ones on the site are batch averages, and you can email to get another copy of your specific chart's measurements.
| |
20:15 | Bertl | the question is, how to identify the specific chart?
| |
20:16 | gcolburn | good question :)
| |
20:16 | gcolburn | how old is the chart?
| |
20:16 | Bertl | I'd say, from the image, it must be june 2010, no?
| |
20:16 | gcolburn | the read me in the download stated after about two years its best to get a new chart
| |
20:17 | gcolburn | ah. didn't notice that. I don't have the image up
| |
20:17 | Bertl | but maybe 2010:06 means something completely different
| |
20:18 | Bertl | but to me it definitely looks like the year and month
| |
20:20 | troy_s | Bertl: âIT 8.7 compatible reference file containing the color measurements for the target.
| |
20:20 | troy_s | Bertl: ;)
| |
20:24 | Bertl | yeah, I just wonder how you get those files when you only have the chart, because the chart has no unique identifier besides the charge number and the date
| |
20:27 | troy_s | Bertl: I seem to recall each batch checked and stuffed into the data
| |
20:27 | troy_s | (per print batch)
| |
20:29 | gcolburn | Bertl: was there any glare on the IT8 chart? it kind of looks like there might be but I can't tell for sure
| |
20:30 | Bertl | yes, I had to fight to keep it low, the chart is very reflective
| |
20:30 | Bertl | I would have expected some kind of diffuse reflection, but it is actually all specular
| |
20:31 | Bertl | just look at the bootom, the gray there is uniform on the chart
| |
20:32 | Bertl | but you can see the table and camera being reflected from the chart :)
| |
20:32 | gcolburn | okay. how much trouble would it be to get another shot with the defect columns off of the patches? the relative error in the profile that was generated is too high. if we crop the image I think it will have a hard time picking out the patches since they won't be the right size
| |
20:32 | Bertl | give me a few minutes and I fix the sensor errors for you :)
| |
20:33 | troy_s | Here is the link for posterity
| |
20:33 | troy_s | Have a bot tag it please
| |
20:33 | troy_s | http://trumpetpower.com/photos/Exposure#Normalizing_exposure
| |
20:34 | troy_s | Bertl: Ideally a broad diffuse source. Exposure needs to also heavily saturate the data - as in VERY well exposed but still within the linear range of the data.
| |
20:46 | rexbron | troy_s: I'm still confused as to why you have a hate on for tiff
| |
20:47 | rexbron | Also, as for OIIO support of DNG, the plumbing should already be there, as DNG is an extention of TIFF
| |
20:48 | rexbron | What is beyond my knowledge for the implimentation is there needs to be a feedback mechanism to pass settings to the underlying plug in (white balance, exposure comp etc).
| |
20:48 | troy_s | rexbron: Because it has no true gain beyond DPX / EXR.
| |
20:49 | troy_s | rexbron: EXR is the single format really required (TRC / color as an aside / parallel need of course)
| |
20:49 | rexbron | troy_s: gain? What do you mean, advantage? Unlike DPX, it's not ambigous as to whether the byte level storeage is gamma compensated or not! Remember the issues with the ASC-CDL compliance suite?
| |
20:49 | troy_s | EXR is more robust in all facets.
| |
20:49 | rexbron | troy_s: sure, at the expense of storeage space :)
| |
20:49 | troy_s | DPX has a TRC metadata tag
| |
20:50 | rexbron | as does Tiff, it supports arbitrary metadata
| |
20:50 | troy_s | rexbron: Storage is free. It isn't storage either... it is precision
| |
20:50 | troy_s | rexbron: The question is TIFF vs EXR. EXR wins.
| |
20:50 | troy_s | (both in full, half, and stereo)
| |
20:50 | rexbron | troy_s: then I'll expect a cheque for the 30Tb of hard drives needed for my low budget feature
| |
20:51 | troy_s | TIFF gains nothing over half!
| |
20:51 | troy_s | Egads
| |
20:51 | rexbron | I don't disagree
| |
20:51 | troy_s | Or even 10bit DPX
| |
20:51 | rexbron | uhh, it's moot when compared to DPX really
| |
20:51 | rexbron | except for herritage
| |
20:51 | troy_s | My point isn't a TIFF hate on, just that it is only acceptable when the others are unavailable for whatever reason
| |
20:52 | rexbron | DPX. Is. For. Printing Density.
| |
20:52 | troy_s | rexbron: Transfer. Period.
| |
20:52 | troy_s | rexbron: All house transfers are DPX.
| |
20:52 | troy_s | Largely due to the TRC issue
| |
20:53 | rexbron | troy_s: for convention and historical reasons alone
| |
20:53 | troy_s | (1.6 Cineon seems the bog standard)
| |
20:53 | troy_s | rexbron: The point is... it has never been TIFF. And apples to apples, no sense.
| |
20:53 | troy_s | Total sense for mattes
| |
20:53 | troy_s | Or other assets that it makes sense for.
| |
20:54 | troy_s | But still images less so.
| |
20:54 | troy_s | Convention is a design context.
| |
20:54 | rexbron | my qualms with DPX have to do with implimentation issues and color assumtions, that we have both come across, in the lower level libraries.
| |
20:54 | troy_s | rexbron: Let's face it
| |
20:54 | rexbron | troy_s: and the context has changed!
| |
20:55 | troy_s | rexbron: EVERYONE has screwed color up, and any format / app that can insulate that from the artist is a toxic format.
| |
20:55 | troy_s | rexbron: Agree on the shooting front, _NOT_ on the post house front.
| |
20:56 | troy_s | rexbron: If you wanted to sit in on a Baselight say, or get a film print, etc. Those are still real contextuals.
| |
20:56 | troy_s | rexbron: And to be fair to DPX, it too is robust as hell. It isn't just a legacy âgosh we all hate xxx formatâ - it fills its role well. (Albeit a little too powerful and doesall)
| |
20:57 | rexbron | troy_s: sure, for those contexts. For my purposes and on all the films I've posted, I go Tiff because I trust it
| |
20:57 | troy_s | (as in it almost does too much)
| |
20:57 | troy_s | TIFF can transfer curve flags and meta that 99% of apps likely ignore
| |
20:57 | troy_s | has
| |
20:57 | rexbron | opposed to DPX? Which can equally be ignored no?
| |
20:58 | rexbron | Format crusades...
| |
20:58 | troy_s | So it too is riddled with issues. DPX is well suited for a log starting point, and given convention, it is rare that it doesn't get treated as such.
| |
20:58 | troy_s | Again, I am not against tiff.
| |
20:58 | rexbron | In any case, go to OIIO and you get both
| |
20:58 | rexbron | well tested implimentations
| |
20:58 | troy_s | But if I send you a DPX, I can assure you you will at least assume it is a 1.6 log image
| |
20:58 | troy_s | Fair.
| |
20:58 | troy_s | ?
| |
20:59 | rexbron | Am I a user or a library in this context?
| |
20:59 | troy_s | Where TIFF is bog standard sRGB curve which is rather goofball in imaging of this sort (photographic)
| |
20:59 | troy_s | Any app.
| |
20:59 | troy_s | The convention is my point.
| |
21:00 | troy_s | So perhaps you misread my opinion of TIFF. I would rec no other format to be honest. Given still images of a photographic nature aimed t post production however, that context leans me to DPX for the still component. Can TIFF work?
| |
21:02 | troy_s | Yes. If used carefully with someone very aware.
| |
21:03 | rexbron | I don't know where in the TIFF spec is states a TRC
| |
21:05 | troy_s | rexbron: Don't quote me but I recall the spec has a slot for the TRC
| |
21:05 | rexbron | I'd be curious to know
| |
21:05 | troy_s | rexbron: And I bet 99.9% of all apps utterly ignore it.
| |
21:05 | troy_s | rexbron: Grr... wait.
| |
21:05 | rexbron | DNGs do have linearization tables
| |
21:08 | troy_s | rexbron: Page 84
| |
21:08 | troy_s | TiffSpec
| |
21:08 | troy_s | TransferFunction
| |
21:08 | troy_s | :)
| |
21:09 | rexbron | Pixel components can be gamma-compensated, companded, non-uniformly quantized, or coded in some other way. The TransferFunction maps the pixel components from a non-linear BitsPerSample (e.g. 8-bit) form into a 16-bit linear form without a perceptible loss of accuracy.
| |
21:09 | rexbron | it's for linerizing the data
| |
21:10 | troy_s | http://pastebin.com/LfTAPM9b
| |
21:31 | gcolburn | left the channel | |
21:41 | se6astian | good night!
| |
21:41 | se6astian | left the channel | |
21:53 | Bertl | FWIW, here a 'fixed' version of the chart, no 'debayering' per se, just an overlay of the colors
| |
21:53 | Bertl | http://vserver.13thfloor.at/Stuff/AXIOM/RAW/IT8_incand.fix.png
| |
21:53 | Bertl | (the sensor artefacts have been removed)
|