Get Colormanaged » LightRoom

“Hacking” Grain settings into ACR and more

René — Fri, 11 Jun 2010 11:37:40 +0000

Noise

While most people in this digital age seem overly concerned with noise, and mainly want noise reduction, I tend to like grain: It can really improve a digital image, and even make it appear sharper. Until now I had to simulate it using Photoshop for instance.

No longer: Recently, Adobe released ACR 6.1 and LightRoom 3. In these there was a new option added: “Grain”, with three controls: “Amount”, “Size” and “Roughness”. It produced some pretty nice “film like” grain. Way better then a simple “add noise” in Photoshop for instance.
That could be a time saver and simplify the workflow quite a bit.
Of course, I’d need to upgrade to LR3 for this feature. But, along with the mayor improvements in IQ due to the new demosaicing and processing algorithms (Process Version 2010) that would be totally worth it to me. Some of the other new features would be the icing on the cake.

One problem

I’d need a new Mac to run it: LightRoom 3 and PSCS5 only run on an Intel Mac, not on my Dual G5 PPC.
Since buying a new Mac just for this is a bit over the top, I decided to see what my options were.

A while back, Adobe updated the previous versions of ACR and LR to ACR 5.7 and LR 2.7: These versions also support the demosaic algorithm from Lightroom 3.
From what I’d read on the web, these should render the file as seen in Lightroom3, but not allow you to make changes to the new Develop settings, like “Grain”.

A bit more researching led (as often) to the excellent site of Victoria Bampton, AKA. Lightroom Queen. She had a bit more detailed info: ACR 5.7 should use the same Demosaic, and match the new additions closely. She also mentioned “5.7 can read LR’s settings but there’s no UI to change the new settings.” Sadly, LR2.7 will ignore the new LR3 settings. (Why Adobe, why?)

Then I got an idea when answering a question on POTN. Would it be possible to “hack” an .XMP file to only adjust the Grain settings?

The answer? It is!

All you need is an .XMP file with settings applied in LightRoom3 (thanks Anouk!) and a text editor.
It really is that simple.

An .XMP file is simply a plain text file, with instructions for the Adobe Raw converter: “Set this slider to this value”.
The part we are interested in, is this:
58 30 59

All you need to do is copy-paste this into a “blank” .XMP file.
To do that, open a Raw file (not a DNG) in ACR 5.7. Then go to the “flyout” menu and choose “Save settings…”.

To make life easy on yourself, only save one set of parameters, for instance “sharpening”.
The advantage of doing it like this, is that all other settings will remain the same. So if you’d already made adjustments to the Raw, they will remain.

Close ACR.

Open the .XMP in a text editor. I like Smultron.
That gives you an .XMP that looks like this:

xmlns:crs="http://ns.adobe.com/camera-raw-settings/1.0/"> 5.7 5.0 62 +1.0 8 81 True

Delete the “Sharpening” settings, and replace them with the “Grain” settings you want.

You get this:

xmlns:crs="http://ns.adobe.com/camera-raw-settings/1.0/"> 6.1 5.7 50 30 60 50 True

Save this under a new name. “Grain50_30_60″ seems a logical choice in this case. You can of course save a number of different settings under different names.
Open a Raw file, apply the preset, and BOOM. You just added Grain

But wait, there’s more

So, what if you want to alter just one of the settings? Do you need to open a text editor every time?
No. It’s easier to create a few more presets, each only adjusting 1 parameter.

I created separate presets for GrainAmount, GrainSize and GrainFrequency, in different values.
So, if I open an image in ACR, it looks like this:

Then I apply three presets to set the Grain I want.

In this case GrainAmount80, GrainSize20 and GrainFrequency80. Not as flexible as sliders, but pretty close.

The other way around

In LR3, there’s another new addition that is lacking in LR2.7: There’s a point curve added.
In LR2, you could only adjust the (wrongly named) “point curve” as the ACR “Parametric Curve”. So it was not possible to create a curve to invert the image or set the black and white point to something other then 0 and 255. (Something quite a few people like to do, which makes absolutely no sense to me).

There’s a way around that as well: Open a CR2 file in ACR, adjust the curve as you like, and click “Done”. You just created an .XMP file with all the info you need.
Open that .xmp file in an editor, and look for the second entry for tone curve:

0, 255 255, 0

the first entry for “Tone Curve” is the Parametric Curve. Don’t mess with it, since LR allows you to adjust that.

0, 0 32, 22 64, 56 128, 128 192, 196 255, 255

Now, in LightRoom2, create a new Preset. Use only the “Tone Curve” setting,

Open this preset in a text editor as well.
It will look different then an xmp, but will be plain text as well.

s = { id = "847A699E-AEA0-4E00-BF19-F6E681D5EBD7", internalName = "Negative", title = "Negative", type = "Develop", value = { settings = { ParametricDarks = 0, ParametricHighlightSplit = 75, ParametricHighlights = 0, ParametricLights = 5, ParametricMidtoneSplit = 50, ParametricShadowSplit = 25, ParametricShadows = -5, ToneCurve = { 0, 0, 32, 22, 64, 56, 128, 128, 192, 196, 255, 255, }, ToneCurveName = "Medium Contrast", }, uuid = "F2FF3CF0-C863-43EA-B051-B624A8113D3A", }, version = 0, }

Remove the stuff you don’t want, and change it to this:

s = { id = "847A699E-AEA0-4E00-BF19-F6E681D5EBD7", internalName = "Negative", title = "Negative", type = "Develop", value = { settings = { ToneCurve = { 0, 255, 255, 0, }, ToneCurveName = "Negative", }, uuid = "F2FF3CF0-C863-43EA-B051-B624A8113D3A", }, version = 0, }

Restart LR2, apply the preset. You just inverted the image

Of course, there might be a number of other things you’d want to “hack” into either LR2 or ACR 5.7. Just give it a try! And be sure to post any nice results you get in the comments!

Canon DPP or Adobe Lightroom?

René — Mon, 11 Jan 2010 22:00:55 +0000

Or: Why I shoot Raw

I shoot a lot of Performing Arts. That often involves “difficult” lighting: Different light sources, with different color temperatures. And to make matters worse, they are fitted with colored gels most of the time.
While I mostly try to go for “pleasing color”, rather then “neutral skintone” (the lighting was done a specific color for a reason I think), this still poses some challenges every now and then.

Simply setting ‘tungsten’ white balance is an okay starting point, but with certain types or colors of lighting, I need to do quite a bit of tweaking to get the image where I want it.

For that reason, I choose to shoot Raw: Gives me the most flexibility, and allows me to change whitebalance without causing too much harm.

Raw converters

Most of the time, I use Lightroom 2 for editing these images: I prefer the workflow over using the combination of DPP and Photoshop: I can do local edits on the Raw file in LR, and I can save the DNG with all edits included. With DPP/PS, I have to save a layered psd file of each image (which might be about 100Mb or so. With hundreds of images, that eats up HDD space rather fast).
This might not make sense to everybody, but makes sense to me.

DPP offers better noise reduction and sharpening in my opinion, but most of the time LightRoom is good enough for the intended purpose (images for the web).

Sometimes not

Occasionally however, I come across an image that simply will not give decent results in LightRoom. Blue gelled lights often give problems: For one: No way to reduce noise without obliterating all detail on the process. A while back I processed one of those images.

Here’s what it looked like in LightRoom at my default settings (Camera Neutral):
Not the best rendering. Obviously, the purple causes some problems by “blocking up”, and the blue does horrid things as well: Details and sharpness are gone. (notice the faces? A bit further down are the images up close.)

One thing that might help some colors (but not blues in my experience) is switching the camera profile. In this case, “Adobe Standard” didn’t exactly help, and the ACR4.4 profile was so bad I won’t even bother posting the screenshot…

Adjusting white balance and using specific HSL adjustments helped the image quite a bit, but still, the details in the shadow stayed absent.

Time to try a different Raw converter…

DPP

Canon’s own DPP is a very different piece of software then LightRoom: It has no DAM capabilities, and only offers global adjustments. So any local editing must be done in Photoshop. For instance by doing multiple conversions and use masks in PS.
Also, the user interface is very different and seems to be a case of “you love it or you hate it”.
Most importantly however, it rendered this image quite different from LightRoom

DPP “As shot” looks quite “neon”, but it clearly contains more detail:

The lack of detail in LR is not caused by noise reduction: If NR in LR is set to 0, the difference is still apparent. Setting Color NR higher then about 7 does obliterate any detail that was left however. Clearly, LR Color NR is not just targeting color noise… Luminance NR doesn’t help the image, but doesn’t destroy it either.

In comparison, DPP does much different: you can set a fairly high amount of Chroma NR before you start losing detail, and it actually removes color noise. However, setting a Luminance NR of something as low as 2 visibly removes detail: Avoid this like the plague.

Finishing up

Setting a higher color temperature, different color tone, and using “tune” to shift the image toward green/yellowish helps colors in DPP, although some transitions in the beams of light still look quite harsh. LightRoom does better in that respect.

The most striking difference (apart from the loss of detail in LR) is that the smoke appears to be almost gone in DPP!

Sometimes neither works alone

So, this appears to be a case were neither Raw converter gives satisfactory results… DPP gives detail, but no smoke. LightRoom gives smoke, better transitions, yet no detail. RIT handles the image like DPP does, apart from the fact that is seems to do some noise reduction by default, with no (working) option to turn it off. So no sense in going that route: RIT is a bit more constricting then DPP (you can only adjust what you could adjust on the camera) and the user interface is horrid.

I finally decided to open both the LR and DPP conversion in Photoshop, and blend them together, thus getting an image that contained both detail and smoke:

If anyone wants to give this image a try, the Raw file can be downloaded from here.

Please respect my copyright, and only use the image for evaluation purposes.

Tethered shooting with a Canon camera

René — Mon, 14 Sep 2009 20:36:49 +0000

Why should you?

If you are shooting portraits or architecture, it can be very useful to be able to view the images on a larger screen then that on the back of your camera: You can better judge focus, expression, exposure and composition for instance. Not only because the screen is bigger and of better quality (not to mention calibrated!), but also because the software you use might have some visual aids (clipping warning, grid, 100% view, stuff like that)

What do you need

Obviously a camera and the proper cable: USB for most consumer models and the Eos 1D(s)3, Firewire for the Canon 1D(2) and 1D(s)Mk2(n).
Apart from that, you’ll need some software to connect the camera to the computer and some kind of viewer or raw converter.

The software

There are a few options: Capture One Pro is highly regarded, and does all in one package, but the price is fairly steep.
Then there’s Bibble Pro. Quite a bit cheaper and supports more (older) cameras then C1Pro. Both of these support Nikon and Canon. Bibble also supports other brands. Both are available for Windows and OSX, Bibble also for Linux. Neither allow remote control of the camera, but Capture one allows you to fire the shutter remotely.

Free

Lucky for us that Canon also offers a free solution: Eos Utility. It came on the disk with your camera. If it didn’t, or you lost the disk, you can download it, following the instructions here.
Once installed, you’ll also need a viewer. I prefer to use DPP on my laptop, since that’s ~~a dinosaur~~ an old Powerbook G4 with a 12″ screen. Others prefer to use Lightroom. I’ll explain how to use both:

Step by step

First, start Eos Utility and go to the preferences: (Do this before connecting the camera. On my Mac (OSX 10.4.11) at least, it won’t complete start up, and needs to be force-quit otherwise)
Since I use DPP mostly for tethered shooting, I set up my Folder and filenames to be meaningful here. If you use Lightroom, you can skip this name customization.

The name is pretty self-explanatory I think. I use 3 lines for Year/Month/Date, since the preset “Shooting day” will add a few underscores I don’t want.

Again, pretty obvious naming scheme: My initials, the date and a short description.

Then set DPP as Linked Software.

Now for the shooting

Exit the prefs. That get’s you back to the main window. Choose “Camera Settings / Remote Shooting”

You get this: Note that, unlike other tethering software, Eos Utility gives you complete control over the camera. Very, very nice if the camera is at a position where you can hardly reach it (high on a tripod for instance).

Take a shot. If the “quick preview” window opens, click it away, since you won’t be needing that. It will stay gone as long as you don’t restart Eos Utility.
The image will now automatically open in DPP, in thumbnail view.

That’s not my preferred way of working. So I hit Cmd+A (select all) and Cmd+right arrow (open in edit image window; no shortcut for it on PC). That gives me this:

Cmd+T gets rid of the tools. All consecutive images will open in the edit image window now. At whatever zoom factor you choose.
You’re all set. So shoot away.

Lightroom

In Lightroom it’s a bit ~~more complicated~~ different.
Set everything the same in Eos Utility, except of course the linked software. As said, you also don’t need to worry about folder naming, because that is taken care of in Lightroom:

Then open Lightroom. It will open with the images you last edited / imported. Enable Auto Import, and set up a watched folder like this, in the very logically named “Auto Import Settings”:

Note that your images will get moved (not copied) by LightRoom into the folder you specify here. No way around it, so the whole naming scheme for folders in Eos Utility is kinda redundant in this case. I’d strongly recommend using a meaningful foldername. You can use either LR or Eos Utility to manage the filenames, depending on what you prefer.

Take a shot:

Note the image in the background is still the old image. If after the shot you get “No Photo Selected”, click a thumbnail in LR.
That’s it. Lightroom will now keep an eye on that folder, and import every image that lands in there. A bit slower on my laptop then DPP, but it works okay.

The drawbacks

Tethered shooting causes the battery of your camera to drain faster. With some cameras (the 1D comes to mind) that’s not something you desire…
Obviously, you also need to lug a laptop with you, but IMO that’s well worth it.
Lastly: Eos Utility does not like it when the camera goes to sleep, or is disconnected: It’ll crash. No idea why it’s buggy that way, probably because it’s free.

Sharpening in Lightroom 2

René — Thu, 20 Aug 2009 08:00:11 +0000

How does it work?

Lightroom 2 has two kinds of sharpening: Capture sharpening and output sharpening. Capture sharpening is used to neutralize the blurring caused by the Anti Aliasing filter in your camera.
Output sharpening is dependent on output (print or screen, what size) and meant to overcome the softening caused by resizing or happening when printing.

Differences

Output sharpening in Lightroom is simple: You get 4 options when you export the image: Off, low, standard or high. All else is taken care of by Lightroom. Ease of use for sure. Drawback is that you cannot preview it, so you’ll need to experiment a bit. After that, it’s “set and forget”.
Capture sharpening on the other hand, requires a bit more user interaction. The settings will depend on camera used, subject and personal preference. You can preview it, but only at 100% or higher magnification. So you either need to zoom in, or you can view sharpening in the ~~microscopic~~ small “preview window” Lightroom 2 has for this purpose.
(There is off course the workaround I mentioned in an earlier blog post)

The “Detail” Tab

…in Lightroom is where it’s at: You get 4 sliders for sharpening: Amount, Radius, Detail and Masking.
Some of these are quite self-explanatory if you know a bit about digital imaging, the others might be new to you. Let’s go over them one by one, using this image:
Notice I have the small “preview” window in the detail tab open. If I didn’t, Lightroom would show an exclamation mark, signifying that “a zoom level of 1:1 or greater is required to see these effects”:

Amount and Radius

These two are pretty obvious: Amount lets you set how much you want to sharpen. Scale goes from “0″ to “150″ (Which is red for a reason: In most cases it will be too much). The default setting is “25″.
Radius lets you set how wide you want the sharpening halos to spread out. Scale goes from 0.5 to 3. Default setting is 1. A higher setting will give you wider sharpening halos.
As with a lot of sliders in Lightroom, you get some “visual help” when you press the Option (Alt) key:
Press Option while sliding the Amount slider, and the image goes grayscale, to better show what the sharpening does to the luminosity values in the image.

Press Option while sliding the Detail slider, and you’ll see just the sharpening halos you are creating.

Detail and Masking

Detail (0 to 100, default 25) suppresses these halos.
A setting of 0 will undo quite a bit of what you did in the above sliders. Again, pressing Option while sliding will give you a fairly accurate idea of how much detail you’re allowing to be sharpened.

Masking does exactly what the name implies: It builds a mask on the fly (which is pretty nifty if you ask me) The default of 0 masks nothing so everything is sharpened, the maximum of 100 will sharpen only the big edges in the image. Press Option while adjusting the slider and, contrary to the other settings above, you’ll be shown the mask, not the effect on the image. Probably Adobe figured that it was less ambiguous that way. (And they were right)

Noise Reduction

… is also present in the Detail tab.
There’s a slider for Luminance NR and one for Color NR.
Color noise consists of randomly colored pixels in an image. Luminance noise is more like “film grain” and less of a problem in my opinion.
That’s good, since in most cases, Color noise is fairly easy removed in Lightroom. Luminance Noise reduction is not. At least, not without loosing detail in the process.
Unfortunately, the Lightroom engineers didn’t provide a “visual aid” for noise reduction, so you’re down to good old WYSIWYG.

Here’s the image again. First without sharpening or noise reduction (notice the “switch” in the top left of the “Detail” tab is in the “off” position):

Next, with sharpening but without Noise Reduction. Pretty big difference.

Let’s see what just Color NR does. Notice the random “blobs of color” that were present in the previous image are about gone. And that with a fairly low setting:

Finally. with both Color and Luminance NR. Notice we are already losing detail in the last, while there’s still Luminance noise present.

Finally, here is the exported image, with “standard” output sharpening for screen:

Hope this has shed some light on the subject of sharpening in Lightroom.

Clipping Warnings in Lightroom

René — Sun, 16 Aug 2009 15:05:58 +0000

And why they deceive you

Adobe Photoshop Lightroom, like many other Raw converters, has a clipping warning.
The purpose of it is to give you a visual warning (apart from the histogram) of what parts of an image might be clipping.

What is clipping?

A pixel is clipping when it reaches a value of 0 or 255 in one or more channels, and “should have gone further”. Since it cannot go lower then 0 or go higher then 255, it remains at those values: Detail is lost if one or two color channels clip, part of the image is solid black or white if all 3 channels clip.

The effect of color space

As with anything in digital imaging, the color space used has a big influence: A wide gamut color space (such as ProPhotoRGB) will have lower values for the same color then for instance sRGB. So a color that is clipping in sRGB, need not be clipping in ProPhotoRGB!
This color for instance, has sRGB values of (250,40,30). The ProPhotoRGB values are (177,76,36) for the exact same color.

This means that you have a lot more “headroom” in ProPhotoRGB before you hit the “clipping wall”.

So what?

Lightroom uses MelissaRGB internally (ProPhoto RGB with sRGB Tone Response Curve).
The histogram in Lightroom is based on its internal working space. So when you are exporting images for a web gallery, the images might be clipping big time while Lightroom is not warning you!

An example

I opened a DNG file in Lightroom 2.4 and in ACR 5.4. These have basically the same raw conversion engine. The exact same settings were used in both Raw converters.

Here is the image, histogram and clipping warning in Lightroom. (click image to open bigger).
Almost no clipping indicated (It makes no difference what output color space you choose): Just a bit in the lower right that goes almost black, and absolutely no clipping highlights according to Lightroom:

Here is the image in ACR 5.4. Output color space is ProPhotoRGB: About the same clipping warning Lightroom is giving.

Here is the same image in ACR 5.4. Output color space is sRGB: major clipping!

For reference: Here is the image exported out of Lightroom: Clipping indeed:

Workaround

Is there a workaround? No (except using ACR that is).
Simply ~~sad~~ said, the only thing you can do is watch the histogram, guess, and use your eyes. If your screen has close to sRGB gamut, clipping in sRGB might also be visible on screen (as can be seen from the above screenshots in Lightroom).
If you use a wide gamut screen however, you might see quite a difference between the Lightroom “Develop” module and the actual exported image…

Lightroom

René — Sun, 26 Jul 2009 18:42:47 +0000

How to see what you’ll get

for a web gallery.
Normally, Lightroom will only let you preview sharpening and noise reduction at 100% view. This is a good thing™ in my opinion, since it is capture sharpening, meant to negate the effects of an anti-aliasing filter in front of the sensor. You’d get all kinds of moiré without an AA filter, as can be seen in the hilarious story Eamon Hickey wrote about the NC2000.
Since the AA filter softens the image a bit, you need to sharpen it. This is input sharpening. So it should be judged at 100%. Unlike output sharpening, which is better judged at reduced size, at least: For print. For web view at 100% and WYSIWYG.
Or is it?

A workaround

I recently was processing a few ISO 6400 images, which had severe noise in them. Here I ran into the problem that the NR isn’t shown at “fit window” view. So I had no way to judge what the images would look like online.
(all images can be clicked for a larger version)
This is the image as shown in the develop module:

This is part of the image at 100%:

Clearly, no NR is shown in the “Fit screen” view.
What works however, is to create a 1:1 preview (In LightRoom > Library Module > Library > Previews > Render 1:1 previews), then look at your image in “Loupe” view (shortcut: “E”) at fit to screen. Bingo. Both input sharpening and NR are applied. There is no way to get LR to preview output sharpening.
This is the image at fit screen in the Loupe view before and after creating a 1:1 preview:

Web Gallery

The beauty of this is, that it also works for the web gallery: If you preview it in LR after making 1:1 previews, you will see the image as it goes online (minus the output sharpening that is)

The image in the web gallery preview in LR, before and after creating a 1:1 preview: An even bigger difference:

This is the final image as it was exported by LightRoom. Inclusive output sharpening.

Pretty neat, huh?