Tag Archives: processing

Speeding Up Lightroom

YouTube is a fantastic way to lose track of time.  It may well have an abundance of crap but it also has lots of informative material.  More importantly, watch one thing and you get recommendations of other things, many of which are actually quite useful.  I was watching a video by Tony Northrup on building a computer for photo processing and he was talking about putting the Lightroom catalog on an SSD.  This got me thinking about something.

When I built my system, I installed an SSD to be the drive on which the OS is installed along with the applications.  I have traditional hard drives for the data storage.  One of these was set up with the Lightroom catalogs keeping them separate from the image files to make the response time better.  At the time of the build, a 250Gb SSD was affordable but not cheap so that was what I went with.  With everything installed, that doesn’t have enough space for the catalogs.

I never thought more about it until after this video.  I started thinking about some old SSDs I have and looked at whether the catalogs would fit on either of them.  It turns out that, with all of the preview files, the SSDs were not big enough.  However, I did then have a look at the price of a drive that would be large enough such as another 250Gb drive.  That would have plenty to spare to account for future needs.

While looking at these, I was also able to see 500Gb drives and they are only about $150.  I was unaware just how much the price had fallen.  Consequently, a spare drive bay now holds my Lightroom catalogs.  I only have a relatively small amount of experience with the new configuration but it is safe to say that things are positively zipping along compared to where they were before.  I was wondering whether the system might be in need up upgrade or replacement but this one change seems to have made things significantly better.  I will report further if I discover more but, if you have a similar configuration, this might be the upgrade that makes things noticeably better.

Fisheye Correction in Lightroom

I have a pretty well defined routine for importing and processing my images in Adobe Lightroom. I have presets for importing images that put them in the right folders, apply copyright information and apply development presets. I can then edit from there as I go. One of the settings I have set as a default is the application of the lens correction settings. This setting deals with any natural vignette in the lens as well as some distortion. Occasionally this can be tricky if you have something close to the edge of a wide lens and it gets slightly chopped by the correction.

AU0E3419-2.jpg AU0E3419.jpgI discovered a more extreme version of this while processing some shots from the Lick Observatory. I had taken my 8-15mm fisheye zoom with me as I thought there might be some use for it in the telescope buildings. It turned out to be a good thing to have. When I first had the lens, Adobe had not created a profile for the lens so the shots came in uncorrected with the fisheye look I expected. More recently, Adobe have created a profile for this lens. It was added in one of the updates and, since I don’t use the lens all of the time, I hadn’t noticed.

AU0E3382-2.jpg AU0E3382.jpgWhen I was going through the shots, I noticed the wide shots had some strange distortion at the edges. I was perplexed by this and also wondered where the circular fisheye shots were because I was sure I had taken some. Only then did I realize that these were those shots and the corrections were being applied. Here are some examples of the before and after with the correction to give you a idea of what the transformation is. A pretty dramatic change. I might make use of this sometimes but I shall also have to remember switching this off when shots with this lens are involved.

Blog Image Upload Using WP/LR Sync

Providing a review on something you haven’t had a lot of use of doesn’t seem like a good plan. This is something I have been using for a while and, now I have had a bit of time with it, I thought I would share what it is like. Uploading images to the blog is obviously a big part of the preparation of posts since, at the end of the day, this is primarily a photographic blog. When I first started out, I would create the images I wanted and then upload them manually. That was time consuming but was soon superseded by an alternative.

I started using the LR/Blog plugin to Lightroom. This would create a version of the file including any formatting, borders and conversion to the right color space and would then upload it to the blog. This worked okay for a long time but it had one significant limitation. If I tried to upload too many shots at once, it would fail and then lock me out of the blog for a while. I started searching for an alternative when my efforts to solve this problem went nowhere fast.

If you Google this topic, almost everything brings you to LR/Blog. However, recently I came across WP/LR Sync. It is a Lightroom plug in that makes use of the Publish services in Lightroom. Rather than uploading the images one time, you add the files to a collection that is then published to your blog. If you change the image, you can have the online version amended in sync with the original. If you go to http://apps.meow.fr/wplr-sync/ you can read more about it.

I decided to give this a go. However, in the guidance, Jordy provides a piece of information for people like me who have problems uploading lots of images. Apparently, my hosting service treats too many upload attempts in a short time as an attack and you get locked out. This was what was happening before. WP/LR Sync has a field that allows a small time delay between images which, if set just long enough, will prevent you getting treated as an attack. Something like this would also cure my LR/Blog issues I guess but that ship has sailed.

I am very happy with the new plug in. It works well and allows the same edits of the image before uploading as before. A benefit is that, if you drag images to the sync collection and they were already in there, you don’t end up with duplication on the blog. The one you previously uploaded is there. You just might have to scroll down a bit to try and find it. If you want to have a go with this add on to Lightroom, visit http://apps.meow.fr/wplr-sync/ and check it out.

Haze Filter

The Creative Cloud version of Lightroom drops new features in to the software when the updates are installed. This is a nice thing to have happen but, unless you are paying attention, you might not be aware of some of the new features. It took me a while after the last update to learn that a new filter had been added that was designed to take haze out of images. This is a great idea. I have experimented with trying to remove the effect of haze in shots before but, because the effect varies by distance, it can be quite tricky to get something that doesn’t look totally wrong.

QB5Y5727.jpg QB5Y5727-2.jpgI have not played with the filter a lot but I did decide to try it out on a shot I took at Crater Lake a few years back. Wildfires had resulted in smoke in the air which meant the usual clear view across the lake was obscured. I thought I would see how the filter worked out. Above are the before and after shots. It is an improvement but obviously isn’t going to rescue a totally messed up shot. I did try a more aggressive setting but that looked wrong itself so this was the one I went with. We shall see if this has other uses for me over time.

Clever Feature of Lightroom CC

This one is something that I can attribute to the Kelby media juggernaut. I did not discover this myself but, if you are a user of Lightroom CC and use either the HDR or the panorama functions, this could be of interest. One of my issues with them was that they took a while to bring up a preview. Once you had got this, the processing would work in the background.

It turns out, if you don’t need to tweak the settings and are happy with what you used previously, you can hold Shift and Ctrl and press either M for panorama or H for HDR and it will launch right into processing the whole thing in the background. You can set multiple versions off if you wish and they will all get to work out of sight while you do something else. While my feelings on the outcome of the processing are not universally great and I covered this in some previous posts, it does a reasonable job most of the time and this is an even better feature that is well concealed!

Experiences with Lightroom CC

I have discussed some of the new functions of Lightroom CC here and here. Aside from those changes, how have things been with the program overall? To be honest, I am a bit underwhelmed by the new version. There have been a few minor functionality upgrades but nothing huge. I do like the ability to add images to a collection when importing them since that has saved a step for me. However, the presets do not seem happy remembering which collection it is so that is rather buggy. Many of the bugs in the previous version also exist so, if they have really recoded a lot, they have still reused a lot of the code.

The new version also seems to have a fair few bugs of its own. The crop tool seems to have developed some new quirks that result in it deciding you have finished selecting the area a short while after you actually do so, if you have moved the cursor away, you get some very odd effects. I still can’t get it to stop trying to create a backup copy of my files when I import new images. Nothing new was added for video which I think is daft. They give you the capability to import video and even trim and edit clips. However, with Photoshop having the ability to be a basic video editor (and now my default), there is no way to connect videos in Lightroom with Photoshop in the same way as you do for stills. That baffles me.

The big benefit is in processing speed. My workflow involves rendering 100% views to speed me through the culling process. The new version certainly renders them a lot faster. I did have to upgrade my graphics cards though. My vintage cards did not have the necessary version of OpenGL to let Lightroom take advantage of them. It also has lens profiles for two of my lenses that were not in the previous version which is nice to have.

Overall, I am okay but a bit underwhelmed. Since I pay for the subscription, I am paying for it but it does have the feel of being free so I am less concerned even if I can understand the truth. What I am hoping for is a bit more frequency in fixes to deal with the bugs and maybe bring some extra capabilities.

HDR Within Lightroom

The changes in Lightroom CC that included the Photomerge also included a change to the processing of HDR images. Again, the functionality has been brought within Lightroom rather than requiring the move out to Photoshop and the output file is again a DNG file. This means a smaller file than the 32 bit TIF that I was previously getting. A while back I wrote about some of the odd experiences I was having with moving these high bit depth files between Photoshop and Lightroom so a new workflow is of interest.

According to some of the publicity at the time of roll out, the new processing approach does not require as many images to work with. I have been shooting five images for HDR to date. They say that only a couple are necessary. I have tried carrying out the processing with five and with two and there doesn’t appear to be an obvious difference in the output. There is a benefit in the time taken to process the images though so this does appear to be a good improvement.

You can either let the output be automatically toned using the normal Lightroom processing functions or do it yourself. I let it have a go at first but have not liked the choices it made so have reverted to carrying out the toning myself. It is not a time consuming process so seems worthwhile to me. While I felt that Photomerge was not as capable as using Photoshop, in to case I think it is a better solution and this will be part of my workflow. Now to reset the camera to shoot fewer bracketed images!

Lightroom’s New Panorama Feature

Lightroom CC comes with a number of new features. High on the list is the new panorama feature. Previously, if you wanted to stitch a panorama, you would select the shots in Lightroom, make sure you had them synced up for any exposure edits and white balance corrections and then send them to Photoshop. Photoshop had a Photomerge function that you could use or you could open them as layers in a document and carry the merge out yourself with a bit more control. This was the approach I used and I wrote about the technique here a while back.

The new Photomerge in Lightroom CC is designed to do without Photoshop. It takes your original files and then makes a new DNG file which is the stitched panorama but, as a RAW format, it still allows you to edit the image using the normal editing tools. I had to give this a go so, how well does it work?

The answer is a mixed one. In many cases, it works just fine. It stitches together the shot nicely and you can go on your way. While the initial preview process takes up a little time, the processing of the final stitch is done in the background so you can get on with something else – something I find very handy. However, it does have some shortcomings.

First, it doesn’t always find the way to stitch the shots. I have had a couple of times when it couldn’t work out the alignment. When I tried the same shots in Photoshop, they worked just fine. Not sure why these didn’t work but the algorithms must have some limitations. Next, it doesn’t always deal well with curvy edges. I have had a couple of stitches that I tried where the aircraft fuselage, although a smooth curve, ended up with some kinks at the area where the stitch took place. Photoshop never caused me trouble with these either. Big panos also seem to make it unhappy with some very odd alignments being chosen (after a long time processing) so they may have to stay in Photoshop for now.

The last problem is cropping. You have the option to have the whole stitch or to have it crop in automatically (or you could crop manually afterwards). Cropping pulls you in to the shot more aggressively to get rid of any blank pixels. You can fix this by shooting a lot wider to have more to work with. However, having been used to being able to fill odd little gaps using Content-Aware Fill in Photoshop, not being able to do so in Lightroom is a limitation. I can, of course, open the file in Photoshop and do just that. However, if I do so, I might as well use Photoshop to do the merge in the first place.

Overall, it is pretty good. I suspect there will be some tweaks behind the scenes as CC gets updated progressively so I might not even know that Adobe have fixed some of the issues. The Fill issue will be more obvious though. I shall probably keep using it unless I feel the Photoshop is merited and it is a good addition but I hope they take it further so I don’t have to consider Photoshop in the future. We shall see because the new update of Photoshop is out and includes Content Aware Fill of the gaps in panos which might be enough to sway me back.

Time Lapse Tutorial

I have mentioned in the past some of my interest in time lapse. I recently posted a sequence on here and a friend of mine asked me to put together a guide to how I had gone about doing it so here you go.

When putting together a time lapse, the first thing is trying to establish what will be special about what you are shooting a sequence of that will make a time lapse more interesting than any other form of presentation. Usually this involves something that changes slowly in real time but becomes more dynamic in a time lapse such as a sunset or storm cloud development. Alternatively, it is something where a lot happens over a long time that isn’t terribly dramatic on its own but, when speeded up, becomes far more impressive. This could be a sequence of activities with multiple people or launching airplanes as was the case for the one I recently made.

Once you have established what it is that makes it interesting, then you have to decide how best to portray that. Choosing your location and your angle of view are the next challenges. I was shooting departing and arriving aircraft at SFO so I needed an angle that gave me a good view of them and a field of view that allowed plenty of the movement to be seen without everything being too far away to be noticeable. In this case, shooting at night works well because the lights stand out far more making the aircraft more conspicuous than would be the case during the day.

Now it is time to get into the technical issues. How long a clip do I want to make? Shooting time lapses means getting a large number of still shots which will each be a single frame of video. Video frame rates vary but I used 30fps for the sequences I make. Therefore, 30 shots will give me a second of video. If I want a minute of video, I need to shoot 1,800 shots. That’s a lot of shots. Also, figure on shooting more before and after the main action since it is nice to have some spare video at each end to play with in future editing.

You know how many shots you need but how long in real time do you want to cover? Are you starting before sunset and finishing well after sunset? Do you have a peak period of activity that you want to cover? Now you can see how many shots you need over a given amount of time so you will work out how long the interval between each shot can be? The interval between shots is critical but you must also factor in how long a shutter speed you want. This is where shooting at night is a lot nicer because you can get nice long shutter speeds. These make for smoother looking videos because there is no jerkiness. Shooting on a sunny day with a very short shutter speed and a few second interval will result in a jerkier output. The “rule” is to have the exposure time at least half the interval. Doing that during the day may require some neutral density filters. At night it is a lot easier to manage.

Now to mount and control the camera. Obviously a tripod is a necessity to make a stable platform for the shots. A cable release is a must have and preferably one with a timer built in so you can program the intervals. However, if you are shooting at night, you can get away with putting the camera on burst mode with a shutter speed to match your interval and then lock the shutter release open. It will then just keep shooting. The other camera thing to consider is image stabilization if you have long shutter speeds. IS can wander around for long exposures making everything blurred. Keep it turned off. I would also switch autofocus off once you are happy everything is sharp to avoid the focus getting changed by the camera. If the conditions are changeable, you might go with something like aperture priority to accommodate changing exposures. At night, manual might be your best bet. Always keep an eye on how the exposures are doing if in a programmed mode to ensure you aren’t exceeding your interval with your shutter speed. There are complex bulb ramping tools available to use if you want to get advanced. I haven’t tried these since they haven’t been necessary for my purposes so I can’t give good advice. I do have the functionality in a cable release device that connects to my iPhone called Triggertrap but I haven’t ever pushed it to its limits.

One thing you will discover is that fixed apertures are not fixed. Cameras will go to a slightly different aperture for each shot which can result in slight variations in exposure. This “flicker” can be managed by clever manipulation of the lens position but I prefer to use software to fix it. The software will also help if you end up tweaking the camera settings during the capture sequence.

Last piece of equipment advice is bring a chair. Once everything is at work, you don’t have much to do. You can shoot with a second body of course or you can sit back and relax. If you have a buddy along, that is not a bad thing! I shoot all of my sequences in RAW format. For night shoots this gives you a lot of latitude for tweaking the exposures. It does use up a lot of memory but storage is cheap these days. With charged batteries and big cards, you are good to go.

Once the shoot is done, you get home with a ton of images that look remarkably similar. First I import them into Lightroom. I will keyword them in the same way as anything else from a shoot including adding a time lapse keyword. Then I will make sure all of the time lapse shots are in one subfolder before jumping over the LRTimelapse. I am not going to try and write a tutorial on using LRTimelapse. The website for the software has far better guides to how to use everything. However, I will focus on the key elements I go for.

The main one is the Deflicker process. This is a routine that analyses each shot and applies little tweaks to the exposure to avoid any visible flicker. You can draw out a box in the image preview to tell it where to analyze. This means you can pick an area that is constant in the image as a reference and avoid areas where there is a lot going on. If the image exposure is gradually changing, it won’t affect that. It will just take out the individual variance. You can see a trace of how the overall exposure tracks during the sequence.

The other element I sometimes use is panning. You can define keyframes in the sequence and jump back into Lightroom to crop each one as you wish. Back to LRTimelapse and it will calculate the individual crops for each frame to make a smooth pan between your chosen keyframes. Quite nice to provide a little variety if you wish. I always crop the images to a 16×9 format since that works nicely for HD output formats.

When all of your tweaks are fixed, you save the metadata files and go back to Lightroom to reload them. (There can be a bit of back and forth like this throughout the process.) In Lightroom, there is an export dialog from LRTimelapse which then renders out the individual files from each shot. These will then be taken by LRTimelapse and rendered as a video clip.

Sounds really simple that way and, to be honest, it is pretty straightforward. A little practice helps of course. When it works out, the result can be very satisfying. Of course, a lot of times, you see something that you really wish you had done differently. That is something you will have to put down to experience and try to remember next time you are out shooting.

One last thought – if you are shooting something that involves light trails at night, consider making each image a layer in Photoshop and blending them together as a stack to see what happens. It can work pretty nicely sometimes. However, you can end up with a pretty huge Photoshop file so your computer may groan while processing it. Happy shooting!

HDR 32 Bit and Lightroom

This post is a plea for help. Anyone who is a regular user of Lightroom and Photoshop may be in a position to educate me a little. I use Photoshop to process my HDR shots. I start out in Lightroom, select the shots and use the Edit Photo>HDR Pro method to open them up in Photoshop. I then use the 32 bit version of the HDR Pro processor to create the file. I then take the Edit Using Adobe Camera Raw option for opening the file to undertake the final mapping. This works pretty well and I can usually get something I am happy with.

I then close the file and save it which automatically reimports the finished file back into Lightroom. This is when things go wrong. The view of the file in Lightroom doesn’t appear to make use of any of the edits I had done in ACR. The highlights are too bright and the shadows too dark. I can then use the Lightroom Develop settings to get something close to what I want but surely that should not be necessary. I might make further tweaks but shouldn’t it look the same when I close out of Photoshop.

Below is a sequence of screen captures to show you the unprocessed shot in ACR, the finished version, what it looks like in Lightroom and then what I can tweak it to. Any suggestions are gratefully received.  (Note, I didn’t make this exactly match the two edited versions.  It is aimed to illustrate the disconnect and the recovery process.)

Original HDR merge pre tone mapping

wpid12810-Screenshot-3.jpg

HDR with ACR tone mapping appliedwpid12808-Screenshot-4.jpg

How the saved image appears when imported to Lightroomwpid12806-Screenshot-5.jpg

Using Lightroom to get back to something like I had in Photoshopwpid12804-Screenshot-6.jpg