Tag Archives: Lightroom

Lightroom Issues Update

In quite a few previous posts, I have mentioned the troubles I have had with Lightroom recently.  This was all triggered by an update a while back and subsequent updates have not solved any issues.  The problems just continued and I was unable to get anything to address the sluggish behavior.  The program would respond better when I was working in the Develop module but it was very difficult in Library and when importing.

I recently had a bit more success.  I contacted someone who, while not working for Adobe, does have a business based around Lightroom and has good connections with the company.  I was able to send this individual a copy of my catalog.  They had a play with it and had similar issues with memory overuse so it wasn’t a hardware issue.  They were able to pass on the catalog to an Adobe engineer to investigate further.  I feared there was some corruption in the catalog and hoped they would find a solution.

It transpires that there is not any corruption.  Instead, it is in the nature of the catalogs that I have created that the problem lies.  A long time ago I posted about my approach to processing a shoot.  I would use a Collection Set for each shoot in which I would use smart collections to take shots with the right combination of keywords and dates.  They would split out rejects from non-rejects and put HDR, panorama shots and videos in separate smart collections.  This made processing the shoot more efficient.

As a result of this approach, I have, over the years, accumulated a large number of these collection sets with smart collections in them.  This is what is causing the trouble.  The program is getting bogged down with all of them.  This leaves two ways forward.  In the short term, I am going to go through these smart collections and turn them into simple collections.  Hopefully this will reduce the processing burden.  I don’t need the smart functionality any longer so I can just take the selected images and make simple collections out of them.

The longer term action is that Adobe is now aware of this issue.  Hopefully they can investigate a way to address this in a future update so that it isn’t constrained in the same way.  It happened suddenly so there was something in the coding that changed to cause the issue so maybe it can be similarly quickly fixed.  In the early days of Lightroom, it was limited in the number of images it could have before things got sluggish and that was resolved so hopefully this can be too.  We shall see.  If it is, you’re welcome!

 

Lightroom Keyword Approach Update

I have been using Lightroom since the first version came out many moons ago.  For most of that time, I have been actively keywording my photos.  It is a bit time consuming, but it does provide for good searchability and it also is useful when providing images to stock agencies.  My initial keywording was a little light, but I have got a pretty good level of information in there now.  The only problem is that I have to try and remember all of the different words I use for given types.  I almost always forget something when doing this.

The solution to this is using a hierarchy system for the keywords.  Lightroom allow you to have these hierarchies in the keywords such that, if you add one word, a whole sequence of other words will automatically be added.  For example, if you want to add AH-64, it would also add Apache, military, helicopter, Boeing etc.  This does require you to set up all of the words properly of course.  I took a halfhearted go at this many years ago and it didn’t work out well.  Recently, I decided to have another go.

This time, I wanted to do things in a more organized way.  However, editing the words and the hierarchy structures in Lightroom seemed a bit slow going.  Then I realized you can export and import keywords.  I exported the words I currently have and it created a text file.  Where I had tried creating hierarchies before, these were shown as tabbed indents from the words above them.  Therefore, I figured I just had to create a text file in the same structure and then import it.

I spent a fair bit of time creating the file.  Setting up the structure I wanted required a bit of thought and I had to change things a few times as I realized certain groupings would work more efficiently.  I also changed a couple of times to have the one word that was likely to be used as I keyworded be the top of the hierarchy.  For example, I am going to add 787-8 reliably but not Dreamliner.  Therefore, if I have 787-8 at the top and Dreamliner below, it will get added without me thinking about it.  The same for F-22 versus Raptor.

By taking a couple of weeks to create the list, I got it pretty well laid out.  I remembered to add stuff as I went that I had initially forgotten so the final list was pretty comprehensive.  I will have still missed out on some stuff but it didn’t have to be everything.  All of the existing keywords are still going to be there, and I can add more stuff later if it seems valuable.  Finally, I imported the file to Lightroom and boom, all of the new structures were there.  Next time I add a bunch of stuff, we shall see whether it makes a significant different to the process.

One thing to note, if you have the keyword box set to Enter Keywords, this hierarchy approach doesn’t work. Much frustration ensued when I first found this. However, some good guidance was provided and by changing to Will Export, things work as intended. No idea why that is necessary but, now I know, things are okay. I am also going to progressively clean up the old keywords to get rid of the non-hierarchy ones to ease entry even further.

My Copy of Lightroom Got Sick

After a previous update to Lightroom (6.12), it became almost unusable.  Importing would take forever and, once the images were in, it would grind to a halt.  Keywording and editing became a nightmare.  I was struggling to work out what was wrong.  A check on performance showed the processor wasn’t busy but the RAM was maxed out.  I couldn’t understand why.  The first thing I do when Lightroom behaves strangely is to delete the Preferences file.  This file can get corrupted and mess with the performance badly.  Just delete it and restart and things are often fixed.  That didn’t work in this case.  When the new version of Lightroom was released, I hoped this would fix everything but sadly not.  (Meanwhile Photoshop itself is working just fine on this system.)

I had a long session with the Adobe tech support people which got me nowhere.  After telling me this was normal, they realized it was not when our screen sharing crapped out as a result of the machine slowing to a virtual standstill.  They tried a bunch of simple stuff and got no further than I had on my own.  They suggested a second session would be needed and then promptly sent me an email telling me that the issue had been successfully resolved.  Not sure how they concluded that.  Meanwhile, I wondered whether there was an issue with my Windows installation so decided to do a completely clean install.  This had some slight benefits but basically the problem still remained.

I have done a bunch of scanning of similar issues and I found out a technique the support team can use to tweak performance.  There is a config.lua file that can be created in the presets folder to influence the system.  I have added this file and it has certainly made a few things work better.  It has also slowed some things down as well which isn’t ideal.  This was not a solution though.  All it did was make the program slightly more usable.

Another session with Adobe ensued.  This time we got into the permissions for some of the folders that contained the catalogs.  Lots of time to reset these to give greater authority.  I was told this is sometimes an issue with large catalog files.  Lots of time later, I found that nothing had really changed.  The whole thing would still get bogged down very quickly.

Then I read about Lightroom 7.2.  This was a new update that was supposed to address a lot of performance issues.  It was supposed to make better use of multi-core processors as well as larger RAM configs.  I had seen a sequence of updates not improve things – my issues were clearly not the normal performance problems although I had previously experienced some of them too – but I was hoping that, if they had changed the architecture of the software, maybe whatever was causing my machine to have problems might have been tweaked/replaced.  If not, I was seriously considering the need to buy a new system since this was so horribly inefficient.

I waited for the release date to come around when I knew the update was on its way.  Then I got an update to the iPad version and it said the new version of Camera Raw was included.  This must mean it was close.  A day later, the update dropped.  I downloaded it immediately and opened up.  Hurrah!!!  Everything run fast, the RAM levels were moderate and stable, everything was happening as it should.  My system lives!  Let’s hope this isn’t a false dawn.

My Approach to Shooting and Processing on Crappy Weather Days

This is the finished image. This is pretty much what it looked like to the naked eye (through the viewfinder) when I took the shot given how dark the sky was.

A rare arrival was due on a day that was not good from a weather perspective.  It was dull and rainy and so not what you would hope for.  Conditions like this mean I try to exploit some of the features of the camera and the processing options available.  First, how to set up the camera?  With the light being bad and variable, I went to a pretty high ISO level.  I shot in aperture priority mode and added a lot of exposure compensation.

In my experience, the metering is pretty good when shooting against the sky in clear weather but, when there is a lot of cloud, the camera tends to treat the clouds as too bright and it underexposes the subject too much.  I use a lot of exposure compensation in this case with a setting of +2.0 being used on this day.  The reason I do this is that, aside from the exposure question mark, there is a lot more information available in the lighter end of the exposure curve.  Shooting in RAW gives you options.

This is how the camera recorded the image. This is the in camera JPEG that I extracted from the RAW file using Instant Raw From JPEG.

If you were to look at the aircraft at the time, you would see a dark and menacing sky but you would see plenty of detail on the plane.  The camera does not see that for the original shot.  The aircraft would be very dark.  When processing, this dark area would give you something to work with but the variation in data would be more limited.  Shoot overexposed and you get more to work with.

This approach will only work well if you are shooting RAW.  If you are using JPEG, too much of the usable data will be discarded during the processing in the camera.  To show you what I mean, here are two images.  These are both from the same shot.  One is the RAW file as it showed up when imported in to Lightroom and the other is the embedded JPEG that you can extract from the RAW file and which can be seen when the file is first imported before the rendering is undertaken.  As you can see, the JPEG is over exposed but the RAW rendering seems even more so.

There is way more data in the RAW file though.  Immediately, as I bring the exposure slider back down, the clouds go from being white to quite dark – just as they appeared on the day.  Meanwhile, the fuselage of the aircraft has a lot of the data intact and maintains a lot of the brightness that you could see at the time.  Very little needs to be done with the blacks and they are almost in the right spot by the time the exposure is good for the clouds.  The fuselage might be a bit too dark though.  A small tweak of the blacks and a little boost in the shadows to compensate for too much darkening with the exposure slider and suddenly the shot is looking a lot more like it did when I saw it develop.

My RAW processing baseline always results in a slightly more overexposed shot the embedded JPEG includes. When you first open the image, the embedded image you see in the previous shot initially shows up and then it renders the RAW file. This was the initial RAW rendering prior to any adjustments.

One advantage of shooting on such a crummy day is that the sky is a giant softbox – in this case a very soft one!  The result is that the light is a lot more even than on a sunny day.  The darker look can actually make the colors look a bit more intense than if they were losing out to the whites when the sun is right on them.  While there was only one plane I was specifically there for, playing around with these other shots and working on the technique was a nice extra benefit.

Stitching a Moving Ship

This is less of a technique post and more about the capabilities of modern software.  In a previous post I discussed a visit to Vancouver to meet up with family members that had come off a cruise ship.  We were down on the waterfront when the ship that they had come in on departed.  As it got further away, I shot a few frames with the longer lens to try and stitch together in a panorama.  The problem with this type of shot is that the ship is moving so the background is not consistent between the frames, even if you try and do them quickly.  However, I handed them over the Lightroom and it did its stitching thing and the attached shot resulted.  I think you would struggle to know that there was an issue based on the output.  Quite impressive software performance!

Adobe Fixed the Time Zone Issue for Video

In this previous post, I noted that there was a problem with the way in which Lightroom identified the time of video files.  I was having to manually adjust the capture time after importing them.  When I contacted Adobe, they said it was a problem with Canon and vice versa.  Not helpful.  However, I notice that, with a recent update (I won’t say upgrade because some aspects of it seem to have really screwed up Lightroom performance), the video files now come in with the correct time associated.  I only found this out because I was about to adjust them when I realized they were already correct.  One little annoyance has now gone away.  Hurrah!

Another Go at Stitching iPhone Raw Shots

As I posted a while ago, I have been experimenting with stitching shots from my phone.  Since I am shooting in raw on the phone, I have some latitude to play with the shots in post that wasn’t there before.  This time, though, I thought about it a bit more and put the camera into manual mode to fix the exposure.  This should make the stitching and blending easier than when it changed between shots (although, to give the Lightroom team credit, it did a pretty good job anyway).  I allowed plenty of overlap and the merge seemed to go pretty well.  Since it outputs a dng file, you still have the chance to edit more aggressively than would be possible with a jpeg.  Meanwhile, you get a higher resolution shot than with the internal pano mode.  This may be my go to method from now on.

Sacramento Roundhouse

One end of the railroad museum in Sacramento is a roundhouse. It is accessible still from the line outside and I was there for a modern locomotive that was being unveiled. Access comes via a turntable which sits right next to the path along the river. I figured I would put together a panorama of the scene. However, I only had my phone (albeit able to shoot raw). I had never tried shooting a pano sequence with it before having only used its internal pano function.

I wasn’t controlling the exposure (although there is a manual function in the app I use) but I had noticed that the Lightroom pano function seemed quite adept at dealing with small exposure variation. I took the sequence and there was not a big difference across them. When I got home, I added them to Lightroom and had a go at the stitching function. It worked better than I had expected. Some small distortions were there but it actually was rather good. I had not been happy about the reduced size of the pano function of the phone so this has provided a better option to use in the future.

My Revised Workflow

My approach to processing images after a shoot is something that constantly evolves.  I have written about how I do this in the past but a few things have changed since I wrote that so I thought I would write up the latest approach in case it is of any use/interest to any other shooters out there.  I should say at the start that my workflow is based around the use of Lightroom.  If you don’t use Lightroom, this might not be of any use to you although I imagine that a similar process could be achieved with other software.

One thing to highlight at the start is that, when shooting aviation (and that is the majority of my photography), I aim to slightly overexpose my shots.  I have found that going a slight bit over and then bringing the exposure back down in post-production gives a better balance of exposure across the shots and also makes for more pleasing sky colors.  This is something I do when shooting RAW.  If you shoot in JPEG, this might still work but your latitude for adjustment afterwards is a bit reduced so you might not get the same effect.  I don’t shoot in JPEG so I can’t state what happens.

All the shots are imported in to Lightroom and I will form a Collection Set for the shoot.  I don’t have specific folders for shoots, nor do I have a renaming convention.  I keyword all shoots and this is how I manage files and find things later.  Keywording is a story for another day.  Within the Collection Set, I shall create a series of Smart Collections.  They vary depending on what I have shot.  There will always be Not Rejects, Rejects and Picks.  Then, depending on what else there is, there might be Videos, Time Lapse, Blend Stack, Pano Originals, Pano Edits, HDR Originals and HDR Edits.  I keyword any of these types of shot with that term so the smart collections will pick them up.  The Smart Collections may be looking for a date range or shoot specific keywords depending on what I have been shooting.

The aim for all of this is that I get a Smart Collection which is unrejected shots which doesn’t include and shots from HDRs, panos, time lapses or blend stacks.  I don’t want to get rid of those shots by mistake and I want to be able to edit those shots at a convenient time.  Then the Not Rejects folder becomes my focus.  I am aiming to get all of them roughly corrected for exposure so I can make decisions about which shots to keep.  I will be looking for sharpness/focus issues and exposure variation can really mess with how you perceive sharpness.  I will open a shot up in the Develop module and I will have the Grid view on the second monitor.  I can now select shots with the same exposure and choose Auto Sync.  Then a change to one shot will be reflected in all of them.

It used to be that I would select the shots by eye.  Then it occurred to me that the Metadata filter is powerful here.  I select the filter of shutter speed and then I can select each shutter speed in turn.  Now it is easy to select the similar shots and edit together.  This really speeds up the quick edit process.  I know tweak whatever needs tweaking and get everything basically okay.  I won’t bother with detailed editing unless a shot is going to be used for something further.  Now I select all files and, in the Library module, select Render 1-1 Views.  Then I head off to do something else for a while.

When the rendering is done (I don’t try and do anything else while it is underway because, while you can do other Lightroom tasks, everything gets pretty sluggish.  It is easier to wait.  I may even shut Lightroom down and restart it after the rendering is done because it seems to like the chance to clean itself up.  Then I go to the first of the Not Rejects shots.  I have it full screen on the main screen and then zoom to 100% on the second screen.  The Smart Collection is set up to show any file that is not marked as a reject (or all of the other stuff I mentioned earlier) so now I can click through the shots.  If a shot is good, I Right Arrow to the next one.  If it is bad, hit X and it disappears.  Now I can run through the whole shoot and quickly get rid of all shots that are not good, be they unsharp, chopping off a bit of something or just clearly useless.

When this first pass is done, I am now left with a bunch of shots, many of which are very similar.  Since I know they all are basically acceptable, I can now select all the ones that I won’t have a need for and hit X.  Very quickly I am down to a far more manageable number of shots.  Then I can pick which ones I want to do something with.  Hit P for those and they will automatically appear in the Picks Smart Collection and I can come back to them at any time.  If I have shots that will be used for a specific piece, I may create a Collection specifically for that publication and just drag the shots in so I can deal with them at any time.

That pretty much sums up how I handle a shoot.  Some will have pano shots, some will have HDR, occasionally there will be time lapses and often videos.  Sadly, the integration of video between Lightroom and Photoshop is non-existent so I have yet to have a good process for video editing.  Maybe one day Adobe will fix that.  They tempted us by having video in Lightroom but they never took it any further despite the fact that the opening in layers option for stills would be ideal for video editing.  One day…