DOP files deleted while navigating directory (9.3.1 build 36)

DxO PhotoLab
1

I recently noticed some weird behavior with PhotoLab 9 on my Mac Mini. It is so strange that I have a hard time believing it happened the first time but it just happened again so I have to post about.

I have a directory that probably has several thousand files in it that were all shot at one location while I was on a trip. I was scrolling through the files (in PhotoLab) looking for something interesting to edit in PhotoLab and all of a sudden I noticed something changed on the screen. All (or many) markers on photos indicating that they had been processed disappeared. At the same time, I noticed that all of the editing details for these files were gone as well. It was if nothing had ever been changed in the photos.

Since I use a NAS for storing my files, deleted files are simply moved to a separate directory (or trashcan) temporarily. I looked in that location and immediately saw a large number of .dop files had been deleted and moved there. I recovered them by simply dragging all of the files back to the original photo directory.

I did a periodic cleanup of the NAS trash can within the last hour and permanently deleted all of the files that were there.

In the last few minutes I went back to editing photos in this same directory and duplicated this mass deletion of .dop files. Suddenly there were another large group of .dop files in the NAS trashcan. I can recover these files again but it is really weird to see something like this happen while I am just moving through the files in PhotoLibrary.

2

Have you ever noticed such an issue with earlier versions of PL9 or before? How is PL set, does it automatically import and export sidecars?

Meanwhile, I propose you make backups regularly.

3

I think at general if the .dop deleted, than you not lose anything editing, exported state, etc. As its (also) stored in the database.

4

Too me it sounds like something has interrupted or stopped the backup to your NAS in the process of transferring files.

1 Like
5

ā€¦that is the scary part. Therefore, we need to proceed carefully.

As a first step, Iā€˜d make a backup of the database and then uncheck sidecar import and export. After that, Iā€˜d manually export the sidecar of ONE image. If it gets back its edits and metadata, the database seems to have survived. You can then select a bunch of images and export sidecars manually again and again until done.

6

I do have sidecar import and export checked but metadata synchronization is not enabled. I wanted to do some tests on a duplicate directory but I think I have run into some more conflicts with PhotoLab behavior. Since the real information about changes is in the database not the .DOP files, I canā€™t duplicate all the information by just exiting PhotoLab and copying files in the Finder. When I did this, I lost a huge number of image modifications and PhotoLab was forced to generate brand new .DOP files.

But now that I do have all the RAW images in a new location I can try and reproduce my original scenario and try to determine what has happened and if it is really a bug or something I introduced inadvertently. I donā€™t think the fact that .DOP files were unexpectedly deleted is the issue that apparently happens all the time when photos are touched in PhotoLab. I need to verify if the actual changes in the database are lost and how try to understand the exact steps that caused it.

7

Rewriting the sidecars can possibly leave an image without its sidecar for a few seconds, but Iā€™d not expect them to be all gone at onceā€¦ For better control, I set PL to NOT automatically import or export .dop sidecars. I do it manually when I start and end a session.

Also, if (all) my edits were gone, Iā€™d be worried. PhotoLab isnā€™t that good in keeping its database in good shape, but itā€™s not been so wicked as to ā€œremoveā€ my edits yet.

If edits AND .dop sidecars are gone, there is nothing that will save your bacon except a backup.

Iā€™ve posted a few lines about how to force PL to export .dop files. It involves editing a copy of the database. If thatā€™s not your thing, you neednā€™t look for the post(s).

8

This is a bizarre situation. Iā€™d be tempted to suspect one of two things:

  1. macOS Finder. Iā€™ve noticed lately that it can be a real mess when it comes to displaying the truth of what files are where. This includes simply not showing some files, which would fit your situation. It also uses the wrong icons and file type labels. If youā€™re not already, check the contents of the NAS by other means ā€” if a Synology, then with FileStation, otherwise something similar or, last resort, Terminal.
  2. macOSā€™s handling of network shares. Now, I have not had many issues since I got my Synology about a year ago, but file shares to other Macs have been notoriously problematic. One problem I had both with other Macs and the Synology is the inability to delete certain files. Maybe the inverse could also be true. I have a vague recollection of a discussion on a recent Accidental Tech Podcast of someone who had tons of files get suddenly deleted.