AI masks not working well on simple selection

Take a simple colour circle…

Select the basic AI mask tool and hover it over the red sector…

See how part of the purple sector is also selected and cannot be got rid of.

Click the mouse on the red sector…

See how part of the purple sector is even more selected.

Desaturate the masked area…

See how the purple sector is still partially affected.


The only way I could get this clean with one mask was to carefully position a “zone”, which is only barely bigger the the red sector…

I know there is a learning curve but I could have done the same thing, a lot easier, with three clicks and a slider in the Colour Wheel…


Now, I read somewhere that a mask can be copied from one image to another and it would adjust “intelligently” to the new position of the masked area…

Ah well, back to the drawing board.

7 Likes

Thanks for synthetic example. That’s strange indeed.

I could “explain” that, if micro/fine-contrast, selective tones, smartlighting, or clearview were used, but they weren’t?

Do you mean ‘add an area’ AI mask working mode, as it’s called in the manual?

That’s why I use it quite often, resorting to Hue mask only if brushing the mask is required or special corrections are needed. Btw, it may be surprising how spiky hue histograms often look (e.g. in darktable).

@Joanna, as you and others have discovered, AI masking, as implemented in PL 9, has usability limitations. And, as you are also aware, there are multiple ways to mask objects in PhotoLab 9,

I don’t think any of the mask types, used individually, are the perfect solution for every set of conditions. However, when used singularly and in combination with each other, I think we can now successfully apply masks in ways that many of PhotoLab’s competitors cannot. This often requires much more effort than a single click, but I don’t mind putting in the extra work to get the exact results I want.

Mark

wonder if other masking struggle with that use case example LR etc tricky one

I don’t think you can draw any conclusions from this synthetic sample. The AI algorithms will only work well with images that are similar to the data that it has been trained on, and I think your synthetic sample differs quite a lot to a typical training dataset of photographic images, so it is no surprise it struggles. That is a limitation of current AI algorithms.

3 Likes

Sure, but still it’s funny/interesting to see how it “thinks”.

I guess AI masks were trained on photos made by good photographers, which had some typical masking case usage. It may take few months before one gets a good “feeling” about where and for what purpose they can be effective, learn all their weak points (e.g. halos and sharp edges being standard masking problems). But they won’t “fix” most of bad photos and often old masks will do the job better. I’m not a fan of local adjustments and I use them very sparingly, but still found AI masks useful in several cases, e.g. for taming busy bokeh. Speed of edits is important for me, so that I can still “see” my target vision.

This! I would stake money on there being no flat-colour Venn diagrams in the training data.

2 Likes

@Joanna , thank you for sharing this with us. This is an additional piece of experience with masking. I guess in post processing it is necessary to choose the best option pic by pic.

Very likely that’s true, but there is a little elephant in the room - AI Object Selection.

That one isn’t searching for a person, sky, or animal, it’s searching whatever the likely object is.

Perhaps a “fine tuning” slider might help, that sharpens up the criteria by which it selects an object (I guess by chroma/luma/contrast borders to an object).

That should help it to work out that purple is not red, if you’re strict enough with it.

Did you export the images (with edited masks)? I would be interested to see the masks are exactly the same on export or not, as it takes so long to export, like it is recalculating them with more refinement.

I thought I would try out a couple of the other “magic” masks.

Here’s what happens with the Auto-brush tool…

Notice the lack of definition of the selection between the red and purple segments. This is still not as effective as using the Colour Wheel. Unfortunately, that would be a global selection and all sorts of other stuff in more complex images then get selected.

1 Like

The Tint mask though is very accurate and, when you think about it, is basically doing the same as the Colour Wheel but locally…

2 Likes

Even the Luminance mask is pretty accurate, even with the possibility of having two colours with the same luminance value…

1 Like

For this kind of thing it’d be nice to be able to feather the selection very slightly.

I’ve recently been editing some photos of ducks and - depending on the method used - found a very slight colour line of just a few pixels against some edges of (the duck). There was no rapid way to adequately and neatly select what was needed to remove that.

Here’s an interesting combination of two masks…

… or, if I invert the graduated mask…

Hmmm. Slowly getting the hang of this stuff. It would be helpful if others could post their examples, especially of combined masks

This was the case even before the AI tools.

interestingly though, the Control Point now has a diffusion slider…

But a Control Line really needs fixing around high contrast edges…

And I just rechecked Tint Mask to find that, on closer examination, it also, to a lesser extent, misses a line around the selection…

…so it does, when did that happen?! That’s actually great for reigning in the weird overspread that CP’s previously suffered from (here’s an example with diffusion set to 100, as I believe is the default before this option existed):

Note the mask impacting way beyond its supposed border.

Now here’s the exact same thing, with diffusion set to 40. There’s still some very slightly impact beyond the border, but it’s so much better.

1 Like

Which was still trained on real photos. Auto-brush is the more simplistic “find edges” tool.

I am finding the AI Object selection very effective for lots of wildlife photos. AI dropdown list for subject types still causes lots of issues although a bit better with the latest NVIDIA drivers.

I still can’t understand why PL continuously reports errors and well DxO cannot just remove the error and continue without having to restart PL.

1 Like

So, are you saying it won’t cope with my (in)famous, real world, lobster image?