Indigo camera app for computational photography

The new Adobe Indigo app for iPhone and later for Android provides raw capture using computational photography, encapsulated in DNG file format.

Will DxO pay attention ?

Many of our users prefer to shoot raw, not JPEGs, and they want these raw images to benefit from computational photography. (Some big cameras offer the ability to capture bursts of images and combine them in-camera, but they output a JPEG, not a raw file.) Indigo can output JPEG or raw files that benefit equally from the computational photography strategy outlined here

https://research.adobe.com/articles/indigo/indigo.html

Review published by The Verge
Adobe’s Project Indigo app is making me rethink phone photography | The Verge

I have made a first test, see attached pictures.
Indigo pictures seem less noisy and less artificial, as said.


I dislike the pictures of my iPhone 15 that look artificial and they need at least -20% saturation to be acceptable but it’s too much work ; it would be pleasant to have mass processing in DxO !
Some subjects look fine, such as skin tones, more generally low saturated subjects.

1 Like

These are both iPhone 15 JPEGs, straight out of the phone, one using the promising Project Indigo Camera, the other the native camera, right? As DxO PL is built to edit RAW images, I’m not sure what it might improve here where things are mostly baked in. I do wonder if a HEIF at the Max setting from the native camera would be more to your liking?

With the iPhone 15 you are not able to shoot in ProRaw which would make the better comparison. On the iPhone 15 Pro shooting ProRaw, I find that if I reduce exposure a bit at capture, then reduce or even turn off local tone mapping in post, that the results can be similar to the Indigo DNG RAW output. In fact, detail seems better in the ProRaw using the 1x lens at the 48 MP setting. Indigo is limited to 12 MP at present. I find that noise is rarely an issue for either output.

The catch is still the small sensor. Lots of tricks and multi-image processes are used to improve the picture quality. What is now being added is AI-supported enlargement a la Topaz Gigapixel and AI-supported image analysis and enhancement. This means that the result - which can look good in many cases - is moving further and further away from the original. If people like it that way …

Hoping that future versions of Photolab could process Indigo DNG raw files !

If I was a betting man I would bet DxO will NOT support this Raw format based on endless discussions about DNG and phone support.

The main reason for choosing PhotoLab is because DxO has taken a camera and the one RAW format it is capable of producing and calibrated any necessary corrections for that one RAW format.

But, with all these computational “RAW” formats, there is no base RAW data that can be tested, once and for all cameras. Thus it is not possible to calculate corrections for every possible combination of “RAW” data that might have been computed by the AI, etc in the camera.

2 Likes

With the help of Google Gemini :

Do Indigo’s DNG files retain the sensor’s Bayer matrix data?

YES, according to Adobe Research. The Indigo DNGs are described as being “stored before demosaicking, i.e. 1 color per pixel instead of 3.” This means they contain data similar to a Bayer pattern (or whatever CFA the iPhone uses), but it’s a computationally derived Bayer-like pattern that has benefited from multi-frame integration for improved dynamic range and noise characteristics.

While Indigo DNGs come from iPhones (which DxO doesn’t typically profile in the same way as dedicated cameras), the type of raw data within is confirmed to be undemosaiced. This shifts the challenge from a fundamental incompatibility of data type to how DxO would choose to handle a computationally pre-processed but still undemosaiced raw.

the Adobe Research article directly challenges the premise that there’s “no base RAW data.” For Indigo DNGs, there is a base RAW data – it’s just a multi-frame merged, undemosaiced RAW.

While the DNG data is undemosaiced, it’s not a single-shot undemosaiced RAW. The in-camera merging, alignment, and initial noise reduction mean that the “raw data” presented to DxO is already highly influenced by Adobe’s computational pipeline.

DxO’s optical modules are built on pure, physical measurements of lens aberrations. When frames are merged and potentially slightly aligned in-camera, how do these pre-processing steps interact with DxO’s highly precise lens corrections? It might necessitate DxO profiling Adobe’s Indigo pipeline on a specific iPhone model rather than just the iPhone’s raw sensor output.

What would it take for DxO to process Adobe Indigo DNG files?

Given the updated understanding that Indigo DNGs contain undemosaiced data (albeit merged):

  1. DNG Input Support: DxO PhotoLab already supports various DNG types. It would need to ensure it can parse and correctly interpret the specific metadata and structure of Indigo DNGs.
  2. DeepPRIME/XD Integration: This is the big win. Since the data is undemosaiced, DxO’s DeepPRIME and DeepPRIME XD (their state-of-the-art noise reduction and demosaicing) could potentially be applied directly to the Indigo DNGs, potentially offering further quality improvements over the in-camera processing, especially in areas like fine detail and noise texture. This would be a strong selling point.
  3. Lens Module Adaptation/Profiling: This is where the challenge lies. DxO’s strength is optical corrections. While the Indigo DNG is undemosaiced, the multi-frame merging might alter the perceived optical characteristics in a way that makes DxO’s standard lens modules less perfectly applicable. They might need to:
  • Develop “Indigo-specific” optical modules that account for the pre-processing. This would be a massive undertaking per iPhone model/lens.
  • Focus on Post-Demosaicing Tools: Alternatively, DxO could process the undemosaiced data with DeepPRIME/XD, but then rely more on their general image enhancement tools (Smart Lighting, ClearView Plus, local adjustments) that work on the now-fully-processed RGB image, rather than their ultra-precise optical corrections, which might be redundant or less effective if the lens corrections are already handled by Indigo’s pre-processing.
  1. Integration of Embedded Profiles/Looks: Adobe embeds SDR/HDR profiles within the Indigo DNG. For a seamless user experience, DxO would ideally need to read these profiles and allow users to select or disable them, similar to how Lightroom handles them.

Final Thoughts:

The information from Adobe Research significantly refines our understanding. Project Indigo’s DNGs are a fascinating hybrid: they are computationally enhanced but manage to retain the undemosaiced data, making them potentially compatible with DxO’s core demosaicing and noise reduction strengths.

The primary hurdle for DxO would then shift from “can we even process this data type?” to “how do we adapt our precise optical profiling and ensure our tools add significant value on top of Adobe’s already sophisticated in-camera computational processing?” It’s a strategic decision for DxO: whether to expand their rigorous profiling methodology to encompass these dynamic computational pipelines in addition to static optics.

My enthusiasm for the Adobe Project Indigo camera app is more tempered. It’s still very much a beta, as Adobe is quick to say. Additionally, I’ve been unable as yet to find any independent, authoritative source of information about the Indigo DNG RAW format. There are a couple of Adobe publications, then endless AI-assisted rehashes of same with little or no new information presented. The Indigo DNG RAW format in my own testing does exhibit characteristics of a RAW file, e.g., ExifTool gives the photometric interpretation as a color filter array. At other times, it acts like a simple linear DNG, albeit one with a boatload of embedded information, including local tone maps. The encouraging news is that apps like Lr and Nitro seem to have no problem opening these files and editing them there seems easy-peasy.