Canon Develops A New Wide Dynamic Range Sensor With “area-specific exposure”

Dynamic Range

It seems Canon is actively developing a new imaging sensor with wide dynamic range, according to news coming from Japan.

Newswitch (Nikkan Kogyo Shimbun) posted an interesting article about a new Canon imaging sensor with wide dynamic range and featuring a technology called “area-specific exposure”.

Canon has developed a new complementary metal-oxide-semiconductor (CMOS) sensor product (pictured) suitable for surveillance applications. The dynamic range, which is the range of brightness and darkness that can be expressed, is 148 decibels, which is the highest level in the industry for surveillance cameras, according to the company. High-quality images can be obtained even in environments with a large difference in brightness. Aiming for early commercialization.

The developed CMOS sensor is a layered type with two layers: pixels that convert external light into electrical signals and a central processing unit (CPU) that performs calculations. Compared to when pixels and CPUs are placed on the same substrate, more CPUs and dedicated circuits can be mounted. Processing power has increased, making it easier to shoot high-precision images even when the subject is moving.

When shooting in an environment with a large difference in brightness, normally multiple images with different exposure times are combined and processed to correct the difference in brightness. However, since images with different exposure times are combined, there was the problem that the moving subjects overlapped several times and appeared blurred.

The CMOS sensor developed by Canon this time divides the screen finely and adopts “exposure by area” that changes the exposure conditions for each area. Since no compositing process is required, there is no need to worry about blurring the subject. It can contribute to improving the performance of surveillance cameras by, for example, simultaneously recognizing the vehicle license plate and driver’s face at the entrance/exit of an underground parking lot.

The metal oxide semiconductor (CMOS) imaging sensor we are talking here is first and foremost for surveillance applications. Don’t expect it in your next Canon consumer mirrorless camera. The imaging sensor has two layers: pixels that convert external light into electrical signals and a central processing unit (CPU) that performs calculations. And here comes the trick used by Canon:

When shooting in an environment with a large difference in brightness, normally multiple images with different exposure times are combined and processed to correct the difference in brightness. However, since images with different exposure times are combined, there was the problem that the moving subjects overlapped several times and appeared blurred. The CMOS sensor developed by Canon this time divides the screen finely and adopts “exposure by area” that changes the exposure conditions for each area. Since no compositing process is required, there is no need to worry about blurring the subject.

Cool, kudos Canon.

And here is the press release:

Canon develops CMOS sensor for monitoring applications with industry-leading dynamic range, automatic exposure optimization function for each sensor area that improves accuracy for recognizing moving subjects

TOKYO, January 12, 2023—Canon Inc. announced today that the company has developed a 1.0-inch, back-illuminated stacked CMOS sensor for monitoring applications that achieves an effective pixel count of approximately 12.6 million pixels (4,152 x 3,024) and provides an industry-leading1 dynamic range of 148 decibels2 (dB). The new sensor divides the image into 736 areas and automatically determines the best exposure settings for each area. This eliminates the need for synthesizing images, which is often necessary when performing high-dynamic-range photography in environments with significant differences in brightness, thereby reducing the amount of data processed and improving the recognition accuracy of moving subjects.

With the increasingly widespread use of monitoring cameras in recent years, there has been a corresponding growth in demand for image sensors that can capture high-quality images in environments with significant differences in brightness, such as stadium entrances and nighttime roads. Canon has developed a new sensor for such applications, and will continue to pursue development of sensors for use in a variety of fields.

The new sensor realizes a dynamic range of 148 dB—the highest-level performance in the industry among image sensors for monitoring applications. It is capable of image capture at light levels ranging from approximately 0.1 lux to approximately 2,700,000 lux. The sensor’s performance holds the potential for use in such applications as recognizing both vehicle license plates and the driver’s face at underground parking entrances during daytime, as well as combining facial recognition and background monitoring at stadium entrances.

In order to produce a natural-looking image when capturing images in environments with both bright and dark areas, conventional high-dynamic-range image capture requires taking multiple separate photos under different exposure conditions and then synthesizing them into a single image. Because exposure times vary in length, this synthesis processing often results in a problem called “motion artifacts,” in which images of moving subjects are merged but do not overlap completely, resulting in a final image that is blurry. Canon’s new sensor divides the image into 736 distinct areas, each of which can automatically be set to the optimal exposure time based on brightness level. This prevents the occurrence of motion artifacts and makes possible facial recognition with greater accuracy even when scanning moving subjects. What’s more, image synthesizing is not required, thereby reducing the amount of data to be processed and enabling high-speed image capture at speeds of approximately 60 frames-per-second3 (fps) and a high pixel count of approximately 12.6 million pixels.

Video is comprised of a series of individual still images (single frames). However, if exposure conditions for each frame is not specified within the required time for that frame, it becomes difficult to track and capture images of subjects in environments with subject to significant changes in brightness, or in scenarios where the subject is moving at high speeds. Canon’s new image sensor is equipped with multiple CPUs and dedicated processing circuitry, enabling it to quickly and simultaneously specify exposure conditions for all 736 areas within the allotted time per frame. In addition, image capture conditions can be specified according to environment and use case. Thanks to these capabilities, the sensor is expected to serve a wide variety of purposes including fast and highly accurate subject detection on roads or in train stations, as well as stadium entrances and other areas where there are commonly significant changes in brightness levels.

Example use case for new sensor

  • Parking garage entrance, afternoon: With conventional cameras, vehicle’s license plate is not legible due to whiteout, while driver’s face is not visible due to crushed blacks. However, the new sensor enables recognition of both the license plate and driver’s face.
  • The new sensor realizes an industry-leading high dynamic range of 148 dB, enabling image capture in environments with brightness levels ranging from approx. 0.1 lux to approx. 2,700,000 lux. For reference, 0.1 lux is equivalent to the brightness of a full moon at night, while 500,000 lux is equivalent to filaments in lightbulbs and vehicle headlights.

Technology behind the sensor’s wide dynamic range

  • With conventional sensors, in order to produce a natural-looking image when capturing images in environments with both bright and dark areas, high-dynamic-range image capture requires taking multiple separate photos under different exposure conditions and then synthesizing them into a single image. (In the diagram below, four exposure types are utilized per single frame).
  • With Canon’s new sensor, optimal exposure conditions are automatically specified for each of the 736 areas, thus eliminating the need for image synthesis.

Technology behind per-area exposure

  • Portion in which subject moves is detected based on discrepancies between first image (one frame prior) and second image (two frames prior). ((1) Generate movement map).
  • In first image (one frame prior) brightness of subject is recognized for each area4 and luminance map is generated (2). After ensuring difference in brightness levels between adjacent areas are not excessive ((3) Reduce adjacent exposure discrepancy), exposure conditions are corrected based on information from movement map, and final exposure conditions are specified (4).
  • Final exposure conditions (4) are applied to images for corresponding frames.

[via digicame-info]

Canon EOS R7 Dynamic Range Figures Published

Canon Eos R7 Review Canon Firmware Updates

Curious to learn about the Canon EOS R7 dynamic range? We have you covered.

At a glance:

  • 32.5MP APS-C CMOS Sensor
  • Dual Pixel CMOS AF II
  • 4K60 10-Bit Video, HDR-PQ & C-Log 3
  • 30 fps E. Shutter, 15 fps Mech. Shutter
  • 2.36m-Dot OLED EVF
  • 1.6m-Dot Vari-Angle Touchscreen LCD
  • Sensor-Shift 5-Axis Image Stabilization
  • Dual UHS-II Memory Card Slots
  • Multi-Function Shoe, Wi-Fi and Bluetooth

Photon to Photo posted the Canon EOS R7 dynamic range figures. Looks good.

More Canon EOS R7 information, hands-on reviews and more is listed here.

Canon EOS R7:

America: B&H Photo, Adorama, Amazon USA, Amazon Canada, Canon Canada, Canon USA
Europe & UK: Amazon DE, Amazon UK, Amazon IT, Canon IT, WEX Photographic, Canon FR, Canon UK, Canon DE

Click here to open the rest of the article

Preliminary, Non Scientific Tests Suggest Canon’s New 32MP Sensor Improves On Dynamic Range

Canon Eos 90d Canon Aps-c Firmware Dynamic Range

It seems Canon’s claim they managed to improve dynamic range while raising the resolution of their latest APS-C sensor is not wrong.

Fred Miranda forum user cgarcia did some tests with sample images from DPReview to compare dynamic range figures of the new Canon EOS 90D (32MP) and the Canon EOS 80D (24MP).

Canon EOS 90D – ISO 100:

  • DR at 32MP: 12.468
  • DR at 8MP: 13.480 (+1.012)
  • read noise: 2.80125

Canon EOS 80D – ISO 100:

  • DR at 24MP: 12.435 EV
  • DR at 8MP: 13.2343 (+0.7993)
  • read noise: 2.86601

As you can see, there is a small improvement over the EOS 80D.

cgarcia also learned that the dynamic range improves much more at higher ISO settings (compared to the EOS 80D). The image below shows that a higher ISO settings the DR of the EOS 90D improves continously.

Dynamic range comparison between Canon EOS 90D and Canon EOS 80D at different ISO settings (image © cgarcia)

These figures look pretty good. However, keep in mind this is a non scientific test. To be sure we have to wait for further analysis of the performance of Canon’s new 32MP APS-C sensor. Never the less, it appears Canon managed to deliver a quite amazing image sensor.

Canon’s new 32MP APS-C sensor is featured on the brand new Canon EOS 90D and Canon EOS M6 Mark II.

Canon EOS 90D:

America: B&H Photo, Adorama, Amazon USA, Amazon Canada, Canon Canada, Canon USA
Europe & UK: Amazon DE, Amazon UK, Amazon IT, Canon IT, WEX Photographic, Canon FR, Canon UK, Canon DE

Canon EOS M6 Mark II:

America: B&H Photo, Adorama, Amazon USA, Amazon Canada, Canon Canada, Canon USA
Europe & UK: Amazon DE, Amazon UK, Amazon IT, Canon IT, WEX Photographic, Canon FR, Canon UK, Canon DE

Canon Cameras Might Get An Expanded Dynamic Range Thanks To Dual Pixel AF Sensors

Dual Pixel AF

Image sensors with Dual Pixel Autofocus on board can be used to obtain expanded dynamic range, a patent application suggests.

Canon patent application 2019-129491 (Japan) discusses technology and methods for an image sensor output with increased dynamic range. As you probably know, DPAF splits a pixel in two (see here how it works). The idea is that the two half pixel can be amplified at different levels while being read and processed at the same moment. Think about it as “dual ISO”.

More Canon patent applications are listed here. Some particularly interesting patent applications we think might get into production are these:

Canon EOS RP vs EOS R vs EOS 6D Mark II Dynamic Range Comparison

Canon Eos Rp

FroKnowsPhoto (aka Jared Polin) compared the dynamic range of the Canon EOS RP, EOS R and EOS 6D Mark II.

I never cared much about dynamic range but it seems t’s a hot topic for a lot of people out there. The raw files used by Jared Polin can be downloaded here.

In a recent interview with Canon execs, the company confirmed that the EOS RP has the same sensor as the EOS 6D Mark II, with the exception of different microlenses.

Pre-order the EOS RP in USA:

  • EOS RP Body with EG-E1 Extension Grip and Canon Mount Adapter on sale at $1299 Amazon | Adorama | B&H Photo
  • EOS RP with EF 24-105mm f/3.5-5.6 IS STM, EG-E1 Extension Grip and Canon Mount Adapter on sale at $1699 Amazon | Adorama | B&H Photo
  • EOS RP with RF 24-105mm f/4L IS, EG-E1 Extension Grip and Canon Mount Adapter on sale at $2199 Amazon | Adorama | B&H Photo

Pre-order the EOS RP in UK: Park Cameras

Pre-order the EOS RP in Germany: Amazon DE | Canon Germany

World-wide pre-order links:

America: B&H Photo, Adorama, Amazon USA, Amazon Canada, Canon Canada, Canon USA
Europe & UK: Amazon DE, Amazon UK, Amazon IT, Canon IT, WEX Photographic, Canon FR, Canon UK, Canon DE


Who Has Better Image Quality and Dynamic Range: Nikon Z6, Nikon Z7, Canon EOS R or Sony a7 III?

Dynamic Range

Tony & Chelsea Northrup investigate which camera has the best image quality and dynamic range. It’s Nikon Z6 vs Nikon Z7 vs Sony a7 III vs Canon EOS R. Enjoy, and if you want then let us know what you think.