Dynamic range is the luminance ratio between the brightest and the darkest objects in a scene, factoring in floor noise and is measured as dB. The human vision system can visually replicate about 150dB, while most current image sensors capture in a range of 60dB to 90dB natively. Many technologies have been developed to attempt to get closer to the range of human vision system. These include dual/triple conversion gain, multi-exposure (LDR images of the same scene taken under different exposure times) and intra-scene methods. While sensor-level HDR approaches have merit, there are trade-offs and all are limited by the amount of dynamic range they can achieve without either slowing down frame rates, lowering resolution or creating unacceptable noise levels and transition area noise and artifacts.
Agnostic Approach with Sensors and Logic
Pinnacle’s agnostic approach to providing Ultra HDR™ Video allows a developer to utilize any applicable combination of low, mid and high-end image sensors and logic, various gain, exposure and scene improvements, at the sensor level and can be used in combined with proprietary frame merge IP Cores. Pinnacle’s merge IP core blocks are capable of 2, 3 and 4 frame merges and are meant to be utilized with Pinnacle’s proprietary LATM IP block and supportive IP cores or as stand-alone IP blocks.
For example, some sensors produce up to 115 dB non-natively, at 1080p/60fps, which may not need further dynamic range improvement for the application, but need Pinnacle’s Locally Adaptive Tone Mapping IP cores for adaptive scene improvement for each frame. Some sensors produce about 65 dB in their native mode and can utilize an added boost in range to 120 dB utilizing Pinnacle’s 4 frame merge, or Pinnacle’s 2 frame merge with no visible artifacts for improved motion capture.
Pinnacle’s IP Block Segmentation
Pinnacle’s 23 proprietary IP Cores related to Ultra HDR™ video and still capture are categorized into 3 main IP blocks, the Ultra HDR™ frame merge block, supportive Ultra HDR™ ICS blocks to the Ultra HDR™ merge block and Ultra HDR™ LATM.
Some IP Cores are designed to be dependent IP’s, supporting Pinnacle’s proprietary Ultra HDR™ ICS (Internal Color Space), but can be made independent and utilized outside Pinnacle’s Ultra HDR™ ICS in other ICS’s by utilizing transforms (direct and reverse).
Use Cases for Ultra HDR™ proprietary Locally Adaptive Tone Mapping
Pinnacle’s Locally Adaptive Tone Mapping (LATM) algorithms can be utilized with Pinnacle’s proprietary Ultra HDR™ 4, 3, or 2 frame merge color data, using LATM IP cores embedded in logic to render tonal reproduction and dynamic range better matched to specific displays output using Pinnacle’s proprietary CCM’s.
Customers and partners can also utilize Pinnacle’s Locally Adaptive Tone Mapping (LATM) algorithms embedded in logic in conjunction with a selective sensor’s WDR mode that already has a relatively wide dynamic range to produce better Ultra HDR™ results than utilizing the sensor alone (sensor dependent), enhancing the tonal range to provide higher quality video.