24th week of 2022 patent applcation highlights part 83 |
Patent application number | Title | Published |
20220191410 | OPTICAL DEVICE FOR A THERMAL SENSOR AND A HYBRID THERMAL SENSOR - An imaging device includes: a sensor to detect a first target spectrum, the first target spectrum corresponding to a thermal imaging region of an infrared (IR) spectrum; and an optical device to transmit external light to the sensor, the optical device including: a substrate; and a plurality of nanostructures on the substrate, and to collimate at least the first target spectrum in the external light on the sensor. The plurality of nanostructures are spaced apart from each other, and at least one of the plurality of nanostructures has a different geometric size from that of another. | 2022-06-16 |
20220191411 | SPECTRAL IMAGE CAPTURING USING INFRARED LIGHT AND COLOR LIGHT FILTERING - In some aspects, a spectral image capturing device may receive, from a filter array, visible light and infrared light, wherein the filter array includes a quantity of color filters to block the infrared light and pass the visible light and a quantity of infrared filters to block the visible light and pass the infrared light. The spectral image capturing device may produce, using an image sensor that includes an array of pixel sensors, a spectral image based at least in part on the visible light and the infrared light passed by the filter array. Numerous other aspects are provided. | 2022-06-16 |
20220191412 | IMAGE SENSOR AND OPERATION METHOD OF THE SAME - Provided is an operation method of an image sensor including a plurality of pixels, the operation method including transmitting a first output voltage of a first pixel to a first amplifier, transmitting the first output voltage to a second amplifier by controlling a first switch connected to the first pixel, transmitting a second output voltage of a second pixel to be binned with the first pixel to the second amplifier by controlling a second switch connected to the second pixel, and outputting selectively one of a first output of the first amplifier and a second output of the second amplifier based on an illuminance of an environment in which the image sensor operates. | 2022-06-16 |
20220191413 | Systems, Devices, And Methods for Pixel Frequency Filtering for an Event Camera - A technology is described for pixel frequency filtering for event cameras. An example of the technology can include receiving events representative of changes in brightness detected by a pixel in a pixel array included in the event camera, tracking a number of event sign transitions that occur within a defined time window, determining that the number of event transitions corresponds to an event transition frequency, and allowing the events generated by the pixel to be output from the event camera. | 2022-06-16 |
20220191414 | IMAGE SENSOR AND IMAGING DEVICE - An imaging device having first and second pixels is described. The first pixel includes a first transfer transistor, a first reset transistor, a first amplifier transistor and a first select transistor. The second pixel includes a first photoelectric conversion element, a second transfer transistor, a second reset transistor, a second amplifier transistor and a second select transistor. | 2022-06-16 |
20220191415 | MATRIX DETECTOR WITH REDUCED ODD/EVEN EFFECT - A matrix-array detector having: an array of pixels arranged in a matrix along rows and down columns, each pixel for generating a signal according to a physical effect; a signal generator for generating two clock signals that are phase-shifted relative to one another; and a row-addressing device including a shift register, the shift register including a plurality of stages arranged in a cascade, each stage for receiving, in alternation from one stage to another, one clock signal from the two clock signals, and delivering an intermediate output signal that takes a high value and a low value allowing the pixels of the row to be activated and to be deactivated, respectively. The signal generator is also for generating a third clock signal. The addressing device further includes a plurality of isolation circuits, each isolation circuit connected between each stage and the corresponding row of the matrix, for receiving the third clock signal, the isolation circuit also for delivering a selection signal for selecting the corresponding row of the matrix when the intermediate output signal and the third clock signal are at the high level. | 2022-06-16 |
20220191416 | PIXEL LEVEL EXPANDABLE MEMORY ARRAY FOR VOLTAGE DOMAIN GLOBAL SHUTTER - A sample and hold (SH) circuit includes a pixel level connection coupled to a pixel cell. A reset row transistor is coupled between a first supply voltage and the pixel level connection. A source follower row transistor having a gate is coupled to the pixel level connection. A row select row transistor is coupled between the source follower row transistor and a bitline. A first storage transistor is coupled to the pixel level connection. A first storage device is coupled between the first storage transistor and a second supply voltage. A second storage transistor is coupled to the pixel level connection. A second storage device is coupled between the second storage transistor and the second supply voltage. | 2022-06-16 |
20220191417 | SOLID-STATE IMAGING DEVICE AND IMAGING DEVICE - To improve image quality. A solid-state imaging device according to an embodiment includes: a plurality of unit pixels ( | 2022-06-16 |
20220191418 | IMAGE SENSOR - An image sensor includes a pixel array including a plurality of pixels; and processing circuitry, wherein each of the plurality of pixels includes: a photodiode; a floating diffusion node configured to integrate photocharge generated by the photodiode; a first capacitor configured to store charge corresponding to a voltage of the floating diffusion node which is reset; a first sampling transistor one terminal of which is connected to the second node, and another terminal of which is connected to the first capacitor, being configured to sample charge to the first capacitor; a second capacitor configured to store charge corresponding to the voltage of the floating diffusion node at which the photocharge has been integrated; and a second sampling transistor, one terminal of which is connected to the second node, and another terminal of which is connected to the second capacitor, being configured to sample charge to the second capacitor. | 2022-06-16 |
20220191419 | DIGITAL PIXEL SENSOR AND ANALOG DIGITAL CONVERTER - A digital pixel sensor for correcting and reducing a mismatch between a pixel and an analog digital converter provided. The digital pixel sensor includes a pixel array including a plurality of pixels; and a bank disposed on the pixel array. The bank includes: a plurality of comparators disposed on the plurality of pixels and configured to compare each of a plurality of pixel signals output from the plurality of pixels with a reference signal to output a plurality of comparison result signals; and a counter connected to the plurality of comparators, and configured to receive the plurality of comparison result signals and latch count code based on the plurality of comparison result signals. | 2022-06-16 |
20220191420 | IMAGE SENSOR - An image sensor includes a pixel array; a logic circuit configured to convert an image signal generated from the pixel array during a first period into image data; and a memory. The image data may be written in the memory during a second period, of which at least a portion overlaps the first period. The logic circuit may write dummy data in the memory during a third period overlapping the first period and not overlapping the second period. | 2022-06-16 |
20220191421 | IMAGE PICKUP ELEMENT AND IMAGE PICKUP DEVICE - An imaging element includes: an imaging unit in which a plurality of pixel groups including a plurality of pixels that output pixel signals according to incident light are formed, and on which incident light corresponding to mutually different pieces of image information is incident; a control unit that controls, for each of the pixel groups, a period of accumulating in the plurality of pixels included in the pixel group; and a readout unit that is provided to each of the pixel groups, and reads out the pixel signals from the plurality of pixels included in the pixel group. | 2022-06-16 |
20220191422 | CTIA IMAGE SENSOR PIXEL - An image sensor and pixel circuit therefor includes a photoelectric conversion device; an amplifier including a first input terminal connected to the photoelectric conversion device, and an output terminal; a capacitor disposed between the first input terminal and the output terminal; and a reset switch network disposed between the first input terminal and the output terminal in parallel with the capacitor, the reset switch network including at least a first reset transistor, a second reset transistor, and a third reset transistor. | 2022-06-16 |
20220191423 | DIGITALLY-CALIBRATED CTIA IMAGE SENSOR PIXEL - A pixel circuit includes a photoelectric conversion device; an amplifier including a first amplifier transistor and a second amplifier transistor connected in series between a first voltage and a second voltage, wherein a gate terminal of the first amplifier transistor is connected to the photoelectric conversion device; a feedback capacitor connected between a first current terminal of the first amplifier transistor and the photoelectric conversion device; a first reset switch connected between the gate terminal of the first amplifier transistor and an anode voltage; and a second reset switch connected between a first current terminal of the second amplifier transistor and a gate terminal of the second amplifier transistor. | 2022-06-16 |
20220191424 | IMAGING DEVICE - An imaging device includes: a solid-state imaging element having a plurality of pixel cells arranged in a matrix; and a signal processing part configured to process a detection signal outputted from each of the pixel cells. The pixel cells each include an avalanche photodiode and output a voltage corresponding to a count number of photons received by the avalanche photodiode as the detection signal. The signal processing part includes a variation calculation part configured to calculate a variation between the pixel cells in the detection signal outputted from each of the pixel cells, and a correction calculation part configured to correct the detection signal outputted from each of the pixel cells, on the basis of the variation calculated by the variation calculation part. | 2022-06-16 |
20220191425 | DISPLAY SYSTEM, DISPLAY METHOD, AND DISPLAY APPARATUS - A display system includes a conversion apparatus converting video luminance including a luminance value in a first luminance range and a display apparatus connected thereto and displaying the video. The conversion apparatus includes a first acquisition unit, a first luminance converter, a second luminance converter, a quantization converter, and an output unit outputting a third luminance signal to the display apparatus. The display apparatus includes: a second acquisition unit acquiring the third luminance signal and setting information indicating display settings recommended to the display apparatus in display of the video; a display setting unit setting the display apparatus, using the setting information; a third luminance converter converting a third code value indicated by the third luminance signal into a second luminance value compatible with a second luminance range, using the setting information; and a display controller displaying the video on the display apparatus based on the second luminance value. | 2022-06-16 |
20220191426 | VIDEO FRAME PULLDOWN BASED ON FRAME ANALYSIS - The described technology is directed towards generating a new video image sequence (e.g., for playback at 30 frames per second) based on an existing video image sequence (e.g., originated for playback at 24 frames per second). The technology is based on processing frames, e.g., adjacent pairs of frames in a four-frame sequence, to obtain candidate frames for selecting a similar candidate frame to insert into the original sequence to create the new sequence (e.g., a five-frame sequence). Aspects include selecting a repeated frame to insert or creating a new frame from existing frames to insert, to generate the new sequence based on a difference/scoring comparison. | 2022-06-16 |
20220191427 | AUDIO/VIDEO DEVICE WITH VIEWER - An audio/video (A/V) device may include or accommodate a viewer through a barrier. For example, an A/V device may include a first component for installation on an exterior surface of a door, a second component for installation on an interior surface of the door, a viewer that extends through an opening in the door, and a flexible connector that electrically couples the first component and the second component. The A/V device may enable use of an existing hole in the door as part of a door viewer, while also providing the functionality of an A/V device. For example, the A/V device may be configured to receive an input using a button on the first component, generate image data using a camera on the first component, and send the image data to a network device. | 2022-06-16 |
20220191428 | INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND PROGRAM - An information processing apparatus includes a reception unit that receives data from a communication destination, an output unit that outputs the received data, a sensor that senses a first space in which the output unit is arranged, a transmission unit that transmits sensing data obtained by the sensing to the communication destination, and a control unit that performs control to present an event that is a cause of cognitive dissonance to the output unit, based on at least the sensing data of a user in the first space, when the user has the cognitive dissonance. | 2022-06-16 |
20220191429 | METHOD FOR ENABLING SYNTHETIC AUTOPILOT VIDEO FUNCTIONS AND FOR PUBLISHING A SYNTHETIC VIDEO FEED AS A VIRTUAL CAMERA DURING A VIDEO CALL - One variation of a method for enabling autopilot functionality during a video call includes, during an operating period: receiving a sequence of frames from a camera in a first device; detecting a face, of a first user, in the sequence of frames; generating a sequence of facial landmark containers representing facial actions of the face of the first user; transmitting the sequence of facial landmark containers to a second device for combination with a look model to generate a first synthetic image feed depicting facial actions of the first user; and detecting a trigger event. The method also includes, during an autopilot operating period, entering autopilot mode; retrieving a prerecorded autopilot sequence of facial landmark containers from a memory; and transmitting the prerecorded autopilot sequence of facial landmark containers to the second device for combination with the look model to generate a second synthetic image feed depicting predefined facial actions. | 2022-06-16 |
20220191430 | SYSTEMS AND METHODS FOR APPLICATION OF CONTEXT-BASED POLICIES TO VIDEO COMMUNICATION CONTENT - The disclosed invention provides methods supporting systems that processes video communication(s) provided by an organization subject to internal or external regulations such as a specific financial services firm or a specific consumer product goods company. In various embodiments, video content is analyzed through a pipeline process of multiple extraction scripts, programs, and/or services and processes the content for participant likeness through facial recognition, voice recognition, and voice-to-text and stores the output in a normalized, searchable data store. A policy analysis is performed based on the stored data and external regulatory compliance, internal rules such as acceptable use policies, community-based regulations, or any combination thereof, to determine a risk score. | 2022-06-16 |
20220191431 | GENERATING AN ALPHA CHANNEL - A method for generating alpha channel information related to a person, the method may include generating the alpha channel information related to the person by an alpha channel neural network; wherein the alpha channel machine learning process is trained using ground truth alpha channel information that is associated with background information; wherein the ground-truth alpha channel information is generated by: obtaining input images of the person; wherein each image comprises the person and an arbitrary background; repeating, for each input image of the input images, converting the input image, by a portrait matting predictor, to (a) a first colored background image that comprises the person and a background of a first color, and (b) a second colored background image that comprises the person and a background of a second color; wherein the first color differs from the second color. | 2022-06-16 |
20220191432 | FOOD MONITORING APPARATUS, REFRIGERATOR INCLUDING THE SAME, AND OPERATING METHOD THEREOF - Provided is a food monitoring apparatus including at least one light source configured to selectively radiate light of a first wavelength band and light of a second wavelength band that is different from the first wavelength band to food, at least one image sensor configured to obtain a visible image of the food and a hyperspectral image of the food based on light scattered, emitted, or reflected from the food, and at least one processor configured to obtain first information of the food based on the visible image, and to obtain second information of the food based on the first information and the hyperspectral image. | 2022-06-16 |
20220191433 | MOBILE VIDEO SURVEILLANCE RECORDING SYSTEM - The video recording system comprises a video recorder and one or more cameras which is specially designed to record video on the exterior and interior of a locomotive. The system is capable of withstanding the railroad environment, and has been designed to maximize safety and to minimize liability. The video recording system is capable of recording video on at least two drives (same video or different video on at least two drives) thereby creating redundancy in case one of the videos is unclear and/or damaged. | 2022-06-16 |
20220191434 | SURVEILLANCE SYSTEM WITH FIXED CAMERA AND TEMPORARY CAMERAS - A surveillance system including a fixed camera and one or more temporary cameras and a control means coupled to the fixed camera and the one or more temporary cameras is disclosed. The control means is configured to extend coverage of the fixed camera using the one or more temporary cameras coupled to the fixed camera. Each of the one or more temporary cameras includes one or more sensors and is configured to be deployed and adjusted based on sensor data obtained from the one or more sensors of the one or more temporary cameras and from one or more fixed camera sensors co-located with the fixed camera. | 2022-06-16 |
20220191435 | SURVEILLANCE SYSTEM WITH FIXED CAMERA AND TEMPORARY CAMERAS - A surveillance system including a fixed camera and one or more temporary cameras and a control means coupled to the fixed camera and the one or more temporary cameras is disclosed. The control means is configured to extend coverage of the fixed camera using the one or more temporary cameras coupled to the fixed camera. Each of the one or more temporary cameras includes one or more sensors and is configured to be deployed and adjusted based on sensor data obtained from the one or more sensors of the one or more temporary cameras and from one or more fixed camera sensors co-located with the fixed camera. | 2022-06-16 |
20220191436 | COMMUNICATION SYSTEM AND COMMUNICATION METHOD - A comnunication system includes a transmission terminal and a reception terminal. One of the transmission terminal and the reception terminal includes a processor. The processor is configured to calculate an adjustment value indicating a difference between an imaging cycle and a display cycle. The processor is configured to cause the imaging cycle and the display cycle to match each other by adjusting a signal generator on the basis of the adjustment value. A connection history in which adjustment information and identification information of a communicator are associated with each other is recorded on a recording medium. The processor is configured to adjust the signal generator on the basis of the adjustment value indicated by the adjustment information when the first communicator and the second communicator connect to each other again. | 2022-06-16 |
20220191437 | VEHICLE ELECTRONIC DEVICE CONTROL DEVICE, VEHICLE ELECTRONIC DEVICE, VEHICLE CONTROL METHOD, AND COMPUTER-READABLE STORAGE MEDIUM - A vehicle electronic device control device includes a position information acquisition unit configured to acquire position information of a current position of a vehicle; an area identification unit configured to identify an area corresponding to the current position of the vehicle based on the position information acquired by the position information acquisition unit and map information including information for identifying a border of a given area on a map; and a determination unit configured to determine, based on a determination table in which control on a function of a vehicle electronic device is specified for each area, control on a function of the vehicle electronic device in the area of the vehicle identified by the area identification unit. | 2022-06-16 |
20220191438 | CAPSULE ENDOSCOPE WITH A DYNAMIC ADJUSTABLE COLOR ILLUMINATION SPECTRUM - A capsule endoscope device, system and method for dynamically adjusting a color illumination spectrum. A plurality of different color groups of LEDs may emit light, recorded by an image sensor, corresponding to a plurality of different respective wavelength subranges. A driving circuit may send a driving current to independently activate each different color group of LEDs during entirely or partially non-overlapping time pulses. A single color group of LEDs is independently activated at any one time, and the plurality of different color groups of LEDs are sequentially activated in successive time pulses to simulate a white light or multi-color illumination spectrum over a plurality of the time pulses. The activation pattern of the color groups of LEDs may be dynamically adjusted, in real-time, to achieve a flexible and customizable illumination spectrum ideal for imaging a variety of different environments e.g., in the GI tract. | 2022-06-16 |
20220191439 | Apparatus, System and Method to Capture Images of a Medical Site In White Light and Fluorescent Light - A device for capturing an image of an object of medical interest in remitted or reflected illumination light and for capturing an image of the object in fluorescent light generated by Cy5.5 and/or SGM-101 and for capturing an image in fluorescent light generated OTL38 and/or indocyanine green (ICG). The device includes an image sensor for detecting blue, green and red light, another image sensor for detecting fluorescent light of Cy5.5 and/or SGM-101 and OTL38 and/or ICG, a beam splitter guiding light having a wavelength smaller than a predetermined cutoff wavelength to the first sensor and guiding light having a wavelength greater than the predetermined cutoff wavelength to the second sensor, and filters upstream of the second sensor for partially, substantially or completely suppressing light having a wavelength exciting Cy5.5 and/or SGM-101 and for partially, substantially or completely suppressing light having a wavelength suitable for exciting fluorescence of OTL38 and/or ICG. | 2022-06-16 |
20220191440 | DUAL-MODULATION LASER PROJECTION SYSTEMS AND METHODS - A dual-modulation laser projection system ( | 2022-06-16 |
20220191441 | SYSTEMS, DEVICES, AND METHODS FOR PROJECTING DIGITAL CONTENT INCLUDING HAIR COLOR CHANGES ONTO A USER'S HEAD, FACE, OR BODY - In an embodiment, a virtual hair coloration system includes: a projector | 2022-06-16 |
20220191442 | CAMERA-ASSISTED PROJECTION OPTICS DISTORTION CHARACTERIZATION AND CORRECTION - A method includes projecting an image onto a projection surface through a projection lens of a projector, where the image comprises a fiducial marker. The method also includes capturing a point cloud of the fiducial marker with a camera, and generating a distortion map of projection lens distortion based at least in part on the point cloud. The method also includes generating a correction map for the projection lens, and applying the correction map to a video signal input to the projector. | 2022-06-16 |
20220191443 | PROJECTION METHOD AND NON-TRANSITORY COMPUTER-READABLE STORAGE MEDIUM STORING A PROGRAM - A projection method including specifying a first correspondence between a projector coordinate system and a camera coordinate system, based on a first picked-up image and a first image, determining a second correspondence between the projector coordinate system and the camera coordinate system, based on a second picked-up image and a second image, generating correction information, based on one or a plurality of first feature points in a third image acquired by converting the first picked-up image into the projector coordinate system, based on the first correspondence, and one or a plurality of second feature points corresponding to the one or plurality of the first feature points, in a fourth image acquired by converting the second picked-up image into the projector coordinate system, based on the second correspondence, and projecting the projection image that is corrected based on the correction information. | 2022-06-16 |
20220191444 | DISPLAY SYSTEM AND DISPLAY METHOD USING IMAGING APPARATUS AND PROJECTION VIDEO DISPLAY APPARATUS - In a display system, an imaging apparatus takes a video by shifting pixels in units of frames by moving a solid state image sensing device or an optical member physically. A projection video display apparatus acquires a video taken by the imaging apparatus, optically performs pixel shift corresponding to pixel shift performed in the imaging apparatus at the time of imaging, and projects the video acquired. | 2022-06-16 |
20220191445 | METHOD FOR CONTROLLING PROJECTOR, PROJECTOR, AND DISPLAY SYSTEM - A method for controlling a projector, the method comprising: determining, when the projector having an RF tag is started up, whether a setting that permits a process of reading out setting information stored in the RF tag and configuring a setting on the projector based on the setting information is configured or not; determining whether a password requested to be inputted to an information processing device is at an initial value or not, when the setting information is written into the RF tag from the information processing device; and notifying a user of a warning message when it is determined that the setting that permits the process is configured and it is determined that the password is at the initial value. | 2022-06-16 |
20220191446 | IMAGE SENSING DEVICE - Disclosed is an image sensing device including a first module suitable for generating a plurality of interpolated images separated for each color channel, based on a raw image and a plurality of first convolution layers, a second module suitable for generating a plurality of refined images separated for each color channel, based on the plurality of interpolated images and a plurality of second convolution layers, and a third module suitable for generating at least one output image corresponding to the raw image, based on the plurality of refined images and a plurality of third convolution layers. | 2022-06-16 |
20220191447 | SELECTIVE USE OF ADAPTIVE IN-LOOP COLOR-SPACE TRANSFORM AND OTHER VIDEO CODING TOOLS - A method of video processing is provided. The method includes: determining, for a conversion between a current video unit of a video and a coded representation of the video, that applicability of a first coding tool and a second coding tool is mutually exclusive; and performing the conversion based on the determining, wherein the first coding tool corresponds to an adaptive color space transformation (ACT) tool; wherein use of the ACT tool comprises: converting, during encoding a representation of a visual signal from a first color domain to a second color domain, or converting during decoding, a representation of a visual signal from the second color domain to the first color domain. | 2022-06-16 |
20220191448 | MULTIPLE TONE CONTROL - Image analysis and processing may include a multiple-tone-control (MTC) unit configured to obtain a tone-control gain lookup table, a plurality of MTC gain lookup tables, wherein the input image is divided into a plurality of blocks and wherein the plurality of MTC gain lookup tables includes a respective MTC gain lookup table corresponding to each respective block from the plurality of blocks, MTC grid parameters, MTC weighting parameters, a tone-control gain based on the tone-control gain lookup table, a MTC gain based on at least one MTC gain lookup table from the plurality of MTC gain lookup tables, the MTC grid parameters, and the MTC weighting parameters, and an output value based on the tone-control gain and the MTC gain. | 2022-06-16 |
20220191449 | IMAGE PROCESSING DEVICE, IMAGE CAPTURING DEVICE, MOBILE BODY, AND IMAGE PROCESSING METHOD - An image processing device includes an input interface and at least one processor. The input interface is configured to acquire an image obtained by image-capturing a surrounding region of a mobile body. The computation unit is configured to process the image obtained by image-capturing the surrounding region. The computation unit is configured to execute first processing of detecting, from the image, a region in which the mobile body is movable, and second processing of calculating an adjustment parameter for adjusting the image on the basis of the region in which the mobile body is movable. | 2022-06-16 |
20220191450 | DIGITAL CAMERAS WITH DIRECT LUMINANCE AND CHROMINANCE DETECTION - Digital camera systems and methods are described that provide a color digital camera with direct luminance detection. The luminance signals are obtained directly from a broadband image sensor channel without interpolation of RGB data. The chrominance signals are obtained from one or more additional image sensor channels comprising red and/or blue color band detection capability. The red and blue signals are directly combined with the luminance image sensor channel signals. The digital camera generates and outputs an image in YCrCb color space by directly combining outputs of the broadband, red and blue sensors. | 2022-06-16 |
20220191451 | SYSTEMS AND METHODS FOR OPERATION OF RECORDING DEVICES SUCH AS DIGITAL VIDEO RECORDERS (DVRs) - According to one embodiment, a method includes determining that a size of video data associated with a recording operation at a first recording device exceeds an amount of available storage space; selecting previously-stored video data for transfer to a second device; transferring the selected video data from the first recording device to the second device; and deleting the selected video data from the first recording device. | 2022-06-16 |
20220191452 | Methods and Apparatus for Supporting Content Generation, Transmission and/or Playback - Methods and apparatus for supporting the capture of images of surfaces of an environment visible from a default viewing position and capturing images of surfaces not visible from the default viewing position, e.g., occluded surfaces, are described. Occluded and non-occluded image portions are packed into one or more frames and communicated to a playback device for use as textures which can be applied to a model of the environment where the images were captured. An environmental model includes a model of surfaces which are occluded from view from a default viewing position but which maybe viewed is the user shifts the user's viewing location. Occluded image content can be incorporated directly into a frame that also includes non-occluded image data or sent in frames of a separate, e.g., auxiliary content stream that is multiplexed with the main content stream which communicates image data corresponding to non-occluded environmental portions. | 2022-06-16 |
20220191453 | USING REINFORCEMENT LEARNING AND PERSONALIZED RECOMMENDATIONS TO GENERATE A VIDEO STREAM HAVING A PREDICTED, PERSONALIZED, AND ENHANCE-QUALITY FIELD-OF-VIEW - Embodiments of the invention are directed to a computer-implemented method that includes using a reinforcement learning (RL) system to generate a first set of displayed region candidates based on inputs received from online users while watching video. A recommendation system is used to rank the first set of displayed region candidates based on inputs received from a local user watching video. The recommendation system is further used to select a first highest ranked one of the first set of displayed region candidates. Based on the first highest ranked one of the first set of displayed region candidates, a first section of a first raw video frame is fetched that matches the first highest ranked one of the first set of displayed candidate regions, wherein the first section of the first raw video frame includes a first predicted display region of the video frame. | 2022-06-16 |
20220191454 | METHODS AND SYSTEM FOR GENERATING AND DISPLAYING 3D VIDEOS IN A VIRTUAL, AUGMENTED, OR MIXED REALITY ENVIRONMENT - Disclosed is an approach for displaying 3D videos in a VR and/or AR system. The 3D videos may include 3D animated objects that escape from the display screen. The 3D videos may interact with objects within the VR and/or AR environment. The 3D video may be interactive with a user such that based on user input corresponding to decisions elected by the user at certain portions of the 3D video such that a different storyline and possibly a different conclusion may result for the 3D video. The 3D video may be a 3D icon displayed within a portal of a final 3D render world. | 2022-06-16 |
20220191455 | IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND PROGRAM - There is provided an image processing apparatus, an image processing method, and a program that are capable of correcting a three-dimensional image viewable with naked eyes with high accuracy by integrally and simultaneously correcting deterioration due to mixing of images between a plurality of projectors and optical deterioration due to a lens MTF. A multi-viewpoint image projected by a projection unit is generated by integrally and simultaneously applying correction to optical deterioration and correction to crosstalk deterioration. The present disclosure can be applied to a three-dimensional image display device. | 2022-06-16 |
20220191456 | IMAGE DATA ENCODING/DECODING METHOD AND APPARATUS - Disclosed are methods and apparatuses for decoding an image. A method includes receiving a bitstream obtained by encoding the image; dividing a first coding block into a plurality of second coding blocks; generating a prediction block of a second coding block based on syntax information obtained from the bitstream; and reconstructing the second coding block based on the prediction block and a residual block of the second coding block, the residual block being obtained by performing a dequantization and an inverse-transform on quantized transform coefficients from the bitstream. The first coding block has a recursive division structure. The first coding block is divided based on at least one of a quad tree division, a binary tree division or a triple tree division. | 2022-06-16 |
20220191457 | DEVICE AND METHOD FOR TRANSMITTING DATA OF MULTIPLE APPLICATIONS WITH LOW LATENCY - Various embodiments of the present disclosure provide an electronic device comprising: a communication module comprising communication circuitry, a memory, and a processor operatively connected to the communication module and the memory, wherein the processor is configured to: control the electronic device to establish a connection to a wearable display device through the communication module, receive gaze information from the wearable display device, determine a first application and a second application corresponding to the gaze information to be displayed on a screen, identify profiles of the determined first application and second application, and combine graphic data corresponding to the first application and graphic data corresponding to the second application and transmit the combined graphic data to the wearable display device, or transmit each of graphic data corresponding to the first application and graphic data corresponding to the second application to the wearable display device, based on the identified profiles. | 2022-06-16 |
20220191458 | REDUCED RENDERING OF SIX-DEGREE OF FREEDOM VIDEO - Embodiments described herein provide for techniques to reduce the complexity of rendering immersive 3D video content. One embodiment provides for an apparatus comprising one or more processors to receive a data set that represents a two-dimensional encoding of planar projections of a frame of a three-dimensional video, decode the two-dimensional encoding into texture data, geometry data, and metadata, determine, based on the metadata, a visibility status and an occupancy status for a sample position in the three-dimensional video, and render video data for the sample position when the sample position is visible and occupied. | 2022-06-16 |
20220191459 | SYSTEMS AND METHODS OF CREATING A THREE-DIMENSIONAL VIRTUAL IMAGE - Embodiments of the present invention create a three-dimensional virtual model by a user identifying a three-dimensional object, capturing a plurality of two-dimensional images of said object in succession, said plurality of images being captured from different orientations, recording said plurality of images on a storage medium, determining the relative change in position of said plurality of images by comparing two subsequent images, wherein the relative change is determined by a difference in color intensity values between the pixels of one image and another image, generating a plurality of arrays from the difference determined and generating a computer image from said plurality of arrays, wherein said computer image represents said three-dimensional object. | 2022-06-16 |
20220191460 | OBSTACLE DETECTION METHOD AND APPARATUS AND UNMANNED AERIAL VEHICLE - Embodiments of the present invention relate to an obstacle detection method and apparatus and an unmanned aerial vehicle. The unmanned aerial vehicle includes a binocular photographing component and a laser texture component. The method includes: determining to start the laser texture component; starting the laser texture component, to emit a laser texture; obtaining a binocular view that is collected by the binocular photographing component and that includes the laser texture, and setting the binocular view that includes the laser texture as a target binocular view; and performing obstacle detection based on the target binocular view. In the above technical solutions, according to the embodiments of the present invention, precision of binocular stereo matching can be improved without changing an original binocular matching algorithm and structure, thereby improving precision of obstacle detection. In addition, the unmanned aerial vehicle can perform binocular sensing while flying at night. | 2022-06-16 |
20220191461 | TOF CAMERA DEVICE AND METHOD OF DRIVING THE SAME - A time of flight (TOF) camera device and a method of operating the same is provided. The time of flight (TOF) camera device includes a pulse generator configured to generate a pulse signal, a light module configured to emit output light to at least one object in response to the pulse signal, a three-dimensional (3D) sensor configured to receive reflected light when the output light is reflected by the at least one object for a first frame, a distance calculator configured to receive an output of the 3D sensor and generate a distance data signal, and a light density control device configured to receive the distance data signal from the distance calculator and output a light density control signal. The light density control signal may adjust the size of an opening in the light module to change a projected area from the output light onto the at least one object. | 2022-06-16 |
20220191462 | MULTIVIEW BACKLIGHT, MULTIVIEW DISPLAY, AND METHOD EMPLOYING REFLECTIVE MULTIBEAM ELEMENTS - A multiview backlight, multiview display, and method of multiview backlight operation include reflective multibeam elements configured to provide emitted light having directional light beams with directions corresponding to view directions of a multiview image. The multiview backlight includes a light guide configured to guide light and an array of the reflective multibeam elements, each reflective multibeam element including a plurality of reflective sub-elements and being configured to reflectively scatter out a portion of the guided light as the emitted light. The multiview display includes the multiview backlight and an array of light valves to modulate the directional light beams to provide the multiview image. | 2022-06-16 |
20220191463 | APPARATUS AND METHOD FOR PROVIDING WRAP-AROUND VIEW BASED ON 3D DISTANCE INFORMATION - This application relates to an apparatus and method for providing a wrap-around view based on three-dimensional (3D) distance information. The apparatus may include a camera module, a sensor module, and a controller. The camera module acquires image information in all directions, and the sensor module measures 3D spatial information in all directions. The controller is configured to generate 3D distance information by projecting the measured 3D spatial information onto a two-dimensional (2D) plane, to generate a 3D model in a 3D space by using the generated 3D distance information, and to generate a wrap-around view by mapping the acquired image information to the generated 3D model. | 2022-06-16 |
20220191464 | DISPLAY DEVICE AND METHOD - Provided is a display method that prevents degradation of image quality due to ghosting. The display method performed with a display apparatus includes a viewpoint position detection step (S | 2022-06-16 |
20220191465 | METHOD AND APPARATUS FOR PROJECTING 2D AND 3D MOTION PICTURES AT HIGH FRAME RATES - High-frame-rate stereoscopic projection using a single digital projector provides a powerful sense of immersion when shown on wide screens, and the human eye perceives each frame as unique and separate from the others by virtue of the natural left-right “shuttering” that occurs via the chosen 3D projection technology. Techniques are provided for the introduction of one or more consecutive “digital dark frames” into the image streams presented to the dual projectors in such a manner that the sequence of out-of-phase photography is replicated via out-of-phase projection. This is achieved by alternately introducing the dark frames so that the sequence of stereoscopic images is presented in proper temporal continuity. | 2022-06-16 |
20220191466 | Aperture Health Monitoring Mode - The present disclosure relates to systems, vehicles, and methods for detecting optical defects in an optical path of a camera system. An example system may include an image sensor configured to provide images of a field of view via an optical path that extends through an optical window. The system also includes at least one phase-detection device and a controller. The controller is configured to execute instructions stored in the memory so as to carry out various operations, including receiving, from the image sensor, first pixel information indicative of an image of the field of view. The operations additionally include receiving, from the at least one phase-detection device, second pixel information indicative of a portion of the field of view. The operations yet further include determining, based on the first pixel information and the second pixel information, at least one optical defect associated with the optical path. | 2022-06-16 |
20220191467 | CALIBRATION UNIT FOR A MONITORING DEVICE, MONITORING DEVICE FOR MAN-OVERBOARD MONITORING, AND METHOD FOR CALIBRATION - The invention relates to a calibration unit ( | 2022-06-16 |
20220191468 | METHOD, DEVICE, SERVER AND SYSTEM FOR CALIBRATING AT LEAST ONE CAMERA OF A DRIVER ASSISTANCE SYSTEM - Disclosed herein is a method for calibrating at least one camera of a driver assistance system, comprising the steps of: imaging a calibration pattern using a display device and transmitting a control command to the camera to capture the calibration pattern imaged by the display device. Further disclosed is a method, a device, a server and a system ( | 2022-06-16 |
20220191469 | Estimating Real-Time Delay of a Video Data Stream - In an arrangement where a physical phenomenon affects a digital video camera and is measured or sensed by a sensor, a delay of a digital video stream from the digital video camera is estimated. The digital video stream is processed by a video processor for producing a signal that represents the changing over time of the effect of the physical phenomenon on the digital video camera. The signal is then compared with the sensor output signal, such as by using cross-correlation or cross-convolution, for estimating the time delay between the compared signals. The estimated time delay may be used for synchronizing when combining additional varied data to the digital video stream for low-error time alignment. The physical phenomenon may be based on mechanical position or motion, such as pitch, yaw, or roll. The time delay estimating may be performed once, upon user control, periodically, or continuously. | 2022-06-16 |
20220191470 | METHOD AND APPARATUS FOR PROCESSING VIDEO SIGNAL - An image decoding method according to the present invention comprises the steps of: deriving most probable mode (MPM) candidates on the basis of an intra-prediction mode of candidate blocks; determining whether the MPM candidate having the intra-prediction mode, which is the same as that of a current block, exists among MPM candidates; and deriving the intra-prediction mode of the current block on the basis of the determination, wherein the candidate block includes a neighboring block which is adjacent to the current block, and a non-neighboring block which is not adjacent to the current block. | 2022-06-16 |
20220191471 | INTRA PREDICTION METHOD ON BASIS OF MPM LIST AND APPARATUS THEREFOR - An image decoding method performed by a decoding apparatus according to the present disclosure comprises the steps of: obtaining intra prediction information including at least one of MPM flag information, MRL index information, and planner flag information from a bitstream; checking the MPM flag information; checking the MRL index information on the basis of a case where the MPM flag information indicates that the MRL index information is checked; checking the planner flag information on the basis of a case where a value of the MRL index information is 0; deriving an intra prediction mode for a current block on the basis of the check for the planner flag information; deriving prediction samples for the current block on the basis of the intra prediction mode for the current block; and generating a reconstructed picture on the basis of the prediction samples. | 2022-06-16 |
20220191472 | IMAGE ENCODING/DECODING METHOD AND DEVICE FOR DERIVING WEIGHT INDEX OF BIDIRECTIONAL PREDICTION, AND METHOD FOR TRANSMITTING BITSTREAM - An image encoding/decoding method and apparatus are provided. An image decoding method according to the present disclosure is performed by an image decoding apparatus. The image decoding method comprises reconstructing an inter prediction mode of a current block, deriving an affine merge candidate based on neighboring blocks of the current block, based on the inter prediction mode of the current block being an affine merge mode, deriving motion information of the current block based on motion information of the affine merge candidate, generating a prediction block of the current block by performing inter prediction on the current block based on the motion information of the current block, and reconstructing the current block based on the prediction block. The motion information may comprise a weight index for bi-prediction. | 2022-06-16 |
20220191473 | NEURAL NETWORK BASED RESIDUAL CODING AND PREDICTION FOR PREDICTIVE CODING - Systems and methods disclosed for video compression, utilizing neural networks for predictive video coding. Processes employed combine multiple banks of neural networks with codec system components to carry out the coding and decoding of video data. | 2022-06-16 |
20220191474 | WIDE ANGLE INTRA PREDICTION WITH SUB-PARTITIONS - A method and apparatus for performing prediction for encoding or decoding uses intra prediction with sub-partitions. The sub-partitions are oriented either horizontally or vertically and can use wide-angle modes different than that of the video block they originate from. Reference samples for a sub-partition are those of the video block when reference samples for the sub-partition are not available, such as due to direction. In an embodiment, when a sub-partition is square, conventional intra prediction directions are used. Reference samples can be used from a block above and right of the video block or left and below the video block using a mapping along a prediction direction, vertically, or horizontally. | 2022-06-16 |
20220191475 | RANGE CONSTRAINS FOR BLOCK VECTOR IN INTRA-BLOCK COPY MODE - A method of video processing is described. The method includes performing a conversion between a current video block of a video picture of a video and a coded representation of the video according to a buffer allocation rule, wherein the conversion uses an intra block copy (IBC) mode in which a prediction of the current video block is derived based on sample values from a same video slice with the current video block, and wherein the sample values are determined by block vectors, wherein the buffer allocation rule specifies that a virtual buffer allocated for the conversion using the IBC mode is greater than a minimum size of memory for storing a portion of the video picture searched for determining the block vectors. | 2022-06-16 |
20220191476 | PICTURE ENCODING/DECODING METHOD AND RELATED APPARATUS - A picture encoding/decoding method and a related apparatus are provided. The picture decoding method includes obtaining a current picture from a video, the current picture being segmented using random access points into multiple video segments supporting a random access function; selecting, from a knowledge base, K reference pictures of the current picture, wherein at least one reference picture in the knowledge base does not belong to a random access segment in which the current picture is located, the random access segment comprising a picture sequence arranged in a decoding order from a closest random access point before the current picture to a closest random access point after the current picture; and decoding the current picture according to the K reference pictures. | 2022-06-16 |
20220191477 | CODING MODE SELECTION METHOD AND APPARATUS, AND ELECTRONIC DEVICE AND COMPUTER-READABLE MEDIUM - A coding mode selection method is provided. The method includes acquiring a target frame image of a target video, determining a target coding unit based on the target frame image, the target coding unit comprising a prediction unit, obtaining rate-distortion costs of a symmetric inter prediction mode and a motion merge prediction mode by separately performing estimation on the prediction unit in the symmetric inter prediction mode and the motion merge prediction mode, determining a first candidate prediction mode based on the rate-distortion costs of the symmetric inter prediction mode and the motion merge prediction mode, and determining a second candidate prediction mode set in asymmetric inter prediction modes based on the first candidate prediction mode. | 2022-06-16 |
20220191478 | IMAGE DECODING METHOD AND DEVICE AND IMAGE ENCODING METHOD AND DEVICE IN IMAGE CODING SYSTEM - According to embodiments of the present document, an intra-prediction mode candidate list of a current block can be constructed by means of a process of constructing a common intra-prediction mode list with respect to intra-prediction types. Therefore, the dependency of the intra-prediction types in the process of constructing the intra-prediction mode list is reduced, and thus the coding efficiency of an intra-prediction can be enhanced. | 2022-06-16 |
20220191479 | ADAPTIVE FILTER INTRA PREDICTION MODES IN IMAGE/VIDEO COMPRESSION - Generating a prediction block for coding a block includes determining an adaptive intra-prediction mode indicative of at least a training region and a configuration of neighboring pixel locations. The training region neighbors the block and includes a plurality of reconstructed pixels. Filter coefficients are obtained. The filter coefficients are used to obtain respective prediction pixels of neighboring pixels within the training region when applied to defined respective configurations of the neighboring pixels according to the configuration of the neighboring pixels. The filter coefficients minimize a function of differences, each difference being a respective difference between a pixel in the training region and a prediction of that pixel in the training region. The prediction block is generated by recursive extrapolations that use the filter coefficients by predicting each pixel of the prediction block by applying the filter coefficients to the configuration of neighboring pixels for the pixel being predicted. | 2022-06-16 |
20220191480 | ADAPTIVE GOP STRUCTURE USING TEMPORAL DEPENDENCIES LIKELIHOOD - A first aspect is a method for coding a group of pictures (GOP) that includes frames of a video. The method includes encoding, at least some of the frames of the GOP, using a first encoding pass to obtain encoding statistics; obtaining, using the encoding statistics, respective temporal dependency likelihoods (TDLs) for the at least some of the frames of the GOP, where the respective TDLs indicate contributions that the at least some of the frames make in reducing prediction errors of the GOP; obtaining a reference frame based on the respective TDLs; and using the reference frame in encoding at least some of the frames of the GOP in a second encoding pass. | 2022-06-16 |
20220191481 | IN-LOOP RESHAPING ADAPTIVE RESHAPER DIRECTION - A method and apparatus for performing a forward mapping function or its inverse is implemented through information conveyed in a bitstream to perform mapping. The information can be implemented in a uniform or non-uniform lookup table. A decoder can receive the information and derive the inverse function to be used. In one embodiment, a decoder receives information representative of an inverse mapping function and uses the information to implement an inverse mapping lookup table for intra coded picture portions and can derive a forward mapping lookup table to be used with an inverse mapping lookup table for inter coded picture portions. | 2022-06-16 |
20220191482 | METHOD AND APPARATUS FOR VIDEO CODING - Aspects of the disclosure provide methods and apparatuses for video processing. In some examples, an apparatus for video processing includes processing circuitry. The processing circuitry determines gating weights associated with expert modules based at least partially on a quantization parameter (QP) value. The expert modules are configured to process an input block that includes an image block being reconstructed based on the QP value. The processing circuitry then weights the expert modules based on the gating weights to generate an output image block corresponding to the image block. | 2022-06-16 |
20220191483 | Model Selection in Neural Network-Based In-loop Filter for Video Coding - A method implemented by a video coding apparatus. The method includes selecting a neural network (NN) filter model from a plurality of NN filter model candidates for each video unit. The NN filter model selected for a first video unit is different than the NN filter model selected for a second video unit. The method also includes converting between a video media file and a bitstream based on the one or more NN filter models selected for the video unit. A corresponding video coding apparatus and non-transitory computer readable medium are also disclosed. | 2022-06-16 |
20220191484 | DEBLOCKING FILTERING AT CODING BLOCK OR SUBBLOCK BOUNDARY - A method of video processing is described. The method includes determining, for subblocks of a current video block of a video, subblock boundaries to which a deblocking filter is to be applied according to a rule; and performing a conversion between the video and a coded representation of the video using the deblocking filter, wherein the rule specifies that a deblocking filter length is determined without checking a relationship between i) a sum of a position of a subblock of the current video block and a predefined value and ii) a width or a height of the current video block. | 2022-06-16 |
20220191485 | METHOD AND SYSTEM FOR ADAPTIVE CROSS-COMPONENT FILTERING - An image processing method includes obtaining statistics information of a block of an image frame, determining whether the statistics information satisfies a condition, and disabling cross-component filtering (CCF) for the block in response to the statistics information satisfying the condition. | 2022-06-16 |
20220191486 | ENCODER-SIDE DECISIONS FOR SAMPLE ADAPTIVE OFFSET FILTERING - Disclosed herein are exemplary embodiments of innovations in the area of encoding pictures or portions of pictures (e.g., slices, coding tree units, or coding units) and determining whether and how certain filtering operation should be performed and flagged for performance by the decoder in the bitstream. In particular examples, various implementations for setting the sample adaptive offset (SAO) syntax elements in the H.265/HEVC standard are disclosed. Although these examples concern the H.265/HEVC standard and its SAO filter, the disclosed technology is more widely applicable to other video codecs that involve filtering operations (particularly multi-stage filtering operations) as part of their encoding and decoding processes. | 2022-06-16 |
20220191487 | SYSTEM AND METHOD FOR VIDEO CODING - An encoder includes circuitry and memory. The circuitry, in operation, generates a first coefficient value by applying a CCALF (cross component adaptive loop filtering) process to a first reconstructed image sample of a luma component. The circuitry generates a second coefficient value by applying an ALF (adaptive loop filtering) process to a second reconstructed image sample of a chroma component. The circuitry generates a third coefficient value by adding the first coefficient value to the second coefficient value, and encodes a third reconstructed image sample of the chroma component using the third coefficient value. The circuitry determines a first parameter having the same value for Cb component and Cr component of the chroma component. The circuitry determines, using the first parameter, a model of entropy coding from a plurality of models. The circuitry performs, using the model, the entropy coding of a second parameter of the CCALF process. | 2022-06-16 |
20220191488 | DEBLOCKING FILTER SELECTION IN VIDEO OR IMAGE CODING - The long filter decision in VVC is modified by adding at least one gradient check that at least includes sample p6 or q6. This makes it possible to avoid using the long filters when there is some natural structure at sample p6 or q6. In one specific embodiment at least two gradient checks including both q6 and p6 are added. In another embodiment, the dpq threshold is modified from beta>>2 to beta>>4. This threshold change embodiment may be used in conjunction with or instead of the embodiment in which a gradient check that includes p6 and/or q6 is added to the long filter decision. | 2022-06-16 |
20220191489 | IMAGE INFORMATION ENCODING AND DECODING METHOD - The present invention relates to an image information encoding and decoding method and a device for same. One embodiment of an image information encoding method according to the present invention, as an image information encoding method according to another embodiment of the present invention, includes the steps of: generating a restore block; applying a deblocking filter on the restore block; applying a Sample Adaptive Offset (SAO) on the restore block having the deblocking filter applied thereon; and transmitting information on the SAO application. During the applying of the SAO, the SAO is applied to chroma pixels, and during the transmitting of the information, in addition to information on whether the SAO is applied on the chroma pixels, at least one of area information, division information on the SAO coverage area, SAO type information, and SAO offset information is transmitted. | 2022-06-16 |
20220191490 | SUB-PARTITIONING IN INTRA CODING - Methods, devices, and systems related to video processing are disclosed. In one example aspect, a method of video processing includes performing a conversion between a block of a current picture of a video and a coded representation of the video using an intra-subblock partitioning (ISP) mode. A prediction is determined for each sub-partition using an intra-prediction process based on samples in the current picture using the ISP mode. The block is partitioned into multiple sub-partitions including a first sub-partitions having a same top-left corner position as a top-left corner position of the block. | 2022-06-16 |
20220191491 | METHOD AND APPARATUS FOR IMAGE ENCODING, AND METHOD AND APPARATUS FOR IMAGE DECODING - An image decoding method includes reconstructing a current image by performing deblocking filtering on a boundary of at least one reconstruction block from among reconstruction blocks, wherein the reconstructing of the current image by performing the deblocking filtering on the boundary of the at least one reconstruction block from among the reconstruction blocks includes, when a prediction mode of at least one reconstruction mode from among blocks located on both sides of the boundary of the at least one reconstruction block is a combined inter-intra prediction mode, determining that a value of a boundary filtering strength applied to the boundary of the at least one reconstruction block is a predetermined value and performing deblocking filtering on the boundary of the at least one reconstruction block based on the determined value of the boundary filtering strength. | 2022-06-16 |
20220191492 | COEFFICIENT SCALING FOR HIGH PRECISION IMAGE AND VIDEO CODING - Methods, systems, and devices for coefficient scaling for high-precision image and video coding are described. A example method of video processing includes performing a conversion between a current block of a video and a bitstream representation of the video according to a rule, wherein the rule specifies that the conversion includes during encoding, skipping applying a forward transform to residual coefficients of the current block prior to including in the bitstream representation, or during decoding, reconstructing residual coefficients of the current block from the bitstream representation without applying an inverse transform, and wherein the rule further specifies that a scale factor is applied to the residual coefficients independent of a size of the current block. | 2022-06-16 |
20220191493 | VIDEO COMPRESSION AND TRANSMISSION TECHNIQUES - Embodiments feature families of rate allocation and rate control methods that utilize advanced processing of past and future frame/field picture statistics and are designed to operate with one or more coding passes. At least two method families include: a family of methods for a rate allocation with picture look-ahead; and a family of methods for average bit rate (ABR) control methods. At least two other methods for each method family are described. For the first family of methods, some methods may involve intra rate control. For the second family of methods, some methods may involve high complexity ABR control and/or low complexity ABR control. These and other embodiments can involve any of the following: spatial coding parameter adaptation, coding prediction, complexity processing, complexity estimation, complexity filtering, bit rate considerations, quality considerations, coding parameter allocation, and/or hierarchical prediction structures, among others. | 2022-06-16 |
20220191494 | QUANTIZATION MATRIX COMPRESSION IN VIDEO CODING - A method of quantization matrix compression in a video encoder is provided that includes preprocessing a quantization matrix by performing at least one selected from down-sampling the quantization matrix and imposing 135 degree symmetry on the quantization matrix, performing zigzag scanning on the pre-processed quantization matrix to generate a one dimensional (1D) sequence, predicting the 1D sequence to generate a residual 1D sequence, and coding the residual 1D sequence using kth order exp-Golomb coding to generate a compressed quantization matrix, wherein k≥0. | 2022-06-16 |
20220191495 | METHOD AND APPARATUS FOR SIGNALING OF CHROMA QUANTIZATION PARAMETERS - According to an aspect of the disclosure, a method of video decoding performed in a video decoder is provided. In the method, syntax information of a coding unit (CU) is decoded from a coded video bitstream. The syntax information is signaled in a picture header (PH) and includes chroma quantization parameter (QP) offsets in a PH level. The chroma QP offsets include at least one of a Cb offset, a Cr offset, and a CbCr offset. Further, quantization parameters for the CU are determined based on the chroma QP offsets in the PH level and a quantization parameter range offset of the CU. | 2022-06-16 |
20220191496 | PERFORMING CHROMA DEBLOCKING FOR BLOCKS WHICH USE JOINT CHROMA CODING - A method for deblocking a chroma block edge between a first chroma block of a first image block and a second chroma block of a second image block. The method includes a decision process which includes: determining a first chroma quantization parameter for the first chroma block based on a first luma quantization parameter of a first luma block of the first image block and a chroma QP mapping table for the first chroma block; determining a second chroma quantization parameter for the second chroma block based on a second luma quantization parameter of a second luma block of the second image block and a chroma QP mapping table for the second chroma block; determining an averaged and rounded chroma quantization parameter based on the first chroma quantization parameter and the second chroma quantization parameter; and determining a threshold parameter based on the averaged and rounded chroma quantization parameter. | 2022-06-16 |
20220191497 | DECOMPOSITION OF RESIDUAL DATA DURING SIGNAL ENCODING, DECODING AND RECONSTRUCTION IN A TIERED HIERARCHY - Computer processor hardware receives a first set of adjustment values. The first set of adjustment values specify adjustments to be made to a predicted rendition of a signal generated at a first level of quality to reconstruct a rendition of the signal at the first level of quality. The computer processor hardware processes the first set of adjustment values and derives a second set of adjustment values based on the first set of adjustment values and a rendition of the signal at a second level of quality. The second level of quality is lower than the first level of quality. | 2022-06-16 |
20220191498 | Signalling Profile Level Exemptions For Immersive Video - An encoder may determine that volumetric video data comprises at least one time period during which a computational requirement for rendering or decoding changes at least a threshold amount; and include, in a bitstream, an indication of the change in the computational requirement for rendering or decoding of the volumetric video data during the at least one time period. A decoder may receive an indication of a change in at least one computational requirement for rendering or decoding of volumetric video data; and reallocate at least one computational resource based on the received indication. | 2022-06-16 |
20220191499 | VIDEO ENCODING AND DECODING METHOD BASED ON ENTRY POINT INFORMATION IN A SLICE HEADER, AND APPARATUS USING SAME - A video encoding method includes deriving entry point information specifying an entry point of a substream for a picture. The entry point information may include a number syntax element representing a number of offset syntax elements in a slice header; an offset syntax element representing an entry point offset between in bytes two entry points; and a length syntax element representing a bits length of the offset syntax element. A value of the length syntax element plus one corresponds to the bits length of the offset syntax element and the length syntax element is signaled when the number of the offset syntax elements is larger than 0. A value of the number syntax element corresponds to the number of offset syntax elements in the slice header, and the offset syntax element is signaled when the number of the offset syntax elements is larger than 0. | 2022-06-16 |
20220191500 | CONTEXT CODING FOR INFORMATION ON TRANSFORM KERNEL SET IN IMAGE CODING SYSTEM - An image decoding method, according to the present document, comprises a step of generating residual samples for a current block on the basis of residual information, wherein the residual samples are generated on the basis of information on a transform kernel set and transform coefficients for the current block, the transform coefficients are derived on the basis of the residual information, and the information on the transform kernel set represents a transform kernel set to be applied to the current block from among transform kernel set candidates. At least one bin from among bins of a bin string of the information on the transform kernel set is derived on the basis of context coding, and the context coding is performed on the basis of at least one context model. | 2022-06-16 |
20220191501 | METHOD FOR IMAGE PROCESSING AND APPARATUS FOR IMPLEMENTING THE SAME - A method of processing an image is proposed, which includes: generating a decoded image by first encoding the image, wherein the first encoding the image includes decoding encoded data generated based on the image, determining estimates of parameters of a parametric model of noise contained in the image based on the decoded image, including the estimates of parameters of the parametric model of noise in an encoded stream generated by second encoding the image. | 2022-06-16 |
20220191502 | METHODS AND APPARATUS FOR PREDICTION REFINEMENT FOR DECODER SIDE MOTION VECTOR REFINEMENT WITH OPTICAL FLOW - Methods, devices, apparatus, systems, architectures and interfaces to improve motion vector (MV) refinement based sub-block (SB) level motion compensated prediction are provided. A decoding method includes receiving a bitstream of encoded video data, the bitstream including at least one block of video data including a plurality of SBs; performing a MV derivation, including a decoder based MV (DMVR) process, for at least one SB in the block to generate a refined MV for each SB; performing SB based motion compensation on the at least one sub-block to generate a SB based prediction within each SB; obtaining a spatial gradient for the prediction within each SB; determining a MV offset for each pixel in each SB; obtaining an intensity change in each SB based on the spatial gradients and MV offsets via an optical flow equation; and refining the prediction within each SB based on the obtained intensity changes. | 2022-06-16 |
20220191503 | METHOD FOR DERIVING MOTION VECTOR, AND ELECTRONIC DEVICE - A method for deriving motion vector is provided, this method includes: obtaining a space domain motion vector prediction and a time domain motion vector prediction of adjacent blocks of a coding unit in a predetermined direction; performing a filtering operation on the space domain motion vector and the time domain motion vector prediction to obtain the space domain motion vector prediction and the time domain motion vector prediction of the filtered adjacent blocks; determining, according to a predetermined inter-frame prediction mode, reference motion vectors of a current block in four side directions by using the space domain motion vector prediction and the time domain motion vector prediction of the filtered adjacent blocks and a coordinate position of the current block in the coding unit; and deriving motion vectors of the current block according to the reference motion vectors and the coordinate position of the current block in the coding unit. | 2022-06-16 |
20220191504 | METHOD AND APPARATUS FOR MOTION INFORMATION STORAGE - A motion information storing method comprises: determining a distance between a sample set in the current block and the common boundary; and comparing the distance with a threshold to determine whether third motion information is stored for the sample set, wherein the third motion information is derived by the first motion information and the second motion information. | 2022-06-16 |
20220191505 | VIDEO ENCODING DEVICE, VIDEO DECODING DEVICE, VIDEO ENCODING METHOD, VIDEO DECODING METHOD, AND PROGRAM USING INTER PREDICTION - A video encoding device includes encoding control means | 2022-06-16 |
20220191506 | VIDEO ENCODING DEVICE, VIDEO DECODING DEVICE, VIDEO ENCODING METHOD, VIDEO DECODING METHOD, AND PROGRAM USING INTER PREDICTION - A video encoding device includes encoding control means | 2022-06-16 |
20220191507 | METHOD AND CIRCUIT SYSTEM FOR COMPRESSING VIDEO SIGNALS BASED ON ADAPTIVE COMPRESSION RATE - A method for compressing video signals based on adaptive compression rate and a circuit system thereof are provided. In the method, a digital signal processor is used to process a video so as to frame-by-frame obtain statistical data, for example, a maximum of compressed data. The maximum of compressed data of a previous frame is used to determine a compression state of a current frame. The compression state of the frame allows the processor to decide a direction to adjust a compression ratio. Next, statistical data of the previous frame is used to decide a stride to adjust the compression ratio. The statistical data can be a maximum of compressed data and a quantization table scale referred to rendering a prediction curve that allows the processor to determine the stride. A compression ratio is then determined according to the direction and the stride of adjustment. | 2022-06-16 |
20220191508 | METHODS AND SYSTEMS FOR IMPROVED CONTENT ENCODING - Methods and systems for improved content encoding are described herein. An encoder may allocate a time budget for encoding each frame of a content item. When the encoder takes longer than the allocated time budget to encode at least a portion of a given frame(s) of the content item at a first resolution, the encoder may take a number of actions in order to allow the encoder to “catch up,” such as encoding frames at a second resolution. Once the encoder catches up and the allocated time budget is not being exceeded, the encoder may resume encoding frames of the content item at the first resolution. | 2022-06-16 |
20220191509 | RATE CONTROL FOR A VIDEO ENCODER - A method of encoding an input video as a hybrid video stream, the method comprising: receiving the input video at a first resolution; obtaining an indication of a desired quality level for the encoding, the desired quality level setting one or more bit rates for the hybrid video stream, said hybrid stream comprising a base encoded stream at a second resolution and a plurality of enhancement streams at each of the first and second resolutions, the first resolution being higher than the second resolution; encoding each of the plurality of enhancement streams by: generating a set of residuals based on a difference between the input video and a reconstructed video at the respective resolution of the enhancement stream; determining quantisation parameters for the set of residuals for based on the desired quality level; quantising the set of residuals based on the quantisation parameters; and creating an encoded stream from the set of quantised residuals. | 2022-06-16 |