42nd week of 2021 patent applcation highlights part 77 |
Patent application number | Title | Published |
20210329162 | SYNCHRONIZED MEDIA CAPTURING FOR AN INTERACTIVE SCENE - There are provided systems and methods for synchronized media capturing for an interactive scene. A user at a venue may watch an event unfold at the venue. The venue may include wireless beacons established throughout the venue. The wireless beacons may be configured to establish short range wireless communications with the user's device. Once a connection is established, the wireless beacons may instruct the user's device to capture media of an instance during the event. The wireless beacons may similar instruct other user's devices to capture media of the instance at the same time, thereby synchronizing media capturing of a particular instance during the event. The user may review the media and select to delete the media or upload the media to a media sharing service. The server may further process the media into an interactive scene. | 2021-10-21 |
20210329163 | IMAGING APPARATUS, IMAGING SYSTEM, IMAGING METHOD, AND IMAGING PROGRAM - An imaging apparatus includes: an imaging unit that has a pixel region in which a plurality of pixels is arranged and reads and outputs a pixel signal from the pixels included in the pixel region; a unit-of-readout controller that controls a unit of readout set as a part of the pixel region; a first unit-of-readout setting unit that sets a first unit of readout that is used for reading out the pixel signal from the pixel region for a recognition process that has learned training data for each of the units of readout; a second unit-of-readout setting unit that sets a second unit of readout that is used for reading out the pixel signal from the pixel region so as to output the pixel signal to a subsequent stage; and a mediation unit that performs mediation between the first unit of readout and the second unit of readout. | 2021-10-21 |
20210329164 | IMAGING APPARATUS, IMAGING SYSTEM, IMAGING METHOD, AND IMAGING PROGRAM - An imaging apparatus includes: an imaging unit that has a pixel region in which a plurality of pixels is arranged and that reads and outputs a pixel signal from the pixels included in the pixel region; a unit-of-readout controller that controls a unit of readout set as a part of the pixel region: a recognition unit that has learned training data for each of units of readout; a first output unit that outputs a recognition result of recognition performed by the recognition unit for each of the units of readout; a second output unit that outputs the pixel signal to a subsequent stage; and a trigger generator that generates a trigger signal for controlling a first timing at which the first output unit outputs the recognition result and a second timing at which the second output unit outputs the pixel signal. | 2021-10-21 |
20210329165 | DISPLAY ASSISTANT DEVICE FOR HOME MONITORING - A display assistant device comprises a display, a camera, a speaker, microphones, a processor and memory. The memory stores programs comprising instructions that, when executed by the processor, enable a plurality of modes of the display assistant device. The modes include a monitoring mode and an assistant mode. In the monitoring mode, the device is configured to perform a remote monitoring function in which first video captured by the camera is streamed to a remote server system for monitoring uses. The monitoring uses include transmission of the first video to remote client devices authorized to access the first video. In the assistant mode, the device is configured to perform a second plurality of functions that excludes the monitoring function and includes a video communication function in which second video captured by the camera is transmitted to second devices participating in a video communication with a first user of the device. | 2021-10-21 |
20210329166 | IMAGE DEVICE AND IMAGE PROCESSING INTEGRATED CIRCUIT THEREOF - An image device and an image processing integrated circuit (IC) of the image device are provided. The image device includes a camera module, a display panel, a central processing IC, and an image processing IC. Based on a control of the central processing IC, the image processing IC decides whether to pre-process an output of the camera module and provide a pre-processed result to the central processing IC, or provide the output of the camera module directly to the central processing IC. Based on the control of the central processing IC, the image processing IC decides whether to post-process an output of the central processing IC and provide a post-processed result to the display panel, or provide the output of the central processing IC directly to the display panel. | 2021-10-21 |
20210329167 | VEHICULAR VISION SYSTEM WITH VIDEO DISPLAY - A vehicular vision system includes a plurality of cameras and an ECU. The cameras are in communication with one another via a vehicle network and image data captured by the cameras is provided to the ECU. Responsive to a type of driving maneuver of the vehicle, (i) the ECU generates a first control signal that enables automatic control of exposure, gain and white balance of one camera of the plurality of cameras and (ii) the ECU generates respective second control signals that disable automatic control of exposure, gain and white balance of at least one other camera of the plurality of cameras. Responsive to processing of captured image data, composite video images derived from image data captured by the plurality of cameras are synthesized, and composite images are displayed that provides bird's eye view video images derived from video image data captured by the cameras. | 2021-10-21 |
20210329168 | IMAGE ADJUSTMENT SYSTEM, IMAGE ADJUSTMENT DEVICE, AND IMAGE ADJUSTMENT METHOD - An image adjustment system and an image adjustment method include a camera, an image adjustment device, an image display device, and a controller. The image adjustment device includes an image generator and an image processor. The image generator generates a spherical image. The image processor acquires the spherical image from the image generator based on instruction information output from the controller and displays the spherical image on the image display device. The image processor rotates the spherical image based on the instruction information, and adjusts a captured image displayed on the image display device in accordance with the rotation of the spherical image. | 2021-10-21 |
20210329169 | USING REAL TIME RAY TRACING FOR LENS REMAPPING - A method for generating a surround view (SV) image for display in a view port of an SV processing system is provided that includes capturing, by at least one processor, corresponding images of video streams from each camera of a plurality of cameras and generating, by the at least one processor, the SV image using ray tracing for lens remapping to identify coordinates of pixels in the images corresponding to pixels in the SV image. | 2021-10-21 |
20210329170 | CAMERA MODULE AND CAMERA-EQUIPPED DEVICE - A camera module has: a lens holder for holding a lens unit; an image sensor holding unit that is arranged spaced apart from the lens holder in a first direction along the optical axis of the lens unit and holds an image sensor; and a drive unit that moves the image sensor holding unit with respect to the lens holder in a second direction and a third direction which are perpendicular to the optical axis and are perpendicular to each other, and that rotates the image sensor holding unit around the optical axis. | 2021-10-21 |
20210329171 | IMAGE ADJUSTMENT SYSTEM, IMAGE ADJUSTMENT DEVICE, AND IMAGE ADJUSTMENT - An image adjustment system includes a camera, an image adjustment device, an image display device, and a controller. The image display device displays a captured image adjusted by the image adjustment device. The image adjustment device includes an image generator and an image processor. The image generator generates a spherical surface image. The image processor acquires the spherical surface image from the image generator to display the spherical surface image on the image display device on the basis of instruction information output from the controller. The image processor rotates the spherical surface image on the basis of the instruction information. The image processor adjusts a right-eye image or a left-eye image of the captured image displayed on the image display device in accordance with a rotation of the spherical surface image. | 2021-10-21 |
20210329172 | IMAGE CAPTURING APPARATUS, CONTROL METHOD THEREFOR, AND STORAGE MEDIUM - An image capturing apparatus comprises an image capturing device, a detection unit configured to detect the subject from the image captured by the image capturing device, a setting unit configured to set a plurality of focus detection frames inside the image based on a result of the detection by the detection unit, a focus detection unit configured to detect a focus state and reliability thereof in each of the plurality of focus detection frames; and a selection unit configured to select a main focus detection frame for performing focus adjustment based on results of the detections by the detection unit and the focus detection unit, wherein the selection unit is configured to cause a method of selecting the main focus detection frame to vary depending on a part of the subject detected by the detection unit. | 2021-10-21 |
20210329173 | IMAGE SAVE ORIENTATION DETERMINED BASED ON ORIENTATION OF OBJECT WITHIN IMAGE - In one aspect, a device includes at least one processor, a camera accessible to the at least one processor, a display accessible to the at least one processor, and storage accessible to the at least one processor. The storage includes instructions executable by the at least one processor to generate an image using the camera, to determine a first orientation of at least one object shown in the image, and to save the image in a second orientation determined based on the first orientation. | 2021-10-21 |
20210329174 | Automated Control Of Image Acquisition Via Acquisition Location Determination - Techniques are described for using computing devices to perform automated operations to control acquisition of images in a defined area, including obtaining and using data from one or more hardware sensors on a mobile device that is acquiring the images, analyzing the sensor data (e.g., in a real-time manner) to determine the geometric orientation of the mobile device in three-dimensional (3D) space, and using that determined orientation to control the acquisition of further images by the mobile device. In some situations, the determined orientation information may be used in part to automatically generate and display a corresponding GUI (graphical user interface) that is overlaid on and augments displayed images of the environment surrounding the mobile device during the image acquisition process, so as to control the mobile device's geometric orientation in 3D space. | 2021-10-21 |
20210329175 | IMAGE PROCESSING SYSTEM, IMAGE PROCESSING METHOD, AND PROGRAM - An image processing system, an image processing method, and a program capable of implementing an association of a person appearing in a video image through a simple operation are provided. The image processing system includes an input device which accepts input of video images captured by a plurality of video cameras, a display screen generating unit which causes a display device to display at least one video image among the video images inputted from the input device, and a tracked person registering unit which is capable of registering one or more persons appearing in the video image displayed by the display device. When a person appears in the video image displayed by the display device, the display screen generating unit selectably displays person images of one or more persons, which are associable with the person appearing in the video image and which are registered by the tracked person registering unit, in a vicinity of the video image. | 2021-10-21 |
20210329176 | VIDEO STICKER PROCESSING METHOD AND DEVICE - The present invention provides a video sticker processing method and device. The method comprises: performing face recognition and speech recognition on video to be processed separately to obtain face position data when face recognition is successful, and speech recognition text when speech recognition is successful; matching speech recognition text with description text of each sticker in sticker library to obtain a target sticker, and obtaining a target video frame according to speech recognition text; adding target sticker to default position or target position of target video frame; wherein, target position is calculated according to the face position data. The present invention can automatically determine the target sticker and its added position according to the face recognition result and the speech recognition result of the video to be processed, realize the intelligent selection and placement of the target sticker, and improve the processing efficiency of the video sticker. | 2021-10-21 |
20210329177 | SYSTEMS AND METHODS FOR VIDEO PROCESSING AND DISPLAY - A method for sensing an environment in which an unmanned aerial vehicle (UAV) is configured to operate includes, with aid of one or more processors onboard the UAV individually or collectively, obtaining video data of the environment that is collected using a binocular video camera mounted in a forward-looking direction of the UAV, encoding the video data to generate stereoscopic video data, and transmitting the stereoscopic video data to a terminal remote to the movable object. | 2021-10-21 |
20210329178 | MOTION BASED THERMAL IMAGE PROCESSING SYSTEMS AND METHODS - Various techniques are provided for improved detection of scene changes using a thermal imager. In one example, a method includes capturing a plurality of thermal images of a scene using a thermal imager. The method also includes detecting motion associated with the thermal imager during the capturing. The method also includes determining a temporal delay in response to the detected motion. The method also includes selecting first and second ones of the thermal images captured at corresponding first and second times separated by the temporal delay. The method also includes processing the first and second thermal images to generate a comparison thermal image identifying changes in the scene between the first and second times. Additional methods and systems are also provided. | 2021-10-21 |
20210329179 | IMAGE SENSING DEVICE - Disclosed is an image sensing device including a current supply circuit coupled between a supply terminal of a first voltage and a pair of output terminals, an input circuit coupled between the pair of output terminals and a common node, and suitable for receiving a pixel signal and a ramp signal, and a mirroring circuit coupled between the common node and a supply terminal of a second voltage, and suitable for compensating for an operating current, which flows between the common node and the supply terminal of the second voltage, based on a reference current when generating the operating current by mirroring the reference current. | 2021-10-21 |
20210329180 | SEMI-GLOBAL SHUTTER IMAGER - This disclosure is directed to an image sensor. The image sensor includes a two-dimensional pixel array divided into a plurality of blocks, each of the plurality of blocks comprising pixels arranged in at least two different rows and two different columns, and a shutter mechanism that exposes the plurality of blocks sequentially, with all pixels in each block being exposed synchronously. | 2021-10-21 |
20210329181 | IMAGING DEVICE AND DRIVE METHOD THEREFOR - An imaging device includes: a photoelectric converter including a first electrode, a second electrode, and a photoelectric conversion layer that generates a signal charge; a charge accumulator connected to the first electrode to accumulate the signal charge; a first voltage supply circuit connected to the second electrode and that selectively supplies at least two different voltages including a first voltage and a third voltage greater than the first voltage; and a second voltage supply circuit that is connected to the charge accumulator via capacitance and that selectively supplies at least two different voltages including a second voltage and a fourth voltage less than the second voltage, where in a first period in which the first voltage supply circuit supplies the first voltage, the first period being included in an accumulation period for accumulating the signal charge in the charge accumulator, the second voltage supply circuit supplies the second voltage. | 2021-10-21 |
20210329182 | DUAL RAMP PIXEL READOUT - An image sensor includes a plurality of pixel columns and a plurality of readout circuits. Each readout circuit is coupled to one of the plurality of pixel columns and includes an ADC for receiving a first analog signal of a pixel in a reset conversion phase and a second analog signal of the pixel in a signal measurement phase, a dual-ramp generator for generating a first ramp having a first ramp rate and a second ramp having a second ramp rate greater than the first ramp rate and providing the first ramp to the readout circuits in the reset conversion phase and the second ramp to the plurality of readout circuits in the signal measurement phase, and a controller configured to provide control signals to the readout circuits and the dual-ramp generator. | 2021-10-21 |
20210329183 | IMAGING ELEMENT, DRIVING METHOD, AND ELECTRONIC DEVICE - A pixel is included, the pixel including a photoelectric conversion portion configured to convert incident light to a charge by photoelectric conversion and accumulate the charge, a charge transfer unit configured to transfer the charge generated in the photoelectric conversion portion, a diffusion layer to which the charge is transferred through the charge transfer unit, the diffusion layer having a predetermined storage capacitance, a conversion unit configured to convert the charge transferred to the diffusion layer to a pixel signal, and connection wiring configured to connect the diffusion layer and the conversion unit. The connection wiring is connected to the diffusion layer and the conversion unit through contact wiring extending in a vertical direction with respect to a semiconductor substrate on which the diffusion layer is formed and is formed closer to the semiconductor substrate than other wiring provided in the pixel. | 2021-10-21 |
20210329184 | IMAGING DEVICE AND IMAGING METHOD - An imaging device acquires first dark image data in a state where an image sensor has been light shielded, acquires second dark image data in a state where the image sensor has been light shielded, based on completion of exposure, corrects fixed pattern noise of a reference combined image data based on at least one of the first dark image data and the second dark image data, and stores the reference combined image data that has been subjected to correction. | 2021-10-21 |
20210329185 | IMAGE SENSOR WITH SHARED GRAY CODE GENERATOR AND PARALLEL COLUMN ARITHMETIC LOGIC UNITS - A readout circuit for use in an image sensor includes a plurality of comparators. Each one of the plurality of comparators is coupled to receive a ramp signal and a respective analog image data signal from a respective one of a plurality of column bit lines to generate a respective comparator output. Each one of a plurality of arithmetic logic units (ALUs) is coupled to receive phase-aligned Gray code (GC) outputs generated by a GC generator. Each one of the plurality of ALUs is further coupled to a respective one of the plurality of comparators to receive the respective comparator output. Each one of the plurality of ALUs is coupled to latch the phase-aligned GC outputs in response to the respective comparator output to generate a respective digital image data signal. | 2021-10-21 |
20210329186 | SOLID-STATE IMAGING ELEMENT AND ELECTRONIC EQUIPMENT - The present disclosure relates to a solid-state imaging element and electronic equipment that make it possible to sufficiently secure a time width of a pulse signal. In an AD converter for each unit pixel, a pulse generation circuit feeds back a delay signal obtained by delaying an output signal of the comparator to the comparator and arithmetically operates the output signal and the delay signal to generate a pulse signal. A latch circuit latches the pulse signal generated by the pulse generation circuit. The present disclosure can be applied to a solid-state imaging element of a stacked type and a back side illumination type. | 2021-10-21 |
20210329187 | ANALOG-TO-DIGITAL CONVERSION SYSTEMS AND METHODS WITH PULSE GENERATORS - Techniques are disclosed for analog-to-digital conversion systems and methods with pulse generators. In one example, an imaging system includes an analog-to-digital converter (ADC). The ADC includes a comparator configured to generate a comparator output signal based on a first signal and a second signal. The comparator output signal is associated with a first state or a second state. The ADC further includes a pulse generator coupled to the comparator. The pulse generator is configured to generate a pulse signal in response to a transition of the comparator output signal from the first state to the second state. The ADC further includes a memory device coupled to the pulse generator. The memory device is configured to capture a counter value from a counter circuit in response to the pulse signal. The counter value is associated with the detector signal. Related methods are also provided. | 2021-10-21 |
20210329188 | SOLID-STATE IMAGING ELEMENT AND IMAGING DEVICE - Power consumption is reduced in a solid-state imaging element including a differential input circuit for each pixel. | 2021-10-21 |
20210329189 | DIGITAL PIXEL ARRAY WITH MULTI-STAGE READOUTS - Examples of an apparatus are disclosed. In some example, an apparatus may include an array of digital pixel cells, each digital pixel cell including a photodiode and a memory device to store a digital output generated based on charge generated by the photodiode in an exposure period. The apparatus may also include an image processor configured to: receive first digital outputs from the memory devices of a first set of digital pixel cells of the array of digital pixel cells; determine, from the first set of digital pixel cells, a second set of digital pixel cells of which the first digital outputs satisfy one or more pre-determined conditions; identify, based on the second set of digital pixel cells, a third set of digital pixel cells; receive the second digital outputs generated by the third set of digital pixel cells; and perform image processing operations based on the second digital outputs. | 2021-10-21 |
20210329190 | SOLID STATE IMAGING ELEMENT, ELECTRONIC APPARATUS, AND POWER NOISE CORRECTION METHOD - A solid state imaging element ( | 2021-10-21 |
20210329191 | CONTROL METHOD AND CIRCUITRY OF RECEIVER - The present invention provides a control method of a receiver. The control method includes the steps of: when the receiver enters a sleep/standby mode, continually detecting an auxiliary signal from an auxiliary channel to generate a detection result; and if the detection result indicates that the auxiliary signal has a preamble or a specific pattern, generating a wake-up control signal to wake up the receiver before successfully receiving the auxiliary signal having a wake-up command. | 2021-10-21 |
20210329192 | RECORDING AND REPRODUCING APPARATUS AND METHOD OF CONTROLLING RECORDING AND REPRODUCING APPARATUS - An apparatus includes a first writing unit configured to write data to a recording medium in a first unit, a second writing unit configured to write data to the recording medium in a second unit smaller than the first unit, a reading unit configured to read data from the recording medium, and a control unit configured to perform control, in response to an instruction of reading data from the recording medium during writing data by the first writing unit, to stop writing data by the first writing unit, and then to read data from the recording medium by the reading unit, and, in response to completion of reading data from the recording medium, to write data in the second unit by the second writing unit. | 2021-10-21 |
20210329193 | MOTION DETECTION METHODS AND IMAGE SENSOR DEVICES CAPABLE OF GENERATING RANKING LIST OF REGIONS OF INTEREST AND PRE-RECORDING MONITORING IMAGES - A motion detection method applied into an image sensor device includes: providing a plurality of regions of interest (ROIs) on at least one monitoring image; for each region of interest (ROI): detecting whether at least one motion event occurs within the each ROI; and determining a priority level of the each ROI according to at least one feature information of the at least one motion event; and determining an alarm schedule of the ROIs for a user according to a plurality of priority levels of the RIOs. | 2021-10-21 |
20210329194 | REPRODUCTION DEVICE, REPRODUCTION METHOD, AND RECORDING MEDIUM - The present technology relates to a reproduction device, a reproduction method, and a recording medium that enable content having a wide dynamic range of brightness to be displayed with an appropriate brightness. A recording medium, on which the reproduction device of one aspect of the present technology performs reproduction, records coded data of an extended video that is a video having a second brightness range that is wider than a first brightness range, brightness characteristic information that represents a brightness characteristic of the extended video, and brightness conversion definition information used when performing a brightness conversion of the extended video to a standard video that is a video having the first brightness range. The reproduction device decodes the coded data and converts the extended video obtained by decoding the coded data to the standard video on the basis of the brightness conversion definition information. | 2021-10-21 |
20210329195 | METHOD AND APPARATUS FOR INTERPOLATING FRAME TO VIDEO, AND ELECTRONIC DEVICE - The disclosure provides a method and an apparatus for interpolating a frame to a video. A first deep-level feature of a first frame is obtained and a second deep-level feature of a second frame is obtained. Forward optical flow information and inverse optical flow information between the first frame and the second frame are obtained based on first deep-level feature and the second deep-level feature. An interpolated frame between the first frame and the second frame is generated based on the forward optical flow information and the inverse optical flow information, and the interpolated frame is inserted between the first frame and the second frame. | 2021-10-21 |
20210329196 | RECTILINEAR VIEWPORT EXTRACTION FROM A REGION OF A WIDE FIELD OF VIEW USING MESSAGING IN VIDEO TRANSMISSION - Rectilinear viewport extraction from a region of a wide field of view is described using messaging in the video transmission field. Some embodiments pertain to a method that includes receiving a wide field of view video, receiving position data from a remote coupled user device, selecting a region of interest in the video based on the received position data, extracting the region of interest from the video, generating region metadata describing the extracted region of interest, encoding the extracted region of interest of the video, and transmitting the encoded video with the region metadata to the user device. | 2021-10-21 |
20210329197 | Hand-Up Initiating and Responding Method and Interactive System in Multi-Party Video Activity - A hand-up initiating and responding method and interactive system in a multi-party video activity are disclosed. The hand-up initiating method in a multi-party video activity includes: step 1) pressing a hand-up button, sending a hand-up message, and updating a hand-up status in a local video window and hand-up statuses in a local roster; step 2) releasing the hand-up button, and starting countdown; step 3) sending a hand-up cancellation message and updating the hand-up status in the local video window and the hand-up statuses in the local roster at the end of the countdown; and step 4) if the hand-up button is pressed again within the countdown time, skipping to step 2) without sending a hand-up message. The present invention provides a special interactive mode, in which when a participant raises a question, an initiator can perceive in real time and respond in time. | 2021-10-21 |
20210329198 | CONTROLLING SENSORS OF A DEVICE AND NOTIFYING SENSOR CLIENTS - Techniques for disabling a sensor are described. In an example, the techniques include receiving input data indicating a request to disable a sensor of the device. Based on the input data, the sensor is disabled by at least decoupling the sensor from a power source and decoupling the sensor from an input terminal of a processor of the device. The techniques also include sending, to a plurality of clients that are implemented on the device and that are configured to receive sensor data generated by the sensor, notification data indicating that the sensor is disabled. Further, the techniques include outputting, by a user interface of the device, an indication that the sensor is disabled. | 2021-10-21 |
20210329199 | SYSTEM AND METHOD FOR MOVING AND ALIGNING TANDEM AXLE LOCK PINS ON A SEMI-TRAILER - A system and method for moving and aligning tandem axle lock pins on a semi-trailer, having a viewer and a remote receiver that are placeable in communication with each other. The viewer is attachable to a trailer so that a camera on the viewer can be positioned such that the trailer slide rail and tandem axle slider frame of a trailer are within the field of vision. The remote receiver may be a smartphone which can access data from the camera so that the user can from a remote location, such as a cab of a tractor, determine the alignment and orientation of the trailer slide rail and the tandem axle slider frame. | 2021-10-21 |
20210329200 | VIDEO DELIVERY SYSTEMS USING WIRELESS CAMERAS - A wearable form factor wireless camera may include an image sensor, coupled to an infrared detection module, which captures infrared video. The wearable form factor wireless camera may attach to clothing worn on a user and be ruggedized. A storage device may store the captured infrared video at a first fidelity. The stored infrared video may be capable of being transmitted at the first fidelity and at a second fidelity, with the first fidelity providing a higher frame rate than the second fidelity. A burst transmission unit may transmit the stored infrared video at the second fidelity via a cellular network. The infrared detection module, the image sensor, the storage device and the burst transmission unit may be powered by a battery. The image sensor, the infrared detection module, the battery, the storage device and the burst transmission unit may be internal to the wearable form factor wireless camera. | 2021-10-21 |
20210329201 | CAMERA MODULE ALIGNING METHOD - A camera module aligning method includes the following steps. Firstly, a reference chart having plural chart characteristic points is provided. Then, a camera module is used to shoot the reference chart, and an installation position and an installation posture of the camera module are acquired according to an internal parameter matrix and an external parameter matrix. When the camera module shoots the reference chart and an image is formed on an imaging plane of the camera module, a relationship between at least one image characteristic point of the image and the corresponding chart characteristic point complies with a standard relationship. The standard relationship is defined by the internal parameter matrix and the external parameter matrix. | 2021-10-21 |
20210329202 | IMAGE BLENDING METHOD, PROJECTION SYSTEM AND PROCESSING DEVICE THEREOF - The disclosure provides an image blending method. The method includes projecting a plurality of images onto a projection surface, respectively, wherein an image of the first portion of the first image and an image of the first portion of the second image projected onto the projection surface overlap each other in the first overlapping area on the projection surface; the image parameters of all pixels of the first non-overlapping area and the second non-overlapping area are adjusted according to the position of the first non-overlapping area and the position of the second non-overlapping area, such that the black-level brightness of the first non-overlapping image in the first non-overlapping area of the first image and the black-level brightness of the second non-overlapping image in the second non-overlapping area of the second image are close to the black-level brightness of the first overlapping image in the first overlapping area. | 2021-10-21 |
20210329203 | PROJECTION METHOD AND PROJECTION DEVICE - The disclosure provides a projection method and projection device. The method comprises: acquiring a sound signal sent by a user; performing locating to determine a positional relationship between the user and the projection device according to the sound signal sent by the user; determining a projected image orientation meeting viewing requirements of the user according to the positional relationship between the user and the projection device; and projecting an image to be projected onto a projection plane according to the projected image orientation. By use of the projection method provided by the disclosure, the projected image orientation may be automatically adjusted according to the viewing requirements of the user, and convenience and friendliness for human-computer interaction may be improved. | 2021-10-21 |
20210329204 | METHOD AND APPARATUS FOR PRODUCING 360 DEGREE IMAGE CONTENT ON RECTANGULAR PROJECTION BY SELECTIVELY APPLYING IN-LOOP FILTER - Accordingly embodiments herein disclose a method for producing 360 degree image content on a rectangular projection. The method includes detecting whether at least one discontinuous boundary is present in the 360-degree image content, wherein the at least one discontinuous boundary is detected using the packing of one or more projection segments. Further, the method includes obtaining one or more reconstructed blocks from the 360-degree image content. The reconstructed blocks are generated from the 360 degree image content. Further, the method includes performing one of enabling at least one in-loop filtering function on the one or more reconstructed blocks of the 360 degree image content when the at least one of image content discontinuous boundary is not present and disabling at least one in-loop filtering function on the one or more reconstructed blocks of the 360 degree image content located around the at least one discontinuous boundary. | 2021-10-21 |
20210329205 | INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND PROGRAM - [Object] To set a projection region for video at various positions desired by a user and easily project the video on the projection region. [Solving Means] An information processing apparatus includes an input unit and a control unit. The input unit to which sensing information and coordinate information are input, the sensing information being obtained by sensing a space in which video is projected, the coordinate information being obtained by pointing through a pointing operation of the space by a user. The control unit stores setting information for setting a projection region in a predetermined range in a storage unit on the basis of a result of analyzing a state in the space on the basis of the sensing information and the coordinate information. Then, the control unit controls, in a case where a projection region is designated by the user on the basis of the stored setting information, a projection apparatus to project the video onto the projection region. | 2021-10-21 |
20210329206 | PROCESSING IMAGES CAPTURED BY A CAMERA BEHIND A DISPLAY - A method includes capturing, by a camera disposed behind a display panel of an electronic device, an original image through a semi-transparent pixel region of the display panel. The original image includes one or more color components. The method further includes determining, for a plurality of pixel regions of the original image, a point spread function (PSF) for each of the one or more color components. The method further includes performing, for the plurality of pixel regions of the original image, a deconvolution of each of the one or more color components of the original image based at least in part on their respective PSFs. The method thus includes generating a reconstructed image corresponding to the original image based on the deconvolutions of the one or more color components of the plurality of pixel regions of the original image. | 2021-10-21 |
20210329207 | IMAGE DISPLAYING METHOD, APPARATUS AND ELECTRONIC DEVICE - Embodiments of the present invention relate to an image displaying method, apparatus and electronic device. The image displaying method includes: acquiring brightness information of a current image; and adjusting a color of the current image or descriptive information according to the brightness information of the image, so that the color of the image and the color of the descriptive information have a preset degree of contrast. In the embodiments of the present invention, the color of the current image or the descriptive information of the image is adjusted according to the brightness information of the image, so that the color of the image matches the color of the descriptive information. In this way, a user can obtain a better viewing experience. | 2021-10-21 |
20210329208 | Illuminant estimation referencing facial color features - Disclosed is a method and apparatus of illuminant estimation referencing characterized facial color features in a digital image. Example embodiments of automatic white balance of the digital image leveraging the illuminant estimation are illustrated. | 2021-10-21 |
20210329209 | METHOD FOR PROCESSING IMMERSIVE VIDEO AND METHOD FOR PRODUCING IMMERSIVE VIDEO - A method of producing an immersive video comprises decoding an atlas, parsing a flag for the atlas, and producing a viewport image using the atlas. The flag may indicate whether the viewport image is capable of being completely produced through the atlas, and, according to a value of the flag, when the viewport image is produced, it may be determined whether an additional atlas is used in addition to the atlas. | 2021-10-21 |
20210329210 | METHOD OF OUTPUTTING THREE-DIMENSIONAL IMAGE AND ELECTRONIC DEVICE PERFORMING THE METHOD - A method and apparatus for outputting a three-dimensional (3D) image are provided. To output a 3D image, a stereo image is generated based on viewpoints of a user and rendered into a 3D image. Since the stereo image is generated based on the viewpoints of the user, the user views a different side of an object appearing in the 3D image depending on a viewpoint of the user. | 2021-10-21 |
20210329211 | STEREO DEPTH ESTIMATION - An in-stream disparity processing system comprises a delay block having an input for receiving an input stream of disparity cost vectors, and configured to provide a delayed stream of disparity cost vectors at an output of the delay block, by delaying the input stream by a predetermined amount; and a processing block having a cost input connected to receive the delayed stream of disparity cost vectors and a smoothing input connected to receive the input stream of disparity cost vectors, and configured to apply cost smoothing to the delayed stream based on the input stream, so as to generate, at an output of the processing block, a stream of reverse pass disparity cost vectors. | 2021-10-21 |
20210329212 | PROCESSING METHOD AND PROCESSING SYSTEM FOR MULTIPLE DEPTH INFORMATION - A processing method and a processing system for multiple depth information are provided. The processing method for multiple depth information includes the following steps. A plurality of first images and a plurality of second images are obtained. The first images and the second images are inputted to the same depth generating unit. The first images and the second images are calculated by the depth generating unit to obtain a plurality of depth information corresponding to the first images and the second images. | 2021-10-21 |
20210329213 | FUSION METHOD AND FUSION SYSTEM FOR MULTIPLE DEPTH INFORMATION - A fusion method and a fusion system for multiple depth information are provided. A first depth information is obtained by a first image capturing module. A second depth information is obtained by a second image capturing module. Through a non-linear transformation, the first depth information is transformed into a first transformation information, and the second depth information is processed according to the first transformation information to generate a transformed information; or the first depth information and the second depth information are merged to be a fusion information, which is then transformed into the transformed information through the nonlinear transformation. | 2021-10-21 |
20210329214 | AN APPARATUS FOR TRANSMITTING A VIDEO, A METHOD FOR TRANSMITTING A VIDEO, AN APPARATUS FOR RECEIVING A VIDEO, AND A METHOD FOR RECEIVING A VIDEO - In accordance with embodiments, a decoder may be referred to as a receiver to decode video data and/or signaling information in accordance with embodiments. The decoder may be interpreted on the ground of some embodiments of the disclosure and can provide effects of efficient decoding performance and regenerating view performance. | 2021-10-21 |
20210329215 | SYSTEMS AND METHODS FOR STABILIZING VIEWS OF VIDEOS - A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint. | 2021-10-21 |
20210329216 | METHOD FOR TRANSMITTING VIDEO, APPARATUS FOR TRANSMITTING VIDEO, METHOD FOR RECEIVING VIDEO, AND APPARATUS FOR RECEIVING VIDEO - An apparatus for receiving a video according to embodiments of the present invention comprises a decoder configured to decode bitstream based on viewing position and viewport information; an unpacker configured to unpack pictures in the decoded bitstream; a view regenerator configured to perform view regenerating the unpacked pictures; and a view synthesizer configured to perform view synthesis on the view regenerated pictures. A method of transmitting a video, the method comprising inter-view redundancy removing pictures for multiple viewing positions; packing the inter-view redundancy removed pictures; and encoding the packed pictures and signaling information. | 2021-10-21 |
20210329217 | METHOD AND AN APPARATUS FOR GENERATING DATA REPRESENTATIVE OF A PIXEL BEAM - There are several types of plenoptic devices and camera arrays available on the market, and all these light field acquisition devices have their proprietary file format. However, there is no standard supporting the acquisition and transmission of multi-dimensional information. It is interesting to obtain information related to a correspondence between pixels of a sensor of said optical acquisition system and an object space of said optical acquisition system. Indeed, knowing which portion of the object space of an optical acquisition system a pixel belonging to the sensor of said optical acquisition system is sensing enables the improvement of signal processing operations. The notion of pixel beam, which represents a volume occupied by a set of rays of light in an object space of an optical system of a camera along with a compact format for storing such information is thus introduce. | 2021-10-21 |
20210329218 | CAMERA - A camera according to an embodiment of the present invention comprises: a light-emitting module for configured to output output light according to a set control mode; a light-receiving module configured to receive input light corresponding to the output light according to the control mode; and a control module configured to detect at least one of presence of a subject and a distance from the subject on the basis of the input light, reset the control mode according to a detection result, control an output of the light-emitting module and an input of the light-receiving module according to the reset control mode, and generate a depth map for the subject on the basis of the input light which is input according to the reset control mode. | 2021-10-21 |
20210329219 | TRANSFER OF ADDITIONAL INFORMATION AMONG CAMERA SYSTEMS - A method for enriching a target image, which a target camera system had recorded of a scene, with additional information, with which at least one source image that a source camera system had recorded of the same scene from a different perspective, has already been enriched. The method includes: assigning 3D locations in the three-dimensional space, which correspond to the positions of the source pixels in the source image, to source pixels of the source image; assigning additional information which is assigned to source pixels, to the respective, associated 3D locations; assigning those target pixels of the target image, whose positions in the target image correspond to the 3D locations, to the 3D locations; assigning additional information, which is assigned to 3D locations, to associated target pixels. A method for training a Kl module is also described. | 2021-10-21 |
20210329220 | MULTI-PASS ADD-ON TOOL FOR COHERENT AND COMPLETE VIEW SYNTHESIS - An embodiment of an image processor for immersive video includes technology to re-order patches from a plurality of views based on one or more of relative position and orientation related information for a desired synthesized view, select a set of views to be used in each view synthesis pass, perform two or more view synthesis passes for the synthesized view to provide two or more intermediate view synthesis results, and mask and merge the two or more intermediate view synthesis results to provide a final view synthesis result. Other embodiments are disclosed and claimed. | 2021-10-21 |
20210329221 | METHOD AND APPARATUS FOR CAMERA CALIBRATION - An imaging system is provided comprising: a memory storing instructions which, when executed by processing circuitry, cause the processing circuitry to perform operations comprising: determining multiple image regions of interest (ROIs) within a camera image plane that correspond to one or more three-dimensional (3D) world object images; determining multiple radar ROIs that correspond to one or more 3D world objects; determining 3D world distances corresponding to the radar ROIs; determining multiple co-registered ROI pairs by co-registering individual image ROIs with individual radar ROIs corresponding to common 3D world objects; adjusting one or more parameters associated with the camera, based upon the co-registered ROI pairs. | 2021-10-21 |
20210329222 | SYSTEM AND METHOD FOR CREATING A NAVIGABLE, THREE-DIMENSIONAL VIRTUAL REALITY ENVIRONMENT HAVING ULTRA-WIDE FIELD OF VIEW - The present invention relates to a system and method for capturing video of a real-world scene over a field of view that may exceed the field of view of a user, manipulating the captured video, and then stereoscopically displaying the manipulated image to the user in a head mounted display to create a virtual environment having length, width, and depth in the image. By capturing and manipulating video for a field of view that exceeds the field of view of the user, the system and method can quickly respond to movement by the user to update the display allowing the user to look and pan around, i.e., navigate, inside the three-dimensional virtual environment. | 2021-10-21 |
20210329223 | IMAGE ADJUSTMENT SYSTEM, IMAGE ADJUSTOR, AND IMAGE ADJUSTMENT METHOD - An image adjustment system includes a camera, an image adjustor, an image display, and a controller. The image adjustor includes an image generator and an image processor. The image generator generates a spherical image and a composite image to be synthesized with a shooting image imaged by the camera. The image processor acquires the spherical image generated by the image generator and displays the spherical image on an image display. The image processor rotates the spherical image based on instruction information output from the controller, adjusts the shooting image displayed on the image display in accordance with rotating the spherical image, adjusts the composite image in accordance with the adjusted shooting image, and synthesizes the adjusted composite image with the adjusted shooting image. | 2021-10-21 |
20210329224 | PICTURE CODING DEVICE, PICTURE CODING METHOD, AND PICTURE CODING PROGRAM, PICTURE DECODING DEVICE, PICTURE DECODING METHOD, AND PICTURE DECODING PROGRAM - Technology for improving coding efficiency by performing a block split suitable for picture coding and decoding is provided. A device includes a coding information storage unit configured to add the inter prediction information used in the inter prediction to a history-based motion vector predictor candidate list; a history-based motion vector predictor candidate derivation unit configured to derive history-based motion vector predictor candidates from the history-based motion vector predictor candidate list; and a history-based merging candidate derivation unit configured to derive history-based merging candidates from the history-based motion vector predictor candidate list, wherein the history-based motion vector predictor candidate derivation unit and the history-based merging candidate derivation unit set candidates included in the history-based motion vector predictor candidate list as the history-based motion vector predictor candidates or the history-based merging candidates with reference to the candidates included in the history-based motion vector predictor candidate list in orders different from each other. | 2021-10-21 |
20210329225 | Context Modeling Method and Apparatus for Flag - A context modeling method includes: determining, for a current block, whether a first preset condition is satisfied and whether a second preset condition is satisfied, where the first preset condition is a preset condition related to a first neighboring block neighboring to the current block in a first direction, the second preset condition is a preset condition related to a second neighboring block neighboring to the current block in a second direction; determining a subclass index of a context model of a first flag of the current block based on the height and the width of the current block; and determining the context model of the first flag of the current block based on a satisfaction status of the first preset condition, a satisfaction status of the second preset condition, and the subclass index of the context model of the first flag. | 2021-10-21 |
20210329226 | Support of Adaptive Resolution Change In Video Coding - A video coding mechanism is disclosed. The mechanism includes receiving a bitstream including a plurality of picture parameter sets (PPSs) and a plurality of pictures at a plurality of picture sizes. A first picture size of a first picture is determined from a first PPS. The first picture is decoded at the first picture size to create a decoded reference picture. The decoded reference picture is stored in a decoded picture buffer. A second picture size of a second picture is determined from a second PPS. The second picture references the decoded reference picture according to inter-prediction. The decoded reference picture is scaled from the first picture size to the second picture size. The second picture is decoded at the second picture size based on the decoded reference picture at the second picture size. | 2021-10-21 |
20210329227 | VIDEO PROCESSING METHOD AND DEVICE THEREOF - A video processing method includes obtaining a historical motion information candidate list, and encoding or decoding a plurality of first image blocks in a first region of a current frame according to the historical motion information candidate list. The historical motion information candidate list is obtained based on motion information of one or more second image blocks each being an encoded or decoded image block in a second region of the current frame outside the first region. | 2021-10-21 |
20210329228 | METHOD AND APPARATUS FOR FURTHER IMPROVED CONTEXT DESIGN FOR PREDICTION MODE AND CODED BLOCK FLAG (CBF) - A method of controlling intra-inter prediction for decoding or encoding of a video sequence, is performed by at least one processor. The method includes determining whether one or more neighboring blocks in a video sequence is coded by an intra prediction mode, coding a prediction mode flag of a current block by a first context based on determining that at least one of the neighboring blocks is coded by the intra prediction mode, and coding the prediction mode flag of the current block by a second context based on determining that none of the neighboring blocks are coded by at least the intra prediction mode. | 2021-10-21 |
20210329229 | VIDEO PICTURE DECODING AND ENCODING METHOD AND APPARATUS - This application provides a video picture decoding and encoding method and a video picture decoding and encoding apparatus. When it is determined that a merge or skip mode is used, if it is determined through decoding that an MMVD indicator is true, a triangle PU indicator may not be coded. The triangle PU indicator is coded only when it is determined through decoding that the MMVD indicator is false. This reduces a quantity of used coding resources, and can reduce bit overheads of a bitstream. | 2021-10-21 |
20210329230 | Method and Apparatus of Intra Prediction with MPM Generation in Image and Video Processing - An intra prediction method comprises receiving input data of a current block in a current picture, deriving multiple Most Probable Modes (MPMs) to be included in a MPM list for the current block, setting remaining intra prediction modes as non-MPMs, and encoding or decoding the current block according to a current intra prediction mode selecting from the MPMs and non-MPMs. The first MPM in the MPM list is Planar mode for blocks coded or to be coded in intra prediction, and one or more other MPMs in the MPM list are derived according to a number of available angular mode of one or more neighboring blocks of the current block. | 2021-10-21 |
20210329231 | MODE LIST GENERATION FOR MULTI-LINE INTRA PREDICTION - A method of signaling an intra prediction mode used to encode a current block in an encoded video bitstream includes generating a first most probable mode (MPM) list corresponding to a zero reference line of the current block, wherein the first MPM list includes a first plurality of intra prediction modes; generating a second MPM list corresponding to one or more non-zero reference lines of the current block, wherein the second MPM list includes a second plurality of intra prediction modes, the second plurality of intra prediction modes including a subset of the first plurality of intra prediction modes; signaling a reference line index indicating a reference line used to encode the current block; and signaling an intra mode index indicating the intra prediction mode from among the first MPM list and the second MPM list. | 2021-10-21 |
20210329232 | IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD AND IMAGE PROCESSING PROGRAM - An image processing device that updates a pixel value of a processing target image and generates a new image generates a first feature vector based on the processing target image and a first feature map generated with at least one pre-decided filter; updates the processing target image to generate an updated image; generates a second feature vector based on the updated image and a second feature map generated with at least one pre-decided filter; performs quality evaluation of the updated image based on the first and second feature vectors and generates a quality feedback vector which is a vector based on a result of the quality evaluation; performs an encoding amount evaluation on the updated image and generates an encoding amount feedback vector which is a vector based on a result of the encoding amount evaluation; and determines an updating amount in updating of the updated image based on the quality feedback vector and the encoding amount feedback vector. | 2021-10-21 |
20210329233 | Methods and Apparatuses of Processing Video Pictures with Partition Constraints in a Video Coding System - Video processing methods and apparatuses in a video encoding or decoding system for processing a video picture partitioned into blocks with one or more partition constraints. The video encoding or decoding system receives input data of a current block and checks whether a predefined splitting type is allowed to partition the current block according to first and second constraints. The first constraint restricts each sub-block partitioned from the current block to be completely contained in one pipeline unit, and the second constraint restricts each sub-block partitioned from the current block to contain one or more complete pipeline units. The pipeline units are non-overlapping units in the video picture designed for pipeline processing. The current block is not partitioned by the predefined splitting type if any sub-block partitioned by the predefined splitting type violates both the first and second constraints. The system encodes or decodes the current block. | 2021-10-21 |
20210329234 | METHOD FOR ENCODING/DECODING IMAGE AND DEVICE THEREFOR - Provided is an image decoding method of decoding an image, the image decoding method including: obtaining at least one of block shape information and split shape information about a first coding unit included in the image, from a bitstream; determining at least one second coding unit included in the first coding unit based on at least one of the block shape information and the split shape information; and decoding the image based on the at least one second coding unit, wherein the block shape information indicates a shape of the first coding unit and the split shape information indicates whether the first coding unit is split into the at least one second coding unit. Also, provided is an image encoding method corresponding to the image decoding method. Also, provided is an image encoding apparatus and image decoding apparatus for respectively performing the image encoding method and image decoding method. | 2021-10-21 |
20210329235 | IMAGE CODING APPARATUS, IMAGE CODING METHOD, IMAGE DECODING APPARATUS, IMAGE DECODING METHOD, AND PROGRAM - An image coding apparatus configured to divide an image into one or more slices each including a plurality of blocks and to code each slice on a block-by-block basis includes a first coding unit configured to code blocks included in a first portion of the slice, and a second coding unit configured to code blocks included in a second portion of the slice, wherein, when the second coding unit codes an initial block in the second portion, the second coding unit codes the initial included in the second portion by referring to a first quantization parameter provided to the slice as an initial value and referred to by the first coding unit when the first coding units codes the initial block in the first portion. | 2021-10-21 |
20210329236 | Explicit Address Signaling In Video Coding - A video coding mechanism is disclosed. The mechanism includes receiving a sub-bitstream including: a sub-picture of a picture partitioned into a plurality of slices including a first slice, a parameter set associated with the picture and the sub-picture, and a slice header associated with the first slice. The parameter set is parsed to obtain an identifier and a length of a slice address of the first slice. A slice address for the first slice is determined from the slice header based on the identifier and the length of the slice address. The sub-bitstream is decoded to create a video sequence of sub-pictures including the first slice. The video sequence of sub-pictures is forwarded for display. | 2021-10-21 |
20210329237 | VIDEO CODING METHOD AND APPARATUS USING ANY TYPES OF BLOCK PARTITIONING - The present invention relates to a block partitioning structure in video coding technology, and a video encoding and decoding method and apparatus using the same, wherein the video encoding and decoding method includes the steps of acquiring quad-partitioning information of a block; acquiring bi-partitioning information of the block when the acquired quad-partitioning information of the block does not indicate four partitions; acquiring partitioning direction information for bi-partitioning of the block when the acquired bi-partitioning information of the block indicates two partitions; acquiring information on whether to perform any other type of partitioning, when the acquired bi-partitioning information of the block does not indicate two partitions; and acquiring additional information required for the any other type of partitioning, when the acquired information on whether to perform any other type of partitioning indicates that the any other type of partitioning is performed. | 2021-10-21 |
20210329238 | VIDEO SIGNAL ENCODING/DECODING METHOD AND APPARATUS - An image signal decoding method according to the present invention comprises the steps of: decoding information indicating whether a current block is encoded using a multi-mode intra prediction; when it is determined that the current block is encoded in the multi-mode intra prediction, dividing the current block into a plurality of partial blocks; and obtaining an intra prediction mode of each of the plurality of partial blocks. | 2021-10-21 |
20210329239 | METHODS AND APPARATUS OF VIDEO CODING FOR TRIANGLE PREDICTION - A method for video coding is provided. The method includes: partitioning video pictures into a plurality of coding units (CUs), at least one of which is further portioned into two prediction units (PUs) including at least one triangular shaped PU with a partitioning orientation in one of: from top-left corner to bottom-right corner, and from top-right corner to bottom-left corner; constructing a uni-prediction motion vector candidate list; determining whether a current CU is coded as triangle prediction mode according to coded information; signaling a partition orientation flag indicating the partitioning orientation; and signaling index values that indicate selected entries in the constructed uni-prediction motion vector candidate list. | 2021-10-21 |
20210329240 | APPARATUS AND METHOD FOR VIDEO ENCODING OR DECODING SUPPORTING VARIOUS BLOCK SIZES - Disclosed herein is video encoding or decoding for efficiently encoding video. The techniques of the present disclosure are related to various split shapes of a block, syntaxes representing various split types of blocks, and syntax elements represented at a high level therefor. | 2021-10-21 |
20210329241 | APPARATUS AND METHOD FOR VIDEO ENCODING OR DECODING SUPPORTING VARIOUS BLOCK SIZES - Disclosed herein is video encoding or decoding for efficiently encoding video. The techniques of the present disclosure are related to various split shapes of a block, syntaxes representing various split types of blocks, and syntax elements represented at a high level therefor. | 2021-10-21 |
20210329242 | COEFFICIENT DEPENDENT CODING OF TRANSFORM MATRIX SELECTION - A video processing method includes checking, during a conversion from a coded representation of a current video block to the current video block, a position of a last non-zero coefficient of the current video block, wherein the position is relative to a top-left position of the current video block; and performing a determination, based on the position, whether or not to parse a syntax element which signals a transform information in the coded representation. | 2021-10-21 |
20210329243 | METHOD AND APPARATUS FOR SELECTING TRANSFORM SELECTION IN AN ENCODER AND DECODER - There are provided mechanisms for methods and apparatuses for transform selection in encoding and decoding of video blocks. | 2021-10-21 |
20210329244 | UPSAMPLING FOR SIGNAL ENHANCEMENT CODING - There is disclosed a method of encoding an input signal, the method comprising: receiving a base encoded signal, the base encoded signal being generated by feeding an encoder with a down-sampled version of an input signal; producing a first residual signal by: decoding the base encoded signal to produce a first decoded signal; and using a difference between the base decoded signal and the down-sampled version of the input signal to produce the first residual signal; producing a second residual signal by: correcting the base decoded signal using the residual signal to create a corrected decoded version; up-sampling the corrected decoded version; and using a difference between the up-sampled corrected decoded signal and the input signal to produce the second residual signal; wherein the up-sampling is one of bilinear or bicubic up-sampling. A corresponding decoding method is also disclosed. | 2021-10-21 |
20210329245 | TRANSFORMS FOR LARGE VIDEO AND IMAGE BLOCKS - Improved transforms are used to encode and decode large video and image blocks. During encoding, a prediction residual block having a large size (e.g., larger than 32×32) is generated. The pixel values of the prediction residual block are transformed to produce transform coefficients. After determining that the transform coefficients exceed a threshold cardinality representative of a maximum transform block size (e.g., 32×32), a number of the transform coefficients are discarded such that a remaining number of transform coefficients does not exceed the threshold cardinality. A transform block is then generated using the remaining number. During decoding, after determining that the transform coefficients exceed the threshold cardinality, a number of new coefficients are added to the transform coefficients such that a total number of transform coefficients exceeds the threshold cardinality. The transform coefficients are then inverse transformed into a prediction residual block having a large size. | 2021-10-21 |
20210329246 | ARCHITECTURE FOR SIGNAL ENHANCEMENT CODING - There is disclosed a method of encoding an input signal, the method comprising producing a base encoded signal by feeding an encoder with a down-sampled version of an input signal. The method further comprising producing a first quantised residual signal by: decoding the base encoded signal to produce a base decoded signal; and using a difference between the base decoded signal and the down-sampled version of the input signal to produce a first residual signal; quantising the first residual signal to produce the first quantised residual signal. The method further comprises producing a second residual signal by: de-quantising the first quantised residual signal to produce a reconstructed version of the first residual signal; correcting the base decoded signal using the first reconstructed version of the residual signal to create a corrected decoded version; upsampling the corrected decoded version; and using a difference between the corrected decoded signal and the input signal to produce the second residual signal. | 2021-10-21 |
20210329247 | RECEIVING APPARATUS, RECEIVING METHOD, TRANSMITTING APPARATUS, AND TRANSMITTING METHOD - It is made possible to reduce motion picture quality degradation caused by strobing in a layer of a basic frame frequency and to maintain a high image quality in layers of the other frame frequencies. | 2021-10-21 |
20210329248 | CHROMA CODING MODE DETERMINATION BASED ON MATRIX-BASED INTRA PREDICTION - Devices, systems and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes performing a first determination that a luma video block of a video is coded using a matrix based intra prediction (MIP) mode in which a prediction block of the luma video block is determined by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation, performing, based on the first determination, a second determination about a chroma intra mode to be used for a chroma video block associated with the luma video block, and performing, based on the second determination, a conversion between the chroma video block and a bitstream representation of the chroma video block. | 2021-10-21 |
20210329249 | IMAGE CODING METHOD BASED ON SECONDARY TRANSFORM AND APPARATUS THEREFOR - An image decoding method according to the present document comprises the steps of: receiving a quantized transform coefficient for a target block and a transform index for a non-separable secondary transform; dequantizing the quantized transform coefficients to derive transform coefficients; deriving modified transform coefficients on the basis of a matrix operation of a transform kernel matrix in a transform set indicated by the transform index and a transform coefficient list corresponding to the magnitude of dequantized transform coefficients; clipping the modified transform coefficients to a predetermined range of values; and deriving residual samples for the target block on the basis of an inverse primary transform with respect to the modified transform coefficients clipped. | 2021-10-21 |
20210329250 | MOTION VECTOR DERIVATION BETWEEN DIVIDING PATTERNS - A method for processing video data, including: deriving one or more motion vectors for a first set of sub-blocks belonging to a first dividing pattern of a current video block of a video; and performing, based on the one or more motion vectors, a conversion between the current video block and a bitstream of the video. | 2021-10-21 |
20210329251 | INTER PREDICTION METHOD AND APPARATUS, AND CORRESPONDING ENCODER AND DECODER - An inter prediction method and apparatus, and a corresponding encoder and decoder are disclosed. The method includes: obtaining an index value of a length of a motion vector difference of the current picture block; determining target length information from a set of candidate length information based on the index value of the length; obtaining the motion vector difference of the current picture block based on the target length information; determining the motion vector target value of the current picture block based on the motion vector difference of the current picture block and the motion vector predictor of the current picture block; and obtaining a prediction block of the current picture block based on the motion vector target value of the current picture block. | 2021-10-21 |
20210329252 | MOTION INFORMATION ACQUISITION METHOD AND DEVICE FOR VIDEO ENCODING OR DECODING - A motion information acquisition method for video encoding or decoding includes acquiring a to-be-processed image block, where the to-be-processed image block is divided into coding units using quadtree division and non-quadtree division, determining a motion estimation region of the to-be-processed image block according to division information and size of quadtree division nodes of the to-be-processed image block, and obtaining motion information of a coding unit or decoding unit in the motion estimation region according to the motion estimation region. | 2021-10-21 |
20210329253 | ENCODING AMOUNT ESTIMATION APPARATUS, ENCODING AMOUNT ESTIMATION METHOD AND ENCODING AMOUNT ESTIMATION PROGRAM - A coding amount estimation device includes: a feature vector generation unit that generates a feature vector on the basis of a feature map generated by an estimation target image and at least one filter set in advance; and a coding amount evaluation unit that evaluates a coding amount of the estimation target image on the basis of the feature vector. | 2021-10-21 |
20210329254 | BITRATE CONTROL METHOD FOR VIDEO CODING - The present disclosure provides methods for controlling bitrates in encoding multiple video sequences. An exemplary method includes: setting a plurality of target bitrates for encoding a plurality of video sequences, respectively, each of the plurality of video sequences having a plurality of allowable bitrates that are larger than the target bitrate set for the corresponding video sequence; determining, among the plurality of video sequences, a first video sequence and a first allowable bitrate of the first video sequence; and changing the target bitrate for encoding the first video sequence to the first allowable bitrate. The changing of the target bitrate for encoding the first video sequence to the first allowable bitrate has a highest ratio of increase of encoding quality versus increase of bitrate, among the allowable bitrates for the plurality of video sequences, and causes a total bitrate for encoding the plurality of video sequences to be equal to or below a threshold. | 2021-10-21 |
20210329255 | Video Encoding Based on Customized Bitrate Table - An original input content is subjected to multiple constant quality probe encodes for a defined set of resolutions. In one embodiment, probe encodes encode a few parts of the original source video, for example, 30 seconds from 5 different positions. Each probe encode delivers an average bitrate that is required to achieve the configured constant quality. The mean value of the average bitrate is taken per resolution. This results in a list of bitrates that map to a resolution that would achieve the best quality, a custom bitrate: table. Based on the custom bitrate table, an optimized bitrate ladder is computed. The process starts with a configurable minimum bitrate and steps up by a bitrate step size that is between a configurable min and max bitrate step size until the bitrate of the highest resolution is reached. | 2021-10-21 |
20210329256 | METHOD FOR OPTIMIZING STRUCTURE SIMILARITY INDEX IN VIDEO CODING - The present disclosure provides a computer-implemented method for encoding video. The method includes: generating training data based on one or more video sequences, the training data including a structure similarity index comprising at least one of structure similarity index (SSIM) or multi-scale-structural similarity index (MS-SSIM); training a rate-distortion optimalization (RDO) model using the training data; processing the one or more video sequences using the rate-distortion optimalization model. | 2021-10-21 |
20210329257 | Hardware And Software Friendly System And Method For Decoder-Side Motion Vector Refinement With Decoder-Side Bi-Predictive Optical Flow Based Per-Pixel Correction To Bi-Predictive Motion Compensation - Methods and system, including decoders and encoders, for interprediction. In one aspect, a method includes selecting reference samples based on motion information of a current picture block of a current picture, deriving first interpolated samples by performing a first interpolation on the selected reference samples, deriving an integer distance delta motion vector for a target sub-prediction unit (PU) by performing integer-distance MVR, deriving M×M pixel matrix flow vectors by performing BPOF, for each M×M pixel matrix in the target sub-PU, based on the first interpolated samples and the integer distance delta motion vector, deriving second interpolated samples by performing a second interpolation on the reference samples, computing at least one correction parameter for the target sub-PU based on the M×M pixel matrix flow vectors, the first interpolated samples and the second interpolated samples, and performing bi-prediction based on the second interpolated samples and the at least one correction parameter. | 2021-10-21 |
20210329258 | METHOD AND APPARATUS FOR PROCESSING VIDEO SIGNAL - A method for processing a video signal according to the present invention comprises: determining a length of a current string, which is decoded on the basis of a sample string matching technique in a current block; determining a reference string on the basis of at least one between the length of the current string and a string vector for the current string; and predicting the current string using the reference string. | 2021-10-21 |
20210329259 | CHROMA INTRA PREDICTION METHOD AND DEVICE - A chroma intra prediction method and device are provided. The method applied to a decoder includes parsing bitstream data corresponding to a current chroma block, and determining that a prediction mode corresponding to the current chroma block is a direct mode (DM); determining an intra prediction mode of the current chroma block from a set of chroma prediction modes, wherein the set of chroma prediction modes comprises at least one of DM, LM, LM_T or LM_L; and determining a reconstructed value of the current chroma block according to the intra prediction mode. | 2021-10-21 |
20210329260 | INTER PREDICTION METHOD AND APPARATUS THEREFOR - According to the present invention, an inter prediction method comprises the steps of: generating a merge candidate list for a block to be predicted, wherein the block is to correspond to a current prediction unit; deriving, on the basis of one of a plurality of merge candidates constituting the merge candidate list, motion information on the block to be predicted; and performing, on the basis of the derived motion information, a prediction on the block to be predicted so as to generate a prediction block corresponding to the current prediction unit. | 2021-10-21 |
20210329261 | CHROMA BLOCK PREDICTION METHOD AND APPARATUS - This application provides a chroma block prediction method and apparatus. The method includes: obtaining chroma values of chroma samples; obtaining, luma values of luma samples corresponding to the chroma samples; obtaining, from the luma values, a first luma set and a second luma set; grouping the chroma values into a first chroma set and a second chroma set; determining a scaling coefficient in a linear model based on an average value of luma values in the first luma set, an average value of luma values in the second luma set, an average value of chroma values in the first chroma set, and an average value of chroma values in the second chroma set; determining, based on the scaling coefficient, an offset factor in the linear model; and determining prediction information of the chroma block based on the scaling coefficient and the offset factor. | 2021-10-21 |