Patent application number | Description | Published |
20090028248 | Video Encoding Method and Decoding Method, Apparatuses Therefor, Programs Therefor, and Storage Media for Storing the Programs - A video encoding method for encoding video images as a single video image by using parallax compensation which performs prediction by using parallax between the video images, and a corresponding decoding method. The number of parameters as parallax data used for the parallax compensation is selected and set for each reference image. Data of the set number of parameters is encoded, and parallax data in accordance with the number of parameters is encoded. During decoding, parallax-parameter number data, which is included in encoded data and designates the number of parameters as parallax data for each reference image, is decoded, and parallax data in accordance with the number of parameters is decoded, where the parallax data is included in the encoded data. | 01-29-2009 |
20100008422 | VIDEO ENCODING METHOD AND DECODING METHOD, APPARATUSES THEREFOR, PROGRAMS THEREFOR, AND STORAGE MEDIA WHICH STORE THE PROGRAMS - A video encoding method includes selecting a reference vector target frame and a reference frame from among already-encoded frames; encoding information for designating each frame; setting a reference vector for indicating an area in the reference vector target frame with respect to an encoding target area; encoding the reference vector; performing a corresponding area search by using image information of a reference vector target area, which belongs to the reference vector target frame and is indicated by the reference vector, and the reference frame; determining a reference area in the reference frame based on the search result; generating a predicted image by using image information of the reference frame, which corresponds to the reference area; and encoding differential information between image information of the encoding target area and the predicted image. | 01-14-2010 |
20100021072 | IMAGE ENCODING METHOD AND DECODING METHOD, APPARATUSES THEREFOR, PROGRAMS THEREFOR, AND STORAGE MEDIA FOR STORING THE PROGRAMS - An image encoding method includes determining a corresponding point on a target image for encoding, which corresponds to each pixel on a reference image, based on the distance from a camera used for obtaining the reference image to an imaged object, and a positional relationship between cameras; computing a parallax vector from the position of the pixel to the corresponding point in the pixel space; computing a target predictive vector having the same starting point as the parallax vector and components obtained by rounding off the components of the parallax vector; computing a target reference vector having the same starting point as the parallax vector and the same size and direction as a differential vector between the target predictive vector and the parallax vector; and setting a predicted pixel value of a pixel on the target encoding image, which is indicated by the target predictive vector, to a value of a pixel on the reference image, which is indicated by the target reference vector. | 01-28-2010 |
20100034260 | VIDEO ENCODING METHOD AND DECODING METHOD, APPARATUSES THEREFOR, PROGRAMS THEREFOR, AND STORAGE MEDIA WHICH STORE THE PROGRAMS - A video encoding method for generating, based on disparity information between an already-encoded reference camera image and an encoding target camera image corresponding to the reference camera image, a disparity-compensated image by means of inter-camera image prediction; and encoding a differential image between the encoding target camera image and the disparity-compensated image. The method includes selecting, for each predetermined section unit on the differential image, one of a decoded differential image group obtained by decoding a differential image between the already-encoded camera image and the disparity-compensated image and a decoded camera image group obtained by decoding the already-encoded camera image, by determining whether or not there is a disparity-compensated image at the corresponding position, that is, whether or not the corresponding pixel in the disparity-compensated image has an effective value. | 02-11-2010 |
20100086222 | IMAGE ENCODING METHOD AND DECODING METHOD, APPARATUSES THEREFOR, PROGRAMS THEREFOR, AND STORAGE MEDIA FOR STORING THE PROGRAMS - An image encoding method includes determining and encoding global parallax data which is probably correct parallax data in consideration of the Epipolar geometry constraint between a camera of a standard viewpoint, which is selected from the entire multi-viewpoint images, and images obtained by all the other viewpoints; generating base parallax data for each camera as a viewpoint other than the standard viewpoint, where the base parallax data is probably correct parallax data in consideration of the Epipolar geometry constraint between the image of the relevant camera and the images of all the other cameras based on the global parallax data and the camera parameters; determining and encoding correction parallax data used for correcting the base parallax data, so as to indicate parallax data between the image of the relevant camera and an already-encoded reference viewpoint image used for parallax compensation; and encoding the image of the relevant camera by using parallax data obtained by correcting the base parallax data by means of the correction parallax data. | 04-08-2010 |
20100118939 | PREDICTED REFERENCE INFORMATION GENERATING METHOD, VIDEO ENCODING AND DECODING METHODS, APPARATUSES THEREFOR, PROGRAMS THEREFOR, AND STORAGE MEDIA WHICH STORE THE PROGRAMS - When video images are processed by applying temporal or spatial interframe prediction encoding to each divided area, and generating a predicted image of a processing target area based on a reference frame of the processing target area and reference information which indicates a predicted target position of the processing target area in the reference frame, predicted reference information is generated as predicted information of the reference information. Reference information used when an area adjacent to the processing target area was processed is determined as predicted reference information prediction data used for predicting the reference information of the processing target area. Reference area reference information is generated using one or more pieces of reference information used when a reference area indicated by the prediction data was processed. The predicted reference information prediction data is updated using the reference area reference information. The predicted reference information is generated using one or more pieces of the updated predicted reference information prediction data. | 05-13-2010 |
20100189177 | VIDEO ENCODING METHOD AND DECODING METHOD, APPARATUSES THEREFOR, PROGRAMS THEREFOR, AND STORAGE MEDIA WHICH STORE THE PROGRAMS - A video encoding apparatus used in encoding of a multi-viewpoint image. The apparatus generates a synthetic image for a camera used for obtaining an encoding target image, by using an already-encoded reference camera image having a viewpoint different from the viewpoint of the camera used for obtaining the encoding target image, and disparity information between the reference camera image and the encoding target image, thereby encoding the encoding target image. A predicted image for a differential image between an input image of an encoding target area to be encoded and the synthetic image generated therefor is generated, and a predicted image for the encoding target area, which is represented by the sum of the predicted differential image and the synthetic image for the encoding target area, is generated. A prediction residual represented by a difference between the predicted image for the encoding target area and the encoding target image of the encoding target area is encoded. | 07-29-2010 |
20100208991 | IMAGE GENERATION METHOD AND APPARATUS, PROGRAM THEREFOR, AND STORAGE MEDIUM WHICH STORES THE PROGRAM - An image generation method for generating image information of a color signal Y of an image A by using a color signal X of image A, and color signal X and color signal Y of an image B. The presence or absence of a point in color signal X of image B corresponding to each pixel position of color signal X of image A, and the position of the relevant corresponding point are estimated. To each estimated pixel position in color signal Y of image A, image information of the corresponding position in the second color signal Y of image B is assigned. Color signal Y at a pixel position in image A for which it is estimated that there is no corresponding point is generated by using the image information of color signal Y assigned to pixels having a corresponding point. | 08-19-2010 |
20100209016 | IMAGE GENERATION METHOD AND APPARATUS, PROGRAM THEREFOR, AND STORAGE MEDIUM WHICH STORES THE PROGRAM - An image generation method for generating image information of an image C by using an image A and an image B having a resolution higher than that of image A. Image C having the same resolution as image B is generated by enlarging image A; presence or absence of a point in image B corresponding to each pixel position of image C and the position of the relevant corresponding point are estimated; and to each pixel position in image C for which it is estimated that there is a corresponding point, image information of the corresponding position in image B is assigned. It is possible to generate image information at each pixel position in image C for which it is estimated in the corresponding point estimation that there is no corresponding point, by using the image information assigned according to an estimation result that there is a corresponding point. | 08-19-2010 |
20100220784 | Video Encoding Method and Decoding Method, Apparatuses Therefor, Programs Therefor, and Storage Media for Storing the Programs - By using parallax compensation which performs prediction by using parallax between video images, the video images are encoded as a single video image. Reference parallax for a target image to be encoded is set, wherein the reference parallax is estimated using a reference image; area division in an image frame is set; parallax displacement for each divided area is set, wherein the parallax displacement is the difference between the reference parallax and parallax for the parallax compensation; data of the area division is encoded; and data for indicating the parallax displacement is encoded. During decoding, reference parallax for a target image to be decoded is set, wherein it is estimated using a reference image; data for indicating area division, which is included in encoded data, is decoded; and data of parallax displacement, which is included in the encoded data, is decoded for each area indicated by the area division data. | 09-02-2010 |
20110286678 | MULTI-VIEW IMAGE CODING METHOD, MULTI-VIEW IMAGE DECODING METHOD, MULTI-VIEW IMAGE CODING DEVICE, MULTI-VIEW IMAGE DECODING DEVICE, MULTI-VIEW IMAGE CODING PROGRAM, AND MULTI-VIEW IMAGE DECODING PROGRAM - In the disclosed multi-view image encoding/decoding method in which a frame to be encoded/decoded is divided and encoding/decoding is done to each region, first, a prediction image is generated not only for the region to be processed, but also for the already encoded/decoded regions neighboring to the region to be processed. The prediction image is generated using the same prediction method for both kinds of regions. Next, correction parameters for correcting illumination and color mismatches are estimated from the prediction image and decoded image of the neighboring regions. At this time, the estimated correction parameters can be obtained even at the decoding side, therefore, encoding them is unnecessary. Thus, by using the estimated correction parameters to correct the predicted image that was generated for the region to be processed, a corrected predicted image that can be actually used is generated. | 11-24-2011 |
20120027291 | MULTI-VIEW IMAGE CODING METHOD, MULTI-VIEW IMAGE DECODING METHOD, MULTI-VIEW IMAGE CODING DEVICE, MULTI-VIEW IMAGE DECODING DEVICE, MULTI-VIEW IMAGE CODING PROGRAM, AND MULTI-VIEW IMAGE DECODING PROGRAM - The disclosed multi-view image coding/decoding device first obtains depth information for an object photographed in an area subject to processing. Next, a group of pixels in an already-coded (decoded) area which is adjacent to the area subject to processing and in which the same object as in the area subject to processing has been photographed is determined using the depth information and set as a sample pixel group. Then, a view synthesis image is generated for the pixels included in the sample pixel group and the area subject to processing. Next, correction parameters to correct illumination and color mismatches in the sample pixel group are estimated from the view synthesis image and the decoded image. A predicted image is then generated by correcting the view synthesis image relative to the area subject to processing using the estimated correction parameters. | 02-02-2012 |
20120170651 | Video Encoding Method and Decoding Method, Apparatuses Therefor, Programs Therefor, and Storage Media which Store the Programs - A video encoding method includes selecting a reference vector target frame and a reference frame from among already-encoded frames; encoding information for designating each frame; setting a reference vector for indicating an area in the reference vector target frame with respect to an encoding target area; encoding the reference vector; performing a corresponding area search by using image information of a reference vector target area, which belongs to the reference vector target frame and is indicated by the reference vector, and the reference frame; determining a reference area in the reference frame based on the search result; generating a predicted image by using image information of the reference frame, which corresponds to the reference area; and encoding differential information between image information of the encoding target area and the predicted image. | 07-05-2012 |
20120314776 | MULTIVIEW VIDEO ENCODING METHOD, MULTIVIEW VIDEO DECODING METHOD, MULTIVIEW VIDEO ENCODING APPARATUS, MULTIVIEW VIDEO DECODING APPARATUS, AND PROGRAM - A highly efficient encoding technique is realized even for a multiview video involved in local mismatches in illumination and color between cameras. A view synthesized picture corresponding to an encoding target frame is synthesized from an already encoded reference view frame taken at a reference view different from an encoding target view simultaneously with the encoding target frame at the encoding target view of a multiview video. For each processing unit region having a predetermined size, a reference region on an already encoded reference frame at the encoding target view corresponding to the view synthesized picture is searched for. A correction parameter for correcting a mismatch between cameras is estimated from the view synthesized picture for the processing unit region and the reference frame for the reference region. The view synthesized picture for the processing unit region is corrected using the estimated correction parameter. A video at the encoding target view is subjected to predictive encoding using the corrected view synthesized picture. | 12-13-2012 |
20120320986 | MOTION VECTOR ESTIMATION METHOD, MULTIVIEW VIDEO ENCODING METHOD, MULTIVIEW VIDEO DECODING METHOD, MOTION VECTOR ESTIMATION APPARATUS, MULTIVIEW VIDEO ENCODING APPARATUS, MULTIVIEW VIDEO DECODING APPARATUS, MOTION VECTOR ESTIMATION PROGRAM, MULTIVIEW VIDEO ENCODING PROGRAM, AND MULTIVIEW VIDEO DECODING PROGRAM - Efficient multiview video encoding is realized even in a situation in which a processing picture cannot be obtained, by accurately estimating a motion vector and simultaneously using an inter-camera correlation and a temporal correlation in prediction of a video signal. A view synthesized picture at a time when a processing picture has been taken is generated from a reference camera video that has been taken by a camera different from a processing camera that has taken the processing picture included in a multiview video based on the same setting as that of the processing camera. A motion vector is estimated by searching for a corresponding region in a reference picture taken by the processing camera using a picture signal on the view synthesized picture corresponding to a processing region on the processing picture without using the processing picture. | 12-20-2012 |
20130058584 | IMAGE ENCODING AND DECODING FOR MULTI-VIEWPOINT IMAGES - An image encoding method includes determining corresponding points on an encoding target image, which correspond to pixels on a reference image, based on distance from a camera of the reference image to an object, and positional relationship between cameras; computing a parallax vector from each pixel position to the corresponding point in pixel space; computing a target predictive vector having the same start as the parallax vector and components obtained by rounding off components of the parallax vector; computing a target reference vector having the same start as the parallax vector and the same size and direction as a differential vector between the target predictive vector and the parallax vector; and setting a predicted value of a pixel on the encoding target image, which is indicated by the target predictive vector, to a value of a pixel on the reference image, which is indicated by the target reference vector. | 03-07-2013 |
20130101038 | Predicted Reference Information Generating Method, Video Encoding and Decoding Methods, Apparatuses Therefor, Programs Therefor, and Storage Media Which Store the Programs - When video images are processed by applying temporal or spatial interframe prediction encoding to each divided area, and generating a predicted image of a processing target area based on a reference frame of the processing target area and reference information which indicates a predicted target position of the processing target area in the reference frame, predicted reference information is generated as predicted information of the reference information. Reference information used when an area adjacent to the processing target area was processed is determined as predicted reference information prediction data used for predicting the reference information of the processing target area. Reference area reference information is generated using one or more pieces of reference information used when a reference area indicated by the prediction data was processed. The predicted reference information prediction data is updated using the reference area reference information. The predicted reference information is generated using one or more pieces of the updated predicted reference information prediction data. | 04-25-2013 |
20130170763 | IMAGE ENCODING METHOD AND APPARATUS, IMAGE DECODING METHOD AND APPARATUS, AND PROGRAMS THEREFOR - An image encoding method in which when transmitting or storing an image, a frame of the image is divided into predetermined-sized processing regions, and for each processing region, a pixel value of each pixel is predicted for the encoding. The method includes a step that determines one pixel value, which is assigned to and represents each object in the processing region, to be an object pixel value that is associated with an object identifier for identifying the relevant object; a step that generates, based on each object pixel value and the pixel value of each pixel in the processing region, an object map that indicates which object has been obtained at each pixel in the processing region, by using the object identifier; a step that generates a predicted image for the processing region by assigning the object pixel value to each pixel in accordance with the object map; a step that encodes the object map; a step that encodes each object pixel value; and a step that performs predictive encoding of an image signal for the processing region by using the predicted image. | 07-04-2013 |
20130188707 | IMAGE ENCODING METHOD AND APPARATUS, IMAGE DECODING METHOD AND APPARATUS, AND PROGRAMS THEREFOR - When the entire image is divided into regions, each of which is subjected to predictive encoding while predicting an image signal by using an independent method assigned to the region, the object number and a representative pixel value for each object are predicted utilizing spatial continuity for the presence of the object, and also using decoded pixel values of a previously-processed neighbor region adjacent to a processing region. Accordingly, it is possible to reduce the amount of code required for encoding the object number in the processing region or the pixel value as a representative of each object in the processing region, where these encoded items are required in highly accurate image signal prediction which can handle any object shape by utilizing the pixel value as a representative of each object in the processing target region and information for identifying the object assigned to each pixel in the processing region. Therefore, efficient image encoding can be implemented. Since the employed decoded pixel values of pixels in a previously-decoded neighbor region are common information between the encoding and decoding sides, appropriate prediction can be performed even in the case where one of multiple image signal prediction modes is selected for each region, like in H.264. | 07-25-2013 |
20130301721 | MULTIVIEW IMAGE ENCODING METHOD, MULTIVIEW IMAGE DECODING METHOD, MULTIVIEW IMAGE ENCODING DEVICE, MULTIVIEW IMAGE DECODING DEVICE, AND PROGRAMS OF SAME - A multiview image encoding method includes, a view synthesis step for generating a view synthesis image at an encoding target view using a reference view image, a prediction image candidate generation step for generating plural intra prediction image candidates for each encoding target region using decoded images in already-encoded regions which are adjacent to the encoding target region, a prediction image candidate evaluation step for determining evaluation values of each intra prediction image candidates using the view synthesis image, a prediction image generation step for generating an intra prediction image from the plural intra prediction image candidates based on the evaluation values, and an image signal encoding step for performing a predictive encoding of an encoding target image in the encoding target regions using the intra prediction image. | 11-14-2013 |
20140003511 | IMAGE ENCODING METHOD, IMAGE DECODING METHOD, IMAGE ENCODING DEVICE, IMAGE DECODING DEVICE, IMAGE ENCODING PROGRAM, AND IMAGE DECODING PROGRAM | 01-02-2014 |