[go: up one dir, main page]

WO2012099108A1 - Appareil de codage d'images multi-vues, appareil de décodage d'images multi-vues, procédé de codage d'images multi-vues, procédé de décodage d'images multi-vues - Google Patents

Appareil de codage d'images multi-vues, appareil de décodage d'images multi-vues, procédé de codage d'images multi-vues, procédé de décodage d'images multi-vues Download PDF

Info

Publication number
WO2012099108A1
WO2012099108A1 PCT/JP2012/050823 JP2012050823W WO2012099108A1 WO 2012099108 A1 WO2012099108 A1 WO 2012099108A1 JP 2012050823 W JP2012050823 W JP 2012050823W WO 2012099108 A1 WO2012099108 A1 WO 2012099108A1
Authority
WO
WIPO (PCT)
Prior art keywords
viewpoint
information
viewpoint image
disparity
reliability
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2012/050823
Other languages
English (en)
Japanese (ja)
Inventor
内海　端
田中　誠一
紫村　智哉
保孝 若林
徳井　圭
佐藤　俊一
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sharp Corp
Original Assignee
Sharp Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sharp Corp filed Critical Sharp Corp
Publication of WO2012099108A1 publication Critical patent/WO2012099108A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity

Definitions

  • the present invention relates to a multi-view image encoding device, a multi-view image decoding device, a multi-view image encoding method, a multi-view image decoding method, and a program.
  • This application claims priority based on Japanese Patent Application No. 2011-007275 filed in Japan on January 17, 2011 and Japanese Patent Application No. 2011-056967 filed in Japan on March 15, 2011. , The contents of which are incorporated herein.
  • a stereoscopic image display technique As a typical use example of a multi-viewpoint image, there are a stereoscopic image display technique and an arbitrary viewpoint image display technique.
  • the displayed image In the stereoscopic image display technique, the displayed image itself is a planar image, that is, two-dimensional information.
  • the images 501 and 502 having parallax are observed for the left and right eyes of the observer.
  • the image 503 perceived in the brain gives a pseudo three-dimensional effect similar to that when observing an actual three-dimensional object / three-dimensional space.
  • image data 601v to 603v photographed from a plurality of viewpoints, distance information 601d to 603d between the camera and the subject, and camera parameters at the time of photographing are generated using a focal length, a camera direction, a positional relationship, and the like. Thereby, it is possible to observe an image from an observer's preferred viewpoint position. Further, by combining these display technologies, it is possible to display a stereoscopic image from an arbitrary viewpoint, and to adjust the stereoscopic effect of the stereoscopic image observed by changing the parallax between the left and right images.
  • disparity information between a plurality of images Based on the parallax information and the camera parameters at the time of shooting, a certain viewpoint image is converted into another viewpoint (virtual viewpoint) different from the viewpoint position to obtain a new image.
  • a virtual viewpoint image disparity information between a plurality of images is used as described above, but the disparity information is usually handled as a disparity image in which a disparity value is a pixel value.
  • a parallax image is generally performed by estimating parallax between viewpoint images by stereo matching processing.
  • the stereo matching process as shown in FIG. 5, for the rectangular image block 23, the image block having the highest degree of coincidence in the other viewpoint image 22 with respect to one viewpoint image 21 in units of image blocks. look for. Then, a horizontal distance 27 between the target block 23 and the position of the image block 26 having a high degree of coincidence is determined as a parallax between both viewpoint images related to the target block 23.
  • a plurality of image blocks having a high degree of coincidence with the target block are detected and there is no difference in the degree of coincidence or is very small, it is uniquely decided which distance to the block should be decided as the parallax value. I can't.
  • Patent Document 1 discloses a parallax estimation method that recalculates parallax using an edge detection result of a viewpoint image when such parallax cannot be calculated correctly.
  • the present invention has been made in view of such circumstances, and an object of the present invention is to provide a multi-view image encoding apparatus and multi-view image decoding that can suppress an increase in the amount of calculation even when the reliability of the parallax value is low.
  • An apparatus, a multi-view image encoding method, a multi-view image decoding method, and a program are provided.
  • the present invention has been made to solve the above-described problems, and one aspect of the present invention estimates a parallax value with the second viewpoint image for each pixel of the first viewpoint image, A disparity information generating unit that determines the reliability of the disparity value and generates disparity information of the first viewpoint image including the disparity value and information indicating the reliability, and disparity information that encodes the disparity information
  • a multi-view image encoding apparatus including an encoding unit.
  • Another aspect of the present invention is the multi-view image encoding device described above, wherein the disparity information stores information indicating the reliability in an upper predetermined number of bits for each pixel, and The multi-view image encoding apparatus stores the disparity value in a predetermined number of lower bits.
  • another aspect of the present invention is the above-described multi-view image encoding device, in which the disparity information generation unit determines whether or not the reliability is higher than a predetermined reference for each pixel. When it is determined that the disparity information is high, the disparity information of the pixel is the disparity value of the pixel, and when it is determined not high, the disparity information of the pixel is a value indicating that the disparity value is indefinite.
  • This is a multi-view image encoding device.
  • Another aspect of the present invention is the multi-viewpoint image encoding device described above, wherein the disparity information generation unit is configured to perform the disparity when the resolution of the first viewpoint image exceeds a predetermined value.
  • the multi-view image encoding apparatus extends an area for storing information and stores a part of the parallax value or information indicating the reliability in the expanded area.
  • another aspect of the present invention is the above-described multi-view image encoding device, in which the disparity information includes the disparity image in which the disparity values are arranged in order according to corresponding pixels, and the reliability.
  • the disparity information includes the disparity image in which the disparity values are arranged in order according to corresponding pixels, and the reliability.
  • a multi-viewpoint image encoding device including a reliability map in which information indicating s is arranged in an order corresponding to corresponding pixels.
  • a parallax estimation step for each pixel of the first viewpoint image, a parallax estimation step for estimating a parallax value with the second viewpoint image, and a reliability of each of the parallax values are determined.
  • a disparity value reliability information generating step for generating information indicating the determined reliability
  • a disparity information generating step for generating disparity information of the first viewpoint image including the disparity value and the information indicating the reliability.
  • a parallax information encoding step for encoding the parallax information.
  • disparity information including an image decoding unit that decodes encoded viewpoint image data, disparity values related to the viewpoint image data, and information indicating reliability of the disparity values.
  • the multi-viewpoint image decoding apparatus includes a disparity information decoding unit that decodes encoded disparity information.
  • Another aspect of the present invention is the above-described multi-viewpoint image decoding apparatus, wherein the disparity information stores information indicating the reliability in an upper predetermined number of bits for each pixel, and The multi-viewpoint image decoding apparatus stores the disparity value in a predetermined number of lower bits.
  • another aspect of the present invention is the above-described multi-viewpoint image decoding device, wherein the disparity information decoding unit is configured to trust the pixel when the disparity information in each pixel has a predetermined value.
  • the degree of disparity is determined to be lower than a predetermined reference, the disparity value of the pixel is indefinite, and when the degree is not the predetermined value, the reliability of the pixel is determined to be higher than a predetermined reference, and the disparity information
  • the multi-viewpoint image decoding apparatus uses the value as the parallax value of the pixel.
  • Another aspect of the present invention is the above-described multi-view image decoding device, in which the disparity information decoding unit uses information indicating a part of the disparity values or the reliability as the disparity information.
  • the multi-viewpoint image decoding apparatus extracts information from the extended region and restores the information indicating the parallax value and the reliability.
  • another aspect of the present invention is the above-described multi-viewpoint image decoding device, wherein a viewpoint different from the viewpoint of the viewpoint image data is based on the decoded viewpoint image data and the disparity information.
  • a viewpoint image generation unit that generates the viewpoint image data of the different viewpoints, and the viewpoint image generation unit generates the viewpoint image data of the different viewpoints when the reliability is higher than a predetermined reference.
  • the multi-viewpoint image decoding apparatus does not use the disparity value corresponding to the reliability when the disparity value corresponding to is used and the reliability is lower than the predetermined reference.
  • another aspect of the present invention is the above-described multi-viewpoint image decoding device, wherein a viewpoint different from the viewpoint of the viewpoint image data is based on the decoded viewpoint image data and the disparity information.
  • a viewpoint image generation unit that generates the viewpoint image data, and the decoded viewpoint image data is displayed, or the viewpoint image generation unit generates the viewpoint image data of the different viewpoint, and the viewpoint image data of the different viewpoint
  • a multi-viewpoint image decoding apparatus including a switching unit that switches whether to display the image.
  • disparity information including an image decoding step for decoding encoded viewpoint image data, and a disparity value related to the viewpoint image data and information indicating reliability of the disparity value. And a disparity information decoding step for decoding the encoded disparity information.
  • the computer estimates a parallax value with the second viewpoint image for each pixel of the first viewpoint image, further determines the reliability of the parallax value
  • the computer includes an image decoding unit that decodes the encoded viewpoint image data, a disparity value related to the viewpoint image data, and information indicating reliability of the disparity value.
  • This is disparity information, and is a program for causing a disparity information decoding unit to decode encoded disparity information.
  • FIG. 1 is a schematic block diagram illustrating a configuration of a multi-viewpoint image display system according to an embodiment of the present invention. It is a schematic block diagram which shows the structure of the multiview image coding apparatus 200 in the embodiment. It is a schematic block diagram which shows the structure of the arbitrary viewpoint image display apparatuses 400 in the embodiment. It is an example of the processing flowchart which shows the process sequence of the multiview image coding apparatus 200 in the embodiment. It is a figure explaining the process of the estimation of the parallax value in step S3 in the embodiment. It is a figure explaining the format of the parallax information in the embodiment. It is a figure (the 1) explaining another format of the parallax information in the embodiment.
  • FIG. 1 is a schematic block diagram illustrating a configuration of a multi-viewpoint image display system according to the present embodiment.
  • the multi-viewpoint image display system 10 includes a first viewpoint camera 101, a second viewpoint camera 102,...
  • the Nth viewpoint camera 103 a multi-viewpoint image encoding device 200, a network 300, and an arbitrary viewpoint image display device 400. .
  • the Nth viewpoint camera 103 are video cameras that shoot subjects from different viewpoints and output viewpoint image data that is moving image data from each viewpoint.
  • the multi-view image encoding apparatus 200 calculates the parallax value between the viewpoints and the reliability of the parallax value from the viewpoint image data output from each of the first viewpoint camera 101, the second viewpoint camera 102,. Calculate and generate parallax information including the parallax value and information indicating the reliability.
  • the multi-view image encoding device 200 encodes the viewpoint image data and the parallax information, and transmits the encoded image to the arbitrary viewpoint image display device 400 via the network 300.
  • the network 300 is a network such as the Internet.
  • the network 300 may be a network such as a broadcast wave or cable television.
  • the arbitrary viewpoint image display device 400 receives the encoded viewpoint image data and disparity information transmitted from the multi-view image encoding device 200 via the network 300.
  • the arbitrary viewpoint image display device 400 decodes the received parallax information and viewpoint image data, and generates and displays an image of the viewpoint designated by the user using the decoding result.
  • FIG. 2 is a schematic block diagram showing the configuration of the multi-view image encoding apparatus 200.
  • the multi-view image encoding apparatus 200 includes a first viewpoint image processing unit 210, a second viewpoint image processing unit 220,... An Nth viewpoint image processing unit 230, and an encoded multi-view image transmission unit 240.
  • the first viewpoint image processing unit 210 includes a first viewpoint image input unit 211, a first viewpoint image encoding unit 212, a first viewpoint parallax information generation unit 213, and a first viewpoint parallax information encoding unit 214. .
  • the second viewpoint image processing unit 220 includes a second viewpoint image input unit 221, a second viewpoint image encoding unit 222, a second viewpoint parallax information generation unit 223, and a second viewpoint parallax information encoding unit 224.
  • the Nth viewpoint image processing unit 230 includes an Nth viewpoint image input unit 231, an Nth viewpoint image encoding unit 232, an Nth viewpoint parallax information generation unit 233, and an Nth viewpoint parallax information encoding unit 234. .
  • the first viewpoint image processing unit 210 to the Nth viewpoint image processing unit 230 receive the viewpoint image data output from the corresponding one of the first viewpoint camera 101 to the Nth viewpoint camera 103, and the viewpoint image data Disparity information is generated, and the viewpoint image data and the disparity information are encoded.
  • the first viewpoint image processing unit 210 receives the viewpoint image data output by the second viewpoint camera 102 from the second viewpoint image processing unit 220, and the viewpoint image data of the first viewpoint camera 101 of the second viewpoint camera 102.
  • a parallax value with respect to the viewpoint image data is calculated.
  • the second viewpoint image processing unit 220 calculates a parallax value between the viewpoint image data of the second viewpoint camera 102 and the viewpoint image data of the third viewpoint camera.
  • the encoded multi-view image transmission unit 240 transmits the encoded multi-view image data including the viewpoint image data and the disparity information encoded by the first viewpoint image processing unit 210 to the N-th viewpoint image processing unit 230 via the network 300. And transmitted to the arbitrary viewpoint image display device 400.
  • the first viewpoint image input unit 211 receives the viewpoint image data output from the first viewpoint camera 101, and includes the first viewpoint image encoding unit 212, the first viewpoint parallax information generation unit 213, and the Nth viewpoint image processing unit 230. The information is output to the Nth viewpoint parallax information generation unit 233.
  • the first viewpoint image encoding unit 212 encodes the viewpoint image data output from the first viewpoint image input unit 211. In FIG. 2, the first viewpoint image encoding unit 212 performs encoding based only on the viewpoint image data of the first viewpoint camera, but refers to the encoded viewpoint image data of other viewpoint cameras. You may make it do.
  • the first viewpoint parallax information generating unit 213 calculates a parallax value with the viewpoint image data output from the second viewpoint image input unit 221 for each pixel of the viewpoint image data output from the first viewpoint image input unit 211.
  • the first viewpoint parallax information generation unit 213 calculates the parallax value with the image data of the second viewpoint, but may calculate the parallax value with the image data of another viewpoint. Further, the first viewpoint parallax information generation unit 213 calculates the reliability for each calculated parallax value.
  • the first viewpoint parallax information generation unit 213 outputs these parallax values and information indicating the reliability to the first viewpoint parallax information encoding unit 214 as parallax information.
  • the first viewpoint parallax information encoding unit 214 encodes the parallax information output from the first viewpoint parallax information generating unit 213. Note that the first viewpoint parallax information generation unit 213 calculates the parallax value with reference to the camera parameters of the first viewpoint camera 101 and the camera parameters of the second viewpoint camera 102. These camera parameters may be output by each viewpoint camera, or may be stored in advance by the first viewpoint parallax information encoding unit 214. These camera parameters are encoded by other means (not shown) and output to the encoded multi-viewpoint image transmission unit 240.
  • FIG. 3 is a schematic block diagram showing the configuration of the arbitrary viewpoint image display device 400.
  • the arbitrary viewpoint image display device 400 includes an encoded multi-viewpoint image reception unit 401, a viewpoint determination unit 402, a viewpoint selection unit 403, a parallax information decoding unit 404, a viewpoint image decoding unit 405, a switching unit 406, an arbitrary viewpoint image generation unit 407, An image display unit 408 is included.
  • the encoded multi-view image receiving unit 401 receives the encoded multi-view image data transmitted from the multi-view image encoding device 200 via the network 300.
  • the viewpoint determination unit 402 determines a viewpoint of an image to be displayed based on an instruction from a user using a remote controller or the like.
  • the viewpoint selection unit 403 encodes the viewpoint image data of the viewpoint closest to the viewpoint determined by the viewpoint determination unit 402 and the disparity information from the encoded multi-view image data received by the encoded multi-view image reception unit 401. Extract as it is. Whether the viewpoint is close to the determined viewpoint is determined by referring to the camera parameter corresponding to each viewpoint image separately extracted from the encoded multi-viewpoint image data.
  • the viewpoint is information consisting of a position relative to the subject and the direction of the line of sight.
  • the disparity information decoding unit 404 decodes the encoded disparity information that is the disparity information extracted by the viewpoint selection unit 403.
  • the viewpoint image decoding unit 405 decodes the encoded viewpoint image data that is the viewpoint image data extracted by the viewpoint selection unit 403.
  • the switching unit 406 determines whether or not the difference between the viewpoint determined by the viewpoint determination unit 402 and the viewpoint regarding the data decoded by the disparity information decoding unit 404 and the viewpoint image decoding unit 405 is within a predetermined range. When it is determined that it is within the predetermined range, the viewpoint image data decoded by the viewpoint image decoding unit 405 is output to the image display unit 408 and displayed. Also, when it is determined that it is not within the predetermined range, the viewpoint determined by the viewpoint determination unit 402 and the data decoded by the parallax information decoding unit 404 and the viewpoint image decoding unit 405 are output to the arbitrary viewpoint image generation unit 407. .
  • the switching unit 406 instructs the arbitrary viewpoint image generation unit 407 to generate an image from the viewpoint determined by the viewpoint determination unit 402.
  • the difference in viewpoint includes a difference regarding the position of the viewpoint and a difference regarding the direction of the viewpoint. Further, that the difference in viewpoint is within the predetermined range means that both the difference regarding the position and the difference regarding the direction are within the predetermined range.
  • the arbitrary viewpoint image generation unit 407 generates image data from the viewpoint determined by the viewpoint determination unit 402 from the data decoded by the parallax information decoding unit 404 and the viewpoint image decoding unit 405, that is, viewpoint image data and parallax information. And output to the image display unit 408.
  • the image display unit 408 includes a device for displaying an image such as a liquid crystal display, and displays an image of the image data output from the switching unit 406 or the arbitrary viewpoint image generation unit 407.
  • FIG. 4 is an example of a processing flow diagram showing a processing procedure of the multi-view image encoding apparatus 200.
  • each of the first viewpoint image input unit 211 to the Nth viewpoint image input unit 231 accepts corresponding viewpoint image data output from the first viewpoint camera 101 to the Nth viewpoint camera 103 (step S1). .
  • each of the first viewpoint parallax information generation unit 213 to the Nth viewpoint parallax information generation unit 233 corresponds to the following steps S3 to S5 and among the first viewpoint image input unit 211 to the Nth viewpoint image input unit 231. It performs about each pixel of the viewpoint image data which the thing to accept (step S2, S6).
  • step S3 a parallax value between adjacent viewpoint image data (for example, the viewpoint image data of the second viewpoint camera 102 in the case of the first viewpoint parallax information generation unit 213) is estimated.
  • step S4 the reliability of the parallax value is calculated from the estimation result of the parallax value.
  • step S5 disparity information including the estimated disparity value and information indicating the reliability of the disparity value is generated.
  • the first viewpoint parallax information encoding unit 214 to the Nth viewpoint parallax information encoding unit 234 are included in the first viewpoint parallax information generating unit 213 to the Nth viewpoint parallax information generating unit 233.
  • the disparity information generated by the corresponding one is encoded according to a predetermined method (step S7).
  • the first viewpoint image encoding unit 212 to the Nth viewpoint image encoding unit 232 encode the viewpoint image data received by the corresponding one of the first viewpoint image input unit 211 to the Nth viewpoint image input unit 231.
  • the encoded multi-view image transmission unit 240 outputs the parallax information encoded in step S7 and the viewpoint image data encoded in step S8 as encoded multi-view image data (step S9).
  • FIG. 5 is a diagram for explaining the process of estimating the parallax value in step S3.
  • FIG. 5 is a diagram illustrating the process of estimating the parallax value between the first viewpoint image 21 and the second viewpoint image 22.
  • the first viewpoint image 21 an image having the highest degree of coincidence within a predetermined search range 25 including the same image position 24 on the second viewpoint image with respect to the image region 23 centering on the target pixel whose parallax value is estimated. Search for a region.
  • the degree of coincidence is determined by the magnitude of the sum of absolute differences (SAD) of pixel values (for example, luminance values) between image areas.
  • SAD sum of absolute differences
  • the image area having the smallest calculated sum of absolute differences is searched within the predetermined search range 25.
  • a horizontal distance 27 between the image area 26 where the calculated sum of absolute differences is the smallest and the image position 24 is determined as a parallax value.
  • the parallax value may be represented by the number of pixels, or may be represented by an amount having a unit such as mm as a distance on the image. Note that the parallax value can take both a positive value and a negative value depending on whether the image area 26 is on the right side or the left side with respect to the image position 24. By normalizing within the range of the two values having the maximum value, the parallax values can be expressed as all positive values (or all negative values).
  • the parallax value when it is the first viewpoint image, the parallax value between the second viewpoint image and if it is the second viewpoint image, the third viewpoint image.
  • the parallax value between is calculated, other combinations may be estimated.
  • step S3 If, in step S3, Xi satisfying the following equation (1) with respect to the calculated sum of absolute differences Xi is present in addition to C as a result of the search for the target pixel, the process proceeds to step S4 without determining the parallax value. . Xi ⁇ C + C ⁇ Err (1)
  • Xi is the difference absolute value sum of the i-th region in the search range
  • C is the minimum value of the difference absolute value sum in the search range
  • Err is a predetermined constant (parallax error detection parameter). ). Even when there are a plurality of positions where the sum of absolute differences is the minimum value, the process proceeds to step S4 in the same manner as when Expression (1) is satisfied.
  • step S3 in addition to satisfying the above equation (1), all the absolute difference sums SAD calculated for the target region for which the parallax value is estimated exceed a predetermined threshold TH (that is, the degree of coincidence) When no high image area exists), the process may proceed to step S4 without determining the parallax value.
  • a predetermined threshold TH that is, the degree of coincidence
  • step S4 for the pixel for which the parallax value is determined in step S3, information indicating that the reliability is high (for example, 0) is given as information indicating the reliability of the parallax value, and the parallax value is not determined in step S3.
  • information for the pixels, information (for example, 1) indicating that the reliability is low is given as information indicating the reliability of the parallax value.
  • step S5 parallax information including both the parallax value determined in step S3 and the information indicating the reliability determined in step S4 is generated.
  • FIG. 6 is a diagram for explaining the format of disparity information. As shown in FIG. 6, in the disparity information 31, for each pixel corresponding to each pixel position of the disparity image, information 32 indicating reliability is stored in the most significant bit, and the disparity value 33 is stored in the remaining lower bits. Are configured as a set of unit information 34 having a predetermined number of bits.
  • the parallax information 31 is data that can be handled as a parallax image having the same number of unit information 34 as the number of pixels of the viewpoint image. When two viewpoint images are input, two pieces of parallax information 31 are obtained, which are based on the first viewpoint image and based on the second viewpoint image.
  • step S7 the disparity information generated in step S5 is compression encoded according to a predetermined encoding method. Since the disparity information 31 can be handled as a monochrome image including a disparity value, the amount of information can be compressed by applying a compression encoding method for images, similarly to the viewpoint image.
  • compression encoding methods include ISO / IEC10918-1, ITU-T T.30, and so on. 81 (JPEG), ISO / IEC 15444-1 (JPEG 2000), or other still image coding schemes, or ISO / IEC13818-2 (MPEG-2), ISO / IEC14496-2 (MPEG-4), ISO / IEC14496 -10 (Advanced Video Coding), ITU-T H.264.
  • a moving picture encoding method such as H.264 may be applied.
  • step S9 the viewpoint image data encoded in step S8 and the parallax information encoded in step S7 are output.
  • the output viewpoint image and parallax information are recorded on a recording medium or transmitted via the network 300, and input to another video decoding device / playback device / editing device such as the arbitrary viewpoint image display device 400 for decoding / decoding. Played.
  • Step S3 when the expression (1) is satisfied in Step S3, the parallax value is not calculated and a value indicating that the reliability is low is given as information indicating the reliability.
  • Step S3 the parallax value may be calculated, and in step S5, the calculated parallax value may be stored in the parallax value 33 in FIG.
  • FIG. 6 shows an example in which disparity information is configured as a set of information having a predetermined number of bits, in which information indicating reliability is stored in the most significant bit and the disparity value is stored in the remaining lower bits.
  • the information indicating the reliability is included in the range of the number of bits for storing the original parallax value, the data width at the time of transmission and recording is compared with the conventional method of transmitting and recording the parallax image.
  • the transmission band and recording capacity can be used effectively without changing the (number of bits).
  • the value of the information indicating the reliability when the information is decoded is It can be suppressed from changing.
  • FIG. 7 is a diagram illustrating another format of disparity information.
  • the disparity information 34a for each pixel shown in FIG. 7 is an example in which the information indicating the disparity value and the reliability is included in the 8-bit data width as in the example of FIG. 0 to 254 are used to store parallax values.
  • the reliability means “high”.
  • the reliability is “low”, the parallax value itself is not stored and is indefinite, and a maximum value 255 that can be represented by 8 bits is given as the parallax information.
  • the reliability when the reliability is low, the value is always represented by the value 255 regardless of the estimated parallax value, and since only the parallax value is stored in other cases, it is almost the same as when all 8 bits are used for storing the parallax value.
  • the range of parallax values can be expressed.
  • the configuration example of FIG. 7 also shows the reliability without changing the data width (number of bits) at the time of transmission or recording, as in the example of FIG. 6, with respect to the conventional method of transmitting and recording parallax images. Information can be added, and the transmission band and recording capacity can be used effectively.
  • FIG. 8 is a diagram for explaining another format of disparity information.
  • the examples in FIGS. 6 and 7 are effective formats when the parallax value between given parallax images is a certain value or less, but the width of the viewpoint image, that is, the number of pixels in the horizontal direction becomes larger than a certain level. This is not suitable when it is necessary to have a large parallax value. Therefore, when the resolution of the viewpoint image exceeds a predetermined value, the parallax information generation unit such as the first viewpoint parallax information generation unit 213 has a basic area 51 (8 bits) of the parallax information 34b for each pixel as illustrated in FIG. Is extended to provide another extended area 52 (4 bits).
  • parallax information unit information 34b By configuring the parallax information unit information 34b with the basic area and the extension area in this way, even when a large value is required for the parallax value, information indicating reliability without limiting the storage of the parallax value. Can be added. Further, information other than information indicating the reliability may be stored in the expanded area.
  • the numerical value of the parallax value itself is expanded, for example, as shown in FIG. 8A, information 32c indicating reliability in the upper 1 bit and the parallax value 33c in the lower 11 bits are stored. It may be. Further, as shown in FIG. 8B, the reliability information 32d may be expanded to multiple values (here, 4 bits) instead of binary values as described above. Further, as shown in FIG. 8C, both the parallax value 33e (10 bits) and the reliability information 32e (2 bits) may be extended. Further, when there are three or more input viewpoint images, information on which viewpoint image the parallax value indicates the parallax value is also required. The information may be included in the extended area 52. For example, if 2 bits of the extended area are assigned to this information, values of 4 patterns can be designated, so that it is possible to indicate which viewpoint the parallax has been calculated with respect to inputs up to 5 viewpoints.
  • parallax value By expanding the parallax value as described above, it becomes possible to store a large parallax value that cannot be expressed with a data width (8 bits) generally used as a conventional parallax image. Appropriate parallax can be transmitted and recorded even for high-definition images with an increased number of pixels.
  • the information indicating the reliability can be expanded to multiple values, the reliability of the parallax value can be widened. Therefore, when generating a virtual viewpoint image using the parallax value, the parallax value can be changed. Instead of using or not using, it is possible to increase choices of usage methods, and the parallax value can be used in an optimal manner according to the capability of the playback device and the application.
  • the numerical value of the reliability includes the minimum value of the sum of absolute differences calculated in the above-described parallax value estimation step S3, or a value obtained by converting the minimum value (for example, Only the upper few bits of the sum of absolute differences are extracted), the number of Xi that applies to the above-described equation (1), or the like may be given.
  • FIG. 8 an example in which the data width of the extension area is 4 bits is shown.
  • the extension width may be an arbitrary number of bits of 1 bit or more. The extension width may be determined according to the number of pixels of the input viewpoint image, the required maximum parallax value, and the like.
  • the basic area 51 and the extended area 52 may be independently encoded. Encoding may be performed, and the disparity value and the information indicating the reliability may be distinguished and encoded independently.
  • FIG. 9 and 10 are diagrams for explaining other formats of disparity information.
  • the disparity information shown in FIG. 9 and FIG. 10 configures the disparity image 61 composed only of the disparity value 33f and the reliability map 62 composed only of the information 32f indicating the reliability as separated data. is there.
  • the parallax value can be stored as a parallax image with a data width (for example, 8 bits) generally used conventionally, the parallax value can be processed using an existing device or software as it is.
  • the information indicating reliability is independent as a reliability map, it is easy to add functional units and modules that process the reliability map to devices and software that handle existing parallax images.
  • a function that uses the parallax value reliability information can be added.
  • the decoding device or software when the virtual viewpoint image is not generated, that is, when the parallax value reliability information is not required, since it is separated from the parallax image, decoding of the reliability map can be easily omitted, The processing load at the time of decoding can be reduced.
  • the data width of the information indicating the reliability is not limited to this, and may be an arbitrary number of bits of 1 bit or more.
  • the data width of the information indicating the reliability depends on the maximum value that can be taken by the sum of absolute differences calculated at the time of parallax value estimation, the number of pixels included in the search range, that is, the value that can be taken as the reliability Just decide.
  • FIG. 11 is a diagram for explaining another format of disparity information.
  • the degree of reliability of the disparity value is sufficient if the two types of states, whether the reliability of the disparity value is high or low, are sufficient, or restrictions on the processing capacity on the encoding device side, etc.
  • the information indicating the reliability of the parallax value may be configured by 1-bit data representing a binary value for each corresponding pixel as shown in the reliability map 70 of FIG.
  • FIG. 12 is a diagram illustrating a difference between a region where the reliability of the parallax value is high and a region where the reliability is low.
  • reference numeral 81 is, for example, a first viewpoint image corresponding to the left eye
  • reference numeral 82 is, for example, a second viewpoint image corresponding to the right eye.
  • a region corresponding as an image between the two viewpoint images 81 and 82, such as the region 83 in the second viewpoint image 82, can be determined to have high reliability of the parallax value in the estimation of the parallax value. High nature.
  • the reliability of estimation of the parallax value is low in a region where the images do not correspond between the two viewpoint images (a region in which the viewpoint image 81 is a blind spot) like the region 84.
  • the region where the reliability of the parallax value is low occurs mainly in the occlusion portion in the viewpoint image, and the distribution tends to be concentrated around a subject that is somewhat large.
  • the reliability of the parallax value is expressed by binary values as in the format illustrated in FIG. 11, for example, a high reliability value can be indicated by a value 0 and a low reliability value can be indicated by a value 1, but this is encoded. In this case, it is advantageous in terms of reducing redundancy at the time of encoding to configure data so that data of value 0 and data of value 1 are as continuous as possible. Therefore, the first viewpoint parallax information encoding unit 214, the second viewpoint parallax information encoding unit 224, and the like indicate information indicating the reliability of the parallax value in predetermined units as in blocks 71, 72, and 73 in FIG. Blocks are configured so that the reliability of the same value is easily concentrated on a block basis.
  • a reliability map 70 which is a set of reliability information of disparity values, is divided into blocks 71 (4 ⁇ 4), 72 (2 ⁇ 2), 73 (2 ⁇ 2), etc. of a predetermined size. Indicates that the data has a configuration.
  • the block size may be determined according to the degree to which the reliability information of the parallax value continues with the same value, or for example, 16 ⁇ 16, 8 ⁇ 8, 4 for each image sequence or image frame to be encoded.
  • a size such as ⁇ 4, 2 ⁇ 2 or the like may be determined in advance.
  • Each viewpoint disparity information encoding unit such as the first viewpoint disparity information encoding unit 214 and the second viewpoint disparity information encoding unit 224 encodes the reliability map 70 for each block when the reliability map 70 is encoded.
  • a single value of 0 or 1 representing the degree information is assigned (for example, taking an average within the block, the representative value of the block 71 is 1, and the representative values of the blocks 72 and 73 are 0), and the code to be transmitted Significantly reduce the amount.
  • the reliability information may be expressed as a numerical value in units of a plurality of bits, such as every 2 ⁇ 2 pixel block indicated by reference numerals 74 to 77.
  • each viewpoint parallax information encoding unit is a unit of a block composed of a plurality of these numerical values (that is, a block composed of a plurality of 2 ⁇ 2 pixel blocks such as the above-described codes 74 to 77).
  • the code amount may be compressed by applying a block-based compression encoding method such as DCT.
  • FIG. 14 is an example in which reliability information is digitized in units of 2 ⁇ 2 pixels, but may be digitized in other units such as 3 ⁇ 3 pixels and 4 ⁇ 4 pixels.
  • the reliability information of the disparity value is digitized and encoded in units of blocks, and the disparity value with low reliability is generated for an image region that is gathered to a certain extent, such as the image region 84 shown in FIG. ,
  • the reliability information can be efficiently encoded and transmitted.
  • disparity information can take a plurality of formats. Which of these formats is used may be determined in advance for each device and software that encodes multi-viewpoint images, and the specifications, properties, and use of viewpoint images input to these devices and software. It may be determined according to the purpose and the like, and identification information for identifying the determination result may be added and transmitted and recorded separately from the viewpoint image data and the parallax information. For example, if the input image has the so-called HD (High Definition) resolution that is currently mainstream, the data structure shown in FIGS. 6, 7, and 11 is selected, and the input image is a high-definition image that exceeds the HD resolution. In this case, the data configuration shown in FIG. 8, FIG. 9, and FIG.
  • HD High Definition
  • the method of using the disparity value on the decoding device or software side it is sufficient to determine only whether or not the disparity value can be used according to the reliability of the disparity value, or it is necessary to change the disparity value using method according to the degree of reliability If it is known in advance whether the data structure of FIG. 6, FIG. 7, FIG. 11, FIG. 8, FIG. 9, or FIG. 10 is selected regardless of the resolution of the input image. Good.
  • the decoding device side knows the data structure in which the disparity value and the disparity value reliability information, that is, the disparity information is stored, and uses it appropriately. can do.
  • the parallax information described above there may be information indicating whether or not the parallax information itself is transmitted and recorded. For example, when the number of input viewpoints is 3, if two types of disparity information, that is, disparity information between viewpoints 1 and 2 and disparity information between viewpoints 2 and 3 are generated, a virtual viewpoint image between viewpoints 1 to 3 is generated. Therefore, the disparity information corresponding to the viewpoint image 2 may not necessarily be transmitted / recorded.
  • disparity information descriptor may be stored in a separate area from each piece of parallax information for transmission / recording.
  • step S7 in the above-described example, an example in which the compression encoding method for images is applied in the same manner as the viewpoint image has been shown.
  • the encoding method is not limited to this.
  • the parallax information is configured by a parallax image and a reliability map as shown in FIGS. 9 and 10
  • an image compression coding method is applied to the parallax image, and another coding is applied to the reliability map.
  • a scheme may be applied.
  • compression coding methods for images include quantization processing to improve the compression ratio, so distortion occurs during the coding process, and the images before coding and after decoding do not completely match. This is the encoding method.
  • a parallax image is configured with only a parallax value, and the information is encoded with a compression encoding method for images, while information indicating the reliability (reliability map).
  • a general data lossless encoding method for example, run-length encoding, Huffman encoding, etc.
  • a reversible encoding method can be selected as the compression encoding method for images, if such a method is used, the disparity information and the information indicating the reliability are not distinguished from each other, and the disparity information remains as an image. You may compression-encode.
  • a distance value between the camera and the subject may be encoded and transmitted instead of the parallax value.
  • the parallax values calculated as described above respectively correspond to the distance from the camera of the subject in the image. That is, the image area with the maximum parallax value corresponds to the subject with the shortest distance from the camera, and the image area with the minimum parallax value corresponds to the subject with the longest distance from the camera.
  • the distance value is generated by normalizing all the parallax values in the image, for example, in an 8-bit range (0 to 255).
  • the generated distance value can form a distance image similarly to the parallax value, and can be encoded and transmitted in the same manner as the parallax image.
  • the distance information is information that does not depend on the reference viewpoint image, such as the parallax value, and can be handled as more versatile information.
  • FIG. 15 is an example of a processing flowchart showing a processing procedure of the arbitrary viewpoint image display device 400.
  • the encoded multi-view image receiving unit 401 receives the encoded viewpoint image and the encoded disparity information (step S21).
  • the viewpoint determination unit 402 determines the viewpoint of the image to be displayed based on a user input using a remote controller or the like.
  • the viewpoint determination method may be determined by the user selecting from viewpoint selection candidates prepared in advance, and the transition direction such as up, down, left, and right with respect to the currently displayed viewpoint can be determined by the user. May be determined by designating (step S22).
  • the viewpoint selection unit 403 selects a viewpoint to be decoded from the encoded viewpoint image and disparity information based on the viewpoint of the image to be displayed determined in step S22 (step S23).
  • the disparity information decoding unit 404 decodes the disparity information of the viewpoint selected in step S23
  • the viewpoint image decoding unit 405 decodes the viewpoint image of the viewpoint selected in step S23.
  • the parallax information is restored (step S24).
  • the switching unit 406 determines whether it is necessary to generate a virtual viewpoint image (step S25). When the switching unit 406 determines that the synthesis of the virtual viewpoint image is not necessary (S25-N), the switching unit 406 proceeds to step S32 and displays the viewpoint image decoded by the viewpoint image decoding unit 405 on the image display unit 408. Let
  • step S25 when it is determined in step S25 that a virtual viewpoint image needs to be generated (S25-Y), the switching unit 406 indicates the decoded viewpoint image and disparity information, and the viewpoint determined by the viewpoint determination unit 402. Information is output to the arbitrary viewpoint image generation unit 407.
  • the arbitrary viewpoint image generation unit 407 for each pixel position of the viewpoint image output by the switching unit 406 (steps S26 and S29), from the information indicating the reliability included in the disparity information output by the switching unit 406, the corresponding disparity value Is determined to be high or low (step S27).
  • the viewpoint determination unit 402 determines the pixel value of the target pixel using the corresponding parallax value. Plotting is performed on a virtual viewpoint image that is a viewpoint image from the viewpoint (step S28).
  • step S27 when it is determined in step S27 that the reliability is low, the process returns to step S27 to set the processing target as the next pixel.
  • the arbitrary viewpoint image generation unit 407 interpolates, using the surrounding pixel values, for the pixels whose pixel values are not plotted in step S28 in the virtual viewpoint image.
  • a viewpoint image from the viewpoint determined by the determination unit 402 is generated (step S30).
  • the arbitrary viewpoint image generation unit 407 displays the generated virtual viewpoint image on the image display unit 408 (step S31).
  • step S24 what is necessary is just to decode each encoded data according to the encoding system used by the multiview image coding apparatus 200 according to a corresponding system.
  • the processing of steps S26 to S29 is performed by extracting the parallax value corresponding to each pixel of the viewpoint image and the information indicating the reliability from the parallax information shown in FIGS.
  • the identification information for identifying the encoded disparity information includes the multi-view image code.
  • the information indicating the parallax value and the reliability is extracted according to the result of interpretation of the identification information, which is input separately by the conversion apparatus 200. Note that the data structure may be determined in advance.
  • step S24 it is determined whether it is necessary to generate a virtual viewpoint image in accordance with a user or application request. For example, the position and number of the virtual viewpoint that the user wants to display is specified using the remote controller of the arbitrary viewpoint image display device 400, and the viewpoint position and viewpoint number of the viewpoint image decoded in step S24 are specified. If they do not match, it is determined that generation of the designated virtual viewpoint image is necessary.
  • step S27 the information indicating the reliability in the disparity information decoded in step S24 is referred to, and the reliability of the corresponding disparity value is obtained. Decide whether to generate the requested virtual viewpoint image using the corresponding parallax value or not using the corresponding parallax value according to the obtained reliability value To do.
  • the corresponding pixel value is plotted on the virtual viewpoint image using a corresponding parallax value in step S28.
  • step S28 in order to plot the pixel value on the virtual viewpoint image using the parallax value, the viewpoint image is projected on the virtual viewpoint position based on the parallax value and the camera parameter at the time of shooting obtained separately.
  • the positional relationship between the viewpoint coordinates of the already obtained viewpoint image and the coordinates of the virtual viewpoint is derived.
  • An image at the virtual viewpoint position can be generated by plotting each pixel on the viewpoint image at the coordinate position corresponding to the virtual viewpoint based on the corresponding parallax value.
  • step S30 pixel values are generated without using the parallax values for the pixels for which pixel values were not obtained in step S28.
  • the positional relationship between the viewpoint coordinates of the viewpoint image and the coordinates of the virtual viewpoint can be obtained, but since the parallax value cannot be used, it is not possible to determine at which position corresponding to the virtual viewpoint the corresponding pixel value should be plotted.
  • the corresponding pixels are interpolated using the peripheral pixel values and the peripheral parallax values.
  • the average value of the surrounding pixel values is calculated, the adjacent pixel values in the horizontal direction are copied, the filter coefficient is determined from the pixel values or the parallax values in the vertical and horizontal directions and the surrounding 8 directions, and the surrounding pixel values are obtained. What is necessary is just to interpolate a pixel value by the method of applying the smoothing filter based on.
  • step S31 a virtual viewpoint image obtained by generating or interpolating by the method as described above is displayed on the image display unit 408. If only one virtual viewpoint image is displayed, a video from a viewpoint different from the originally captured viewpoint can be displayed, and a plurality of virtual viewpoint images can be generated and displayed as a stereoscopic image. If it is displayed as a stereoscopic image together with other viewpoint images, it can be displayed as a stereoscopic image from a different stereoscopic effect or at a different angle from the captured viewpoint image.
  • the viewpoint selection unit 403 has been described as selecting one viewpoint. However, the viewpoint selection unit 403 selects a plurality of viewpoints, and the viewpoint image decoding unit 405 and the disparity information decoding unit 404 select the plurality of selected viewpoints.
  • the viewpoint data may be decoded, and the arbitrary viewpoint image generation unit 407 may generate a virtual viewpoint image from the plurality of viewpoint data.
  • an area where the reliability of the parallax value is low such as an occlusion area, may not have an image area with a high degree of matching in the other image. In that case, even if recalculation is performed, an appropriate parallax value is not obtained. In the present embodiment, it is possible to prevent such an inappropriate parallax value from being determined and to generate an inappropriate image using the inappropriate parallax value.
  • the position of the required parallax value may differ depending on the application and the virtual viewpoint image to be generated, such as using only a part of the viewpoint image. Even in such a case, it is not preferable to estimate and transmit all disparity values from the viewpoint of not only processing load but also coding efficiency. In the example of the disparity information format shown in FIG. 7, when the reliability is low, the disparity value is not transmitted, so that good coding efficiency can be obtained.
  • the multi-view image encoding apparatus 200, the arbitrary viewpoint image display apparatus 400 in FIG. 1, or a program for realizing some of these functions is recorded on a computer-readable recording medium, and the recording medium is recorded on the recording medium.
  • These functions may be realized by reading a recorded program into a computer system and executing it.
  • the “computer system” includes an OS and hardware such as peripheral devices.
  • the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
  • the “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM or a CD-ROM, and a hard disk incorporated in a computer system.
  • the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line.
  • a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included.
  • the program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.
  • Multiview image display system 101 ... 1st viewpoint camera 102 ... 2nd viewpoint camera 103 ... Nth viewpoint camera 200 ...
  • Multiview image encoding apparatus 210 ... 1st viewpoint image processing part 211 ... 1st viewpoint image input part 212 ... first viewpoint image encoding unit 213 ... first viewpoint parallax information generating unit 214 ... first viewpoint parallax information encoding unit 220 ... second viewpoint image processing unit 221 ... second viewpoint image input unit 222 ... second viewpoint image code Conversion unit 223 ... second viewpoint parallax information generation unit 224 ... second viewpoint parallax information encoding unit 230 ... Nth viewpoint image processing unit 231 ...

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

L'invention concerne un appareil de codage d'images multi-vues capable de limiter l'accroissement de la quantité de calcul nécessaire même lorsque la fiabilité de valeurs de parallaxe est faible, du fait qu'il comporte : une unité génératrice d'informations de parallaxe qui estime des valeurs de parallaxe entre une image de premier point de vue et une image de deuxième point de vue pour chacun des pixels de l'image de premier point de vue, évalue la fiabilité des valeurs de parallaxe et génère des informations de parallaxe de l'image de premier point de vue qui comprennent les valeurs de parallaxe et des informations indiquant leur fiabilité ; et une unité de codage d'informations de parallaxe qui code les informations de parallaxe.
PCT/JP2012/050823 2011-01-17 2012-01-17 Appareil de codage d'images multi-vues, appareil de décodage d'images multi-vues, procédé de codage d'images multi-vues, procédé de décodage d'images multi-vues Ceased WO2012099108A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2011-007275 2011-01-17
JP2011007275 2011-01-17
JP2011-056967 2011-03-15
JP2011056967 2011-03-15

Publications (1)

Publication Number Publication Date
WO2012099108A1 true WO2012099108A1 (fr) 2012-07-26

Family

ID=46515731

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/050823 Ceased WO2012099108A1 (fr) 2011-01-17 2012-01-17 Appareil de codage d'images multi-vues, appareil de décodage d'images multi-vues, procédé de codage d'images multi-vues, procédé de décodage d'images multi-vues

Country Status (1)

Country Link
WO (1) WO2012099108A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015536608A (ja) * 2012-10-25 2015-12-21 エルジー エレクトロニクス インコーポレイティド 多視点３ｄｔｖサービスにおいてエッジ妨害現象を処理する方法及び装置
WO2023182290A1 (fr) * 2022-03-25 2023-09-28 パナソニックＩｐマネジメント株式会社 Dispositif de génération d'informations de parallaxe, procédé de génération d'informations de parallaxe et programme de génération d'informations de parallaxe

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003150937A (ja) * 2001-11-09 2003-05-23 Fuji Heavy Ind Ltd 画像処理装置および画像処理方法
JP2005535203A (ja) * 2002-07-31 2005-11-17 コーニンクレッカ　フィリップス　エレクトロニクス　エヌ　ヴィ デジタルビデオ信号を符号化する方法及び装置

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003150937A (ja) * 2001-11-09 2003-05-23 Fuji Heavy Ind Ltd 画像処理装置および画像処理方法
JP2005535203A (ja) * 2002-07-31 2005-11-17 コーニンクレッカ　フィリップス　エレクトロニクス　エヌ　ヴィ デジタルビデオ信号を符号化する方法及び装置

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015536608A (ja) * 2012-10-25 2015-12-21 エルジー エレクトロニクス インコーポレイティド 多視点３ｄｔｖサービスにおいてエッジ妨害現象を処理する方法及び装置
US9578300B2 (en) 2012-10-25 2017-02-21 Lg Electronics Inc. Method and apparatus for processing edge violation phenomenon in multi-view 3DTV service
WO2023182290A1 (fr) * 2022-03-25 2023-09-28 パナソニックＩｐマネジメント株式会社 Dispositif de génération d'informations de parallaxe, procédé de génération d'informations de parallaxe et programme de génération d'informations de parallaxe
JPWO2023182290A1 (fr) * 2022-03-25 2023-09-28

Similar Documents

Publication Publication Date Title
JP6633694B2 (ja) 多視点信号コーデック
JP5575908B2 (ja) ２ｄビデオデータの３ｄビデオデータへの変換のための深度マップ生成技法
JP5241500B2 (ja) カメラパラメータを利用した多視点動画符号化及び復号化装置並びに方法と、これを行うためのプログラムの記録された記録媒体
CN102939763B (zh) 计算三维图像的视差
KR101661436B1 (ko) 비디오 인코딩 및 디코딩 방법, 장치 및 시스템
US10798416B2 (en) Apparatus and method for motion estimation of three dimension video
CN102918846B (zh) 多视点视频编码方法、多视点视频解码方法、多视点视频编码装置、多视点视频解码装置
JP5197591B2 (ja) 映像符号化方法及び復号方法、それらの装置、それらのプログラム並びにプログラムを記録した記録媒体
JP6307152B2 (ja) 画像符号化装置及び方法、画像復号装置及び方法、及び、それらのプログラム
US9924197B2 (en) Image encoding method, image decoding method, image encoding apparatus, image decoding apparatus, image encoding program, and image decoding program
US20150249839A1 (en) Picture encoding method, picture decoding method, picture encoding apparatus, picture decoding apparatus, picture encoding program, picture decoding program, and recording media
US20150350678A1 (en) Image encoding method, image decoding method, image encoding apparatus, image decoding apparatus, image encoding program, image decoding program, and recording media
US20150172715A1 (en) Picture encoding method, picture decoding method, picture encoding apparatus, picture decoding apparatus, picture encoding program, picture decoding program, and recording media
JP6039178B2 (ja) 画像符号化装置、画像復号装置、並びにそれらの方法及びプログラム
US20150071362A1 (en) Image encoding device, image decoding device, image encoding method, image decoding method and program
WO2012099108A1 (fr) Appareil de codage d'images multi-vues, appareil de décodage d'images multi-vues, procédé de codage d'images multi-vues, procédé de décodage d'images multi-vues
JP6232117B2 (ja) 画像符号化方法、画像復号方法、及び記録媒体
JP2013211777A (ja) 画像符号化装置、画像復号装置、画像符号化方法、画像復号方法およびプログラム
JP2013179554A (ja) 画像符号化装置、画像復号装置、画像符号化方法、画像復号方法およびプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12736668

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12736668

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP