JP2011114641A - Recording device, reproducer, method for recording and reproducing stereoscopic video, recording method and reproducing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a reproducer that selectively reproduces recorded stereoscopic video content according to the capability thereof. <P>SOLUTION: Information for discriminating an image for right eye, an image for left eye or a combined image is recorded to a recording medium together with a video signal as attribute information of the video. The reproducer reads the attribute information from the recording medium, and selects the image and reproduces and outputs it. The reproducer for outputting a reproduced image and marking information that shows whether to reproduce a stereoscopic image, is included. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a recording apparatus, a reproducing apparatus, a stereoscopic video recording / reproducing method, a recording method, and a reproducing method.

  In parallel with the spread of high-definition broadcasting, an apparatus for reproducing an optical disk using a blue laser that enables viewing of movie software exceeding the conventional DVD image quality is becoming widespread. In such an apparatus, a high-definition video image having a horizontal resolution of 1920 dots, a vertical resolution of 1080 dots, and a frame rate of 30 frames / second can be reproduced. Since the main software is movie software, it is necessary to display subtitles, but bitmap images can be displayed so that arbitrary graphics can be displayed independently of the video image so that the user can switch the subtitle language. It is recorded together with the video image in a compressed state. Since this bitmap image is reproduced and displayed as an overlay on the video image, it has the same resolution as the normal video image.

  At the same time as the high quality of these videos, stereoscopic video has been attracting attention recently. In movie theaters, the development of an environment for enjoying movies as stereoscopic images is ongoing, and it is natural that various methods for recording these stereoscopic video contents on a medium such as a DVD and enjoying them on a home display are proposed. The basic principle of stereoscopic video is to deliver two parallax videos, so-called right-eye video and left-eye video, independently to each eye of the viewer. Therefore, there is a possibility that the amount of information handled in transmission or recording / reproduction may double as compared with normal video.

  As one of proposals related to stereoscopic video technology, there is a technology listed in Patent Document 1. In Patent Document 1, when the right-eye video and the left-eye video are transmitted or recorded / reproduced, the right-eye video and the left-eye video are merged in the horizontal direction after performing a process of halving the horizontal pixels of each video, A technique is disclosed in which the number of pixels is equivalent to that of a normal (that is, non-stereoscopic) video. The video thus completed will be referred to as side-by-side video or SBS video. According to Patent Document 1, since the difference between normal video and SBS video is transparent in the transmission or recording / playback system, for example, SBS video can be recorded on a DVD after applying the same compression method as before. The viewer can enjoy the stereoscopic video by playing it on a normal DVD player and outputting it to an appropriate display device.

JP 2005-522958 A

  While the above technique has a great advantage that a stereoscopic video can be delivered to a viewer using an existing transmission path or a recording / reproducing system, the horizontal direction per one eye compared to a normal video. The number of pixels is halved, and display is performed by performing pixel interpolation in the horizontal direction, but a reduction in resolution is inevitable. In the trend toward high-quality video, each of the two three-dimensional images will need at least the same quality as normal video.

  A suitable solution is to prepare video for each eye that is equivalent to normal video, and record and play back two at the same time, but as a playback device, to play back conventional video to play back stereoscopic video Double playback capability is required compared to the above, and there is a problem that playback is not possible with conventional devices. In addition, it is conceivable to record both two images for stereoscopic video and video for normal reproduction or stereoscopic reproduction using SBS video and selectively reproduce them appropriately on various reproduction devices. Could not make a selection.

  The following three types of playback devices are targeted by the present invention.

  1. This is a conventional playback device that can play back one video. Accordingly, it is possible to select and reproduce the left-eye video, the right-eye video, or the SBS video. In such a reproducing apparatus, it is normal that an identification signal as to whether or not a stereoscopic display video is being output can be sent to the video display apparatus when the video is output.

  2. A playback device capable of playing back one video, and when outputting video, an identification signal can be sent to the video display device as to whether or not a stereoscopic display video is being output. A reproducing apparatus that outputs the identification signal when selecting and reproducing.

  3. A playback device that can play back two images, and can output an identification signal as to whether or not a stereoscopic display image is being output to the image display device when outputting the image. A playback device that outputs the identification signal when simultaneously playing back video or selecting and playing back SBS video.

  In order to solve the above problems, the recording apparatus of the present invention records a right-eye video and a left-eye video when recording stereoscopic video content on a recording medium, or a horizontal resolution from a right-eye video and a left-eye video. Is recorded in the horizontal direction, or the combined video in the horizontal direction is recorded, or the video for the right eye and the video for the left eye are recorded, and the video attribute information is either the video for the right eye or the video for the left eye. Alternatively, information that enables identification of the combined video is recorded together with the video signal.

  When playing back stereoscopic video content, the playback device of the present invention reads video attribute information identifying whether it is a right-eye video, a left-eye video, or a combined video from a recording medium, and corresponds to the playback capability. A playback device that selects video and performs playback output. (1) When the display information indicating whether the playback of the stereoscopic video and the playback of the playback video cannot be output, the video for the right eye or the video for the left eye is displayed. (2) When the indication information can be output and multiple images cannot be reproduced at the same time, the combined image is selected and reproduced, and at the same time, the indication indicates stereoscopic video reproduction (3) When the indication information can be output and a plurality of images can be reproduced at the same time, both the right-eye image and the left-eye image are selected and reproduced, and stereoscopic image reproduction is performed. Output sign information indicating That.

  In the stereoscopic video recording / reproducing method of the present invention, in order to record / reproduce a stereoscopic video, the recording apparatus records the right-eye video and the left-eye video on the recording medium, or horizontally from the right-eye video and the left-eye video. Reduce the resolution by half and record the combined video in the horizontal direction, or record the video for the right eye and the video for the left eye, and the video for the right eye or the video for the left eye as video attribute information. Or a combination of video and video information is recorded together with the video signal, and the playback device reads the attribute information from the recording medium, selects the video, and outputs the playback video. And a playback device that can output the indication information indicating whether or not the playback is a stereoscopic video. (1) The playback device that cannot output the indication information selects and plays back the right-eye video or the left-eye video. , (2 A playback device capable of outputting the indication information, wherein a playback device that cannot simultaneously play a plurality of videos selects and plays back the combined video, and outputs indication information indicating that the video is 3D video playback. And (3) a playback device capable of outputting the indication information, wherein the playback device capable of simultaneously playing a plurality of videos selects and plays both the right-eye video and the left-eye video, and plays back a stereoscopic video. The sign information indicating that is output.

  In the recording method of the present invention, when recording stereoscopic video content on a recording medium, the right-eye video and the left-eye video are recorded, or the horizontal resolution is reduced by half from the right-eye video and the left-eye video, and the horizontal direction Record the combined video combined with the right-eye video, the left-eye video and the combined video, and identify the right-eye video, the left-eye video, or the combined video as video attribute information Is recorded together with the video signal.

  In the playback method of the present invention, when playing back stereoscopic video content, the video attribute information for identifying whether the video is for the right eye, the left eye, or the combined video is read from the recording medium, and the playback capability is determined. This is a method of selecting video and performing playback output. (1) When the display information indicating whether the playback of the stereoscopic video and the playback of the playback video cannot be output, the video for the right eye or the video for the left eye is selected. (2) When the indication information can be output and a plurality of images cannot be reproduced simultaneously, the combined image is selected and reproduced, and at the same time, the indication information indicates that the image is a three-dimensional image reproduction. (3) When the indication information can be output and a plurality of images can be reproduced simultaneously, both the right-eye image and the left-eye image are selected and reproduced, and the three-dimensional image reproduction is performed. Output the indication information

  According to the present invention, when stereoscopic video content is transmitted or recorded and reproduced in addition to the conventional video content, the video content can be selected and reproduced according to the capability of the reproduction device. Compatibility problems can be reduced.

The figure which shows the recording device which concerns on this invention The figure which shows the structural example of the stream attribute information which concerns on this invention The figure which shows the example of the reproducing | regenerating apparatus concerning this invention The figure which shows another example of the reproducing | regenerating apparatus concerning this invention The figure which shows another example of the reproducing | regenerating apparatus concerning this invention The figure which shows another structural example of the stream attribute information which concerns on this invention

  FIG. 1 shows a recording apparatus to which the present invention is applied. This recording apparatus receives as input a pair of images with parallax, that is, a right-eye image and a left-eye image, produced for stereoscopic image display. Such a video is a normal moving image, and processing is performed over a period in which the moving image exists. First, the input video is input to the SBS processing unit 11. In the SBS processing unit 11, the horizontal pixels in each eye video frame are thinned in half, and then merged in the horizontal direction to create a side-by-side video (SBS video). For example, if the video frame for each eye has a horizontal resolution of 1920 pixels and vertical 1080 pixels, each eye image before merging is thinned to 960 pixels in the horizontal direction, the left and right are merged, and again horizontal 1920 pixels, vertical Get a video frame of 1080 pixels.

  These three video frames are transferred to the compression processing unit 12, and video compression processing is executed. For the compression process, well-known MPEG compression may be applied.

  Video compression data, which is the compression result for each video frame, is input to the format processing unit 13. The format processing unit 13 performs multiplexing processing of video data using packetization as a basic technology. For example, a multiplexed video stream called a transport stream can be obtained by an MPEG multiplexing process. In this multiplexing, each video data is stored in a packet with identification information, so that each video data can be separated on the decoding side. In the MPEG system, identification information called PID is defined and stored at the beginning of each packet, and separation processing is possible.

  At the same time as the multiplexing process, the format processing unit 13 creates and outputs stream attribute information that is information related to the contents of the multiplexed video stream.

  In the recording processing unit 14, in order to record the multiplexed video stream and the stream information on the optical disc 15, addition of a correction code and application of digital modulation are executed.

  The stream attribute information will be further described.

  The stream attribute information is information in which attribute information relating to each video data that has been multiplexed is recorded in the form of a data table. An example of the configuration is shown in FIG.

  Each video data has PID at the time of multiplexing, video encoding method, video resolution, frame rate, and content identification as attribute information. In the content identification field, the type of stereoscopic viewing of the video content can be recorded. In the example of FIG. 2, the video data with PID 0x1011 (0x indicates hexadecimal display) is the video for the right eye, the video data with PID 0x1012 is the video for the left eye, and the PID is 0x1013 It can be identified that the video data is a side-by-side video. If the video data is a normal content that is not related to stereoscopic viewing, the content identification column can be left blank.

  Alternatively, for right-eye video, the lower 4 bits of the PID are encoded to be 0x1, for left-eye video, the lower 4 bits of the PID are encoded to be 0x2, and for side-by-side video, the lower order of the PID The encoding may be performed so that the 4 bits are 0x3, and in the case of normal content not related to stereoscopic viewing, the lower 4 bits of the PID may be encoded as 0x4. In this case, it is not necessary to newly add a content identification column to the data table, and the processing of the data table in the playback device can be simplified.

  Such a table of stream attribute information is appropriately encoded and recorded at a predetermined position on the optical disc 15.

  FIG. 3 shows an example of a playback apparatus for carrying out the present invention. The optical disk 15 created by the previous recording device is reproduced. The reproduction processing unit 31 reads the recording data of the optical disc, executes demodulation and correction processing, and then outputs the stream attribute information and the multiplexed video stream described above. The inverse format processing unit 32 processes the stream attribute information, separates desired video data from the multiplexed video stream, and outputs it to the decompression processing unit 33. The decompression processing unit 33 decompresses the compressed video data and outputs the video as a sequence of video frames.

  The playback device shown in FIG. 3 is a playback device in which the reverse format processing unit 32 is changed to process stream attribute information with respect to the conventional playback device, and the decompression processing unit 33 decompresses one video data. The decompressed video is output as it is. Therefore, when the reverse format processing unit 32 receives the stream attribute information shown in FIG. 2, the content identification information is read, and, for example, video data with a PID of 0x1011 that is a right-eye video is separated from the multiplexed stream and decompressed. Supply to the processing unit 33.

  In this manner, in the present playback device, the right-eye video is automatically selected and played back, so that it is possible to perform playback similar to normal video playback.

  FIG. 4 shows an example of another reproducing apparatus. This playback device is compatible with only one playback data decompression process, similar to the playback device of FIG. 3, but includes a video processing unit 44 and a function of converting SBS video into video output of an appropriate format. . The reverse format processing unit 42 receives the stream attribute information and automatically selects the side-by-side video content with priority. That is, in the example of FIG. 2, the video data with the PID of 0x1013 is separated from the multiplexed video stream and supplied to the decompression processing unit 43. The decompression processing unit 43 performs video decompression processing. The video processing unit 44 temporarily stores the supplied video frame, performs a double interpolation process for the pixels in the horizontal direction, and sequentially outputs the merged left and right videos in the sequence of the left side, right side, left side, and right side. By this processing, a stereoscopic image can be output at a resolution of 1920 horizontal pixels, 1080 vertical pixels, and a frame rate of 60 frames / second. Such an output form is called page flipping, and stereoscopic viewing can be enjoyed with an appropriate display device. The playback device must notify the display device that the video output is being sent by page flipping. Therefore, when the reverse format processing unit 42 selects and separates the SBS video, the reverse format processing unit 42 controls the video processing unit 44 as shown in FIG. 4 and provides identification information indicating that it is output in the page flipping mode as additional information for the video. Output together with video information. As such an output form, it is desirable to use HDMI (High-Definition Multimedia Interface) or the like capable of performing complete digital transmission and transmitting video information and auxiliary information by time division multiplexing.

  FIG. 5 shows an example of another reproducing apparatus. Unlike the previous example, this playback apparatus includes an expansion processing unit A53 and an expansion processing unit B54, and can simultaneously expand two video data. The inverse format processing unit 52 receives the stream attribute information, separates the right-eye video data and the left-eye video data from the multiplexed video stream, and supplies them to the expansion processing unit A53 and the expansion processing unit B54, respectively. That is, in the example of FIG. 2, the operation is performed to separate and supply the right-eye video data having a PID of 0x1011 and the left-eye video data having a PID of 0x1012. The video processing unit 55 temporarily stores the video frames supplied from the two decompression processing units and sequentially outputs them in the sequence of the left side, right side, left side, and right side. By this processing, a stereoscopic image can be output at a resolution of 1920 horizontal pixels, 1080 vertical pixels, and a frame rate of 60 frames / second. The playback device must notify the display device that the video output is being sent by page flipping. Therefore, when the reverse format processing unit 52 selects and separates the left and right paired videos, it controls the video processing unit 55 as shown in FIG. 5, and the identification information indicating that it is output in the page flipping mode as additional information for the video Are output together with video information. As such an output form, it is desirable to use HDMI capable of performing complete digital transmission and transmitting video information and auxiliary information by time division multiplexing. When this playback device is used, unlike the example of the previous playback device, pixel interpolation processing is not required, and higher quality stereoscopic video can be enjoyed.

  If it is known in advance that the display device connected to the video output of the playback device shown in FIG. 3, FIG. 4 and FIG. The playback device selects an SBS video from the multiplexed video stream, and bypasses the processing in the video processing unit 44 in FIG. 4 or the video processing unit 55 in FIG. 5 so that the SBS video can be output to the display device as it is. May be configured. In this case, it is desirable to output identification information indicating that the data is output in the SBS mode, instead of identification information indicating that the data is output in the page flipping mode, as additional information in the output.

  In the first embodiment, the recording / playback of video content by shooting has been described, but movie software or the like often has subtitles for display in accordance with the video. Therefore, when stereoscopically viewing a video, it is preferable to perform processing for stereoscopic viewing of subtitles because there is less discomfort.

  Subtitles are a type of graphics data, and video and compression encoding methods are different, but recording and playback can be realized with video by applying the recording device shown in FIG. 1 and the playback devices shown in FIGS. 3, 4, and 5. . When recording and reproducing graphics in addition to video, the stream attribute information for graphics shown in FIG. 6 is recorded in addition to the stream attribute information for video shown in FIG.

  The example in FIG. 6 shows that three types of graphics data are recorded. Each graphics uses PID at the time of multiplexing, graphics encoding method, graphics resolution, frame rate, and content identification as attribute information. Have. As a graphics encoding method, a standard method such as PNG (Portable Network Graphics) can be used. In the content identification field, the type of stereoscopic viewing of the graphics can be recorded. In the example of FIG. 6, it is possible to identify that the graphics data with the PID of 0x1200 is the right-eye video, the graphics data with the PID of 0x1201 is the video for the left eye, and the graphics data with the PID of 0x1202 is the side-by-side video. is there. If the graphics data is a normal content that is not related to stereoscopic viewing, the content identification column can be left blank.

  Alternatively, the content identification information can be assigned to the lower 4 bits of the PID without adding the content identification column as in the first embodiment.

  Such a table of stream attribute information is appropriately encoded and recorded at a predetermined position on the optical disc 15.

  3, 4, and 5, by performing the operation of the first embodiment also on the graphics data, it is possible to display graphics that match the video and enjoy more stereoscopic video. .

DESCRIPTION OF SYMBOLS 11 SBS process part 12 Compression process part 13 Format process part 14 Recording process part 15 Optical disk 31 Playback process part 32 Reverse format process part 33 Decompression process part 41 Playback process part 42 Reverse format process part 43 Decompression process part 44 Video process part 51 Playback Processing unit 52 Reverse format processing unit 53 Decompression processing unit A
54 Decompression processing part B
55 Video processor

Claims (5)

When recording stereoscopic video content on a recording medium,
Record right-eye video and left-eye video, or reduce the horizontal resolution from the right-eye video and left-eye video by half and record the combined video horizontally, or right-eye video and left-eye video Record the combined video,
Furthermore, a recording apparatus that records information that can identify whether the image is right-eye video, left-eye video, or combined video as video attribute information together with a video signal. When playing 3D video content,
A playback device that reads attribute information of a video identifying whether it is a right-eye video, a left-eye video, or a combined video from a recording medium, selects a video corresponding to a playback capability, and performs playback output.
(1) When the display information indicating whether or not the playback of the stereoscopic video can be output together with the output of the playback video, the video for the right eye or the video for the left eye is selected and played back,
(2) When the indication information can be output and a plurality of images cannot be reproduced simultaneously, the combined image is selected and reproduced, and at the same time, the indication information indicating that the stereoscopic image reproduction is performed,
(3) When the indication information can be output and a plurality of images can be reproduced at the same time, both the right-eye image and the left-eye image are selected and reproduced, and the indication information indicating the stereoscopic image reproduction is displayed. Playback device to output. In order to record and reproduce stereoscopic video, the recording device records the right-eye video and the left-eye video on the recording medium, or reduces the horizontal resolution from the right-eye video and the left-eye video in half, and in the horizontal direction. Record combined video, or record right-eye video, left-eye video, and combined video, and identify video-right attribute, left-eye video, or combined video as video attribute information Information to be recorded along with the video signal,
A playback device is a device that reads the attribute information from a recording medium, selects a video, and performs playback output. The playback device can output indication information indicating whether or not playback of a stereoscopic video is performed together with the output of the playback video Including
(1) A playback device that cannot output the indication information selects and plays a right-eye video or a left-eye video,
(2) A reproduction apparatus capable of outputting the indication information, wherein the reproduction apparatus that cannot simultaneously reproduce a plurality of videos selects and reproduces the combined video, and indicates a stereoscopic video reproduction Output information,
(3) A playback apparatus capable of outputting the indication information, wherein the playback apparatus capable of simultaneously playing a plurality of videos selects and plays both the right-eye video and the left-eye video, and is a stereoscopic video playback. 3D image recording / reproducing method, characterized in that sign information indicating that is output. When recording stereoscopic video content on a recording medium,
Record right-eye video and left-eye video, or reduce the horizontal resolution from the right-eye video and left-eye video by half and record the combined video horizontally, or right-eye video and left-eye video Record the combined video,
Furthermore, a recording method for recording information that can identify whether the image is right-eye video, left-eye video, or combined video as video attribute information together with a video signal. When playing 3D video content,
A playback method for reading video attribute information identifying whether the video for right eye, video for left eye, or combined video from a recording medium, selecting video corresponding to playback capability, and performing playback output,
(1) When the display information indicating whether or not the playback of the stereoscopic video can be output together with the output of the playback video, the video for the right eye or the video for the left eye is selected and played back,
(2) When the indication information can be output and a plurality of images cannot be reproduced simultaneously, the combined image is selected and reproduced, and at the same time, the indication information indicating that the stereoscopic image reproduction is performed,
(3) When the indication information can be output and a plurality of images can be reproduced at the same time, both the right-eye image and the left-eye image are selected and reproduced, and the indication information indicating the stereoscopic image reproduction is displayed. Playback method to output.

Images