WO2012023807A2 - Multidimensional layer sending-and-receiving device and method for stereoscopic three-dimensional video data - Google Patents

Abstract

The present invention relates to a multidimensional layer sending-and-receiving device and method for stereoscopic three-dimensional video data. According to one embodiment, a sending device of the present invention maps respective multidimensional data items onto a complex plane and converts the same to stream data items, and maps respective stream data items onto respective dimensions divided by time and space before sending. Also, according to one embodiment, a receiving device checks a received signal strength and performance and power mode, checks a service image corresponding to the received signal strength and performance and power mode, checks dimensions corresponding to the service image, and receives stream data of the checked dimensions.

Description

Multidimensional Layer Transceiver and Method for Stereoscope 3D Video Data

The present invention relates to a method for transmitting stereoscopic 3D video data, and more particularly, to a method of providing maximum user capacity as well as providing maximum quality of service through optimal use of communication resources when transmitting stereoscopic 3D video data.

As 3D movies succeed in recent years, 3D broadcasting services have become a focus of attention. In the future, various types of 3D video transmission applications such as 3D games, 3D Internet access, and 3D video phones are expected to be utilized. However, in order to service 3D, 4th, etc. multi-view data including stereo (secondary) such as 3D, more communication resources are needed because much data must be transmitted. However, since communication resources, in particular, radio resources, are limited, an efficient and optimal method of using resources is required.

There is a conventional method of transmitting 3D video to SVC (Scalable Video Coding) video information. That is, the left view image data (Left data) as the base layer in the stereoscopic 3D video data, the right There may be a method of mapping view image data (right data) to an enhancement layer or vice versa. Existing SVC image information may be transmitted by a layer transmission technique. At this time, the conventional layer transmission technology uses constellations overlapping only in the two-dimensional complex plane.

An embodiment of the present invention provides an apparatus and method for multi-dimensional layer transmission and reception of stereoscopic 3D video data.

An embodiment of the present invention provides a transmitting apparatus for mapping each of the multidimensional data to a complex plane and converting the stream data into stream data, and mapping each of the stream data to each of the dimensions divided into time and space.

An embodiment of the present invention checks the received signal strength, performance, and power mode, checks the service image corresponding to the received signal strength, performance, and power mode, confirms the dimension corresponding to the service image, and confirms the identified dimension. Provided is a receiving device for receiving stream data.

In accordance with an aspect of the present invention, an apparatus for transmitting a multidimensional hierarchical layer of stereoscopic 3D video data includes: a data generator configured to generate multidimensional data; A stream generation unit for mapping each of the multidimensional data to a complex plane and converting the stream data into stream data; And a multi-dimensional transmitter for mapping each of the stream data to each of the dimensions divided into time and space. In this case, the multidimensional data may include at least one two-dimensional view data.

The multi-dimensional hierarchical receiver for stereoscopic 3D video data according to an embodiment of the present invention checks a received signal strength, a performance, and a power mode, and displays a service image corresponding to the received signal strength, the performance, and the power mode. A control unit for confirming and confirming a dimension corresponding to the service image; A multi-dimensional receiving unit receiving stream data having a dimension confirmed through the control unit; And a data converter for converting the received stream data into data. At this time, the multi-dimensional can be divided by time, space and complex plane.

A multidimensional hierarchical transmission method of stereoscopic 3D video data according to an embodiment of the present invention includes generating multidimensional data; Mapping each of the multidimensional data to a complex plane and converting the stream data into stream data; And mapping each of the stream data to each of the dimensions divided into time and space. In this case, the multidimensional data may include at least one two-dimensional view data.

In accordance with an aspect of the present invention, there is provided a method for receiving a multidimensional layer of stereoscopic 3D video data, the method comprising: checking received signal strength; Checking performance; Identifying a power mode; Checking a service image corresponding to the received signal strength, the performance, and the power mode; Receiving stream data of a dimension corresponding to the service image from among stream data mapped to multiple dimensions; And converting the received stream data into data. At this time, the multi-dimensional can be divided by time, space and complex plane.

The present invention relates to an apparatus and method for multidimensional hierarchical transmission and reception of stereoscopic three-dimensional video data. The transmission apparatus of the present invention physically stores each data of multiple views including stereo (secondary) without using additional radio resources. Transmits multi-dimensional signals in layers at once. Therefore, a receiver having a good channel condition can serve a 3D image, and a receiver having a poor channel condition can efficiently use a radio resource by serving a 2D image. In addition, the multi-dimensional data may be adaptively received in consideration of the received signal strength, the performance of the terminal, and the power mode.

1 shows a configuration of a multi-dimensional layer transmission apparatus according to an embodiment of the present invention.

2 illustrates a configuration of a stream generator in a multi-dimensional layer transmission apparatus according to an embodiment of the present invention.

3 shows an area for providing a service for each layer in a multi-dimensional layer transmission apparatus according to an embodiment of the present invention.

4 shows a configuration of a multi-dimensional layer receiving apparatus according to an embodiment of the present invention.

5 illustrates a configuration of a data converter in a multi-dimensional hierarchical receiver according to an exemplary embodiment of the present invention.

6 illustrates an example of receiving multi-dimensional data according to a situation in a multi-dimensional layer receiving apparatus according to an embodiment of the present invention.

7 illustrates an example in which multidimensional data is transmitted through a repeater according to an embodiment of the present invention.

8 illustrates an example in which multi-dimensional data is transmitted through a repeater according to a flow of time according to an embodiment of the present invention.

9 is a flowchart illustrating transmission of multidimensional data in a multidimensional hierarchical transmission apparatus according to an embodiment of the present invention.

10 is a flowchart illustrating receiving multidimensional data in a multidimensional layer receiving apparatus according to an exemplary embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 shows a configuration of a multi-dimensional layer transmission apparatus according to an embodiment of the present invention.

Referring to FIG. 1, the transmitter 100 may include a scheduling unit 110, a first stream generator 120, a second stream generator 130, an Nth stream generator 140, and a multi-dimensional transmitter 150. And a multiple antenna unit 160.

The scheduling unit 110 generates a first stream generator 120, a second stream generator 130, and an Nth stream by scheduling the multidimensional data to be transmitted as a 3D image to be transmitted through a multidimensional received from an application layer. Provided to the unit 140. In this case, the multi-dimensional data may include at least one two-dimensional view data, and may include depth map data. At least one of the multidimensional data may be data of a base layer, and the rest may be data of an enhancement layer.

Each of the stream generators 120, 130, and 140 maps each of the multidimensional data to a complex plane to convert the stream data into stream data. The detailed configuration of the stream generators 120, 130, and 140 may be configured as shown in FIG. 2 below.

2 illustrates a configuration of a stream generator in a multi-dimensional layer transmission apparatus according to an embodiment of the present invention.

Referring to FIG. 2, the stream generator 120 may include a CRC inserter 210, a coder 220, a first interleaver 230, a modulator 240, a second interleaver 250, and an amplifier 260. ).

The CRC insertion unit 210 inserts an error correction code (CRC; Cyclic Redundancy Check) into the received data.

The encoder 220 encodes multidimensional data into which an error correction code is inserted.

The first interleaver 230 bit interleaves the encoded data. In this case, the first interleaver 230 interleaves the encoded data bit by bit in order to convert the cluster error into a random error to facilitate error correction.

The modulator 240 modulates the bit interleaved data by mapping the constellation coordinates.

The second interleaver 250 symbolly interleaves the modulated data. In this case, the second interleaver 250 interleaves the modulated data in symbol units in order to convert the cluster error into a random error to facilitate error correction.

The amplifier 260 amplifies the symbol interleaved data to generate stream data for each dimension.

In FIG. 2, the first interleaver 230 and the second interleaver 250 may be omitted.

Returning to the description of FIG. 1 again, the multi-dimensional transmitter 150 maps each stream data to each of the dimensions divided into time and space and transmits the mapped data.

The multi-dimensional transmitter 150 divides the time by varying the time for transmitting data, divides the space by changing the antennas 162 and 164 included in the multi-antenna unit 160 for transmitting data, and divides the divided dimensions. The stream data are mapped to each and transmitted.

That is, the multi-dimensional transmission described in the present invention refers to a procedure of mapping and transmitting a signal to all dimensions that are optimally available at the same time for signal transmission in dimensions such as complex plane, time, and space. Taking 8-dimensional transmission as an example, if a signal is transmitted using a two-dimensional complex plane, two time intervals considered in two dimensions, and two transmission antennas that are also considered in two dimensions, the signal is 2 x 2 x 2 = mapped to the transmission signal of the 8-dimensional to be transmitted. Of course, as different signals may be superimposed on different layers in a two-dimensional complex plane, such as layered modulation, multiple signals in each dimension may be further overlapped in the same dimension as necessary.

Then, at least two dimensions are required to transmit a three-dimensional image through the transmission apparatus of the present invention described with reference to FIG. 1. This is because at least two-dimensional left view images and two-dimensional right view images must be transmitted or two-dimensional images and depth map images must be transmitted in order to transmit three-dimensional images.

Even if the transmitting apparatus 100 transmits the 3D image through the multi-dimensional, the receiving apparatus may change the quality of the image that can be serviced by the receiving apparatus according to a power mode for managing location, performance, and power.

The reason why the quality of the image that can be serviced by the receiving device varies depending on the location of the receiving device will be described with reference to FIG.

3 shows an area for providing a service for each layer in a multi-dimensional layer transmission apparatus according to an embodiment of the present invention. 3 illustrates an example of transmitting and receiving SVC (Scalable Video Coding).

Referring to FIG. 3, when a signal of a base layer 320 as a basic data layer and an enhanced layer 310 as a quality enhancement layer overlaps and is transmitted, a base station, which is a transmission device 100, is selected. The terminal within a point about 80% away from the center can reliably receive both the base layer 320 and the enhancement layer 310 to receive a 3D or high quality video image. However, at about 20% of the base stations, that is, cell boundary points, only the base layer 320 may be reliably received to receive a 2D or low quality video image.

4 shows a configuration of a multi-dimensional layer receiving apparatus according to an embodiment of the present invention.

Referring to FIG. 4, the reception apparatus 400 includes a controller 410, a multiple antenna unit 420, a multidimensional receiver 430, a first data converter 440, and an Mth data converter 450.

The controller 410 checks the received signal strength, performance, and power mode, checks the service image corresponding to the received signal strength, performance, and power mode, and checks the dimension corresponding to the service image.

The multi-dimensional receiving unit 430 receives the stream data having the dimension confirmed through the control unit 410. In this case, the multi-dimensional receiver 430 distinguishes the dimensions of the space divided by the antennas 422 and 424 included in the multi-antenna unit 420, and distinguishes the dimensions of the divided time through the time when the stream data is received. .

The data converters 440 and 450 convert the received stream data into data.

The detailed configuration of the data converters 440 and 450 may be configured as shown in FIG. 5 below.

5 illustrates a configuration of a data converter in a multi-dimensional hierarchical receiver according to an exemplary embodiment of the present invention.

Referring to FIG. 5, the data converter 440 includes a second deinterleaver 510, a demodulator 520, a first deinterleaver 530, a decoder 540, and an error detector 550.

The second deinterleaver 510 deinterleaves the interleaved stream data in symbol units to reduce clustering errors.

The demodulator 520 demodulates a symbol mapped to a complex plane into data.

The first deinterleaver 530 deinterleaves the demodulated data interleaved bit by bit in order to reduce clustering errors.

The decoder 540 decodes the demodulated data received from the first deinterleaver 530.

The error detector 550 checks an error correction code included in the decoded data and corrects the error.

6 shows an example of receiving a receiver to suit the circumstances of the receiver when the transmitter transmits a parallel data signal such as Scalable Video Coding (SVC) or Multi-view Video Coding (MVC) in an optimal condition. I will explain through.

6 illustrates an example of receiving multi-dimensional data according to a situation in a multi-dimensional layer receiving apparatus according to an embodiment of the present invention.

FIG. 6 illustrates a case in which parallel data signals such as SVC and MVC are mapped and transmitted with a two-dimensional complex plane and a 16-dimensional time at a time. Here, 16-dimensional time means 2 ^ 4 = 16, which means that four time slices composed of two-dimensional complex planes are applied as one unit and mapped. Therefore, FIG. 6 is a 32-dimensional signal transmission, and if the signal is extended to the number of transmit and receive antennas, a spatial dimension may be added to generate a multi-dimensional signal. In this case, multi-dimensional gains can be generated to further increase radio transmission efficiency.

Referring to the transmission signal of the transmitter in FIG. 6, two data streams overlap each other in a two-dimensional complex plane, and four time slices are transmitted in one unit.

In FIG. 6, Br is right view data of the base layer, Bl is left view data of the base layer, and Er1 is the right side of the enhanced layer 1. View data, El1 is left view data of enhancement layer 1, Er2 and El2 are view data of right and left of enhancement layer 2, and Er3 and El3 are view data of right and left of enhancement layer 3, respectively.

Each case of the terminals of FIG. 6 is as shown in Table 1 below.

As can be seen through Figure 6, it can be seen that the image quality that can be serviced by the receiving device is different depending on the received signal strength, the performance and power mode of the receiving device.

On the other hand, the problem that the high frequency signal is not transmitted to the cell boundary of the base station can be solved by using a repeater.

7 illustrates an example in which multidimensional data is transmitted through a repeater according to an embodiment of the present invention.

Referring to FIG. 7, the reception device 400 located at a cell boundary may receive a signal of an enhancement layer through the repeater 700.

In this case, a full duplex relay or a half duplex relay may be used as the type of repeater used. When the full duplex relay is used, the receiving device 400 may be provided with the same service as that at the cell center even at the cell boundary.

However, when the repeater used is a half duplex relay, the receiving device may not be provided with the same service as that at the cell center even at the cell boundary.

When using a half duplex relay, the receiving device 400 located at the cell boundary may receive a signal as shown in FIG. 8 below.

8 illustrates an example in which multi-dimensional data is transmitted through a repeater according to a flow of time according to an embodiment of the present invention.

During the time period T1, the base station, which is a transmitting device, transmits only the base layer to the terminal located at the cell boundary, and delivers both the base layer and enhancement layer 1 to the repeater.

During the time period of T2, the base station, which is a transmitting device, transmits only the enhancement layer 2 to the terminal located at the cell boundary, and the relay delivers the enhancement layer 1 received from the base station in the time period of T1 to the terminal located at the cell boundary. Therefore, the terminal located at the cell boundary can serve the image using the base layer, enhancement layer 1 and enhancement layer 2.

Hereinafter, a multidimensional layer transmission / reception method of stereoscopic 3D video data according to the present invention configured as described above will be described with reference to the accompanying drawings.

9 is a flowchart illustrating transmission of multidimensional data in a multidimensional hierarchical transmission apparatus according to an embodiment of the present invention.

Referring to FIG. 9, in operation 910, the transmitting apparatus generates multidimensional data to be transmitted in multiple dimensions. In this case, the multi-dimensional data may include at least one two-dimensional view data, and may include depth map data. At least one of the multidimensional data is data of a base layer, and the rest belongs to data of an enhancement layer.

In operation 912, the transmitting apparatus inserts an error correction code (CRC; Cyclic Redundancy Check) into each of the dimension data.

In operation 914, the transmitting apparatus encodes each of the multi-dimensional data into which the error correction code is inserted, for each dimension.

In operation 916, the transmitting apparatus bit interleaves each of the encoded data for each dimension.

In operation 918, the transmitting apparatus maps and modulates each of the bit interleaved data for each dimension to constellation coordinates for each dimension.

In operation 920, the transmitting apparatus symbol-interleaves each of the modulated data.

In operation 922, the transmitting apparatus amplifies each of the symbol interleaved data for each dimension to generate stream data for each dimension.

In operation 924, the transmitting apparatus maps and transmits each stream data to each of the dimensions divided into time and space. At this time, the transmitting apparatus divides time by changing the time for transmitting data, divides the space by changing the antenna for transmitting data, and maps and transmits stream data to each of the divided dimensions.

10 is a flowchart illustrating receiving multidimensional data in a multidimensional layer receiving apparatus according to an exemplary embodiment of the present invention.

Referring to FIG. 10, the receiving apparatus checks the received signal strength in step 1010. That is, the state of the channel receiving the multi-dimensional stream data is checked.

In operation 1012, the receiving device checks the performance of the terminal serving as the receiving device. That is, the receiving device checks the quality of the serviceable image.

In operation 1014, the receiving device checks the power mode set. In this case, the power mode may mean a mode divided according to the amount of power used.

In operation 1016, the receiving apparatus checks a service image corresponding to the received signal strength, performance, and power mode, and identifies a dimension corresponding to the service image.

In operation 1018, the receiving apparatus receives the stream data in the dimension identified from the multidimensional stream. At this time, at least one of the received stream data is data of a base layer, and the rest is data of an enhancement layer.

The receiving device converts the received stream data for each dimension identified in step 1020 into data.

Methods according to an embodiment of the present invention can be implemented in the form of program instructions that can be executed by various computer means and recorded in a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the media may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts.

As described above, the present invention has been described by way of limited embodiments and drawings, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the claims below but also by the equivalents of the claims.

Claims (20)

A data generator for generating multidimensional data; A stream generation unit for mapping each of the multidimensional data to a complex plane and converting the stream data into stream data; And A multi-dimensional transmitter for mapping and transmitting each of the stream data to each of the dimensions divided into time and space; The multidimensional data includes at least one two-dimensional view data. Multidimensional layer transmission apparatus of stereoscopic 3D video data. The method of claim 1, The multidimensional data, Including at least one depth map data Multidimensional layer transmission apparatus of stereoscopic 3D video data. The method of claim 1, At least one of the multidimensional data is data of a base layer, and the rest is data of an enhancement layer. Multidimensional layer transmission apparatus of stereoscopic 3D video data. The method of claim 1, The multi-dimensional transmitter, By dividing the time by varying the time to transmit data, by dividing the space by varying the antenna to transmit the data, by mapping the stream data to each of the divided dimensions and transmitting Multidimensional layer transmission apparatus of stereoscopic 3D video data. The method of claim 1, The stream generation unit, A CRC insertion unit for inserting an error correction code (CRC; Cyclic Redundancy Check) into each of the multidimensional data; A coder for encoding each of the multi-dimensional data into which the error correction code is inserted, for each dimension; A modulation unit for mapping and modulating each of the encoded data by dimension to constellation coordinates by dimension; And And an amplifier configured to amplify each of the modulated data by dimension to generate the stream data by dimension. Multidimensional layer transmission apparatus of stereoscopic 3D video data. The method of claim 5, A first interleaver for interleaving each of the data encoded for each dimension in the encoder; The modulator, Maps and modulates each of the interleaved data by dimension to constellation coordinates by dimension Multidimensional layer transmission apparatus of stereoscopic 3D video data. The method of claim 5, A second interleaver for interleaving each of the modulated data in the modulator; The amplification unit, Amplifying each of the interleaved data by dimension to generate stream data by the dimension Multidimensional layer transmission apparatus of stereoscopic 3D video data. A controller for checking a received signal strength, a performance, and a power mode, checking a service image corresponding to the received signal strength, the performance, and the power mode, and confirming a dimension corresponding to the service image; A multi-dimensional receiving unit receiving stream data having a dimension confirmed through the control unit; And A data converter for converting the received stream data into data; The multidimensional is divided by time, space and complex plane Multidimensional hierarchical receiver for stereoscopic 3D video data. The method of claim 8, At least one of the received stream data is data of a base layer, and the rest is data of an enhancement layer. Multidimensional hierarchical receiver for stereoscopic 3D video data. The method of claim 8, The control unit, When the service image is checked, the stronger the received signal strength is, the higher the service image of the high flavor is determined to be selected, and the higher the performance is, the higher the service image of the high aspect is determined to select the service image, the power mode is low power If it does not work, the service video of the home office Multidimensional hierarchical receiver for stereoscopic 3D video data. Generating multidimensional data; Mapping each of the multidimensional data to a complex plane and converting the stream data into stream data; And Mapping each of the stream data to each of the dimensions divided into time and space; The multidimensional data includes at least one two-dimensional view data. Multidimensional Layer Transmission Method of Stereoscopic 3D Video Data. The method of claim 11, The multidimensional data, Including at least one depth map data Multidimensional Layer Transmission Method of Stereoscopic 3D Video Data. The method of claim 11, At least one of the multidimensional data is data of a base layer, and the rest is data of an enhancement layer. Multidimensional Layer Transmission Method of Stereoscopic 3D Video Data. The method of claim 11, Mapping and transmitting each of the stream data to each of the dimensions divided into time and space, By dividing the time by varying the time to transmit data, by dividing the space by varying the antenna to transmit the data, by mapping the stream data to each of the divided dimensions and transmitting Multidimensional Layer Transmission Method of Stereoscopic 3D Video Data. The method of claim 11, Converting the stream data, Inserting an error correction code (CRC; Cyclic Redundancy Check) into each of the multidimensional data; Encoding each of the multi-dimensional data into which the error correction code is inserted, by dimension; Mapping each of the data encoded for each dimension to constellation coordinates for each dimension and modulating the data; And Amplifying each of the modulated data by dimension to generate the stream data by dimension; Multidimensional Layer Transmission Method of Stereoscopic 3D Video Data. The method of claim 15, After the encoding step, Interleaving each of the encoded data for each dimension; The modulating step, Maps and modulates each of the interleaved data by dimension to constellation coordinates by dimension Multidimensional Layer Transmission Method of Stereoscopic 3D Video Data. The method of claim 15, After the modulating step, Interleaving each of the modulated data; The amplification step, Amplifying each of the interleaved data by dimension to generate stream data by the dimension Multidimensional Layer Transmission Method of Stereoscopic 3D Video Data. Checking the received signal strength; Checking performance; Identifying a power mode; Checking a service image corresponding to the received signal strength, the performance, and the power mode; Receiving stream data of a dimension corresponding to the service image from among stream data mapped to multiple dimensions; And Converting the received stream data into data, The multidimensional is divided by time, space and complex plane A method for receiving multidimensional layers of stereoscopic 3D video data. The method of claim 18, At least one of the received stream data is data of a base layer, and the rest is data of an enhancement layer. A method for receiving multidimensional layers of stereoscopic 3D video data. The method of claim 18, Checking the service image, As the received signal strength is stronger, it is determined to select a high-quality service image. The better the performance is determined to select the service image of the high-facing service image, If the power mode does not operate at a low power to determine to select a service image of the high-quality service image A method for receiving multidimensional layers of stereoscopic 3D video data.

Images