WO2012165718A1 - Automatic convergence control apparatus using eye-tracking and method for same - Google Patents

Abstract

Disclosed are an apparatus and method which extract a region on a display panel on which the eyes are fixed through a camera module that is mounted in front of a binocular camera and senses movement of the eyes, when a stereoscopic 3D video is generated or reproduced using the binocular camera; and a convergence is automatically controlled on the basis of the extracted region. When users generate or reproduce a stereoscopic 3D video, a convergence to a region for aligning a convergence can be automatically controlled without a separate operation, and with just visual inspection, thereby removing inconveniences when controlling a convergence, and enabling optimal recognition of a three-dimensional structure.

Description

Convergence automatic control device using eye tracking and method

The present invention relates to an apparatus and method for automatically adjusting convergence by detecting eye movement when generating or playing a stereoscopic 3D image using a binocular camera, and more particularly, to an eye movement in front of the binocular camera. The present invention relates to a technology for detecting a region of a display panel on which the eye is looking through the camera module and automatically adjusting convergence based on the extracted region.

In the binocular stereoscopic image, although the two left and right camera modules of the camera system are photographing the same object, the object is photographed with a slight horizontal difference like the human eye. It is called time difference. When the 3D image is captured by the human eye and the 3D image is reproduced in the brain, if the image does not match according to the left and right camera intervals and the size of the parallax of the left and right images toward the object, the eye becomes tired and headaches occur. Cause problems such as causing.

If two cameras are taken by one camera, the two images can be perfectly matched, but there is no parallax between the two images, so the stereoscopic feeling cannot be felt. However, when photographing an arbitrary point with a binocular camera that is regularly spaced apart, the left and right images do not overlap each other in inverse proportion to the viewing distance, and the parallax increases. In other words, the parallax between two images taken with a binocular camera has a characteristic that the parallax increases from a distance to a near distance. The left and right images are similar to each other, but because the objects in the distance and the objects in the short distance are mixed, a difference occurs in the matching point depending on the state of the background and the subjects.

Accordingly, the stereoscopic 3D image is generated by adjusting the convergence by matching the gaze points by moving both images left and right or up and down about a target object or gaze area (a point where depth = 0) as a reference. However, in the past, in order to adjust the convergence, it was necessary to touch a specific object or an area on the display panel on which a 3D 3D image is being reproduced or manually manipulate the UI. In other words, the user has no choice but to adjust the convergence by directly manipulating the UI or touching the panel each time in order to adjust the convergence of stereoscopic 3D.

A technique for automatically adjusting convergence on a display panel using eye tracking is presented. In other words, when users create or play stereoscopic 3D images, the convergence is automatically adjusted and the 3D stereoscopic images are automatically adjusted just by looking at the area for the convergence without the need for a separate operation such as manipulating the UI or touching the panel. It is intended to present a technique that can be created or reproduced.

According to an aspect, an automatic convergence control apparatus using eye-tracking may include a sensing camera module and a sensing camera module configured to detect eye movement looking at a display panel of a device for generating or playing a stereoscopic 3D image. It includes a convergence control unit for automatically controlling the convergence according to the movement of the eye.

According to a further aspect, the apparatus may further include a gaze extractor configured to extract an area on the display panel that the eye gazes according to the movement of the eye sensed by the sensing camera module.

In addition, the convergence adjustment unit controls the convergence based on the gaze region extracted by the gaze region extraction unit.

According to a further aspect, the apparatus may further include a calibration unit configured to perform calibration according to the movement of the eye detected by the sensing camera module.

In addition, according to an additional aspect, and receives the image corresponding to the left and right eyes from the two camera modules, to generate the stereoscopic 3D image by applying the result of the convergence control processing by the convergence control unit to the received left and right eyes image The apparatus may further include a stereoscopic image generator.

In addition, according to another aspect, the reproduction of the stereoscopic 3D image generated in advance, and if the convergence is automatically controlled by the convergence control unit while the stereoscopic 3D image is reproduced, the stereoscopic 3D image is adjusted to match the processing result It may further include a stereoscopic image playback unit.

In addition, according to an additional aspect, the two camera modules may be camera modules supporting different maximum resolutions.

According to another aspect of the present invention, an automatic convergence control method using eye-tracking is characterized in that a three-dimensional sensor camera module detects eye movements of a human eye and eyes are monitored according to eye movements detected at a detection stage. The apparatus may include a gaze region extraction step of extracting a gaze region on the display panel and a convergence adjustment step of controlling convergence based on the extracted region in the gaze region extraction step.

The convergence adjustment step may control the convergence based on the gaze region extracted in the gaze region extraction step.

In addition, the sensing step may include performing a calibration according to the movement of the eye detected by the sensing camera module.

Eye-tracking can be used to provide a technology that allows the user to automatically adjust the convergence on the display panel. In other words, when users create or play stereoscopic 3D images, the convergence can be automatically adjusted just by looking at the area to adjust the convergence without any action, eliminating the hassle of adjusting the convergence and optimizing stereoscopically. I can recognize it.

1 is a diagram illustrating an example of adjusting convergence in a conventional stereoscopic 3D imaging apparatus.

2 is a diagram illustrating an apparatus for automatically adjusting convergence using eye-tracking according to an embodiment.

3 is a block diagram of an apparatus for automatically adjusting convergence using eye-tracking according to an embodiment.

4 is a diagram illustrating an image recognized by the right and left eyes of a stereoscopic image.

5 is a diagram illustrating a display result of left and right eye images on a display panel.

6 is a diagram illustrating an image after convergence is automatically adjusted according to an embodiment.

7 is a diagram illustrating a calibration for accurately extracting a gaze area according to eye-tracking.

8 is a flowchart illustrating a method for automatically adjusting convergence using eye-tracking according to an embodiment.

Specific details of other embodiments are included in the detailed description and the drawings. Advantages and features of the present invention and methods for achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but can be implemented in various different forms, and only the embodiments make the disclosure of the present invention complete, and the general knowledge in the art to which the present invention belongs. It is provided to fully inform the person having the scope of the invention, which is defined only by the scope of the claims. Like reference numerals refer to like elements throughout.

Hereinafter, an apparatus for automatically adjusting convergence using eye-tracking and a method thereof according to embodiments will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating an example of adjusting convergence in a conventional stereoscopic 3D imaging apparatus. As shown in FIG. 1, in the conventional apparatus for generating or playing stereoscopic 3D images, in order to match the convergence of the stereoscopic 3D images, the user sets an area to be converged through the user interface or a specific region on the display panel of the apparatus. The convergence was adjusted by touching. However, since the gaze of the user is not fixed to an object or a specific area while the stereoscopic 3D image is being played back, it changes from time to time, so each time the user has to adjust the screen UI or touch the display panel to adjust the convergence. There was pain and discomfort.

2 is a diagram illustrating an apparatus for automatically adjusting convergence using eye-tracking according to an embodiment. As shown in FIG. 2, the apparatus 100 for automatically adjusting convergence using eye-tracking according to an embodiment may be a mobile device such as a binocular camera or a smartphone as a device for generating or playing a stereoscopic 3D image. have. However, the convergence automatic adjustment device 100 is not limited thereto and includes all devices capable of generating or playing stereoscopic 3D images.

2 illustrates a smartphone in which a video call camera module 110 is built in the front, and two camera modules 120 are built in the rear to capture an image corresponding to the left and right eye images.

3 is a block diagram of an apparatus for automatically adjusting convergence using eye-tracking according to an embodiment. According to an embodiment, the automatic convergence adjusting apparatus 100 using eye tracking includes a sensing camera module 110 and a convergence adjusting unit 150.

The sensing camera module 110 detects eye movement looking at the display panel of the device in which a stereoscopic 3D image is generated or reproduced. Smartphones or mobile phones can play a role as a front camera for a video call, and in the case of a general binocular camera can be equipped with a sensing camera module in the front separately.

The convergence adjuster 150 automatically controls the convergence according to the movement of the eye detected from the sensing camera module 110. To adjust the convergence means to match the gaze points by moving both images left and right or up and down about a target object or gaze area (a point where depth = 0) as one of the left and right eye images.

4 is a diagram illustrating an image recognized by the right and left eyes of a stereoscopic image. As shown in FIG. 4, the images seen through both eyes are different, and through this different information, the distance difference to the object is recognized, thereby making the stereoscopic sense. At this time, convergence control should be performed according to which object is viewed as the center to make the stereoscopic recognition more effective. If the point of view of the user is not the point of convergence, it may cause eye fatigue or headache. Therefore, it is a very useful technique to immediately detect the movement of the eye and automatically adjust the convergence centered on the point where the eye looks.

In the binocular stereoscopic image, although the two left and right camera modules of the camera system are photographing the same object, the object is photographed with a slight horizontal difference like the human eye. It is called time difference. When the 3D image is captured by the human eye and the 3D image is reproduced in the brain, if the image does not match according to the left and right camera intervals and the size of the parallax of the left and right images toward the object, the eye becomes tired and headaches occur. Cause problems such as causing.

The parallax between two images taken with a binocular camera has a characteristic that the parallax increases from a distance to a near distance. The left and right images are similar to each other, but because the objects in the distance and the objects in the short distance are mixed, a difference occurs in the matching point depending on the state of the background and the subjects. Accordingly, the stereoscopic 3D image is generated by adjusting the convergence by matching the gaze points by moving both images left and right or up and down about a target object or gaze area (a point where depth = 0) as a reference.

5 is a diagram illustrating a display result of left and right eye images on a display panel. FIG. 5 shows the results of the case where the convergence is not matched and when the object A is centered, the center of the object B is adjusted.

6 is a diagram illustrating an image after convergence is automatically adjusted according to an embodiment. The left side of FIG. 6 is a case where the gaze area extraction unit 140 extracts the object A into the gaze area according to eye motion information detected through the front camera (corresponding to the detection camera module 110). 150 shows that the convergence is adjusted by horizontally moving an image corresponding to the left and right eyes around the object A. FIG. 6 illustrates a case in which the gaze extraction unit 140 extracts the object B as a gaze area according to eye motion information detected through the front camera (corresponding to the detection camera module 110). The adjusting unit 150 adjusts the convergence by horizontally moving the image corresponding to the left and right eyes around the object B. FIG.

Meanwhile, referring to FIG. 3, the automatic convergence adjusting device 100 may further include a gaze extraction unit 140. The gaze extraction unit 140 extracts an area on the display panel that the eye is looking at according to the movement of the eye detected by the sensing camera module 110. In this case, all conventionally known methods may be used to extract a spot that the pupil gazes by using the image of the eye photographed by the sensing camera.

In addition, the convergence adjuster 150 controls the convergence based on the gaze region extracted by the gaze region extractor 140.

In addition, the convergence automatic adjustment device 100 may further include a calibration unit 130. The calibration unit 130 performs calibration according to the movement of the eyes detected by the sensing camera module. In order to more accurately extract the gaze area according to the eye movement detected by the detection camera module 110, that is, a specific position on the display panel of the device 100 that the eye is gazing, the gaze area extraction unit 140 is calibrated. This may be necessary.

For example, FIG. 7 illustrates a calibration for accurately extracting a gaze area according to eye-tracking. Referring to FIG. 7, the calibration unit 130 displays a calibration to perform calibration. Cursors are output in order from the bottom right of the image to the bottom left, top left, and top right. However, the order of outputting the cursor and the point of outputting the cursor may be arbitrarily determined, but are not limited thereto. Then, the sensing camera module 110 detects (shoots) the movement of the eye tracking the point where the cursor is output. The calibration unit 130 sets coordinates for each eye position by converting the position of the eye detected (photographed) by the sensing camera module 110 into coordinates.

Therefore, the gaze area extractor 140 detects the eye movement and detects the eye position looking at a predetermined position on the display panel where the image is reproduced, and the calibrating unit 130 sets the calibrator 130. According to the coordinates, the eye gaze on the display panel can be accurately extracted.

In addition, the automatic convergence control device 100 according to an additional embodiment may further include a stereoscopic image generation unit 160. The stereoscopic image generator 160 receives images corresponding to the left and right eyes from the two camera modules 120, and applies the result of the convergence control process by the convergence control unit to the received left and right eyes images. Create an image.

In this case, the two camera modules 120 may be camera modules that support the same maximum resolution or support different maximum resolutions. That is, the two camera modules 120 may be the same camera module supporting the same resolution, but in this case, a high-resolution camera module is mainly used, which causes a high cost of manufacturing the binocular camera. Therefore, when manufacturing a binocular camera, the cost of using a camera module that supports different maximum resolution, that is, one using a relatively low cost low resolution camera module, and one using a relatively high resolution camera module Can reduce the cost.

For example, of the two camera modules, the first camera module may support a relatively high resolution of 8M, and the second camera module may be a camera module that supports a relatively low resolution of 3M. In an embodiment, the image captured by the first camera module may have a wider angle of view than the image photographed by the second camera module, thereby capturing a wider range. However, the present invention is not limited thereto, and the two images may have the same angle of view or have an arbitrary angle of view by adjusting or designing an optical system. On the other hand, even if two camera modules support different resolutions, the resolution of the output image includes the same or different output.

That is, although the maximum resolution of the camera module that supports relatively high resolution and the camera module that supports low resolution differs from each other, the resolutions of the output images can be matched with each other to output images of the same resolution. On the other hand, when capturing, the image may be output by photographing by making the size of the object substantially the same within the maximum resolution supported by each camera module.

When an image corresponding to the left and right eye images is input from two camera modules 120 supporting different resolutions, the stereoscopic image generator 160 may generate an image cutting unit (not shown) to generate a stereoscopic 3D image. And a scaling unit (not shown).

The image cutting unit (not shown) corresponds to left and right eye images, and two images respectively photographed from two camera modules 120 supporting different resolutions are input. The image cutting unit (not shown) according to an exemplary embodiment cuts an image captured from at least a high resolution camera module among two input images according to an angle of view of an input image captured from a low resolution camera module.

The scaling unit (not shown) may output the same to the convergence control unit 150 by matching the resolutions of two images whose angles of view are adjusted by the image cutting unit (not shown).

 According to one embodiment, the output resolutions of the high resolution camera module and the low resolution camera module are the same, and the respective images are captured and the captured images are input. That is, two cameras with different angles of view, that is, the 8M high resolution camera module and the 3M low resolution camera module, capture the target object to generate a stereoscopic 3D image by using the same output resolution, and each of the recorded images (Not shown). At this time, since the resolution of the image captured and input from each camera module 120 is the same, the target objects of the image input from the high-resolution camera module having a wide angle of view are larger than the same target objects of the image captured from the low resolution camera module. Becomes small.

In this case, the image cutting unit (not shown) first crops a part of an image input from a high resolution camera module having a wide angle of view, that is, a portion where the angle of view coincides with an image input from a low resolution camera module. The convergence adjusting unit 150 generates a stereoscopic 3D image by adjusting the convergence of both images having the same angle of view.

The scaling unit (not shown) scales a portion of the image input from the high resolution camera module cut according to the angle of view of the image input from the low resolution camera module so that the size of the image is relatively large. Match the resolution of both images to match the size of the image.

The convergence control unit 150 adjusts the convergence of both images in which the angle of view and the resolution match, based on the gaze region extracted by the gaze extraction unit 140. That is, the convergence control unit 150 adjusts the convergence by matching the left and right eye images by moving horizontally or vertically based on the point of the area (depth = 0) extracted from the gaze extraction unit 140.

On the other hand, according to another embodiment, when shooting so that the size of the target object to generate a three-dimensional 3D image is roughly matched by two cameras of the 8M high resolution camera module and the 3M low resolution camera module from a high resolution camera module having a wide angle of view The size of the captured image is larger than the size of the image captured from the low resolution camera module.

Therefore, in order to generate a stereoscopic 3D image, first, an image cutting unit (not shown) crops a portion of an image captured by a high resolution camera module that matches an angle of view of an image captured by the low resolution camera module.

 Then, the scaling unit (not shown) first determines whether to scale the cropped image of the high resolution camera module. Because each image photographed through the high resolution camera module and the low resolution camera module is photographed so as to roughly match the size of the target object to generate a stereoscopic 3D image, the size of the cut image is input from the low resolution camera module. Will be the same as the video.

Therefore, the image of the cut-off high resolution camera module and the image of the low resolution camera module have the same size, and the objects do not need to be scaled.

However, even when the sizes of the target objects are photographed with approximately the same size, some differences may occur in the sizes of the target objects in the photographed image. In this case, the scaling unit (not shown) performs scaling to match the resolution of both images.

The convergence control unit 150 controls convergence control of two images whose angle of view and resolution are matched according to an input indication value. The stereoscopic image generation unit 160 outputs an image corresponding to the result of the convergence control process.

In addition, according to an additional embodiment, the automatic convergence adjustment device 100 may further include a stereoscopic image playback unit 170. The stereoscopic image reproducing unit 170 reproduces the stereoscopic 3D image generated in advance, and if the convergence is automatically controlled by the convergence adjusting unit while the stereoscopic 3D image is reproduced, the stereoscopic 3D image is reproduced to match the processing result. Adjust the output.

8 is a flowchart illustrating a method for automatically adjusting convergence using eye-tracking according to an embodiment. In the method of automatically controlling convergence using eye tracking according to the exemplary embodiment shown in FIG. 8, first, the sensing camera module detects the movement of a human eye (step S100).

More specifically, the detecting step (S100) may include performing a calibration according to the movement of the eye detected by the sensing camera module. That is, calibration is performed to more accurately extract the gaze area according to the eye movement detected by the detection camera module 110, that is, a specific position on the display panel of the device 100 that the eye is gazing at the gaze area extractor 140. Calibration may be necessary. To this end, the convergence automatic adjustment device 100 may further include a calibration unit 130. The calibration unit 130 performs calibration according to the movement of the eyes detected by the sensing camera module.

For example, FIG. 7 illustrates a calibration for accurately extracting a gaze area according to eye-tracking. Referring to FIG. 7, the calibration unit 130 displays a calibration to perform calibration. Cursors are output in order from the bottom right of the image to the bottom left, top left, and top right. However, the order of outputting the cursor and the point of outputting the cursor may be arbitrarily determined, but are not limited thereto. Then, the sensing camera module 110 detects (shoots) the movement of the eye tracking the point where the cursor is output. The calibration unit 130 sets coordinates for each eye position by converting the position of the eye detected (photographed) by the sensing camera module 110 into coordinates.

Next, in the sensing step (step S100), the image being generated by the stereoscopic image generator 160 or reproduced by the stereoscopic image reproducing unit 170 is output.

That is, the stereoscopic image generation unit 160 receives images corresponding to the left and right eyes from the two camera modules 120 and outputs the input images to the display.

In this case, the two camera modules 120 may be the same camera module that supports the same resolution, but in this case, both of them use the same high resolution camera module, which leads to a high cost when producing a binocular camera. Therefore, when manufacturing a binocular camera to solve this problem, it is possible to use a low-resolution camera module of a relatively low cost of any one of the two camera modules.

For example, a first camera module of two camera modules may support a relatively high resolution of 8M, and the second camera module may be a camera module supporting a resolution of 3M, which is a relatively low cost. In an embodiment, the image captured by the first camera module may have a wider angle of view than the image photographed by the second camera module, thereby capturing a wider range.

On the other hand, even if two camera modules support different resolutions, the resolution of the output image includes the same or different output. That is, although the maximum resolution of the camera module that supports relatively high resolution and the camera module that supports low resolution differs from each other, the resolutions of the output images can be matched with each other to output images of the same resolution. On the other hand, when capturing, the image may be output by photographing by making the object size approximately the same within the range of the maximum resolution supported by each camera module.

That is, the image cutting unit (not shown) of the stereoscopic image generator 160 corresponds to the left and right eye images, and receives two images respectively captured by two camera modules 120 supporting different resolutions. In addition, the image cutting unit (not shown) cuts an image photographed from at least a high resolution camera module among two input images according to an angle of view of an input image photographed from a low resolution camera module. In addition, the scaling unit (not shown) of the stereoscopic image generating unit 160 outputs by matching the resolution of the two images with the angle of view at the image cutting unit (not shown).

According to one embodiment, the output resolutions of the high resolution camera module and the low resolution camera module are the same, and the respective images are captured and the captured images are input. That is, two cameras with different angles of view, that is, the 8M high resolution camera module and the 3M low resolution camera module, capture the target object to generate a stereoscopic 3D image by using the same output resolution, and each of the recorded images (Not shown). At this time, since the resolution of the image captured and input from each camera module 120 is the same, the target objects of the image input from the high-resolution camera module having a wide angle of view are larger than the same target objects of the image captured from the low resolution camera module. Becomes small.

In this case, the image cutting unit (not shown) first crops a part of an image input from a high resolution camera module having a wide angle of view, that is, a portion where the angle of view coincides with an image input from a low resolution camera module.

The scaling unit (not shown) scales a portion of the image input from the high resolution camera module cut according to the angle of view of the image input from the low resolution camera module so that the size of the image is relatively large. Match the resolutions of both images to match the size of the image and output them to the display.

On the other hand, according to another embodiment, when shooting so that the size of the target object to generate a three-dimensional 3D image is roughly matched by two cameras of the 8M high resolution camera module and the 3M low resolution camera module from a high resolution camera module having a wide angle of view The size of the captured image is larger than the size of the image captured from the low resolution camera module.

Therefore, in order to generate a stereoscopic 3D image, first, an image cutting unit (not shown) crops a portion of an image captured by a high resolution camera module that matches an angle of view of an image captured by the low resolution camera module.

 Then, the scaling unit (not shown) first determines whether to scale the cropped image of the high resolution camera module. Because each image photographed through the high resolution camera module and the low resolution camera module is photographed so as to roughly match the size of the target object to generate a stereoscopic 3D image, the size of the cut image is input from the low resolution camera module. Will be the same as the video.

Therefore, the image of the cut-off high resolution camera module and the image of the low resolution camera module have the same size, and the objects do not need to be scaled.

However, even when the sizes of the target objects are photographed with approximately the same size, some differences may occur in the sizes of the target objects in the photographed image. In this case, the scaling unit (not shown) performs scaling to match the resolution of both images.

Alternatively, the stereoscopic image reproducing unit 170 outputs and reproduces the stereoscopic 3D image previously generated on the display.

Next, the sensing step (step S100) detects the movement of the eye looking at the display panel of the device 100 in which the stereoscopic 3D image is being generated or reproduced by the sensing camera module 110 to capture a captured image in the gaze extraction unit. Send it.

Then, according to the movement of the eye detected in the detection step (step S100), the gaze area on the display panel on which the eye is looking is extracted (step S200).

The gaze extraction unit 140 analyzes an image sensed and transmitted by the sensing camera module 110 and extracts an area on the display panel that the eye gazes as the eye moves. On the other hand, when the calibration is performed in the detection step (step S100), the detection camera module 110 detects the eye movement and detects the eye position looking at a predetermined position on the display panel where the image is reproduced. The unit 140 may accurately extract an area of the eye on the display panel according to the coordinates set by the calibration unit 130.

Then, the convergence is adjusted based on the region extracted in the gaze region extraction step (step S200) (step S300).

That is, the convergence adjustment step (step S300) may adjust the convergence by horizontally or vertically moving the image corresponding to the left and right eyes based on the gaze region extracted in the gaze region extraction step.

In this case, if the two camera modules support different resolutions, the convergence is adjusted by horizontally or vertically moving both images scaled and output by the scaling unit (not shown).

As shown in FIG. 6, on the left side of FIG. 6, the gaze area extraction unit 140 moves the object A to the gaze area according to eye motion information detected through the front camera (corresponding to the sensing camera module 110). In this case, the convergence adjusting unit 150 adjusts the convergence by horizontally or vertically moving the image corresponding to the left and right eyes around the object A. FIG. 6 illustrates a case in which the gaze extraction unit 140 extracts the object B as a gaze area according to eye motion information detected through the front camera (corresponding to the detection camera module 110). The adjusting unit 150 shows that the convergence is adjusted by horizontally or vertically moving the image corresponding to the left and right eyes with respect to the object B. FIG.

Finally, the convergence outputs the stereoscopic 3D image adjusted in the adjusting step (step S300) (step S400).

That is, when the convergence is adjusted in the convergence adjustment step (step S300), the stereoscopic image generating unit 160 or the stereoscopic image reproducing unit 170 generates or reproduces the final stereoscopic 3D image in which the convergence is adjusted.

Those skilled in the art will appreciate that the present invention can be embodied in other specific forms without changing the technical spirit or essential features of the present invention. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. The scope of the present invention is indicated by the scope of the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and the equivalent concept are included in the scope of the present invention. Should be interpreted.

Claims (10)

A sensing camera module for detecting a movement of an eye looking at a display panel of a device in which a stereoscopic 3D image is generated or reproduced; A convergence automatic control apparatus using eye-tracking, including; a convergence control unit for automatically controlling the convergence according to the movement of the eyes detected by the detection camera module. The method of claim 1, And an eye region extracting unit configured to extract an area on the display panel that the eye observes according to the movement of the eye detected by the sensing camera module. The method of claim 2, wherein the convergence control unit, An automatic convergence control apparatus using eye-tracking to control the convergence based on the gaze region extracted by the gaze region extraction unit. The method according to any one of claims 1 to 3, And a calibration unit configured to perform calibration according to the movement of the eye detected by the detection camera module. The automatic convergence control apparatus using eye tracking. The method according to any one of claims 1 to 3, A stereoscopic image generation unit that receives images corresponding to left and right eyes from two camera modules and generates stereoscopic 3D images by applying a result of convergence control processing by the convergence control unit to the received left and right eye images; Convergence automatic control device using eye tracking (eye-tracking) further included. The method according to any one of claims 1 to 3, A stereoscopic image reproducing unit for reproducing a stereoscopic 3D image generated in advance, and adjusting the reproduced stereoscopic 3D image according to the processing result when the convergence is automatically controlled by the convergence adjusting unit while the stereoscopic 3D image is reproduced. Convergence automatic control device using eye-tracking (Eye-tracking) further comprising. The method of claim 5, wherein the two camera modules, Convergence automatic control device using eye-tracking, characterized in that the camera module supporting different maximum resolution. In the method for controlling the convergence in the device for generating or playing stereoscopic 3D image, A sensing step of sensing, by the sensing camera module, a movement of a human eye; A gaze region extraction step of extracting gaze regions on the display panel that the eyes are gazing in accordance with the movement of the eyes detected in the sensing step; And A convergence automatic control method using eye-tracking comprising a; convergence control step of controlling the convergence based on the region extracted in the gaze region extraction step. The method of claim 8, wherein the convergence adjustment step, The convergence automatic control method using eye-tracking, characterized in that for controlling the convergence on the basis of the gaze region extracted in the gaze region extraction step. The method of claim 8 or 9, wherein the detecting step, A method for automatically controlling convergence using eye-tracking, comprising performing calibration according to eye movement detected by the sensing camera module.

Images