[go: up one dir, main page]

CN103885646B - Optical touch device and operating method thereof - Google Patents

Optical touch device and operating method thereof Download PDF

Info

Publication number
CN103885646B
CN103885646B CN201210563689.XA CN201210563689A CN103885646B CN 103885646 B CN103885646 B CN 103885646B CN 201210563689 A CN201210563689 A CN 201210563689A CN 103885646 B CN103885646 B CN 103885646B
Authority
CN
China
Prior art keywords
image
center
gravity
optical touch
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201210563689.XA
Other languages
Chinese (zh)
Other versions
CN103885646A (en
Inventor
黄昱豪
高铭璨
许恩峯
陈浥元
谢孟寰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Pixart Imaging Inc
Original Assignee
Pixart Imaging Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pixart Imaging Inc filed Critical Pixart Imaging Inc
Priority to CN201210563689.XA priority Critical patent/CN103885646B/en
Publication of CN103885646A publication Critical patent/CN103885646A/en
Application granted granted Critical
Publication of CN103885646B publication Critical patent/CN103885646B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Analysis (AREA)
  • Position Input By Displaying (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses an optical touch device and an operation method thereof. The operation method of the optical touch device comprises the following steps: emitting a light source with the light emitting unit to illuminate an object; acquiring an image of the object reflecting the light source by using the image sensing device; selecting all pixels of which the brightness is greater than or equal to a brightness critical value in the image; sorting the selected pixels according to a first coordinate axis of the image, a second coordinate axis of the image or pixel brightness; selecting pixels with the preset proportion from the sorted pixels as the object image of the object; and calculating the gravity center of the object image according to the pixel position or the collocation of the pixels with the preset proportion in a mode of taking the pixel brightness as weight. The invention also discloses an optical touch device. The gravity center judgment result obtained by the optical touch device and the operation method thereof provided by the invention can not cause the back-end circuit to execute wrong operation.

Description

光学式触控装置及其操作方法Optical touch device and operating method thereof

技术领域technical field

本发明涉及光学触控的技术领域,且特别是有关于一种光学式触控装置及其操作方法。The present invention relates to the technical field of optical touch, and in particular to an optical touch device and an operation method thereof.

背景技术Background technique

现有的光学式触控装置采用发光装置发出光源来照射使用者的手部,并采用影像感测装置来获取所述手部反射所述光源的影像,进而计算所获取影像中的手部影像(即手掌部分的影像)的重心。如此一来,后端电路便可依据光学式触控装置所计算出的重心来执行对应操作,例如是控制屏幕上的光标(cursor)的位移。Existing optical touch devices use a light emitting device to emit a light source to irradiate the user's hand, and use an image sensing device to obtain an image of the hand reflecting the light source, and then calculate the hand image in the obtained image (that is, the image of the palm part) of the center of gravity. In this way, the back-end circuit can perform corresponding operations according to the center of gravity calculated by the optical touch device, such as controlling the displacement of a cursor on the screen.

然而,这种光学式触控装置有一缺点,就是当使用者的手部连同手臂都进入影像感测装置所获取的影像中时,光学式触控装置便会去计算手部影像及手臂影像二者共同的重心,导致后端电路执行错误的操作,例如是让屏幕上的光标移动到错误的位置。However, this optical touch device has a disadvantage, that is, when the user's hand and arm enter the image captured by the image sensing device, the optical touch device will calculate the two images of the hand image and the arm image. Or the common center of gravity, causing the back-end circuit to perform wrong operations, such as moving the cursor on the screen to the wrong position.

因此,有必要提供改进的技术方案以克服现有技术中存在的以上技术问题。Therefore, it is necessary to provide an improved technical solution to overcome the above technical problems in the prior art.

发明内容Contents of the invention

本发明要解决的主要技术问题是提供一种光学式触控装置,其仅会计算所需的对象影像的重心,因而不会产生习知技术的问题。The main technical problem to be solved by the present invention is to provide an optical touch device, which only calculates the center of gravity of the required object image, and thus does not cause the problems of the prior art.

为解决上述技术问题,本发明提供了以下参考附图的详细说明,本发明的其它方面和特征变得明显。但是应当知道,所述附图仅仅为解释的目的设计,而不是作为本发明的范围的限定,这是因为其应当参考附加的权利要求。还应当知道,除非另外指出,不必要依比例绘制附图,它们仅仅力图概念地说明此处描述的结构和流程。In order to solve the above-mentioned technical problems, the present invention provides the following detailed description with reference to the accompanying drawings, and other aspects and features of the present invention will become apparent. It should be understood, however, that the drawings are designed for purposes of illustration only and not as a limitation of the scope of the invention, since reference should be made to the appended claims. It should also be understood that, unless otherwise indicated, the drawings are not necessarily drawn to scale and are merely intended to conceptually illustrate the structures and processes described herein.

本发明提供一种光学式触控装置,其仅会计算所需的对象影像的重心,因而不会产生习知技术的问题。The present invention provides an optical touch device, which only calculates the center of gravity of the required object image, and thus does not cause the problems of the prior art.

本发明另提供一种对应于上述光学式触控装置的操作方法。The present invention further provides an operation method corresponding to the above-mentioned optical touch device.

本发明提出一种光学式触控装置,其包括有发光单元、影像感测装置与处理电路。所述的发光单元用于发出光源以照射对象。所述的影像感测装置用于获取上述对象反射上述光源的影像。至于所述的处理电路,其电性连接上述影像感测装置,以取得上述影像,并用于选取上述影像中亮度大于或等于亮度临界值的所有像素,以对所选取的像素依上述影像的第一坐标轴、上述影像的第二坐标轴或像素亮度进行排序。所述的处理电路还用于从排序出来的像素中再取前面预定比例的像素来当作上述对象的对象影像,并根据上述预定比例的像素的像素位置,或根据上述预定比例的像素的像素位置并以像素亮度为权重来计算上述对象影像的重心。The present invention provides an optical touch device, which includes a light emitting unit, an image sensing device and a processing circuit. The light emitting unit is used to emit light to illuminate the object. The image sensing device is used to acquire the image of the object reflecting the light source. As for the processing circuit, it is electrically connected to the above-mentioned image sensing device to obtain the above-mentioned image, and is used to select all the pixels in the above-mentioned image whose brightness is greater than or equal to the brightness threshold value, so as to select the pixels according to the first image of the above-mentioned image. The first axis, the second axis of the image above, or the pixel brightness are sorted. The processing circuit is also used to take the pixels of the predetermined ratio in front of the sorted pixels as the object image of the above object, and according to the pixel positions of the pixels of the predetermined ratio, or the pixels of the pixels of the predetermined ratio The position and the weight of the pixel brightness are used to calculate the center of gravity of the above-mentioned object image.

本发明另提出一种光学式触控装置的操作方法。所述的光学式触控装置包括有发光单元与影像感测装置。所述的操作方法包括有下列步骤:利用上述发光单元发出光源以照射对象;利用上述影像感测装置获取上述对象反射上述光源的影像;选取上述影像中亮度大于或等于亮度临界值的所有像素;对所选取的像素依上述影像的第一坐标轴、上述影像的第二坐标轴或像素亮度进行排序;从排序出来的像素中再取前面预定比例的像素来当作上述对象的对象影像;以及根据上述预定比例的像素的像素位置,或根据上述预定比例的像素的像素位置并以像素亮度为权重来计算上述对象影像的重心。The invention further provides an operation method of the optical touch device. The optical touch device includes a light emitting unit and an image sensing device. The operation method includes the following steps: using the above-mentioned light-emitting unit to emit a light source to illuminate the object; using the above-mentioned image sensing device to obtain an image of the above-mentioned object reflecting the above-mentioned light source; selecting all pixels in the above-mentioned image whose brightness is greater than or equal to a brightness threshold; Sorting the selected pixels according to the first coordinate axis of the above image, the second coordinate axis of the above image, or the brightness of the pixels; taking the pixels of the previous predetermined proportion from the sorted pixels as the object image of the above object; and The center of gravity of the object image is calculated according to the pixel positions of the predetermined proportion of pixels, or according to the pixel positions of the predetermined proportion of pixels with pixel brightness as a weight.

本发明解决前述问题的方式,乃是先发出光源以照射物件;接着,利用上述影像感测装置获取上述对象反射上述光源的影像;然后,选取上述影像中亮度大于或等于亮度临界值的所有像素;再接着,对所选取的像素依上述影像的第一坐标轴、上述影像的第二坐标轴或像素亮度进行排序;然后,从排序出来的像素中再取前面预定比例的像素来当作上述对象的对象影像;最后,根据上述预定比例的像素的像素位置,或根据上述预定比例的像素的像素位置并以像素亮度为权重来计算上述对象影像的重心。由上述可知,本发明仅会计算所需的对象影像的重心,因而不会产生习知技术的问题。The method of the present invention to solve the aforementioned problems is to first emit a light source to illuminate the object; then, use the above-mentioned image sensing device to obtain the image of the above-mentioned object reflecting the above-mentioned light source; and then select all pixels in the above-mentioned image whose brightness is greater than or equal to the brightness threshold ; Next, sort the selected pixels according to the first coordinate axis of the above-mentioned image, the second coordinate axis of the above-mentioned image, or the brightness of the pixels; The object image of the object; finally, the center of gravity of the object image is calculated according to the pixel positions of the above predetermined proportion of pixels, or according to the pixel positions of the above predetermined proportion of pixels and taking the pixel brightness as a weight. From the above, it can be seen that the present invention only calculates the center of gravity of the required object image, and thus does not cause the problems of the prior art.

为让本发明的上述和其他目的、特征和优点能还明显易懂,下文特举较佳实施例,并配合所附图式,作详细说明如下。In order to make the above and other objects, features and advantages of the present invention more comprehensible, preferred embodiments will be described in detail below together with the accompanying drawings.

附图说明Description of drawings

下面将结合附图,对本发明的具体实施方式进行详细的说明。The specific implementation manners of the present invention will be described in detail below in conjunction with the accompanying drawings.

图1为电子装置的侧面剖视示意图。FIG. 1 is a schematic side sectional view of an electronic device.

图2为图1的影像感测装置所获取到的其中一种影像的示意图。FIG. 2 is a schematic diagram of one of the images captured by the image sensing device in FIG. 1 .

图3为处理电路在其中一步骤所选取到的像素。FIG. 3 shows the pixels selected by the processing circuit in one of the steps.

图4为处理电路在其中一步骤所选取到的像素。FIG. 4 shows the pixels selected by the processing circuit in one of the steps.

图5为影像感测装置所获取的影像与屏幕的示意图。FIG. 5 is a schematic diagram of an image and a screen captured by the image sensing device.

图6为依照本发明一实施例的光学式触控装置的操作方法的流程图。FIG. 6 is a flowchart of an operating method of an optical touch device according to an embodiment of the invention.

具体实施方式detailed description

为使本发明的上述目的、特征和优点能够还加明显易懂,下面结合附图对本发明的具体实施方式做详细的说明。In order to make the above objects, features and advantages of the present invention more comprehensible, specific implementations of the present invention will be described in detail below in conjunction with the accompanying drawings.

需要说明的是,为了图示的清楚起见,本发明的附图仅显示了与本发明的创作点相关的结构特征,而对于其他的结构特征则进行了省略。It should be noted that, for the sake of clarity of illustration, the drawings of the present invention only show structural features related to the inventive point of the present invention, while other structural features are omitted.

图1为电子装置的侧面剖视示意图。图1中的标号100所指的即为所述的电子装置,此电子装置100例如是智能型手机、平板计算机、笔记本电脑的类的便携型电子装置,或者是其他具运算功能的电子装置,例如是多媒体播放装置。而如图1所示,此电子装置100采用了依照本发明一实施例的光学式触控装置110,而此光学式触控装置110电性连接电子装置100内部的处理器120(其可视为光学式触控装置110的后端电路)。FIG. 1 is a schematic side sectional view of an electronic device. The reference numeral 100 in FIG. 1 refers to the electronic device, and the electronic device 100 is, for example, a portable electronic device such as a smart phone, a tablet computer, a notebook computer, or other electronic devices with computing functions. For example, a multimedia playback device. As shown in FIG. 1 , the electronic device 100 adopts an optical touch device 110 according to an embodiment of the present invention, and the optical touch device 110 is electrically connected to the processor 120 inside the electronic device 100 (which can be viewed visually. is the back-end circuit of the optical touch device 110).

光学式触控装置110包括发光单元112、影像感测装置114与处理电路116。发光单元112用于发出光源以照射使用者的手部(如标号130所示)。而影像感测装置114用于获取手部130反射所述光源的影像。至于处理电路116,其电性连接影像感测装置114,以取得影像感测装置114所获取到的影像。进一步地,处理电路116还可以电性连接发光单元112,以控制发光单元112的开启或关闭,甚至是控制光源的亮度。The optical touch device 110 includes a light emitting unit 112 , an image sensing device 114 and a processing circuit 116 . The light emitting unit 112 is used for emitting a light source to irradiate the user's hand (shown by reference numeral 130 ). The image sensing device 114 is used to acquire the image reflected by the light source from the hand 130 . As for the processing circuit 116 , it is electrically connected to the image sensing device 114 to obtain an image captured by the image sensing device 114 . Further, the processing circuit 116 can also be electrically connected to the light emitting unit 112 to control the light emitting unit 112 to be turned on or off, and even to control the brightness of the light source.

以下将以图2所示的影像来举例说明处理电路116的动作方式。请参照图2,其为图1的影像感测装置114所获取到的其中一种影像的示意图。此影像是由多个像素所组成,例如是由800×600个像素所组成。为了说明的方便,图2所示的影像仅以四种不同的亮度来表示的,包含有:最亮(如不具任何花纹的区域)、次亮(如以点所形成的区域)、次暗(如以斜线所形成的区域)以及最暗(如以交叉线所形成的区域)。最亮的区域具有第一亮度值,次亮的区域具有第二亮度值,次暗的区域具有第三亮度值,而最暗的区域具有第四亮度值。此外,图2中的标号202是指手部影像及手臂影像。在图2中,手部影像及手臂影像202之所以会呈现出三种不同的亮度,是因为这三种不同亮度所对应的手部部位及手臂部位与发光单元112的距离不同所致;而手部影像及手臂影像202的外的区域之所以会呈现最暗的亮度,则是因为对应的空间中不存在物体来反射所述光源所致。The image shown in FIG. 2 will be used as an example to illustrate the operation of the processing circuit 116 below. Please refer to FIG. 2 , which is a schematic diagram of one of the images captured by the image sensing device 114 of FIG. 1 . The image is composed of multiple pixels, for example, 800×600 pixels. For the convenience of illustration, the image shown in Figure 2 is represented by only four different brightnesses, including: the brightest (such as an area without any patterns), the second brightest (such as an area formed by dots), and the second darkest. (as areas formed by diagonal lines) and the darkest (as areas formed by cross lines). The brightest area has a first brightness value, the next brightest area has a second brightness value, the next darkest area has a third brightness value, and the darkest area has a fourth brightness value. In addition, reference numeral 202 in FIG. 2 refers to a hand image and an arm image. In FIG. 2 , the reason why the hand image and the arm image 202 present three different brightnesses is that the distances between the hand parts and arm parts corresponding to the three different brightness levels and the light emitting unit 112 are different; The reason why the areas outside the hand image and the arm image 202 have the darkest brightness is that there is no object in the corresponding space to reflect the light source.

请同时参照图1与图2。处理电路116在透过影像感测装置114取得图2所示的影像后,便会去选取此影像中亮度大于或等于亮度临界值的所有像素。此亮度临界值可依实际的设计需求来决定。假设此亮度临界值介于所述第一亮度值与所述第二亮度值之间,那么处理电路116在此步骤所选取到的像素,便会是最亮的区域(即不具任何花纹的区域)里的所有像素。图3即为处理电路116在此步骤所选取到的像素。在图3中,所示的影像搭配直角坐标系统来显示,且此影像中位于左上角的像素位于直角坐标系统的原点(以P来标号),然而此图所示的影像与直角坐标系统的位置关系仅是用于举例,并非用于限制本发明。Please refer to Figure 1 and Figure 2 at the same time. After the processing circuit 116 acquires the image shown in FIG. 2 through the image sensing device 114 , it will select all the pixels in the image whose brightness is greater than or equal to the brightness threshold. The brightness threshold can be determined according to actual design requirements. Assuming that the brightness critical value is between the first brightness value and the second brightness value, then the pixel selected by the processing circuit 116 in this step will be the brightest region (that is, the region without any patterns) ) in all pixels. FIG. 3 is the pixels selected by the processing circuit 116 in this step. In Fig. 3, the image shown is displayed with a Cartesian coordinate system, and the pixel in the upper left corner of this image is located at the origin of the Cartesian coordinate system (labeled by P), however the image shown in this figure is not compatible with the Cartesian coordinate system The positional relationship is for example only, and is not intended to limit the present invention.

请同时参照图1与图3,处理电路116在取得所述的最亮区域(如图3中的不具任何花纹的区域)里的所有像素的后,处理电路116便会对所选取的像素依影像的X轴、影像的Y轴或像素亮度来进行排序。以依Y轴来进行排序而言,处理电路116例如可以是依由上至下、由左至右的方式来对所选取的像素进行排序。当然,排序的方式需依可能的成像方式而事先设定好。以图4所示的影像为例,处理电路116在选取到最亮区域(如图4中的不具任何花纹的区域)里的所有像素的后,便可依X轴(例如是由左至右、由上至下的方式)来对所选取的像素进行排序。而以图3所示的例子而言,依Y轴来进行排序,且是依由上至下的方式来进行排序,是较理想的选择。Please refer to FIG. 1 and FIG. 3 at the same time. After the processing circuit 116 obtains all the pixels in the brightest region (such as the region without any pattern in FIG. 3 ), the processing circuit 116 will select the selected pixels according to The X-axis of the image, the Y-axis of the image, or the brightness of the pixels are sorted. In terms of sorting according to the Y axis, the processing circuit 116 may sort the selected pixels from top to bottom and from left to right, for example. Of course, the sorting method needs to be set in advance according to the possible imaging methods. Taking the image shown in FIG. 4 as an example, after the processing circuit 116 selects all the pixels in the brightest region (such as the region without any pattern in FIG. , from top to bottom) to sort the selected pixels. Taking the example shown in FIG. 3 as an example, it is an ideal choice to sort according to the Y axis, and to sort from top to bottom.

请再同时参照图1与图3,假设处理电路116已依所述的由上至下、由左至右的方式对所选取的像素排序完毕,那么处理电路116便会从排序出来的像素中再取前面预定比例的像素来当作所需的对象影像。以图3为例,排序出来的像素均位于Y”与原点P的间,而所述前面预定比例的像素则是位于Y’与原点P的间。如此一来,处理电路116就仅会取得手指影像,并可将所述手指影像当作其所需的对象影像,而手部影像的其他部分、手臂影像及其他非相关影像便予以滤除。所述预定比例可依实际的设计需求来决定,举例来说,处理电路116可以是从排序出来的像素中取前面20%的像素。而在取得所需的对象影像后,处理电路116便会根据此对象影像中像素的像素位置,或是根据此对象影像中像素的像素位置并以像素亮度为权重来计算此对象影像的重心。以此例来说,处理电路116用于计算所取得的手指影像的重心,且是以手指影像中像素的像素位置来计算此手指影像的重心。然而,在其他实施方式中,处理电路116也可以是以手指影像中像素的像素位置并以像素亮度为权重来计算此手指影像的重心。值得注意的是,以此方式所计算出的重心为平均重心。以下将列出以像素亮度为权重来计算所需的影像重心的计算式:Please refer to FIG. 1 and FIG. 3 at the same time. Assuming that the processing circuit 116 has sorted the selected pixels from top to bottom and from left to right as described above, the processing circuit 116 will sort the selected pixels from the sorted pixels. Then take the pixels of the predetermined ratio in front as the required object image. Taking Fig. 3 as an example, the sorted pixels are all located between Y" and the origin P, and the pixels of the predetermined proportion are located between Y' and the origin P. In this way, the processing circuit 116 will only obtain Finger image, and the finger image can be regarded as its required object image, while other parts of the hand image, arm image and other irrelevant images are filtered out. The predetermined ratio can be determined according to actual design requirements Determine, for example, the processing circuit 116 can be to get the front 20% pixels from the pixels sorted out. And after obtaining the required object image, the processing circuit 116 will be based on the pixel position of the pixel in the object image, or Calculate the center of gravity of the object image according to the pixel position of the pixel in the object image and take the pixel brightness as a weight. For this example, the processing circuit 116 is used to calculate the center of gravity of the obtained finger image, and is based on the weight of the finger image The pixel position of the pixel is used to calculate the center of gravity of the finger image. However, in other implementations, the processing circuit 116 can also calculate the center of gravity of the finger image with the pixel position of the pixel in the finger image and with the pixel brightness as a weight. It should be noted The most important thing is that the center of gravity calculated in this way is the average center of gravity. The calculation formula for calculating the required image center of gravity with the pixel brightness as the weight is listed below:

Xx AA == (( Xx 11 ×× LL 11 )) ++ (( Xx 22 ×× LL 22 )) ++ ...... ++ (( Xx NN ×× LL NN )) LL 11 ++ LL 22 ++ ...... ++ LL NN ...... ...... (( 11 ))

YY AA == (( YY 11 ×× LL 11 )) ++ (( YY 22 ×× LL 22 )) ++ ...... ++ (( YY NN ×× LL NN )) LL 11 ++ LL 22 ++ ...... ++ LL NN ...... ...... (( 22 ))

其中,XA为平均重心的X坐标,YA为平均重心的Y坐标,X1~XN分别为所取得的对象影像中像素的像素位置的X坐标,L1~LN分别为所取得的对象影像中像素的像素亮度,Y1~YN分别为所取得的对象影像中像素的像素位置的Y坐标。此外,N为自然数,其表示所取得的对象影像中像素总数。Among them, X A is the X coordinate of the average center of gravity, Y A is the Y coordinate of the average center of gravity, X 1 ~ X N are the X coordinates of the pixel positions of the pixels in the obtained target image, and L 1 ~ L N are the obtained The pixel luminance of the pixel in the target image, Y 1 to Y N are the Y coordinates of the pixel positions of the pixels in the obtained target image, respectively. In addition, N is a natural number, which represents the total number of pixels in the acquired target image.

在计算出所需的对象影像的重心后,处理电路116便可以对应输出重心信息GS来作为重心判断结果,以便电子装置100内部的处理器120可依照此重心判断结果来控制电子装置100执行对应的操作。假设此电子装置100具有屏幕(未画出),那么处理器120便可依照此重心判断结果来控制此屏幕上的光标的位移。After calculating the center of gravity of the desired object image, the processing circuit 116 can correspondingly output the center of gravity information GS as the center of gravity judgment result, so that the processor 120 inside the electronic device 100 can control the electronic device 100 to execute the corresponding center of gravity according to the center of gravity judgment result. operation. Assuming that the electronic device 100 has a screen (not shown), the processor 120 can control the displacement of the cursor on the screen according to the determination result of the center of gravity.

由上述的描述可知,当使用者的手部连同手臂都进入影像感测装置114所获取的影像中时,光学式触控装置110并不会去计算手部影像及手臂影像二者共同的重心,而是仅会去计算所需的对象影像的重心,因此其所取得的重心判断结果不会导致后端电路执行错误的操作,例如是让屏幕上的光标移动到错误的位置。From the above description, it can be seen that when the user's hand and arm both enter the image captured by the image sensing device 114, the optical touch device 110 does not calculate the common center of gravity of the hand image and the arm image. , but will only calculate the center of gravity of the required object image, so the obtained center of gravity judgment result will not cause the back-end circuit to perform wrong operations, such as moving the cursor on the screen to a wrong position.

请再参照图1,假设电子装置100具有屏幕(未画出),而此屏幕的分辨率不同于影像感测装置114所获取的影像的分辨率时,那么处理电路116还可以是依据其所计算出的重心在影像感测装置114所获取的影像中的相对位置来换算光标在所述屏幕上的相对位置,以便处理器120可依照处理电路116的换算结果来控制此光标的移动。Please refer to FIG. 1 again, assuming that the electronic device 100 has a screen (not shown), and the resolution of the screen is different from the resolution of the image captured by the image sensing device 114, then the processing circuit 116 can also be based on its The calculated relative position of the center of gravity in the image captured by the image sensing device 114 is used to convert the relative position of the cursor on the screen, so that the processor 120 can control the movement of the cursor according to the converted result of the processing circuit 116 .

当然,处理电路116还可以是依据其所计算出的重心的移动向量乘上另一预设比例的结果来换算所述光标的移动向量,以便处理器120可依照处理电路116的换算结果来控制所述光标的移动。如此一来,就可以达成使光标的移动速度比用户的手部移动速度还快的效果。而所述的另一预定比例可依实际的设计需求来决定。另外,处理电路116也可以是进一步依据其所计算出的重心所处的位置相对于影像感测装置114所获取的影像的中心位置的位置向量乘上再另一预设比例的结果来换算所述光标的移动向量,以便处理器120可依照处理电路116的换算结果来控制所述光标的移动。如此一来,就可以达成即使使用者的手部未持续移动,光标却仍可持续移动的效果。而所述的再另一预定比例同样可依实际的设计需求来决定。此外,值得一提的是,处理电路116还可进一步包括有低通滤波器116-2,以利用此低通滤波器116-2来平滑化所述光标在所述屏幕上的移动。Of course, the processing circuit 116 can also convert the moving vector of the cursor according to the result of multiplying the calculated moving vector of the center of gravity by another preset ratio, so that the processor 120 can control the cursor according to the conversion result of the processing circuit 116. The movement of the cursor. In this way, the effect of making the cursor move faster than the user's hand can be achieved. The other predetermined ratio can be determined according to actual design requirements. In addition, the processing circuit 116 may also further convert the calculated weight according to the result of multiplying the calculated position of the center of gravity relative to the center position of the image captured by the image sensing device 114 by another preset ratio. The moving vector of the cursor, so that the processor 120 can control the moving of the cursor according to the conversion result of the processing circuit 116 . In this way, the effect that the cursor can still move continuously can be achieved even if the user's hand does not move continuously. The still another predetermined ratio can also be determined according to actual design requirements. In addition, it is worth mentioning that the processing circuit 116 may further include a low-pass filter 116-2, so as to use the low-pass filter 116-2 to smooth the movement of the cursor on the screen.

另外,为了解决所述光标没办法移动到所述屏幕的边缘的问题,处理电路116还可以是依据其所计算出的重心在影像感测装置114所获取的影像中的默认区域的相对位置来换算所述光标在所述屏幕上的相对位置,以图5来说明的。图5为影像感测装置114所获取的影像与所述屏幕的示意图。在图5中,标号510表示影像感测装置114所获取到的影像,标号512表示所述的默认区域,标号516表示处理电路116所需的对象影像,而标号520表示所述的屏幕。在此例中,默认区域512的形状为平行四边形,且默认区域512的中心点位于影像510的中心点(如标号514所示),然此并非用于限制本发明。此外,为了说明的方便,以下将假设对象影像516的重心位于默认区域512的边缘。In addition, in order to solve the problem that the cursor cannot move to the edge of the screen, the processing circuit 116 may also calculate the center of gravity based on the relative position of the default area in the image captured by the image sensing device 114. The conversion of the relative position of the cursor on the screen is illustrated in FIG. 5 . FIG. 5 is a schematic diagram of the image captured by the image sensing device 114 and the screen. In FIG. 5 , reference numeral 510 represents the image captured by the image sensing device 114 , reference numeral 512 represents the default area, reference numeral 516 represents the object image required by the processing circuit 116 , and reference numeral 520 represents the screen. In this example, the shape of the default area 512 is a parallelogram, and the center point of the default area 512 is located at the center point of the image 510 (shown by reference numeral 514 ), but this is not intended to limit the present invention. In addition, for the convenience of description, it will be assumed that the center of gravity of the object image 516 is located at the edge of the default area 512 .

请参照图5,当对象影像516位于影像感测装置114所获取的影像510的边缘时,由于对象影像516本身需具备定的尺寸(因为尺寸太小时就会被处理电路116当作噪声而滤除),因此若是处理电路116在计算出对象影像516的重心后,便依据其所计算出的重心在影像感测装置114所获取的影像510中的相对位置来换算所述光标在屏幕520上的相对位置时,那么所述光标会离屏幕520的边缘还有一段不小的距离。然而,若是处理电路116在计算出对象影像516的重心后,便改成以其所计算出的重心在默认区域512的相对位置来换算所述光标在所述屏幕520上的相对位置时,那么所述光标便可位于屏幕520的边缘。Please refer to FIG. 5, when the object image 516 is located at the edge of the image 510 acquired by the image sensing device 114, since the object image 516 itself needs to have a certain size (because the size is too small, it will be filtered out by the processing circuit 116 as noise). In addition), if the processing circuit 116 calculates the center of gravity of the object image 516, it converts the position of the cursor on the screen 520 according to the relative position of the calculated center of gravity in the image 510 acquired by the image sensing device 114 When the relative position of , then the cursor will still have a considerable distance from the edge of the screen 520 . However, if the processing circuit 116 uses the calculated relative position of the center of gravity in the default area 512 to convert the relative position of the cursor on the screen 520 after calculating the center of gravity of the object image 516, then The cursor can then be located at the edge of the screen 520 .

根据以上的教示,本领域具有通常知识者当可归纳出前述光学式触控装置的一些基本操作步骤,依如图6所示。图6为依照本发明一实施例的光学式触控装置的操作方法的流程图。所述的光学式触控装置包括有发光单元与影像感测装置,而所述的操作方法包括有下列步骤:利用所述发光单元发出光源以照射对象(如标号S602所示);利用所述影像感测装置获取所述对象反射所述光源的影像(如标号S604所示);选取所述影像中亮度大于或等于亮度临界值的所有像素(如标号S606所示);对所选取的像素依所述影像的第一坐标轴、所述影像的第二坐标轴或像素亮度进行排序(如标号S608所示);从排序出来的像素中再取前面预定比例的像素来当作所述对象的对象影像(如标号S610所示);以及根据所述预定比例的像素的像素位置,或根据所述预定比例的像素的像素位置并以像素亮度为权重来计算所述对象影像的重心(如标号S612所示)。According to the above teachings, those skilled in the art can summarize some basic operation steps of the aforementioned optical touch device, as shown in FIG. 6 . FIG. 6 is a flowchart of an operating method of an optical touch device according to an embodiment of the invention. The optical touch device includes a light-emitting unit and an image sensing device, and the operation method includes the following steps: using the light-emitting unit to emit a light source to illuminate an object (as shown in label S602); using the The image sensing device acquires the image of the object reflecting the light source (as shown in label S604); selects all pixels in the image whose brightness is greater than or equal to the brightness threshold (as shown in label S606); Sorting according to the first coordinate axis of the image, the second coordinate axis of the image, or pixel brightness (as shown in label S608); from the sorted pixels, take the pixels of the previous predetermined proportion as the object and calculate the center of gravity of the object image according to the pixel positions of the predetermined proportion of pixels, or according to the pixel positions of the predetermined proportion of pixels and taking the pixel brightness as a weight (such as shown in label S612).

综上所述,本发明解决前述问题的方式,乃是先发出光源以照射物件;接着,利用上述影像感测装置获取上述对象反射上述光源的影像;然后,选取上述影像中亮度大于或等于亮度临界值的所有像素;再接着,对所选取的像素依上述影像的第一坐标轴、上述影像的第二坐标轴或像素亮度进行排序;然后,从排序出来的像素中再取前面预定比例的像素来当作上述对象的对象影像;最后,根据上述预定比例的像素的像素位置,或根据上述预定比例的像素的像素位置并以像素亮度为权重来计算上述对象影像的重心。由上述可知,本发明仅会计算所需的对象影像的重心,因而不会产生习知技术的问题。To sum up, the method of the present invention to solve the foregoing problems is to first emit a light source to irradiate the object; then, use the above-mentioned image sensing device to obtain the image of the above-mentioned object reflecting the above-mentioned light source; All the pixels of the critical value; then, sort the selected pixels according to the first coordinate axis of the above-mentioned image, the second coordinate axis of the above-mentioned image, or the pixel brightness; then, from the sorted pixels, take the previous predetermined proportion Finally, the center of gravity of the object image is calculated according to the pixel position of the above-mentioned predetermined proportion of pixels, or according to the pixel position of the above-mentioned predetermined proportion of pixels with pixel brightness as a weight. From the above, it can be seen that the present invention only calculates the center of gravity of the required object image, and thus does not cause the problems of the prior art.

本文中应用了具体个例对本发明的光学式触控装置及其操作方法的原理及实施方式进行了阐述,以上实施方式的说明只是用于帮助理解本发明的方法及其核心思想;同时,对于本领域的一般技术人员,依据本发明的思想,在具体实施方式及应用范围上均会有改变的处,综上所述,本说明书内容不应理解为对本发明的限制,本发明的保护范围应以所附的权利要求为准。In this paper, specific examples are used to illustrate the principle and implementation of the optical touch device and its operation method of the present invention. The description of the above implementation is only used to help understand the method of the present invention and its core idea; at the same time, for Those of ordinary skill in the art, according to the idea of the present invention, will have changes in the specific implementation and application scope. In summary, the content of this specification should not be construed as limiting the present invention, and the protection scope of the present invention The appended claims shall prevail.

Claims (20)

1. an optical touch-control device, it is characterised in that including:
Luminescence unit, is used for sending light source with irradiation object;
Image sensor apparatus, for obtaining the image of light source described in described object reflection;And
Process circuit, be electrically connected with described Image sensor apparatus, to obtain described image, and be used for choosing In described image, brightness is more than or equal to all pixels of brightness critical values, with to selected pixel according to institute State the first coordinate axes of image, the second coordinate axes of described image or pixel intensity to be ranked up, described place Reason circuit is additionally operable to take the pixel of above the first predetermined ratio from the pixel sorted out again to be come as described The object image of object, and the location of pixels of the pixel according to described first predetermined ratio, or according to described The location of pixels of the pixel of the first predetermined ratio also calculates described object image with pixel intensity for weight Center of gravity.
2. optical touch-control device as claimed in claim 1, it is characterised in that described process circuit also depends on Convert the relative position that light is marked on screen according to the described center of gravity relative position in described image.
3. optical touch-control device as claimed in claim 2, it is characterised in that described process circuit also wraps Having included low pass filter, described low pass filter is for smoothing the movement on the screen of described cursor.
4. optical touch-control device as claimed in claim 2, it is characterised in that described process circuit also depends on According to the motion-vector of described center of gravity be multiplied by the result of the second preset ratio to the described smooth target that converts move to Amount.
5. optical touch-control device as claimed in claim 2, it is characterised in that described process circuit also depends on It is multiplied by second according to described center of gravity present position relative to the position vector of the center of described image and presets ratio The result of example converts described smooth target motion-vector.
6. optical touch-control device as claimed in claim 1, it is characterised in that described process circuit also depends on According to the relative position of described center of gravity default zone in described image convert that light is marked on screen relative Position.
7. optical touch-control device as claimed in claim 6, it is characterised in that the shape of described default zone Shape is parallelogram, and the central point of described default zone is positioned at the central point of described image.
8. optical touch-control device as claimed in claim 6, it is characterised in that described process circuit also wraps Having included low pass filter, described low pass filter is for smoothing the movement on the screen of described cursor.
9. optical touch-control device as claimed in claim 6, it is characterised in that described process circuit also depends on According to the motion-vector of described center of gravity be multiplied by the result of the second preset ratio to the described smooth target that converts move to Amount.
10. optical touch-control device as claimed in claim 6, it is characterised in that described process circuit is also It is multiplied by second according to described center of gravity present position relative to the position vector of the center of described image to preset The result of ratio converts described smooth target motion-vector.
The operational approach of 11. 1 kinds of optical touch-control devices, described optical touch-control device includes luminous single Unit and Image sensor apparatus, it is characterised in that described operational approach includes:
Described luminescence unit is utilized to send light source with irradiation object;
Described Image sensor apparatus is utilized to obtain the image of light source described in described object reflection;
Choose brightness in described image and be more than or equal to all pixels of brightness critical values;
Selected pixel is depended on the first coordinate axes of described image. the second coordinate axes of described image or pixel Brightness is ranked up;
Take from sequence pixel out that the pixel of above the first predetermined ratio comes as described object again is right As image;And
The location of pixels of the pixel according to described first predetermined ratio, or according to described first predetermined ratio The location of pixels of pixel also calculates the center of gravity of described object image with pixel intensity for weight.
12. operational approach as claimed in claim 11, it is characterised in that described operational approach also includes depending on Convert the relative position that light is marked on screen according to the described center of gravity relative position in described image.
13. operational approach as claimed in claim 12, it is characterised in that described operational approach also include with Low pass filter smooths the movement on the screen of described cursor.
14. operational approach as claimed in claim 12, it is characterised in that described operational approach also includes depending on According to the motion-vector of described center of gravity be multiplied by the result of the second preset ratio to the described smooth target that converts move to Amount.
15. operational approach as claimed in claim 12, it is characterised in that described operational approach also includes depending on It is multiplied by second according to described center of gravity present position relative to the position vector of the center of described image and presets ratio The result of example converts described smooth target motion-vector.
16. operational approach as claimed in claim 11, it is characterised in that described operational approach also includes depending on According to the relative position of described center of gravity default zone in described image convert that light is marked on screen relative Position.
17. operational approach as claimed in claim 16, it is characterised in that being shaped as of described default zone Parallelogram, and the central point of described default zone is positioned at the central point of described image.
18. operational approach as claimed in claim 16, it is characterised in that described operational approach also include with Low pass filter smooths the movement on the screen of described cursor.
19. operational approach as claimed in claim 16, it is characterised in that described operational approach also includes depending on According to the motion-vector of described center of gravity be multiplied by the result of the second preset ratio to the described smooth target that converts move to Amount.
20. operational approach as claimed in claim 16, it is characterised in that described operational approach also includes depending on It is multiplied by second according to described center of gravity present position relative to the position vector of the center of described image and presets ratio The result of example converts described smooth target motion-vector.
CN201210563689.XA 2012-12-21 2012-12-21 Optical touch device and operating method thereof Active CN103885646B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210563689.XA CN103885646B (en) 2012-12-21 2012-12-21 Optical touch device and operating method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210563689.XA CN103885646B (en) 2012-12-21 2012-12-21 Optical touch device and operating method thereof

Publications (2)

Publication Number Publication Date
CN103885646A CN103885646A (en) 2014-06-25
CN103885646B true CN103885646B (en) 2016-12-28

Family

ID=50954574

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210563689.XA Active CN103885646B (en) 2012-12-21 2012-12-21 Optical touch device and operating method thereof

Country Status (1)

Country Link
CN (1) CN103885646B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI543046B (en) * 2014-07-15 2016-07-21 廣達電腦股份有限公司 Optical touch system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1493053A (en) * 2001-01-08 2004-04-28 Vkb���޹�˾ data entry device
CN1932726A (en) * 2006-10-13 2007-03-21 广东威创日新电子有限公司 Digital image sensor locator based on CMOS and locating method
CN101651804A (en) * 2008-08-14 2010-02-17 索尼株式会社 Information processing apparatus, method, and program
EP2392991A1 (en) * 2010-06-02 2011-12-07 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. Hand-held pointing device, software cursor control system and method for controlling a movement of a software cursor
CN102314258A (en) * 2010-07-01 2012-01-11 原相科技股份有限公司 Optical touch system, object position calculation device and object position calculation method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1493053A (en) * 2001-01-08 2004-04-28 Vkb���޹�˾ data entry device
CN1932726A (en) * 2006-10-13 2007-03-21 广东威创日新电子有限公司 Digital image sensor locator based on CMOS and locating method
CN101651804A (en) * 2008-08-14 2010-02-17 索尼株式会社 Information processing apparatus, method, and program
EP2392991A1 (en) * 2010-06-02 2011-12-07 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. Hand-held pointing device, software cursor control system and method for controlling a movement of a software cursor
CN102314258A (en) * 2010-07-01 2012-01-11 原相科技股份有限公司 Optical touch system, object position calculation device and object position calculation method

Also Published As

Publication number Publication date
CN103885646A (en) 2014-06-25

Similar Documents

Publication Publication Date Title
US10915186B2 (en) Projection video display apparatus and video display method
CN102799318B (en) A kind of man-machine interaction method based on binocular stereo vision and system
TW201423478A (en) Gesture recognition apparatus, operating method thereof, and gesture recognition method
US20140168065A1 (en) Motion detection system
CN104898893B (en) Optical touch device and optical touch method
US20110148822A1 (en) Three-Dimensional Space Touch Apparatus Using Multiple Infrared Cameras
CN103150060B (en) Frameless optical touch device and image processing method for frameless optical touch device
JP2009252234A (en) Capacitive touch control device and data transmission method applied to it
US9639209B2 (en) Optical touch system and touch display system
US20130127704A1 (en) Spatial touch apparatus using single infrared camera
CN102446036A (en) Object sensing device
CN103885646B (en) Optical touch device and operating method thereof
US10379677B2 (en) Optical touch device and operation method thereof
US9342164B2 (en) Motion detecting device and the method for dynamically adjusting image sensing area thereof
US8294673B2 (en) Input device that adjusts its operation mode according to its operation direction and a control method thereof
US9721353B2 (en) Optical positional information detection apparatus and object association method
JP2018005543A (en) Image processing device, image processing system and image processing method
CN103941849A (en) Handheld pointing device and method of operation thereof
CN103885645B (en) Gesture judging device, its operating method, and gesture judging method
CN102929434B (en) Projection system and its image processing method
CN102298468B (en) Object image capturing device and method for capturing object image of pointer
US20160370880A1 (en) Optical input method and optical virtual mouse utilizing the same
US20180356937A1 (en) Projection touch system and correction method thereof
CN103970365B (en) Gesture detection device for detecting hover and click
TW201520861A (en) Optical touch device and method for calculating coordinate of touch point

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant