[go: up one dir, main page]

CN1674042A - Contact screen information inputting positioning method based on image recognition - Google Patents

Contact screen information inputting positioning method based on image recognition Download PDF

Info

Publication number
CN1674042A
CN1674042A CNA2005100098975A CN200510009897A CN1674042A CN 1674042 A CN1674042 A CN 1674042A CN A2005100098975 A CNA2005100098975 A CN A2005100098975A CN 200510009897 A CN200510009897 A CN 200510009897A CN 1674042 A CN1674042 A CN 1674042A
Authority
CN
China
Prior art keywords
acquisition unit
data acquisition
display screen
image recognition
ccd data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CNA2005100098975A
Other languages
Chinese (zh)
Inventor
张伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Heilongjiang University
Original Assignee
Heilongjiang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Heilongjiang University filed Critical Heilongjiang University
Priority to CNA2005100098975A priority Critical patent/CN1674042A/en
Publication of CN1674042A publication Critical patent/CN1674042A/en
Pending legal-status Critical Current

Links

Landscapes

  • Position Input By Displaying (AREA)

Abstract

本发明公开计算机的触摸屏信息输入方法。基于图像识别的触摸屏信息输入定位方法通过下述步骤实现,由控制电路同时给第一CCD数据采集单元2和第二CCD数据采集单元3发出工作指令,通过分别固定在智能设备1的显示屏1-1相邻角处的2和3摄取碰触显示屏1表面的点触物4的图像数据;4的图像数据送入图像识别与定位计算单元进行确认和计算,根据4到2和3的入射角度换算出4在显示屏上的两维坐标然后通过信号输出单元送入1的人机接口;本发明方法由于只需要两个CCD图像采集装置而不需要很多的光学图像采集元件,因此结构简单、工作可靠,可广泛适用于仅能在显示屏一侧或相互平行的两侧安装光学图像采集元件的场合。

Figure 200510009897

The invention discloses a touch screen information input method of a computer. The touch screen information input positioning method based on image recognition is realized through the following steps, the control circuit sends work instructions to the first CCD data acquisition unit 2 and the second CCD data acquisition unit 3 at the same time, and is respectively fixed on the display screen 1 of the smart device 1 - 2 and 3 at the adjacent corners of 1 capture the image data of the touch object 4 that touches the surface of the display screen 1; the image data of 4 are sent to the image recognition and positioning calculation unit for confirmation and calculation, according to 4 to 2 and 3 The angle of incidence is converted into the two-dimensional coordinates of 4 on the display screen and then sent to the man-machine interface of 1 through the signal output unit; the method of the present invention does not require many optical image acquisition elements because only two CCD image acquisition devices are needed, so the structure It is simple and reliable, and can be widely used in occasions where optical image acquisition components can only be installed on one side of the display screen or on two sides parallel to each other.

Figure 200510009897

Description

基于图像识别的触摸屏信息输入定位方法Touch screen information input positioning method based on image recognition

技术领域:Technical field:

本发明涉及计算机的触摸屏信息输入方法。The invention relates to a computer touch screen information input method.

背景技术:Background technique:

触摸屏是人与多媒体计算机进行人机交互的重要输入设备,在诸如航班查询机、银行提款机等领域得到了广泛应用,目前触摸屏从工作原理方面可分四种,它们分别是电阻式、红外线式、电容感应式和表面声波式。红外线式触摸屏是现在触摸技术中性能较高、应用广泛的一种装置,红外线式触摸屏的基本结构,是在一个围着显示器边缘的框架内,沿着显示器的显示表面的四个边缘按照一定的顺序安装许多红外发射管和接收管,构成一个互相垂直的收发阵列,从而可以检测到手指或指示器在触摸屏上的位置,它存在以下缺点:第一,使用场合受限制。由于需构成互相垂直的红外线收发阵列,沿着显示表面的四个边缘均要安装红外线发射和接收管,故不能满足仅能在一侧或相互平行的两侧安装相关发射接收设备的特殊需求;第二,使用的红外发射和接收管数量较多,并需要使用数量众多的光学透镜,结构重复,工作的可靠性低。Touch screen is an important input device for human-computer interaction between people and multimedia computers. It has been widely used in fields such as flight inquiry machines and bank cash machines. At present, touch screens can be divided into four types in terms of working principles. They are resistive, infrared type, capacitive sensing and surface acoustic wave. Infrared touch screen is a device with high performance and wide application in current touch technology. The basic structure of infrared touch screen is in a frame around the edge of the display, along the four edges of the display surface of the display according to a certain Many infrared emitting tubes and receiving tubes are installed in sequence to form a mutually perpendicular transceiver array, so that the position of the finger or pointer on the touch screen can be detected. It has the following disadvantages: First, the use occasions are limited. Since it is necessary to form a mutually perpendicular infrared transmitting and receiving array, infrared transmitting and receiving tubes must be installed along the four edges of the display surface, so it cannot meet the special requirements that relevant transmitting and receiving equipment can only be installed on one side or on two sides parallel to each other; Second, the number of infrared emitting and receiving tubes used is large, and a large number of optical lenses are required, the structure is repeated, and the reliability of the work is low.

发明内容:Invention content:

本发明的目的是提供一种基于图像识别的触摸屏信息输入定位方法,以克服已有技术使用场合受限制、结构重复和工作的可靠性低的缺陷。本发明的技术方案通过下述步骤实现,一、由控制采样频率的控制电路6同时给第一CCD数据采集单元2和第二CCD数据采集单元3发出工作指令,通过分别固定在智能设备1的显示屏1-1相邻角处的第一CCD数据采集单元2和第二CCD数据采集单元3摄取碰触显示屏1表面的点触物4的图像数据;二、点触物4的图像数据送入图像识别与定位计算单元5进行确认和计算,根据点触物4到第一CCD数据采集单元2和第二CCD数据采集单元3的入射角度换算出点触物4在显示屏1-1上的两维坐标;三、把点触物4在显示屏1-1上的两维坐标通过信号输出单元7送入智能设备1的人机接口;按顺序重复以上三个步骤就完成了人对智能设备的信息输入。本发明的方法首先在控制单元6的控制下从两个CCD数据采集单元采集同一时刻的图像数据,然后对采集的图像运用图像识别技术识别出手指、笔尖等点触物的像的中心位置,再通过人眼视觉判断距离的原理及光学原理计算出点触物的二维坐标定位信息,最后通过信号输出单元7将定位信息输出至PDA、手机、平板电脑或计算机等电子产品的键盘或鼠标通讯接口。本发明基于图像识别的触摸屏信息输入定位方法由于只需要两个CCD图像采集装置而不需要很多的光学图像采集元件,因此结构简单、工作可靠,可广泛适用于仅能在显示屏一侧或相互平行的两侧安装光学图像采集元件的场合,或用于因显示屏面积太小而无法安装大量实体按键的电子产品,亦可适用于一些特别需要避免集尘的医院、无尘室等环境,本发明设计合理、工作可靠,具有较大的推广价值。The object of the present invention is to provide a touch screen information input and positioning method based on image recognition, so as to overcome the defects of limited application occasions, repetitive structure and low working reliability in the prior art. The technical scheme of the present invention is realized by following steps, one, by the control circuit 6 of control sampling frequency, send work instruction to the first CCD data acquisition unit 2 and the second CCD data acquisition unit 3 simultaneously, by being respectively fixed on the smart device 1 The first CCD data acquisition unit 2 and the second CCD data acquisition unit 3 at the adjacent corners of the display screen 1-1 pick up the image data of the touch object 4 touching the surface of the display screen 1; two, the image data of the touch object 4 Send it into the image recognition and positioning calculation unit 5 for confirmation and calculation, and convert the point of contact object 4 to the first CCD data acquisition unit 2 and the second CCD data acquisition unit 3 according to the angle of incidence of the touch object 4 on the display screen 1-1 for confirmation and calculation. 3. Send the two-dimensional coordinates of the touch object 4 on the display screen 1-1 to the man-machine interface of the smart device 1 through the signal output unit 7; repeat the above three steps in order to complete the human-machine interface. Information input to smart devices. The method of the present invention first collects the image data at the same moment from two CCD data acquisition units under the control of the control unit 6, then uses image recognition technology to recognize the central position of the image of the finger, pen tip, etc. for the collected image, Then calculate the two-dimensional coordinate positioning information of the touch object through the principle of human visual judgment distance and optical principle, and finally output the positioning information to the keyboard or mouse of electronic products such as PDA, mobile phone, tablet computer or computer through the signal output unit 7 Communication Interface. The touch screen information input positioning method based on image recognition in the present invention only needs two CCD image acquisition devices and does not need many optical image acquisition components, so the structure is simple and the operation is reliable, and it can be widely used in the The occasions where optical image acquisition components are installed on parallel sides, or for electronic products that cannot be installed with a large number of physical buttons because the display area is too small, can also be used in some environments such as hospitals and clean rooms that need to avoid dust collection. The invention has reasonable design, reliable operation and great popularization value.

附图说明:Description of drawings:

图1是本发明采集点触物4图像信息的原理示意图,图2是本发明信号的流向示意图。FIG. 1 is a schematic diagram of the principle of collecting image information of a touch object 4 according to the present invention, and FIG. 2 is a schematic diagram of the signal flow of the present invention.

具体实施方式:Detailed ways:

具体实施方式一:下面结合图1和图2具体说明本实施方式。本实施方式由下述步骤实现,一、由控制采样频率的控制电路6同时给第一CCD数据采集单元2和第二CCD数据采集单元3发出工作指令,通过分别固定在智能设备1的显示屏1-1相邻角处的第一CCD数据采集单元2和第二CCD数据采集单元3摄取碰触显示屏1表面的点触物4的图像数据;二、点触物4的图像数据送入图像识别与定位计算单元5进行确认和计算,根据点触物4到第一CCD数据采集单元2和第二CCD数据采集单元3的入射角度换算出点触物4在显示屏上的两维坐标;三、把点触物4在显示屏上的两维坐标通过信号输出单元7送入智能设备1的人机接口;信号输出单元7受控制单元6的控制完成与数据采集的同步;按顺序重复以上三个步骤就完成了人对智能设备的信息输入。所述第一CCD数据采集单元2和第二CCD数据采集单元3都是线性CCD(线阵列电荷耦合器件)视觉传感器,在步骤一中点触物4的形状透过第一CCD数据采集单元2和第二CCD数据采集单元3的镜头11分别在第一CCD数据采集单元2和第二CCD数据采集单元3的线阵列CCD感光单元12上成像,由于第一CCD数据采集单元2和第二CCD数据采集单元3的位置和角度固定,镜头11与线阵列CCD感光单元12的相对位置固定,所以根据点触物4某一时刻在第一CCD数据采集单元2和第二CCD数据采集单元3的入射角度就能唯一确定点触物4该时刻在显示屏上的两维坐标位置。所述镜头11为广角镜头。Specific Embodiment 1: The present embodiment will be specifically described below with reference to FIG. 1 and FIG. 2 . The present embodiment is realized by following steps, one, by the control circuit 6 of control sampling frequency, send work instruction to the first CCD data acquisition unit 2 and the second CCD data acquisition unit 3 simultaneously, through the display screen that is respectively fixed on smart device 1 The first CCD data acquisition unit 2 and the second CCD data acquisition unit 3 at 1-1 adjacent corners pick up the image data of the touch object 4 touching the surface of the display screen 1; two, the image data of the touch object 4 is sent into The image recognition and positioning calculation unit 5 performs confirmation and calculation, and converts the two-dimensional coordinates of the touch object 4 on the display screen according to the incident angle of the touch object 4 to the first CCD data acquisition unit 2 and the second CCD data acquisition unit 3 3. The two-dimensional coordinates of the touch object 4 on the display screen are sent to the man-machine interface of the smart device 1 through the signal output unit 7; the signal output unit 7 is controlled by the control unit 6 to complete the synchronization with data acquisition; in order Repeat the above three steps to complete the information input of the person to the smart device. The first CCD data acquisition unit 2 and the second CCD data acquisition unit 3 are all linear CCD (line array charge-coupled device) vision sensors, and the shape of the touch object 4 in step one sees through the first CCD data acquisition unit 2 and the camera lens 11 of the second CCD data acquisition unit 3 are imaged on the line array CCD photosensitive unit 12 of the first CCD data acquisition unit 2 and the second CCD data acquisition unit 3 respectively, because the first CCD data acquisition unit 2 and the second CCD The position and angle of the data acquisition unit 3 are fixed, and the relative position of the lens 11 and the line array CCD photosensitive unit 12 is fixed, so at a certain moment according to the touch object 4, the position of the first CCD data acquisition unit 2 and the second CCD data acquisition unit 3 is fixed. The incident angle can uniquely determine the two-dimensional coordinate position of the touch object 4 on the display screen at that moment. The lens 11 is a wide-angle lens.

具体实施方式二:本实施方式与实施方式一的不同点是所述智能设备1是PDA(Personal Digital Assistant个人数字助理)、个人移动电话、笔记本电脑或台式计算机。本发明方法所使用的电子装置既可以内建于智能设备1,由智能设备1中的程序来完成相应的功能,也可以独立设计电路装置来完成相应的功能,还可以用专用的大规模逻辑电路来实现相应的功能。Embodiment 2: The difference between this embodiment and Embodiment 1 is that the smart device 1 is a PDA (Personal Digital Assistant), a personal mobile phone, a notebook computer or a desktop computer. The electronic device used in the method of the present invention can be built into the smart device 1, and the corresponding functions can be completed by the program in the smart device 1, or the circuit device can be independently designed to complete the corresponding functions, or a dedicated large-scale logic can also be used. circuit to achieve the corresponding function.

具体实施方式三:本实施方式与实施方式一的不同点是镜头11的视角为90~100度。镜头11选用TOPGON型广角物镜。Embodiment 3: The difference between this embodiment and Embodiment 1 is that the viewing angle of the lens 11 is 90-100 degrees. Camera lens 11 selects TOPGON type wide-angle objective lens for use.

Claims (4)

1、基于图像识别的触摸屏信息输入定位方法,其特征在于它通过下述步骤实现,一、由控制采样频率的控制电路(6)同时给第一CCD数据采集单元(2)和第二CCD数据采集单元(3)发出工作指令,通过分别固定在智能设备(1)的显示屏(1-1)相邻角处的第一CCD数据采集单元(2)和第二CCD数据采集单元(3)摄取碰触显示屏(1)表面的点触物(4)的图像数据;二、点触物(4)的图像数据送入图像识别与定位计算单元(5)进行确认和计算,根据点触物(4)到第一CCD数据采集单元(2)和第  CCD数据采集单元(3)的入射角度换算出点触物(4)在显示屏(1-1)上的两维坐标;三、把点触物(4)在显示屏(1-1)上的两维坐标通过信号输出单元(7)送入智能设备(1)的人机接口;按顺序重复以上三个步骤就完成了人对智能设备的信息输入。1, the touch screen information input positioning method based on image recognition, it is characterized in that it realizes by following steps, one, give the first CCD data acquisition unit (2) and the second CCD data simultaneously by the control circuit (6) of control sampling frequency The acquisition unit (3) sends out work instructions, through the first CCD data acquisition unit (2) and the second CCD data acquisition unit (3) respectively fixed at the adjacent corners of the display screen (1-1) of the smart device (1) Capture the image data of the touch object (4) that touches the surface of the display screen (1); 2. The image data of the touch object (4) is sent to the image recognition and positioning calculation unit (5) for confirmation and calculation. Object (4) to the first CCD data acquisition unit (2) and the incident angle conversion of the 2nd CCD data acquisition unit (3) to convert the two-dimensional coordinates of the touch object (4) on the display screen (1-1); 3. Send the two-dimensional coordinates of the touch object (4) on the display screen (1-1) to the man-machine interface of the smart device (1) through the signal output unit (7); repeat the above three steps in order to complete the human-machine interface. Information input to smart devices. 2、根据权利要求1所述的基于图像识别的触摸屏信息输入定位方法,其特征在于所述智能设备(1)是PDA、个人移动电话、笔记本电脑或台式计算机。2. The image recognition-based touch screen information input positioning method according to claim 1, characterized in that the smart device (1) is a PDA, a personal mobile phone, a notebook computer or a desktop computer. 3、根据权利要求1所述的基于图像识别的触摸屏信息输入定位方法,其特征在于第一CCD数据采集单元(2)和第二CCD数据采集单元(3)的镜头(11)为广角镜头。3. The image recognition-based touch screen information input positioning method according to claim 1, characterized in that the lenses (11) of the first CCD data acquisition unit (2) and the second CCD data acquisition unit (3) are wide-angle lenses. 4、根据权利要求3所述的基于图像识别的触摸屏信息输入定位方法,其特征在于镜头(11)的视角为90~100度。4. The image recognition-based touch screen information input and positioning method according to claim 3, characterized in that the viewing angle of the lens (11) is 90-100 degrees.
CNA2005100098975A 2005-04-15 2005-04-15 Contact screen information inputting positioning method based on image recognition Pending CN1674042A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNA2005100098975A CN1674042A (en) 2005-04-15 2005-04-15 Contact screen information inputting positioning method based on image recognition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNA2005100098975A CN1674042A (en) 2005-04-15 2005-04-15 Contact screen information inputting positioning method based on image recognition

Publications (1)

Publication Number Publication Date
CN1674042A true CN1674042A (en) 2005-09-28

Family

ID=35046568

Family Applications (1)

Application Number Title Priority Date Filing Date
CNA2005100098975A Pending CN1674042A (en) 2005-04-15 2005-04-15 Contact screen information inputting positioning method based on image recognition

Country Status (1)

Country Link
CN (1) CN1674042A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102221942A (en) * 2009-03-06 2011-10-19 孙倩倩 Touch screen using photosensitive diode chip
CN102298471A (en) * 2009-03-06 2011-12-28 孙倩倩 Optical touch screen
WO2012031513A1 (en) * 2010-09-07 2012-03-15 北京汇冠新技术股份有限公司 Touch positioning method, touch screen, touch system, and display
CN101556516B (en) * 2008-04-08 2012-09-26 乐金显示有限公司 Multi-touch system and driving method thereof
CN104345989A (en) * 2013-08-06 2015-02-11 纬创资通股份有限公司 Optical touch system and touch display system

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101556516B (en) * 2008-04-08 2012-09-26 乐金显示有限公司 Multi-touch system and driving method thereof
CN102221942A (en) * 2009-03-06 2011-10-19 孙倩倩 Touch screen using photosensitive diode chip
CN102298471A (en) * 2009-03-06 2011-12-28 孙倩倩 Optical touch screen
WO2012031513A1 (en) * 2010-09-07 2012-03-15 北京汇冠新技术股份有限公司 Touch positioning method, touch screen, touch system, and display
US9430080B2 (en) 2010-09-07 2016-08-30 Beijing Irtouch Systems Co., Ltd Touch positioning method, touch screen, touch system, and display
CN104345989A (en) * 2013-08-06 2015-02-11 纬创资通股份有限公司 Optical touch system and touch display system

Similar Documents

Publication Publication Date Title
CN102799317B (en) Intelligent Interactive Projection System
CN101963848B (en) Method for determining if target point belong to plane, mouse and touch screen
US20170357346A1 (en) Touch screen and pressure touch detection method
CN102654809B (en) Optical image type touch device
CN101833403B (en) Touch system based on image recognition
CN103809792A (en) touch monitor
CN101533322B (en) Multi-point touch plate and multi-point touch positioning method
CN102880304A (en) Character inputting method and device for portable device
CN102323868A (en) Human-computer multi-point interaction method and device based on infrared image
CN100478860C (en) Electronic plane display positioning system and positioning method
CN202948405U (en) Optical sensor keyboard
Ho et al. 32.3: Simple Single‐Layer Multi‐Touch Projected Capacitive Touch Panel
CN101833401B (en) Optical touch display device and operating method thereof
CN1479191A (en) Projected virtual keyboard device
CN101788872A (en) Position detecting device for detecting multi-point touch
CN1674042A (en) Contact screen information inputting positioning method based on image recognition
US20100128005A1 (en) Touch panel by optics unit sensor
CN103593085B (en) Touch event is detected using the first touch interface and the second touch interface
CN102622140B (en) Image pick-up multi-point touch system
CN201383135Y (en) A multi-touch interactive device
CN103076969A (en) Input system for mobile terminal display screen and control method thereof
CN102298456B (en) Method and touch module for analyzing two-dimensional trajectory to generate at least one nonlinear index
TW201128479A (en) Position detection device for detecting multi-touch
CN211628614U (en) A transparent touch LED display
CN201556191U (en) A large-screen multi-touch device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication