TWI248015B - Method and controller for recognizing drag gesture - Google Patents
Method and controller for recognizing drag gesture Download PDFInfo
- Publication number
- TWI248015B TWI248015B TW92133381A TW92133381A TWI248015B TW I248015 B TWI248015 B TW I248015B TW 92133381 A TW92133381 A TW 92133381A TW 92133381 A TW92133381 A TW 92133381A TW I248015 B TWI248015 B TW I248015B
- Authority
- TW
- Taiwan
- Prior art keywords
- occurrence
- time
- length
- gesture
- signal
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 238000006073 displacement reaction Methods 0.000 claims abstract description 34
- 230000001186 cumulative effect Effects 0.000 claims description 13
- 230000009471 action Effects 0.000 claims description 10
- 230000005540 biological transmission Effects 0.000 claims description 6
- 238000010079 rubber tapping Methods 0.000 claims description 2
- 238000004519 manufacturing process Methods 0.000 claims 2
- 229910000679 solder Inorganic materials 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 6
- 238000012545 processing Methods 0.000 description 4
- 238000012360 testing method Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 241001122767 Theaceae Species 0.000 description 2
- 238000007796 conventional method Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000001939 inductive effect Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000010897 surface acoustic wave method Methods 0.000 description 2
- 241000239226 Scorpiones Species 0.000 description 1
- 229910052770 Uranium Inorganic materials 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 239000008280 blood Substances 0.000 description 1
- 210000004369 blood Anatomy 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 210000003746 feather Anatomy 0.000 description 1
- 235000011389 fruit/vegetable juice Nutrition 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000010248 power generation Methods 0.000 description 1
- JFALSRSLKYAFGM-UHFFFAOYSA-N uranium(0) Chemical compound [U] JFALSRSLKYAFGM-UHFFFAOYSA-N 0.000 description 1
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
Description
1248015 坎、發明說明: 【發明所屬之技術領域】 本發明是有關於一種辨識拖曳手勢(Drag gesture)之方 法及控制益,特別是指一種於一觸控裝置上辨識拖良手勢 之方法及控制器,以於觸控裝置上辨識出拖矣手勢時,產 生一模擬滑鼠拖髮目標物之拖_叫)訊號。 【先前技術】 視囪"面(Graphical User Interface,GUI)最早由全祿 j\RC研九至所推出的程式操作介面,搭配指向裝置(如滑 ?來使用使用者僅需以視覺式的指標移動滑鼠並加上點 ^動作Fp可輕鬆完成想要執行的動作,解決了以往文字 $式而輸入繁雜的指令而造成使用不便的障礙。因此,視 窗介面紛紛被·果電腦與微軟(Microsoft)所採用,成為所有 作業系統的主流模式。在應用視窗介面系統的電子設備, 例如桌上型電腦、筆記型電腦、平板電腦、個人數位助理 機(PDA^等,指向裝置(p〇inting心⑹)已成為基本配備。 /目前指向裝置包含外部裝置滑鼠與㈣於攜帶式電腦 糸統上的軌跡球觸控板(t〇uch㈣、以及與螢幕結合之觸控 面板(touch panel)等等,其中滑鼠為最早推出的指向裝置。 以滑鼠為例來說明指向裝置的功能,滑鼠可控制電子裝置 ,螢幕上的指標(pointer)’即滑鼠移到哪裡,指標也跟隨移 :那裡’然後在螢幕上對欲執行的目標按下控制按鍵,即 可對電子裝置下達執行指。 _ “ ^…而目則的電子設備設計 朝短小輕薄發展,例如筆剖 掌,己U已逐漸取代桌上型電腦 5 10 15 1248015 的出貨,致使體積小之觸控裝置(如觸控板)有逐漸成為扑。 裝置主流的態勢。 -曰向 目鈾觸控板的技術大致包含電容式、電阻式、 _ ,. 、 、、電磁式 、堅力式、電感式、表面聲波式、超音波式、光學式等等 。當諸如手指之類的物體於觸控板上移動,即可控制指护 沿物體=動的方向移動。然而,指向裝置除了控制指= ,動外:還需兼具下達命令的功能。茲以滑鼠之操作為例: 說,當指標移動至欲移動之目標物(如程式 '文件、圖片)時 ,可持續按壓滑鼠按鍵(如左鍵)並移動滑鼠,則可拖^ (Drag)目標物至其他位置。’然而,以諸如觸控板之類的觸控 裝置來說,目前多於其下方增設兩控制按鍵以取代滑鼠之 左右鍵,或者定義物體於觸控裝置上的某種動作手勢,來 於移動目標物時—併產生連續按麼滑鼠按鍵的訊號,以使 目標物可被拖曳至其他位置。 身又觸&裝置係以_拖矣手勢,來模擬滑鼠拖良的動 ”方法係才木以於觸控裝置上施行-次敲擊(tap)與緊接 者再施行一次移動(m〇ve_)之手勢,來令目標物移動。因 、國專利第6,414,671號中提出-種如何辨識觸控裝 f上的拖Μ勢之習知方法。配合圖】,首先將物體於觸控 ^的第-,出現之時間長度%(即指物體於觸控裝置上第 次出現的停留時間)血 ^ ^ ^ Μ與一第一苓考時間值比較,若第一次 出現之時間長度t4小於箆一 、第麥考%間值時,則產生一拖曳 矾唬11 ;而後,將第一 f . 人出現及弟二次出現間的時間間距 1、一第二參考時間值比較,若時間間距t5小於第二參考時 20 5 10 15 20 1248015 門值時,則維持拖曳訊號〗〗 _ 重複產生x、Yf訊。 “現之時間長“内 羽知=知方法可達到辨識拖,手勢之目的,然而由於 :’中,將第一次出現之時間長度t4和1^盘第二次 級缝姐迦上分別和對應之參考時間 上較為複雜,且於第二次出現之時間長度^内重複 '丫錢,造成設計上較騎雜。㈣,由於使用者 固人差異’所以每一個人於觸控裝置上執行拖矣手勢的 動作之時間或有差異,甚者同一使用者於每-次執 订扼复手勢的各動作之時間長短亦可能會有不同,導致習 知方法容易有誤判的情況發生。又,在觸控裝置的使用過 知中容易被誤觸、或者因觸控裝置本身工作時產生之雜訊 、或源於外界環境的雜訊所干擾,因而會產生短暫的突波 式(spike)之第-次出現、突波式之第—次出現與第二次出現 間的%間間距、突波式之第二次出現的現象,習知方法未 對第 第一次出現之時間長度、兩次出現間的時間間距 作最小時間限制,如此容易對因雜訊干擾而產生之訊號作 不菖判斷,而容易有誤判的情況發生。 【發明内容】 本^明之主要目的是在提供一種辨識拖良手勢之方法 及控制器’利用各動作之時間加總來與—參考時間值比較 ,以達到判斷更簡捷與可靠之功效。 本發明之另一目的是在提供一種辨識拖良手勢之方法 及控制ϋ ’係要求各動作之時間須分別大於一對應時間值 6 5 10 15 20 1248015 ’以有效避免因雜訊而誤判之情況發生。 本發明之又一目的是在於提供一種辨識拖矣手勢之方 法及控制器,可將第二次出現期間之累積位移量與一夹考 位移量比較,以射是否為拖夷手勢,進而達到更為精確 判斷之功效。 本發明之辨識拖良手勢之方法,該拖良手勢係於—觸 控裝置上生成,該方法包含以下步驟: 偵測一物體於該觸控板上的一第一次出現; 偵測該物體於該觸控板上的一第二次出現;以及 』若該第-次出現之時間長纟、及該第一次出現之 與該第二次出現之起始間的時間間距之加總小於—第—夂 考時間值,以及若符合下述兩種情況中之一,則參 (A) 若該第一次出現之時間長度、該第一次出現之結 與该第二次出現之起始間的時間間距、及該第二 出現之時間長度之加總不小於該參考時間值;及 (B) 若該第二次出現期間之累計位移量不小於―’ 移量。 、多号 【實施方式】 有關本發明之前述及其他技術内容、 以下配合參考圖式之-較佳實施例的詳細 楚的明白。 首先說明的是本發明之辨識拖戈手勢之方法BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method and control benefit for identifying a drag gesture, and more particularly to a method and control for recognizing a drag gesture on a touch device. In order to recognize the drag gesture on the touch device, a drag and drop signal simulating the target of the mouse dragging is generated. [Prior Art] The Graphical User Interface (GUI) was first introduced by the Quanro j\RC Research and Development Program. It is equipped with a pointing device (such as sliding to use the user only by visually). The indicator moves the mouse and adds the action Fp to easily complete the action that you want to perform. It solves the problem of inconvenient use caused by the input of the traditional text and the complicated instructions. Therefore, the Windows interface has been connected to the computer and Microsoft ( Adopted by Microsoft) to become the mainstream mode of all operating systems. In the application of Windows interface system electronic devices, such as desktop computers, notebook computers, tablet computers, personal digital assistants (PDA^, etc., pointing devices (p〇inting Heart (6)) has become the basic equipment. / The current pointing device includes an external device mouse and (4) a trackball trackpad on the portable computer system (t〇uch (4), and a touch panel combined with the screen) Etc., the mouse is the earliest pointing device. Take the mouse as an example to illustrate the function of the pointing device, the mouse can control the electronic device, the indicator on the screen (pointer ) 'Where the mouse moves, the indicator also moves: where' then press the control button on the screen to execute the target on the screen. _ " ^... and the electronic device design The development of short, light and thin, such as pen-cutting, has gradually replaced the shipment of desktop computers 5 10 15 1248015, resulting in a small touch device (such as a touchpad) gradually becoming a mainstream. - The technology of the uranium touch panel generally includes capacitive, resistive, _, ., ,, electromagnetic, rigid, inductive, surface acoustic wave, ultrasonic, optical, etc. when such as a finger The object can be moved on the touchpad to control the movement of the finger along the object=moving direction. However, in addition to the control finger=, the pointing device also needs to have the function of issuing the command. The operation is as an example: When the indicator moves to the target to be moved (such as the program 'file, picture'), you can drag the mouse button (such as the left button) and move the mouse to drag the target. To other locations. 'However, to For a touch device such as a touchpad, more than two control buttons are added below the mouse to replace the left and right buttons of the mouse, or some action gesture of the object on the touch device is defined to move the target. - and generate a continuous button press of the mouse button, so that the target can be dragged to other positions. The body touch & device is _ drag gesture to simulate the movement of the mouse dragging the "method" Performing a tap on the touch device and performing a move (m〇ve_) gesture to move the target object. The method of recognizing the touch is proposed in Japanese Patent No. 6,414,671. The conventional method of loading the drag on f. In conjunction with the map, first compare the length of the object to the touch--, the length of time (that is, the first time the object appears on the touch device) blood ^ ^ ^ Μ and a first reference time value If the length of time t4 of the first occurrence is less than the value between 箆1 and 麦麦考%, then a drag 矾唬11 is generated; then, the time interval between the first f. A second reference time value comparison, if the time interval t5 is less than the threshold value of the second reference time 20 5 10 15 20 1248015, then the drag signal 〗 〖 is maintained to repeatedly generate x, Yf signals. "The current time is long". The inner feather knows that the method can achieve the purpose of recognizing the drag and the gesture. However, due to: '中, the length of the first appearance will be t4 and the 1st disc will be the second sub-sewer. Corresponding reference time is more complicated, and repeats 'money' in the length of time of the second occurrence, resulting in a more complicated design. (4) Because of the difference in the user's personal connection, the time for each person to perform the drag gesture on the touch device may vary, and the length of time for each action of the same user to perform the gesture is also It may be different, resulting in a situation where the conventional method is prone to misjudgment. Moreover, in the use of the touch device, it is easy to be accidentally touched, or the noise generated by the touch device itself or the noise originating from the external environment interferes, so that a short spike is generated. The first occurrence of the first occurrence, the interval between the first occurrence and the second occurrence of the surge, and the second occurrence of the surge, the length of the first method does not occur for the first time. The time interval between the two occurrences is limited by the minimum time, so that it is easy to judge the signal generated by the noise interference, and it is easy to have a misjudgment. SUMMARY OF THE INVENTION The main purpose of the present invention is to provide a method for recognizing a gesture of awkwardness and a controller to use the time sum of each action to compare with the reference time value to achieve a more simple and reliable judgment. Another object of the present invention is to provide a method for identifying a gesture of dragging and controlling the time required for each action to be greater than a corresponding time value of 6 5 10 15 20 1248015 'to effectively avoid misjudgment due to noise. occur. Another object of the present invention is to provide a method and a controller for recognizing a drag gesture, which can compare the cumulative displacement amount during the second occurrence period with a clip displacement amount to determine whether the shot is a drag gesture or not. For the purpose of accurate judgment. In the method for recognizing a gesture of the present invention, the gesture is generated on a touch device, and the method includes the following steps: detecting a first occurrence of an object on the touch panel; detecting the object a second occurrence on the touchpad; and "if the time of the first occurrence is longer, and the sum of the time intervals between the first occurrence and the beginning of the second occurrence is less than - the first - reference time value, and if one of the following two conditions is met, then (A) if the first occurrence of the length of time, the first occurrence of the knot and the second occurrence The sum of the time interval between the beginning and the length of the second occurrence is not less than the reference time value; and (B) if the cumulative displacement during the second occurrence period is not less than the shift amount. MODE FOR CARRYING OUT THE INVENTION The foregoing and other technical contents of the present invention will be apparent from the following detailed description of the preferred embodiments. First, the method for recognizing the drag gesture of the present invention is explained.
觸控裝置中。為了今'明夕a A θ”兄明之目的,在本實施例中選In the touch device. For the purpose of today's 'A Xi θ' brother, in this embodiment
特點與功效,在 說明中,將可清 用於一 以電容 7 5 10 15 1248015 式觸控裝置來作說明。 如電容式觸控裝置2大致包 2 具有一 X方向處理單元29 攸- 單亓Μ θ Υ方向處理單元23、一運管 早兀24與一位移單元乃 運开 觸祕近難板2丨時,則_ 生電谷值變化,緊接著,χ、γ方向 22、23分別處理X、γ方 〜 凡 , 时— 方向的笔谷值後傳遞至運算單元24 早70 24會據此運算出物體接觸位置之χ座標值、盘 座“值。而後,位移單元25接收運算單元24之運算結果 、Υ,並依此計算出物體於觸控板21上的相對位移Features and functions, in the description, can be used for a capacitor 7 5 10 15 1248015 type touch device for illustration. For example, the capacitive touch device 2 has a X-direction processing unit 29 攸-single θ Υ direction processing unit 23, a transport tube early 24 and a displacement unit are transported to the touch panel 2 Then, the _ power generation valley value changes, and then, the χ, γ directions 22, 23 respectively process the X, γ square ~ 凡, the time-direction of the pen value is passed to the arithmetic unit 24 early 70 24 will calculate the object according to this The coordinate value of the contact position and the value of the disk holder. Then, the displacement unit 25 receives the operation result of the operation unit 24, and calculates the relative displacement of the object on the touch panel 21 accordingly.
Dy(指觸壓訊號)後,傳遞予手勢單元26與傳輸介面π。如 此’計算結S Dx、Dy可經傳輸介面27傳送至一主機 伽叫3 ’以供主機3控制其指標於螢幕上的移動。主機3可 為個人電腦、筆記型電腦、個人數位處理機(pDA卜行動電 話等各種電子裝置。在此,由於前述構件並非本案之改良 特徵且廣為熟習該項技藝者所熟習,故不在此贅述❶另外 ,本例之運算單元24、位移單元25、手勢單元%與傳輸 介面27係整合於諸如晶片之類的控制器中。 手勢單元26接收位移單元24之計算結果Dx、Dy,以 判斷物體是否有於觸控板21上產生一符合拖矣手勢之動作 ’並於判斷為拖曳手勢時對應輸出一模擬按壓滑鼠按鍵與 移動滑鼠之拖曳訊號(此拖曳訊號為複數個連續的訊號封 20 l248〇i5 包),以經傳輸介面27饋入主機3來作游標之對應控制。本 發明之技術特徵在於:手勢單元26辨識拖曳手勢之方法。 此方法可以軟體、軔體、或硬體方式設於手勢單元26中。 5 再者,雖然本例之手勢單元26係整合於觸控裝置2之控制 器中,然而亦可以軟體或硬體方式設置於主機3中,並不應 受限於本實施例所揭露者。 另外,雖然本實施例以電容式觸控裝置2為例作說明, 然而熟習該項技藝者當知,本發明亦可應用於其他型態之 1〇 觸控板裝置,例如光學式、電阻式、電感式、壓力式、電 磁式、表面聲波式、超音波式等等,並不應受限於本實施 例所揭露。 茲配合圖3,來說明本實施例之一範例的判斷流程。在 此範例中,先假設觸控板21被諸如手指10之類的物體敲擊 15 (_兩次。為了說明方便,在下文中物體以手指1G作代表 。另外,雖本例中以一為手指1〇之物體來說明,然而熟該 項技藝者當知,觸控板21亦可感測多個物體,並不應受限 於本實例所揭露。 首先,在步驟41,觸控裝置2偵測到手指1〇於觸控板 21之第一次出現的開始,即第—次敲擊的開始。此時,觸 2〇 j裝置2會開始計數手指1G於觸控板21上的出現時間。 若本例中假設若為拖曳手勢則會於一第一參考時間值丁】内 谓測到兩次出現之開始。本例之第一參考時間值τ丨的範圍 可設定為約介於100微秒〜1〇〇〇微秒⑽㈣丁^誦㈣ ,可依設計者的需要或使用者的操作習慣而調整。 9 5 10 15 20 !248〇15 而後’在步驟42中,觸控裝置 板21上的手指1〇,以·^於觸控 中^~~~兩條件 若步驟42中先判斷出偵測到第 在計時尚未達到第—參考時間值 、,·。時’因為 而有可能在第一參考時間冑τ 才已有第一次出現,因 續執行步驟44。反之,若牛赞4有第二次出現,因而繼 第一參考時間值丁則^判斷出計數時間已抵達 出現且第時間值Tl内僅有第一次 弟人出現的時間長度Tdown】已超 ',可確定非為拖,手勢,因而由手勢單元26:考時間值 ,以判斷是否為其他手勢。 兀%執行步驟43 板2ΓΙ:Γ觸:裝置2繼續判斷 祕件巾哪—條件先㈣成。· 斷出苐二次出現已經開始, 贤44巾先判 可能會有兩次出現而 茶考時間值丁】内 若步驟44中先判斷出:广手勢,所以繼續步驟45。 ’可確認非為㈣手勢 抵達第—參考時間值丁】時 其他手勢。 冑因而跳至步驟43中,判斷是否為 若步驟44中判斷屮 觸控裝置2已於先前的二出現已經開始時’如圖4, !_(指手指U)第—中測中獲得繼 與—位於卜次與第;?現於觸控板21上㈣續時間), -人出現間1間距τ,ιη1 (指 10 1248015 介於手指10第一次敲擊後而提起而離開觸控板21,直至手 指10之第二次敲擊前之時間長度)。 觸控板21的使用過程中容易被誤觸、或者因觸控板21 本身工作所產生的雜訊、或源於外界環境的雜訊所干擾而 產生的不當讯*5虎’例如短暫時間之第《 一次出現、第二次出 現及兩次出現間的時間間距。由於這些不當訊號在許多時 候僅持續短暫時間,所以,在本實施例中更要求各動作之 持續時間需分別大於對應的最小參考時間值,以有效濾除 這些不當訊號,進而增加辨識之精準度。 ίο 15 因而,在步驟45中,判斷位於第一次與第二次出現間 之第一次時間間距Tupl是否大於一第一最小提起參考時間 2】。在此,第一敢小提起參考時間值“丨叩亍相川提起 (UP)再洛下之最短有效時間。本例之第—最小提起參考時間 值丁2之範圍可設定為約介於1微秒〜10微秒(1ms彡丁 1〇m〇’可依設計者需要或使用者操作習慣而調整。若步驟 =中判斷第-時間心Tup]不大於第一最小提起參考時間 一 ^】(Tup】f21)時,意味著第一次與第二次出現間的第 為:時間間距::過短,因而判斷第-次時間間距之訊號 賢4: 1:7 一次出現實際上並未真正結束,而跳回步 ㈣。若步驟45中匈斷第一時間 二 起參考時間值Τ2】(Τ >τ、R主 _大方、弟取小提 T ^ υρ1>Τ2】)時,意味著第一次聘間間距 up】為有效讯唬,則繼續步驟46。 在/驟46中’判斷第一次出現之 大方《一筮一罢丨古焚反1 down】疋否 。翏考時間值丁3】。在此,第一最小敲擊 20 1248015 =時間值T31係指手指Η)於觸控板21上所停留之最短有 It間。若步驟46中判斷第-次出現之時間長度丁一大 第昂^小敲擊參考時間值T3i(Td_>T3i)Bf,意味著 ,-人出現之訊號為有效訊號,而繼續步驟47。反之,若 t驟46中判斷出第一次出現之時間長度T,一不大於第— 考時間值T“T—)時,意味著第一次 見:雜訊,故揚棄不用而跳回步驟41,以重新偵測第一 ίο 15 20 可依。本狀第—最錢擊參切難τ3]之範圍 &汁者為要或使用者操作習慣而調整。 在^步驟47_ ’意味著第—次出現之時間長度 二二-次時間間距、的加料^ 10接觸觸控板2"卜屮Γ勢不外乎是手指 於觸控板21之第…心”爾長,或手指10 例中以時門W t 移量較A,因而本實施 出:=—條件先被達成。手勢單 生的計算社果D “十時外,更利用位移單元25產 一 Χ,來計算第二次出現的累計位移量 二次to先偵測出第二次出現結束時,可,得一第 出現之相長與―第二以現結輕手1】: 迹^或作要求條件來判 以增加_的可靠度。因而 ^否為拖良手勢, 到^^出, ^47巾,同時判_測 12 5 10 15 20 1248015 提起時產生的第二次時„距Tup2。此時,若確認第二次時 間間距Tup2與第二次出現之時間長度為有效訊號時, 意味著在第一參考時間值T #女^ ^ 值τ丨内有兩次完整出現【(TdownI +After Dy (referred to as a touch signal), it is passed to the gesture unit 26 and the transmission interface π. Thus, the compute nodes S Dx, Dy can be transmitted via the transport interface 27 to a host gamma 3 ' for the host 3 to control the movement of its indicators on the screen. The host computer 3 can be a personal computer, a notebook computer, a personal digital processor (pDA, mobile phone, etc.). Here, since the aforementioned components are not an improved feature of the present case and are familiar to those skilled in the art, they are not here. In addition, the arithmetic unit 24, the displacement unit 25, the gesture unit %, and the transmission interface 27 of this example are integrated in a controller such as a chip. The gesture unit 26 receives the calculation results Dx, Dy of the displacement unit 24 to determine Whether the object has an action corresponding to the drag gesture on the touch panel 21 and correspondingly outputs a drag button for simulating the mouse button and moving the mouse when determining the drag gesture (the drag signal is a plurality of consecutive signals) The cover 20 l248〇i5 package is fed to the host 3 via the transmission interface 27 for corresponding control of the cursor. The technical feature of the present invention is: the method for recognizing the drag gesture by the gesture unit 26. The method can be soft, scorpion, or hard. The body mode is set in the gesture unit 26. In addition, although the gesture unit 26 of the present example is integrated in the controller of the touch device 2, it can also be soft. Or the hardware is not limited to the one disclosed in the embodiment. In addition, although the capacitive touch device 2 is taken as an example, the skilled person knows that The invention can also be applied to other types of touch panel devices, such as optical, resistive, inductive, pressure, electromagnetic, surface acoustic wave, ultrasonic, etc., and should not be limited by this. The embodiment of the present invention is described with reference to Fig. 3. In this example, it is assumed that the touch panel 21 is tapped by an object such as the finger 10 (_ twice. The description is convenient. In the following, the object is represented by the finger 1G. In addition, although in this example, an object of the finger 1〇 is used for explanation, but the skilled person knows that the touch panel 21 can also sense a plurality of objects. It should not be limited by the example. First, in step 41, the touch device 2 detects the start of the first occurrence of the finger 1 on the touch panel 21, that is, the start of the first tap. At the same time, the device 2 will start counting the finger 1G on the touch panel 21. In this example, if it is assumed that the drag gesture is a first reference time value, the start of the two occurrences is detected. The range of the first reference time value τ丨 in this example can be set to In 100 microseconds to 1 〇〇〇 microseconds (10) (four) ding ^ 诵 (four), can be adjusted according to the needs of the designer or the user's operating habits. 9 5 10 15 20 !248〇15 and then 'in step 42, touch The finger on the device board 21 is 〇1, and the two conditions in the touch control ^~~~, if it is determined in step 42, it is determined that the first time has not reached the first reference time value, . It is possible that the first reference time 胄τ has already appeared for the first time, because step 44 is continued. Conversely, if the Niu Zan 4 has a second occurrence, then the first reference time value is determined to determine that the counting time has been Arrival occurs and the time length T1 in the first time value T1 is only exceeded, and the non-drag, gesture, and thus the gesture unit 26: the time value is determined to determine whether it is another gesture.兀%Execution Step 43 Board 2ΓΙ: Touch: Device 2 continues to judge which part of the secret towel - condition first (four) into. · The second occurrence of the breakout has begun. The Xian 44 towel may be judged twice. The tea test time value is within. If the step 44 is first judged: wide gesture, proceed to step 45. ‘Can confirm non-(4) gestures When arriving at the first – reference time value D) Other gestures. Then, the process jumps to step 43 to determine whether it is determined in step 44 that the touch device 2 has already started when the previous two appearances have begun. - on the second and second; on the touchpad 21 (four) continued time), - between the appearance of the person 1 spacing τ, ιη1 (refer to 10 1248015 between the finger 10 after the first tap and lifted off the trackpad 21, the length of time until the second tap of the finger 10). The touch panel 21 is easily misunderstood during use, or is caused by noise generated by the operation of the touch panel 21 itself or by noise from the external environment. The time interval between the appearance of one occurrence, the second occurrence, and the occurrence of two occurrences. Since these improper signals only last for a short time in many times, in this embodiment, the duration of each action is required to be greater than the corresponding minimum reference time value, respectively, to effectively filter out the inappropriate signals, thereby increasing the accuracy of the identification. . Thus, in step 45, it is determined whether the first time interval Tupl between the first and second occurrences is greater than a first minimum lifting reference time 2]. Here, the first dare to mention the reference time value "the shortest effective time of the UP 川 提起 提起 (UP) and then the lower limit. In this example - the minimum lifting reference time value □ 2 can be set to about 1 micro Seconds ~ 10 microseconds (1ms Kenting 1〇m〇' can be adjusted according to the designer's needs or user's operating habits. If the step = the first time heart Tup] is not greater than the first minimum lifting reference time ^ ^ ( Tup】f21) means the first time between the first time and the second time: the time interval:: is too short, so the signal of the first time interval is judged 4: 1:7. End, and jump back to step (4). If the reference time value Τ2] (Τ >τ, R main_generous, and younger T^ υρ1>Τ2]) in the first time of the Hungarian break in step 45, it means The first inter-employment interval up] is valid, then proceed to step 46. In / 46, 'Judge the first appearance of the generous "One-on-one slamming ancient burning 1 down" 疋 No. Reference time value Ding 3]. Here, the first minimum tap 20 1248015 = time value T31 refers to the most remaining on the touchpad 21 There is an It. If the length of the first occurrence of the first occurrence is determined in step 46, the reference time value T3i(Td_>T3i)Bf means that the signal appearing is a valid signal and continues. Step 47. Conversely, if the length of time T of the first occurrence is judged in step 46, and the value is not greater than the value of the first test time T "T-), it means that the first time sees: noise, so discarding is not needed. Jump back to step 41 to re-detect the first ίο 15 20 compliant. The scope of the first - the most money hits the difficult τ3] & the juice is adjusted for the user or the user's operating habits. In ^Step 47_ ' means the length of the second occurrence of the second time - the time interval, the feeding ^ 10 touch the touchpad 2 " the momentum is nothing more than the finger on the touchpad 21 ... heart" In the long case, or in the finger 10 case, the time gate W t shift is larger than A, so the implementation: = - condition is first achieved. The calculation of the gesture single life D "10 o'clock, the displacement unit 25 is used to produce one Χ, to calculate the second occurrence of the cumulative displacement twice to first detect the end of the second occurrence, can be, the first appearance of the constructive and the second to the current light hand 1]: trace ^ or The requirements are imposed to increase the reliability of _. Therefore, ^ is a good gesture, to ^^ out, ^47 towel, at the same time judge _ test 12 5 10 15 20 1248015 when the second time is raised „from Tup2. At this time, if the second time interval Tup2 is confirmed When the length of time when the second occurrence is a valid signal, it means that there are two complete occurrences in the first reference time value T #女^^值τ丨[(TdownI +
Tdown2 + Tupl)〈Ti】且第―+山不目 ,… 弟—人出現之又 ^ 拖电手勢。 結束時,繼 ㈣“8、49,以先判斷第二次時間間距Tup2與第二次出 現之時間長度TdQW„2是否為有效訊號。Tdown2 + Tupl) <Ti] and the first - + mountain is not the eye, ... brother - the person appears again ^ dragging gestures. At the end, following (4) "8, 49, first determine whether the second time interval Tup2 and the second time length TdQW „2 are valid signals.
在步驟AS中’判斷第二次時間間距TUP2是否大於一第 :最小提料考時間值T22。本例之第二最小提起參考時間 值Τα之範圍可設定為約介於1微秒,微秒(lmgT2S Γΐυ*依設計者f要或使用者操作習慣而調整。若步驟 :,二次時間間⑬T-大於第二最小提起參考時間值 二繼til時,代表第二次時間間⑮%為有效訊號 以:續步驟49的判斷。若步驟49判斷為否(Tu^T22) 奪不二未著此第二次時間間距Tup2的訊號僅為雜訊,故揚 值;用而跳回步驟47。本例中設定第一最小提起參考時間 2】目同於第二最小提起參考時間值丁22。 大於3驟最49/’判斷第二次出現之時間長度Td_2是否 '第-最小敲擊參考時間值T32。若步驟49中判斷出 τ第現之時間長度τ“η2Α於第二最小敲擊參考時間值 32 ( d〇'vn2>T32)時,可確定第二 號,繼而可推斷…U “ 出見之机唬為有效訊 是否為f: 因而跳至步驟43’以判斷 〜、他手勢。反之’若步驟49巾,判斷出第二次出現 13 1248015 τ/=度於第二最錢擊參考時間值t32( 回步^ 4Γ)時,意味者第二次出現為雜訊而揚棄不用,跳 ,以繼續偵測弟二次出現是否已開始。本例 5 10 15 20 摔擊參考時間值Τ32之範圍可依設計者需要或使用者 第;’:而調整’更可設定第二最小敲擊參考時 弟取小敲擊參考時間值T31相同。 一 若步驟47中,先判斷出自筮 h Γ、’則可推斷出兩次出現為拖$手勢,因而先執行步Ϊ 以判斷第二次出現是否為有效訊號。 ΜIn step AS, it is judged whether or not the second time interval TUP2 is greater than a first: minimum lifting time value T22. The second minimum lifting reference time value Τα of this example can be set to be about 1 microsecond, and the microsecond (lmgT2S Γΐυ* is adjusted according to the designer f or the user's operating habit. If the step:, the second time When 13T- is greater than the second minimum lifting reference time value and two til, it represents that 15% of the second time is a valid signal to: continue the judgment of step 49. If the determination in step 49 is no (Tu^T22) The signal of the second time interval Tup2 is only noise, so the value is used; and it is used to jump back to step 47. In this example, the first minimum lifting reference time 2 is set to be the same as the second minimum lifting reference time value. More than 3 steps most 49 / 'determine the second occurrence time length Td_2 whether the 'first-minimum tap reference time value T32. If the τ first time length τ "η2" is determined in step 49, the second minimum tap reference is When the time value is 32 (d〇'vn2>T32), the second number can be determined, and then it can be inferred that ... U "whether the machine is a valid message or not f: thus jump to step 43' to judge ~, his gesture. Conversely, if step 49 is used, it is judged that the second occurrence of 13 1248015 τ/= degrees The second most money hit reference time value t32 (back to ^ 4Γ), the meaning of the second occurrence of noise for the discarding and discarding, skip, to continue to detect whether the second appearance of the brother has begun. This example 5 10 15 20 fell The range of the reference time value Τ32 can be adjusted according to the designer's needs or the user's first; ': and 'the second minimum tap reference can be set to the same as the small tap reference time value T31. Judging that 筮h Γ, ' can be inferred that two occurrences are dragging $ gestures, so step 执行 is performed first to determine whether the second occurrence is a valid signal.
大2步Γ 5G中’判斷第二次出現之時間長度Td_是否 W二最小敲擊參考時間值T32。若步驟5Q ,出現之時間長度U於第二最小敲擊參考時間值T /“n2>T32)日夺’意味著第二次出現為有效訊號,且第: 人出現之時間長度τ“η1、第—次與第二次出現間的第 間間距Tup,及第二次出現之時間長度Tdewn2之加總不小Μ :參考時間值T,【(Td_, + Td_2+Tupi)4】,因而手勢 早兀26產生一拖矣訊號’以經傳輸介面27饋入主機3,以 告知主機3拖矣手勢的產生,模擬滑鼠之按鍵持續被按壓 並私動所產生之拖良訊號。若步驟5〇中,判斷出第二·欠出 寺間長度Td()wn2不大於第二最小敲擊參考時間值丁3 ( TdowuST32)時,代表第二次出現為雜訊,但因自第一次出 現開始後已達到第-參考時間值τ】,所以跳至步驟43^ 判斷是否為其他手勢。 Η 5 10 15 20 1248015 元判斷出第二次出現之累計位移量 :大於茶考位移量Μι (Μ“^Μι)時 兩次敲擊的整體時間較短,但第二次敲擊(即第二 :觸控板21上拖,,使用者應是為㈣目 :’因而執行步驟51,如圖5以產生融號。本例j 考位移量JVh的範圍可為 η 1Λ 〆In the big 2 step Γ 5G, it is judged whether the second occurrence time length Td_ is W or not the minimum tap reference time value T32. If step 5Q, the length of time U appearing at the second minimum tapping reference time value T / "n2 > T32) means that the second occurrence is a valid signal, and the length of time: τ "η1 The first interval Tup between the first and second occurrences, and the second occurrence time length Tdewn2 are not small: reference time value T, [(Td_, + Td_2+Tupi) 4], thus the gesture The early 26 generates a drag signal 'to be fed into the host 3 via the transmission interface 27 to inform the host 3 of the generation of the drag gesture, simulating the drag signal generated by the mouse button being continuously pressed and privately moved. If in step 5, it is judged that the second inter-temple length Td() wn2 is not greater than the second minimum tap reference time value D3 (TdowuST32), the second occurrence is noise, but since the second The first reference time value τ has been reached after the start of one occurrence, so skip to step 43^ to determine if it is another gesture. Η 5 10 15 20 1248015 yuan to determine the cumulative displacement of the second occurrence: greater than the tea test displacement Μι (Μ "^Μι) when the overall time of two strokes is shorter, but the second stroke (ie the first Second, the touchpad 21 is dragged, and the user should be (4): 'Therefore, step 51 is performed, as shown in Fig. 5 to generate a fuse. In this example, the range of displacement JVh can be η 1Λ 〆
10 pixel) ^像素②⑽〗)〜1 〇像素(! PiWS 4 4 σ、3像素,亦可依設計者需求盥使肖 者操作習慣而調整。 ^ L、使用 依前所述,有別於習知的 次敲擊後隨即產生,配合圖4,:」號於第-度Th t t 田第一、一二人出現之時間長 。_】、Td_與兩次出現間之第一次 總大於或等於第一參考時間Μ Τι,( 1ET-之加10 pixel) ^Pixel 2(10)〗)~1 〇pixel (! PiWS 4 4 σ, 3 pixels, can also be adjusted according to the designer's needs to make the operator's operating habits. ^ L, use as described above, different from the ha After the known knock, it will be generated immediately. With the figure: 4, the number of the first and second persons in the first degree is longer than the first one or two. _], Td_ and the first time between the two occurrences are always greater than Or equal to the first reference time Μ Τι, ( 1ET- plus
Tl時,則於第一次出現後?計 J1 —n2+Tupl) ^ 絲,+ 傻系冲日可間到達第一參考時間值τ 山 才輸出拖矣訊號51。另外,配合圖5,當第一、一1 二時間長度τ-νηί’、τ“η2’與兩次出現間之 Μ】時( &之累抽心里Md_2,不小於參考位移量 量不t /_2心〗),則於該第二次出現期間當該累積㈣ -於該參考位移量之時間點,輸出拖复訊號5ι,。夕 公式歸納前述,本實施例對於拖,手勢之要求條件如下列 公式 I: Td()wnl> τ3ι 公式 2·· Td()、vn2> τ32 公式3: Tup】>T2】 15 1248015 公式 4: Tup2>T22 公式 5: (Tdownl+Tupl) < τ】;an(i a· (Tdowni+Tdown2+Tup】)—丁〗; 5 10 15 20 b· M<j〇 wn2 = M j 應注意的是’雖然前述步驟42、44、47係同 個條件,然而熟習該項技藝者當知,前述步驟42、料夕 之條件亦可依序判斷,並不應受限於本實施所揭露。、47 依據所述’有別習知需個別判斷第-次出現及第一 二次出現間的間隔時間之時間是否小於對應之參考時間伯 並^第—出現時間内需額外輸出χ、γ資訊作為計算依 ,本發明之辨識㈣手勢之方法中無f輸出χ、γ 是綜合各動作時間τ一、τ一、Tupi 判斷 不小於第一參考時間值夂本a斷疋否 出現之累計位移量Md〗/否^ )’或者判斷第二次 d_^疋否不小於筝考位移量M】(表考公 式叫,以達到判斷更為簡潔且可靠之功效。另外本明 二?考料:需分別⑽ 魂^ ^ 不田5孔唬,以達到判斷更為精 ◊力效。再者’有別於習知僅利用時 M之判斷:本發明…用判斷第二次出現之累計位二 二=小於參考位移量Μι來判斷其是否為㈣手勢( 多j a式5b),以便利你用去 之功效。 _使㈣&作,進而達到判斷更精確 惟以上所述者,僅為本發明之較佳實施例而已,當不 16 1248015 能以此限定本發明實施之範圍,即大凡依本發明申請專利 範圍及發明說明書内容所作之簡單的等效變化與修飾,皆 應仍屬本發明專利涵蓋之範圍内。 【圖式簡單說明】 圖1是一種習用拖曳手勢之示意時脈圖; 圖2是結合本發明之辨識拖良手勢之方法的較佳實施 例的觸控裝置之方塊示意圖; 圖3是圖2中實施例之流程圖; 圖4是圖2中實施例的一範例的輸入與輸出訊號之時 脈圖;及 口 圖5是圖2中實施例的另一範例的輸入與輸出訊號之 時脈圖。 17 1248015 【圖式之主要元件代表符號說明】 1 0手指 τ downl、Tdownl 弟一火出 2觸控裝置 現之時間長度 21觸控板When Tl, after the first appearance? Count J1 —n2+Tupl) ^ Silk, + Silly rushing to the first reference time value τ Mountain to output the drag signal 51. In addition, in conjunction with FIG. 5, when the first, one, and two time lengths τ-νηί', τ "η2', and the occurrence of the two occurrences (the & the exhausted mind, Md_2, not less than the reference displacement amount is not t /_2心〗), during the second occurrence period, when the accumulation (4) - at the time of the reference displacement amount, the output of the drag signal 5ι, the formula is summarized in the foregoing, the requirements for the drag and the gesture of the present embodiment For example, the following formula I: Td()wnl> τ3ι Formula 2·· Td(), vn2> τ32 Equation 3: Tup】>T2] 15 1248015 Formula 4: Tup2>T22 Equation 5: (Tdownl+Tupl) < τ 】;an(ia·(Tdowni+Tdown2+Tup))-丁〗; 5 10 15 20 b· M<j〇wn2 = M j It should be noted that although the aforementioned steps 42, 44, 47 are the same condition, However, those skilled in the art are aware that the conditions of the aforementioned step 42 and the eve may also be judged in order, and should not be limited to the disclosure of the present embodiment. 47 According to the above-mentioned, it is necessary to judge individually. Whether the time between the occurrence and the first occurrence of the second time is less than the corresponding reference time, and the additional time is required during the occurrence time. γ information is used as the calculation. In the method for identifying (4) gestures of the present invention, there is no f output χ, γ is the integration of each action time τ1, τ1, Tupi judgment is not less than the first reference time value 夂本 a broken or not accumulated Displacement amount Md〗 / No ^) 'or determine whether the second d_^疋 is not less than the kite displacement M] (the formula is called to achieve a more concise and reliable effect. In addition, this second? : Need to separate (10) Soul ^ ^ No field 5 hole 唬, in order to achieve a more refined and effective effect. In addition, 'different from the conventional use only when the judgment of M: the invention ... use the judgment of the second occurrence of the cumulative position 22 = less than the reference displacement Μι to determine whether it is (four) gesture (multi-ja 5b), to facilitate the use of your effect. _ make (four) & to achieve more accurate judgment, but the above, only this The preferred embodiment of the invention is not limited to the scope of the invention, and the simple equivalent changes and modifications made in accordance with the scope of the invention and the description of the invention are still in the invention. Within the scope of the patent. [Simple diagram 1 is a schematic clock diagram of a conventional drag gesture; FIG. 2 is a block diagram of a touch device in accordance with a preferred embodiment of the present invention for identifying a drag gesture; FIG. 3 is an embodiment of FIG. FIG. 4 is a clock diagram of input and output signals of an example of the embodiment of FIG. 2; and FIG. 5 is a clock diagram of input and output signals of another example of the embodiment of FIG. 2. 17 1248015 [The main components of the diagram represent the symbol description] 1 0 finger τ downl, Tdownl brother fire 2 touch device current time length 21 touchpad
T d 〇 w η 2 Τ d o w η 2 第二次出 22 X方向處理單元 23 Υ方向處理單元 24運算單元 25位移單元 26手勢單元 27傳輸介面 3主機 41〜51步驟 5 1、5 Γ拖良訊號 現之時間長度T d 〇w η 2 Τ dow η 2 second output 22 X direction processing unit 23 Υ direction processing unit 24 arithmetic unit 25 displacement unit 26 gesture unit 27 transmission interface 3 host 41 to 51 step 5 1, 5 Γ good signal Current length of time
Tupl、Tupl’第一次與第二 次出現間之第一次時間間 距The first time interval between the first and second occurrences of Tupl and Tupl’
TUP2第二次時間間距 τ3參考時間值 M(j〇wn2、M(j〇wn2’ 苐一次出 現之累計位移量 down點觸TUP2 second time interval τ3 reference time value M(j〇wn2, M(j〇wn2’ 累计 cumulative displacement amount at one time down touch
1818
Claims (1)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW92133381A TWI248015B (en) | 2003-11-27 | 2003-11-27 | Method and controller for recognizing drag gesture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW92133381A TWI248015B (en) | 2003-11-27 | 2003-11-27 | Method and controller for recognizing drag gesture |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TW200517931A TW200517931A (en) | 2005-06-01 |
| TWI248015B true TWI248015B (en) | 2006-01-21 |
Family
ID=37400712
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW92133381A TWI248015B (en) | 2003-11-27 | 2003-11-27 | Method and controller for recognizing drag gesture |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TWI248015B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI396118B (en) * | 2006-06-02 | 2013-05-11 | Intellectual Discovery Inc | Apparatus and method for searching and displaying data |
| TWI416381B (en) * | 2008-03-05 | 2013-11-21 | Mitac Int Corp | Touch the sliding method |
| TWI464647B (en) * | 2012-09-10 | 2014-12-11 | Elan Microelectronics Corp | Touch device and gesture identifying method thereof |
| TWI475440B (en) * | 2012-09-10 | 2015-03-01 | Elan Microelectronics Corp | Touch device and gesture identifying method thereof |
| TWI493437B (en) * | 2013-06-19 | 2015-07-21 | 義隆電子股份有限公司 | Method of opening window control bar by identification of edge swipe gesture and touch system using the method |
| TWI612442B (en) * | 2011-12-21 | 2018-01-21 | 諾基亞科技公司 | Apparatus and method for user gesture recognition, and associated computer program |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI393053B (en) * | 2007-09-29 | 2013-04-11 | Htc Corp | Method for viewing image |
-
2003
- 2003-11-27 TW TW92133381A patent/TWI248015B/en not_active IP Right Cessation
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI396118B (en) * | 2006-06-02 | 2013-05-11 | Intellectual Discovery Inc | Apparatus and method for searching and displaying data |
| TWI416381B (en) * | 2008-03-05 | 2013-11-21 | Mitac Int Corp | Touch the sliding method |
| TWI612442B (en) * | 2011-12-21 | 2018-01-21 | 諾基亞科技公司 | Apparatus and method for user gesture recognition, and associated computer program |
| TWI464647B (en) * | 2012-09-10 | 2014-12-11 | Elan Microelectronics Corp | Touch device and gesture identifying method thereof |
| TWI475440B (en) * | 2012-09-10 | 2015-03-01 | Elan Microelectronics Corp | Touch device and gesture identifying method thereof |
| TWI493437B (en) * | 2013-06-19 | 2015-07-21 | 義隆電子股份有限公司 | Method of opening window control bar by identification of edge swipe gesture and touch system using the method |
Also Published As
| Publication number | Publication date |
|---|---|
| TW200517931A (en) | 2005-06-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4295280B2 (en) | Method and apparatus for recognizing two-point user input with a touch-based user input device | |
| KR101835188B1 (en) | Using pressure differences with a touch-sensitive display screen | |
| KR101555795B1 (en) | Using pressure differences with a touch-sensitive display screen | |
| KR101551133B1 (en) | Using pressure differences with a touch-sensitive display screen | |
| KR101545804B1 (en) | Using pressure differences with a touch-sensitive display screen | |
| CN107193479B (en) | Information processing method, device, electronic equipment and storage medium | |
| CN105359086B (en) | Method for controlling chat window and electronic device implementing the method | |
| US8164575B2 (en) | Method for identifying a single tap, double taps and a drag and a controller for a touch device employing the method | |
| CN205427823U (en) | Electronic device and device for performing text selection operation | |
| US7190356B2 (en) | Method and controller for identifying double tap gestures | |
| US20140237408A1 (en) | Interpretation of pressure based gesture | |
| US7184031B2 (en) | Method and controller for identifying a drag gesture | |
| US20130155031A1 (en) | User control of electronic devices | |
| TW201104529A (en) | Touch device, control method and control unit for multi-touch environment | |
| WO2014183351A1 (en) | Handwriting input method and device | |
| CN101667077B (en) | Single click, double click and drag action recognition method and controller of touch device | |
| TWI248015B (en) | Method and controller for recognizing drag gesture | |
| CN107438817B (en) | Avoid accidental pointer movement when touching the surface of the trackpad | |
| CN1624631A (en) | Method and controller for recognizing dragging gesture | |
| TWI569183B (en) | Touch sensing method and touch sensing apparatus and touch sensing keyboard | |
| CN108475126A (en) | The processing method and touch keyboard of touch operation | |
| US20150091803A1 (en) | Multi-touch input method for touch input device | |
| WO2012001412A1 (en) | User control of electronic devices | |
| TWI252433B (en) | Method and control device for identifying a double-tap gesture | |
| TW201214211A (en) | Touch pattern detecting method and touch pattern detector using the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| MM4A | Annulment or lapse of patent due to non-payment of fees |