TWI853600B - Mobile device and switching method of input method thereof - Google Patents

Abstract

A mobile device and switching method of input method thereof is related to the mobile device, which includes a general camera module, a specific camera module, a barcode-decoding module, a touch display module, and a control module. The touch display module is configured to display a display frame, and the display frame has an input field. The control module is configured to activate a trigger element for an image conversion input method in response to an input trigger event on the input field, control the touch display module to display the input field and a first overlapping window composed of a virtual keyboard for a system default input method on the display frame simultaneously, and control the touch display module to switch the first overlapping window which is displayed to a second overlapping window in response to a first trigger event on the trigger element. The second overlapping window has a self-defined keyboard and a preview pane for the image conversion input method in parallel.

Description

Mobile device and input method switching method thereof

This case is about image conversion input method, and in particular, about a mobile device and a method for switching its input method.

In order to meet the special needs of the market, some companies have developed applications with barcode scanning and/or optical character recognition (OCR) functions, and applied these applications to various types of mobile devices (such as smartphones, tablets or industrial touch computers, etc.). However, this application is not convenient to use. For example, when a user wants to use this application to convert a barcode image or a text image into a string and input this string into the input field of another application (such as Facebook or Google Chrome, etc.), the user needs to open the windows of these two applications alternately to complete the above operations.

In view of this, the inventor proposes a mobile device and a method for switching input methods thereof, integrating an application with a barcode scanning function and/or an OCR function (hereinafter referred to as an image conversion input method) into the input method of the mobile device, so as to use the barcode scanning function and/or the OCR function to obtain the content represented by the barcode and/or the image and directly input the obtained content into the input field, thereby improving the convenience of the image conversion input method in use.

In some embodiments, a mobile device includes: a general camera module; a dedicated camera module; a barcode decoding module electrically connected to the dedicated camera module, for capturing at least one barcode image through the dedicated camera module, and converting at least one barcode image into at least one first string, wherein each barcode image is generated by the dedicated camera module photographing at least one barcode; a touch display module, for displaying a display screen, wherein the display screen has an input field; and a control module electrically connected to the general camera module, the barcode decoding module, and the control module. The code decoding module and the touch display module are used to respond to an input trigger event of the input field to activate a trigger element of an image conversion input method, control the touch display module to simultaneously display the input field and a first overlay window composed of a virtual keyboard of a system default input method on the display screen, and respond to a first trigger event of the trigger element to control the touch display module to switch the displayed first overlay window to a second overlay window, wherein the second overlay window has a custom keyboard of the image conversion input method and a preview pane in parallel.

In some embodiments, the trigger element is a virtual button, and the control module activates the trigger element by controlling the touch display module to simultaneously display the first overlay window and the virtual button on the display screen.

In some embodiments, the mobile device further includes a housing, a general camera module, a dedicated camera module and a touch display module are embedded in the housing, a barcode decoding module and a control module are disposed in the housing, the trigger element is a physical key, the physical key is embedded in the housing and electrically connected to the control module, and the control module activates the trigger element by enabling an input method switching function of the physical key, and the first trigger event is a switching signal generated by the physical key.

In some embodiments, the mobile device further includes a communication module electrically connected to the control module; and a control element wirelessly connected to the communication module, wherein the trigger element is a physical key on the control element, the control module activates the trigger element by enabling an input method switching function of the physical key, and the first trigger event is a switching signal generated by the trigger element.

In some embodiments, the trigger element is a designated gesture, and the control module activates the trigger element by enabling a gesture detection input function of the designated gesture.

In some embodiments, the control module is further used to control the touch display module to switch the displayed second overlay window back to the first overlay window in response to the first trigger event occurring again.

In some embodiments, the control module is further used to control the touch display module to display a setting screen of the image conversion input method in response to a second trigger event of the trigger element.

In some embodiments, the mobile device further includes at least one selection key, wherein the dedicated camera module is used to capture a preview screen having at least one barcode image, and the control module is further used to activate the barcode decoding module in response to a barcode selection trigger event of the at least one selection key, and after activating the barcode decoding module, the preview screen is displayed in real time in the preview pane and one of the at least one first string is displayed in the input field.

In some embodiments, at least one barcode image is plural, the second overlay window further has a candidate field, the candidate field is above the virtual keyboard and the preview pane, and the control module is further used to display at least one first string as an input option of the input field in the candidate field after starting the barcode decoding module.

In some embodiments, the mobile device further includes a text recognition engine, which is disposed between the general camera module and the control module, and is used to capture at least one string image and another preview screen having at least one string image through the general camera module, and recognize and convert each string image into at least one second string, wherein each string image is generated by the general camera module by photographing at least one text.

In some embodiments, the control module is further used to activate the text recognition engine in response to a text selection trigger event of at least one selection key, and after activating the text conversion engine, another preview screen is instantly displayed in the preview pane and one of the second strings is displayed in the input field.

In some embodiments, the second overlay window further includes a magnification key, and the control module is further used to control the touch display module to magnify the preview pane in response to a magnification trigger event of the magnification key.

In some embodiments, a method for switching input methods of a mobile device includes: displaying an input field on a display screen; activating a trigger element of an image conversion input method through the input field, and controlling a touch display module to simultaneously display the input field and a first overlay window on the display screen, wherein the first overlay window is composed of a virtual keyboard of a system default input method; and switching the first overlay window displayed on the display screen to a second overlay window in response to a first trigger event of the trigger element, wherein the second overlay window has a custom keyboard of an image conversion input method and a preview pane in parallel, and the preview pane is linked to a general camera module or a dedicated camera module.

In some embodiments, the trigger element is a virtual key, and the simultaneous display step includes: simultaneously displaying the input field, the virtual key, and a first overlay window consisting of a virtual keyboard of the system default input method on the display screen.

In some embodiments, the trigger element is a physical key, the first trigger event is a switching signal generated by the physical key, and the activation step of the trigger element includes: enabling an input method switching function of the physical key to activate the trigger element.

In some embodiments, the switching method further includes: receiving a switching signal from a physical key via a wire; and switching the first overlay window displayed on the display screen to a second overlay window in response to the switching signal.

In some embodiments, the switching method further includes: wirelessly receiving a switching signal from a physical key; and switching the first overlay window displayed on the display screen to a second overlay window in response to the switching signal.

In some embodiments, the trigger element is a designated gesture, and the switching method further includes: detecting the designated gesture; and switching the first overlay window displayed on the display screen to the second overlay window when the designated gesture is detected.

In some embodiments, the switching method further includes: in response to the first trigger event occurring again, switching the second overlay window displayed on the display screen back to the first overlay window.

In some embodiments, the switching method further includes: displaying a setting screen of the image conversion input method in response to a second trigger event of the trigger element.

In some embodiments, the image conversion input method includes a barcode scanning input method, and the switching method further includes: activating the barcode scanning input method in response to a barcode selection trigger event; scanning at least one barcode using the barcode scanning input method to obtain at least one first string, wherein the activation step of the barcode scanning input method includes: photographing at least one barcode by a dedicated camera module to obtain at least one barcode image of the at least one barcode; and decoding at least one barcode image into at least one first string using a barcode decoding module; and displaying one of the at least one first string in the input field.

In some embodiments, the shooting step of the dedicated camera module also obtains a preview screen having at least one barcode image, and the scanning step using the barcode scanning input method further includes: previewing and displaying the preview screen in the preview pane.

In some embodiments, at least one barcode image is plural, the second overlay window has a candidate field, the candidate field is above the virtual keyboard and the preview pane, and the switching method further includes: displaying at least one first string as an input option of the input field in the candidate field.

In some embodiments, the image conversion input method includes a text recognition input method, the mobile device further includes a text recognition engine, and the switching method further includes: activating the text recognition input method in response to a text selection trigger event; using the text recognition input method to detect at least one text to obtain at least one second string, wherein the activation step of the text recognition input method includes: photographing at least one text by a general camera module to obtain at least one string image of at least one text and another preview screen having at least one string image; previewing and displaying another preview screen in a preview pane; and using the text recognition engine to recognize and convert at least one string image into at least one second string; and displaying one of the at least one second string in an input field.

In some embodiments, the second overlay window further includes a magnification key, and the switching method further includes: responding to a magnification trigger event of the magnification key to magnify the preview pane.

In summary, according to any embodiment, the mobile device or its input method switching method has both a system default input method and an image conversion input method to provide multiple input functions. In this way, when the user inputs text in any input field, he can select an appropriate input method to perform input operations (such as but not limited to Chinese and English input, barcode scanning input or OCR input, etc.), thereby improving the convenience and efficiency of text input.

10: Mobile devices

100: General camera module

110: Dedicated camera module

120: Barcode decoding module

130: Touch display module

140: Control module

150:Text recognition engine

160: Communication module

20: Shell

21: Physical buttons

200: Display screen

210: Input field

211: Cursor

220: First overlay window

221: Virtual keyboard

230:Virtual keys

240: Second overlay window

241: Customize keyboard

242: Preview pane

243:Select key

244:Select key

245: Preview screen

246: Candidate field

247: Preview screen

248: Zoom in key

250: Setting window

30: Trigger element

31,32,33: Barcode image

41,42: string image

50: Control components

51: Physical buttons

BT:Virtual keys

BT1~BT6: Button

IT1,IT2: Input options

S100~S180: Steps

S110a, S110b, S110c, S110d: Steps

S120a, S120b, S120c: Steps

S131~S134: Steps

S132a, S132a’, S132b, S132c: Steps

S141~S144: Steps

S142a, S142b, S142c: Steps

ST1: First string

ST2: Second string

FIG1 is a module block diagram of a first embodiment of a mobile device.

FIG2 is a front view schematic diagram of one exemplary state of the mobile device in FIG1.

FIG3 is a rear view schematic diagram of one exemplary embodiment of the mobile device in FIG1.

FIG4 is a flowchart of the operation of a mobile device according to some embodiments.

FIG5 is a schematic diagram of an exemplary state of the input field in FIG2 after being processed by step S110 in FIG4.

FIG6 is a schematic diagram of an exemplary state of the trigger element in FIG2 after being processed in step S120 in FIG4.

FIG. 7 is an operation flow chart of the first embodiment of the process following step S120 in FIG. 4 .

FIG8 is an operation flow chart of the second embodiment following step S120 in FIG4.

FIG. 9 is a schematic diagram of an exemplary state of the preview pane in FIG. 6 after being processed by step S132a' and step S132b in FIG. 8.

FIG10 is a schematic diagram of an exemplary state of the preview pane in FIG6 after being processed by step S132c and step S134 in FIG8.

FIG11 is an operation flow chart of an implementation example of the subsequent step S132 in FIG8.

FIG12 is a schematic diagram of an exemplary state of the preview pane in FIG9 after being processed by step S134 in FIG11.

FIG13 is a module block diagram of the second embodiment of the mobile device.

FIG14 is an operation flow chart of the third embodiment following step S120 in FIG4.

FIG15 is a detailed flow chart of an embodiment of step S142 in FIG14.

FIG16 is a schematic diagram of an exemplary state of the preview pane in FIG6 after being processed by step S142a and step S142b in FIG15.

FIG. 17 is a schematic diagram of an exemplary state of the preview pane in FIG. 6 after being processed by steps S143 and S144 in FIG. 14 .

FIG. 18 is an operation flow chart of the fourth embodiment following step S120 in FIG. 4 .

FIG. 19 is an operation flow chart of the first embodiment of the subsequent step S110 in FIG. 4.

FIG. 20 is a schematic diagram of an exemplary state of the trigger element in FIG. 6 after being processed in step S170 in FIG. 19.

FIG. 21 is an operation flow chart of the fifth embodiment following step S120 in FIG. 4 .

FIG. 22 is a schematic diagram of an exemplary state of the preview pane in FIG. 6 after being processed by step S180 in FIG. 21 .

FIG. 23 is an operation flow chart of the first embodiment of the subsequent step S100 in FIG. 4.

FIG. 24 is a schematic diagram of an exemplary state of the trigger element in FIG. 2 after being processed by step S110a and step S110b in FIG. 23.

FIG. 25 is a schematic diagram of an exemplary state of the mobile device and the control element in FIG. 1 or FIG. 13 .

FIG. 26 is an operation flow chart of the second embodiment following step S100 in FIG. 4.

FIG. 27 is an operation flow chart of the second embodiment following step S110 in FIG. 4.

Please refer to FIG. 1 , a mobile device 10 with multiple input methods (hereinafter referred to as mobile device 10) can provide multiple input operations such as virtual keyboard, image conversion (such as barcode scanning and/or text recognition). The mobile device 10 includes a general camera module 100, a dedicated camera module 110, a barcode decoding module 120, a touch display module 130 and a control module 140. Among them, the barcode decoding module 120 is electrically connected between the dedicated camera module 110 and the control module 140, and the control module 140 is electrically connected to the general camera module 100, the barcode decoding module 120 and the touch display module 130.

Here, the barcode decoding module 120 can capture at least one barcode image through the dedicated camera module 110 and convert each captured barcode image into at least one string (hereinafter referred to as the first string).

Please refer to Figures 1 to 3. In some embodiments, the mobile device 10 includes a housing 20 and at least one physical button 21. The touch display module 130 is embedded in the front of the housing 20 (as shown in Figure 2), the general camera module 100, the dedicated camera module 110 and at least one physical button 21 are embedded in the housing 20, and the barcode decoding module 120 and the control module 140 are disposed inside the housing 20 (not shown).

In some embodiments, the general camera module 100 can be embedded in the back of the housing 20 (as shown in FIG. 3 ). In some embodiments, the general camera module 100 can also be embedded in the front of the housing 20 (not shown).

In some embodiments, the dedicated camera module 110 can be embedded in the back of the housing 20 (as shown in FIG. 3 ). In other embodiments, the dedicated camera module 110 can also be embedded in the side of the housing 20 (not shown).

In some embodiments, at least one physical key 21 may be embedded in the side of the housing 20 (as shown in FIG. 3 ). In other embodiments, at least one physical key 21 may also be embedded in the front of the housing 20 (not shown). In some embodiments, at least one physical key 21 is plural. Among them, the plural physical keys 21 may all be embedded in the side or front of the housing 20, or some physical keys 21 may be embedded in the side of the housing 20 and other physical keys 21 may be embedded in the front of the housing 20.

In some embodiments, the mobile device 10 may be a device with a touch function and a text input application, such as but not limited to a smart phone, a tablet computer, or a touch computer. In some embodiments, the general camera module 100 may be a front camera or a rear camera on the mobile device 10 for taking photos or recording videos in normal state.

Please refer to Figures 1 to 6. When the mobile device 10 starts to operate, the touch display module 130 displays an input field 210 on a display screen 200 (step S100, as shown in Figures 4 and 5).

In some embodiments, the size of the display screen 200 is not larger than the size of the screen of the touch display module 130. For example, the size of the display screen 200 may be substantially equal to the size of the touch display module 130 (as shown in FIG. 2 ).

In some embodiments, the input field 210 may be a desktop widget provided by the operating system or application of the mobile device 10 and resident on the desktop (such as but not limited to the search bar on the main screen of the mobile device 10), a search engine field in an application or web page (such as but not limited to the App Store search engine or the Google search engine, etc.), or a text input page or field in an application or web page (such as but not limited to the input page of Word or the post creation field of Facebook, etc.).

After step S100, the control module 140 responds to a trigger input trigger event of the input field 210 to activate a trigger element 30 of an image conversion input method, and controls the touch display module 130 to simultaneously display the input field 210 and a first overlay window 220 in the display screen 200 (step S110, as shown in Figures 4 and 5). The first overlay window 220 is composed of a virtual keyboard 221 of a system default input method, and the system default input method is linked to the input field 210.

In some embodiments, the trigger element 30 is a virtual key 230, and the control module 140 controls the touch display module 130 to simultaneously display the input field 210, the first overlay window 220, and the virtual key 230 on the display screen 200 to activate the trigger element 30. In other words, the control module 140 activates the trigger element 30 of the image conversion input method by controlling the touch display module 130 to display the trigger element 30. In some embodiments, the virtual key 230 can be floated in the display screen 200. In other words, the user can press and drag the virtual key 230 to any position in the display screen 200, and after the user releases the press, the virtual key 230 will stay at the current position in the display screen 200 where it is dragged. In other implementations, the virtual key 230 can also be fixed in the display screen 200. For example, it can be fixed in the middle position near the left side of the display screen 200.

After step S110, the control module 140 switches the first overlay window 220 displayed on the display screen 200 to a second overlay window 240 in response to a first trigger event of the trigger element 30 (as shown in FIG. 4 and FIG. 6 , step S120). The second overlay window 240 has a custom keyboard 241 of an image conversion input method and a preview pane 242 of the image conversion input method in parallel, and the preview pane 242 is linked to the general camera module 100 or the dedicated camera module 110.

In some embodiments, the custom keyboard 241 may be a text input keyboard having the same function as the virtual keyboard 221 (as shown in FIG6 ), or may be other types of input keyboards, such as but not limited to a handwriting input keyboard or a voice input keyboard (not shown). The user may set the type of the custom keyboard 241 by himself.

In some embodiments, if the trigger element 30 is a virtual key 230, the first trigger event may be a user pressing or continuously clicking the virtual key 230.

For example, the input field 210 is a search bar on the main screen of the mobile device 10 (as shown in FIG. 2 ). When the user clicks the input field 210 (i.e., an input trigger event occurs in the input field 210 ), the control module 140 responds to the user's click event and controls the touch display module 130 to display a cursor 211 in the input field 210 , and a first overlay window 220 including a virtual keyboard 221 of the system default input method is floated from the bottom of the display screen 200 , and at the same time, a virtual key 230 of the image conversion input method is displayed floatingly or fixedly at any position in the display screen 200 (as shown in FIG. 5 ). Then, when the user presses (i.e., the first trigger event) the virtual key 230, the touch display module 130 switches the first overlay window 220 displayed on the display screen 200 to the second overlay window 240 (as shown in FIG. 6).

Please refer to FIG. 6 . In some embodiments, the mobile device 10 further includes at least one selection key 243, 244, and the image conversion input method includes a barcode scanning input method. In other words, the mobile device 10 has a barcode scanning function.

Please refer to Figures 1, 4, 6 and 7. In some embodiments, after step S120, the control module 140 activates the barcode scanning input method in response to a barcode selection event occurring on at least one selection key 243 of the selection keys 243 and 244 (step S131). In other words, the selection key 243 corresponds to the barcode scanning function.

In some embodiments, the selection key 243 corresponding to the barcode scanning function may be a physical key of the mobile device 10 (e.g., at least one of the physical keys 21), or a virtual key on the second overlay window 240. For example, if the selection key 243 is a virtual key, the barcode selection event may be a user clicking the virtual key (i.e., the selection key 243) once.

After step S131, the mobile device 10 uses the barcode scanning input method to scan at least one barcode to obtain at least one first string (step S132).

In some embodiments of step S132, the dedicated camera module 110 captures at least one barcode to obtain at least one barcode image 31 of the at least one barcode (step S132a). Subsequently, the barcode image 31 is transmitted to the barcode decoding module 120, and the barcode decoding module 120 decodes each barcode image 31 into at least one first string (step S132c).

Please refer to FIG. 1, FIG. 4, FIG. 6 and FIG. 8, in some other embodiments of step S132, the dedicated camera module 110 captures at least one barcode to obtain at least one barcode image 31 of the at least one barcode, and a preview screen 245 having at least one barcode image 31 (step S132a'). Then, the control module 140 of the mobile device 10 controls the touch display module 130 to preview and display the preview screen 245 in the preview pane 242 in real time (step S132b, as shown in FIG. 8 and FIG. 9), so that the user can confirm the barcode that the dedicated camera module 110 is aligned with. Subsequently, the control module 140 transmits at least one barcode image 31 to the barcode decoding module 120, and the barcode decoding module 120 decodes at least one barcode image 31 into at least one first string (step S132c).

After step S132, the control module 140 receives the first string output by the barcode decoding module 120, and controls the touch display module 130 to display any first string ST1 in the at least one first string in the input field 210 (step S134, as shown in Figures 8 and 10).

For example, take a barcode as an example, the barcode information carried by this barcode is "ABC123456". Here, the dedicated camera module 110 takes a picture of this barcode to obtain a barcode image 31 of this barcode, and then the barcode decoding module 120 decodes the obtained barcode image 31 to obtain the first string ST1 of "ABC123456".

In some embodiments, when the dedicated camera module 110 captures multiple barcodes at one time (i.e., there are multiple barcode images at least one), the touch display module 130 displays the first string represented by (i.e., converted from) the barcode image at a specified position in the preview screen 245 (e.g., the barcode image overlapped with the center of the preview screen 245) in the input field 210.

Please refer to FIG. 1, FIG. 4, FIG. 9, FIG. 11 and FIG. 12. In some embodiments, at least one first string can be plural, and the second overlay window 240 further has a candidate field 246. The candidate field 246 is above the custom keyboard 241 and the preview pane 242 (as shown in FIG. 12). In other words, the dedicated camera module 110 captures plural barcodes at one time and obtains plural barcode images 32, 33 accordingly. At this time, in step S132c, the barcode decoding module 120 decodes the barcode images 32 and 33 of the multiple barcodes into multiple first character strings, and the control module 140 controls the touch display module 130 to display the multiple first character strings as input options IT1 and IT2 of the input field 210 in the candidate field 246 (step S133, as shown in FIG. 11).

For example, the dedicated camera module 110 takes two barcodes at one time (as shown in FIG. 12 ), and the barcode information carried by the two barcodes is “DEF789012” and “GHI345678” respectively. At this time, the candidate field 246 has two input options IT1 and IT2, one of which is the first string “DEF789012” converted from the barcode image 32, and the other is the first string “GHI345678” converted from the barcode image 33. Specifically, when the mobile device 10 captures and captures the barcode images 32 and 33 of the two barcodes, the barcode decoding module 120 decodes the two barcode images 32 and 33 into first strings of "DEF789012" and "GHI345678", respectively, and the two first strings are displayed in the candidate field 246 as input options IT1 and IT2, so that at least one of the two first strings can be selected to be input into the input field 210.

Please refer to FIG. 13 . In some embodiments, the image conversion input method may further include a text recognition input method, and the mobile device 10 further includes a text recognition engine 150 . The text recognition engine 150 is electrically connected between the general camera module 100 and the control module 140 , and is disposed inside the housing 20 (not shown). In other words, the mobile device 10 has an optical character recognition (OCR) function.

Please refer to FIG. 4, FIG. 13 and FIG. 14. In some embodiments, after step S120 or step S134, the control module 140 activates the text recognition input method in response to a text selection event occurring on another selection key 244 of at least one selection key 243, 244 (step S141). In other words, the selection key 244 corresponds to the optical character recognition function.

In some embodiments, the selection key 244 corresponding to the optical character recognition function may be a physical key of the mobile device 10 (e.g., at least one of the physical keys 21), or a virtual key on the second overlay window 240. For example, if the selection key 244 is a virtual key, the text selection event may be a user clicking the virtual key (i.e., the selection key 244) once.

In some embodiments, the selection key 243 corresponding to the barcode scanning function and the selection key 244 corresponding to the optical character recognition function may both be physical keys of the mobile device 10 (e.g., any two of the multiple physical keys 21 of the mobile device 10), or both may be virtual keys on the second overlay window 240 (as shown in FIG. 6 ), or one may be a physical key of the mobile device 10 (e.g., at least one of the physical keys 21) and the other may be a virtual key on the second overlay window 240.

After step S141, the mobile device 10 can detect at least one character using the text recognition input method to obtain at least one character string (hereinafter referred to as the second character string, step S142).

Please refer to FIG. 4 and FIG. 13 to FIG. 17 . In some embodiments of step S142 , the general camera module 100 captures at least one word to obtain at least one word string image 41, 42 of the at least one word and another preview screen 247 having at least one word string image 41, 42 (step S142a, as shown in FIG. 15 and FIG. 16 ). Then, the control module 140 of the mobile device 10 controls the touch display module 130 to preview and display another preview screen 247 in the preview pane 242 in real time (step S142b, as shown in FIG. 15 and FIG. 16 ). Subsequently, the mobile device 10 uses the text recognition engine 150 to recognize and convert at least one string image 41, 42 into at least one second string (step S142c, as shown in Figures 15 and 17).

Finally, the control module 140 controls the touch display module 130 to display any second string ST2 of the at least one second string in the input field 210 (step S144, as shown in FIG. 17 ). For example, taking two string images 41 and 42 as examples, in step S142c, the second string ST2 converted by the string image 41 is "Hello", and the second string converted by the string image 42 is "world". And, in step S144, the second string ST2 of "Hello" is displayed in the input field 210.

In some embodiments, when the at least one second string obtained in step S142c is plural, after step S142c and before step S144, the control module 140 can control the touch display module 130 to display the plural second strings as input options of the input field 210 in the candidate field (step S143, not shown). After the user clicks, the touch display module 130 displays the second string ST2 selected by the user in the input field 210 (step S144, as shown in Figures 14 and 17).

Please refer to FIG. 1 , FIG. 4 , FIG. 13 and FIG. 18 , in some embodiments, after step S120 , the control module 140 controls the touch display module 130 to switch the displayed second overlay window 240 back to the first overlay window 220 in response to the first trigger event occurring again (step S160 , as shown in FIG. 5 and FIG. 18 ). For example, continuing the previous example, taking pressing once as the first trigger event as an example, when the second overlay window 240 is displayed on the display screen 200 (as shown in FIG. 6 , FIG. 9 , FIG. 10 , FIG. 12 , FIG. 16 and FIG. 17 ), and the user presses the trigger element 30 once again, the control module 140 can switch the displayed second overlay window 240 back to the first overlay window 220 (as shown in FIG. 5 ). It should be clear that FIG. 18 shows that step S160 is executed immediately after step S120, but this order is not a limitation of the present invention. Under reasonable circumstances, step S160 is executed before or after any step after step S120 (for example, any one of steps S131~S134, S141~S144).

Please refer to FIG. 1, FIG. 4, FIG. 13, FIG. 19 and FIG. 20. In some embodiments, after step S110, the control module 140 controls the trigger display module 130 to display a setting window 250 of the image conversion input method in response to a second trigger event of the trigger element 30 (step S170, as shown in FIG. 19 and FIG. 20). It should be clear that FIG. 19 shows that step S170 is executed immediately after step S110, but this order is not a limitation of the present invention. Under reasonable circumstances, step S170 is executed before or after any step after step S110 (for example, any one of steps S120, S131~S134, S141~S144, and S160).

In some embodiments, the first trigger event and the second trigger event are different trigger events. In some embodiments, the first trigger event is a short press, and the second trigger event is a long press. For example, a short press is, but not limited to, a single press or a press for 1 second and then release, and a long press is, for example, a press for more than 3 seconds, but not limited to this.

In some embodiments, the mobile device 10 can adjust various functions of the image conversion input method and its preview pane 242 through the setting window 250.

Please refer to FIG. 20 . In some embodiments, the setting window 250 has a plurality of virtual buttons BT. Each virtual button BT has a corresponding setting or function. For example, the function button BT1 is used to adjust the detailed settings of functions such as OCR, QR code scanning and barcode scanning (e.g., the automatic/manual function setting of barcode scanning). The window button BT2 is used to set the size and position of the preview pane 242. The notice button BT3 is used to set the switch of the sound notification and/or the switch of the vibration notification when the recognition or scanning is successful. The prefix/suffix button BT5 is used to set the switch of adding prefix/suffix strings before and after at least one first string. The auto return button BT4 is used to set the switch of automatically or manually hiding the preview pane 242 after scanning or recognition is successful. The other button BT6 is used to execute other detailed settings related to the preview pane 242 (such as appearance settings such as language or background). In other words, any functions related to the image conversion input method and its custom keyboard 241 and preview pane 242 (such as the type of the custom keyboard 241 mentioned above) can be customized by providing setting buttons, options or any combination thereof in the setting window 250 for the user to set.

1, 4, 6, 13, 21 and 22, in some embodiments, the overlay window 240 may include a zoom key 248. After step S120, the control module 140 controls the touch display module 130 to zoom in and display the preview pane 242 in response to a zoom trigger event of the zoom key 248 (e.g., the zoom key 248 is pressed or clicked) (step S180, as shown in FIG. 21). It should be clear that FIG. 21 shows that step S180 is executed immediately after step S120, but this order is not a limitation of the present invention. Under reasonable circumstances, step S180 is executed before or after any step after step S120 (for example, any one of S131~S134, S141~S144).

In some embodiments of step S180, the control module 140 can control the touch display module 130 to enlarge and display the preview pane 242 in response to the enlargement trigger event of the enlargement key 248. In some embodiments, the second overlay window 240 has a first size, the preview pane 242 before enlargement has a second size, and the preview pane 242 after enlargement has a third size. Here, the second size is smaller than the first size, and the third size is larger than the second size and smaller than or equal to the first size. In some embodiments, the second size and/or the third size of the preview pane 242 can be set through the setting window 250 of the image conversion input method. For example, the third size of the preview pane 242 is substantially equal to the first size of the second overlay window 240 (as shown in Figure 22). In other words, in some embodiments, the second overlay window 240 may only have a preview pane 242 without a custom keyboard 241. The user may use the setting window 250 of the image conversion input method to set the second overlay window 240 to have a parallel custom keyboard 241 and a preview pane 242 (as shown in FIG. 6 ), or to set the second overlay window 240 to have only a preview pane 242 (as shown in FIG. 22 ).

In some embodiments, the trigger element 30 is a physical key. Please refer to Figures 1, 4, 13 to 15, 23 and 24. In some embodiments, the trigger element 30 can be one of at least one physical key 21 located on the body of the mobile device 10 (i.e., embedded on the housing 20) (hereinafter referred to as the physical key 21), and the physical key 21 is electrically connected to the control module 140 (as shown in Figure 2).

In some embodiments of step S110, the control module 140 enables an input method switching function of the physical key 21 (i.e., activates the trigger element 30 of the image conversion input method via the input field 210) in response to the input trigger event of the input field 210 (step S110a), and controls the touch display module 130 to simultaneously display the input field 210 and the first overlay window 220 on the display screen (step S110b). After step S110b, the control module 140 of the mobile device 10 receives a switching signal from the physical key 21 via wire (step S110c), and switches the first overlay window 220 displayed on the display screen 200 to the second overlay window 240 in response to the switching signal (step S120a). It should be clear that FIG. 23 shows that steps S110 and S120a are executed immediately after step S100, but this order is not a limitation of the present invention. Under reasonable circumstances, steps S110 and S120a may be executed before or after any step after step S100 (for example, any one of steps S131 to S134, S141 to S144).

In some embodiments of step S110a, when the input field 210 is clicked (i.e., the input trigger event occurs) and the cursor 211 appears therein, the input field 210 generates an activation signal to notify the control module 140 of the input trigger event. The control module 140 enables the input method switching function of the predetermined physical key 21 in response to the received activation signal. In other words, before the physical key 21 enables the input method switching function, any pressing or clicking event (i.e., the first triggering event) on the physical key 21 will not cause the control module 140 to control the touch display module 130 to display the input field 210 and the first overlay window 220 on the display screen at the same time, and the touch display module 130 keeps displaying the first overlay window 220 on the display screen 200.

In other embodiments, the trigger element 30 may be a physical button located on a peripheral component of the mobile device 10 body (i.e., embedded in a component that is separate from the body but matches the body, such as embedded in a housing of a control element).

Please refer to Figures 1, 4, 13 to 15, 25 and 26. In some embodiments, the mobile device 10 further includes a communication module 160 and a control element 50 (as shown in Figures 1 and 25), and the trigger element 30 is a physical button 51 on the control element 50. The communication module 160 is electrically connected to the control module 140, and the control element 50 is wirelessly connected to the communication module 160. In some embodiments, the communication module 160 is disposed inside the housing 20 of the mobile device 10 (not shown in Figure 25).

In some embodiments of step S110, the control module 140 enables an input method switching function of the physical key 51 in response to the input trigger event to activate the trigger element 30 of the image conversion input method (step S110a), and controls the touch display module 130 to simultaneously display the input field 210 and the first overlay window 220 on the display screen (step S110b). After step S110b, the communication module 160 of the mobile device 10 wirelessly receives a switching signal from the physical key 51 on the control element 50 (step S110d), and transmits the switching signal to the control module 140. Subsequently, the control module 140 of the mobile device 10 switches the first overlay window 220 displayed on the display screen 200 to the second overlay window 240 in response to the switching signal (step S120a). It should be clear that FIG. 26 shows that steps S110 and S120a are executed immediately after step S100, but this sequence is not a limitation of the present invention. Under reasonable circumstances, steps S110 and S120a are executed before or after any step after step S100 (for example, any one of steps S131~S134, S141~S144).

In some embodiments, the user can control the control element 50 to generate the switching signal through any switching trigger event. The switching trigger event is, for example, pressing the physical button 51 or long pressing the physical button 51, etc., but is not limited thereto. In some embodiments, the user can set the switching trigger event in the setting window 250.

In some embodiments, the trigger element 30 is a designated gesture, and the control module 140 activates the trigger element 30 by enabling a gesture detection input function of the designated gesture.

1 to 7, 13 to 15 and 27, in some embodiments, after step S110, the control module 140 may detect a designated gesture received by the touch display module 130 (step S120b). When the control module 140 detects the designated gesture, the control module 140 controls the touch display module 130 to switch the first overlay window 220 displayed on the display screen 200 to the second overlay window 240 (step S120c). It should be clear that FIG. 27 shows that step S120 is executed immediately after step S110, but this order is not a limitation of the present invention. Under reasonable circumstances, step S120 is executed before or after any step after step S110 (for example, any one of steps S131~S134, S141~S144).

In some embodiments, the designated gesture is a gesture action performed by the user on the touch display module 130 of the mobile device 10, such as but not limited to single click, double click, drag, flick, swipe, zoom in, zoom out, or any combination thereof. In some embodiments, the user can set the designated gesture in the setting window 250.

In some embodiments, the control module 140 can simultaneously activate multiple trigger elements 30 of different types, such as the virtual key 230 shown in FIG5, the physical key 21 at the near end shown in FIG24, the physical key 51 at the far end shown in FIG25, and the specified gesture (not shown). In other embodiments, the control module 140 can only activate a single type of trigger element 30, such as the virtual key 230 shown in FIG5, the physical key 21 at the near end shown in FIG24, the physical key 51 at the far end shown in FIG25, or one of the specified gestures (not shown).

In some embodiments, the general camera module 100 and the dedicated camera module 110 may be photosensitive elements for sensing images (including barcode images and string images) and converting the images into electronic signals, such as but not limited to charge-coupled devices (CCD) or complementary metal oxide semiconductor sensors (CMOS sensors).

In some embodiments, the barcode decoding module 120 and the text recognition engine 150 may be hardware components with computing functions, such as but not limited to a microprocessor, a graphics processing unit (GPU), an embedded controller, or a microcontroller unit (MCU).

In some embodiments, the barcode decoding module 120 converts at least one barcode image into at least one first string according to data in a database built into the mobile device 10, and the text recognition engine 150 converts at least one string image into at least one second string according to data in a database built into the mobile device 10.

In some embodiments, the mobile device 10 is coupled to a cloud database by wireless communication via the communication module 160. The barcode decoding module 120 converts at least one barcode image into at least one first string based on the data in the cloud database, and the text recognition engine 150 converts at least one string image into at least one second string based on the data in the cloud database.

In some embodiments, the touch display module 130 may be a display device with a touch function, such as but not limited to a resistive touch panel, a capacitive touch panel, an infrared touch panel, an optical touch panel, or a surface acoustic wave touch panel, etc.

In some embodiments, the control module 140 may be a hardware component having a logic processing function, such as but not limited to a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a complex programmable logic device (CPLD), a field programmable gate array (FPGA), an application specific integrated circuit (ASIC) or a microcontroller unit, etc.

In some embodiments, the barcode decoding module 120, the control module 140 and the text recognition engine 150 can be three hardware components with signal processing functions.

In other embodiments, the dedicated camera module 110 and the barcode decoding module 120 can be integrated into an independent hardware component, namely a barcode engine (also known as a barcode scanning module). The control module 140 and the text recognition engine 150 are implemented by a single hardware component with signal processing function.

In some other embodiments, the barcode decoding module 120, the control module 140 and the text recognition engine 150 can be implemented by a single hardware component with signal processing function.

In some embodiments, the communication module 160 may be a chip or circuit with wireless communication function, such as but not limited to a wireless network (Wi-Fi) chip, a Bluetooth chip, or an infrared chip, etc.

In some embodiments, the control element 50 may be a control device having a physical button 51 and a wireless communication function, such as but not limited to a stylus, a presentation pen, a remote control, a wireless mouse or a wireless keyboard, etc.

In summary, according to any embodiment, the mobile device or its input method switching method has both a system default input method and an image conversion input method to provide multiple input functions. In this way, when a user inputs text in any input field, he or she can select an appropriate input method to perform input operations (such as but not limited to Chinese and English input, barcode scanning input or OCR input, etc.), thereby improving the convenience and efficiency of text input.

Although this case has been disclosed as an embodiment, it is not intended to limit the invention of this case. Anyone with ordinary knowledge in the relevant technical field can make some modifications and changes within the spirit and scope of the disclosed content, but such modifications and changes are still within the scope of the patent application of this case.

S100~S120: Steps

Claims (25)

A mobile device, comprising: a general camera module; a dedicated camera module; a barcode decoding module, electrically connected to the dedicated camera module, for capturing at least one barcode image through the dedicated camera module, and converting the at least one barcode image into at least one first string, wherein each barcode image is generated by the dedicated camera module photographing at least one barcode; a touch display module, for displaying a display screen, wherein the display screen has an input field; and A control module is electrically connected to the general camera module, the barcode decoding module and the touch display module, and is used to respond to an input trigger event of the input field to activate a trigger element of an image conversion input method, control the touch display module to simultaneously display the input field and a first overlay window composed of a virtual keyboard of a system default input method on the display screen, and respond to a first trigger event of the trigger element to control the touch display module to switch the displayed first overlay window to a second overlay window, wherein the second overlay window has a custom keyboard and a preview pane of the image conversion input method in parallel. A mobile device as described in claim 1, wherein the trigger element is a virtual key, and the control module activates the trigger element by controlling the touch display module to simultaneously display the first overlay window and the virtual key on the display screen. The mobile device as described in claim 1 further includes a housing, the general camera module, the dedicated camera module and the touch display module are embedded in the housing, the barcode decoding module and the control module are arranged in the housing, the trigger element is a physical key, the physical key is embedded in the housing and electrically connected to the control module, and the control module activates the trigger element by enabling an input method switching function of the physical key, and the first trigger event is a switching signal generated by the physical key. The mobile device as described in claim 1 further comprises: a communication module electrically connected to the control module; and a control element wirelessly connected to the communication module, wherein the trigger element is a physical key on the control element, the control module activates the trigger element by enabling an input method switching function of the physical key, and the first trigger event is a switching signal generated by the trigger element. In the mobile device as described in claim 1, the trigger element is a designated gesture, and the control module activates the trigger element by enabling a gesture detection input function of the designated gesture. A mobile device as described in claim 1, wherein the control module is further configured to control the touch display module to switch the displayed second overlay window back to the first overlay window in response to the first trigger event occurring again. The mobile device as described in claim 1, wherein the control module is further used to control the touch display module to display a setting screen of the image conversion input method in response to a second trigger event of the trigger element. The mobile device as described in claim 1 further includes at least one selection key, wherein the dedicated camera module is used to capture a preview screen having the at least one barcode image, and the control module is used to activate the barcode decoding module in response to a barcode selection trigger event of the at least one selection key, and after activating the barcode decoding module, the preview screen is displayed in real time in the preview pane and one of the at least one first string is displayed in the input field. A mobile device as described in claim 8, wherein the at least one barcode image is plural, the second overlay window further has a candidate field, the candidate field is above the virtual keyboard and the preview pane, and the control module is further used to display the at least one first string as an input option of the input field in the candidate field after activating the barcode decoding module. The mobile device as described in claim 8 further comprises: A text recognition engine, disposed between the general camera module and the control module, for capturing at least one string image and another preview screen having the at least one string image through the general camera module, and recognizing and converting each string image into at least one second string, wherein each string image is generated by the general camera module by photographing at least one text. A mobile device as described in claim 10, wherein the control module is further used to activate the text recognition engine in response to a text selection trigger event of the at least one selection key, and after activating the text conversion engine, the other preview screen is displayed in the preview pane in real time and one of the second strings is displayed in the input field. The mobile device as described in claim 1, wherein the second overlapping window further includes a magnification key, and the control module is further used to control the touch display module to magnify and display the preview pane in response to a magnification trigger event of the magnification key. A method for switching input methods of a mobile device comprises: Displaying an input field on a display screen; Activating a trigger element of an image conversion input method via the input field, and controlling a touch display module to simultaneously display the input field and a first overlay window on the display screen, wherein the first overlay window is composed of a virtual keyboard of a system default input method; and In response to a first trigger event of the trigger element, the first overlay window displayed on the display screen is switched to a second overlay window, wherein the second overlay window has a customized keyboard of an image conversion input method and a preview pane in parallel, and the preview pane is linked to a general camera module or a dedicated camera module. The switching method as described in claim 13, wherein the trigger element is a virtual key, and the simultaneous display step includes: Simultaneously displaying the input field, the virtual key, and the first overlay window consisting of the virtual keyboard of the system default input method on the display screen. The switching method as described in claim 13, wherein the trigger element is a physical key, the first trigger event is a switching signal generated by the physical key, and the activation step of the trigger element includes: Enabling an input method switching function of the physical key to activate the trigger element. The switching method as described in claim 15, wherein the switching method further comprises: receiving the switching signal from the physical key via wire; and switching the first overlay window displayed on the display screen to the second overlay window in response to the switching signal. The switching method as described in claim 15, wherein the switching method further comprises: wirelessly receiving the switching signal from the physical key; and switching the first overlay window displayed on the display screen to the second overlay window in response to the switching signal. The switching method as described in claim 13, wherein the triggering element is a designated gesture, and the switching method further comprises: Detecting the designated gesture; and Switching the first overlay window displayed on the display screen to the second overlay window when the designated gesture is detected. The switching method as described in claim 13 further includes: In response to the first trigger event occurring again, the second overlay window displayed on the display screen is switched back to the first overlay window. The switching method as described in claim 13 further includes: Displaying a setting screen of the image conversion input method in response to a second trigger event of the trigger element. The switching method as described in claim 13, wherein the image conversion input method includes a barcode scanning input method, and the switching method further includes: Activating the barcode scanning input method in response to a barcode selection trigger event; Utilizing the barcode scanning input method to scan at least one barcode to obtain at least one first string, wherein the activation step of the barcode scanning input method includes: Utilizing the dedicated camera module to photograph the at least one barcode to obtain at least one barcode image of the at least one barcode; and Utilizing a barcode decoding module to decode the at least one barcode image into the at least one first string; and Displaying one of the at least one first string in the input field. The switching method as described in claim 21, wherein the shooting step of the dedicated camera module also obtains a preview screen having the at least one barcode image, and the scanning step using the barcode scanning input method further includes: Previewing and displaying the preview screen in the preview pane. The switching method as described in claim 21, wherein the at least one barcode image is plural, the second overlay window further has a candidate field, the candidate field is above the virtual keyboard and the preview pane, and the switching method further comprises: Displaying the at least one first string as an input option of the input field in the candidate field. The switching method as described in claim 21, wherein the image conversion input method includes a text recognition input method, the mobile device further includes a text recognition engine, and the switching method further includes: Activating the text recognition input method in response to a text selection trigger event; Detecting at least one text using the text recognition input method to obtain at least one second string, wherein the activation step of the text recognition input method includes: Photographing the at least one text by the general camera module to obtain at least one string image of the at least one text and another preview screen having the at least one string image; Previewing and displaying the other preview screen in the preview pane; and Recognizing and converting the at least one string image into the at least one second string using the text recognition engine; and Display one of the at least one second string in the input field. The switching method as described in claim 13, wherein the second overlapping window further includes a magnification key, and the switching method further includes: In response to a magnification trigger event of the magnification key, the preview pane is magnified and displayed.

Images