[go: up one dir, main page]

WO2015163500A1 - Système d'ensemble de dispositifs électroniques comprenant un dispositif d'entrée assistée et dispositif électronique de traitement d'entrée l'utilisant - Google Patents

Système d'ensemble de dispositifs électroniques comprenant un dispositif d'entrée assistée et dispositif électronique de traitement d'entrée l'utilisant Download PDF

Info

Publication number
WO2015163500A1
WO2015163500A1 PCT/KR2014/003624 KR2014003624W WO2015163500A1 WO 2015163500 A1 WO2015163500 A1 WO 2015163500A1 KR 2014003624 W KR2014003624 W KR 2014003624W WO 2015163500 A1 WO2015163500 A1 WO 2015163500A1
Authority
WO
WIPO (PCT)
Prior art keywords
input
gesture
electronic device
input unit
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2014/003624
Other languages
English (en)
Korean (ko)
Inventor
손동현
조한울참
이호찬
우수지
장수진
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to KR1020167031030A priority Critical patent/KR20160148567A/ko
Priority to PCT/KR2014/003624 priority patent/WO2015163500A1/fr
Publication of WO2015163500A1 publication Critical patent/WO2015163500A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/018—Input/output arrangements for oriental characters
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/0202—Constructional details or processes of manufacture of the input device
    • G06F3/0219—Special purpose keyboards
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233—Character input methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons
    • G09B21/003—Teaching or communicating with blind persons using tactile presentation of the information, e.g. Braille displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality

Definitions

  • the present invention relates to an electronic device set device including an input auxiliary device and an interface for processing an input of the input auxiliary device.
  • a smartphone comprising a smartphone cover (Cover) and an interface for processing the input of the smartphone cover.
  • the display screen of a smartphone is made of glass and can be easily broken when falling on the floor or colliding with another object.
  • a smartphone cover (Cover) has appeared to protect the glass of the smartphone.
  • the smart phone cover can make a variety of products by changing the color, material and shape at a lower cost than the smart phone.
  • the expensive smartphone appearance which can be monotonous, can be easily changed by using the smartphone cover.
  • the smart phone cover may add a business card or a card as an additional function. With the recent increase in the use of smartphone covers, the demand for such additional functions is increasing.
  • An object of the present invention is to provide an input auxiliary device that helps to make a gesture input and a sign input without seeing.
  • An object of the present invention is to provide an electronic device including an interface for processing a gesture input, a motion input, or a sign input.
  • the present invention has been made in an effort to provide an electronic device set device including an input auxiliary device capable of operating without seeing and an electronic device for processing the input.
  • an electronic device set device includes an input auxiliary device including a gesture input unit for gesture input and a code input unit for sign input, and a gesture input for receiving the gesture input.
  • An electronic device includes a receiver and a code input receiver to receive the code input.
  • the electronic device is a smart phone or a game machine or a remote control or a calculator or a tablet PC.
  • the sign input unit includes a braille input unit for braille input.
  • the braille input unit may include a rubber material or a sponge material including a silicon material or a rubber material or a metal.
  • the sign input unit may include a Korean input unit for Korean input, a numeric input unit for numeric input, or an English input unit for English input.
  • the Hangul input unit or the numeric input unit or the English input unit may include a rubber material or a sponge material including a silicon material or a rubber material or a metal.
  • the electronic device includes a touch display unit including the input receiver and a voice output unit for notifying the gesture input or the code input.
  • the gesture input selects an upper menu according to a horizontal gesture, and selects a lower menu according to a vertical touch.
  • the upper menu is a message related menu, a weather guidance menu, a current time menu, a location information menu, a current date menu, a calculator menu, or a telephone related menu.
  • the lower menu is a message transmission menu or a message storage menu according to the selection of the upper message related menu.
  • the electronic device may include a braille / character converter for converting the braille input into Korean, English, Japanese, German, Chinese, Spanish, Portuguese, Russian, Hebrew, or Hindi characters.
  • the braille / character conversion unit converts by referring to a hash table.
  • a material of the gesture input unit and a material of the code input unit are the same.
  • an input assistance device includes a gesture input unit for gesture input and a sign input unit for sign input, and the gesture input unit and the sign input unit are located at different positions. Position it.
  • the input assistance device is a smartphone cover.
  • the sign input unit includes a braille input unit for braille input.
  • the braille input unit may include a rubber material or a sponge material including a silicon material or rubber or metal.
  • the sign input unit may include a Korean input unit for Korean input, a numeric input unit for numeric input, or an English input unit for English input.
  • the Hangul input unit or the numeric input unit or the English input unit may include a rubber material or a sponge material including a silicon material or a rubber material or a metal.
  • a smart phone cover includes a braille input unit including at least six braille input buttons or holes in different positions for braille input.
  • the apparatus further includes a sign input unit including at least one sign input button or hole for sign input.
  • an electronic device includes a touch display unit having a gesture input receiving unit for receiving a gesture input and a code input receiving unit for receiving a code input, and including the gesture input receiving unit;
  • the sign input receiver is positioned at different positions of the touch display unit.
  • the electronic device is a smartphone or a game machine or a remote controller or a calculator or tablet PC.
  • the electronic device further includes a voice output unit for notifying the gesture input and the code input by voice.
  • the gesture input selects an upper menu according to a horizontal gesture, and selects a lower menu according to a vertical gesture.
  • the upper menu is a message related menu, a weather guidance menu, a current time menu, a location information menu, a current date menu, a calculator menu, or a telephone related menu.
  • the message transmission menu or the message storage menu is selected according to the selection of the upper message transmission menu.
  • the electronic device further includes a braille / character converter for converting the braille input into Korean, English, Japanese, German, Chinese, Spanish, Portuguese, Russian, Hebrew, or Hindi characters. .
  • the braille / character converting apparatus converts with reference to a hash table.
  • an electronic device includes a motion sensor that selects an upper menu according to a horizontal motion, and selects a lower menu according to a vertical motion operation.
  • the electronic device is a smartphone or a game machine or a remote controller or a calculator or tablet PC.
  • the motion sensor selects the upper menu according to the vertical motion, and selects the lower menu in the horizontal motion.
  • 1 is an electronic device set device according to an embodiment of the present invention.
  • FIG 2 is an electronic device set device for braille input according to an embodiment of the present invention.
  • 3A illustrates an electronic device set device for smartphone keyboard input according to an embodiment of the present invention.
  • 3B illustrates an electronic device set device for inputting a Qwerty keyboard according to an embodiment of the present invention.
  • 4A to 4F are various input auxiliary devices according to an embodiment of the present invention.
  • 5A to 5B are cross-sectional views of an input auxiliary device for braille input according to an embodiment of the present invention.
  • 6A and 6B are electronic devices illustrating a gesture input according to an embodiment of the present invention.
  • FIG. 7 is a conceptual diagram illustrating horizontal and vertical menu selection according to an embodiment of the present invention.
  • FIG 8 is another conceptual diagram illustrating horizontal and vertical menu selection according to an embodiment of the present invention.
  • FIG 9 is another conceptual diagram illustrating horizontal and vertical menu selection according to an embodiment of the present invention.
  • FIG. 10 is a table showing a shortcut gesture input according to an embodiment of the present invention.
  • 11A through 11B are electronic devices illustrating a motion input according to an embodiment of the present invention.
  • 12A is a tablet PC showing a gesture input in accordance with one embodiment of the present invention.
  • 12B is a tablet PC showing a motion input according to one embodiment of the invention.
  • 13A to 13B are remote controllers showing a gesture input and a motion input according to an embodiment of the present invention.
  • FIG. 14 is a conceptual diagram of processing a gesture input and a sign input according to an embodiment of the present invention.
  • 15 is a hash table for Hangul conversion of Braille according to an embodiment of the present invention.
  • 16 is a flowchart illustrating an electronic device operating method for selecting a horizontal and vertical menu according to an embodiment of the present invention.
  • 17 is a flowchart illustrating an electronic device operating method for booting according to an embodiment of the present invention.
  • FIG. 18 is a flowchart illustrating an electronic device operating method for converting braille input according to an embodiment of the present invention.
  • 19 is a method of operating an electronic device for selecting a phone number according to an embodiment of the present invention.
  • 20A to 20B illustrate an electronic device set device for a game according to an embodiment of the present invention.
  • 21 is a flowchart illustrating a method of manufacturing an input auxiliary device according to an embodiment of the present invention.
  • the present invention relates to an electronic device set device including an input auxiliary device and an electronic device for processing an input using the same.
  • the electronic device set device 10 includes an input auxiliary device 100 and an electronic device 200.
  • the input assistance device 100 may be a smartphone cover, and the electronic device 200 may be a smartphone.
  • the input assistance device 100 includes a gesture input unit 110 and a sign input unit 120.
  • the gesture input 110 and the sign input unit 120 are located in the input auxiliary device 100 so as not to overlap each other.
  • the input assistance device 100 includes a home button input unit 195 for inputting a home button 295 of the smart phone 200.
  • the home button may be made of a hole.
  • the code input unit 120 may be included.
  • the input auxiliary device 100 may include a motion input sensor hole 194 for inputting a motion motion, a voice output hole 190 for transmitting an output voice, and an image sensor hole 191 for taking a photo; It includes an illuminance sensor hole 192 for detecting the brightness of the light and a temperature sensor hole 193 for detecting the temperature.
  • the electronic device 200 includes a gesture input receiver 210 and a sign input receiver 220. The gesture input receiver 210 and the sign input receiver 220 are located in the electronic device 200 so as not to overlap each other.
  • the electronic device 200 includes a home button 295, a motion sensor 294, a speaker 290, an image sensor 291, an illuminance sensor 292, a temperature sensor 293, and a touch display unit 235. do.
  • the input auxiliary device 100 and the electronic device 200 are connected by the connection unit 150.
  • the connection unit 150 may include an electrical material or a circuit line to electrically connect the electronic device 200 and the sign input unit 120 of the input auxiliary device 100.
  • the gesture input unit 110 and the gesture input receiver 210 are located at the same position, and the code input unit 120 and the code input unit are provided.
  • the receiver 220 is also located at the same position.
  • the gesture input unit 110 may include a rubber or sponge material including a hole or a silicon material or a rubber material or a metallic material.
  • the materials are materials that facilitate the gesture input, and are not limited to the materials, and may include all materials capable of touch input.
  • the sign input unit 120 of the input assistance device 100 includes six braille input units 124, 125, 126, 127, 128, and 129 for braille input and function input units 121, 122, 123, 130, and 131 for function input. .
  • the home button may also be included in the sign input unit 120.
  • the braille input button 124 and the function input unit 121 includes a braille 133 so that the visually impaired person can easily know the meaning and location of the input units.
  • the electronic device 200 includes a sign input receiver 220.
  • the sign input receiver 220 includes six braille input receivers 224, 225, 226, 227, 228, and 229 and function input receivers 221, 222, 223, 230, and 231.
  • the braille input receivers 221, 222, 223, 230, and 231 may each have a circular shape.
  • the function input receivers 221, 222, 223, 230, and 231 are deleted with an English-Korean numeral input receiver 221, a double vowel input receiver 222, and a rewrite input receiver 223 for inputting English, Korean, and numbers.
  • the input receiver 230 and the confirmation input receiver 231 may be included in the shape of a quadrangle.
  • the braille input units 124, 125, 126, 127, 128, 129 and the braille input receivers 221, 222, 223, 230 and 231 are located at the same position.
  • the input assistance device 101 includes a gesture input unit 110 and a sign input unit 140.
  • the code input unit 140 includes smartphone keyboard input units 141 for inputting letters, numbers, and symbols of the smartphone.
  • the electronic device 201 includes a sign input receiver 240 including a gesture input receiver 210 and smartphone keyboard input receivers 241, and is located at different positions of the touch display unit 235.
  • the smartphone keyboard input unit 141 of the code input unit 140 is superimposed on the electronic device 201, the smartphone keyboard input receivers 141 of the electronic device 201 are input. It is located almost identically to the location.
  • the smartphone keyboard input result is also output as voice.
  • the visually impaired person can know what type of keyboard he / she has typed and immediately enter it.
  • the electronic device 201 may be used without using the input auxiliary device 101.
  • the sign input unit 150 of the input assistance device 102 includes Qwerty keyboard input units 151.
  • the sign input receiver 250 of the electronic device 202 includes QWERTY keyboard input receivers 251.
  • 4A illustrates that the input assistance device 103 includes a gesture input unit, a menu selection input unit, and a braille input unit, and are located at different positions.
  • the gesture input unit is located above the auxiliary input device 103, and the menu selection input unit is positioned between the gesture input unit and the braille input unit.
  • the menu selection input includes settings, weather, calculator, radio, music, phone, current location, internet and clock menus.
  • the braille input unit includes six braille input units, a clock input unit and a confirmation input unit.
  • the braille input unit is positioned between the gesture input unit and the menu selection input unit.
  • the input assistance device 105 includes a first menu selection input unit, a braille input unit, and a second menu selection input unit.
  • the braille input unit is positioned between the first menu selection input unit and the second menu selection input unit.
  • the input assistance device 106 includes a braille input unit, a menu selection input unit, and a gesture input unit.
  • the braille input unit of the input assistance device 100 is located above, and in the order of the menu selection input unit and the gesture input unit below.
  • the braille input unit includes braille input units, and each braille input unit has a display for knowing each meaning. For example, braille can be used for blind people.
  • the input assistance device 107 includes a first braille input unit, a second braille input unit, and a menu selection input unit.
  • the first braille input unit includes three braille input units
  • the second braille input unit includes three braille input units different from the first braille input unit.
  • the menu selection input unit is located between the first braille input unit and the second braille input unit.
  • the input auxiliary device set 13 includes an input auxiliary device 108 and an electronic device auxiliary device 108-1.
  • the input assistance device 108 includes a menu selection input unit, a braille input unit, and a gesture input unit for gesture input.
  • the electronic device assisting device 108-1 may include concave or convex guides 108-2. It helps to know the sign input position when inputting electronic equipment. For example, when an input for driving a calculator is displayed on the touch display unit of the electronic device, the finger holding the electronic device is positioned in the concave or convex guides, and the electronic device is used to feel the finger. You can see the calculator input position of the hand that is not held.
  • FIG. 5A is a view of FIG. 2 rotated 90 degrees to the left.
  • 5B is a cross-sectional view of A to B of the input auxiliary device 100 of FIG.
  • the cross-sectional view of the input assisting device 100 shows a front side F and a rear side R, and shows cross sections of the braille input units 127, 128, and 129.
  • the braille input unit 127 includes Brailles 127-1 and 127-2 to know the location and location of the braille input button.
  • the braille input unit 127 includes a conductive material. Also, it may include a rubber material or a sponge material or a plastic material including a silicon material or a rubber material or a conductive material.
  • the gesture input unit 110 of the input assistance device may include an empty space or a thin transparent plastic material 111.
  • the braille input unit 127, 128, 129 may include the same material as the material included.
  • the thickness A of the disc 135 of the input auxiliary device 100 may be 2 mm or less as the thickness between the front surface F and the front surface R.
  • the thickness B is the length from the front surface F of the input auxiliary device 100 to the braille that protrudes longest.
  • the thickness C is the length from the surface of the braille inputs 127, 128, 129 to the longest protruding braille.
  • the thickness B may be larger than the thickness A in order to identify the braille input units 127, 128, and 129 using only a feeling of a finger.
  • the cross section of the input interpolation device 100 includes an input auxiliary device disc 135, a gesture input unit 110, and Braille input units 127, 128, and 19.
  • the gesture input unit 110 may include a conductive material including a metal for gesture input. Also, it may include a rubber material or a sponge material or a plastic material including a silicon material or a rubber material or a conductive material.
  • the thickness A is the thickness of the input auxiliary device disc 135.
  • the thickness D is the length from the rear surface R of the input auxiliary device to the longest protruding braille of the braille input units 127, 128, 129.
  • the thickness A and the thickness D may be equal to or smaller than when the braille input unit is formed into a groove. Instead of the braille, you can make various protrusions such as squares, asterisks, and triangles.
  • the difference between the thickness B and the thickness A may be 1 mm or less.
  • the material of the gesture input unit 110 and the material of the code input units 127a, 128a, and 129a may be formed of the same material.
  • the gesture input unit 110 and the code input units 127a, 128a, and 129a may transmit an input to an electronic device by a touch, and operate by a “TAP” gesture.
  • the electronic device 201 includes a gesture input receiver 210 and a code input receiver 240 including a smart phone key input unit.
  • the gesture input receiver 210 may receive a horizontal gesture input and a vertical gesture input.
  • the horizontal gesture input may be performed by contacting the finger or the object with electricity in the horizontal direction with the gesture input receiver and dragging the contact after a certain time.
  • the electronic device 200 includes a sign input receiver 240 including a gesture input receiver 210 and a braille input receiver.
  • the touch input receiver 210 may receive a horizontal gesture input and a vertical gesture input.
  • the upper and lower menus are selected through horizontal and vertical gesture inputs of the touch input unit 210 of the electronic device 201 of FIG. 6A and the electronic device 200 of FIG. 6B. Shows that One of the upper menus 1-0, 2-0, 3-0, 4-0, 5-0, 6-0 is selected by the horizontal gesture input. If the horizontal gesture is input from the right menu to the left side in the upper menu 5-0, the user moves to the upper menu 6-0, and if the horizontal gesture is input again from the right to the left side, the upper menu 1-0 can be selected. After selecting the upper menu 2-0, the lower menus 2-1, 2-2, and 2-3 can be selected by the vertical gesture input.
  • the lower menu 2-1 is selected.
  • Menu 2-2 If it repeats again, it moves to the upper menu 2-0.
  • the upper menu and the lower menu may be displayed on the gesture input receiver 210 on the touch display of the electronic device 200.
  • the menu moves directly to the upper menu 3-0 (A, B). can do.
  • the upper menu can be selected by the vertical gesture input
  • the lower menu can be selected by the horizontal gesture input.
  • the top menu includes directions, music, calculator, phone, current time, messages, weather, my location, internet, calendar, and app selection.
  • the upper menu may further include a setting menu and a radio menu for setting the electronic device.
  • the upper menu may be selected by a horizontal gesture input. After selecting a message menu, which is an upper menu, a message transmission, a message reading, a message storing, and a message searching menu, which are lower menus, may be selected by the horizontal gesture input. After selecting a message transmission, one of the lower menus, a horizontal gesture is input from right to left or from left to right to directly move to the current menu or the weather menu.
  • the upper menus and the lower menus may be displayed in all or part of the gesture input receiver 210 of the electronic device 200.
  • the user may move to the directions menu.
  • a message storage menu which is a sub-menu
  • a vertical gesture from the top to the bottom
  • the selected upper menu or lower menu can be executed by tap gesture input.
  • the selected menus are determined as the selected menu and output the stored voice of the corresponding menu.
  • the voice selected menu can be known.
  • an interface method for selecting an upper and lower menu by horizontal and vertical gesture inputs is one of a plurality of applications (Applications, App 1, ..., App 16) on the electronic device 200.
  • Applications Applications, App 1, ..., App 16
  • App6 can be selected through the horizontal gesture.
  • the app 2 and the app 10 may be selected through the vertical gesture input.
  • the app screen may be composed of at least two apps.
  • App 1 and App 2 may be simultaneously displayed on one gesture input receiver 210.
  • the horizontal and vertical gesture input may also be used when selecting group apps including a plurality of apps.
  • a corresponding menu may be immediately selected and executed by a gesture input input through the gesture input receiver 210 of the electronic device 200 of FIGS. 6A to 6B.
  • the menus for directions, music, calculator, current time, phone, message, weather, my location, internet, calendar, app selection, and setting menu are displayed according to the shortcut gesture type of the table. You can choose.
  • Shortcut gesture types are Type 1 (1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12) and Type 2 (a, b, c, d, e, f, g, h, i) and type 3 ( ⁇ , C, A, ⁇ , ⁇ , ⁇ , P, M, W, +, ⁇ , C, A).
  • the menu corresponding to the table of FIG. 10 can be moved and executed.
  • the user may move to and execute the route guidance menu.
  • FIG. 10B if a code including Korean, English, numerals, and special characters is input like a letter, it may be converted into the same character as the input character.
  • the shortcut gesture is converted into a voice and output at about the same time as the input.
  • the electronic device 200 or 201 includes a smartphone keyboard input receiver or a braille input receiver and a motion sensor 194.
  • the motion sensor 194 may detect a hand motion or a horizontal motion and a vertical motion of an object.
  • the upper menu is selected by the horizontal motion as shown in the menu selection of FIG. 8 without receiving the gesture input of the gesture input receiving unit 210 and the vertical direction.
  • the upper or lower menu can be selected as the stop motion or "click" sound of the human hand.
  • the horizontal and vertical motion directions and the upper and lower menu moving directions are the same. For example, if you move your hand vertically up and down, the submenu will also move up and down.
  • the electronic device 300 is a tablet PC including a large screen touch display 310 for receiving a gesture input.
  • an upper menu is selected through a horizontal gesture input
  • a lower menu is selected through a vertical gesture input.
  • the electronic device 300 includes a motion sensor 394 and a large screen touch display 310 for receiving a gesture input. The motion sensor selects an upper menu by horizontal motion and a lower menu by vertical motion. The reverse is also possible.
  • the electronic device 400 includes a display on / off switch 410, a satellite or internet on / off switch 420, operation buttons 430, and a gesture input receiver 440.
  • the gesture input receiver 440 selects an upper menu by a horizontal gesture input, and selects a lower menu by a vertical gesture input.
  • the reverse is also possible.
  • the electronic device 400 of FIG. 13A further includes a motion sensor 494.
  • the motion sensor 494 may detect a horizontal motion to select an upper menu of a display screen such as a TV, and detect a vertical motion to select a lower menu. The reverse is also possible.
  • the electronic device 200 of FIG. 2 is a system for gesture input and sign input processing of the input auxiliary device 100.
  • the electronic device 200 may include a gesture input receiver 510, a gesture input identifier 511, a gesture processor 513, an operation processor 520, a memory 530, and a voice output unit. 550 and a code / Korean transmission unit 560.
  • the gesture input is transmitted to the gesture input receiver 510, and the gesture input identification unit 521 converts various gesture inputs including horizontal or vertical gestures into digital signals and informs the operation processing controller 520.
  • the arithmetic processing control unit 520 determines whether to output a screen, a message or a voice stored in the memory 530 according to the digital signal.
  • the arithmetic processing control unit 520 may be a CPU or an AP.
  • the gesture processor 513 includes a gesture / Hangul converter 524.
  • the memory 530 is referred to by the digital signal of the gesture input identification unit 511, and based on the referenced result, the gesture / sign converter 514 uses the input gesture as a sign including letters, numbers, or special characters. Convert to The converted code is converted into voice by the voice converter 540 and output by the voice output unit 550. On the other hand, the code converted in the gesture input is transmitted as a message by the code / Hangul transmitter 560.
  • the electronic device 200 includes a sign input identification unit 571 including a sign input receiving unit 570 and a braille input identification unit 572 and a braille / Hangul conversion unit 574.
  • a code processing unit 573 is further included.
  • the code input receiving unit 570 may receive Korean or English or Japanese or German or Chinese or Spanish or Portuguese or Russian or Hebrew or Hindi. Also, numbers (1, 2, ...) and special characters (@, #, #, $,%, ⁇ , & ,, *, (,),-, +,?,>, [,], ⁇ , ⁇ ,:,:, ", ⁇ , ⁇ ).
  • the code input identification unit 571 may further include a numeric input identification unit and a special character identification unit for identifying the letters, the numbers, and the special characters.
  • the braille input identification unit 572 of the sign input identification unit 571 is converted into a digital signal, and the result is transmitted to the arithmetic processing control unit 520 and the sign processing unit 573.
  • the processing unit 573 includes a braille / Hangul conversion unit 574, and converts the braille input to Korean by referring to the hash table 531 of the memory 530.
  • the result is converted into the voice conversion unit 540.
  • the voice output unit 550 outputs the voice signal by the voice output unit 550.
  • the gesture input and the code input may be simultaneously processed by the arithmetic processing control unit 520.
  • the hash table 531 of Fig. 14 is shown.
  • one of six braille combinations corresponds to Korean initial consonant, neutral vowel, and final consonant. Due to the characteristics of Braille and Hangul, there is a limit that one-to-one correspondence cannot be achieved.
  • When entering Hangul consonants with one of the six Braille combinations it is necessary to distinguish between the initial and the final Hangul.
  • the hash table 531 converts Braille into Korean by using a hash table to distinguish between Korean initials, neutrals, and verticals corresponding to each Braille.
  • the hash table 531 shows the horizontal addresses (1, 2, ..., 23) and the vertical addresses (1, 2, ..., 6). For example, when the vertical address is 1 and the horizontal address is 1, the input of the braille “ ⁇ ” may be recognized as “a” of the Hangul Jongjong and converted. The distinction between the initial and the finality of the braille input may be determined in the order from the first note input of the confirmation input receiver 231 of FIG. 2 until the next confirmation button is input. After inputting the Hangul Hangul characters, the Hangul characters received by the input of the confirmation input receiver 231 may be confirmed by voice. "Second" of the hash table means initial property, and "parent” means vowel.
  • the hash table may be constructed in other combinations. The hash table can be used to convert Braille to English or Japanese or German or Chinese or Spanish or Portuguese or Russian or Hebrew or Hindi.
  • the electronic device 200 receives a horizontal motion by the gesture input receiver from the horizontal direction gesture or the motion sensor 610 and performs a horizontal motion by the gesture input identifier by the horizontal gesture or the motion sensor. Recognizing step 620 and selecting the upper menu corresponding to the horizontal motion by the horizontal gesture or the motion sensor by the operation processing control unit 630 and vertical gesture or the by the gesture input receiver Receiving vertical motion by a motion sensor (640), Recognizing the vertical motion by the vertical gesture or the motion sensor by the gesture input receiver (650) and by the arithmetic processing control unit To select a vertical gesture or a sub-menu corresponding to the vertical motion And a system (660).
  • the electronic device 200 may include booting an electronic device (710), automatically executing a program for the visually impaired by the electronic device (720), and executing a general program by the electronic device. Or maintaining (730) an active state and selecting (740) upper and lower menus by recognizing horizontal and vertical gestures or horizontal and vertical motions by the arithmetic processing control unit of the electronic device.
  • a horizontal gesture or motion 950 is used to select the first Korean letter ( ⁇ , ⁇ , ..., ⁇ ) or the first letter of English name (A, B, ..., Z) as the upper menu.
  • the selected first Korean letter or first letter of English may be displayed on the gesture input receiving unit 901, 902, 903, ..., 90n.
  • a name 921, 922,..., 927 of the person who wants to call the vertical gesture or motion 960 may be selected as a submenu. After selecting a submenu, you can call the Tap gesture.
  • a” or “A” may be first selected by the horizontal gesture or motion input, and "kim-gil” or “Amus” may be selected by the vertical gesture or motion input.
  • the finger 950 moves in close contact with the gesture input receiver 902 in a first horizontal touch direction 950-2 (right to left) to move a predetermined distance.
  • the controller moves to the gesture input receiver 903 according to the menu movement direction 950-4.
  • the finger 950 moves in close contact with the gesture input receiving unit 902 in the second horizontal touch direction 950-1 (from left to right), and then separates the finger 950, the finger 950 is moved according to the menu moving direction 950-3.
  • the gesture input receiver 901 is moved.
  • the first horizontal touch direction 950-2 (right to left) and the second horizontal touch direction 950-1 (left to right) which are the horizontal direction gestures are the moving directions 950-4 and 950-of the upper menu. The opposite of 3).
  • the gesture input receiver 901 is selected and a lower menu is selected, the finger 960 is in close contact with the gesture input receiver 901 in the first vertical touch direction 960-2, from the top to the bottom. If the distance is moved and then separated, the submenu “Steel” 921 is selected.
  • the sub-menu “Kim Gil-dong” 923 is displayed. Is selected.
  • the first vertical touch and the second vertical touch input directions of the vertical gesture are opposite to the moving directions 960-3 and 960-4 of the submenu.
  • the vertical and horizontal touch directions and the upper and lower menu moving directions are the same. The relationship between the horizontal and vertical touch directions and the moving directions of the upper and lower menus can be relatively viewed according to the reference.
  • the electronic device set device 30 includes an input auxiliary device 105 and an electronic device 203.
  • the input auxiliary device 105 may include a first operation input unit 150 and a second operation input unit 151 for input of the electronic device 203, a function input button unit 153 for setting, a gesture input, and the electronic input.
  • the gesture input / screen display unit 155 for viewing the screen of the device 203 is included.
  • the electronic device 203 includes a first manipulation input receiver 250, a second manipulation input receiver 251, a function input button receiver 253, a gesture input receiver, and a screen display output unit 255.
  • the input units 150, 151, 153, and 155 of the input auxiliary device 105 are located at different positions in the input auxiliary device 105, respectively.
  • the input receivers 250, 251, 253, and 255 of the electronic device 203 are located at different positions in the electronic device 203, respectively.
  • the respective input units and the input receivers are located at the same position.
  • the position of the first manipulation input unit 150 is located at substantially the same position as the first manipulation input receiver 250.
  • the inputs of the input auxiliary device 105 may be used as an input auxiliary device for game operation.
  • the input receivers of the electronic device 203 may be used for input processing for a game. Referring to FIG. 20B, the electronic device set device 30 of FIG.
  • the 20A includes a gesture input unit, a screen display input unit 154, a third manipulation input unit 152, a fourth manipulation input unit 158, and a motion sensor home of a larger size. And an input auxiliary device 105 including 157 and 157-1. Due to the larger gesture input unit and the screen display input unit 156, the third manipulation input unit 150 is located directly below the spigger output unit 159.
  • the electronic device set device 30 of FIG. 20B includes a gesture input unit and a screen display input receiver 256, a third manipulation input receiver 251, a fourth manipulation input receiver 250, and a motion sensor 257 having a larger size. It may include an electronic device 203 including).
  • the electronic device set device 30 may further include input and reception units 152, 158, 252, and 258 of operation buttons for the convenience of game operation.
  • the method of manufacturing the input auxiliary device 100 includes a step of making an electronic device cover almost identical to the size of the electronic device for input to the electronic device 100 and a gesture input unit and a sign for inputting a gesture to the electronic device cover. Distinguishing a sign input unit for input (971), removing the gesture input unit and the sign input unit from the cover (972), a gesture input unit capable of touch input using a material different from the cover material, and a sign input capable of touch input A step (973) of combining the electronic device cover with the gesture input unit and the code input unit with the touch input unit including the material different from the electronic device cover and the sign input unit including the touch input unit Step 974.
  • the touch input unit and the touch input code input unit of the input assistance device 100 may be made of a silicon material or a rubber material or a sponge material including a conductive material.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • User Interface Of Digital Computer (AREA)
  • Input From Keyboards Or The Like (AREA)

Abstract

La présente invention concerne un système d'ensemble de dispositifs électroniques comportant: un dispositif d'entrée assistée comprenant une unité d'entrée de geste servant à introduire un geste et une unité d'entrée de code servant à introduire un code; et un dispositif électronique comprenant une unité de réception d'entrée de geste servant à recevoir l'entrée de geste et une unité de réception d'entrée de code servant à recevoir l'entrée de code.
PCT/KR2014/003624 2014-04-24 2014-04-24 Système d'ensemble de dispositifs électroniques comprenant un dispositif d'entrée assistée et dispositif électronique de traitement d'entrée l'utilisant Ceased WO2015163500A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
KR1020167031030A KR20160148567A (ko) 2014-04-24 2014-04-24 입력 보조 장치 및 이를 이용한 입력을 처리하는 전자 기기를 포함하는 전자 기기 세트 장치
PCT/KR2014/003624 WO2015163500A1 (fr) 2014-04-24 2014-04-24 Système d'ensemble de dispositifs électroniques comprenant un dispositif d'entrée assistée et dispositif électronique de traitement d'entrée l'utilisant

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2014/003624 WO2015163500A1 (fr) 2014-04-24 2014-04-24 Système d'ensemble de dispositifs électroniques comprenant un dispositif d'entrée assistée et dispositif électronique de traitement d'entrée l'utilisant

Publications (1)

Publication Number Publication Date
WO2015163500A1 true WO2015163500A1 (fr) 2015-10-29

Family

ID=54332653

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2014/003624 Ceased WO2015163500A1 (fr) 2014-04-24 2014-04-24 Système d'ensemble de dispositifs électroniques comprenant un dispositif d'entrée assistée et dispositif électronique de traitement d'entrée l'utilisant

Country Status (2)

Country Link
KR (1) KR20160148567A (fr)
WO (1) WO2015163500A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112233505A (zh) * 2020-09-29 2021-01-15 浩辰科技(深圳)有限公司 一种新型盲童交互学习系统
US20230196942A1 (en) * 2021-12-21 2023-06-22 Toshiba Tec Kabushiki Kaisha Input apparatus and control method thereof

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102246119B1 (ko) * 2020-02-28 2021-04-29 전수아 시각장애인용 점자 리모컨 및 이를 이용한 홈 네트워크 시스템

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030179133A1 (en) * 2002-03-20 2003-09-25 Gilles Pepin Wireless handheld portabel navigation system and method for visually impaired pedestrians
US20110187657A1 (en) * 2010-02-04 2011-08-04 Ian Robert Knowles Touch sensitive screen for scrolling through sets of data
US20120081271A1 (en) * 2010-10-01 2012-04-05 Imerj LLC Application display transitions between single and multiple displays
KR20120092034A (ko) * 2011-02-10 2012-08-20 삼성전자주식회사 터치 스크린 디스플레이를 구비한 휴대 기기 및 그 제어 방법
US20130314338A1 (en) * 2012-05-24 2013-11-28 Samsung Display Co. Ltd. Dual display apparatus and method of driving the same

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030179133A1 (en) * 2002-03-20 2003-09-25 Gilles Pepin Wireless handheld portabel navigation system and method for visually impaired pedestrians
US20110187657A1 (en) * 2010-02-04 2011-08-04 Ian Robert Knowles Touch sensitive screen for scrolling through sets of data
US20120081271A1 (en) * 2010-10-01 2012-04-05 Imerj LLC Application display transitions between single and multiple displays
KR20120092034A (ko) * 2011-02-10 2012-08-20 삼성전자주식회사 터치 스크린 디스플레이를 구비한 휴대 기기 및 그 제어 방법
US20130314338A1 (en) * 2012-05-24 2013-11-28 Samsung Display Co. Ltd. Dual display apparatus and method of driving the same

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112233505A (zh) * 2020-09-29 2021-01-15 浩辰科技(深圳)有限公司 一种新型盲童交互学习系统
US20230196942A1 (en) * 2021-12-21 2023-06-22 Toshiba Tec Kabushiki Kaisha Input apparatus and control method thereof

Also Published As

Publication number Publication date
KR20160148567A (ko) 2016-12-26

Similar Documents

Publication Publication Date Title
WO2014030902A1 (fr) Procédé d'entrée et appareil de dispositif portable
WO2012169730A2 (fr) Procédé et appareil pour fournir une interface de saisie de caractères
WO2011102656A2 (fr) Appareil et procédé de fourniture d'interface utilisateur
WO2012074256A2 (fr) Dispositif portable et son procédé de fourniture de mode d'interface utilisateur
WO2015099293A1 (fr) Dispositif et procédé permettant d'afficher l'interface utilisateur d'un dispositif d'entrée virtuel d'après une reconnaissance de mouvements
WO2016104867A1 (fr) Dispositif numérique et procédé de commande associé
WO2014107077A1 (fr) Boîtier de protection pour dispositif mobile
WO2011043555A2 (fr) Terminal mobile et procédé de traitement d'informations pour ce dernier
WO2007084078A1 (fr) Clavier pour telephone mobile ou autres dispositifs de communication portables
WO2015064893A1 (fr) Appareil d'affichage et son procédé de fourniture d'ui
WO2018056571A1 (fr) Clavier iot bluetooth capable d'un mappage de clavier personnalisé pour chaque utilisateur
WO2015174597A1 (fr) Dispositif d'affichage d'image à commande vocale et procédé de commande vocale pour dispositif d'affichage d'image
WO2015163500A1 (fr) Système d'ensemble de dispositifs électroniques comprenant un dispositif d'entrée assistée et dispositif électronique de traitement d'entrée l'utilisant
WO2011065744A2 (fr) Procédé permettant de fournir une interface utilisateur graphique (iug) pour guider la position de départ d'une opération utilisateur et dispositif numérique mettant en œuvre ledit procédé
WO2010016717A2 (fr) Appareil de saisie utilisateur mettant en œuvre un pave ecran tactile
WO2015115691A1 (fr) Terminal de communication mobile et boîtier pour terminal de communication mobile
CN110069305A (zh) 一种屏幕界面切换方法及终端设备
WO2011145788A1 (fr) Dispositif à écran tactile et interface utilisateur pour personnes ayant une déficience visuelle
WO2018124564A1 (fr) Système de lecture braille par vibrations, et procédé d'implémentation de système de lecture braille par vibrations basés sur un écran tactile
CN101576770B (zh) 多触点交互系统及方法
EP2524291A2 (fr) Procédé de saisie d'un caractère coréen sur un écran tactile
WO2016093448A1 (fr) Dispositif mobile et procédé de fonctionnement d'un dispositif mobile
WO2014157961A1 (fr) Procédé de commande de toucher dans un terminal mobile ayant un grand écran
CN110531881A (zh) 鼠标调用osd菜单的集中式kvm系统
WO2015008929A1 (fr) Procédé de déplacement et de commutation d'écran sur un dispositif à écran tactile

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14890341

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20167031030

Country of ref document: KR

Kind code of ref document: A

122 Ep: pct application non-entry in european phase

Ref document number: 14890341

Country of ref document: EP

Kind code of ref document: A1