HK40037351A - Method for inputting based on input peripheral and related device - Google Patents

Description

Input peripheral based input method and related device

Technical Field

The present application relates to the field of computer technologies, and in particular, to a method and a related apparatus for performing input based on an input peripheral.

Background

With the rapid development of terminal technology, terminal devices such as smart phones, tablet computers, and the like have gradually become common electronic consumer products for people. The input device is a bridge for the terminal device to interact with the user.

In the related art, more and more terminal devices interact with users through input peripherals in order to facilitate input. The terminal equipment can be connected with the input peripheral equipment through the Bluetooth, so that a user can interact with the terminal equipment through the input peripheral equipment.

However, since the terminal device is limited by the number of bluetooth connections, the terminal device cannot be connected to a large number of input peripherals, which results in a single input mode and a large limitation on application scenarios.

Disclosure of Invention

In order to solve the technical problems, the application provides an input device based on mesh networking, an input method and a related device, the number of device nodes can be arbitrarily expanded according to scene requirements through the mesh networking, and the limitation of the device nodes by the network connection number of terminal devices is avoided, so that the input modes of users are enriched, and the input device is suitable for different scene requirements.

The embodiment of the application discloses the following technical scheme:

in a first aspect, an embodiment of the present application provides a method for performing input based on an input peripheral, where the input peripheral includes a plurality of device nodes, the device nodes are connected in a mesh networking manner, the device nodes include a device node serving as a master node, the master node is connected to a terminal device through a network, the terminal device runs an application, and the device nodes and an object in the application have a mapping relationship, and the method includes:

in the process of interaction between a user and an application, responding to input operation executed by the user through the target equipment node under a preset condition, and collecting state change data;

processing the collected state change data to generate interaction information;

receiving interaction information of the target equipment node connected with the main node through the main node by utilizing a data transmission function among the plurality of equipment nodes;

and reporting the interaction information on the main node to the terminal equipment by using a data transmission function between the main node and the terminal equipment so that the terminal equipment can realize the interaction between the user and the target object in the application according to the interaction information and the mapping relation.

In a second aspect, an embodiment of the present application provides an apparatus for performing input based on an input peripheral, where the input peripheral includes a plurality of device nodes, the device nodes are connected in a mesh networking manner, the device nodes include a device node serving as a master node, the master node is connected to a terminal device in a network, the terminal device runs an application, the device nodes and an object in the application have a mapping relationship, and the apparatus includes an acquisition unit, a generation unit, a reception unit, and a reporting unit:

the acquisition unit is used for responding to input operation executed by the user through the target equipment node under a preset condition in the process of interaction between the user and the application and acquiring state change data;

the generating unit is used for respectively processing the acquired state change data to generate interactive information;

the receiving unit is configured to receive, by using a data transmission function among the plurality of device nodes, interaction information of the target device node connected to the master node through the master node;

the reporting unit is configured to report the interaction information on the master node to the terminal device by using a data transmission function between the master node and the terminal device, so that the terminal device implements interaction between the user and the target object in the application according to the interaction information and the mapping relationship.

In a third aspect, an embodiment of the present application provides a system for performing input based on an input peripheral, where the system includes the input peripheral and a terminal device, the input peripheral includes a plurality of device nodes, the device nodes are connected in a mesh networking manner, the device nodes include a device node serving as a master node, the master node is connected to the terminal device through a network, an application runs on the terminal device, and the device nodes and an object in the application have a mapping relationship:

the input peripheral is used for responding to input operation executed by the user through the target equipment node under a preset condition in the process of interaction between the user and the application and acquiring state change data; processing the collected state change data to generate interaction information; receiving interaction information of the target equipment node connected with the main node through the main node by utilizing a data transmission function among the plurality of equipment nodes; reporting the interaction information on the main node to the terminal equipment by using a data transmission function between the main node and the terminal equipment;

the terminal equipment is used for receiving the interactive information reported by the main node; determining a target object in the application for which the interaction information aims according to the mapping relation; and finishing the interaction between the user and the application according to the interaction information and the target object.

In a fourth aspect, an embodiment of the present application provides an apparatus for performing input based on an input peripheral, where the apparatus includes a processor and a memory:

the memory is used for storing program codes and transmitting the program codes to the processor;

the processor is configured to perform the method of the first aspect according to instructions in the program code.

In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium for storing program code for executing the method of the first aspect.

According to the technical scheme, the mesh networking mode is fused to the equipment nodes, so that the equipment nodes form an input peripheral to realize the interaction between a user and the application on the terminal equipment. The input peripheral equipment comprises a plurality of equipment nodes, the equipment nodes are connected in a mesh networking mode, the equipment nodes comprise equipment nodes serving as main nodes, the main nodes are in network connection with the terminal equipment, and the number of the main nodes can be determined according to the limitation of the network connection number of the terminal equipment. In the process of interaction between a user and an application, the input peripheral responds to input operation executed by the user through a target device node under a preset condition, acquires state change data, processes the acquired state change data, and generates interaction information, so that the actual operation meaning of the state change data is given, and the user can know what kind of interaction needs to be carried out with the application. Because all the equipment nodes form a mesh networking, data such as interactive information can be transmitted among a plurality of equipment nodes and/or between the main node and the terminal equipment, so that other equipment nodes such as a target equipment node can conveniently send interactive information to the main node, and then the main node sends all the interactive information to the terminal equipment, so that the terminal equipment can conveniently realize the interaction between a user and a target object in application according to the interactive information and the mapping relation. Therefore, the number of the equipment nodes can be arbitrarily expanded according to the scene requirements through mesh networking, and the limitation of the network connection number of the terminal equipment on the equipment nodes is avoided, so that the input modes of users are enriched, and the method and the device are suitable for different scene requirements.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and for a person of ordinary skill in the art, other drawings can be obtained according to these drawings without inventive exercise.

Fig. 1 is a schematic diagram of a system architecture of a method for performing input based on an input peripheral according to an embodiment of the present application;

FIG. 2 is a flowchart of a method for inputting based on an input peripheral according to an embodiment of the present application;

fig. 3 is a schematic structural diagram of an apparatus node according to an embodiment of the present application;

fig. 4 is an interface schematic diagram of a piano type game scene provided in the embodiment of the present application;

fig. 5 is a schematic diagram illustrating an effect of a ring-shaped device node and a ring wearing effect provided in an embodiment of the present application;

fig. 6 is a schematic diagram of a system architecture formed by an input peripheral and a terminal device based on mesh networking in a piano game scene according to an embodiment of the present application;

FIG. 7 is a flowchart of a method for inputting based on an input peripheral according to an embodiment of the present application;

FIG. 8 is a block diagram of an apparatus for performing input based on an input peripheral according to an embodiment of the present disclosure;

fig. 9 is a structural diagram of a terminal device according to an embodiment of the present application.

Detailed Description

Embodiments of the present application are described below with reference to the accompanying drawings.

The terminal equipment can be connected with the input peripheral equipment through the Bluetooth, so that a user can interact with the terminal equipment through the input peripheral equipment, and the input is more convenient. However, since the terminal device is limited by the number of bluetooth connections, for example, the terminal device can only connect 1 or 2 bluetooth devices as external input devices, so that the user can input through the 1 or 2 bluetooth devices. Therefore, the input mode is single, and the application scene has larger limitation.

In order to solve the above technical problems, embodiments of the present application provide an input device based on mesh networking, which fuses a mesh networking mode to device nodes as input peripherals of a terminal device, and the mesh networking can arbitrarily expand the number of the device nodes according to scene requirements, thereby avoiding the limitation of the device nodes on the number of network connections of the terminal device, and enriching the input modes of users to adapt to different scene requirements.

Referring to fig. 1, fig. 1 is a schematic diagram of a system architecture of a method for performing input based on an input peripheral according to an embodiment of the present application. The system architecture may include a terminal device 100 and an input peripheral 200, where the terminal device 100 may be a smart phone, a PAD (PAD), a notebook computer, a desktop computer, a smart watch, and the like, but is not limited thereto.

An application, such as a game application, a video application, a search application, a text editing application, etc., may be installed on the terminal device 100, and a user may interact with the application by performing an input operation through the input peripheral device 200. For example, the terminal device 100 runs a game application, the user can play a game by inputting an input operation of the peripheral device, or can type and chat with teammates by inputting an input operation of the peripheral device, or the like.

The input peripheral 200 includes a plurality of device nodes, for example, device nodes 1-6 in fig. 1, the plurality of device nodes are connected in a wireless mesh network (mesh) networking manner, and the input peripheral 200 formed by the plurality of device nodes may be shown by a dashed rectangle in fig. 1. mesh networking is also known as "multi-hop" (multi-hop) networks. In the mesh networking, all nodes are connected with each other, each node has a plurality of connecting channels, and all nodes form an integral network.

At present, mesh networking is used for expanding the coverage range of a wireless network, and by the ad hoc network characteristics of a plurality of equipment nodes, network coverage in a large range can be realized at a low cost, and robust network link can be realized. Suppose the handset is 50 meters away from the wireless router a, but the signal coverage distance of the wireless router a is only 30 meters, and the handset cannot be directly connected to the wireless router a. Then, a wireless router b supporting mesh networking is additionally arranged between the wireless router a and the mobile phone, the wireless router b is connected to the wireless router a through a wireless network and then transmits signals to be connected by the mobile phone, and therefore the coverage range of the wireless network is expanded.

In order to enrich input modes and enable a user to interact with the terminal device 100 through various input operations, the embodiment of the application creatively applies mesh networking to the construction of the input peripheral device 200 comprising a plurality of device nodes, and enriches the input modes through cooperation of the sensor units and the application on the terminal device 100. Since the number of network connections of the terminal device 100, for example, bluetooth connections, is limited, the device nodes that are master nodes among the plurality of device nodes are network-connected to the terminal device 100 through the master nodes, and the number of master nodes is determined based on the limited number of network connections of the terminal device 100, so that data on the remaining device nodes can be transmitted to the master nodes and thus to the terminal device 100 through the master nodes, so that the terminal device 100 can respond to input operations performed by the user through the plurality of device nodes.

If the limited number of network connections of the terminal device 100 is one, one of the device nodes may be determined as a master node; if the number of network connections to which the terminal device 100 is restricted is two, two device nodes among the plurality of device nodes may be determined as the master nodes. In fig. 1, the master nodes may be device node 1 and device node 2.

The master node may be set by default, that is, when the input peripheral device 200 leaves a factory, a certain device node is set as the master node by default. The master node may also be determined according to a user selection, for example, when the terminal device 100 is connected to the input peripheral device 200, a selection interface is presented to the user so as to set a certain device node as the master node according to the user selection.

In order to save the power of the terminal device, the network connection may be implemented by using a Low power transmission technology, for example, the network connection may be a Bluetooth Low Energy (BLE) connection.

After the terminal device 100 is connected to the input peripheral device 200, since the application object may include a plurality of objects, the object controlled by each of the plurality of device nodes may be different. In order to accurately determine the target object of interaction required by the user to perform the interactive operation, the terminal device 100 may establish a mapping relationship between a plurality of device nodes and the object in the application in advance through the application. For example, the mapping relationship may be a mapping relationship between an identifier of a device node and an object, and the interaction information may include the identifier of the device node, so as to represent from which device node the state change data generating the interaction information comes.

The objects may be different in different applications, for example gaming applications, for example in dance-type gaming applications, the objects may be different parts of the body, such as hands, feet, head, etc.; in a piano type game application, the objects may be different music tracks or the like. Thus, during the interaction of the user with the application, the input peripheral 200 may collect state change data after the user performs an input operation on a device node, e.g., a target device node, in the input peripheral 200. And processing the acquired state change data to generate interactive information, thereby giving actual operation meaning to the state change data and knowing what kind of interaction needs to be carried out with the application.

Since all the device nodes form a mesh network, data such as interactive information transmission can be performed between a plurality of device nodes and/or between the master node and the terminal device 100, so that the interactive information of the target device node connected with the master node is received by the master node by using the data transmission function between the plurality of device nodes, and the interactive information on the master node is reported to the terminal device 100 by using the data transmission function between the master node and the terminal device 100.

After receiving the interaction information reported by the host node, the terminal device 100 may determine a target object in the application to which the interaction information is directed according to the mapping relationship, and then complete the interaction between the user and the application according to the interaction information and the target object.

Next, based on the system architecture diagram provided in the foregoing, mainly taking an application as a game application as an example, a detailed description is given to a method for performing input based on an input peripheral according to an embodiment of the present application with reference to the accompanying drawings.

Referring to fig. 2, fig. 2 shows a flow chart of a method for inputting based on an input peripheral, the method comprising:

s201, in the process of interaction between a user and an application, responding to input operation executed by the user through the target equipment node under a preset condition, and collecting state change data.

When a user needs to interact with the terminal equipment through input operation, the user can execute the input operation through the input peripheral equipment. The input operation may cause a state change, generating state change data, so that corresponding state change data may be collected through the input device.

Taking fig. 1 as an example, if the user performs an input operation through the device node 4, the device node 4 may acquire state change data.

In this embodiment, in order to ensure that a user can perform an input operation through each device node and that a plurality of device nodes can be connected in a mesh networking manner, a structure of each device node may be as shown in fig. 3, and includes a power module 2011, a sensor unit 2012, a processing unit 2013, and a mesh networking unit 2014.

In this embodiment, the power module 2011 may be configured to provide power for the device node and perform charging management, where the charging mode may be wireless charging or wired charging.

In the present embodiment, the state change data generated according to the input operation of the user on the device node may be collected by the sensor unit 2012. In general, when a user wishes to perform an input through a device node in the input peripheral 200, the user may perform an input operation on the device node, where the input operation may cause a state change, and the state change may reflect an interaction intention of the user with the terminal device 100, so that state change data may be collected by the sensor unit 2012, so that what kind of interaction is required to be performed by the terminal device 100 may be determined according to the state change.

It should be noted that in this embodiment, the sensor unit 2012 may include one or more combinations of a pressure sensor, an acceleration sensor, a gyroscope, and a heart rate sensor. In one possible implementation, the sensor unit 2012 may be configured with different types of sensors, with different application scenarios.

For example, in a scene of a dance-type game application, the sensor unit 2012 may collect state change data generated by motions of a hand, a foot, a head, a whole body, and the like, wherein motions such as a rotation motion, various swings, and a bounce may be included in the dance process, the state change data generated by the rotation motion may be collected by a gyroscope, and motions such as various swings and bounces may cause acceleration to change, so the state change data may be collected by an acceleration sensor, and at this time, the sensor unit 2012 may include a gyroscope and an acceleration sensor.

As another example, in the context of a piano-type game application, referring to the piano-type game shown in fig. 4, when a piece of music falls to a strike position, the user needs to click on the touch screen of the terminal device 100 at the strike position in the corresponding music track (1, 2, 3, 4). Due to the problem of the size of the screen of the terminal device 100, the fingers are placed too crowded and easily fatigued. For this reason, a piano type game can be played based on the system architecture shown in fig. 1. In this case, the input operation by the user is a click action, which may cause a change in acceleration or pressure, and therefore, the state change data may be collected by the acceleration sensor or the pressure sensor. The sensor unit 2012 may include an acceleration sensor or a pressure sensor.

For another example, in a scenario where a user preference is predicted to wish to develop an application according to the user's preference, a heart rate may be changed since, in a general case, the reflection of a user's favorite content and a user's disliked content may be different. For example, the heartbeat of the user may be accelerated when the user likes the content, so that the heart rate of the user can be acquired through the heart rate sensor, the user preference can be predicted accordingly, and further, the application program is developed according to the user preference, more funny content is developed, and the user can experience more easily and more variously. At this time, the sensor unit 2012 may include a heart rate sensor.

In some possible embodiments, the device node may further comprise a feedback unit 2015, which may be used to provide vibratory or sound feedback to the user. It should be noted that, in this embodiment, the feedback unit 2015 may be configured to provide vibration or sound feedback to the user before the user performs the input operation, so as to remind the user to start performing the input operation. For example, in the piano game shown in fig. 4, the feedback unit 2015 may provide vibration or sound feedback to the user to remind the user to perform a click operation, so that the hitting position in the terminal device 100 may be timely controlled to be successfully hit, the user may timely and accurately perform the click operation, a higher game score is obtained, and the game experience of the user is improved.

In this case, the preset condition may be that the target device node emits vibration or sound feedback.

In some cases, the user may also observe whether the music block falls to the hitting position by himself or herself, and when the user observes that the music block falls to the hitting position, a click operation is performed, where the preset condition is that the music block on the music track falls to the hitting position.

If the plurality of equipment nodes are respectively worn on different fingers of the user, the input operation is a clicking action of the finger of the user wearing the target equipment node, and the target equipment node is an equipment node which has a mapping relation with the music track of the music block falling to the hitting position.

Of course, the feedback unit 2015 may also be configured to provide vibration or sound feedback to the user after the user performs the input operation, so as to remind the user that the input operation has been performed, avoid a misoperation caused by repeated execution, and improve the game experience of the user.

S202, processing the acquired state change data to generate interactive information.

The collected state change data is numerical data, so that the collected state change data can be processed to generate interactive information. The interactive information is information having practical meaning, and may embody an interactive intention of a user input operation so as to instruct what kind of interaction is performed by the terminal device 100.

Based on the structure of the device node shown in fig. 3, the processing unit 2013 may process the collected state change data to generate the interaction information.

It should be noted that the interaction information generated by the processing unit 2013 may be different in different application scenarios. If the state change data is the heart rate, the interaction information can be user preference information predicted according to the heart rate; if the state change data is pressure or acceleration change or angle change acquired by a gyroscope, the interaction information may be an action command. In many scenarios, the interaction between the terminal device 100 and the user refers to that the user controls the terminal device to execute an action through an input operation, and at this time, the interaction information includes an action instruction, and the action instruction is used for instructing the terminal device to execute an action corresponding to the action instruction for the target object.

S203, receiving the interaction information of the target equipment node connected with the main node through the main node by using the data transmission function among the plurality of equipment nodes.

S204, uploading the interaction information on the main node to the terminal equipment by using a data transmission function between the main node and the terminal equipment.

In this embodiment, the structure of the device node includes a mesh networking unit 2014 shown in fig. 3, where the mesh networking unit 2014 is mainly used for taking charge of network connection among multiple device nodes, so that the multiple device nodes are connected in a mesh networking manner; and for data transmission between multiple device nodes and/or between a master node and terminal device 100. Wherein the data comprises the determined interaction information.

In some cases, the processing unit 2013 may further receive data reported by the mesh networking unit 2014, so that the processing unit 2013 may know what kind of processing is performed according to the data.

Based on the characteristics of mesh networking, data transmission functions are provided among a plurality of equipment nodes and between a main node and terminal equipment. Because the number of network connections, such as bluetooth connections, of the terminal device is limited, the device node connected to the terminal device is the master node, and not every device node can directly report the interaction information to the terminal device. Therefore, the other equipment nodes except the main node can send the interaction information to the main node, and then the main node sends the interaction information to the terminal equipment, so that the terminal equipment can realize the interaction with the user according to the interaction information.

S205, the terminal device determines a target object in the application, to which the interactive information is directed, according to the mapping relation.

S206, the terminal equipment completes the interaction between the user and the application according to the interaction information and the target object.

After the terminal device receives the interaction information, the terminal device can analyze the interaction information through the application, the interaction information can include the identification of the target device node, and because the plurality of device nodes have the mapping relation with the object in the application, the target object in the application to which the interaction information aims can be determined according to the mapping relation, and then the interaction between the user and the application can be completed according to the interaction information and the target object. The target object may be an object that may react to an input operation of a user in an application, for example, in a game application, the target object may be different parts of a game character, may also be different music tracks, and the like.

If the application is a piano game application in the game application, the mapping relationship is a mapping relationship between the multiple device nodes and different music tracks in the piano game application, the target object is a target music track, the interaction information includes an action instruction, and the implementation manner of completing the interaction between the user and the application according to the interaction information and the target object can be that the terminal device strikes a striking position on the target music track according to the action instruction.

According to the technical scheme, the mesh networking mode is fused to the equipment nodes, so that the equipment nodes form an input peripheral to realize the interaction between a user and the application on the terminal equipment. The input peripheral equipment comprises a plurality of equipment nodes, the equipment nodes are connected in a mesh networking mode, the equipment nodes comprise equipment nodes serving as main nodes, the main nodes are in network connection with the terminal equipment, and the number of the main nodes can be determined according to the limitation of the network connection number of the terminal equipment. In the process of interaction between a user and an application, the input peripheral responds to input operation executed by the user through a target device node under a preset condition, acquires state change data, processes the acquired state change data, and generates interaction information, so that the actual operation meaning of the state change data is given, and the user can know what kind of interaction needs to be carried out with the application. Because all the equipment nodes form a mesh networking, data such as interactive information can be transmitted among a plurality of equipment nodes and/or between the main node and the terminal equipment, so that other equipment nodes such as a target equipment node can conveniently send interactive information to the main node, and then the main node sends all the interactive information to the terminal equipment, so that the terminal equipment can conveniently realize the interaction between a user and a target object in application according to the interactive information and the mapping relation. Therefore, the number of the equipment nodes can be arbitrarily expanded according to the scene requirements through mesh networking, and the limitation of the network connection number of the terminal equipment on the equipment nodes is avoided, so that the input modes of users are enriched, and the method and the device are suitable for different scene requirements.

It is understood that, in order to facilitate the device node to collect the state change data, the device node may adopt different forms according to different application scenarios. In one possible implementation, the device node may have a ring-shaped appearance, so that a user may wear a plurality of device nodes. Of course, the device node may also be in the form of a touch screen or a drumstick, and the embodiment does not limit this.

For example, in a scene of a dance-type game application, a user may need to perform various motions such as swinging and jumping, so that the user can perform the motions conveniently, and a device node can accurately acquire state change data generated by the motions in real time, and at this time, the device node may have a ring shape. The ring shape may be a bracelet shape (for collecting state change data generated by the movement of the hand) or a foot ring shape (for collecting state change data generated by the movement of the foot).

As another example, in the scenario of the piano-like game application shown in fig. 4, the user may control the hitting positions of different music tracks by click actions generated by different fingers. At this time, the shape of the device node may be a ring shape, that is, the ring shape is a ring shape, the device node may be as shown in fig. 5, a plurality of device nodes may be respectively worn on different fingers of the user, and an effect diagram after wearing the ring may be as shown on the right side of an arrow in fig. 5. At this time, the input operation is a click action of a finger of the user wearing the target device node, the click action may be a click on a desktop (the desktop may be a common household desktop or a specially developed hitting surface) by the finger, and the target device node is a device node having a mapping relationship with a music track where the music block falls to a hitting position.

It should be noted that in this scenario, the device node may also be a touch screen, for example, an intelligent terminal with a touch screen, and a user finger clicks different touch screens, which is equivalent to clicking hitting positions of different music tracks.

In a possible implementation manner, device nodes of different forms may also be fused, and such fusion may be integrated or combined. For example, the ring can be fused with the drumstick, the ring is sleeved on the drumstick, and the clicking operation is performed by the drumstick.

When the appearance of the equipment node is in a ring shape, the equipment node is made of a telescopic material, so that the diameters of different human body parts or objects wearing the electronic equipment, such as fingers, wrists or ankles, are met.

Taking the scenario of the piano game application shown in fig. 4 as an example, if the device node is in the shape of a ring, a system architecture formed by an input peripheral and a terminal device based on mesh networking may be as shown in fig. 6, where a user completes mesh networking by wearing rings 1, 2, 3, and 4 (as shown in the right side diagram in fig. 6), and selects one of the rings as a master node to connect with the terminal device 100 (the left side diagram in fig. 6 is a game interface of the piano game application shown on the terminal device 100) through BLE. The ring 1, 2, 3, 4 is mapped with the music track 1, 2, 3, 4 respectively to establish a mapping relation. Wherein the mapping process may be implemented by a piano like gaming application on the terminal device 100. No. 1 music track corresponds No. 1 ring, and No. 2 music track corresponds No. 2 rings, and No. 3 tracks correspond No. 3 rings, and No. 4 tracks correspond No. 4 rings. When a user sees that a music block on a certain music track, for example, the music track No. 3, falls to a hitting position, the user only needs to knock a desktop with a corresponding finger (the finger wearing the ring No. 3), at this time, an acceleration sensor included in the ring can detect acceleration change (namely state change data) generated by the clicking action of the finger, vibration can be provided to be fed back to the user, meanwhile, an action instruction generated by a processing unit included in the ring is transmitted to the ring serving as a master node, the master node reports the action instruction to a piano game application of the terminal device 100, the piano game application maps the received action instruction back to a touch event, namely, the hitting position on which music track is clicked is determined, and therefore, the whole control interaction is completed.

Next, a method for a user to interact with a terminal device based on an input peripheral provided by the embodiment of the present application will be described with reference to an actual application scenario. The application scene is a piano game application scene, and when the music block falls to the hitting position, a user needs to click the touch screen of the terminal equipment at the hitting position corresponding to the music track (1-4). Due to the size problem of the screen of the intelligent terminal, fingers are crowded when being put on the intelligent terminal, and fatigue is easy to occur. For this purpose, it is desirable to implement a click operation of the stroke position by the input peripheral. In the piano type game application shown in fig. 4, there are 4 music tracks, each music track may have a music piece falling to a hitting position at any time, so that 4 fingers are required to control one music track respectively, which may require 4 device nodes (e.g., rings) to constitute an input peripheral. Because the number of the bluetooth devices that can be connected to the terminal device is limited, only one bluetooth device may be generally connected, and at most, the number of the bluetooth devices is not more than two, in order to ensure that the control of the user on the music track can be realized through the input peripheral in the process of 4 device nodes, the embodiment may connect 4 ring to form the input peripheral based on the mesh networking mode. Specifically, a plurality of rings are connected in a mesh networking mode, one ring is determined to be used as a master node, and the master node is connected with the terminal equipment in a network mode.

Based on the input peripheral, referring to fig. 7, the method for the user to interact with the terminal device includes:

s701, the user wears the ring and starts a piano game application.

S702, the user selects to start the game.

And S703, the user executes the click operation according to the ring vibration.

S704, the ring collects state change data and generates an action instruction according to the state change data.

And S705, the ring sends the action command to a ring serving as a main node.

And S706, the ring serving as the main node sends the action instruction to the terminal equipment.

And S707, the terminal equipment determines the corresponding music track according to the action instruction and the mapping relation established in advance.

S708, executing the hitting operation on the hitting position on the music track, and generating a syllable of the music piece falling to the hitting position.

Based on the method for performing input based on the input peripheral provided in the embodiment corresponding to fig. 2, an embodiment of the present application further provides a device 800 for performing input based on the input peripheral, where the device 800 includes an acquisition unit 801, a generation unit 802, a receiving unit 803, and a reporting unit 804:

the acquisition unit 801 is configured to, in a process of interaction between a user and an application, acquire state change data in response to an input operation performed by the user through the target device node under a preset condition;

the generating unit 802 is configured to process the acquired state change data to generate interaction information;

the receiving unit 803 is configured to receive, by using a data transmission function between the multiple device nodes, interaction information of the target device node connected to the master node through the master node;

the reporting unit 804 is configured to report the interaction information on the master node to the terminal device by using a data transmission function between the master node and the terminal device, so that the terminal device implements interaction between the user and the target object in the application according to the interaction information and the mapping relationship.

In some embodiments, the device nodes are in a ring shape, and the plurality of device nodes are worn by the user.

In some embodiments, the device nodes are made of a stretchable material.

In some embodiments, the interaction information includes an action instruction, and the action instruction is used for instructing the terminal device to execute an action corresponding to the action instruction for the target object.

In some embodiments, the application is a piano type game application, and the mapping relationship is a mapping relationship between the plurality of device nodes and different music tracks in the piano type game application, respectively.

In some embodiments, the preset condition is that a music piece on the music track falls to a hitting position, or the target device node emits a vibration or sound feedback.

In some embodiments, if the plurality of device nodes are respectively worn on different fingers of the user, the input operation is a click action of a finger of the user wearing the target device node, and the target device node is a device node having a mapping relationship with a music track where the music chunk falls to the hitting position.

In some embodiments, the device node is a touch screen or drumstick.

In some embodiments, the acquisition unit 801 is configured to acquire the state change data through the sensor unit.

In some embodiments, the sensor unit comprises one or more combinations of a pressure sensor, an acceleration sensor, a gyroscope, and a heart rate sensor.

The embodiment of the application also provides equipment for inputting based on the input peripheral. The apparatus is described below with reference to the accompanying drawings. Referring to fig. 9, the device may be a terminal device, taking the terminal device as a smart phone as an example:

fig. 9 is a block diagram illustrating a partial structure of a smartphone related to a terminal device provided in an embodiment of the present application. Referring to fig. 9, the smart phone includes: radio Frequency (RF) circuit 910, memory 920, input unit 930, display unit 940, sensor 950, audio circuit 960, wireless fidelity (WiFi) module 970, processor 980, and power supply 990. The input unit 930 may include a touch panel 931 and other input devices 932, and the display unit 940 may include a display panel 941. Those skilled in the art will appreciate that the smartphone configuration shown in fig. 9 is not limiting and may include more or fewer components than shown, or some components in combination, or a different arrangement of components.

The memory 920 may be used to store software programs and modules, and the processor 980 may execute various functional applications and data processing of the smart phone by operating the software programs and modules stored in the memory 920. The memory 920 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the smartphone, and the like. Further, the memory 920 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 980 is a control center of the smartphone, connects various parts of the entire smartphone by using various interfaces and lines, and performs various functions of the smartphone and processes data by running or executing software programs and/or modules stored in the memory 920 and calling data stored in the memory 920, thereby integrally monitoring the smartphone. Alternatively, processor 980 may include one or more processing units; preferably, the processor 980 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 980.

In this embodiment, the processor 980 in the terminal device may perform the following steps;

in the process of interaction between a user and an application, responding to input operation executed by the user through the target equipment node under a preset condition, and collecting state change data;

processing the collected state change data to generate interaction information;

receiving interaction information of the target equipment node connected with the main node through the main node by utilizing a data transmission function among the plurality of equipment nodes;

and reporting the interaction information on the main node to the terminal equipment by using a data transmission function between the main node and the terminal equipment so that the terminal equipment can realize the interaction between the user and the target object in the application according to the interaction information and the mapping relation.

Or the like, or, alternatively,

receiving the interactive information reported by the main node;

determining a target object in the application for which the interaction information aims according to the mapping relation;

and finishing the interaction between the user and the application according to the interaction information and the target object.

According to an aspect of the present application, a computer-readable storage medium is provided, which is used for storing a program code for executing the method for inputting based on an input peripheral according to the foregoing embodiments.

According to an aspect of the application, a computer program product or computer program is provided, comprising computer instructions, the computer instructions being stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method provided in the various alternative implementations of the embodiment.

The terms "first," "second," "third," "fourth," and the like in the description of the application and the above-described figures, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

The above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims (15)

1. A method for inputting based on input peripheral equipment is characterized in that the input peripheral equipment comprises a plurality of equipment nodes, the equipment nodes are connected in a mesh networking mode, the equipment nodes comprise equipment nodes serving as main nodes, the main nodes are in network connection with terminal equipment and used for avoiding the limitation of the equipment nodes by the network connection number of the terminal equipment, the terminal equipment runs an application, and the equipment nodes and an object in the application have a mapping relation, and the method comprises the following steps:

judging the limited network connection quantity of the terminal equipment;

determining the master nodes from the plurality of equipment nodes according to the limited network connection number of the terminal equipment, so that the number of the master nodes is the same as the limited network connection number of the terminal equipment;

in the process of interaction between a user and an application, responding to input operation executed by the user through a target equipment node under a preset condition, and collecting state change data;

processing the collected state change data to generate interaction information;

receiving interaction information of the target equipment node connected with the main node through the main node by utilizing a data transmission function among the plurality of equipment nodes;

and reporting the interaction information on the main node to the terminal equipment by using a data transmission function between the main node and the terminal equipment so that the terminal equipment can realize the interaction between the user and the target object in the application according to the interaction information and the mapping relation.

2. The method of claim 1, wherein the device nodes are in a ring-like configuration, and wherein the plurality of device nodes are worn by the user.

3. The method of claim 2, wherein the device nodes are made of a stretchable material.

4. The method according to claim 1, wherein the interaction information comprises an action instruction, and the action instruction is used for instructing the terminal device to execute an action corresponding to the action instruction for the target object.

5. The method of claim 1, wherein the application is a piano type game application, and the mapping relationship is a mapping relationship between the plurality of device nodes and different music tracks in the piano type game application.

6. The method of claim 5, wherein the preset condition is a musical piece on a music track falling to a hitting position, or a vibration or sound feedback from the target device node.

7. The method according to claim 5, wherein if the plurality of device nodes are respectively worn on different fingers of the user, the input operation is a click action of a finger of the user wearing the target device node, and the target device node is a device node having a mapping relation with a music track where the music piece falls to the hitting position.

8. The method of claim 1, wherein the device node is a touch screen or drumstick.

9. The method according to any one of claims 1-8, wherein collecting state change data in response to an input operation performed by the user through a target device node under a preset condition comprises:

and acquiring the state change data through a sensor unit.

10. The method of claim 9, wherein the sensor unit comprises one or more combinations of a pressure sensor, an acceleration sensor, a gyroscope, and a heart rate sensor.

11. The device for performing input based on the input peripheral is characterized in that the input peripheral comprises a plurality of device nodes, the device nodes are connected in a mesh networking mode, the device nodes comprise device nodes serving as main nodes, the main nodes are in network connection with terminal devices and used for avoiding the limitation of the device nodes by the network connection number of the terminal devices, the terminal devices run applications, and the device comprises an acquisition unit, a generation unit, a receiving unit and a reporting unit, wherein the mapping relation is formed between the device nodes and objects in the applications, and the acquisition unit comprises:

the device is used for judging the limited network connection number of the terminal equipment; determining the master nodes from the plurality of equipment nodes according to the limited network connection number of the terminal equipment, so that the number of the master nodes is the same as the limited network connection number of the terminal equipment;

the acquisition unit is used for responding to input operation executed by a user through a target equipment node under a preset condition in the process of interaction between the user and an application, and acquiring state change data;

the generating unit is used for processing the acquired state change data to generate interactive information;

the receiving unit is configured to receive, by using a data transmission function among the plurality of device nodes, interaction information of the target device node connected to the master node through the master node;

the reporting unit is configured to report the interaction information on the master node to the terminal device by using a data transmission function between the master node and the terminal device, so that the terminal device implements interaction between the user and the target object in the application according to the interaction information and the mapping relationship.

12. The system for inputting based on the input peripheral is characterized by comprising the input peripheral and a terminal device, wherein the input peripheral comprises a plurality of device nodes, the device nodes are connected in a mesh networking mode, the device nodes comprise device nodes serving as main nodes, the main nodes are in network connection with the terminal device and used for avoiding the limitation of the network connection number of the terminal device on the device nodes, the terminal device runs an application, and the device nodes and an object in the application have a mapping relation:

the system is used for judging the limited network connection number of the terminal equipment; determining the master nodes from the plurality of equipment nodes according to the limited network connection number of the terminal equipment, so that the number of the master nodes is the same as the limited network connection number of the terminal equipment;

the input peripheral is used for responding to input operation executed by a user through a target equipment node under a preset condition in the process of interaction between the user and an application, and acquiring state change data; processing the collected state change data to generate interaction information; receiving interaction information of the target equipment node connected with the main node through the main node by utilizing a data transmission function among the plurality of equipment nodes; reporting the interaction information on the main node to the terminal equipment by using a data transmission function between the main node and the terminal equipment;

the terminal equipment is used for receiving the interactive information reported by the main node; determining a target object in the application for which the interaction information aims according to the mapping relation; and finishing the interaction between the user and the application according to the interaction information and the target object.

13. The system according to claim 12, wherein the application is a piano type game application, the mapping relationships are mapping relationships between the plurality of device nodes and different music tracks in the piano type game application, the target object is a target music track, the interaction information includes an action instruction, and the terminal device is configured to strike a striking position on the target music track according to the action instruction.

14. An apparatus for input based on an input peripheral, the apparatus comprising a processor and a memory:

the memory is used for storing program codes and transmitting the program codes to the processor;

the processor is configured to perform the method of any of claims 1-10 according to instructions in the program code.

15. A computer-readable storage medium, characterized in that the computer-readable storage medium is for storing program code for implementing the method of any of claims 1-10 when executed by a processor.