CN109008166A - A kind of intelligence school bag system and management method - Google Patents

Abstract

The present invention relates to a kind of intelligent school bag system and management methods, system includes intelligent school bag, server and interactive controlling module, and the function that system is realized includes distance communicating, tone information, GPS electronic map, fence alarm, emergency alarm, school bag is overweight prompts etc..In addition, realizing the management method of the intelligent school bag of a kind of " intelligent curriculum table " in conjunction with the use of system.Compared with prior art, the present invention is not based on the mode made a phone call and realizes voice communication, nor transmitting GPS information by way of short message, but establish a set of real-time communication system Internet-based, all information including audio/video all carry out digitized processing and transmission by system, whereby, it be free to define its working method, and extend its function, it solves child going to school on road and in school and the communication problem and safety problem of parent, a kind of management method of intelligent school bag, the studying and living of convenient child are provided simultaneously.

Description

An intelligent schoolbag system and management method

technical field

The invention relates to the field of smart wear technology, in particular to a smart school bag system and management method.

Background technique

Children are the treasure of the family and the future of the motherland. Parents hope to keep in touch with their children at all times and stay away from danger. However, today's mobile phones are not allowed to be brought into schools because of their various functions and hindering learning. Although some smart watches currently used by students can solve the problem of communication between children and parents, they also have many disadvantages: such as limited functions (only voice calls, GPS inquiries), electromagnetic radiation, and frequent charging.

Young children generally only leave their parents when they go to school. The dangers of children often occur on the way to school. Schoolbags are must-have items for children, and the schoolbags are enough to accommodate the battery power required by smart components, which can ensure their long-term work. No need to recharge frequently. So the school bag is the best as the carrier of smart components.

The technical scheme of the existing smart schoolbag that can be used for calls and GPS positioning is generally: the audio analog signals of the microphone and the loudspeaker are directly connected to the mobile phone module without being processed by the main control. The main control generally adopts a single-chip microcomputer, and sends AT commands through the serial port to control the mobile phone module to make calls. The main control obtains the GPS latitude and longitude data through the serial port. GPS data transmission method 1: open the mobile phone APP, request to obtain the GPS data of the schoolbag through a text message, and the schoolbag sends a text message through the AT command to reply to the GPS information; method 2: open the mobile phone APP, and notify the other party of your IP and port number by text message, the schoolbag After obtaining the information on the mobile phone side, the GPRS (2G technology) is used to log in to the APP side of the mobile phone through AT commands, and upload GPS or other information. The mobile phone module must have its own protocol stack.

In the existing technical solution, there is no server link, no fixed IP and port number, and it is point-to-point communication. However, the IP and port number on the side of the school bag and the APP side of the mobile phone are not fixed, whether it is a mobile phone or a home broadband. Change at any time, so it is necessary to inform the other party of his current IP and port number in some way (basically only through SMS) to establish a connection.

The above-mentioned technical solution is relatively simple to realize, but the disadvantages are also obvious. Assuming that the data communication adopts GPRS (the communication delay of the short message mode is longer and the cost is higher, the effect is poor, and it will not be discussed here), the disadvantages are as follows:

1. The response of data communication is slow. Before establishing GPRS, it is necessary to shake hands by SMS.

2. Calls use the voice channel of the mobile phone, which can only be limited by the function of the mobile phone voice call, and cannot realize its own additional functions: for example, in an emergency, it can only make calls in turn, and cannot leave voice messages (referring to the inability to implement voice messages similar to WeChat. Message function, the voicemail provided by the operator is very inconvenient), unable to distinguish between emergency help and ordinary calls, unable to dynamically block ringing, etc.

3. The GPRS communication can only be established after the mobile APP is online, and the mobile APP is generally closed: the Apple mobile phone does not allow the APP to work for a long time, and it will be killed after exiting the front desk for 10 minutes, only through push (must pass through the server) way Only in order to convey the information; although the APP of the Android mobile phone is allowed to work for a long time, it is very difficult to apply for the permission. Different brands and different versions have different application methods. In addition, there is no possibility of maintaining a long link between the schoolbag side and the mobile APP. This will result in the inability to obtain information on the schoolbag side when the mobile APP is closed. The information is stored locally on the schoolbag side. After an emergency occurs, the mobile APP cannot contact the schoolbag side, and thus cannot obtain historical data on the schoolbag side.

4. The data connection established in this point-to-point way can transmit very limited data information and cannot be extended in function.

Contents of the invention

The purpose of the present invention is to provide a smart schoolbag-based monitoring system in order to overcome the above-mentioned defects in the prior art.

The purpose of the present invention can be achieved through the following technical solutions:

An intelligent schoolbag system includes a schoolbag body, a server and an interactive control module, the schoolbag body includes a schoolbag control device installed on the schoolbag body, the interactive control module is an application program installed on a communication terminal, the schoolbag, The server and the interactive control module are all based on Internet communication, and a real-time communication connection is established between the school bag and the interactive control module through the server, which is used for real-time voice interaction between the two parties or to leave a message for the other party, wherein:

The schoolbag control device includes: a main control unit and a control interface connected to the main control unit, a voice interaction unit, a communication unit, and a power supply unit. The schoolbag user controls the smart schoolbag through the control interface, including initiating call requests and answering messages; The voice interaction unit is used to collect voice information around the smart schoolbag and play the voice information from the interactive control module; the communication unit includes a mobile phone module, which is used as a MODEM to transmit information in the Internet; the main control unit controls and coordinates The work of other units is used to realize audio codec, communication message organization and analysis, data storage and communication control;

The interactive control module: establishes a communication connection with the schoolbag control device through the server; is used for information interaction including voice calls and messages with the smart schoolbag; is used for remotely setting parameters of the schoolbag control device;

The server: used to implement communication between the schoolbag control device and the interactive control module, and establish a communication connection including a P2P peer-to-peer connection for the schoolbag control device and the interactive control module.

Preferably, the schoolbag control device further includes a GPS module and/or a weighing unit, the GPS module is connected to the main control unit for obtaining the location information of the schoolbag; the weighing unit includes a pressure sensor and an AD conversion module, The pressure sensor is connected to the main control unit through an AD conversion module, and the pressure sensor is arranged at the bottom of the schoolbag body.

Preferably, the schoolbag control device further includes a video information collection unit, which is used to collect and transmit video information around the schoolbag when the smart schoolbag initiates an emergency call, and the main control unit also has video encoding and transmission functions.

Preferably, the control interface includes a wire control indicator board and/or an emergency help switch, and the wire control indicator board is provided with a volume control button, a call control button, a voice message control button and an indicator light, and the control interface is set on The shoulder strap of the bag body.

Preferably, the communication unit further includes: a wired network port and/or a wireless WIFI module.

Preferably, the server includes an interactive control module user information database and a smart schoolbag information database; maintains an online interactive control module user and online smart schoolbag information data link list including IP addresses and port numbers.

Preferably, the functions of the interactive control module include: schoolbag remote parameter setting, schoolbag local parameter setting, video call, voice call, voice message, schoolbag electronic map, schoolbag data record viewing, real-time call request, alarm prompt and push, interactive Historical information records, user registration and login, and parameter settings.

Preferably, the smart schoolbag adopts UDP communication mode and interactive control module to realize long-distance real-time transmission of video and audio data, and the specific process includes:

After the code stream of the smart schoolbag is compressed, encoded, time stamped, synchronized, encrypted, packaged, and placed in the device storage pool, it is transmitted to the interactive control module through UDP communication and stored in the storage pool temporarily. After sorting , the interactive control module judges whether there is a missing frame in the transmitted code stream, and if so, requests the smart school bag to be reissued; otherwise, the sorted data packet is decrypted and decoded, and enters a playable state.

Preferably, the process of logging into the server by the smart schoolbag or the interactive control module includes:

After the smart schoolbag/interactive control module is started, it communicates with the server through UDP communication; the server checks the ID and password of the other party and logs in to the server. With the assistance of the server, the smart schoolbag/interactive control module judges its own NAT type and reports it to the Server; the server checks whether the other party has offline information, and if so, reissues the offline information; the smart schoolbag/interactive control module enters a normal communication state and maintains a heartbeat long connection;

In addition to the above process, the interactive control module also includes the process of registering with the push server to obtain a token, and reporting the token to the server.

An intelligent schoolbag management method of the above-mentioned intelligent schoolbag system, comprising:

Remotely set parameters for the smart schoolbag through the interaction module;

The set parameters include a class timetable, with a week as a cycle, set the daily wake-up time, bed time, school and school time, daily course schedule and time;

The smart schoolbag is intelligently processed according to the content of the curriculum and the arrangement of the time period, including:

Time reminder: wake-up alarm reminder, going out reminder, daily course reminder, sleep reminder; do-not-disturb setting during class time: automatically turn to mute, and all call requests are automatically transferred to voice messages; according to the settings, the weak courses are automatically taught Recording; automatic management of power supply according to the time period: the smart schoolbag also enters the dormant state during the sleep time period, fully functional operation during the school and school time periods, and enters the semi-dormant state during the school study period.

Compared with the prior art, the present invention has the following advantages:

1. Different from the existing methods of talking through the voice channel of the mobile phone and reporting the GPS position through SMS or GPRS, the intelligent schoolbag and the interactive control module in the present invention are all online in real time and keep connected with the server; even if the interactive control module is not started, the information It can still be sent to the push server through the server of this system, and delivered to the communication terminal in real time; even if the communication terminal is not powered on, after the interactive control module is launched, the server will resend the missing information to the interactive control module, so as to ensure the information. timeliness and deliverability.

2. The present invention adopts a self-built real-time video and audio transmission system, and the processing and transmission of voice and video all go through digital channels, so there is a very large degree of freedom, and many self-defined functions can be realized, for example: in an emergency, it can be sent simultaneously to Multiple people initiate a call for help, and can realize one-to-many communication to improve the success rate of the alarm; the realization of the voice message function; the viewing of audio and video recordings; the system is closed, and strangers cannot access; it can automatically enter Do Not Disturb according to the timetable setting status etc.

3. In addition to transmitting video and audio information, the system of the present invention can also transmit other information. For example, the smart schoolbag sends GPS positioning information, and the interactive control module can realize electronic maps and electronic fence alarm functions; the overweight alarm prompt of the smart schoolbag can be sent to The interactive control module is for parents to supervise; these information and audio-visual information go through the same digital channel, which can also ensure its timeliness and delivery rate.

Description of drawings

Fig. 1 is a schematic diagram of the system structure of the present invention;

Fig. 2 is the structural representation of each intelligent part of intelligent school bag control device among the present invention;

Fig. 3 is a schematic diagram of the appearance of the smart book in the embodiment;

Fig. 4 is a schematic diagram of the appearance of one side of the remote control indicator board in the embodiment;

Fig. 5 is a schematic diagram of the appearance of the side opposite to Fig. 4 of the remote control indicator board in the embodiment;

Fig. 6 is a schematic diagram of the hardware structure of the intelligent schoolbag control device in the embodiment;

Fig. 7 is the functional block diagram of interactive control module in the embodiment;

Fig. 8 is the video encoding flowchart of smart schoolbag in the embodiment;

Fig. 9 is the audio coding flowchart of smart schoolbag in the embodiment;

Fig. 10 is the audio decoding flowchart of smart schoolbag in the embodiment;

Fig. 11 is the first login and parameter setting flowchart of the smart schoolbag in the embodiment;

Fig. 12 is the flow chart of the login process of the smart schoolbag in the embodiment;

Fig. 13 is a flow chart of the login process of the interactive control module in the embodiment;

Fig. 14 is a flow chart of real-time video and audio data transmission in the embodiment;

Fig. 15 is a flow chart of the realization of the remote recording/image playing (ie leaving a message) function.

Labels in the figure: 1. Microprocessor, 2. WIFI module, 3. Mobile phone module, 4. Power management module, 5. Charging control circuit, 6. Battery, 7. AD conversion module, 8. Pressure sensor, 9. Emergency Help switch, 10, wire control indicator board, 11, camera, 12, speaker, 13, microphone, 14, memory, 15, GPS module, 16, plus button, 17, indicator light, 18, minus button, 19, microphone slot , 20, call control button, 21, voice message control button.

Detailed ways

This application proposes an intelligent schoolbag system and management method to solve communication and safety issues between children on the way to school and with their parents at school, and to facilitate children's life and study. The specific functions realized by this system include: voice call: use the data channel without dialing link; voice message: similar to WeChat communication instead of voice mailbox; emergency help: video call is allowed when emergency help is needed, and multiple parties can be called at the same time Access monitoring, viewing, improve the success rate of the alarm, video and audio data are uploaded to the server at the same time for archiving; GPS electronic map; electronic fence alarm; When events such as calls, alarms, and messages occur, if the party receiving the information is not online, the event will be recorded. Once the other party is online, the receiving party will be notified as soon as possible; this system is closed, and strangers cannot access the system .

In addition, the intelligent management of schoolbags is realized by means of the aforementioned intelligent curriculum.

The system structure of the present invention is shown in Fig. 1, comprises intelligent schoolbag, server and interactive control module, and system realizes real-time, high-efficiency, many-to-many network communication through Internet under the assistance of server: under normal state, intelligent schoolbag and The interactive control module transmits information through the server; in the case of big data communication, the smart schoolbag establishes a direct P2P peer-to-peer connection with the interactive control module through the server.

The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments. This embodiment is carried out on the premise of the technical solution of the present invention, and detailed implementation and specific operation process are given, but the protection scope of the present invention is not limited to the following embodiments.

Example

In this embodiment, the communication terminal is specifically a mobile phone, and the interactive control module is specifically a mobile APP. The smart schoolbag includes a schoolbag body and a schoolbag control device located on the schoolbag body. The structure of each intelligent component of the schoolbag control device is shown in Figure 2, and each part will be explained one by one below.

The schoolbag control device includes a main control unit, an interactive unit connected to the main control unit, a control interface, a communication unit, a power supply unit, a GPS module and a weighing unit. Both the smart schoolbag and the mobile APP actively maintain a connection with the server, the status information of both parties is up-to-date, the GPS position is refreshed in real time, and the program on the schoolbag side can be updated remotely; If the other party is not online, the server will record the event and notify the other party as soon as the other party is online; when a voice or video call is required, the server helps the smart schoolbag and the mobile APP to establish a peer-to-peer connection. The server maintains an information list of all online smart schoolbags and an information list of all online mobile APPs.

The interactive unit includes a camera 11 for video collection, a speaker 12 and a microphone 13 for voice interaction.

The main control unit is the core part of the smart schoolbag. The main control unit includes a microprocessor 1 and a memory 14. The main control unit is connected to other units to coordinate and control the work of other units, and the realization includes video collection, audio collection and playback, communication message organization and analysis, data storage, load evaluation, power management control, GPS positioning and many other functions. A serial connection is adopted between the GPS module 15 and the microprocessor 1 .

The communication unit is a mobile phone module 3, which may also include a WIFI module 2. The communication unit is connected to the mobile phone public network through the mobile phone module 3 or to the Internet through the WIFI module 2 . Mobile phone module 3 is currently a 4G module, which is only used as a modem (MODEM), and all communications (including voice) use data channels. WIFI module 2, mobile phone module 3 and microprocessor 1 are all connected by USB, and automatically access WIFI under the environment of WIFI, and use mobile phone public network (currently 4G) to access in public places. When the emergency help is activated and the surrounding 4G signal is not good, it will switch to the voice channel of the mobile phone and contact the parents by automatically dialing the phone to ensure the delivery of the help information.

The control interface includes a wire control indicator board 10 and an emergency help switch 9 . The control interface is set at the shoulder strap of the schoolbag body, as shown in Figure 3. As shown in Figures 4 and 5, the wire control indicator board 10 is similar in appearance to an earphone wire control device. It is provided with a microphone slot 19 and a built-in radio microphone 13. The emergency help switch is realized by a combination of buttons, which is not easy to touch by mistake and the operation is concealed. The line control indicator board 10 is provided with a volume control button, a call control button 20 , a voice message control button 21 and an indicator light 17 . The volume control buttons include a plus button 16 and a minus button 18 . Indicator light 17 is provided with multiple, comprises two kinds of states, and a kind of is long bright, and a kind of is flickering. Indicator lights 17 are long bright and are used to select the object of calling and leaving a message. Each indicator light 17 represents a different APP user object, and the number of indicator lights 17 is the maximum number of contact objects that can be set. Indicator light 17 flickers and represents that the message message sent by the corresponding APP user is unread, and only the message sent last time is indicated, so only one indicator light 17 may flicker. The functions of the plus button 16 and the minus button 18 include: volume control; user selection of the call partner; selection when listening to messages.

The specific operation method of the remote control indicator board 10 is as follows:

1) When a call is required, use the plus/minus button to select the call partner, then press and hold the call control button 20, and hear a beep, indicating that the operation has been accepted, and press it again to cancel or hang up the call.

2) When leaving a message, first select the contact person, then press and hold the voice message control button 21, and then leave a message when you hear a beep. When leaving a message, you still need to press and hold it. After releasing the button, the message ends. The smart schoolbag sends the message to the mobile APP in the form of a file, and you can listen to it by clicking in the APP.

3) When listening to the message, a certain APP user sends a message, the message is sent in the form of a file, and is forwarded and stored in the smart schoolbag by the server, and the indicator light 17 representing the APP user flashes to remind the smart schoolbag to check. When needing to listen, press plus button 16 or minus button 18 for a long time, voice messages can be played without selecting an object, and all unread voice messages will be played automatically. After the message has been heard, the flashing of the indicator light 17 will stop; if you want to listen to the message again, you can press the plus button 16 or the minus button 18 to enter the message reading state, and then press the plus button 16 or the minus button 18 to select the previous paragraph or the next paragraph. A message.

4) Alarm for help, press and hold the 4 buttons on the wire control indicator board 10 at the same time, and it needs two hands to complete, which can prevent misuse and trigger an alarm for help. The sound from the APP attracted the attention of the gangsters, and the smart schoolbag sent live video and audio to multiple APP users.

The weighing unit includes a pressure sensor 8 and an AD conversion module 7, the pressure sensor 8 is connected to the main control unit through the AD conversion module 7, and the pressure sensor 8 is arranged at the bottom of the schoolbag body. The weighing unit is used to evaluate the load of the smart schoolbag. The schoolbag load data obtained by the weighing unit is compared with the set parameters. When it is overweight, a local sound prompt will be triggered, and it will also be uploaded to the mobile APP as an event prompt.

The power supply unit includes a charging control circuit 5, a battery 6, and a power management module 4. The main control unit controls the power supply of the battery 6 through the power management module 4, and mainly controls the GPS module 15, the mobile phone module 3, and the WIFI module 2, which consume more power. Power supply for unit modules. The hardware part of the power management module 4 is realized by using MOS transistors or power management chips. The power management control function of the main control unit is responsible for the distribution of electric energy to achieve the effect of energy saving, which can be set remotely through the mobile phone APP.

The layout of each intelligent component in the schoolbag body is shown in Figure 3. The button wire control indicator board 10 is on the side of the shoulder strap for easy operation; the front of the schoolbag body is provided with a logo mark, and the camera 11 is hidden at the schoolbag logo; the battery 6 and The main board of the main control unit is arranged in a waterproof hard box, located on the side of the school bag, to avoid being squeezed; the pressure sensor 8 is fixed at the bottom of the school bag. The above four parts are connected by flexible wires buried in the schoolbag, and there are connectors at the joints. When the schoolbag needs to be cleaned, the four parts are separated and taken off.

In this embodiment, the hardware structure of the smart schoolbag control device is shown in FIG. 6 . The microprocessor 1 adopts the linux operating system, and the main chip is Huawei HiSilicon HI35XX series chips, specifically the HI3518E chip, which adopts the ARM9 architecture and can run the linux operating system, with built-in DDR2 memory, which saves the wiring trouble of external DDR. The video encoding format is H264, and the encoding capability is 720P@25fps. Due to the use of hardware encoding, the computing power can be released for other processing. The lens chip of camera 11 adopts OV9712, and other chips such as AR0130 can also be used. Memory 14 includes Flash memory, large-capacity TF card and parameter memory. The Flash memory adopts W25Q128 (128Mbit), which is connected with HI3518E through SPI interface. The parameter memory adopts E2PROM, which is connected to HI3518E through I2C interface. The large-capacity TF card is used to store information such as video and audio data, historical data, event records, etc., and is connected to HI3518E through the SDIO interface to store video and audio data. HI3518E only has one USB2.0 (HOST) interface, so when connecting WIFI module 2 and mobile phone module 3 at the same time, it needs to be expanded with a Hub chip. The HI3518E chip has a built-in high-precision RTC, and the clock part only needs to provide crystal oscillator and battery power protection. The HI3518E is connected to the speaker 12 through the power amplifier chip HXJ8002.

The AD conversion module 7 in the weighing unit adopts HX711, and is connected to the microprocessor 1 through a connection line including a data line and a pulse line. Generally, automatic testing is performed at the beginning of school and school hours, and relevant prompts are made. The mobile APP can also manually initiate a test request to obtain the weight information of the schoolbag in real time.

The following is a detailed description of the functions of the mobile APP:

The functional units in the APP are shown in Figure 7, including: device list unit block; real-time call request, alarm push; user and all associated schoolbag interaction history information record list; user related information.

Among them, in addition to displaying the current state of each smart schoolbag (including online or offline, schoolbag load, battery voltage), and adding and deleting operations of smart schoolbags, the device list unit block can also perform the following operations on each smart schoolbag in the list: save The remote parameter setting of the smart schoolbag in the smart schoolbag control device includes alarm condition setting (including electric fence, load parameters), curriculum setting, contact list setting, security password setting, power management setting, program remote upgrade and other settings ;Set the local parameters of the smart schoolbag saved in the APP, including smart schoolbag picture settings, nickname settings, and access password settings; initiate video calls and voice calls to the smart schoolbag; electronic map of the schoolbag; remotely view smart schoolbag data records, including events, Leave a message, there is an unread message reminder in the record.

Among them, real-time call requests, alarm prompts and pushed content include: emergency help, call request, electronic fence crossing, overweight, voice message, etc.

Among them, the curriculum setting is used to realize the intelligent management of schoolbags.

Among them, the historical information record list of interaction between the user and all associated smart schoolbags is used to record the call requests and alarm prompts sent by the smart schoolbags, as well as all the pushed content, which are displayed in the order of unread first and recent events first, click Details can be viewed. For example, click on a historical message record sent by a smart schoolbag to answer the message content.

Among them, user-related information includes user registration and login information, user parameter settings and display information, including APP user avatar settings, nickname settings, access password settings, registration information modification, etc.

The following is a detailed description of the working principle of the server in this system:

The server of this system stores all mobile APP user information databases and smart schoolbag information databases, and maintains an online mobile APP user and smart schoolbag information data link list including IP addresses and port numbers. Under normal conditions, the smart schoolbag and the mobile phone APP exchange information through the server; when a large amount of data communication is required, such as establishing a video call, voice call, remote parameter setting of the schoolbag by the mobile phone, reading schoolbag data by the mobile phone, etc., the server Help the smart schoolbag and the mobile APP to establish a P2P channel, so that the two can communicate directly, reducing the communication burden on the server. Take the emergency help call initiated by the schoolbag side as an example: the target APP user list is specified in the emergency call message sent by the schoolbag side to the server, and the target APP user list includes multiple target users, which can improve the connection rate; List, find the IP address and port number of each APP user, and send an alarm call request to these APP users at the same time; the APP user returns a response signal to the server, and the server helps the schoolbag side and the user APP to establish a P2P communication connection. A smart schoolbag can establish communication connections with multiple user APPs at the same time.

In addition, the server is responsible for recording important events. For example, when an alarm or a call is made, the called party cannot be connected temporarily because it is not online, and the server will automatically record the information. Delivery of information.

The following is a detailed description of the software implementation process of the main functions between the smart schoolbag and the mobile phone APP in this system.

The video capture, audio capture, and playback processes of the smart schoolbag are shown in Figures 8, 9, and 10, respectively.

As shown in Figure 8, the video acquisition process includes: the VI module captures video images through the camera 11, performs processing such as cutting, zooming, and mirroring to it, and outputs image data of different resolutions according to parameter settings; the VPSS module receives the VI module and decodes The image sent by the module performs denoising, image enhancement, sharpening and other processing on the image; the encoding module receives the image data captured by the VI module and processed by VPSS and outputs it, superimposes the OSD image set by the user through the Region module, and adds time information. Then encode according to different protocols and output the corresponding code stream.

As shown in Figure 9, the audio collection process includes: the AI module captures audio data, and then the AENC module supports encoding it according to various audio protocols, and finally outputs the audio stream;

As shown in Figure 10, the audio playback process includes: the received audio code stream is directly sent to the ADEC module, and the ADEC module supports decoding a variety of different audio format code streams, and the decoded data is sent to the AO module to play the sound.

It should be noted that, due to privacy concerns, the video call is limited to emergency assistance.

The first login server and parameter setting process of the smart schoolbag are shown in Figure 11, including: First, add a new schoolbag on the mobile APP. If the schoolbag uses WIFI communication, you need to set the WIFI password for the schoolbag so that the schoolbag can connect to the network; then, the schoolbag side Actively connect to the server, the server checks the schoolbag ID and factory password, if the verification is passed, the schoolbag is added successfully, and the APP continues to remotely set parameters for the schoolbag. The parameters include the associated APP user list, emergency contacts, smart curriculum settings, etc., parameter settings When finished, send it to the device side and save it. Then, it enters the normal working state and keeps connected with the server by heartbeat.

For the step in the process of "setting the WiFi password for the smart schoolbag on the mobile phone APP so that the smart schoolbag can connect to the network", the newly shipped smart schoolbag needs to specify a WiFi network and set the WiFi password to connect to the network. The smart schoolbag does not have an input interface and can only Set parameters for it through the mobile phone APP. The specific implementation method can be adopted: 1) When the smart schoolbag is started, the WIFI module 2 enters the AP state by default and acts as a router for the mobile APP to access. Its network name and password are fixed. In the state of the new smart schoolbag, it will automatically search for the network. After successful connection, you can communicate. At this time, you can set the WiFi name and password for the smart schoolbag that it needs to log in; The APP sends a broadcast command, using the length information in the broadcast message (since the content of the message is all encrypted, only this information can be parsed), to send information, a set of broadcast messages is needed to piece together a complete WiFi name and password information , the smart schoolbag listens to the broadcast information, and parses the information you need; 3) Connect the router directly through the network interface of the smart schoolbag, and then the smart schoolbag will automatically obtain the IP and port, and connect to the server. Select the WiFi source and password for the smart schoolbag through the mobile APP. The mobile phone public network also needs parameter setting before it can connect to the network. The parameter setting also needs to be connected to the network by WIFI, and then set with the mobile phone APP. The main settings vary with different SIM card operators, and different operators have different PPP dial-up number and password.

Among them, the curriculum setting will be detailed in the management method, which will not be expanded here. Other settings include: the weight setting of the schoolbag, which can set the range according to the day. To set up, you need to learn once: after walking once, call up the track record, and then set the range parameters of the fence alarm, such as deviation from the track > 500m or 1KM.

Both the mobile APP and the smart schoolbag maintain the connection with the server through the heartbeat, because there is no heartbeat for a period of time, the link will be forcibly closed by the operator.

After the device is powered on or disconnected, the re-login process is shown in Figure 12, including:

The smart schoolbag is powered on and started; the smart schoolbag communicates with the server; the server checks the ID and password of the smart schoolbag and logs in to the server. With the assistance of the server, the smart schoolbag judges its own NAT type and reports it to the server; Offline information, if there is, reissue the offline information; the smart schoolbag enters the normal communication state and maintains a long heartbeat connection.

In Fig. 12, the step "dial-up Internet access of the PPP script" has only when the communication uses the mobile phone module 3, and the mobile phone module 3 is used as a MODEM. The step "judging the NAT type on the device side" is to prepare for the breakthrough of the P2P firewall. Because the devices on the network are generally behind the router (although the mobile phone public network cannot see the physical router, it is actually provided by the router service provided by the operator. All data arriving on the mobile phone APP must first pass through the firewall of the operator router Filtering: The outside of the NAT cannot directly access the inside of the NAT, and the inside of the NAT must first access the external IP and port, and the next time the data sent from the external IP and port may be allowed to penetrate the NAT, which is commonly known as the hole punching process), Protected by router firewall. Routers have four NAT types: full cone, restricted cone, port-restricted cone, and symmetric. Then there will be 16 NAT combination methods for the connection between the device and the mobile APP, and each combination method adopts a different scheme to realize the P2P connection, so it is necessary to first determine the NAT type at both ends of the P2P. Offline information means that when the server fails to deliver information to the smart schoolbag or mobile APP, the information is temporarily saved in the server's database, and reissued after receiving the login request or heartbeat request from the other party to prevent the omission of important information .

The first thing after the smart schoolbag is logged in, the server first checks from the database whether the smart schoolbag has offline information to be sent, and if so, reissue it first; then the schoolbag side can report its status and GPS information to the server, and pass the server Get the status of the associated mobile APP. This kind of communication is continuous, usually once every 30 seconds. The purpose of maintaining this long link is to reserve the right of the server to actively access the schoolbag side, because if there is no communication for a period of time, the link will be closed by the operator, and the IP on the schoolbag side And the port number is variable, and the server cannot contact the bag side when a call or alarm event occurs.

The login process of the interactive control module is shown in Figure 13, including:

The interactive control module starts; the interactive control module communicates with the server through the UDP communication connection; the server checks the ID and password of the interactive control module and logs in to the server; the interactive control module registers itself with the push server to obtain the token of the interactive control module of the current communication terminal; The interactive control module reports the token to the server, and when the network needs to be switched, the server judges the NAT type of the smart schoolbag; the server checks whether the interactive control module has offline information, and if so, reissues the offline information; the interactive control module enters the normal communication state.

For the step of obtaining the token of the APP from the push server, the function of the token of the APP is: the mobile phone APP generally only works when it is in the foreground. After exiting the foreground task, the APP is killed by the system, no longer works, and can no longer communicate with the server. At this time, the system service provider (Apple or Google) needs to provide a push notification, so that the mobile phone can receive the notification information sent to the APP. The token is the certificate that the push server pushes to the specified APP in the specified mobile phone. Generally, after an APP is installed on a mobile phone, the token of the APP will not change unless it is reinstalled; however, the user may log in through different mobile phones, and the tokens of the same APP on different mobile phones are different, so the token is re-reported every time they log in . When the server wants to send information to an APP user, it finds that the APP user is not online, that is, the APP is not working, but the mobile phone may still be turned on, so the information can only be sent to the push server. Specifically, according to the latest record in the database, Select the Apple or Google push server, and attach the target token, then the push server will send the information to the specified APP of the specified mobile phone according to the token.

The smart schoolbag uses UDP communication mode and interactive control module to realize long-distance real-time transmission of video and audio data. The specific process is shown in Figure 14, including:

After the code stream of the smart schoolbag is compressed, encoded, time stamped, synchronized, encrypted, packaged, and placed in the device storage pool, it is transmitted to the interactive control module through UDP communication and stored in the storage pool temporarily. After sorting , the interactive control module judges whether there is a missing frame in the transmitted code stream, and if so, requests the smart school bag to be reissued; otherwise, the sorted data packet is decrypted and decoded, and enters a playable state.

In addition, the realization principle of the electronic map function is as follows: only the longitude and latitude of the GPS of the smart schoolbag need to be reported, and other parts are realized by calling the library function interface of the electronic map provider in the mobile APP. The principle of the electronic fence function is: after obtaining the current latitude and longitude, compare it with the nearest point in the parameter trajectory, and if it exceeds the limit, an alarm will be issued. This algorithm is implemented on the schoolbag side.

With the help of the server, the communication between smart schoolbags can be realized, that is, the connection relationship of the dotted line in Figure 1 can be realized. At this time, the system can be applied to other bags, such as travel bags, to realize real-time communication between donkey friends. Communication needs.

The realization process of the remote recording/image playing (ie leaving a message) function is shown in Figure 15, which refers to playing the video files stored in the schoolbag side on the mobile phone APP side, and the leaving message function of the present invention is also realized in this way. The focus of the remote recording/image playback function is different from that of real-time transmission: the missing code retransmission of real-time transmission needs to be completed in a very short time, otherwise there will be a significant delay. The playback of video files does not have strict requirements on this, so the storage pool can be made larger, and there is sufficient time to request retransmission of missing codes; remote video playback adds pause, fast-forward, and rewind processing. It can be seen from the process that the video files are encrypted, and can be personalized if necessary, and only specific users are allowed to view them. For example, user passwords are required before viewing, which is beneficial to privacy protection.

Combined with the intelligent schoolbag system, the present invention also proposes a management method for the intelligent schoolbag, which realizes the intelligent management of the schoolbag by setting the curriculum schedule. It has been mentioned in the previous description of the functional structure block diagram of the interactive control module (Figure 7) and the first login of the smart schoolbag to the server and the parameter setting process (Figure 11). This management approach is implemented as follows:

The interactive control module remotely sets parameters for the smart schoolbag;

The set parameters include a class timetable, with a week as a cycle, set the daily wake-up time, bed time, school and school time, daily course schedule and time;

The smart schoolbag performs corresponding intelligent processing according to the content and time period arrangement in the curriculum. The specific functions include:

Time reminder: wake-up alarm reminder, going out reminder, daily course reminder, sleep reminder; do-not-disturb setting during class time: automatically turn to mute, and all call requests are automatically transferred to voice messages; according to the settings, the weak courses are automatically taught Recording; automatic management of power supply according to the time period: the smart schoolbag also enters the dormant state during the sleep time period, fully functional operation during the school and school time periods, and enters the semi-dormant state during the school study period.

Specifically, the interactive control module remotely sets the course schedule for the smart schoolbag. In addition to the school courses and time in the general sense, the course schedule also includes the daily wake-up time, school time period, school time period, and bedtime. Six-week extracurricular tutoring can also be listed. Since it involves voice broadcasting, the course name is selected through options, and subjects that are not available can be defined by yourself, but they are replaced by "other" when voice broadcasting courses. Because the voice bank of the curriculum is entered in advance and cannot be changed, it is also easy to operate. The course schedule is edited in the interactive control module, and then sent to the smart schoolbag for storage.

The smart schoolbag triggers corresponding tasks according to the set time: wake-up time for alarm reminders; school time starts, triggers out-going reminders, voice broadcasts course content, and weighs and detects schoolbags; The movement track is monitored; during the class time period, it automatically enters the do-not-disturb state. During this period, if the interactive control module initiates a call to the schoolbag, the message answered by the schoolbag contains a do-not-disturb sign. The interactive control module receives the sign and automatically cancels it. Call, switch to the message status, the user can send a message to the schoolbag, and the smart schoolbag will ring to remind you to check the message after class. The smart schoolbag can also automatically record the specified courses according to the settings, which is beneficial for after-school tutoring.

Of course, it is not absolute to trigger corresponding tasks according to the set schedule, and the smart schoolbag will be adjusted according to the actual situation. For example, the GPS positioning function will be turned on intermittently in other time periods. When the schoolbag is detected to have moved before the school time period begins, it will not be reminded to go out, but will directly enter the GPS positioning monitoring state.

The smart schoolbag also performs automatic power management according to the set schedule, and all functions are turned on during school and school hours; the GPS module and communication module are powered intermittently during other working hours; most functions are turned off during sleep time, which greatly prolongs the battery life.

The above is only an explanation to illustrate the core content of the present invention, and those skilled in the art can easily understand the basic concept of the present invention and make certain changes or modifications. Any modification, replacement or improvement within the basic idea and principle of the present invention shall fall within the scope of protection of the present invention.

Claims (10)

1. A kind of intelligent schoolbag system, comprises schoolbag body, server and interactive control module, described schoolbag body comprises the schoolbag control device installed on the schoolbag body, and described interactive control module is the application program installed on the communication terminal, its feature In that, the schoolbag, the server, and the interactive control module are all based on Internet communication, and a real-time communication connection is established through the server between the schoolbag and the interactive control module for real-time voice interaction between the two parties or to leave a message for the other party, wherein: The schoolbag control device includes: a main control unit and a control interface connected to the main control unit, a voice interaction unit, a communication unit, and a power supply unit. The schoolbag user controls the smart schoolbag through the control interface, including initiating call requests and answering messages; The voice interaction unit is used to collect voice information around the smart schoolbag and play the voice information from the interactive control module; the communication unit includes a mobile phone module, which is used as a MODEM to transmit information in the Internet; the main control unit controls and coordinates The work of other units is used to realize audio codec, communication message organization and analysis, data storage and communication control; The interactive control module: establishes a communication connection with the schoolbag control device through the server; is used for information interaction including voice calls and messages with the smart schoolbag; is used for remotely setting parameters of the schoolbag control device; The server: used to implement communication between the schoolbag control device and the interactive control module, and establish a communication connection including a P2P peer-to-peer connection for the schoolbag control device and the interactive control module. 2. A kind of intelligent schoolbag system according to claim 1, characterized in that, the schoolbag control device also includes a GPS module and/or a weighing unit, and the GPS module is connected with the main control unit for obtaining the weight of the schoolbag. Positioning information; the weighing unit includes a pressure sensor and an AD conversion module, the pressure sensor is connected to the main control unit through the AD conversion module, and the pressure sensor is arranged at the bottom of the schoolbag body. 3. A kind of intelligent schoolbag system according to claim 1, characterized in that, the schoolbag control device also includes a video information acquisition unit, which is used for collecting and transmitting video information around the schoolbag when the intelligent schoolbag initiates an emergency call for help, the The main control unit also has video encoding and transmission functions. 4. A kind of intelligent schoolbag system according to claim 1, characterized in that, the control interface includes a wire control indicator board and/or an emergency help switch, and the wire control indicator board is provided with a volume control button, a call control button, a voice message control button and an indicator light, and the control interface is arranged at the shoulder strap of the schoolbag body. 5. A smart schoolbag system according to claim 1, wherein the communication unit further comprises: a wired network port and/or a wireless WIFI module. 6. A kind of intelligent school bag system according to claim 1, is characterized in that, described server comprises interactive control module user information database and intelligent school bag information database; Maintains an online interaction including IP address, port number Control module user and online intelligent schoolbag information data linked list. 7. A kind of intelligent school bag system according to claim 1, characterized in that, the functions of the interactive control module include: school bag remote parameter setting, school bag local parameter setting, video call, voice call, voice message, school bag electronic map , school bag data record viewing, real-time call request, alarm prompt and push, interactive historical information record, user registration and login and parameter setting. 8. A kind of intelligent schoolbag system according to claim 1, characterized in that, said intelligent schoolbag adopts UDP communication mode and interactive control module to realize long-distance real-time transmission of video and audio data, and the specific process includes: After the code stream of the smart schoolbag is compressed, encoded, time stamped, synchronized, encrypted, packaged, and placed in the device storage pool, it is transmitted to the interactive control module through UDP communication and stored in the storage pool temporarily. After sorting , the interactive control module judges whether there is a missing frame in the transmitted code stream, and if so, requests the smart school bag to be reissued; otherwise, the sorted data packet is decrypted and decoded, and enters a playable state. 9. A kind of intelligent schoolbag system according to claim 1, characterized in that, the process of logging in the server of the intelligent schoolbag or the interactive control module comprises: After the smart schoolbag/interactive control module is started, it communicates with the server through UDP communication; the server checks the ID and password of the other party and logs in to the server. With the assistance of the server, the smart schoolbag/interactive control module judges its own NAT type and reports it to the Server; the server checks whether the other party has offline information, and if so, reissues the offline information; the smart schoolbag/interactive control module enters a normal communication state and maintains a heartbeat long connection; In addition to the above process, the interactive control module also includes the process of registering with the push server to obtain a token, and reporting the token to the server. 10. An intelligent schoolbag management method of the intelligent schoolbag system according to any one of claims 1 to 9, characterized in that it comprises: Remotely set parameters for the smart schoolbag through the interaction module; The set parameters include a class timetable, with a week as a cycle, set the daily wake-up time, bed time, school and school time, daily course schedule and time; The smart schoolbag is intelligently processed according to the content of the curriculum and the arrangement of the time period, including: Time reminder: wake-up alarm reminder, going out reminder, daily course reminder, sleep reminder; do-not-disturb setting during class time: automatically turn to mute, and all call requests are automatically transferred to voice messages; according to the settings, the weak courses are automatically taught Recording; automatic management of power supply according to the time period: the smart schoolbag also enters the dormant state during the sleep time period, fully functional operation during the school and school time periods, and enters the semi-dormant state during the school study period.