CN109300112A - Instrument maintaining method and device based on AR - Google Patents
Instrument maintaining method and device based on AR Download PDFInfo
- Publication number
- CN109300112A CN109300112A CN201810980615.3A CN201810980615A CN109300112A CN 109300112 A CN109300112 A CN 109300112A CN 201810980615 A CN201810980615 A CN 201810980615A CN 109300112 A CN109300112 A CN 109300112A
- Authority
- CN
- China
- Prior art keywords
- image data
- target instrument
- instrument
- maintenance
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/20—Administration of product repair or maintenance
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
- G06T7/001—Industrial image inspection using an image reference approach
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30164—Workpiece; Machine component
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30204—Marker
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- Operations Research (AREA)
- General Business, Economics & Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Economics (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention provides a kind of instrument maintaining method and device based on AR, and wherein method includes: to obtain the first image data of target instrument, and the first image data include the video or image of the target instrument；First image data of the target instrument is sent to maintain equipment, to make the to maintain equipment that the first image data be presented in a manner of AR.A kind of instrument maintaining method and device based on AR provided by the invention, even if enabling to the maintenance personnel of instrument not at instrument scene, also the first image data that can be presented in a manner of AR by maintain equipment can be appreciated that the fault condition of object machine tool to safeguard to target instrument, to reduce the time cost and human cost of instrument maintenance, and improve the efficiency of instrument maintenance.
Description
Technical Field
The invention relates to the technical field of Augmented Reality (AR), in particular to an AR-based instrument maintenance method and device.
Background
At present, when an instrument in the engineering field is maintained, a diagnostician usually surveys a target instrument to be maintained on the site, determines a specific fault and a position where the fault occurs, and then informs the on-site maintainer of the part where the instrument needs to be maintained, so that the maintainer can maintain the instrument according to the guidance of the diagnostician.
However, as the need for maintenance of the instruments increases, according to the above technical solutions in the prior art, experienced instrument diagnosticians and maintenance personnel of the relevant instruments are often required to be present at the same time during maintenance of the instruments, which increases the time cost and the labor cost for maintaining the engineering instruments, thereby resulting in low efficiency of maintenance of the instruments.
Disclosure of Invention
The invention provides an AR-based instrument maintenance method and device, which are used for reducing the time cost and the labor cost of instrument maintenance and improving the efficiency of instrument maintenance.
The invention provides an AR-based instrument maintenance method in a first aspect, which comprises the following steps:
acquiring first image data of a target instrument, wherein the first image data comprises a video or an image of the target instrument;
and sending the first image data of the target instrument to a maintenance device so that the maintenance device presents the first image data in an AR manner.
In an embodiment of the first aspect of the present invention, the method further includes:
receiving second image data sent by the maintenance equipment, wherein the second image data comprise fault information of the target instrument labeled by maintenance personnel according to the first image data;
presenting the second image data in an AR manner.
In an embodiment of the first aspect of the present invention, the AR-rendering the second image data comprises:
determining a fault location of the target instrument from the second image data;
and when the second image data is presented in an AR mode, marking the fault position of the target instrument in a virtual scene.
In an embodiment of the first aspect of the present invention, the AR-rendering the second image data comprises:
determining a fault location of the target instrument from the second image data;
acquiring third image data of the target instrument, wherein the third image data comprises a video or an image of the target instrument, and the first image data is different from the third image data;
and when the third image data is presented in an AR mode, marking the fault position of the target instrument in a virtual scene.
In an embodiment of the first aspect of the present invention, the method further includes: before the acquiring the first image data of the target instrument, the method further comprises:
receiving an instruction sent by the maintenance equipment, wherein the instruction is used for instructing to acquire first image data of the target instrument;
and acquiring first image data of the target instrument according to the instruction.
The invention provides an AR-based instrument maintenance method in a second aspect, which comprises the following steps:
receiving first image data of a target instrument sent by a detection device, wherein the first image data comprises a video or an image of the target instrument;
presenting the first image data in an AR manner.
In an embodiment of the second aspect of the present invention, the method further includes:
acquiring second image data of the target instrument according to the operation of a maintainer, wherein the second image data comprises fault information of the target instrument, which is labeled by the maintainer according to the first image data;
and sending the second image data of the target instrument to the detection equipment.
In an embodiment of the second aspect of the present invention, the acquiring second image data of the target instrument according to the operation of the maintenance personnel includes:
acquiring fault information of the target instrument input by the maintenance personnel;
and marking the position of the fault of the target instrument in the first image data according to the fault information to obtain second image data.
In an embodiment of the second aspect of the present invention, the AR-rendering the first image data includes:
comparing the first image data with preset image data, wherein the preset image data is a video or an image when a fault occurs at a preset position of the target instrument;
and presenting the part, which is compared with the preset image data, in the first image data in an AR mode.
A third aspect of the present invention provides an AR-based instrument maintenance apparatus, comprising:
the camera is used for acquiring first image data of a target instrument, wherein the first image data comprises a video or an image of the target instrument;
a transmitter for transmitting the first image data of the target instrument to a maintenance device to cause the maintenance device to present the first image data in an AR manner.
In an embodiment of the third aspect of the present invention, the method further includes:
the receiver is used for receiving second image data sent by the maintenance equipment, and the second image data comprises fault information of the target instrument marked by the maintenance personnel according to the first image data;
a display for presenting the second image data in an AR manner.
In an embodiment of the third aspect of the present invention, further comprising,
a processor for determining a fault location of the target instrument from the second image data;
the display is specifically configured to label a fault location of the target instrument in a virtual scene when the second image data is presented in an AR manner.
In an embodiment of the third aspect of the present invention, the method further includes:
a processor for determining a fault location of the target instrument from the second image data;
the camera is further configured to acquire third image data of the target instrument, where the third image data includes a video or an image of the target instrument, and the first image data is different from the third image data;
the display is specifically configured to label a fault location of the target instrument in a virtual scene when the third image data is presented in an AR manner.
In an embodiment of the third aspect of the present invention, the receiver is further configured to receive an instruction sent by the maintenance device, where the instruction is used to instruct to acquire first image data of the target instrument;
the camera is specifically configured to acquire first image data of the target instrument according to the instruction.
A fourth aspect of the present invention provides an AR-based instrument maintenance apparatus, including:
the receiver is used for receiving first image data of the target instrument sent by the detection equipment, and the first image data comprises a video or an image of the target instrument;
a display to present the first image data in an AR manner.
In an embodiment of the fourth aspect of the present invention, the method further includes:
the processor is used for acquiring second image data of the target instrument according to the operation of a maintainer, wherein the second image data comprises fault information of the target instrument, which is labeled by the maintainer according to the first image data;
a transmitter for transmitting second image data of the target instrument to the detection device.
In an embodiment of the fourth aspect of the present invention, the processor is specifically configured to,
acquiring fault information of the target instrument input by the maintenance personnel;
and marking the position of the fault of the target instrument in the first image data according to the fault information to obtain second image data.
In an embodiment of the fourth aspect of the present invention, the processor is further configured to,
comparing the first image data with preset image data, wherein the preset image data is a video or an image when a fault occurs at a preset position of the target instrument;
the display is specifically configured to present, in an AR manner, a portion of the first image data that is the same as a portion of the first image data compared to a preset image data.
In a fifth aspect, an embodiment of the present application provides an AR-based instrument maintenance apparatus, including: a processor and a memory; the memory is used for storing programs; the processor is configured to call a program stored in the memory to perform the method according to any one of the first aspect of the present application.
In a sixth aspect, an embodiment of the present application provides an AR-based instrument maintenance apparatus, including: a processor and a memory; the memory is used for storing programs; the processor is configured to call a program stored in the memory to perform the method of any of the second aspects of the present application.
In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium storing program code, which, when executed, performs the method according to any one of the first aspect of the present application.
In an eighth aspect, embodiments of the present application provide a computer-readable storage medium storing program code, which when executed, performs the method according to any one of the second aspects of the present application.
In summary, the present invention provides an AR-based instrument maintenance method and apparatus, wherein the method includes: acquiring first image data of a target instrument, wherein the first image data comprises a video or an image of the target instrument; and sending the first image data of the target instrument to a maintenance device so that the maintenance device presents the first image data in an AR manner. According to the AR-based instrument maintenance method and device provided by the invention, even if a maintenance person of the instrument is not in the instrument field, the fault condition of the target instrument can be known through the first image data presented by the maintenance equipment in an AR manner so as to maintain the target instrument, so that the time cost and the labor cost of instrument maintenance are reduced, and the efficiency of instrument maintenance is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a schematic flow chart illustrating an embodiment of an AR-based instrument maintenance method according to the present invention;
FIG. 2 is a schematic diagram illustrating an application of an embodiment of the AR-based instrument maintenance method of the present invention;
FIG. 3 is a schematic flow chart illustrating an embodiment of an AR-based instrument maintenance method according to the present invention;
FIG. 4 is a schematic diagram illustrating an application of an embodiment of the AR-based instrument maintenance method of the present invention;
FIG. 5 is a schematic flow chart illustrating an embodiment of an AR-based instrument maintenance method of the present invention;
FIG. 6 is a schematic diagram illustrating an application of an embodiment of the AR-based instrument maintenance method of the present invention;
FIG. 7 is a schematic flow chart illustrating an embodiment of an AR-based instrument maintenance method of the present invention;
FIG. 8 is a schematic diagram illustrating an application of an embodiment of the AR-based instrument maintenance method of the present invention;
FIG. 9 is a schematic flow chart diagram illustrating an embodiment of an AR-based instrument maintenance method of the present invention;
FIG. 10 is a schematic diagram illustrating an application of an embodiment of the AR-based instrument maintenance method of the present invention;
FIG. 11 is a schematic diagram illustrating an embodiment of an AR based instrument maintenance device of the present invention;
FIG. 12 is a schematic diagram illustrating an embodiment of an AR based instrument maintenance device of the present invention;
FIG. 13 is a schematic diagram illustrating an embodiment of an AR based instrument maintenance device of the present invention;
FIG. 14 is a schematic diagram illustrating an embodiment of an AR based instrument maintenance device of the present invention;
FIG. 15 is a schematic diagram illustrating an embodiment of an AR based instrument maintenance device in accordance with the present invention;
FIG. 16 is a schematic diagram illustrating an embodiment of an AR based instrument maintenance device in accordance with the present invention;
FIG. 17 is a schematic diagram illustrating an embodiment of an AR based instrument maintenance device of the present invention;
FIG. 18 is a schematic structural diagram of an embodiment of an AR-based instrument maintenance device of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The technical solution of the present invention will be described in detail below with specific examples. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments.
Fig. 1 is a schematic flow chart of an embodiment of the AR-based instrument maintenance method of the present invention. As shown in fig. 1, the AR-based instrument maintenance method provided in this embodiment includes:
s101: the detection device acquires first image data of a target instrument, wherein the first image data comprises a video or image of the target instrument.
S102: the detection device sends the first image data of the target instrument to the maintenance device, and the maintenance device receives the first image data of the target instrument sent by the detection device.
S103: the maintenance device presents the first image data in an AR manner.
Specifically, fig. 2 is a schematic application diagram of an embodiment of the AR-based instrument maintenance method according to the present invention. The AR-based instrument maintenance method shown in fig. 1 will be described below using the application of fig. 2 as an example.
As shown in fig. 2, the AR-based instrument maintenance method in this embodiment is implemented by the following two AR-based instrument maintenance apparatuses: a detection device 1 and a maintenance device 2. The detection device 1 is arranged around a target apparatus to be maintained and is used for detecting relevant operations of a person 11 for maintaining the target apparatus 3 according to the detection device 1; the maintenance device 2 is disposed at a different position or area from the target instrument 3 for the maintenance person 21 to perform diagnosis of a failure of the target instrument 3 based on the content displayed on the maintenance device 2.
Optionally, the detection device 1 and the maintenance device 2 are spatially divided by a dashed line in the figure as an example, a communication connection between the detection device 1 and the maintenance device 2 may be a wireless communication manner or a wired communication manner, and a connection between the detection device 1 and the maintenance device 2 that may also pass through a communication device such as a router, a wireless base station, or a server is not shown in the figure but is within the scope of the communication connection described in this application.
Alternatively, the detection device 1 and the maintenance device 2 in this embodiment may be any electronic device that has an image processing function and can perform communication connection, such as a Mobile Phone (Mobile Phone), a tablet computer (Pad), a computer with a wireless transceiving function, an Augmented Reality (AR) electronic device, and the like.
The AR-based instrument maintenance method shown in fig. 1, when step S101 is performed in the schematic diagram shown in fig. 2, the detection device 1 located at the target instrument 3 acquires first image data of the target instrument, wherein the first image data includes a video or an image of the target instrument 3. Specifically, the detection apparatus 1 can acquire first image data of the target instrument 3 to be maintained by the capability of object recognition. The capability of object recognition here may refer to a function of the camera provided in the detection apparatus 1 to photograph the target instrument 3. Meanwhile, the first image data here may be a video of the target instrument 3 captured by the detection apparatus 1 through a camera or at least one image of the target instrument 3 captured by the detection apparatus 1 through a camera. Alternatively, the detection apparatus 1 may also acquire the first image data of the target instrument 3 captured by other means provided around the target instrument 3 and dedicated to capturing images.
In S102 after the detection apparatus 1 acquires the first image data of the target instrument 3 in S101, the detection apparatus 1 transmits the first image data to the maintenance apparatus through its communication connection with the maintenance apparatus 2.
Alternatively, in S101, the detection apparatus 1 may perform acquiring the first image data of the target instrument 3 at a preset time or under a preset condition; or the detection device 1 acquires the first image data under the operation of the detection personnel 11, and then sends the first image data to the maintenance device 2 through the S102; still alternatively, after receiving the instruction sent by the maintenance device, the detection device 1 acquires the first image data of the target instrument 3 according to the instruction, where the instruction may be sent to the detection device 1 by operating the maintenance device 2 when the maintenance person 21 needs to maintain the target instrument 3, and in this scenario, the detection person 11 shown in fig. 2 may not appear, and the maintenance person 21 may know the target instrument 3 unilaterally.
Subsequently, in S103, the maintenance device 2 presents the first image data received in S102 to the maintenance person 21 in an AR manner. For example: the maintenance device 2 processes the first image data of the target instrument 3 to obtain AR content data including the target instrument 3, and presents the AR content data to the maintenance staff 21. That is, the maintainer 21 can see the target instrument 3 from the maintenance device 2 in an AR manner, so that the instrument status of the target instrument 3 at different positions can be determined according to the first image data presented on the maintenance device 2, and the problem of the target instrument 3 can be determined by performing maintenance-related diagnosis on the target instrument 3 according to the AR content seen on the maintenance device 2.
Optionally, in the embodiment shown in fig. 2, a structure of the target apparatus 3 is exemplarily given to illustrate the step, and structures of other target apparatuses may also be applied to this embodiment, which is not described again in the following. For example: the target apparatus 3 may be an automatic goods taking apparatus shown in fig. 2, which includes a motor 31, a thread unreeling device 32 and a goods taking device 33, wherein the thread unreeling device 32 is operated to pay out a predetermined length of thread when the motor 31 is rotated to control the goods taking device 33 to reach a predetermined goods 34 for taking goods. The first image data obtained by the detection device 1 shooting the target instrument 3 is sent to the maintenance device 2, and the maintenance device 2 presents the first image data 41 shot by the detection device 1 to the serviceman 21 in an AR manner on a display device thereof, such as a display screen.
Therefore, in summary, the AR-based instrument maintenance method provided in this embodiment can enable a maintenance person of the instrument to know the fault condition of the target instrument through the first image data presented by the maintenance device in the AR manner to maintain the target instrument even if the maintenance person is not in the instrument field, thereby reducing the time cost and the labor cost of instrument maintenance and improving the efficiency of instrument maintenance.
FIG. 3 is a flowchart illustrating an embodiment of an AR-based instrument maintenance method according to the present invention. The embodiment shown in fig. 3 further includes, after S103 on the basis of the embodiment shown in fig. 1:
s201: and the maintenance equipment acquires second image data of the target instrument according to the operation of the maintenance personnel, wherein the second image data comprises fault information of the target instrument labeled by the maintenance personnel according to the first image data.
S202: and the maintenance equipment sends the second image data of the target instrument to the detection equipment, and the detection equipment receives the second image data sent by the maintenance equipment.
S203: the detection device presents the second image data in an AR manner.
Specifically, fig. 4 is a schematic application diagram of an embodiment of the AR-based instrument maintenance method according to the present invention. The AR-based instrument maintenance method shown in fig. 3 will now be described, taking the application of fig. 4 as an example.
In the embodiment shown in fig. 4, in the example shown in fig. 2, after the maintenance device 2 presents the first AR image data to the serviceman 21 in an AR manner, the maintenance device 2 acquires, in S201, second image data of the target instrument 3 according to the operation of the serviceman 21, where the second image data includes fault information of the target instrument labeled by the serviceman according to the first image data. Specifically, as in the example china shown in fig. 4, the second image data 42 includes: and a failure mark 43 on the basis of the first image data 41, wherein the failure mark 43 is used for indicating a failure position where failure information obtained by the maintenance personnel 21 after judging according to the first image data 41 is located. For example, when the maintenance person 21 inputs the failure information that the maintenance person has judged into the maintenance apparatus 2, the maintenance apparatus 2 marks a failure mark 43 on the first image data 41 based on the failure information to identify the location of the failure. For example, if the display device of the maintenance apparatus 2 is a touch screen, the maintenance person 21 draws the failure mark 43 through the touch screen. Or, the maintenance person 21 inputs or selects "pay-off failure" on the maintenance device 2, and the maintenance device 2 determines the position of the pay-off 43 in the first image data 41 by means of image recognition according to the "pay-off failure", and adds a failure mark 43 to the pay-off. That is, as shown in fig. 4, the first image data 41 plus the failure flag 43 is the second image data 42 referred to in this embodiment.
When the maintenance device 2 determines the second image data, the second image data is transmitted to the inspection device 1 in S202, also through its communication connection with the inspection device 1.
Subsequently, in S203, the detection apparatus 1 presents the second image data received in S202 to the detection person 11 in an AR manner. For example: the detection device 1 processes the second image data of the target instrument 3 to obtain AR content data including the target instrument 3, and presents the AR content data to the detection person 11. That is, the inspector 11 can see the trouble mark 43 of the target instrument 3 indicated in the second image data by the maintainer 21 from the inspection apparatus 1 by means of AR, thereby being able to determine the trouble position of the target instrument 3 and to perform the relevant repair or maintenance operation on the trouble position 43 of the target instrument 3 based on the content of AR seen from the inspection apparatus 1. For example: in the example shown in fig. 4, with the target instrument 3 being the automatic picking instrument 3 in the foregoing embodiment, the maintenance person 21 marks the failed position 43 as the payoff 32 of the automatic picking instrument 3 through the maintenance device 2 as the second image data. When the detection device 1 presents the second image data to the detection person 11 in an AR manner, the detection person 11 may compare the position of the fault label 43 displayed on the detection device 1 with the actual automatic picking apparatus 3 to determine that the pay-off device 32 of the automatic picking apparatus 3 has a fault, and repair or maintain the pay-off device 32.
Alternatively, in the above example, the maintenance person 21 may provide some repair information of the failure in addition to the failure marking of the target instrument 3 by the maintenance device 2, and send it to the detection device 1 together with the second image data, or add some simple prompt words to the second image data, so that the detection person 11 can repair or maintain the target instrument 3 more accurately according to the repair information of the failure prompted on the detection device 2.
Therefore, in summary, the AR-based instrument maintenance method provided by this embodiment can enable a maintenance person of the instrument to know the fault condition of the target instrument through the first image data presented by the maintenance device in the AR manner even if the maintenance person is not in the instrument field, so as to maintain the target instrument. When the maintainer of the instrument sends the second image data to the detection device, the detection device can maintain the on-site target instrument by contrasting the second image data presented by the detection device in an AR mode, so that the maintenance work of the cooperative instrument of multiple people can be realized without the need of simultaneously locating the maintainer and the detection device at the target instrument, the remote cooperation of multiple people is realized, the time cost and the labor cost of instrument maintenance are reduced, and the efficiency of instrument maintenance is improved.
FIG. 5 is a flowchart illustrating an embodiment of an AR-based instrument maintenance method according to the present invention. The embodiment shown in fig. 5 provides a method of S203 in the embodiment shown in fig. 2: the maintenance device presents the second image data in an AR manner, and in one possible implementation manner, specifically, S103 includes the following steps:
s301: the detection device determines a fault location of the target instrument based on the second image data.
S302: and when the detection equipment presents the second image data in an AR mode, marking the fault position of the target instrument in the virtual scene.
Specifically, fig. 6 is a schematic application diagram of an embodiment of the AR-based instrument maintenance method according to the present invention. The AR-based instrument maintenance method shown in fig. 5 will be described below using the application of fig. 6 as an example.
In the embodiment shown in fig. 6, when the detection apparatus 1 receives the second image data transmitted by the maintenance apparatus 2, the failure position of the target instrument 3 is determined based on the second image data. For example, the second image data may directly include the fault label 43 of the target instrument 3, or the second image data carries fault information "pay-off fault" of the target instrument 3, and the detection device 1 needs to determine that the fault position of the target instrument 3 is at the pay-off 32 according to the fault information. The fault location of the target instrument 3 is noted in the virtual scene when the detection device 1 presents the second image data in the AR mode after the detection device 1 determines the fault location of the target instrument 3. The virtual scene refers to a virtual scene generated when the detection device 1 presents the second image data in the AR manner, and the detection person 11 can see the fault position of the target instrument 3 from the virtual scene. For example, as shown in the embodiment shown in fig. 6, taking the second image data 42 as an example in the detection apparatus 1, the detection person 1 may see the fault label 43 at the fault position of the target instrument 3 from the second image data 42, so that after comparing the label content with the actual target instrument 3 on the left side of the detection apparatus 1, the fault position of the target instrument 3 is determined to be the paying-off device 32, and the paying-off device 32 is maintained and repaired in a related manner.
Further, fig. 7 is a schematic flowchart of an embodiment of the AR-based instrument maintenance method according to the present invention. The embodiment shown in fig. 7 provides a method of S203 in the embodiment shown in fig. 2: the maintenance device presents the second image data in an AR manner, and in one possible implementation manner, the embodiment shown in fig. 7 is in a parallel arrangement with the embodiment shown in fig. 5, and the two are in an or relationship with each other, and may be alternatively executed, specifically, S203 includes the following steps:
s401: determining a fault location of the target instrument based on the second image data.
S402: third image data of the target instrument is acquired, the third image data including a video or image of the target instrument, the first image data being different from the third image data.
S403: and when the third image data is presented in an AR mode, marking the fault position of the target instrument in the virtual scene.
Specifically, fig. 8 is a schematic application diagram of an embodiment of the AR-based instrument maintenance method according to the present invention. The AR-based instrument maintenance method shown in fig. 7 will be described below using the application of fig. 8 as an example.
As shown in fig. 8, when the detection device 1 receives the second image data sent by the maintenance device 2, the second image data determines the fault position of the target instrument 3 according to the same manner as in the above-described embodiment, for example, determines the fault position of the target instrument 3 as the paying out device 32. However, in the embodiment shown in fig. 2, the detection device 1 acquires first image data of the target instrument 3 in front of the target instrument and transmits the first image data to the maintenance device 2, and the maintenance device 2 also obtains second image data based on the first image data, and the second image data is also an image of the front of the target instrument 3 when presented to the detection user 11. In the embodiment shown in fig. 8, the detection device 1 is now arranged to the right of the target instrument 3 as seen in fig. 3, and therefore the second image data cannot be presented directly to the user. Instead, third image data of the detection device 1 at this time needs to be acquired after determining the fault location of the target instrument according to the second image data, where the third image data also includes a video or an image of the target instrument 3 in the same manner and principle as the acquisition of the first image data in S101. Specifically, the detection apparatus 1 may also acquire third image data of the target instrument 3 to be maintained by shooting with a camera. Subsequently, when the detection device 1 presents the third image data in the AR manner, the fault position of the target instrument 3 is labeled in the virtual scene. The virtual scene refers to a virtual scene generated when the detection device 1 presents the third image data in the AR manner, and the detection person 11 can see the fault position of the target instrument 3 from the virtual scene. For example, in the embodiment shown in fig. 8, after the detection device 1 determines that the fault position of the target instrument is a fault of the paying-off device 32 according to the second image data, and determines the position of the paying-off device 32 according to the third image data of the current view angle of the detection device, when the third image data 44 is presented in the AR manner, the paying-off device 32 of the target instrument 3 in the third image data 44 is circled by the fault label 34, so that the detection person 11 determines that the fault position of the target instrument is the paying-off device 32 according to the presented third image data.
Further, in the above-described embodiment, the detection apparatus 1 shown in fig. 6 and the detection apparatus shown in fig. 8 may be the same or different detection apparatuses. Wherein,
for the same detection device, the detection device 1 may be an electronic device held by a detection person 11, and after the target instrument 3 is photographed at a front angle as shown in fig. 4 to obtain first image data and sent to the maintenance device 2, the maintenance person determines that the fault occurs and then the maintenance device 2 sends second image data to the detection device 1. At this time, the detection person 11 has already held the detection device 1 to reach the right side of the target apparatus 3 as shown in fig. 8, and then the detection device needs to determine a fault position according to the second image data, and then add the fault label 43 of the fault position to the third image data of the current view angle according to the third image data obtained from the current view angle of the detection device 1, so as to prompt the detection person 11 on the right side of the target apparatus 3 of the fault position.
The detection apparatus 1 shown in fig. 4 is different from the detection apparatus 1 shown in fig. 8 in that the detection apparatus 1 is disposed on the front side of the target instrument 3 and the detection apparatus 1 shown in fig. 8 is disposed on the right side of the target instrument 3. The two set detection devices can simultaneously acquire the first image data of the target instrument and then send the first image data to the same maintenance device 2, the maintenance device 2 presents the target instrument to the maintenance personnel 21 in an AR manner according to the two obtained first image data, and the second image data after adding the fault label to the first image data is sent to the two detection devices simultaneously. And the two detection devices acquire third image data of respective visual angles, add the fault label into the third image data of the visual angle of the device and display the third image data in an AR mode. And enabling the user to see the fault label on the image data of the visual angle under the visual angle in each set two detection devices.
Optionally, the number of different detection devices may be multiple, and the implementation manner and principle of the method are the same as those of the two detection devices, which are only the superposition of the number and are not described again. Alternatively, a plurality of detection devices may be provided around the target instrument by an inspector or a maintainer in accordance with the instrument configuration of the target instrument, the purpose of which is to observe the target instrument with an optimal viewing angle. For example, the front and right views of the device in fig. 4 and 8 are examples of views from which the target instrument can be more fully observed.
FIG. 9 is a flowchart illustrating an embodiment of an AR-based instrument maintenance method according to the present invention. The embodiment shown in fig. 9 provides a method of S103 in the embodiment shown in fig. 1: the detection device presents the first image data in an AR manner, one possible implementation. Specifically, S103 includes the steps of:
s501: and comparing the first image data with preset image data, wherein the preset image data is a video or an image when the preset position of the target instrument has a fault.
S502: and presenting the part of the first image data, which is compared with the preset image data, in an AR mode.
Specifically, fig. 10 is a schematic application diagram of an embodiment of the AR-based instrument maintenance method according to the present invention. The AR-based instrument maintenance method shown in fig. 9 will be described below using the application of fig. 10 as an example.
As shown in fig. 10, after the maintenance device 2 receives the first image data sent by the detection device 1, the first image data is compared with preset image data, where the preset image data includes, for example, data of a fault image of the motor 31, data of a fault image of the paying out device 32, and data of a fault image of the goods taking device 33, and after the first image data is compared with the three kinds of preset image data, it is determined that the first image data is the same as the data of the fault image of the paying out device 32. The maintenance device 2 only presents the part 45 of the first image data, which is compared with the preset image data in the same way, in the AR way, that is, only presents the image of the part of the paying-off device 32, so that the maintenance personnel 21 can pay more attention to the actual problem condition of the target instrument 3, and determine the fault position of the target instrument in a more intelligent automatic comparison way before the judgment of the maintenance personnel 21, so as to improve the working efficiency of the maintenance personnel 21. Alternatively, in this embodiment, the maintenance person 21 may only perform the confirmation operation, that is, after the maintenance device 2 determines that the part of the paying-off device 32 has the fault, and after the maintenance person 21 determines the information, the maintenance device 2 sends the second image data including the fault label to the detection device 1. Alternatively, in this embodiment, the maintenance staff may not be present, and the maintenance device 2 alone determines the fault of the target instrument according to the first image data, and the maintenance device 2 at this time may be understood as a background database.
FIG. 11 is a schematic structural diagram of an embodiment of the AR based instrument maintenance device of the present invention. As shown in fig. 11, the present embodiment provides an AR-based instrument maintenance apparatus including: an acquisition module 1101 and a sending module 1102. Wherein,
the acquiring module 1101 is configured to acquire first image data of a target instrument, where the first image data includes a video or an image of the target instrument;
the sending module 1102 is configured to send the first image data of the target instrument to the maintenance device, so that the maintenance device presents the first image data in an AR manner.
The AR-based instrument maintenance apparatus provided in this embodiment may be used as a detection device for executing the AR-based instrument maintenance method shown in fig. 1, and a specific implementation manner and a principle thereof are the same, and are not described again.
FIG. 12 is a schematic structural diagram of an embodiment of the AR-based instrument maintenance device of the present invention. The AR-based instrument maintenance device shown in fig. 12 further includes, on the basis of the embodiment shown in fig. 11: a receiving module 1201 and a display module 1202. Wherein,
the receiving module 1201 is configured to receive second image data sent by the maintenance device, where the second image data includes fault information of a target instrument labeled by a maintenance worker according to the first image data;
the display module 1202 is for presenting the second image data in an AR manner.
The AR-based instrument maintenance apparatus provided in this embodiment may be used as a detection device for executing the AR-based instrument maintenance method shown in fig. 3, and a specific implementation manner and a principle thereof are the same, and are not described again.
Optionally, in the above embodiment, the method further includes: a processing module 1203; wherein,
the processing module 1203 is configured to determine a fault location of the target instrument according to the second image data;
the display module 1202 is specifically configured to label a fault location of the target instrument in the virtual scene when the second image data is presented in the AR manner.
The AR-based instrument maintenance device provided in this embodiment may be used to execute the AR-based instrument maintenance method shown in the foregoing embodiment, and the specific implementation manner and principle thereof are the same and will not be described again.
Optionally, in the above embodiment, the method further includes: a processing module 1203; wherein,
the processing module 1203 is configured to determine a fault location of the target instrument according to the second image data;
the obtaining module 1101 is further configured to obtain third image data of the target instrument, where the third image data includes a video or an image of the target instrument, and the first image data is different from the third image data;
the display module 1202 is specifically configured to label a fault location of the target instrument in the virtual scene when the third image data is presented in the AR manner.
The AR-based instrument maintenance device provided in this embodiment may be used to execute the AR-based instrument maintenance method shown in the foregoing embodiment, and the specific implementation manner and principle thereof are the same and will not be described again.
Alternatively, in the above-described embodiments,
the receiving module 1201 is further configured to receive an instruction sent by the maintenance device, where the instruction is used to instruct to acquire first image data of the target instrument;
the obtaining module 1101 is further configured to obtain first image data of the target instrument according to the instruction.
The AR-based instrument maintenance device provided in this embodiment may be used to execute the AR-based instrument maintenance method shown in the foregoing embodiment, and the specific implementation manner and principle thereof are the same and will not be described again.
FIG. 13 is a schematic structural diagram of an embodiment of the AR-based instrument maintenance device of the present invention. As shown in fig. 13, the AR-based instrument maintenance apparatus provided in the present embodiment includes: a receiving module 1301 and a display module 1302. Wherein,
the receiving module 1301 is configured to receive first image data of a target instrument sent by a detection device, where the first image data includes a video or an image of the target instrument;
the display module 1302 is configured to present the first image data in an AR manner.
The AR-based instrument maintenance apparatus provided in this embodiment may be used as a maintenance device to execute the AR-based instrument maintenance method shown in fig. 1, and the specific implementation manner and principle thereof are the same and will not be described again.
FIG. 14 is a schematic structural diagram of an embodiment of the AR-based instrument maintenance device of the present invention. The AR-based instrument maintenance device shown in fig. 14 further includes, on the basis of the embodiment shown in fig. 13: a processing module 1401 and a sending module 1402. Wherein,
the processing module 1401 is configured to obtain second image data of the target apparatus according to an operation of a maintainer, where the second image data includes fault information of the target apparatus labeled by the maintainer according to the first image data;
the sending module 1402 is configured to send the second image data of the target instrument to the detection device.
The AR-based instrument maintenance apparatus provided in this embodiment may be used as a maintenance device to execute the AR-based instrument maintenance method shown in fig. 3, and the specific implementation manner and principle thereof are the same and will not be described again.
Alternatively, in the above-described embodiments, the processing module 1401 is specifically configured to,
acquiring fault information of a target instrument input by a maintainer;
the second image data is obtained from the position of the failure in the first image data where the target instrument is present based on the failure information.
The AR-based instrument maintenance device provided in this embodiment may be used to execute the AR-based instrument maintenance method shown in the foregoing embodiment, and the specific implementation manner and principle thereof are the same and will not be described again.
Optionally, in the above-described embodiments, the processing module 1401 is further configured to,
comparing the first image data with preset image data, wherein the preset image data is a video or an image when a fault occurs at a preset position of the target instrument;
the display is specifically configured to present, in an AR manner, a portion of the first image data that is identical to the portion of the first image data compared with the preset image data.
The AR-based instrument maintenance device provided in this embodiment may be used to execute the AR-based instrument maintenance method shown in the foregoing embodiment, and the specific implementation manner and principle thereof are the same and will not be described again.
It should be noted that, in the embodiment of the present application, the division of the module is schematic, and is only one logic function division, and there may be another division manner in actual implementation. Each functional module in the embodiments of the present application may be integrated into one processing module, or each module may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.
The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
FIG. 15 is a schematic structural diagram of an embodiment of the AR-based instrument maintenance device of the present invention. As shown in fig. 15, the AR-based instrument maintenance apparatus provided in the present embodiment includes: a camera 1501 and a transmitter 1502. Wherein,
the camera 1501 is configured to acquire first image data of a target instrument, where the first image data includes a video or an image of the target instrument;
the transmitter 1502 is configured to transmit the first image data of the target instrument to the maintenance device to cause the maintenance device to present the first image data in an AR manner.
The AR-based instrument maintenance apparatus provided in this embodiment may be used as a detection device for executing the AR-based instrument maintenance method shown in fig. 1, and a specific implementation manner and a principle thereof are the same, and are not described again.
FIG. 16 is a schematic structural diagram of an embodiment of the AR-based instrument maintenance device of the present invention. The AR-based instrument maintenance device shown in fig. 16 further includes, on the basis of the embodiment shown in fig. 15: a receiver 1503 and a display 1504. Wherein,
the receiver 1503 is used for receiving second image data sent by the maintenance equipment, wherein the second image data comprises fault information of the target instrument labeled by the maintenance personnel according to the first image data;
the display 1504 is used to present the second image data in an AR manner.
The AR-based instrument maintenance apparatus provided in this embodiment may be used as a detection device for executing the AR-based instrument maintenance method shown in fig. 3, and a specific implementation manner and a principle thereof are the same, and are not described again.
Optionally, in the above embodiment, the method further includes: a processor 1505; wherein,
processor 1505 is for determining a fault location of the target instrument based on the second image data;
the display 1504 is specifically configured to label the fault location of the target instrument in the virtual scene when presenting the second image data in the AR manner.
The AR-based instrument maintenance device provided in this embodiment may be used to execute the AR-based instrument maintenance method shown in the foregoing embodiment, and the specific implementation manner and principle thereof are the same and will not be described again.
Optionally, in the above embodiment, the method further includes: a processor 1505; wherein,
processor 1505 is for determining a fault location of the target instrument based on the second image data;
the camera 1501 is further configured to acquire third image data of the target instrument, where the third image data includes a video or an image of the target instrument, and the first image data is different from the third image data;
the display 1504 is specifically configured to label the fault location of the target instrument in the virtual scene when the third image data is presented in the AR manner.
The AR-based instrument maintenance device provided in this embodiment may be used to execute the AR-based instrument maintenance method shown in the foregoing embodiment, and the specific implementation manner and principle thereof are the same and will not be described again.
Alternatively, in the above-described embodiments,
the receiver 1503 is further configured to receive an instruction sent by the maintenance device, where the instruction is used to instruct acquisition of first image data of the target instrument;
the camera 1501 is further configured to acquire first image data of the target instrument according to the instruction.
The AR-based instrument maintenance device provided in this embodiment may be used to execute the AR-based instrument maintenance method shown in the foregoing embodiment, and the specific implementation manner and principle thereof are the same and will not be described again.
FIG. 17 is a schematic structural diagram of an embodiment of an AR-based instrument maintenance device of the present invention. As shown in fig. 17, the present embodiment provides an AR-based instrument maintenance apparatus including: a receiver 1701, and a display 1702. Wherein,
the receiver 1701 is used for receiving first image data of a target instrument sent by the detection device, wherein the first image data comprises a video or an image of the target instrument;
the display 1702 is used to present the first image data in an AR manner.
The AR-based instrument maintenance apparatus provided in this embodiment may be used as a maintenance device to execute the AR-based instrument maintenance method shown in fig. 1, and the specific implementation manner and principle thereof are the same and will not be described again.
FIG. 18 is a schematic structural diagram of an embodiment of an AR-based instrument maintenance device of the present invention. The AR-based instrument maintenance device shown in fig. 18 further includes, on the basis of the embodiment shown in fig. 17: a processor 1703 and a transmitter 1704. Wherein,
the processor 1703 is configured to obtain second image data of the target instrument according to an operation of a maintainer, where the second image data includes fault information of the target instrument labeled by the maintainer according to the first image data;
the transmitter 1704 is used to transmit the second image data of the target instrument to the detection device.
The AR-based instrument maintenance apparatus provided in this embodiment may be used as a maintenance device to execute the AR-based instrument maintenance method shown in fig. 3, and the specific implementation manner and principle thereof are the same and will not be described again.
Alternatively, in the above-described embodiments, the processor 1703 is specifically configured to,
acquiring fault information of a target instrument input by a maintainer;
the second image data is obtained from the position of the failure in the first image data where the target instrument is present based on the failure information.
The AR-based instrument maintenance device provided in this embodiment may be used to execute the AR-based instrument maintenance method shown in the foregoing embodiment, and the specific implementation manner and principle thereof are the same and will not be described again.
Optionally, in the above embodiments, the processor 1703 is also configured to,
comparing the first image data with preset image data, wherein the preset image data is a video or an image when a fault occurs at a preset position of the target instrument;
the display is specifically configured to present, in an AR manner, a portion of the first image data that is identical to the portion of the first image data compared with the preset image data.
The AR-based instrument maintenance device provided in this embodiment may be used to execute the AR-based instrument maintenance method shown in the foregoing embodiment, and the specific implementation manner and principle thereof are the same and will not be described again.
The present invention also proposes an electronic device-readable storage medium containing a program which, when run on an electronic device, causes the electronic device to perform the AR-based instrument maintenance method according to any of the embodiments described above.
An embodiment of the present invention further provides an electronic device, including: a processor; and a memory for storing executable instructions for the processor; wherein the processor is configured to perform the AR-based instrument maintenance method of any of the above embodiments via execution of the executable instructions.
An embodiment of the present invention also provides a program product, including: a computer program (i.e., executing instructions) stored in a readable storage medium. The computer program may be read from a readable storage medium by at least one processor of the encoding apparatus, and execution of the computer program by the at least one processor causes the encoding apparatus to implement the AR-based instrument maintenance method provided by the various embodiments described above.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the present invention in any way, and any simple modification, equivalent change and modification made to the above embodiment according to the technical spirit of the present invention are still within the scope of the technical solution of the present invention.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (20)
1. An instrument maintenance method based on Augmented Reality (AR), comprising:
acquiring first image data of a target instrument, wherein the first image data comprises a video or an image of the target instrument;
and sending the first image data of the target instrument to a maintenance device so that the maintenance device presents the first image data in an AR manner.
2. The method of claim 1, further comprising:
receiving second image data sent by the maintenance equipment, wherein the second image data comprise fault information of the target instrument labeled by maintenance personnel according to the first image data;
presenting the second image data in an AR manner.
3. The method of claim 2, wherein the AR-rendering the second image data comprises:
determining a fault location of the target instrument from the second image data;
and when the second image data is presented in an AR mode, marking the fault position of the target instrument in a virtual scene.
4. The method of claim 2, wherein the AR-rendering the second image data comprises:
determining a fault location of the target instrument from the second image data;
acquiring third image data of the target instrument, wherein the third image data comprises a video or an image of the target instrument, and the first image data is different from the third image data;
and when the third image data is presented in an AR mode, marking the fault position of the target instrument in a virtual scene.
5. The method of claim 3 or 4, further comprising: before the acquiring the first image data of the target instrument, the method further comprises:
receiving an instruction sent by the maintenance equipment, wherein the instruction is used for instructing to acquire first image data of the target instrument;
and acquiring first image data of the target instrument according to the instruction.
6. An instrument maintenance method based on Augmented Reality (AR), comprising:
receiving first image data of a target instrument sent by a detection device, wherein the first image data comprises a video or an image of the target instrument;
presenting the first image data in an AR manner.
7. The method of claim 6, further comprising:
acquiring second image data of the target instrument according to the operation of a maintainer, wherein the second image data comprises fault information of the target instrument, which is labeled by the maintainer according to the first image data;
and sending the second image data of the target instrument to the detection equipment.
8. The method of claim 7, wherein the acquiring second image data of the target instrument based on the operation of the maintenance personnel comprises:
acquiring fault information of the target instrument input by the maintenance personnel;
and marking the position of the fault of the target instrument in the first image data according to the fault information to obtain second image data.
9. The method of claim 8, wherein the AR-rendering the first image data comprises:
comparing the first image data with preset image data, wherein the preset image data is a video or an image when a fault occurs at a preset position of the target instrument;
and presenting the part, which is compared with the preset image data, in the first image data in an AR mode.
10. An AR-based instrument maintenance device, comprising:
the camera is used for acquiring first image data of a target instrument, wherein the first image data comprises a video or an image of the target instrument;
a transmitter for transmitting the first image data of the target instrument to a maintenance device to cause the maintenance device to present the first image data in an AR manner.
11. The apparatus of claim 10, further comprising:
the receiver is used for receiving second image data sent by the maintenance equipment, and the second image data comprises fault information of the target instrument marked by the maintenance personnel according to the first image data;
a display for presenting the second image data in an AR manner.
12. The apparatus of claim 11, further comprising,
a processor for determining a fault location of the target instrument from the second image data;
the display is specifically configured to label a fault location of the target instrument in a virtual scene when the second image data is presented in an AR manner.
13. The apparatus of claim 11, further comprising:
a processor for determining a fault location of the target instrument from the second image data;
the camera is further configured to acquire third image data of the target instrument, where the third image data includes a video or an image of the target instrument, and the first image data is different from the third image data;
the display is specifically configured to label a fault location of the target instrument in a virtual scene when the third image data is presented in an AR manner.
14. The apparatus of claim 12 or 13,
the receiver is further used for receiving an instruction sent by the maintenance equipment, wherein the instruction is used for instructing to acquire first image data of the target instrument;
the camera is specifically configured to acquire first image data of the target instrument according to the instruction.
15. An apparatus for instrument maintenance based on Augmented Reality (AR), comprising:
the receiver is used for receiving first image data of the target instrument sent by the detection equipment, and the first image data comprises a video or an image of the target instrument;
a display to present the first image data in an AR manner.
16. The apparatus of claim 15, further comprising:
the processor is used for acquiring second image data of the target instrument according to the operation of a maintainer, wherein the second image data comprises fault information of the target instrument, which is labeled by the maintainer according to the first image data;
a transmitter for transmitting second image data of the target instrument to the detection device.
17. The apparatus of claim 16, wherein the processor is specifically configured to,
acquiring fault information of the target instrument input by the maintenance personnel;
and marking the position of the fault of the target instrument in the first image data according to the fault information to obtain second image data.
18. The apparatus of claim 17, wherein the processor is further configured to,
comparing the first image data with preset image data, wherein the preset image data is a video or an image when a fault occurs at a preset position of the target instrument;
the display is specifically configured to present, in an AR manner, a portion of the first image data that is the same as a portion of the first image data compared to a preset image data.
19. An AR-based instrument maintenance device, comprising:
a processor, a memory, and a computer program; wherein the computer program is stored in the memory and configured to be executed by the processor, the computer program comprising instructions for performing the method of any of claims 1-9.
20. A computer-readable storage medium, characterized in that it stores a computer program that causes a server to execute the method of any one of claims 1-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810980615.3A CN109300112A (en) | 2018-08-27 | 2018-08-27 | Instrument maintaining method and device based on AR |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810980615.3A CN109300112A (en) | 2018-08-27 | 2018-08-27 | Instrument maintaining method and device based on AR |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109300112A true CN109300112A (en) | 2019-02-01 |
Family
ID=65165420
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810980615.3A Pending CN109300112A (en) | 2018-08-27 | 2018-08-27 | Instrument maintaining method and device based on AR |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109300112A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112101056A (en) * | 2020-09-29 | 2020-12-18 | 重庆市华驰交通科技有限公司 | Electromechanical equipment identification and information acquisition method and system based on wearable equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105491416A (en) * | 2015-11-25 | 2016-04-13 | 腾讯科技（深圳）有限公司 | Augmented reality information transmission method and device |
| CN106341621A (en) * | 2016-10-24 | 2017-01-18 | 福建北极光虚拟视觉展示科技有限公司 | Method, system and device for augmented reality interaction |
| CN106339094A (en) * | 2016-09-05 | 2017-01-18 | 山东万腾电子科技有限公司 | Interactive remote expert cooperation maintenance system and method based on augmented reality technology |
| CN107645651A (en) * | 2017-10-12 | 2018-01-30 | 北京临近空间飞艇技术开发有限公司 | A kind of remote guide method and system of augmented reality |
| CN207264613U (en) * | 2017-07-14 | 2018-04-20 | 福建铁工机智能机器人有限公司 | A kind of equipment that remote guide scene investigation failure is realized using AR |
-
2018
- 2018-08-27 CN CN201810980615.3A patent/CN109300112A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105491416A (en) * | 2015-11-25 | 2016-04-13 | 腾讯科技（深圳）有限公司 | Augmented reality information transmission method and device |
| CN106339094A (en) * | 2016-09-05 | 2017-01-18 | 山东万腾电子科技有限公司 | Interactive remote expert cooperation maintenance system and method based on augmented reality technology |
| CN106341621A (en) * | 2016-10-24 | 2017-01-18 | 福建北极光虚拟视觉展示科技有限公司 | Method, system and device for augmented reality interaction |
| CN207264613U (en) * | 2017-07-14 | 2018-04-20 | 福建铁工机智能机器人有限公司 | A kind of equipment that remote guide scene investigation failure is realized using AR |
| CN107645651A (en) * | 2017-10-12 | 2018-01-30 | 北京临近空间飞艇技术开发有限公司 | A kind of remote guide method and system of augmented reality |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112101056A (en) * | 2020-09-29 | 2020-12-18 | 重庆市华驰交通科技有限公司 | Electromechanical equipment identification and information acquisition method and system based on wearable equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8834176B2 (en) | Method and system for plant management by augmentation reality | |
| US11127211B2 (en) | Plant management system, plant management method, plant management apparatus, and plant management program | |
| US20190129675A1 (en) | Plant management system, plant management method, plant management apparatus, and plant management program | |
| CN107203196B (en) | Industrial equipment detection system and method | |
| KR102603276B1 (en) | Device, method and program for assisting supevision based on XR | |
| EP3217260A1 (en) | Maintenance support method, maintenance support system, and maintenance support program | |
| JP6833492B2 (en) | Wiring support device | |
| KR102603286B1 (en) | Server, method and program for designing, constructing and supervising buildings | |
| CN103646438A (en) | Routing inspection method and routing inspection system with image uploading function | |
| EP3165979B1 (en) | Providing mounting information | |
| JP2015061339A (en) | Wiring work support system | |
| KR20150083480A (en) | System for managing facilities by using 3d stereoscopic images | |
| US10198593B2 (en) | Information processing apparatus, information processing method and program | |
| JP2013117812A (en) | Plant monitoring information display system, plant monitoring information display device, and plant monitoring information display method | |
| JP7336253B2 (en) | Installation method | |
| JP7368937B2 (en) | Equipment management system | |
| KR20110012407A (en) | Optical cable management system and method | |
| US9013304B2 (en) | Locating computer-controlled entities | |
| CN109300112A (en) | Instrument maintaining method and device based on AR | |
| JP2020086980A (en) | Facility inspection supporting terminal, facility inspection supporting system, and program | |
| KR20200069726A (en) | Application method and system of mobile computerized procedural system interface for field operators | |
| JP2019140712A (en) | Cable laying management device, cable laying management method and program | |
| CN107862029B (en) | Graphic display method for laboratory management system | |
| US20250258485A1 (en) | Plant management device, plant management method, and storage medium | |
| US20250117117A1 (en) | Method for managing photographing information in building subject to safety diagnosis, and worker terminal having installed thereon program for executing method for managing photographing information in building subject to safety diagnosis |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190201 |
|
| RJ01 | Rejection of invention patent application after publication |