[go: up one dir, main page]

EP2356809A2 - Procédé de transmission d'une image entre une première unité de commande et une deuxième unité de commande, ainsi qu'unité d'affichage - Google Patents

Procédé de transmission d'une image entre une première unité de commande et une deuxième unité de commande, ainsi qu'unité d'affichage

Info

Publication number
EP2356809A2
EP2356809A2 EP09783040A EP09783040A EP2356809A2 EP 2356809 A2 EP2356809 A2 EP 2356809A2 EP 09783040 A EP09783040 A EP 09783040A EP 09783040 A EP09783040 A EP 09783040A EP 2356809 A2 EP2356809 A2 EP 2356809A2
Authority
EP
European Patent Office
Prior art keywords
image
control unit
output unit
output
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP09783040A
Other languages
German (de)
English (en)
Inventor
Christian Reimann
Holger Santelmann
Gerhard Schulz
Frank Arndt
Hans-Gerd Brummel
Volker Heblinski
Willi Paschmann
Olaf Schmidt
Dietmar Weber
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens AG
Original Assignee
Siemens AG
Siemens Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens AG, Siemens Corp filed Critical Siemens AG
Publication of EP2356809A2 publication Critical patent/EP2356809A2/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Definitions

  • the invention relates to a method for transmitting an image from a first control unit to a second control unit and to an output unit for carrying out the method.
  • the maintenance technician has a mobile computer system with a head-mounted display (HMD) for the maintenance of technical systems.
  • the maintenance technician can access application-related documents on his mobile computer system, whereby the documents are formed from documents that are required for the maintenance of the relevant technical system. These documents typically created an expert in the Back Office ⁇ .
  • the maintenance technician can have the documents displayed on his head-mounted display of the mobile computer system by using a zoom function to select a suitable image detail from an overall image.
  • the display capability of a head-mounted display differs significantly from the display capability of a conventional monitor of the expert in the back office.
  • the resolution of the HMD is significantly lower.
  • the maintenance technician has hitherto selected the important details of the documents in a time-consuming manner with the aid of a zoom function.
  • the object of the invention is to provide a method and a device for jointing with which the War ⁇ tung technician can operate his computer system with HMD with as few interactions.
  • a method according to the invention is used, in which the image to be displayed is displayed by a first control unit on a first output unit with a first image resolution. On a second control unit with a second output unit, the image to be displayed is displayed on the second output unit with the same image resolution as on the first monitor, wherein the second output unit is designed as an HMD.
  • the first output unit is preferably a commercially available monitor, e.g. an LCD monitor with high image resolution of for example 1280x800 and more, and the first control unit designed as a commercially available computer.
  • the image is composed of a photo of the technical equipment to be maintained and in each case the photo superimposed annotations such. For example, technical texts, freehand lines, circles around technical issues shown on the photo. As a result, all relevant information is quickly available to the service technician.
  • the first output unit there are further pixels for representing an input menu field for storing the image to be transmitted. This makes it possible to provide the service technician exactly or only the images that he needs.
  • additional pixels are present on the first output unit outside of the image for displaying a further input menu field on which a preview of a digital photo is made possible, from which a partial detail of a first or further photos can be selected by menu navigation.
  • This allows the expert in the back office to select exactly the image sections that the maintenance technician needs in his system. This avoids that the maintenance technician is distracted by unimportant image sections.
  • the service technician can access online from his control unit with the head-mounted display to the images stored on the first control unit, which the expert has stored in the back-office for the service technician.
  • the service technician always has the latest versions of the images available.
  • the image desired by the service technician is transmitted in advance from the first control unit via a data transmission line to the second control unit and stored there.
  • the maintenance technician can thus view locally from his second control unit by activating a menu screen on the HMD the respectively called image. There- Through the maintenance technician can access his documents even without the availability of an online data line, z. B. in case of failure of the data transmission line in case of failure.
  • the first dispensing unit a higher ver ⁇ Tikale and / or horizontal resolution than the second output unit. This allows the expert in the back office on his large monitor conveniently and quickly create the images for the maintenance technician.
  • the service technician can only access the immutable images created by the back office expert. An adjustment of the image by the maintenance technician is therefore not feasible. This will prevent the image from being mistakenly altered by the service technician in the field and a format that is difficult to read on the HMD.
  • the developed for viewing of the document or the image and to insert annotations upper flat element on the first output unit has exactly the resolution or size (in Pi ⁇ xeln) such as that developed for display in the HMD upper flat element. This prevents otherwise necessary scalings, in which the document under certain circumstances optically worse.
  • the expert selected from the general stock of documents in the back ⁇ Office documents and determined at each step of the technician to benot costumen documents neckline, under certain circumstances also multiple openings per document. The expert adds If necessary, add annotations and place them in a structured directory, which is made available to the technician online or offline.
  • Figure 1 The system on which the method for transmitting an image from a first to a second control unit profundkelbar.
  • FIG. 2 shows a representation of an image on the first output unit which can be processed by the expert in the back-office.
  • Figure 3 the representation of an image on a HMD, which is selectable by a service technician via a menu.
  • FIG. 4 shows a further comparison of the representations on the first output unit and on the second output unit (HMD).
  • FIG. 1 shows the system on which the method for transmitting an image from a first to a second control unit S1, S2 runs.
  • FIG. 1 shows a first control unit S1, which is a commercially available computer or computer.
  • a keyboard TAI and a mouse MA are connected to the control unit S1.
  • the output unit Ml is designed as a commercially available LCD monitor with high image resolution of 1280 x 800 or more. On the monitor M1 are shown in the following figures Images Bl, B2, Photos PHl, PH2 and input fields EMI1 to EM14 were output.
  • a second control unit S2 is provided, to which a keyboard TA2, a mouse MA2, a microphone MI and a second output unit M2 can be connected as input media.
  • the second output unit M2 is designed as a head mounted display (HMD), which is worn by a maintenance technician WT on the head, a flexible mobile use is made possible even under difficult environmental conditions.
  • HMD head mounted display
  • the service technician may be controlled by voice control, e.g. by command "before”, command "back”, via the microphone MI connected to the headset M2 or the computer S2 to control the menu field EM2 shown in FIG.
  • the first and second control units S1, S2 can be connected to one another via a data connection D1.
  • the data link DL can for example be a standard TCP / IP protocol Internetpro ⁇ .
  • the data connection Dl can alternatively be carried out asynchronously by storing the data on a transportable data medium (hard disk, USB stick, etc.).
  • FIG. 2 shows the output on a first output unit M1, on which an image B1 can be processed by an expert in the back office.
  • an image B1 can be processed by an expert in the back office.
  • the expert in the back office now processes the image Bl technical unit TA so that the War ⁇ processing technician WT is purposefully made to the technical problem. This is done by selecting from a suitable partial section of a photo PHl that is visible to the right of the image Bl in a menu field EM12.
  • the expert Bl can superimpose annotations on the image Bl by means of the menu field EM14 arranged above the image B1. Examples play as a circle around the Al special techni ⁇ cal property "terminals" of the technical unit TA is set here. An arrow connects the text "V?" with the circle Al.
  • the annotations A1, A2 indicate to the service technician that he should observe or measure or check the voltage (in volts) at the terminals located in circuit A1.
  • the technical system TA contains in the picture Bl some circuit breakers including wiring in a cabinet dar. Furthermore lines, rectangles and other geometric shapes can be superimposed on the image Bl.
  • the menu field EMI1 is arranged, with which the images or documents can be stored or can be recalled for further processing.
  • the right of the picture Bl below the Menufelds Emil is the Em- gabemenufeld EM12 arranged, the control elements for initial dialing of a document or a photograph PhI for further processing.
  • the image Bl as Sectionaus ⁇ section of the pictures from PhI Experts.
  • Em further input menu EM13 is located below the image Bl and provides controls for transferring or
  • FIG. 3 shows the representation of the images B1, B2, "that is visible to the maintenance technician WT. visible from his head-mounted display M2.
  • the pictures Bl, B2, ". are each shown on the head-mounted display Ml with the same screen resolution as on the pictures Bl, Bl, ... on the first output ⁇ ment unit Ml.
  • FIG. 4 shows the illustration of the image B1 on the first output unit M1 and the representation of the image B1 on the second output unit M2.
  • the maintenance technician sees an image B1 that has the same resolution as the image B1, which the expert from the back office sees on his first output unit M1.
  • the expert on the first output unit Ml can see in his workspace only the representation that also sees the maintenance technician WT. This avoids the maintenance technician WT gets to see an unfavorable resolution on his head mounted display due to carelessness of the expert in the back office.
  • FIG. 4 a shows a further embodiment of the image from FIG. 4, in which the input EMi of FIGS. 2 and 3 are shown in detail.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

L'invention concerne un procédé de transmission d'une image entre une première unité de commande et une deuxième unité de commande, si bien qu'un technicien de maintenance (WT) peut observer l'image sur son casque virtuel pour la maintenance d'installations techniques. L'image est produite par un expert dans une application dorsale, sur une première unité d'affichage (M1). L'image est reproduite sur la première unité d'affichage (M1) avec la même résolution que sur le casque virtuel. D'autres options augmentent l'efficacité du technicien de maintenance (WT).
EP09783040A 2008-12-10 2009-09-15 Procédé de transmission d'une image entre une première unité de commande et une deuxième unité de commande, ainsi qu'unité d'affichage Withdrawn EP2356809A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102008061448 2008-12-10
PCT/EP2009/061959 WO2010066481A2 (fr) 2008-12-10 2009-09-15 Procédé de transmission d'une image entre une première unité de commande et une deuxième unité de commande, ainsi qu'unité d'affichage

Publications (1)

Publication Number Publication Date
EP2356809A2 true EP2356809A2 (fr) 2011-08-17

Family

ID=42243110

Family Applications (1)

Application Number Title Priority Date Filing Date
EP09783040A Withdrawn EP2356809A2 (fr) 2008-12-10 2009-09-15 Procédé de transmission d'une image entre une première unité de commande et une deuxième unité de commande, ainsi qu'unité d'affichage

Country Status (3)

Country Link
US (1) US20110291916A1 (fr)
EP (1) EP2356809A2 (fr)
WO (1) WO2010066481A2 (fr)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101861380B1 (ko) * 2012-07-16 2018-05-28 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 헤드 마운트 디스플레이를 이용한 컨텐츠 출력 방법 및 이를 위한 헤드 마운트 디스플레이
US20150220506A1 (en) * 2014-02-05 2015-08-06 Kopin Corporation Remote Document Annotation
US9691181B2 (en) * 2014-02-24 2017-06-27 Sony Interactive Entertainment Inc. Methods and systems for social sharing head mounted display (HMD) content with a second screen
EP4236299A3 (fr) 2015-02-27 2023-09-06 Sony Interactive Entertainment Inc. Programme de commande d'affichage, dispositif de commande d'affichage, et procédé de commande d'affichage
JP6693718B2 (ja) 2015-02-27 2020-05-13 株式会社ソニー・インタラクティブエンタテインメント 表示制御プログラム、表示制御装置、及び表示制御方法
JP2024031113A (ja) * 2022-08-25 2024-03-07 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置および画像生成方法

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6078427A (en) * 1998-12-01 2000-06-20 Kaiser Electro-Optics, Inc. Smooth transition device for area of interest head-mounted display

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2612351A1 (fr) * 1987-03-10 1988-09-16 Witzig Patrick Systeme de transmission simultanee d'ordres radio-diffuses et d'images televisees
DE69432466T2 (de) * 1993-08-12 2004-01-15 Seiko Epson Corp Am kopf befestigte bildanzeigevorrichtung und damit ausgestattete informationsverarbeitungseinrichtung
US5874960A (en) * 1995-07-05 1999-02-23 Microsoft Corporation Method and system for sharing applications between computer systems
US7248232B1 (en) * 1998-02-25 2007-07-24 Semiconductor Energy Laboratory Co., Ltd. Information processing device
US6867752B1 (en) * 1998-08-31 2005-03-15 Semiconductor Energy Laboratory Co., Ltd. Portable information processing system
US20020140633A1 (en) * 2000-02-03 2002-10-03 Canesta, Inc. Method and system to present immersion virtual simulations using three-dimensional measurement
EP1199876B1 (fr) * 2000-10-20 2018-05-16 Samsung Electronics Co., Ltd. Système de traitement d'image et système de commande
JP2003279881A (ja) * 2002-03-27 2003-10-02 Hitachi Ltd 携帯情報装置
JP2005018613A (ja) * 2003-06-27 2005-01-20 Toshiba Corp 情報処理装置、ウィンドウ表示制御方法およびプログラム
US7403642B2 (en) * 2005-04-21 2008-07-22 Microsoft Corporation Efficient propagation for face annotation
CA2623394A1 (fr) * 2005-09-19 2007-03-29 Industrial Color, Inc. Gestion de fichiers numeriques
US20070069976A1 (en) * 2005-09-26 2007-03-29 Willins Bruce A Method and system for interface between head mounted display and handheld device
US20080186255A1 (en) * 2006-12-07 2008-08-07 Cohen Philip R Systems and methods for data annotation, recordation, and communication
JP4857196B2 (ja) * 2007-05-31 2012-01-18 キヤノン株式会社 頭部装着型表示装置、及びその制御方法

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6078427A (en) * 1998-12-01 2000-06-20 Kaiser Electro-Optics, Inc. Smooth transition device for area of interest head-mounted display

Also Published As

Publication number Publication date
WO2010066481A3 (fr) 2011-03-03
US20110291916A1 (en) 2011-12-01
WO2010066481A2 (fr) 2010-06-17

Similar Documents

Publication Publication Date Title
EP1141799B1 (fr) Systeme et procede pour le controle-commande d'un systeme d'automatisation
DE69726167T2 (de) Verfahren zur verwaltung der darstellung von bildschirmanzeigen in einer multifenster-rechnungsumgebung
WO2010066481A2 (fr) Procédé de transmission d'une image entre une première unité de commande et une deuxième unité de commande, ainsi qu'unité d'affichage
WO2000058799A1 (fr) Systeme et procede de traitement d'une documentation avec structuration multicouche d'informations, en particulier pour applications techniques et industrielles
AT15099U2 (de) System zur Überwachung einer technischen Vorrichtung
DE10253174A1 (de) Vorrichtung zur Entwicklung und/oder Konfiguration eines Automatisierungssystems
DE10320268B4 (de) Vorrichtung und Verfahren zum Auffinden und Darstellen von Informationen
DE10151938A1 (de) System und Verfahren zur dynamischen Darstellung des Ist-Zustandes eines Auftrages in Relation zu einem Zielzustand
DE112005000278T5 (de) Codec-Steuerung
EP1227647B1 (fr) Diagnostique et maintenance de machines utilisant realité amplifiée et une transmission en temps réel de messages multimédia
DE10315018A1 (de) Vorrichtung und Verfahren zum Übertragen von Videodaten
DE102004010203B4 (de) Verfahren, Vorrichtung und Computerprogramm zur Erstellung einer Projektierung für ein Bediengerät einer Automatisierungskomponente
DE102023111959A1 (de) Verfahren zum Einrichten, Bedienen und/oder Warten einer manuellen oder halbautomatischen Holzverarbeitungsvorrichtung und Anordnung mit einer manuellen oder halbautomatischen Holzverarbeitungsvorrichtung
DE10217818B4 (de) Verfahren zur Anzeige entfernter Bildschirminhalte
EP4287043A1 (fr) Génération des hologrammes destinés à être affichés dans un environnement de réalité augmentée
EP2163983A1 (fr) Procédé de production de fichier d'impression à partir d'objets de données d'une mémoire
DE102019205583B4 (de) Anordnung und Verfahren zum Konfigurieren eines Produkts
DE102008012187A1 (de) Darstellung von Bildschirminhalten in Abhängigkeit von Kompetenzfunktionen
DE102018001663A1 (de) Verfahren zur Übernahme von Daten aus einer Kompetenzliste in eine grafische Darstellung
WO2018072899A1 (fr) Dispositif de terminal informatique et procédé de création de supports de documentation numériques pour une machine de l'industrie alimentaire
DE10153511A1 (de) Service-System mit Multimedia-Dialog zu einem Experten-Center
DE102023133135A1 (de) Verfahren zur Nutzung eines erweiterten Realitätsraumes und ein physischer Anker zur Nutzung eines erweiterten Realitätsraumes
WO2024104560A1 (fr) Génération d'hologrammes pour affichage dans un environnement de réalité augmentée
DE102022108121A1 (de) Verfahren zur steuerung einer whiteboard-funktion eines gerichtssaal-mediensystems
DE202021003963U1 (de) Gerichtssaal-Mediensystem

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20110519

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SIEMENS AKTIENGESELLSCHAFT

17Q First examination report despatched

Effective date: 20170316

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SIEMENS AKTIENGESELLSCHAFT

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20170727