[go: up one dir, main page]

PL4047434T3 - Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów rozszerzonej rzeczywistości ar - Google Patents

Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów rozszerzonej rzeczywistości ar

Info

Publication number
PL4047434T3
PL4047434T3 PL21158161.6T PL21158161T PL4047434T3 PL 4047434 T3 PL4047434 T3 PL 4047434T3 PL 21158161 T PL21158161 T PL 21158161T PL 4047434 T3 PL4047434 T3 PL 4047434T3
Authority
PL
Poland
Prior art keywords
drone
flying
glasses
assisting
operator
Prior art date
Application number
PL21158161.6T
Other languages
English (en)
Inventor
Hannu Lesonen
Lassi Immonen
Original Assignee
Anarky Labs Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Anarky Labs Oy filed Critical Anarky Labs Oy
Publication of PL4047434T3 publication Critical patent/PL4047434T3/pl

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20Control system inputs
    • G05D1/22Command input arrangements
    • G05D1/221Remote-control arrangements
    • G05D1/222Remote-control arrangements operated by humans
    • G05D1/224Output arrangements on the remote controller, e.g. displays, haptics or speakers
    • G05D1/2244Optic
    • G05D1/2245Optic providing the operator with a purely computer-generated representation of the environment of the vehicle, e.g. virtual reality
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0011Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement
    • G05D1/0038Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64CAEROPLANES; HELICOPTERS
    • B64C39/00Aircraft not otherwise provided for
    • B64C39/02Aircraft not otherwise provided for characterised by special use
    • B64C39/024Aircraft not otherwise provided for characterised by special use of the remote controlled vehicle type, i.e. RPV
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0011Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement
    • G05D1/0022Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement characterised by the communication link
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0011Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement
    • G05D1/0044Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20Control system inputs
    • G05D1/22Command input arrangements
    • G05D1/221Remote-control arrangements
    • G05D1/222Remote-control arrangements operated by humans
    • G05D1/224Output arrangements on the remote controller, e.g. displays, haptics or speakers
    • G05D1/2244Optic
    • G05D1/2247Optic providing the operator with simple or augmented images from one or more cameras
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20Control system inputs
    • G05D1/22Command input arrangements
    • G05D1/221Remote-control arrangements
    • G05D1/226Communication links with the remote-control arrangements
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20Control system inputs
    • G05D1/22Command input arrangements
    • G05D1/229Command input data, e.g. waypoints
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2101/00UAVs specially adapted for particular uses or applications
    • B64U2101/30UAVs specially adapted for particular uses or applications for imaging, photography or videography
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2201/00UAVs characterised by their flight controls
    • B64U2201/20Remote controls
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D2109/00Types of controlled vehicles
    • G05D2109/20Aircraft, e.g. drones

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Automation & Control Theory (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Processing Or Creating Images (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Traffic Control Systems (AREA)
  • User Interface Of Digital Computer (AREA)
PL21158161.6T 2021-02-19 2021-02-19 Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów rozszerzonej rzeczywistości ar PL4047434T3 (pl)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP21158161.6A EP4047434B1 (en) 2021-02-19 2021-02-19 Apparatus, method and software for assisting an operator in flying a drone using a remote controller and ar glasses

Publications (1)

Publication Number Publication Date
PL4047434T3 true PL4047434T3 (pl) 2024-04-15

Family

ID=74672174

Family Applications (2)

Application Number Title Priority Date Filing Date
PL21158161.6T PL4047434T3 (pl) 2021-02-19 2021-02-19 Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów rozszerzonej rzeczywistości ar
PL23198555.7T PL4273656T3 (pl) 2021-02-19 2021-02-19 Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów ar

Family Applications After (1)

Application Number Title Priority Date Filing Date
PL23198555.7T PL4273656T3 (pl) 2021-02-19 2021-02-19 Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów ar

Country Status (8)

Country Link
US (2) US11409280B1 (pl)
EP (2) EP4047434B1 (pl)
JP (1) JP7698725B2 (pl)
KR (1) KR20230158498A (pl)
CN (1) CN117222955A (pl)
ES (2) ES3014104T3 (pl)
PL (2) PL4047434T3 (pl)
WO (1) WO2022175379A1 (pl)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11414189B2 (en) * 2020-04-15 2022-08-16 Edmond A. DeFrank Social distancing methods and devices
ES3014104T3 (en) * 2021-02-19 2025-04-16 Anarky Labs Oy Apparatus, method and software for assisting an operator in flying a drone using a remote controller and ar glasses
US11702191B1 (en) * 2022-10-30 2023-07-18 Archer Aviation, Inc. Systems and methods for controlling an electric vertical take-off and landing aircraft
TWI831495B (zh) * 2022-12-01 2024-02-01 財團法人工業技術研究院 定位系統及定位方法
GB2629638B (en) * 2023-05-05 2025-07-16 J Saunders Mike Methods and apparatus for augmented reality
WO2024261732A1 (en) * 2023-06-23 2024-12-26 National Research Council Of Canada Augmenting uav flight data with regulatory alert
CN120317019B (zh) * 2025-06-11 2025-09-19 之江实验室 仿真无人机的调度方法、装置、电子设备及存储介质

Family Cites Families (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10488860B1 (en) * 2006-02-21 2019-11-26 Automodality, Inc. Geocoding data for an automated vehicle
US9134534B2 (en) * 2010-02-28 2015-09-15 Microsoft Technology Licensing, Llc See-through near-eye display glasses including a modular image source
US9097890B2 (en) * 2010-02-28 2015-08-04 Microsoft Technology Licensing, Llc Grating in a light transmissive illumination system for see-through near-eye display glasses
US20150309316A1 (en) * 2011-04-06 2015-10-29 Microsoft Technology Licensing, Llc Ar glasses with predictive control of external device based on event input
FR2957266B1 (fr) * 2010-03-11 2012-04-20 Parrot Procede et appareil de telecommande d'un drone, notamment d'un drone a voilure tournante.
TWI649675B (zh) * 2013-03-28 2019-02-01 新力股份有限公司 Display device
US20160109957A1 (en) 2013-05-09 2016-04-21 Sony Computer Entertainment Inc. Information processing apparatus and application execution method
US8903568B1 (en) * 2013-07-31 2014-12-02 SZ DJI Technology Co., Ltd Remote control method and terminal
JP2015119373A (ja) * 2013-12-19 2015-06-25 ソニー株式会社 画像処理装置および方法、並びにプログラム
US9595138B2 (en) * 2014-05-29 2017-03-14 Commissariat A L'energie Atomique Et Aux Energies Alternatives Augmented reality display device
CN107168352B (zh) * 2014-07-30 2020-07-14 深圳市大疆创新科技有限公司 目标追踪系统及方法
MA41082A1 (fr) * 2015-03-01 2018-06-29 Aris Md Inc Procédure morphologique à réalité augmentée
FR3035523B1 (fr) * 2015-04-23 2017-04-21 Parrot Systeme de pilotage de drone en immersion
JP6572618B2 (ja) * 2015-05-08 2019-09-11 富士通株式会社 情報処理装置、情報処理プログラム、情報処理方法、端末装置、設定方法、設定プログラム
FR3046226B1 (fr) * 2015-12-29 2020-02-14 Thales Affichage de donnees meteorologiques dans un aeronef
FR3046225B1 (fr) * 2015-12-29 2019-06-28 Thales Affichage de donnees meteorologiques dans un aeronef
US10317989B2 (en) * 2016-03-13 2019-06-11 Logitech Europe S.A. Transition between virtual and augmented reality
CN113359807B (zh) * 2016-04-29 2024-11-05 深圳市大疆创新科技有限公司 一种无人机第一视角飞行的控制方法及系统、智能眼镜
US10474144B2 (en) * 2016-08-01 2019-11-12 The United States Of America, As Represented By The Secretary Of The Navy Remote information collection, situational awareness, and adaptive response system for improving advance threat awareness and hazardous risk avoidance
CN113074733B (zh) * 2016-11-14 2025-06-10 深圳市大疆创新科技有限公司 飞行轨迹的生成方法、控制装置及无人飞行器
CN106500716A (zh) * 2016-12-13 2017-03-15 英业达科技有限公司 车辆导航投影系统及其方法
CN106643781A (zh) * 2016-12-14 2017-05-10 英业达科技有限公司 车辆导航显示系统及其方法
JP2018112809A (ja) 2017-01-10 2018-07-19 セイコーエプソン株式会社 頭部装着型表示装置およびその制御方法、並びにコンピュータープログラム
US10532814B2 (en) * 2017-09-11 2020-01-14 Disney Enterprises, Inc. Augmented reality travel route planning
US20190088025A1 (en) * 2017-09-15 2019-03-21 DroneBase, Inc. System and method for authoring and viewing augmented reality content with a drone
US11380039B2 (en) 2017-12-14 2022-07-05 Magic Leap, Inc. Contextual-based rendering of virtual avatars
US10678238B2 (en) * 2017-12-20 2020-06-09 Intel IP Corporation Modified-reality device and method for operating a modified-reality device
US11153503B1 (en) * 2018-04-26 2021-10-19 AI Incorporated Method and apparatus for overexposing images captured by drones
JP2019206262A (ja) 2018-05-29 2019-12-05 日本精機株式会社 表示装置
JP2019211249A (ja) * 2018-05-31 2019-12-12 パナソニック株式会社 飛行物体検知システムおよび飛行物体検知方法
CN111372851B (zh) 2018-08-16 2023-11-21 乐天集团股份有限公司 无人航空器控制系统、无人航空器控制方法、及可读存储媒体
US12019441B2 (en) * 2018-11-30 2024-06-25 Rakuten Group, Inc. Display control system, display control device and display control method
CN110244760A (zh) * 2019-06-06 2019-09-17 深圳市道通智能航空技术有限公司 一种避障方法、装置和电子设备
KR20210078164A (ko) * 2019-12-18 2021-06-28 엘지전자 주식회사 드론을 제어하기 위한 사용자 단말, 시스템 및 제어 방법
US11043038B1 (en) * 2020-03-16 2021-06-22 Hong Kong Applied Science and Technology Research Institute Company Limited Apparatus and method of three-dimensional interaction for augmented reality remote assistance
US11804052B2 (en) * 2020-03-26 2023-10-31 Seiko Epson Corporation Method for setting target flight path of aircraft, target flight path setting system, and program for setting target flight path
ES3014104T3 (en) * 2021-02-19 2025-04-16 Anarky Labs Oy Apparatus, method and software for assisting an operator in flying a drone using a remote controller and ar glasses

Also Published As

Publication number Publication date
US11409280B1 (en) 2022-08-09
US11669088B2 (en) 2023-06-06
WO2022175379A1 (en) 2022-08-25
US20220269266A1 (en) 2022-08-25
CN117222955A (zh) 2023-12-12
EP4047434B1 (en) 2023-11-08
PL4273656T3 (pl) 2025-05-12
JP7698725B2 (ja) 2025-06-25
EP4273656C0 (en) 2025-01-29
JP2024516480A (ja) 2024-04-16
EP4273656B1 (en) 2025-01-29
KR20230158498A (ko) 2023-11-20
EP4273656A2 (en) 2023-11-08
EP4047434C0 (en) 2023-11-08
US20220269267A1 (en) 2022-08-25
EP4047434A1 (en) 2022-08-24
ES2970543T3 (es) 2024-05-29
EP4273656A3 (en) 2023-12-20
ES3014104T3 (en) 2025-04-16

Similar Documents

Publication Publication Date Title
PL4273656T3 (pl) Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów ar
EP4224369A4 (en) METHOD, APPARATUS AND SYSTEM FOR MANAGING A MACHINE LEARNING MODEL
EP4113375A4 (en) METHOD AND APPARATUS FOR TEACHING AN IMAGE PROCESSING MODEL
EP4446882A4 (en) Method and device for model configuration
EP4144155A4 (en) METHOD AND DEVICE FOR PERFORMING RADIO CALLS IN A COMMUNICATIONS SYSTEM
KR102334011B9 (ko) 무선 통신 시스템에서 머신 러닝 기반 제한된 피드백 방법 및 장치
EP4270266A4 (en) METHOD AND APPARATUS FOR UPDATE A MACHINE LEARNING MODEL
EP4258173A4 (en) PROCESSING METHOD AND APPARATUS FOR MODEL
SG11202101591XA (en) System and method for controlling a massage apparatus
IL259252B (en) Device, system and method for docking a flying device
EP3989027A4 (en) ROBOT CONTROL METHOD AND APPARATUS, AND VISUAL DEVICE CONTROL METHOD AND APPARATUS
EP4116894A4 (en) METHOD OF PROCESSING MODEL PARAMETERS AND DEVICE
EP4034988A4 (en) METHOD AND APPARATUS FOR A STAGED WORKFLOW
GB202002870D0 (en) A method and system for controlling a storage apparatus
EP3759059B8 (fr) Procede de traitement d'un recipient a paroi en verre et installation afferente
EP4305873A4 (en) METHOD AND APPARATUS FOR RATE CONTROL
EP4018620A4 (en) METHOD AND APPARATUS FOR PERFORMING PROTECTION CONTROL IN A CENTRAL NETWORK
EP4387708A4 (en) Method and device for assisting a heart
EP3907662A4 (en) METHOD AND APPARATUS FOR PROCESSING AN ARTIFICIAL NEURON NETWORK MODEL
GB201808999D0 (en) An apparatus and a method for controlling steering
EP4116068A4 (en) DEVICE FOR 3D PRINTING AND CONTROL METHOD THEREOF
GB202011887D0 (en) Method and apparatus for manufacturing a consumable unit for an inhalation device
EP3914421A4 (en) ROBOTIC SYSTEM MONITORING METHOD AND APPARATUS
GB202417236D0 (en) Method and apparatus for online training radiation image recognition model, and radiation image recognition method and apparatus
PL4444615T3 (pl) Urządzenie i sposób pobierania wody do lecącego samolotu