[go: up one dir, main page]

GB2494081A - Mobile human interface robot - Google Patents

Mobile human interface robot Download PDF

Info

Publication number
GB2494081A
GB2494081A GB1222036.4A GB201222036A GB2494081A GB 2494081 A GB2494081 A GB 2494081A GB 201222036 A GB201222036 A GB 201222036A GB 2494081 A GB2494081 A GB 2494081A
Authority
GB
United Kingdom
Prior art keywords
point cloud
drive system
human interface
interface robot
mobile human
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB1222036.4A
Other versions
GB2494081B (en
Inventor
Michael T Rosenstein
Michael Halloran
Cheuk Wah Wong
Steven V Shamlian
Chikyung Won
Mark Chiappetta
Justin H Kearns
Orjeta Taka
Robert Todd Pack
Timothy S Farlow
Jasper Fourways Vicenti
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
iRobot Corp
Original Assignee
iRobot Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/032,312 external-priority patent/US8918209B2/en
Application filed by iRobot Corp filed Critical iRobot Corp
Priority to GB1510218.9A priority Critical patent/GB2527207B/en
Publication of GB2494081A publication Critical patent/GB2494081A/en
Application granted granted Critical
Publication of GB2494081B publication Critical patent/GB2494081B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1694Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J5/00Manipulators mounted on wheels or on carriages
    • B25J5/007Manipulators mounted on wheels or on carriages mounted on wheels
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00Manipulators not otherwise provided for
    • B25J11/008Manipulators for service tasks
    • B25J11/009Nursing, e.g. carrying sick persons, pushing wheelchairs, distributing drugs
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00Controls for manipulators
    • B25J13/08Controls for manipulators by means of sensing devices, e.g. viewing or touching devices
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J19/00Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
    • B25J19/02Sensing devices
    • B25J19/021Optical sensing devices
    • B25J19/023Optical sensing devices including video camera means
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
    • G05D1/0248Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means in combination with a laser
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
    • G05D1/0251Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0268Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means
    • G05D1/0274Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means using mapping information stored in a memory device
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00Optical objectives specially designed for the purposes specified below
    • G02B13/22Telecentric objectives or lens systems
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0238Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using obstacle or wall sensors
    • G05D1/024Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using obstacle or wall sensors in combination with a laser
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0255Control of position or course in two dimensions specially adapted to land vehicles using acoustic signals, e.g. ultra-sonic singals
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0268Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means
    • G05D1/0272Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means comprising means for registering the travel distance, e.g. revolutions of wheels

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Automation & Control Theory (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Remote Sensing (AREA)
  • Multimedia (AREA)
  • Electromagnetism (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Health & Medical Sciences (AREA)
  • Nursing (AREA)
  • General Health & Medical Sciences (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Manipulator (AREA)

Abstract

A mobile robot (100) that includes a drive system (200), a controller (500) in communication with the drive system, and a volumetric point cloud imaging device (450) supported above the drive system at a height of greater than about one feet above the ground and directed to be capable of obtaining a point cloud from a volume of space that includes a floor plane in a direction of movement of the mobile robot. The controller receives point cloud signals from the imaging device and issues drive commands to the drive system based at least in part on the received point cloud signals.
GB1222036.4A 2010-05-20 2011-05-06 Mobile human interface robot Active GB2494081B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
GB1510218.9A GB2527207B (en) 2010-05-20 2011-05-06 Mobile human interface robot

Applications Claiming Priority (12)

Application Number Priority Date Filing Date Title
US34661210P 2010-05-20 2010-05-20
US35691010P 2010-06-21 2010-06-21
US201061428759P 2010-12-30 2010-12-30
US201061428734P 2010-12-30 2010-12-30
US201061428717P 2010-12-30 2010-12-30
US201161429863P 2011-01-05 2011-01-05
US201161445408P 2011-02-22 2011-02-22
US201161445473P 2011-02-22 2011-02-22
US13/032,312 US8918209B2 (en) 2010-05-20 2011-02-22 Mobile human interface robot
US13/032,228 US9400503B2 (en) 2010-05-20 2011-02-22 Mobile human interface robot
US201161478849P 2011-04-25 2011-04-25
PCT/US2011/035488 WO2011146259A2 (en) 2010-05-20 2011-05-06 Mobile human interface robot

Publications (2)

Publication Number Publication Date
GB2494081A true GB2494081A (en) 2013-02-27
GB2494081B GB2494081B (en) 2015-11-11

Family

ID=47623748

Family Applications (1)

Application Number Title Priority Date Filing Date
GB1222036.4A Active GB2494081B (en) 2010-05-20 2011-05-06 Mobile human interface robot

Country Status (2)

Country Link
GB (1) GB2494081B (en)
WO (1) WO2011146259A2 (en)

Families Citing this family (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8918209B2 (en) 2010-05-20 2014-12-23 Irobot Corporation Mobile human interface robot
US9014848B2 (en) 2010-05-20 2015-04-21 Irobot Corporation Mobile robot system
US8918213B2 (en) 2010-05-20 2014-12-23 Irobot Corporation Mobile human interface robot
US8935005B2 (en) 2010-05-20 2015-01-13 Irobot Corporation Operating a mobile robot
GB2509814B (en) * 2010-12-30 2014-11-12 Irobot Corp A method of operating a mobile robot
US8930019B2 (en) 2010-12-30 2015-01-06 Irobot Corporation Mobile human interface robot
KR101910382B1 (en) * 2011-12-08 2018-10-22 엘지전자 주식회사 Automatic moving apparatus and manual operation method thereof
US9563966B2 (en) 2011-12-23 2017-02-07 Nokia Technologies Oy Image control method for defining images for waypoints along a trajectory
US8958911B2 (en) 2012-02-29 2015-02-17 Irobot Corporation Mobile robot
WO2013140359A2 (en) * 2012-03-21 2013-09-26 Svip Llc, Series 9 Apparatus and system for imaging in video calls
EP2853097B1 (en) * 2012-05-23 2018-07-11 Intel Corporation Depth gradient based tracking
JP2014212479A (en) * 2013-04-19 2014-11-13 ソニー株式会社 Control device, control method, and computer program
US9378554B2 (en) 2014-10-09 2016-06-28 Caterpillar Inc. Real-time range map generation
KR101620427B1 (en) 2014-10-14 2016-05-12 엘지전자 주식회사 Method of controlling robot cleaner
US9744670B2 (en) 2014-11-26 2017-08-29 Irobot Corporation Systems and methods for use of optical odometry sensors in a mobile robot
GB2538751A (en) * 2015-05-27 2016-11-30 Imp College Of Science Tech And Medicine Modelling a three-dimensional space
US20160349754A1 (en) 2015-05-29 2016-12-01 Clearpath Robotics, Inc. Method, system and apparatus for controlling self-driving vehicles
KR20170053351A (en) * 2015-11-06 2017-05-16 삼성전자주식회사 Cleaning robot and controlling method thereof
US10081106B2 (en) * 2015-11-24 2018-09-25 X Development Llc Safety system for integrated human/robotic environments
EP3203412A1 (en) * 2016-02-05 2017-08-09 Delphi Technologies, Inc. System and method for detecting hand gestures in a 3d space
US10662045B2 (en) 2016-02-11 2020-05-26 Clearpath Robotics Inc. Control augmentation apparatus and method for automated guided vehicles
WO2017197170A1 (en) * 2016-05-12 2017-11-16 The Regents Of The University Of California Safely controlling an autonomous entity in presence of intelligent agents
DE102016212077A1 (en) * 2016-07-04 2018-01-04 Siemens Healthcare Gmbh A method of operating an at least partially autonomously moved mobile medical device and mobile medical device
US10265856B2 (en) 2016-07-21 2019-04-23 X Development Llc Reorienting a distance sensor using an adjustable leveler
WO2018073829A1 (en) * 2016-10-20 2018-04-26 Robo-Team Home Ltd. Human-tracking robot
WO2018191818A1 (en) 2017-04-18 2018-10-25 Clearpath Robotics Inc. Stand-alone self-driving material-transport vehicle
WO2018213931A1 (en) 2017-05-25 2018-11-29 Clearpath Robotics Inc. Systems and methods for process tending with a robot arm
US11422569B2 (en) 2017-08-31 2022-08-23 Clearpath Robotics Inc. Systems and methods for generating a mission for a self-driving material-transport vehicle
WO2019041044A1 (en) 2017-08-31 2019-03-07 Clearpath Robotics Inc. Apparatus, systems, and methods for payload pick-up and drop-off with a self-driving material-transport vehicle
WO2019084686A1 (en) * 2017-10-31 2019-05-09 Clearpath Robotics Inc. Systems and methods for operating robotic equipment in controlled zones
CN110039535B (en) * 2018-01-17 2022-12-16 阿里巴巴集团控股有限公司 Robot interaction method and robot
CN109906134B (en) * 2018-03-27 2022-06-24 尤中乾 Robot avoidance control method and related device
TWI664573B (en) * 2018-05-11 2019-07-01 國立交通大學 Motion computing device, robot system and robot controlling method
US11192253B2 (en) * 2018-10-12 2021-12-07 Toyota Research Institute, Inc. Systems and methods for conditional robotic teleoperation
CN109250004A (en) * 2018-10-29 2019-01-22 逻腾(杭州)科技有限公司 A kind of panoramic information acquisition rolling robot
CN112512755B (en) * 2019-03-01 2025-01-14 谷歌有限责任公司 Robotic manipulation using domain-invariant 3D representations predicted from 2.5D visual data
EP3941693A4 (en) * 2019-03-20 2022-11-30 Covidien LP ROBOTIC SURGICAL COLLISION DETECTION SYSTEMS
WO2021025715A1 (en) * 2019-08-07 2021-02-11 Boston Dynamics, Inc. Navigating a mobile robot
TWI739339B (en) * 2020-03-11 2021-09-11 國立陽明交通大學 System for indoor positioning of personnel and tracking interactions with specific personnel by mobile robot and method thereof
FR3108183B1 (en) * 2020-03-13 2022-02-25 Orano Ds Demantelement Et Services Method for automatically performing an operation on an object with a tool carried by a polyarticulated system
JP7544511B2 (en) * 2020-06-05 2024-09-03 川崎重工業株式会社 Angle Calibration Method
US12085960B2 (en) * 2020-07-23 2024-09-10 Autobrains Technologies Ltd Autonomously following a person
US12122367B2 (en) 2020-09-10 2024-10-22 Rockwell Automation Technologies, Inc. Systems and methods for operating one or more self-driving vehicles
CN114577806B (en) * 2020-11-30 2025-01-14 广东博智林机器人有限公司 Wall panel installation robot and visual inspection method
EP4419302A1 (en) * 2021-10-19 2024-08-28 ABB Schweiz AG Robotic system comprising an environment sensor
CN114612572B (en) * 2022-03-11 2025-01-14 中国科学院长春光学精密机械与物理研究所 A laser radar and camera extrinsic parameter calibration method and device based on deep learning
CN115272427A (en) * 2022-08-11 2022-11-01 熵智科技(深圳)有限公司 Posture recognition method, device and equipment based on minimum envelope and storage medium
CN117670184B (en) * 2024-01-31 2024-05-03 埃罗德智能科技(辽宁)有限公司 Robot scene simulation method and system applied to digital robot industrial chain
CN118928802B (en) * 2024-08-26 2025-10-17 西北工业大学 Reconfigurable modularized robot structure for airplane surface quality detection

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US216621A (en) 1879-06-17 Improvement in clothes-bars
US20020195548A1 (en) 2001-06-06 2002-12-26 Dowski Edward Raymond Wavefront coding interference contrast imaging systems
US6323942B1 (en) 1999-04-30 2001-11-27 Canesta, Inc. CMOS-compatible three-dimensional image sensor IC
US6515740B2 (en) 2000-11-09 2003-02-04 Canesta, Inc. Methods for CMOS-compatible three-dimensional image sensing using quantum efficiency modulation
AU2003217587A1 (en) 2002-02-15 2003-09-09 Canesta, Inc. Gesture recognition system using depth perceptive sensors
AU2003209661A1 (en) 2002-03-14 2003-09-22 Ramot At Tel Aviv University Ltd. All optical extended depth-of-field imaging system
US8390821B2 (en) 2005-10-11 2013-03-05 Primesense Ltd. Three-dimensional sensing using speckle patterns
US7433024B2 (en) 2006-02-27 2008-10-07 Prime Sense Ltd. Range mapping using speckle decorrelation
KR101408959B1 (en) 2006-03-14 2014-07-02 프라임센스 엘티디. Depth-varying light fields for three dimensional sensing
CN101657825B (en) 2006-05-11 2014-02-19 普莱姆传感有限公司 Modeling Human Figures from Depth Maps
US20100066587A1 (en) * 2006-07-14 2010-03-18 Brian Masao Yamauchi Method and System for Controlling a Remote Vehicle
WO2008087652A2 (en) 2007-01-21 2008-07-24 Prime Sense Ltd. Depth mapping using multi-beam illumination
US8150142B2 (en) 2007-04-02 2012-04-03 Prime Sense Ltd. Depth mapping using projected patterns
WO2008120217A2 (en) 2007-04-02 2008-10-09 Prime Sense Ltd. Depth mapping using projected patterns
US7962243B2 (en) * 2007-12-19 2011-06-14 Foster-Miller, Inc. Weapon robot with situational awareness
WO2009093228A2 (en) 2008-01-21 2009-07-30 Prime Sense Ltd. Optical designs for zero order reduction

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
WO2011146259A3 (en) 2013-08-01
WO2011146259A2 (en) 2011-11-24
GB2494081B (en) 2015-11-11

Similar Documents

Publication Publication Date Title
GB2494081A (en) Mobile human interface robot
GB2502213A (en) Mobile Human Interface Robot
EP2647475A3 (en) Mobile human interface robot
EP3064135A4 (en) Interactive hearing diagnosis and treatment system based on wireless mobile communication platform
EP2609568B8 (en) Portable wireless mobile device motion capture and analysis system and method
EP3492118A3 (en) A touch screen interface and infrared communication system integrated into a battery
IN2014CN04929A (en)
GB2555027A (en) Three-dimensional measuring device removably coupled to robotic arm on motorized mobile platform
WO2012093823A3 (en) Wireless power transmission apparatus and system for wireless power transmission thereof
PL2347988T3 (en) Device to control actively the vibrations of an articulated arm to pump concrete.
EP2657776A3 (en) Image forming apparatus
IL227187B (en) Mobile robot system
GB2501209A (en) Mobile Robot System
EP2630856A3 (en) Height control
WO2014018561A3 (en) Wireless immersive simulation system
IN2013MU02460A (en)
WO2013130664A8 (en) 360° imaging system
AU2014209536A8 (en) Medical rehab lift system and method with horizontal and vertical force sensing and motion control
WO2012044712A3 (en) Long drag gesture in user interface
EP2385603A3 (en) Smart power device
WO2014026027A3 (en) Ocean floor mounting of wave energy converters
EP2725465A3 (en) Information-processing device, program, information-processing method, and information-processing system
WO2014013367A3 (en) Swivel gantry for multi-modal imaging systems
EP2664907A3 (en) Wind tunnel model measuring system and method
MX2014002483A (en) Wireless pneumatic controller.

Legal Events

Date Code Title Description
732E Amendments to the register in respect of changes of name or changes affecting rights (sect. 32/1977)

Free format text: REGISTERED BETWEEN 20191219 AND 20191224