[go: up one dir, main page]

WO2007044815A3 - Generation of normalized 2d imagery and id systems via 2d to 3d lifting of multifeatured objects - Google Patents

Generation of normalized 2d imagery and id systems via 2d to 3d lifting of multifeatured objects Download PDF

Info

Publication number
WO2007044815A3
WO2007044815A3 PCT/US2006/039737 US2006039737W WO2007044815A3 WO 2007044815 A3 WO2007044815 A3 WO 2007044815A3 US 2006039737 W US2006039737 W US 2006039737W WO 2007044815 A3 WO2007044815 A3 WO 2007044815A3
Authority
WO
WIPO (PCT)
Prior art keywords
normalized
imagery
lifting
generation
avatar
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2006/039737
Other languages
French (fr)
Other versions
WO2007044815A2 (en
Inventor
Michael I Miller
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Animetrics Inc
Original Assignee
Animetrics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Animetrics Inc filed Critical Animetrics Inc
Publication of WO2007044815A2 publication Critical patent/WO2007044815A2/en
Anticipated expiration legal-status Critical
Publication of WO2007044815A3 publication Critical patent/WO2007044815A3/en
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional objects
    • G06V20/653—Three-dimensional objects by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional objects
    • G06V20/647—Three-dimensional objects by matching two-dimensional images to three-dimensional objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/162—Detection; Localisation; Normalisation using pixel segmentation or colour matching

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Geometry (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)

Abstract

Image acquisition system (202) captures target image (402) and generates (206) best-fitting avatar (404) using the methods described above. Best-fitting avatar is geometrically normalized by backing out deformations corresponding to non-intrinsic and non-permanent features of the target head (406). The geometrically normalized avatar is lit with normal lighting (406), and projected into an image plane corresponding to a normal pose, such as a face-on view. The resulting image (408) is geometrically normalized with respect to shape (expressions and temporary surface alterations) and pose, as well as photometrically normalized with respect to lighting.
PCT/US2006/039737 2005-10-11 2006-10-11 Generation of normalized 2d imagery and id systems via 2d to 3d lifting of multifeatured objects Ceased WO2007044815A2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US72525105P 2005-10-11 2005-10-11
US60/725,251 2005-10-11
US11/482,242 US20070080967A1 (en) 2005-10-11 2006-06-29 Generation of normalized 2D imagery and ID systems via 2D to 3D lifting of multifeatured objects
US11/482,242 2006-06-29

Publications (2)

Publication Number Publication Date
WO2007044815A2 WO2007044815A2 (en) 2007-04-19
WO2007044815A3 true WO2007044815A3 (en) 2009-04-16

Family

ID=37910687

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/039737 Ceased WO2007044815A2 (en) 2005-10-11 2006-10-11 Generation of normalized 2d imagery and id systems via 2d to 3d lifting of multifeatured objects

Country Status (2)

Country Link
US (2) US20070080967A1 (en)
WO (1) WO2007044815A2 (en)

Families Citing this family (80)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2643865A1 (en) * 2006-02-28 2007-09-07 National Research Council Of Canada Method and system for locating landmarks on 3d models
JP4585471B2 (en) * 2006-03-07 2010-11-24 株式会社東芝 Feature point detection apparatus and method
EP2082372A1 (en) * 2006-11-17 2009-07-29 THOMSON Licensing System and method for model fitting and registration of objects for 2d-to-3d conversion
US20080212835A1 (en) * 2007-03-01 2008-09-04 Amon Tavor Object Tracking by 3-Dimensional Modeling
JP4337064B2 (en) * 2007-04-04 2009-09-30 ソニー株式会社 Information processing apparatus, information processing method, and program
GB0707921D0 (en) * 2007-04-24 2007-05-30 Renishaw Plc Apparatus and method for surface measurement
CN101441781B (en) * 2007-11-23 2011-02-02 鸿富锦精密工业（深圳）有限公司 Curved surface overturning method
US8131063B2 (en) 2008-07-16 2012-03-06 Seiko Epson Corporation Model-based object image processing
US9223469B2 (en) * 2008-08-22 2015-12-29 Intellectual Ventures Fund 83 Llc Configuring a virtual world user-interface
JP5684712B2 (en) * 2008-10-29 2015-03-18 レニショウ パブリック リミテッド カンパニーＲｅｎｉｓｈａｗ Ｐｕｂｌｉｃ Ｌｉｍｉｔｅｄ Ｃｏｍｐａｎｙ Method for coordinate measuring system
US8260038B2 (en) 2009-02-25 2012-09-04 Seiko Epson Corporation Subdivision weighting for robust object model fitting
US8208717B2 (en) 2009-02-25 2012-06-26 Seiko Epson Corporation Combining subcomponent models for object image modeling
US8260039B2 (en) 2009-02-25 2012-09-04 Seiko Epson Corporation Object model fitting using manifold constraints
US8204301B2 (en) 2009-02-25 2012-06-19 Seiko Epson Corporation Iterative data reweighting for balanced model learning
US20110025689A1 (en) * 2009-07-29 2011-02-03 Microsoft Corporation Auto-Generating A Visual Representation
ES2353099B1 (en) * 2009-07-30 2012-01-02 Fundacion Para Progreso Soft Computing METHOD AND FORENSIC IDENTIFICATION SYSTEM BY SOFT COMPUTING BASED CRANEOFACIAL SUPERPOSITION.
JP5423379B2 (en) * 2009-08-31 2014-02-19 ソニー株式会社 Image processing apparatus, image processing method, and program
JP2011090466A (en) * 2009-10-21 2011-05-06 Sony Corp Information processing apparatus, method, and program
US9244533B2 (en) * 2009-12-17 2016-01-26 Microsoft Technology Licensing, Llc Camera navigation for presentations
KR20110070056A (en) * 2009-12-18 2011-06-24 한국전자통신연구원 Method and apparatus for generating high quality 3D avatar for user
KR20110071213A (en) * 2009-12-21 2011-06-29 한국전자통신연구원 3D avatar face generation device using stereo vision and face detector and its method
US20110237980A1 (en) * 2010-03-29 2011-09-29 Cranial Technologies, Inc. Assessment and classification system
US8570343B2 (en) * 2010-04-20 2013-10-29 Dassault Systemes Automatic generation of 3D models from packaged goods product images
USRE49044E1 (en) 2010-06-01 2022-04-19 Apple Inc. Automatic avatar creation
US9053562B1 (en) * 2010-06-24 2015-06-09 Gregory S. Rabin Two dimensional to three dimensional moving image converter
US9132352B1 (en) 2010-06-24 2015-09-15 Gregory S. Rabin Interactive system and method for rendering an object
US9454823B2 (en) 2010-07-28 2016-09-27 arian Medical Systems, Inc. Knowledge-based automatic image segmentation
US20130130797A1 (en) * 2010-08-24 2013-05-23 Janos Stone Systems and methods for transforming and/or generating a tangible physical structure based on user input information
US8494237B2 (en) * 2010-11-08 2013-07-23 Cranial Technologies, Inc Method and apparatus for processing digital image representations of a head shape
US8442288B2 (en) * 2010-11-08 2013-05-14 Cranial Technologies, Inc. Method and apparatus for processing three-dimensional digital mesh image representative data of three-dimensional subjects
US8711210B2 (en) 2010-12-14 2014-04-29 Raytheon Company Facial recognition using a sphericity metric
WO2012082077A2 (en) * 2010-12-17 2012-06-21 Agency For Science, Technology And Research Pose-independent 3d face reconstruction from a sample 2d face image
US9165404B2 (en) * 2011-07-14 2015-10-20 Samsung Electronics Co., Ltd. Method, apparatus, and system for processing virtual world
US10013787B2 (en) * 2011-12-12 2018-07-03 Faceshift Ag Method for facial animation
US9671566B2 (en) 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
US8970709B2 (en) * 2013-03-13 2015-03-03 Electronic Scripting Products, Inc. Reduced homography for recovery of pose parameters of an optical apparatus producing image data with structural uncertainty
US9852512B2 (en) 2013-03-13 2017-12-26 Electronic Scripting Products, Inc. Reduced homography based on structural redundancy of conditioned motion
US10533850B2 (en) 2013-07-12 2020-01-14 Magic Leap, Inc. Method and system for inserting recognized object data into a virtual world
WO2015006784A2 (en) 2013-07-12 2015-01-15 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
CN103729510B (en) * 2013-12-25 2016-09-14 合肥工业大学 Based on the interior 3 D complex model exact mirror image symmetry computational methods accumulateing conversion
US10203762B2 (en) 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
US9699123B2 (en) 2014-04-01 2017-07-04 Ditto Technologies, Inc. Methods, systems, and non-transitory machine-readable medium for incorporating a series of images resident on a user device into an existing web browser session
US10852838B2 (en) 2014-06-14 2020-12-01 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
CN112651288B (en) * 2014-06-14 2022-09-20 奇跃公司 Method and system for generating virtual and augmented reality
US9589178B2 (en) * 2014-09-12 2017-03-07 Htc Corporation Image processing with facial features
CN104463969B (en) * 2014-12-09 2017-09-26 广西界围信息科技有限公司 A kind of method for building up of the model of geographical photo to aviation tilt
RU2582852C1 (en) * 2015-01-21 2016-04-27 Общество с ограниченной ответственностью "Вокорд СофтЛаб" (ООО "Вокорд СофтЛаб") Automatic construction of 3d model of face based on series of 2d images or movie
CN106033621B (en) * 2015-03-17 2018-08-24 阿里巴巴集团控股有限公司 A kind of method and device of three-dimensional modeling
JP6754619B2 (en) * 2015-06-24 2020-09-16 三星電子株式会社Ｓａｍｓｕｎｇ Ｅｌｅｃｔｒｏｎｉｃｓ Ｃｏ．，Ｌｔｄ． Face recognition method and device
KR20170000748A (en) 2015-06-24 2017-01-03 삼성전자주식회사 Method and apparatus for face recognition
US11055762B2 (en) 2016-03-21 2021-07-06 The Procter & Gamble Company Systems and methods for providing customized product recommendations
US11577159B2 (en) 2016-05-26 2023-02-14 Electronic Scripting Products Inc. Realistic virtual/augmented/mixed reality viewing and interactions
US9875398B1 (en) 2016-06-30 2018-01-23 The United States Of America As Represented By The Secretary Of The Army System and method for face recognition with two-dimensional sensing modality
US10452896B1 (en) * 2016-09-06 2019-10-22 Apple Inc. Technique for creating avatar from image data
US10483004B2 (en) * 2016-09-29 2019-11-19 Disney Enterprises, Inc. Model-based teeth reconstruction
US10586379B2 (en) 2017-03-08 2020-03-10 Ebay Inc. Integration of 3D models
US20180268614A1 (en) * 2017-03-16 2018-09-20 General Electric Company Systems and methods for aligning pmi object on a model
US10614623B2 (en) 2017-03-21 2020-04-07 Canfield Scientific, Incorporated Methods and apparatuses for age appearance simulation
US10621771B2 (en) 2017-03-21 2020-04-14 The Procter & Gamble Company Methods for age appearance simulation
US10977509B2 (en) * 2017-03-27 2021-04-13 Samsung Electronics Co., Ltd. Image processing method and apparatus for object detection
KR101908851B1 (en) * 2017-04-14 2018-10-17 한국 한의학 연구원 Apparatus and method for correcting facial posture
WO2018222808A1 (en) 2017-05-31 2018-12-06 The Procter & Gamble Company Systems and methods for determining apparent skin age
EP3635626A1 (en) 2017-05-31 2020-04-15 The Procter and Gamble Company System and method for guiding a user to take a selfie
CN109145684B (en) * 2017-06-19 2022-02-18 西南科技大学 Head state monitoring method based on region best matching feature points
CN107978010B (en) * 2017-11-27 2021-03-05 浙江工商大学 Staged precise shape matching method
CN108366250B (en) * 2018-02-06 2020-03-17 深圳市鹰硕技术有限公司 Image display system, method and digital glasses
US11508107B2 (en) 2018-02-26 2022-11-22 Didimo, Inc. Additional developments to the automatic rig creation process
US10796468B2 (en) 2018-02-26 2020-10-06 Didimo, Inc. Automatic rig creation process
US11062494B2 (en) * 2018-03-06 2021-07-13 Didimo, Inc. Electronic messaging utilizing animatable 3D models
US11741650B2 (en) 2018-03-06 2023-08-29 Didimo, Inc. Advanced electronic messaging utilizing animatable 3D models
US11727656B2 (en) 2018-06-12 2023-08-15 Ebay Inc. Reconstruction of 3D model with immersive experience
US11049310B2 (en) * 2019-01-18 2021-06-29 Snap Inc. Photorealistic real-time portrait animation
CN110032927B (en) * 2019-02-27 2024-08-02 视缘(上海)智能科技有限公司 Face recognition method
CN110111246B (en) * 2019-05-15 2022-02-25 北京市商汤科技开发有限公司 Virtual head portrait generation method and device and storage medium
US11182945B2 (en) 2019-08-29 2021-11-23 Didimo, Inc. Automatically generating an animatable object from various types of user input
US11645800B2 (en) 2019-08-29 2023-05-09 Didimo, Inc. Advanced systems and methods for automatically generating an animatable object from various types of user input
CN110728668B (en) * 2019-10-09 2022-06-28 中国科学院光电技术研究所 Airspace high-pass filter for maintaining small target form
US11417011B2 (en) * 2020-02-11 2022-08-16 Nvidia Corporation 3D human body pose estimation using a model trained from unlabeled multi-view data
US12236517B2 (en) * 2021-11-16 2025-02-25 Disney Enterprises, Inc. Techniques for multi-view neural object modeling
CN116563575B (en) * 2023-05-11 2025-08-29 吉林大学 A multi-symmetric model matching method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1139269A2 (en) * 2000-03-30 2001-10-04 Nec Corporation Method for matching a two-dimensional image to one of a plurality of three-dimensional candidate models contained in a database
US20020012454A1 (en) * 2000-03-09 2002-01-31 Zicheng Liu Rapid computer modeling of faces for animation
US6556196B1 (en) * 1999-03-19 2003-04-29 Max-Planck-Gesellschaft Zur Forderung Der Wissenschaften E.V. Method and apparatus for the processing of images
US6940545B1 (en) * 2000-02-28 2005-09-06 Eastman Kodak Company Face detecting camera and method

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5742291A (en) * 1995-05-09 1998-04-21 Synthonics Incorporated Method and apparatus for creation of three-dimensional wire frames
US5844573A (en) * 1995-06-07 1998-12-01 Massachusetts Institute Of Technology Image compression by pointwise prototype correspondence using shape and texture information
US6226418B1 (en) * 1997-11-07 2001-05-01 Washington University Rapid convolution based large deformation image matching via landmark and volume imagery
US5990901A (en) * 1997-06-27 1999-11-23 Microsoft Corporation Model based image editing and correction
WO1999015945A2 (en) * 1997-09-23 1999-04-01 Enroute, Inc. Generating three-dimensional models of objects defined by two-dimensional image data
US6249600B1 (en) * 1997-11-07 2001-06-19 The Trustees Of Columbia University In The City Of New York System and method for generation of a three-dimensional solid model
CA2312315A1 (en) * 1997-12-01 1999-06-10 Arsev H. Eraslan Three-dimensional face identification system
US6362833B2 (en) * 1998-04-08 2002-03-26 Intel Corporation Method and apparatus for progressively constructing a series of morphs between two-dimensional or three-dimensional models
IT1315446B1 (en) * 1998-10-02 2003-02-11 Cselt Centro Studi Lab Telecom PROCEDURE FOR THE CREATION OF THREE-DIMENSIONAL FACIAL MODELS TO START FROM FACE IMAGES.
JP4025442B2 (en) * 1998-12-01 2007-12-19 富士通株式会社 3D model conversion apparatus and method
JP3575679B2 (en) * 2000-03-31 2004-10-13 日本電気株式会社 Face matching method, recording medium storing the matching method, and face matching device
US6975750B2 (en) * 2000-12-01 2005-12-13 Microsoft Corp. System and method for face recognition using synthesized training images
GB2383915B (en) * 2001-11-23 2005-09-28 Canon Kk Method and apparatus for generating models of individuals
US7221809B2 (en) * 2001-12-17 2007-05-22 Genex Technologies, Inc. Face recognition system and method
US20030169906A1 (en) * 2002-02-26 2003-09-11 Gokturk Salih Burak Method and apparatus for recognizing objects
KR100528330B1 (en) * 2003-02-19 2005-11-16 삼성전자주식회사 Method for coating surface of inorganic powder and coated inorganic powder manufactured using the same
US7853085B2 (en) * 2003-03-06 2010-12-14 Animetrics, Inc. Viewpoint-invariant detection and identification of a three-dimensional object from two-dimensional imagery

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6556196B1 (en) * 1999-03-19 2003-04-29 Max-Planck-Gesellschaft Zur Forderung Der Wissenschaften E.V. Method and apparatus for the processing of images
US6940545B1 (en) * 2000-02-28 2005-09-06 Eastman Kodak Company Face detecting camera and method
US20020012454A1 (en) * 2000-03-09 2002-01-31 Zicheng Liu Rapid computer modeling of faces for animation
EP1139269A2 (en) * 2000-03-30 2001-10-04 Nec Corporation Method for matching a two-dimensional image to one of a plurality of three-dimensional candidate models contained in a database

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"2000, In Proceedings of the Intemational Conference on Image Processing", article ZHAO ET AL.: "3D Model Enhanced Faced Recognition", pages: 50 - 53 *

Also Published As

Publication number Publication date
WO2007044815A2 (en) 2007-04-19
US20100149177A1 (en) 2010-06-17
US20070080967A1 (en) 2007-04-12

Similar Documents

Publication Publication Date Title
WO2007044815A3 (en) Generation of normalized 2d imagery and id systems via 2d to 3d lifting of multifeatured objects
WO2008087652A3 (en) Depth mapping using multi-beam illumination
WO2005010825A3 (en) Method and sytem for the three-dimensional surface reconstruction of an object
CN102840825B (en) Particle locating system and method
WO2003087991A3 (en) System and method for authentication of a workpiece using three dimensional shape recovery
WO2007087198A3 (en) Multiple laser scanner
WO2007070853A3 (en) System and method for tracking eyeball motion
WO2014048571A8 (en) High resolution microscopy by means of structured illumination at large working distances
EP4019890A3 (en) Line scanner having target-tracking and geometry-tracking modes
CN103512636B (en) A kind of water detection method based on laser scanning
EP1304264A3 (en) A 360 degree vision system for a vehicle
ATE535841T1 (en) DEVICE FOR ASSESSING A TIRE SURFACE
WO2005101908A3 (en) Data processing for three-dimensional displays
WO2009074751A3 (en) Method for three-dimensional digitisation
EP2341280A3 (en) Illumination device and producing method thereof
WO2009075330A1 (en) Measuring method, inspecting method, measuring apparatus and inspecting apparatus
CN102364524A (en) A 3D reconstruction method and device based on variable illumination multi-viewpoint difference sampling
WO2011071623A3 (en) Accelerating bitmap remoting by identifying and extracting 2d patterns from source bitmaps
WO2007032940A3 (en) System and methods for generating three-dimensional images from two-dimensional bioluminescence images and visualizing tumor shapes and locations
WO2012099556A3 (en) Cooperative pointillistic projection of a graphical image on a pre-selected remote surface by using a multiplicity of lasers
WO2004036248A3 (en) Optical sensor
CN106493731B (en) A method of it realizing that brake disc is torn open using robot 3D vision and stamps
AR060830A1 (en) PROCEDURE TO OBTAIN CIAMELURIC CHLORIDE
WO2007020666A8 (en) Vision sensor for security systems and its operating method
CN204929014U (en) Infrared wide angle of video camera night vision illumination structure

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06816720

Country of ref document: EP

Kind code of ref document: A2