[go: up one dir, main page]

WO2019152983A3 - System and apparatus for face anti-spoofing via auxiliary supervision - Google Patents

System and apparatus for face anti-spoofing via auxiliary supervision Download PDF

Info

Publication number
WO2019152983A3
WO2019152983A3 PCT/US2019/016638 US2019016638W WO2019152983A3 WO 2019152983 A3 WO2019152983 A3 WO 2019152983A3 US 2019016638 W US2019016638 W US 2019016638W WO 2019152983 A3 WO2019152983 A3 WO 2019152983A3
Authority
WO
WIPO (PCT)
Prior art keywords
rnn
cnn
sequence
estimated
network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2019/016638
Other languages
French (fr)
Other versions
WO2019152983A2 (en
Inventor
Xiaoming Liu
Yaojie LIU
Amin JOURABLOO
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Michigan State University MSU
Original Assignee
Michigan State University MSU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Michigan State University MSU filed Critical Michigan State University MSU
Publication of WO2019152983A2 publication Critical patent/WO2019152983A2/en
Publication of WO2019152983A3 publication Critical patent/WO2019152983A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/40—Spoof detection, e.g. liveness detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Molecular Biology (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Image Analysis (AREA)

Abstract

A unified convolutional neural network (CNN) - recurrent neural network (RNN) architecture is provided, which may be trained to distinguish between a presentation attack (PA) and a live face, for a given sequence of image frames (e.g., video). The CNN portion of the network may produce an estimated depth map and an estimated feature map for each image frame in the sequence, while the RNN portion of the network may produce an estimated remote Photoplethysmography (rPPG) signal. A non-rigid registration layer may be coupled between the CNN and the RNN and may frontalize the feature maps using 3D face shape data derived from the sequence of image frames.
PCT/US2019/016638 2018-02-05 2019-02-05 System and apparatus for face anti-spoofing via auxiliary supervision Ceased WO2019152983A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862626486P 2018-02-05 2018-02-05
US62/626,486 2018-02-05

Publications (2)

Publication Number Publication Date
WO2019152983A2 WO2019152983A2 (en) 2019-08-08
WO2019152983A3 true WO2019152983A3 (en) 2020-04-30

Family

ID=67478944

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2019/016638 Ceased WO2019152983A2 (en) 2018-02-05 2019-02-05 System and apparatus for face anti-spoofing via auxiliary supervision

Country Status (1)

Country Link
WO (1) WO2019152983A2 (en)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2579583B (en) 2018-12-04 2021-01-06 Yoti Holding Ltd Anti-spoofing
US11657525B2 (en) 2018-12-04 2023-05-23 Yoti Holding Limited Extracting information from images
US11294996B2 (en) 2019-10-15 2022-04-05 Assa Abloy Ab Systems and methods for using machine learning for image-based spoof detection
US11348375B2 (en) 2019-10-15 2022-05-31 Assa Abloy Ab Systems and methods for using focal stacks for image-based spoof detection
CN111339832B (en) * 2020-02-03 2023-09-12 中国人民解放军国防科技大学 Face synthetic image detection method and device
CN111414887B (en) * 2020-03-30 2021-01-29 上海高重信息科技有限公司 Face recognition method of secondary detection mask based on YOLOV3 algorithm
US11275959B2 (en) 2020-07-07 2022-03-15 Assa Abloy Ab Systems and methods for enrollment in a multispectral stereo facial recognition system
CN111709976B (en) * 2020-08-24 2020-11-06 湖南国科智瞳科技有限公司 Rapid registration method and system for microscopic image and computer equipment
CN112187413B (en) * 2020-08-28 2022-05-03 中国人民解放军海军航空大学航空作战勤务学院 SFBC (Small form-factor Block code) identifying method and device based on CNN-LSTM (convolutional neural network-Link State transition technology)
CN112329606B (en) * 2020-11-03 2023-08-15 济南博观智能科技有限公司 Living body detection method, living body detection device, electronic equipment and readable storage medium
CN112101302B (en) * 2020-11-05 2021-04-27 杭州追猎科技有限公司 Illegal posting detection method, system and electronic device
CN112800941B (en) * 2021-01-26 2023-06-06 中科人工智能创新技术研究院(青岛)有限公司 Face anti-fraud method and system based on asymmetric auxiliary information embedded network
CN113158773B (en) * 2021-03-05 2024-03-22 普联技术有限公司 Training method and training device for living body detection model
CN113076876B (en) * 2021-04-02 2023-01-31 华南理工大学 A Face Spoofing Detection Method and System Based on 3D Structure Supervision and Confidence Weighting
US11720991B2 (en) 2021-05-20 2023-08-08 International Business Machines Corporation Signing and authentication of digital images and other data arrays
CN113486875B (en) * 2021-09-08 2021-12-07 浙江大学 Cross-domain face representation attack detection method and system based on word separation and self-adaptation
CN114092994B (en) * 2021-10-13 2024-09-24 北京工业大学 Face living body detection method based on multi-view feature learning
US12142084B2 (en) * 2021-12-23 2024-11-12 Qualcomm Incorporated Apparatus and methods for spoofing detection using machine learning processes
US20230206700A1 (en) * 2021-12-29 2023-06-29 Elm Biometric facial recognition and liveness detector using ai computer vision
CN114550237A (en) * 2022-01-24 2022-05-27 北京科技大学 Face living body detection method and system
CN114724220A (en) * 2022-04-12 2022-07-08 广州广电卓识智能科技有限公司 Living body detection method, living body detection device, and readable medium
CN115147705B (en) * 2022-09-06 2023-02-03 平安银行股份有限公司 Face copying detection method and device, electronic equipment and storage medium
CN116453182A (en) * 2023-03-27 2023-07-18 山东浪潮超高清智能科技有限公司 Binary face anti-fraud auxiliary method based on rPPG signal supervision
FR3150334A1 (en) * 2023-11-24 2024-12-27 Valeo Vision Facial recognition system for a driver's face of a motor vehicle
CN120823137B (en) * 2025-09-19 2025-11-21 龙兴(杭州)航空电子有限公司 A method and apparatus for aligning point clouds with dynamic depth maps of images

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9665784B2 (en) * 2015-06-16 2017-05-30 EyeVerify Inc. Systems and methods for spoof detection and liveness analysis
US9697414B2 (en) * 2012-01-17 2017-07-04 Amazon Technologies, Inc. User authentication through image analysis
WO2018002275A1 (en) * 2016-06-30 2018-01-04 Koninklijke Philips N.V. Method and apparatus for face detection/recognition systems

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9697414B2 (en) * 2012-01-17 2017-07-04 Amazon Technologies, Inc. User authentication through image analysis
US9665784B2 (en) * 2015-06-16 2017-05-30 EyeVerify Inc. Systems and methods for spoof detection and liveness analysis
WO2018002275A1 (en) * 2016-06-30 2018-01-04 Koninklijke Philips N.V. Method and apparatus for face detection/recognition systems

Also Published As

Publication number Publication date
WO2019152983A2 (en) 2019-08-08

Similar Documents

Publication Publication Date Title
WO2019152983A3 (en) System and apparatus for face anti-spoofing via auxiliary supervision
WO2019222467A8 (en) Self-supervised training of a depth estimation system
US9639935B1 (en) Apparatus and methods for camera alignment model calibration
MX2020007663A (en) Processing a point cloud.
CN103607568B (en) Stereo street scene video projection method and system
EP3043558A3 (en) Large-format display systems having color pixels and white pixels
PH12021552891A1 (en) Image-based localization
EP4412205A3 (en) Methods, devices and stream for encoding and decoding volumetric video
MX2017006720A (en) Method, apparatus and stream for immersive video format.
WO2011143073A3 (en) Method, system, and apparatus for pressure image registration
US20220122228A1 (en) Chrominance Denoising
EP4262193A3 (en) Puppeteering remote avatar by facial expressions
WO2017215899A8 (en) Augmented and virtual reality
PH12018500287A1 (en) Key frame acquisition method for human image video system
WO2014125502A3 (en) Segmenting objects in multimedia data
WO2013059758A3 (en) Generating a depth map
WO2014186420A3 (en) Augmented reality (ar) capture & play
MX373059B (en) AUTOMATED DEFINITION OF SYSTEM BEHAVIOR OR USER EXPERIENCE BY RECORDING, EXCHANGING AND PROCESSING INFORMATION ASSOCIATED WITH WIDE-ANGLE IMAGERY.
EA201390178A1 (en) METHOD FOR ASSOCIATING IMAGES ASSOCIATED WITH THREE-DIMENSIONAL CONTENT
ATE540732T1 (en) STEREO VIDEO FOR GAMES
WO2012005445A3 (en) Camera system for three-dimensional thermal imaging
WO2018191070A3 (en) Optical flow and sensor input based background subtraction in video content
MX2020013016A (en) Seamless injection of augmented three-dimensional imagery using a positionally encoded video stream.
WO2017100487A8 (en) Method and system for image-based image rendering using a multi-camera and depth camera array
HK1232329A1 (en) Motion tracking system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19747395

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19747395

Country of ref document: EP

Kind code of ref document: A2