[go: up one dir, main page]

WO2023230638A3 - Reduced-latency communication using behavior prediction - Google Patents

Reduced-latency communication using behavior prediction Download PDF

Info

Publication number
WO2023230638A3
WO2023230638A3 PCT/US2023/073582 US2023073582W WO2023230638A3 WO 2023230638 A3 WO2023230638 A3 WO 2023230638A3 US 2023073582 W US2023073582 W US 2023073582W WO 2023230638 A3 WO2023230638 A3 WO 2023230638A3
Authority
WO
WIPO (PCT)
Prior art keywords
prediction data
latency communication
networked
reduced
application
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/US2023/073582
Other languages
French (fr)
Other versions
WO2023230638A2 (en
Inventor
Ning Lu
Liang Peng
Hong Heather Yu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to PCT/US2023/073582 priority Critical patent/WO2023230638A2/en
Publication of WO2023230638A2 publication Critical patent/WO2023230638A2/en
Publication of WO2023230638A3 publication Critical patent/WO2023230638A3/en
Pending legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1827—Network arrangements for conference optimisation or adaptation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/46—Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/765—Media network packet handling intermediate
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1822—Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

A system and method for low latency communication in networked applications. User behaviors of participants in a networked meeting or virtual environment application is captured at a time T for use in the networked application. A next or future behavior at a time greater than T is predicted and the prediction data forwarded to the processing devices of other users in the application. The prediction data is used to render the behaviors of the user on the processing devices of other users. The capture and creation of prediction data can be performed continuously or limited to cases where large amounts of latency are detected.
PCT/US2023/073582 2023-09-06 2023-09-06 Reduced-latency communication using behavior prediction Pending WO2023230638A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/US2023/073582 WO2023230638A2 (en) 2023-09-06 2023-09-06 Reduced-latency communication using behavior prediction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2023/073582 WO2023230638A2 (en) 2023-09-06 2023-09-06 Reduced-latency communication using behavior prediction

Publications (2)

Publication Number Publication Date
WO2023230638A2 WO2023230638A2 (en) 2023-11-30
WO2023230638A3 true WO2023230638A3 (en) 2024-05-10

Family

ID=88506723

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2023/073582 Pending WO2023230638A2 (en) 2023-09-06 2023-09-06 Reduced-latency communication using behavior prediction

Country Status (1)

Country Link
WO (1) WO2023230638A2 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119967442A (en) * 2024-12-25 2025-05-09 爱浦路网络技术(南京)有限公司 Communication data processing method, device and medium based on user behavior prediction

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180174347A1 (en) * 2016-12-20 2018-06-21 Sony Interactive Entertainment LLC Telepresence of multiple users in interactive virtual space
US20220051024A1 (en) * 2019-01-23 2022-02-17 Guangzhou Shiyuan Electronics Co., Ltd. Video image transmission method, device, interactive intelligent tablet and storage medium
US20220337784A1 (en) * 2020-05-12 2022-10-20 True Meeting Inc. Virtually mimicking an arm movement of participant of a three dimensional video conference

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180174347A1 (en) * 2016-12-20 2018-06-21 Sony Interactive Entertainment LLC Telepresence of multiple users in interactive virtual space
US20220051024A1 (en) * 2019-01-23 2022-02-17 Guangzhou Shiyuan Electronics Co., Ltd. Video image transmission method, device, interactive intelligent tablet and storage medium
US20220337784A1 (en) * 2020-05-12 2022-10-20 True Meeting Inc. Virtually mimicking an arm movement of participant of a three dimensional video conference

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
HANI SAMI ET AL: "The Metaverse: Survey, Trends, Novel Pipeline Ecosystem & Future Directions", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 18 April 2023 (2023-04-18), XP091488141 *
SHEN CHUANYUE ET AL: "Envisioning a Next Generation Extended Reality Conferencing System with Efficient Photorealistic Human Rendering", 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), IEEE, 17 June 2023 (2023-06-17), pages 4623 - 4632, XP034398254, DOI: 10.1109/CVPRW59228.2023.00487 *
VIVEK NAIR ET AL: "Going Incognito in the Metaverse", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 11 August 2022 (2022-08-11), XP091292126 *

Also Published As

Publication number Publication date
WO2023230638A2 (en) 2023-11-30

Similar Documents

Publication Publication Date Title
WO2023230638A3 (en) Reduced-latency communication using behavior prediction
Alsaffar et al. [Retracted] Human‐Computer Interaction Using Manual Hand Gestures in Real Time
Prajati et al. The analyze of sociodemographic and socioeconomic factors to municipal solid waste generated in sumatera island
CN106296722B (en) Information processing method and electronic equipment
CN117111811A (en) Screenshot method, device, electronic device and readable storage medium
CN113542257B (en) Video processing method, video processing device, electronic equipment and storage medium
CN104579637A (en) Key generation method and device
CN114390143B (en) Call management method, device, electronic device and readable storage medium
CN117151193A (en) Model compression method, device, electronic device and readable storage medium
CN106375700A (en) Method and mobile terminal for video transmission
CN117271090A (en) Image processing methods, devices, electronic equipment and media
CN116051404A (en) Image enhancement method and image enhancement device
Lee et al. Cooperative big data processing engine for fast reaction in internet of things environment: greater than the sum of its parts
CN114979471A (en) Interface display method and device, electronic equipment and computer readable storage medium
CN117857731A (en) Interfacing gesture recognition with web page real-time communications
CN107153949B (en) Chat group information management method
Yamanoue Yet Another Wearable LED Matrix Sign System for Campus Guiding
CN112367468A (en) Image processing method and device and electronic equipment
CN115102915B (en) Information interaction method, device, electronic equipment and computer readable storage medium
CN112529052B (en) Image processing method, device and electronic equipment
CN112584226B (en) Screen capturing method and device for sharing desktop
CN114911393B (en) Screen capture method, device, electronic device and readable storage medium
CN114007130B (en) Data transmission method, device, electronic device and storage medium
CN115272127B (en) Model training method and device, electronic equipment and readable storage medium
JP6865981B1 (en) Deep learning-based image analysis methods, systems and mobile devices