[go: up one dir, main page]

WO2025200040A1 - Procédé et système d'étalonnage d'écran - Google Patents

Procédé et système d'étalonnage d'écran

Info

Publication number
WO2025200040A1
WO2025200040A1 PCT/CN2024/085807 CN2024085807W WO2025200040A1 WO 2025200040 A1 WO2025200040 A1 WO 2025200040A1 CN 2024085807 W CN2024085807 W CN 2024085807W WO 2025200040 A1 WO2025200040 A1 WO 2025200040A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
panoramic video
panoramic
calibration
video conferencing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/CN2024/085807
Other languages
English (en)
Chinese (zh)
Inventor
马睿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kandao Technology Co Ltd
Original Assignee
Kandao Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kandao Technology Co Ltd filed Critical Kandao Technology Co Ltd
Publication of WO2025200040A1 publication Critical patent/WO2025200040A1/fr
Pending legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose

Definitions

  • the present invention relates to image processing technology, and in particular to a screen calibration method and system.
  • panoramic video conferencing devices offering video conferencing capabilities are constantly being developed.
  • panoramic video conferencing devices are equipped with panoramic cameras that capture a 360-degree panoramic view, presenting a comprehensive view of the meeting scene.
  • panoramic video conferencing devices can fully identify all participants in the meeting and display close-ups of them on the conference screen, providing more detailed information and interaction.
  • panoramic video conferencing devices offer advantages in the meeting experience, they also create new challenges. For example, in conference scenarios, a screen is typically used to display the video conference screen. Since panoramic video conferencing devices capture 360-degree facial information, this also includes the faces on the screen.
  • the remote computer will display the local participants I and J and the remote participants including the local participants I and J, so that the remote participants I and J appear in both the local participant screen and the remote participant screen, resulting in a very confusing screen. Therefore, this requires the panoramic video conferencing machine to be able to effectively identify the screen area and block the facial information appearing therein to solve the problems existing in the existing technology.
  • the present invention provides a screen calibration method and system for solving the problem that existing panoramic video conferencing machines cannot effectively identify screen areas and display close-up shots of other participants during video conferencing.
  • the present invention provides a screen calibration method for calibrating the screen of a panoramic video conferencing machine in a conference scene.
  • the panoramic video conferencing machine includes a body and a panoramic camera provided on the body.
  • the screen calibration method includes:
  • the panoramic video conferencing machine sends the calibration screen video to the screen, and obtains the panoramic video through the panoramic camera; wherein the panoramic video includes the calibration screen video;
  • the panoramic video conferencing machine processes the panoramic video acquired by the panoramic camera to calibrate the position of the screen.
  • the present invention also provides a screen calibration system method for calibrating the screen of a panoramic video conferencing machine in a conference scene.
  • the panoramic video conferencing machine includes a machine body and a panoramic camera provided on the machine body, wherein the screen calibration method includes:
  • the panoramic video conferencing machine sends a static calibration picture video to the screen and obtains a panoramic video through the panoramic camera; wherein the panoramic video includes the static calibration picture video, and the static calibration picture video includes a plurality of pure color pictures, each of which has a different color; the panoramic video conferencing machine calculates the position of each pure color picture based on the obtained panoramic video, and then obtains the intersection of the positions of all the pure color pictures to obtain the position of the screen; and/or
  • the panoramic video conferencing machine generates and sends a dynamic calibration picture video to the screen, and obtains a panoramic video through the panoramic camera; wherein the panoramic video includes the dynamic calibration picture video, wherein the dynamic calibration picture video includes a conference picture with a watermark pattern; the watermark pattern is set at the four end corners of the conference picture; the panoramic video conferencing machine calculates the position of each watermark pattern based on the obtained panoramic video, and then obtains the enclosed area of all watermark patterns to obtain the position of the screen.
  • the present invention also provides a screen calibration system, which is provided in a panoramic video conferencing machine and connected to a screen, and is used for calibrating the screen of the panoramic video conferencing machine in a conference scene.
  • the screen calibration system includes:
  • Panoramic camera used to shoot panoramic video
  • Display module used to enable screen calibration function
  • the control module is connected to the panoramic camera, the display module and the screen respectively, and is used to send the calibration picture video to the screen, control the panoramic camera to obtain the panoramic video including the calibration picture video, and calculate the screen position according to the panoramic video obtained by the panoramic camera.
  • a panoramic video conferencing system transmits a calibration video to a screen, and a panoramic camera captures a panoramic video containing the calibration video.
  • the panoramic video conferencing system processes the captured panoramic video to determine the screen position, thereby achieving accurate screen calibration.
  • the panoramic video conferencing system can mask facial information within the calibrated screen to meet the needs of conference participants.
  • screen calibration can be performed using either a static or dynamic calibration screen, depending on the scenario.
  • the panoramic video conferencing system calibrates the screen using the static calibration screen, which not only provides high accuracy and wide adaptability, but also covers most usage scenarios.
  • the panoramic video conferencing system calibrates the screen using the dynamic calibration screen, enabling dynamic calibration without interrupting the meeting, making the calibration process more flexible and convenient.
  • FIG1 is a diagram of an existing panoramic video conferencing scene.
  • Figure 2 is the screen displayed on the local computer.
  • FIG5 is a flow chart of a method according to embodiment 2 of the present invention.
  • FIG6 is a scene diagram of embodiment 2 of the present invention.
  • FIG7 is a flow chart of a method according to embodiment 3 of the present invention.
  • FIG8 is a system block diagram of embodiment 4 of the present invention.
  • the screen calibration method of the present invention is used for calibrating the screen of a panoramic video conferencing machine in a conference scene, thereby achieving the purpose of shielding facial information on the screen and meeting the needs of video conferencing.
  • the screen calibration method of this embodiment includes the following steps:
  • the panoramic video conferencing device includes a device and a panoramic camera mounted thereon.
  • the device can transmit information to the screen for display.
  • the screen can be a television screen, a projection screen, or other screen capable of displaying images or videos, without limitation.
  • the panoramic video conferencing machine sends the calibration image video to the screen and obtains the panoramic video through the panoramic camera.
  • the panoramic video conferencing system generates and transmits a static calibration video to the screen, while the panoramic camera captures the panoramic video.
  • the static calibration video includes multiple solid-color images, each with a different color. This distinguishes the calibration video from the colors of other objects in the conference scene, thus avoiding calibration errors.
  • the static calibration video includes a pure red image, a pure green image, and a pure blue image.
  • the colors of the pure-color images are not limited to red, green, and blue, and the number of colors is not limited to three.
  • the static calibration video transmitted to the screen by the panoramic video conferencing system may include a pure red image held for a certain period of time, a pure green image held for a certain period of time, and a pure blue image held for a certain period of time, to ensure that the panoramic camera can capture each pure-color image.
  • the panoramic camera captures the panoramic video and transmits it to the panoramic video conferencing system, including the static calibration video.
  • the panoramic camera can capture a 360-degree panoramic view.
  • the panoramic video conferencing machine processes the panoramic video acquired by the panoramic camera to calibrate the screen position.
  • This embodiment calibrates the screen through a static calibration picture, and has the characteristics of high screen calibration accuracy, wide adaptability, and the ability to cover most usage scenarios. It should be noted that this screen calibration method is only suitable for the case where the panoramic video conferencing machine and the screen do not move. If the position of the panoramic video conferencing machine or the screen changes during the meeting, it is necessary to interrupt the meeting process and repeat steps S101 to S104 to recalibrate the screen. After the screen position is determined, the panoramic video conferencing machine can shield the facial information in the calibrated screen to meet the needs of the participants.
  • the screen calibration method of the present invention is used for calibrating the screen of a panoramic video conferencing machine in a conference scene, thereby shielding facial information on the screen and meeting the needs of video conferencing.
  • the screen calibration method of this embodiment includes the following steps:
  • the panoramic video conferencing device includes a device and a panoramic camera mounted thereon.
  • the device can transmit information to the screen for display.
  • the screen can be a television screen, a projection screen, or other screen capable of displaying images or videos, without limitation.
  • the panoramic video conferencing machine sends the calibration image video to the screen and obtains the panoramic video through the panoramic camera.
  • S304 The panoramic video conferencing machine processes the panoramic video acquired by the panoramic camera to calibrate the screen position.
  • the panoramic video conferencing machine receives the panoramic video sent by the panoramic camera, processes the received panoramic video, and then determines the screen position based on the processing result. Specifically, the panoramic video conferencing machine calculates the position of each pure color picture based on the acquired panoramic video, and then obtains the intersection of the positions of all pure color pictures to obtain the position of the screen. In this embodiment, the panoramic video conferencing machine calculates the positions of the pure red picture, pure green picture, and pure blue picture in the panoramic video based on the panoramic video acquired by the panoramic camera, and then obtains the intersection of the positions of the three pure color pictures. The obtained intersection is the position of the current screen. For example, the panoramic video area that displays a pure red picture in the first display time, a pure green picture in the second display time, and a pure blue picture in the third display time is set as the position of the current screen.
  • the panoramic video conferencing system or screen may change position for some reason during the conference.
  • the screen position calibrated by the panoramic video conferencing system will change, so the screen needs to be recalibrated.
  • the panoramic video conferencing system automatically detects the screen position at preset intervals to avoid inconsistencies with the calibrated screen position due to changes in the screen position.
  • the panoramic video conferencing machine sends a dynamic calibration screen video to the screen according to a preset time interval, and obtains a panoramic video through the panoramic camera.
  • the dynamic calibration screen video includes a conference screen with a watermark pattern, and the watermark pattern is set at the four corners of the conference screen.
  • the watermark pattern can be a pattern pre-set by the user, which does not overlap with the panoramic screen.
  • the time interval is set according to actual needs. For example, it can be set to detect once every 5 minutes.
  • the panoramic video conferencing machine generates a dynamic calibration screen video containing a watermark pattern, and superimposes the watermark pattern on the four corners of the conference screen respectively.
  • the watermark pattern is maintained for a certain period of time so that the panoramic camera can obtain the screen video of the four watermark patterns.
  • the watermark pattern generated by the panoramic video conferencing machine can also be maintained until the end of the meeting.
  • the panoramic camera obtains the panoramic video and sends the obtained panoramic video to the panoramic video conferencing machine, wherein the panoramic video includes the dynamic calibration screen video.
  • the panoramic video conferencing machine calculates the position of each watermark pattern based on the panoramic video, and compares each calculated watermark pattern with the four end corners of the previous screen position. If they are consistent, the screen position remains unchanged and step S305 is repeated; if they are inconsistent, the screen position is changed and step S306 is executed.
  • the panoramic video conferencing machine needs to resend the dynamic calibration video to the screen when it performs the next screen detection.
  • the panoramic video conferencing machine detects the screen, it does not need to send the dynamic calibration video to the screen.
  • the position of each watermark pattern is directly calculated based on the panoramic video captured by the panoramic camera, and each calculated watermark pattern is compared with the four end corners of the previous screen position.
  • the screen and the panoramic video conferencing machine must be within a reasonable distance to ensure that the watermark pattern sent to the screen by the panoramic video conferencing machine is clear enough, thereby improving the accuracy of watermark detection and, in turn, the accuracy of screen calibration.
  • the panoramic video conferencing machine processes the panoramic video acquired by the panoramic camera to recalibrate the position of the screen.
  • the panoramic video conferencing machine obtains the enclosed area of all watermark patterns according to the position of each watermark pattern, and the obtained enclosed area is the position of the current screen.
  • the panoramic video conferencing system calibrates the screen using a static calibration screen. This not only provides high screen calibration accuracy and wide adaptability, but also covers most usage scenarios.
  • the panoramic video conferencing system automatically detects the screen position using dynamic calibration screens at preset intervals. If a change in the screen position is detected, the system recalibrates the screen. This dynamic calibration process, performed without interrupting the meeting, ensures reliable calibration and makes the calibration process more flexible and convenient.
  • the screen calibration system of this embodiment is provided in the panoramic video conferencing machine, which is connected to the screen and is used for calibrating the screen of the panoramic video conferencing machine in the conference scene, thereby shielding the facial information on the screen and meeting the needs of video conferencing.
  • the panoramic camera 10 is used to shoot panoramic picture videos and send the shot picture videos to the control module 30.
  • the panoramic camera 10 can shoot a 360-degree panoramic view.
  • the display module 20 is used to turn on the screen calibration function, which can be a touch screen display, and it can also display other parameter information, which is not limited here.
  • the control module 30 is connected to the panoramic camera 10 and the display module 20 respectively, and is used to send the calibration picture video to the screen, control the panoramic camera 10 to obtain the panoramic video, and calculate the screen position according to the panoramic video obtained by the panoramic camera.
  • static screen calibration or dynamic screen calibration can be achieved by changing the calibration picture video sent to the screen by the control module 30.
  • the control module 30 sends a static calibration video to the screen.
  • This static calibration video includes multiple solid-color images, each with a different color. This distinguishes the calibration video from the colors of other objects in the meeting scene, thus avoiding calibration errors.
  • the static calibration video includes a pure red image, a pure green image, and a pure blue image.
  • the colors of the solid-color images are not limited to red, green, and blue, and the number of colors is not limited to three.
  • the static calibration video can include a solid red image remaining for a certain period of time, a solid green image remaining for a certain period of time, and a solid blue image remaining for a certain period of time, to ensure that the panoramic camera 10 can capture each solid-color image.
  • the panoramic camera 10 captures the panoramic video and sends it to the control module 30.
  • the control module 30 receives the panoramic video sent by the panoramic camera 10, processes it, and determines the screen position based on the processing results. Specifically, the control module 30 calculates the position of each pure-color image based on the panoramic video captured by the panoramic camera 10, and then obtains the intersection of the positions of all pure-color images to determine the position of the screen.
  • the control module 30 calculates the positions of the pure red, pure green, and pure blue images in the panoramic video captured by the panoramic camera 10, and then obtains the intersection of the positions of the three pure-color images. The obtained intersection is the current screen position.
  • the panoramic video area showing the pure red image in the first display time, the pure green image in the second display time, and the pure blue image in the third display time is set as the current screen position. It should be noted that this static screen calibration is only suitable for situations where neither the panoramic video conferencing machine nor the screen moves. If the position of the panoramic video conferencing machine or the screen changes during a meeting, the meeting needs to be interrupted and the screen recalibrated. After the screen position is calibrated, the control module 30 can mask facial information within the calibrated screen to meet the needs of the participants.
  • the watermark pattern generated by the control module 30 can also be maintained until the end of the meeting.
  • the panoramic camera 10 obtains a panoramic video and sends the obtained panoramic video to the control module 30.
  • the panoramic video contains the conference screen with the four watermark patterns.
  • the panoramic camera can capture a 360-degree panoramic view. It should be noted that, in this embodiment, the screen and the panoramic video conferencing machine must be within a reasonable distance range to ensure that the watermark pattern sent by the control module 30 to the screen is clear enough, thereby improving the accuracy of watermark detection.
  • the control module 30 receives the panoramic video sent by the panoramic camera 10, processes the received panoramic video, and determines the screen position based on the processing results.
  • the panoramic video conferencing machine or screen may change position for some reason.
  • the screen position calibrated by the panoramic video conferencing machine will change, necessitating recalibration of the screen.
  • Automatically detecting the screen position at preset intervals by the control module 30 can prevent inconsistencies with the calibrated screen position due to changes in the screen position.
  • the control module 30 sends a dynamic calibration picture video to the screen according to a preset time interval, and obtains a panoramic video through the panoramic camera.
  • the dynamic calibration picture video includes a conference picture with a watermark pattern, and the watermark pattern is set at the four corners of the conference picture.
  • the watermark pattern can be a pattern pre-set by the user, which does not overlap with the panoramic picture.
  • the time interval is set according to actual needs. For example, it can be set to detect once every 5 minutes.
  • the control module 30 generates a dynamic calibration picture video containing a watermark pattern, and superimposes the watermark pattern on the four corners of the conference picture respectively, and the watermark pattern is maintained for a certain period of time so that the panoramic camera 10 can obtain the picture video of the four watermark patterns.
  • the watermark pattern generated by the panoramic video conferencing machine can also be maintained until the end of the meeting.
  • the panoramic camera 10 obtains the panoramic video and sends the obtained panoramic video to the control module 30, wherein the panoramic video includes the dynamic calibration picture video.
  • the control module 30 calculates the position of each watermark pattern based on the panoramic video, and compares each calculated watermark pattern with the four end corners of the previous screen position. If they are consistent, the screen position has not changed, and the screen detection process is repeated; if they are inconsistent, the screen position has changed, and the control module 30 obtains the enclosed area of all watermark patterns based on the position of each watermark pattern. The obtained enclosed area is the current screen position.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

La présente invention divulgue un procédé d'étalonnage d'écran. Le procédé comprend : la connexion d'une machine de vidéoconférence panoramique à un écran ; l'activation d'une fonction d'étalonnage d'écran de la machine de vidéoconférence panoramique ; l'envoi par la machine de vidéoconférence panoramique d'une vidéo d'image d'étalonnage à l'écran et l'acquisition d'une vidéo panoramique au moyen d'une caméra panoramique, la vidéo panoramique comprenant la vidéo d'image d'étalonnage ; et le traitement par la machine de vidéoconférence panoramique de la vidéo panoramique acquise au moyen de la caméra panoramique, de façon à étalonner la position de l'écran. La présente invention divulgue en outre un système d'étalonnage d'écran.
PCT/CN2024/085807 2024-03-26 2024-04-03 Procédé et système d'étalonnage d'écran Pending WO2025200040A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202410355354.1A CN118115600A (zh) 2024-03-26 2024-03-26 屏幕标定方法及系统
CN202410355354.1 2024-03-26

Publications (1)

Publication Number Publication Date
WO2025200040A1 true WO2025200040A1 (fr) 2025-10-02

Family

ID=91218828

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2024/085807 Pending WO2025200040A1 (fr) 2024-03-26 2024-04-03 Procédé et système d'étalonnage d'écran

Country Status (2)

Country Link
CN (1) CN118115600A (fr)
WO (1) WO2025200040A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010161662A (ja) * 2009-01-08 2010-07-22 Panasonic Corp 画像表示装置、テレビ会議装置、および画像表示方法
CN103096986A (zh) * 2010-07-13 2013-05-08 索尼电脑娱乐公司 移动装置上的补充视频内容
CN105828206A (zh) * 2016-03-22 2016-08-03 乐视网信息技术（北京）股份有限公司 多路视频点播方法和装置
WO2018195879A1 (fr) * 2017-04-27 2018-11-01 西安诺瓦电子科技有限公司 Système et procédé d'enregistrement et de traitement vidéo

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111586341A (zh) * 2020-05-20 2020-08-25 深圳随锐云网科技有限公司 一种视频会议拍摄装置拍摄方法和画面显示方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010161662A (ja) * 2009-01-08 2010-07-22 Panasonic Corp 画像表示装置、テレビ会議装置、および画像表示方法
CN103096986A (zh) * 2010-07-13 2013-05-08 索尼电脑娱乐公司 移动装置上的补充视频内容
CN105828206A (zh) * 2016-03-22 2016-08-03 乐视网信息技术（北京）股份有限公司 多路视频点播方法和装置
WO2018195879A1 (fr) * 2017-04-27 2018-11-01 西安诺瓦电子科技有限公司 Système et procédé d'enregistrement et de traitement vidéo

Also Published As

Publication number Publication date
CN118115600A (zh) 2024-05-31

Similar Documents

Publication Publication Date Title
CN100379281C (zh) 图像处理系统、投影机及图像处理方法
TWI444924B (zh) 圖像處理裝置及程式
CN102508628B (zh) 消除拼接墙拼缝的方法、装置及基于拼接墙的图像系统
US8107018B2 (en) Apparatus and method for providing image-correction function in projector
JP3116472B2 (ja) ホワイト・バランス調整方法
WO2025108228A1 (fr) Procédé de traitement vidéo, appareil de traitement vidéo, dispositif électronique et support
US20030189670A1 (en) Positioning of a cursor associated with a dynamic background
JP3674474B2 (ja) 映像システム
US11218662B2 (en) Image processing device, image processing method, and projection system
WO2025200040A1 (fr) Procédé et système d'étalonnage d'écran
US11303864B2 (en) System and method for projector alignment using detected image features
JP2634401B2 (ja) カラーテレビ受像機のコンバーゼンス測定装置
JPH07239504A (ja) 大型表示装置
Majumder et al. Using a camera to capture and correct spatial photometric variation in multi-projector displays
JP2008067080A (ja) 携帯撮像表示装置
CN113163181A (zh) 投影装置及应用其的投影显示系统
TW202141976A (zh) 影像校正方法及其影像校正裝置
TWI822158B (zh) 沉浸式串流影像擷取與成像之裝置及方法
KR100188193B1 (ko) 투사형 프로젝터의 보정량생성장치
JP4670424B2 (ja) 情報処理装置および情報処理方法、画像表示システム、並びに、プログラム
CN119895481A (zh) Led显示屏校正方法、装置、设备、系统及存储介质
CN114927092A (zh) 一种led显示屏视角差异的修正方法、装置及系统
TW201820856A (zh) 可檢測投影機的投影影像清晰度的檢測系統及其檢測方法
JP2017032873A (ja) 投影型表示装置及びその制御方法、投影システム、コンピュータプログラム
TWI892360B (zh) 投影圖像修正方法、裝置、投影設備、採集設備及可讀存儲介質

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24932276

Country of ref document: EP

Kind code of ref document: A1