[go: up one dir, main page]

WO2022023831A1 - Application d'affichage intelligent ayant un potentiel pour présenter un contenu d'informations extérieures collectées à l'aide de plateformes ido et ia - Google Patents

Application d'affichage intelligent ayant un potentiel pour présenter un contenu d'informations extérieures collectées à l'aide de plateformes ido et ia Download PDF

Info

Publication number
WO2022023831A1
WO2022023831A1 PCT/IB2021/055353 IB2021055353W WO2022023831A1 WO 2022023831 A1 WO2022023831 A1 WO 2022023831A1 IB 2021055353 W IB2021055353 W IB 2021055353W WO 2022023831 A1 WO2022023831 A1 WO 2022023831A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
content
outdoor
display
users
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2021/055353
Other languages
English (en)
Inventor
Mahdi AKHAVAN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of WO2022023831A1 publication Critical patent/WO2022023831A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y10/00—Economic sectors

Definitions

  • the technical field of the invention relates to electronic, loT technology, artificial intelligence, machine learning, image, and audio processing.
  • the remotely controllable loT-based smart advertising display was filed in the patent request number KR1020180078475.
  • This invention relates to an loT- based smart display characterized by an advertising content storage module and shows advertisements based on the infrared module and relevant information processing. At the same time, it applies a beacon module for signal transfer.
  • JP2017162221A entitled Information Processing Device, Content Evaluation, and Program which was filed in 2017 in Japan
  • an advertisement display system equipped with memory, an imaging system, and an image processing system.
  • the image processing system acts as a facial and motion recognition system to count the number of individuals who stop and watch the advertisement when it starts to display.
  • the system also counts the number of individuals who pass indifferently to analyze the effectiveness of the content.
  • the facial recognition system analyzes people’s satisfaction based on their facial expressions. Their faces are then stored in memory with a specific ID for every advertisement. Therefore, it is possible to determine what content was appropriate enough to draw people’s attention.
  • the stored information is limited only to people’s faces, and CRM has no role in error reduction. Audio, temperature, and humidity sensors were not used. The sound of an advertisement is not processed through outdoor information. People’s words are not retrieved. It is also impossible to limit the imaging frames.
  • the current system is applied to accurately identify user's faces and retrieve their information. Given the high error rates in real-time image processing and user-camera distance, the previous systems were prone to user recognition errors. Therefore, outdoor information might not be effective for displaying the appropriate advertising or educational content. Moreover, real-time image processing might not provide other relevant information such as occupation, education, purchase history, and annual income of the user. Furthermore, previous methods were focused on using image processing for displaying the contents. However, in this invention as well as the image, the outdoor sound, light, temperature, and humidity are also processed to select the most relevant content and information.
  • the central controller monitors the outdoor data through the camera, microphone, temperature, and humidity sensors. After processing these data, it sends the outdoor information to the cloud server. Furthermore, this information will continuously be sent to and stored at the cloud server online.
  • the advertiser sets the time and location for content display; thus, the content will automatically be displayed at a specific time, whereas in the second method, it will be displayed based on conditions defined by an advertiser and processing the retrieved outdoor data. In both cases of content display, the number of people seeing the content will be counted. They will also be asked about the displayed content. Finally, the resultant information will be stored and displayed on the content owner’s panel. The number of views of the displayed advertisement is measured through the image processing technology from the head and eye angles of viewers who are present in the environment.
  • the head and eye angles of audiences are determined through the machine learning technology implemented by defining a neural network.
  • the necessary training data of the network are collected from the images captured by outdoor cameras in a few crowded places and are then used to train the network after the labeling process. After the network is trained with a huge data, the output network model is used to detect the head and eye angles of the audiences present in the environment.
  • the invention matches the displayed content with the preferences and interests of most users in the environment to improve the efficiency of this method. Due to the limited display duration of every advertising or educational content in this invention, different businesses have more opportunities. For instance, the display duration of every advertising content will be 30 seconds, which can allow for the display of 120 advertisements in an hour. This can give different businesses more opportunities and reduce the costs of outdoor advertisements.
  • Advertisers can also benefit from a feature called " pay as you go ".
  • This feature advertisers define the display conditions of their campaign and then run it. With the image processing technology, this feature determines the head and eye angles of the audiences present in the environment concerning the display. Accordingly, advertisers will be charged in their accounts.
  • the outdoor advertising system is often used in most countries with no counseling for advertisers that must also negotiate with advertising companies to register their advertisements in any place at any time.
  • this invention benefits from an artificial intelligence system to automatically provide an advertiser with some recommendations based on the collected outdoor data of any environment (e.g. the general traffic data of people and vehicles classified based on gender, clothing style, age, the number of people, type of vehicles, and other parameters collected from the predefined sensors and presented to the advertiser).
  • the system first analyzes people’s faces in the customer relationship management (CRM) database when processing the images captured by the camera connected to the board (raspberry pi). The system then sends all user information that has already existed in the CRM along with the instantly effective parameters to the server to display the efficient content. If user information is unavailable in databases, user demographic information (e.g. height, age, gender, weight, etc.), people’s clothing, number of people, their presence duration, their facial expressions (e.g. sad, happy, energetic, etc.), skin color, hair color, eye color, people’s placement time and location in the environment, and information of objects (e.g.
  • duration of existence the dominant brand in the environment, object dimensions, dominant color, brightness and outdoor light, number of objects, license plate detection, object coverage, placement of objects, movement of objects, sound intensity, etc. are processed at the moment to show content on displays in proportion to the retrieved information.
  • the CRM information ( Figure 8) can be registered through the following methods:
  • the CRM stores different pieces of information as educational degrees, age, marital status, demographics, income per capita, religion, occupation, race, height, weight, skin color, hair color, eye color, social relationships, nationality, place of residence, educational records, type of clothing, banking information, social media accounts, purchase records, number of views, and purchases from shops.
  • the CRM system is also able to connect to all the systems which can be connected through API, a feature that updates and validates the user inserted information constantly.
  • Facial recognition is performed on the present individuals separately.
  • the information is processed, and the system will finally show content based on the outdoor information and predefined conditions.
  • the system Upon processing the outdoor voices, the system analyzes the dominant words and sends the output information to the cloud server. This information includes dialects and languages. Using this feature, the system can display content based on a combination of dominant voices and images in the environment. In other words, the advertisements will be shown based on the words uttered by the users present in the environment. This feature also allows for the smart volume adjustment of displays.
  • the SpeechRecognition is used to convert outdoor voices into texts and process words by adjusting the display volume.
  • Temperature and humidity sensors process outdoor data and send them to the cloud server via the central board (raspberry pi).
  • a light sensor (GY-30) is applied to transmit outdoor brightness to the server; therefore, an advertiser can display their contents accordingly by defining their conditions.
  • the display brightness is also adjusted smartly in this way, something which will reduce energy consumption.
  • the number of sensors differs in different places. For instance, it is unnecessary to use the voice sensor on the highway; however, all sensors are used in a public place like a train station so that the system can process the environment properly.
  • a content owner may adjust the image processing regions based on the distance between a camera and individuals as well as the camera quality by determining those regions while defining the content display conditions.
  • an advertiser can also specify whether users are processed and analyzed when they are moving or standing to show the content accordingly.
  • the advertiser should set some conditions for content display at different times and places after registering the contents; however, they define more conditions for the more purposive presentation of contents on displays by using the capabilities of outdoor sensors ( Figure 11) in the smart display method They can also be defined campaign condition based on the Fuzzy algorithm.
  • image processing cameras can be placed within one or several kilometers away from a display in order to improve the accuracy and decision-making of advertising presentations on highways.
  • the content is then displayed after the information is processed on a display connected to the central board.
  • Facial expressions and hand gestures of the audiences were processed to receive their feedback on the displayed content ( Figure 13). This method detects certain reactions such as frown, smile, surprise, and indifference and reports them to the system. Users can also send their feedback to the displayed content with hand gestures such as liking, disliking, and showing indifference (a horizontal like).
  • the support vector machine algorithm (SVM) and the OpenCV library were used for facial expression recognition, whereas the convolutional neural network algorithm was used for hand gesture detection.
  • the invention can be connected to online TV channels to display content such as an instructive message that might say, “Wash your hands and face every hour to prevent the COVID-19!” and show the important results of a sports game.
  • the invention can also connect to different displays such as TVs, projectors, big screens, smartphones, virtual reality glasses, and tablets to show the content transmitted by the cloud server.
  • displays such as TVs, projectors, big screens, smartphones, virtual reality glasses, and tablets.
  • smartphones, tablets, and smart TVs designed for direct display need no hardware boards and can only be connected to the system if the necessary application is installed on them.
  • the invention can be used to process outdoor data such as voices, images, light, and temperature and display the relevant content in proportion to user preferences in those areas to draw more attention and finally improve efficiency and branding.
  • This feature can be used to display outdoor advertisements in proportion to the dominant keywords and conditions set by advertiser and to adjust the display speakers based on the outdoor sound.
  • this invention allows the system to process data of objects as well as the preferences and demographics of people in the place.
  • the data are then sent to the cloud server, which will then generate the command to display advertising programs online in proportion to the retrieved data and the conditions defined by advertiser.
  • this invention first processes and analyzes user faces in the CRM system. If the user information exists in the CRM system, the relevant content will be shown by using the registered information and combining it with other instantly effective parameters such as user faces, user clothing, voices, and temperature and processing the data of objects existing in the environment.
  • online image processing will be used to retrieve identifiable user demographics based on their faces (gender, height, age, weight, etc.), motion detection, clothing styles, voices, light, temperature, and data of objects (brand, properties and dimensions of objects, placement of objects, license plate detection, etc.) existing in the environment.
  • the content will then be displayed based on the retrieved information and defined conditions. For this group of users, user accounts will be created in the CRM automatically.
  • the proposed method is the integrated presentation of contents on different displays. This helps display owners avoid extra costs for software licenses, software support, and hardware support. Advertisers can also present their advertisements on the displays of different areas in smart and direct methods based on the smart system recommendations.
  • This invention can be connected to all modern displays (LCD, LED, and OLED TV sets, video projectors, VR glasses, smartphones, tablets, computers, etc.) to show advertising contents and information.
  • LCD liquid crystal display
  • LED LED
  • OLED organic light-emitting diode
  • VR glasses smartphones, tablets, computers, etc.
  • [0051] - Defining conditions In the direct presentation method, the advertiser should set some conditions for content presentation after registering the content. These conditions include presentation time, content presentation location, etc. However, in the smart presentation method, advertisers employ the capabilities of outdoor sensors to define more purposive conditions for their contents on displays so that the presented content will be efficient enough for the audiences present in an environment.
  • CRM information bank system This system is among the most important components of this invention. It is used to register and constantly update the information of all users who use the system. If the information is entered into the system wrongly, the system will detect and correct the errors by accessing other information systems and processing outdoor information and user information.
  • the CRM information is entered into the system by users or other information systems. The information includes user demographics, educational degrees, age, marital status, income per capita, religion, occupation, race, height, weight, social relationships, skin color, hair color, eye color, nationality, place of residence, banking information, social media accounts, purchase records, views of a shop, and purchases made. If this information is entered correctly, users will see smarter and more relevant outdoor information.
  • FIG (1 ) the general schematic of the smart display through the analysis of the collected data
  • FIG (2) the smart display flowchart
  • FIG (3) the relay circuit (connecting and disconnecting the utility power)
  • FIG (4) the schematic of temperature and humidity sensors
  • FIG (5) the schematic of camera detection to the ep8266 board
  • FIG (6) the schematic of microphone detection to the esp32 board
  • FIG (7) the schematic of lux meter detection to the esp8266
  • FIG (8) collect user information
  • FIG (9) boundaries of image analysis
  • FIG (10) loT-based object connections to smart displays
  • FIG (11) defining conditions based on the predefined sensors
  • FIG (12) defining conditions to show the smart content
  • FIG (13) analysis of user reactions
  • FIG (14) shows the smart advertising display in proportion to the retrieved outdoor information
  • This invention is made up of software and hardware components.
  • the software component consists of specific panels for advertisers, displayers, relevant experts, and ordinary users in the system as well as image, voice, temperature, humidity, and light processing panels.
  • the hardware component consists of a central board, a temperature sensor, a humidity sensor, a relay (to connect and disconnect power), a cloud server, displays, cameras and microphones, and a lux meter. Interconnected, all of these components are connected to the cloud server via the central controller (raspberry pi). After the outdoor data are processed, all commands are sent from the cloud server to the display based on the predefined conditions ( Figure 1 -7).
  • Advertisers can define the information for connection to loT-based objects in their panels and define certain conditions for the presentation of smart content.
  • a shop manager ( Figure 10) can use the RFID tag for every product and register all of its specifications in the chip memory. If a product is to expire (for example, within three days), the loT-based RFID chip will automatically connect to adjacent displays based on the defined conditions and announces to the outdoor audiences near the shop that this product is going to be sold with a specific discount percentage. This will significantly decrease the extra costs of shops and will increase the business owner’s income.
  • Example 1 - An automotive company can use the dominant brand and license plate as the content presentation base in the content convention definition to direct users to the nearest sales representative.
  • SAIPA can define the following conditions to show the advertisements of its new product “Shahin” on displays:
  • the stopping time should be more than 15 seconds.
  • Example 2 Based on the outdoor information processing ( Figure 14), smart displays show users the appropriate content for an environment. For instance, if the weather is sunny, a pair of sunglasses will be advertised. If it is rainy, an umbrella or a cafeteria nearby the display will be advertised. All contents will be shown based on the conditions defined by advertisers and outdoor information processing.
  • Example 3 The advertiser of a dress manufacturer and shop would like to show content at specific hours and places nearby their branches based on gender, age, and the dominant outdoor color.
  • Example 2 Based on the outdoor information processing ( Figure 14), smart displays show users the appropriate content for an environment. For instance, if the weather is sunny, a pair of sunglasses will be advertised. If it is rainy, an umbrella or a cafeteria nearby the display will be advertised. All contents will be shown based on the conditions defined by advertisers and outdoor information processing.
  • Example 3 The advertiser of a dress manufacturer and shop would like to show content at specific hours and places nearby their branches based on gender, age, and the dominant outdoor color.

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Finance (AREA)
  • General Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Marketing (AREA)
  • Physics & Mathematics (AREA)
  • Game Theory and Decision Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computing Systems (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

À l'aide des technologies IDO et de l'intelligence artificielle (IA), l'invention vise à réduire le taux d'erreur instantanée de traitement d'image à l'aide de CRM, ainsi que l'affichage de contenus appropriés au style de préférences et d'intérêts de la majorité des utilisateurs extérieurs par analyse détaillée d'informations extérieures à l'aide d'un capteur. Dans ce plan, l'annonceur recevra d'abord de manière intelligente les informations d'extérieur collectées par l'intermédiaire du panneau de système, puis sur la base des informations reçues et de leur contenu affiché, enregistrera plusieurs conditions pour un affichage intelligent dans le système. Après l'affichage du contenu, les utilisateurs extérieurs seront interrogés sur le contenu de diffusion et les utilisateurs pourront enregistrer leurs commentaires à l'aide de gestes définis (symboles). À terme, les angles des têtes et des yeux des spectateurs dans l'environnement seront calculés à l'aide de la technologie de traitement d'image et par rapport à l'affichage et les données pertinentes seront affichées dans le panneau d'annonceurs.
PCT/IB2021/055353 2020-07-29 2021-06-17 Application d'affichage intelligent ayant un potentiel pour présenter un contenu d'informations extérieures collectées à l'aide de plateformes ido et ia Ceased WO2022023831A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IR139950140003004056 2020-07-29
IR13993004060 2020-07-29

Publications (1)

Publication Number Publication Date
WO2022023831A1 true WO2022023831A1 (fr) 2022-02-03

Family

ID=80038138

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2021/055353 Ceased WO2022023831A1 (fr) 2020-07-29 2021-06-17 Application d'affichage intelligent ayant un potentiel pour présenter un contenu d'informations extérieures collectées à l'aide de plateformes ido et ia

Country Status (1)

Country Link
WO (1) WO2022023831A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117408760A (zh) * 2023-12-14 2024-01-16 成都亚度克升科技有限公司 基于人工智能的图片显示方法和系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20140119297A (ko) * 2013-03-28 2014-10-10 인텔렉추얼디스커버리 주식회사 옥외 광고 서비스 시스템 및 그 방법
KR101542124B1 (ko) * 2011-04-13 2015-08-13 엠파이어 테크놀로지 디벨롭먼트 엘엘씨 동적 광고 컨텐츠 선택
CN107533357A (zh) * 2014-10-21 2018-01-02 伊特显示器私人有限公司 一种显示装置及内容显示系统
WO2018190773A1 (fr) * 2017-04-10 2018-10-18 Garini Technologies Corporation Pte. Ltd. Procédé et système de publicité ciblée sur la base de caractéristiques physiques personnelles
WO2019088661A1 (fr) * 2017-10-30 2019-05-09 코오롱인더스트리 주식회사 Dispositif, système et procédé de fourniture de services associés à une publicité et à un achat de produit au moyen d'une technologie d'intelligence artificielle

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101542124B1 (ko) * 2011-04-13 2015-08-13 엠파이어 테크놀로지 디벨롭먼트 엘엘씨 동적 광고 컨텐츠 선택
KR20140119297A (ko) * 2013-03-28 2014-10-10 인텔렉추얼디스커버리 주식회사 옥외 광고 서비스 시스템 및 그 방법
CN107533357A (zh) * 2014-10-21 2018-01-02 伊特显示器私人有限公司 一种显示装置及内容显示系统
WO2018190773A1 (fr) * 2017-04-10 2018-10-18 Garini Technologies Corporation Pte. Ltd. Procédé et système de publicité ciblée sur la base de caractéristiques physiques personnelles
WO2019088661A1 (fr) * 2017-10-30 2019-05-09 코오롱인더스트리 주식회사 Dispositif, système et procédé de fourniture de services associés à une publicité et à un achat de produit au moyen d'une technologie d'intelligence artificielle

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117408760A (zh) * 2023-12-14 2024-01-16 成都亚度克升科技有限公司 基于人工智能的图片显示方法和系统
CN117408760B (zh) * 2023-12-14 2024-02-27 成都亚度克升科技有限公司 基于人工智能的图片显示方法和系统

Similar Documents

Publication Publication Date Title
US7921036B1 (en) Method and system for dynamically targeting content based on automatic demographics and behavior analysis
US9952427B2 (en) Measurement method and system
KR101779094B1 (ko) 지능형 영상분석 기술을 이용한 통합 매장관리시스템
CN113674037B (zh) 一种基于购物行为的数据采集和推荐方法
CN110033298B (zh) 信息处理设备及其控制方法、系统和存储介质
JP6123140B2 (ja) デジタル広告システム
US8295542B2 (en) Adjusting a consumer experience based on a 3D captured image stream of a consumer response
US9000928B2 (en) System and method for communicating information
US20190147228A1 (en) System and method for human emotion and identity detection
KR101779096B1 (ko) 지능형 영상분석 기술 기반 통합 매장관리시스템에서의 객체 추적방법
WO2019149005A1 (fr) Système de publicité interactive hors ligne
US20140130076A1 (en) System and Method of Media Content Selection Using Adaptive Recommendation Engine
KR102054443B1 (ko) 인터랙티브 광고를 위한 사용 측정 기술 및 시스템
US20090217315A1 (en) Method and system for audience measurement and targeting media
US20080147488A1 (en) System and method for monitoring viewer attention with respect to a display and determining associated charges
US20120140069A1 (en) Systems and methods for gathering viewership statistics and providing viewer-driven mass media content
US20200320576A1 (en) Targeted Advertising Based On Demographic Features Extracted From Persons
CN104025573A (zh) 用于站点异常记录和通知的系统和方法
KR102341060B1 (ko) 키오스크를 이용한 광고 서비스 제공 시스템
EP2147514A1 (fr) Procédé et système de mesure d'audience et de ciblage multimédia
KR20220021689A (ko) 인공지능 디지털 사이니지 시스템 및 이의 운용방법
JP2016071501A (ja) 広告評価システム、広告評価方法
CN111582964A (zh) 智能商场系统及应用该系统的控制方法
CN117035877A (zh) 一种基于姿态识别的广告投放系统及方法
WO2022023831A1 (fr) Application d'affichage intelligent ayant un potentiel pour présenter un contenu d'informations extérieures collectées à l'aide de plateformes ido et ia

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21851535

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21851535

Country of ref document: EP

Kind code of ref document: A1