[go: up one dir, main page]

WO2019130437A1 - Système et procédé d'affichage de degré de sourire régional, et programme - Google Patents

Système et procédé d'affichage de degré de sourire régional, et programme Download PDF

Info

Publication number
WO2019130437A1
WO2019130437A1 PCT/JP2017/046716 JP2017046716W WO2019130437A1 WO 2019130437 A1 WO2019130437 A1 WO 2019130437A1 JP 2017046716 W JP2017046716 W JP 2017046716W WO 2019130437 A1 WO2019130437 A1 WO 2019130437A1
Authority
WO
WIPO (PCT)
Prior art keywords
smile
degree
area
image
person
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2017/046716
Other languages
English (en)
Japanese (ja)
Inventor
崇 園田
将仁 谷口
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Uhuru Corp
Original Assignee
Uhuru Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Uhuru Corp filed Critical Uhuru Corp
Priority to JP2019561440A priority Critical patent/JP6734487B2/ja
Priority to PCT/JP2017/046716 priority patent/WO2019130437A1/fr
Publication of WO2019130437A1 publication Critical patent/WO2019130437A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis

Definitions

  • the present invention relates to a technology for analyzing the smile of a person by region, and is used in the field of IoT (internet of things) and the like.
  • Patent Document 1 only detects whether a person is a smile, and analyzes regional characteristics of smile, specifically, whether there are many smiling people by region. Absent. Therefore, an object of the present invention is to make it possible to know by region whether or not there are many smiling people.
  • the present invention calculates and displays a smile level for each area based on an acquisition unit that acquires an image of a person, a determination unit that analyzes the image and determines a smile, and a result of the determination. And provides a regional degree of smile display system.
  • the display means may compare and display the degree of smile according to the area.
  • the display means may calculate and display the degree of smile for each area based on the position of the imaging device that has captured the image.
  • the display means may calculate and display the degree of smile of the person by area based on the position of the imaging device which has captured the image of the same person.
  • the display means may calculate and display the degree of smile for each person attribute by region.
  • the display means may calculate and display the degree of smile for each predetermined period for each area.
  • the present invention calculates and displays the degree of smile for each area based on the result of an acquisition step of acquiring an image of a person, a determination step of analyzing the image to determine a smile, and the determination.
  • An area-by-area smile degree display method comprising the display step is provided.
  • a computer is used to obtain an image of a person, analyze the image, determine a smile, and calculate a smile level for each area based on the result of the determination. And providing a program for executing the displaying step.
  • FIG. 3 is a hardware block diagram of a user terminal 300.
  • FIG. 2 is a hardware block diagram of the server device 200.
  • FIG. 2 is a functional block diagram of the server device 200.
  • 100-1 to 100-3 camera, 200: server device, 201: CPU, 202: ROM, 203: RAM, 204: auxiliary storage device, 205: communication IF, 21 ... acquisition unit, 22 ... determination unit, 23 ... display unit, 300 ... user terminal, 301 ... CPU, 302 ... ROM, 303 ... RAM, 304 ... ⁇ ⁇ Auxiliary storage device, 305 ⁇ ⁇ ⁇ Communication IF, 306 ⁇ ⁇ ⁇ Display unit, 307 ⁇ ⁇ ⁇ Operation unit, 900 ⁇ ⁇ ⁇ Network
  • FIG. 1 is a block diagram showing an outline of the smile degree display system 1 classified by region.
  • the regional smile level display system 1 includes a camera 100, a server device 200, and a user terminal 300.
  • the camera 100, the server apparatus 200, and the user terminal 300 are communicably connected via the network 900.
  • the camera 100 is an imaging device, and includes a camera 100-1, a camera 100-2, and a camera 100-3.
  • Each camera 100 is a plurality of network cameras provided at different positions, and has a function of transmitting to the server device 200 image data indicating an imaging position, imaging date and time, and an imaged image.
  • the installation position of the camera 100 is, for example, a station, a commercial facility, a road, or a public facility.
  • Each camera 100 may be the same or different for its use (crime prevention purpose, fixed point observation purpose, public, commercial), function, performance (image quality, zoom function, pan function, data transfer ability, etc.) It is also good.
  • the camera 100 need not be fixed, and may be mounted on a movable terminal.
  • the user terminal 200 when the user terminal 200 is a device with a camera function, the user terminal 200 may have the function of the camera 100.
  • the imaging and transmission of image data are preferably performed at fixed time intervals or at preset timings.
  • a predetermined event for example, a request from the server device 200 or a sensor included in the camera 100 detects a predetermined information
  • imaging and / or transmission of image data is executed. It is also good.
  • FIG. 2 is a block diagram illustrating the hardware configuration of user terminal 300.
  • the user terminal 300 may be, for example, a smartphone, a tablet, or a portable computer such as a camera, a glass type, a head mounted display type or a contact lens type wearable computer, or a desktop type or notebook type personal computer.
  • the user terminal 300 includes a central processing unit (CPU) 301, a read only memory (ROM) 303, a random access memory (RAM) 303, an auxiliary storage device 304, a communication IF 305, a display unit 306, and an operation unit 307.
  • CPU central processing unit
  • ROM read only memory
  • RAM random access memory
  • auxiliary storage device 304 a communication IF 305
  • display unit 306 a display unit 306.
  • the CPU 301 is a processor that performs various operations.
  • the ROM 302 is, for example, a non-volatile memory storing programs and data used to start the user terminal 30.
  • the RAM 303 is a volatile memory that functions as a work area when the CPU 301 executes a program.
  • the auxiliary storage device 304 is a non-volatile storage device such as a hard disk drive (HDD) or a solid state drive (SSD), for example, and stores programs and data used in the user terminal 300. Execution of this program by the CPU 301 realizes the function shown in FIG. 4 described later.
  • the communication IF 305 is an interface for performing communication via the network 900 according to a predetermined communication standard.
  • This communication standard may be a standard of wireless communication or a standard of wired communication.
  • the communication IF 305 includes, for example, an antenna and a communication circuit that operate according to a communication standard such as LTE (Long Term Evolution) or Wi-Fi (registered trademark).
  • the display unit 306 includes, for example, a liquid crystal panel, a liquid crystal drive circuit, and the like, and displays an image according to the image data.
  • the operation unit 307 includes an operator such as a key or a touch sensor, for example, and receives a user operation and supplies a signal corresponding to the operation to the CPU 301.
  • the user terminal 300 may include other configurations such as a GPS (Global Positioning System) unit and an audio input / output unit.
  • GPS Global Positioning System
  • FIG. 3 is a block diagram illustrating a hardware configuration of the server device 200 as the region-by-area smile degree calculation device.
  • the server device 200 is a computer device having a CPU 201, a ROM 202, a RAM 203, an auxiliary storage device 204, and a communication IF 205.
  • the CPU 201 is a processor that performs various operations.
  • the ROM 202 is, for example, a non-volatile memory storing programs and data used to start the server device 200.
  • the RAM 203 is a volatile memory that functions as a work area when the CPU 201 executes a program.
  • the auxiliary storage device 204 is a non-volatile storage device such as an HDD or an SSD, for example, and stores programs and data used in the server apparatus 200.
  • the communication IF 205 is an interface for performing communication via the network 900 according to a predetermined communication standard.
  • the server apparatus 200 may include other configurations such as a display unit and an operation unit, in addition to the configuration illustrated in FIG. 3.
  • FIG. 4 is a block diagram illustrating a functional configuration of the region-by-area smile degree display system 1.
  • the region-specific smile degree display system 1 includes an acquisition unit 21, a determination unit 22, and a display unit 23.
  • the acquisition unit 21 is realized by, for example, the communication IF 205 of the server device 200, and acquires an image including a person captured by each camera 100 via the network 900.
  • the determination unit 22 is realized by, for example, the CPU 201 of the server device 200, and analyzes the image acquired by the acquisition unit 21 to determine a smiling person.
  • the display unit 23 is realized by, for example, the CPU 201 of the server device 200, the auxiliary storage device 204, the communication IF 205, and the display unit 306 of the user terminal 300, and calculates the smile level by area based on the determination result by the determination unit 22. Display.
  • the degree of smile is an index that can compare the number or number of smile people by region, and for example, the number of smiles determined per day for the population of the region within the region. Is the percentage of the total number of people.
  • the display unit 23 calculates and displays the degree of smile for each area based on the position of the camera 100 that has captured the image. In addition, the display unit 23 displays the degree of smile of each area in a comparable state.
  • FIG. 5 is a diagram showing an example of the regional degree of smile degree database stored by the display unit 23 (specifically, the auxiliary storage device 204 that configures the display unit 23).
  • the area-by-area smile degree database for example, the area ID for identifying each area divided by municipality, the population of the area, and the total number of smiling people counted from 0 o'clock to 24 o'clock in the area (Smile count value) is associated with the degree of smile calculated for the area of the person. The smile count value and the degree of smile are cleared every day at 0 o'clock.
  • FIG. 6 shows an operation example of the regional degree of smile degree display system 1.
  • Each camera 100 transmits image data indicating a captured image (here, a still image captured periodically) to the server device 200 at a determined timing.
  • the acquisition unit 21 acquires these image data (step S1).
  • the image pickup position and the image pickup date and time of each camera 100 are added to the image data.
  • the determination unit 22 analyzes the image data of any one of the cameras 100, and collates the image with a predetermined feature point of the human face to be included in the image.
  • the face of the person is recognized (step S2).
  • the determination unit 22 analyzes the image data to determine whether the person included in the image has a smile (step S3). This determination is performed by collating the captured image with a predetermined feature point when the human face smiles.
  • the determination unit 22 registers smile information on the smile (step S4). That is, the determination unit 22 searches the area ID of the area including the imaging position of the camera 100 in the area-by-area smile degree database, and increments the smile count value corresponding to the area ID by one. As a result, smile information is registered.
  • the determination unit 22 excludes the number of smiles captured in duplicate when the person who smiles is simultaneously imaged by a plurality of cameras 100. A smile count value may be obtained.
  • step S6 the determination unit 22 calculates and writes the degree of smile corresponding to each area ID in the area-specific smile degree database (step S6). Specifically, the determination unit 22 divides the smile count value counted from 0 o'clock in the area of each area ID by the population of that area, calculates a value obtained by multiplying this by 100, and sets this as the smile degree Write.
  • the smile level by area is transmitted from the server device 200 to the user terminal 300 in response to a request from the user terminal 300, for example, and displayed on the display unit 306 (step S7).
  • the display unit 23 displays, for example, the area ID or the name of the area and the smile level in association with each other. Furthermore, the display unit 23 compares the smile levels according to areas, such as sorting out and displaying areas and smile levels in descending order of smile level, or displaying smile levels of a plurality of areas side by side on the same page. Display as you get.
  • this degree of smile by region may be displayed as a heat map representing the magnitude of the value (here, the degree of smile) as a color type or strength on the map, or the magnitude of the value (here, the degree of smile) May be displayed as a bubble chart expressing the size of the bubble on the map.
  • the server apparatus 200 When the server apparatus 200 performs the above-described process on the images captured by all the cameras 100, it is possible to know the degree of smile of each area.
  • the display unit 23 selects the smile level of the person according to the area based on the position of the camera 100 that has captured the image of the same person. May be calculated and displayed. Specifically, the determination unit 22 stores the area ID of the area where the same person smiles in association with the person ID of the person in the area-by-area smile degree database. Furthermore, the determination unit 22 stores a smile count value, which is the number of times the same person smiles, in the area-by-area smile degree database, in association with the area ID. The display unit 23 displays the degree of smile of each area in association with the person ID of each person.
  • each person carries a transmission device that transmits a unique ID
  • the camera 100 receives the ID
  • the server device 200 receives an image.
  • the display unit 23 may calculate and display the degree of smile for each person attribute by region. Specifically, for the person included in the image captured by the camera 100, the determination unit 22 estimates the attribute (sex, age, etc.) of the person by face recognition technology. Then, the determination unit 22 calculates and stores the degree of smile by area and by person attribute in the area-specific smile degree database. The display unit 23 displays the degree of smile by region and by person attribute. This makes it possible to know what kind of attribute person often or hardly smiles in which region. Other than face recognition technology, there are the following technologies for recognizing attributes of a person.
  • the determination unit 22 of the server device 200 stores the attribute of the person in association with the person ID.
  • Each person carries a transmission device for transmitting a person ID, and the camera 100 receives the person ID and transfers it to the server device 200 together with image data.
  • the server apparatus determines the attribute of each person included in the image by referring to the attribute corresponding to the received person ID.
  • the display unit 23 may calculate and display the degree of smile for each predetermined period for each area. Specifically, based on the imaging date and time added to the image data transmitted from the camera 100, the determination unit 22 is classified by region and for a predetermined period (for example, 1 hour unit, 1) in the region-by-region smile degree database. Smile level is calculated and stored on a daily basis, a weekly basis, a monthly basis, etc.). The display unit 23 displays the degree of smile by region and for a predetermined period. In this way, it is possible to know in which period often smiles or not in each area.
  • the determination unit 22 calculates the degree of smile by dividing the population of the area by the total number (smile count value) of smiling people counted from 0 o'clock to 24 o'clock in the area.
  • the smile calculation method is not limited to this example.
  • the determination unit 22 may calculate the smile level through calculation to divide the total number of persons included in the image by the total number of smile persons included in the image, or may be included in the image.
  • the total number of smiling people who are Further, the accumulation period of the smile count value is not limited to one day, and any period can be used.
  • the degree of smile may be an index that can compare the number or number of smile people by region.
  • the timing at which the server device 200 acquires an image from the camera 100 and the timing at which the server device 200 executes image analysis are arbitrary.
  • each camera 100 may not transmit image data to the server device 200 spontaneously, and the server device 200 may request the camera 100 for image data in response to a request from the user terminal 300.
  • the server apparatus 200 may execute image analysis according to a predetermined schedule regardless of the timing of a request from the user terminal 300. Acquisition of a captured image, analysis of an image, smile determination and transmission determination may be performed by a plurality of nodes or may be performed by one node.
  • the user terminal 300 may have the function of the server device 200.
  • the present invention may be provided as an information processing method including the steps of processing performed in the server device 200 or the region-based smile degree display system 1. That is, the present invention calculates and displays the degree of smile for each area based on the result of the acquisition step of acquiring an image of a person, the determination step of analyzing the image and determining a smile, and the determination.
  • An area-by-area smile degree display method comprising the display step is provided.
  • the present invention may be provided as a program executed on server apparatus 200 or user terminal 320. Such a program may be provided in the form of being recorded in a recording medium such as an optical disk, or may be provided in the form of being downloaded to a computer via a network such as the Internet and installed and made available. It is possible.
  • the elements of the various steps are presented in an exemplary order and are not limited to the presented order of acquisition.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Tourism & Hospitality (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Economics (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Image Analysis (AREA)
  • Studio Devices (AREA)

Abstract

La présente invention concerne une technologie permettant de déterminer un degré de sourire par région, utilisée dans le domaine de l'internet des objets (IoT) ou similaire. Un dispositif serveur (200) acquiert une image représentant des personnes, prise par un appareil photo (100). Le dispositif serveur (200) détermine les personnes souriantes par analyse de l'image acquise. Sur la base du résultat de la détermination, le dispositif serveur (200) calcule et affiche un degré de sourire par région. Ici, le degré de sourire est un indicateur permettant de comparer le nombre de personnes souriantes par région, et est, par exemple, la proportion du nombre total de personnes souriantes déterminées par jour dans une région de la population de la région.
PCT/JP2017/046716 2017-12-26 2017-12-26 Système et procédé d'affichage de degré de sourire régional, et programme Ceased WO2019130437A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2019561440A JP6734487B2 (ja) 2017-12-26 2017-12-26 地域別笑顔度表示システム、地域別笑顔度表示方法及びプログラム
PCT/JP2017/046716 WO2019130437A1 (fr) 2017-12-26 2017-12-26 Système et procédé d'affichage de degré de sourire régional, et programme

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2017/046716 WO2019130437A1 (fr) 2017-12-26 2017-12-26 Système et procédé d'affichage de degré de sourire régional, et programme

Publications (1)

Publication Number Publication Date
WO2019130437A1 true WO2019130437A1 (fr) 2019-07-04

Family

ID=67063281

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/046716 Ceased WO2019130437A1 (fr) 2017-12-26 2017-12-26 Système et procédé d'affichage de degré de sourire régional, et programme

Country Status (2)

Country Link
JP (1) JP6734487B2 (fr)
WO (1) WO2019130437A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2021177362A (ja) * 2020-05-08 2021-11-11 ヤフー株式会社 情報処理装置、情報処理方法、情報処理プログラム及び端末装置

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011170579A (ja) * 2010-02-18 2011-09-01 Seiko Epson Corp 親密度判定方法及び親密度判定装置
JP2013134601A (ja) * 2011-12-26 2013-07-08 Nikon Corp 電子機器
JP2015075908A (ja) * 2013-10-09 2015-04-20 日本電信電話株式会社 感情情報表示制御装置、その方法及びプログラム

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9760766B2 (en) * 2015-06-30 2017-09-12 International Business Machines Corporation System and method for interpreting interpersonal communication

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011170579A (ja) * 2010-02-18 2011-09-01 Seiko Epson Corp 親密度判定方法及び親密度判定装置
JP2013134601A (ja) * 2011-12-26 2013-07-08 Nikon Corp 電子機器
JP2015075908A (ja) * 2013-10-09 2015-04-20 日本電信電話株式会社 感情情報表示制御装置、その方法及びプログラム

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
SASAKI, WATARU ET AL.: "SmileSpot: Evaluation of the Impact of Sharing Smiling Images of Others on user Smile Formation.", IPSJ SIG TECHNICAL REPORT, UBIQUITOUS COMP. SYSTEMS, vol. 20, no. 9, 4 May 2015 (2015-05-04), pages 1 - 7, ISSN: 2188-8698 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2021177362A (ja) * 2020-05-08 2021-11-11 ヤフー株式会社 情報処理装置、情報処理方法、情報処理プログラム及び端末装置
JP7260505B2 (ja) 2020-05-08 2023-04-18 ヤフー株式会社 情報処理装置、情報処理方法、情報処理プログラム及び端末装置

Also Published As

Publication number Publication date
JP6734487B2 (ja) 2020-08-05
JPWO2019130437A1 (ja) 2020-07-16

Similar Documents

Publication Publication Date Title
KR101741351B1 (ko) 정황 인구통계 판정 시스템
JP6885682B2 (ja) 監視システム、管理装置、及び監視方法
US20170250942A1 (en) Apparatus For Sharing Image Content Based On Matching
CN110916620A (zh) 一种体温测量方法及终端
KR102085187B1 (ko) 정황 건강 판정 시스템
KR20150119131A (ko) 정황 감정 판정 시스템
JP2019101664A (ja) 推定プログラム、推定システム、及び推定方法
WO2017022306A1 (fr) Système de traitement d'informations et procédé de traitement d'informations
EP3090391A1 (fr) Système et procédé pour recommander des emplacements cibles
KR20170098113A (ko) 전자 장치의 이미지 그룹 생성 방법 및 그 전자 장치
US20220180776A1 (en) Determination of parameters for use of an outdoor display unit
US20180067967A1 (en) Information processing device, information processing method, and program
CN114970621A (zh) 异常聚集事件的检测方法、装置、电子设备和存储介质
EP3035225B1 (fr) Dispositif de traitement d'information, système d'authentification, procédé d'authentification et programme
JPWO2017047063A1 (ja) 情報処理装置、評価方法及びコンピュータプログラム
JP5411641B2 (ja) 画像分類装置、画像分類システム、画像分類方法、プログラム、および記録媒体
JP6734487B2 (ja) 地域別笑顔度表示システム、地域別笑顔度表示方法及びプログラム
CN111354210B (zh) 地图生成设备、地图生成系统、地图生成方法以及地图生成程序
WO2021103727A1 (fr) Procédé de traitement de données, dispositif et support de stockage
JP2022550192A (ja) 情報処理方法、装置、機器、システム、記憶媒体及びコンピュータプログラム
JP5560704B2 (ja) 表示スケジュール設定装置、コンテンツ表示システム、スケジュール設定方法、及びプログラム
JP7040664B1 (ja) データ収集装置、データ取得装置及びデータ収集方法
JP6710817B2 (ja) 笑顔伝染判定システム、笑顔伝染判定方法及びプログラム
JP7047174B1 (ja) 予測システム、予測装置、予測方法および予測プログラム
US20240265568A1 (en) Electronic apparatus, information processing system, and control method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17935920

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019561440

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17935920

Country of ref document: EP

Kind code of ref document: A1