[go: up one dir, main page]

WO2025071085A1 - Procédé et appareil pour fournir un service de photographie comprenant une fonction de publicité d'utilisation de contenu sur la base de l'intelligence artificielle - Google Patents

Procédé et appareil pour fournir un service de photographie comprenant une fonction de publicité d'utilisation de contenu sur la base de l'intelligence artificielle Download PDF

Info

Publication number
WO2025071085A1
WO2025071085A1 PCT/KR2024/013828 KR2024013828W WO2025071085A1 WO 2025071085 A1 WO2025071085 A1 WO 2025071085A1 KR 2024013828 W KR2024013828 W KR 2024013828W WO 2025071085 A1 WO2025071085 A1 WO 2025071085A1
Authority
WO
WIPO (PCT)
Prior art keywords
pose
advertising
output image
user
instant output
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/KR2024/013828
Other languages
English (en)
Korean (ko)
Inventor
박정훈
김민석
김진영
유경민
이수학
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Seobuk Co Ltd
Original Assignee
Seobuk Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020240117657A external-priority patent/KR20250047125A/ko
Application filed by Seobuk Co Ltd filed Critical Seobuk Co Ltd
Publication of WO2025071085A1 publication Critical patent/WO2025071085A1/fr
Pending legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/955—Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K19/00—Record carriers for use with machines and with at least a part designed to carry digital markings
    • G06K19/06—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands

Definitions

  • the present invention relates to a method and device for providing a photography service including an artificial intelligence-based content utilization advertising function.
  • Unmanned photo studios that provide self-photography services are establishing themselves as new experiential spaces for the younger generation to express themselves and appeal to them.
  • Unmanned photo studios are being installed in places with a lot of floating population, such as places where various cultural facilities are densely located, or places with a lot of floating population, such as event, exhibition, and concert halls, taking advantage of the device’s booth-type design.
  • advertisements targeting users who visit unmanned photo studios are being launched. For example, advertisements that insert idols, sports players, and influencers into the background or frame of a photo, advertisements that display advertisements on the display screen while the photo is being developed, and advertisements that display advertisements on websites visited to save photos have been launched.
  • a new advertising delivery method is required to maximize advertising effectiveness through unmanned photo studios that provide self-photography services.
  • the inventors of the present invention sought to develop a method for increasing the advertising effect by providing a user-participatory advertising service by inducing the user's actions and providing an advertisement matching the user's actions while the user is taking a composition for taking a photo.
  • a method for providing a photography service including an artificial intelligence-based content utilization function is provided.
  • the method is configured to include a step of receiving at least one instant output image in response to a request for participation in an advertising event from a photographing device or a user device, a step of inputting the instant output image into a pose recognition model configured to output whether an advertisement pose is included by taking an image as an input and determining whether an advertisement pose is included in the instant output image, and a step of providing a reward to the photographing device or the user device when the advertisement pose is included in the instant output image.
  • the pose recognition model may be a model configured to output a probability that a user's pose included in the instant output image corresponds to a predefined advertisement pose.
  • the method may further include a step of determining an advertisement pose to be recognized by the pose recognition model by using an advertisement learning model learned to detect a user pose by inputting advertisement content.
  • the method further comprises the step of providing a guideline for an advertising event by the photographing device, wherein the guideline may include at least one of a full body exposure range for recognizing the advertising pose, a rotation direction for each body part, a movement direction, and a change in size or direction based on coordinates of body feature points.
  • the step of receiving the image is a step of receiving an image that can be output in real time from the photographing device
  • the step of determining whether the advertisement pose includes an expression may further include a step of providing the photographing device with a probability indicating whether the advertisement pose is included in the image that can be output in real time.
  • the step of receiving the image may be a step of receiving a plurality of instant output images composed of a plurality of frames
  • the step of providing the reward may be a step of providing a reward when an advertisement pose matching the advertisement event participation request is included in at least one instant output image among the plurality of instant output images.
  • the step of receiving the instant output image may further include the step of determining the type of advertising event based on a graphic object included in the instant output image.
  • the device includes a communication interface, a memory, and a processor operably connected to the communication interface and the memory, wherein the processor is configured to receive at least one instant output image in response to an advertising event participation request from a photographing device or a user device, input the instant output image into a pose recognition model configured to output whether an advertisement pose is included by taking an image as an input, and determine whether an advertisement pose is included in the instant output image, and provide a reward to the photographing device or the user device if the advertisement pose is included in the instant output image.
  • a photographing device providing an artificial intelligence-based content utilization function includes a communication interface, an I/O interface, a memory, and a processor operably connected to the communication interface, the I/O interface, and the memory, wherein the processor is configured to obtain at least one instant output image including a user's advertisement event participation request through the I/O interface, input the instant output image into a pose recognition model configured to output whether an advertisement pose is included by taking an image as an input, and determine whether an advertisement pose is included in the instant output image, and if the advertisement pose is included in the image, provide a reward to a user matching the instant output image through the communication interface.
  • the present invention can induce active participation of users by inducing a specific pose related to an advertisement target to a user in an unmanned photo studio (hereinafter referred to as a “photographing device”) providing a self-photography service, and providing a corresponding reward to the user when the pose is detected.
  • a photographing device providing a self-photography service
  • the present invention can induce active participation of users by inducing a specific pose related to an advertisement target to a user in an unmanned photo studio (hereinafter referred to as a “photographing device”) providing a self-photography service, and providing a corresponding reward to the user when the pose is detected.
  • a photographing device providing a self-photography service
  • the present invention can improve the recognition accuracy of a pose recognition model that detects a user's pose by providing guidelines for an advertisement target and a specific pose associated therewith to a photographing device.
  • the recognition accuracy by improving the recognition accuracy, rewards can be properly provided to users who participate in an advertisement event, and user participation satisfaction can be improved.
  • the present invention can make users remember the advertising content by designating a signature pose or choreography as an advertising point in various contents and incorporating this into a photo shooting service.
  • FIG. 1 is a block diagram showing the configuration of a photo shooting service system including an artificial intelligence-based content utilization advertising function according to one embodiment of the present invention.
  • FIG. 2 is a block diagram showing the configuration of a photography service providing device according to one embodiment of the present invention.
  • FIG. 3 is a schematic flowchart of a method for providing a photo shooting service performed in a photo shooting service providing device according to one embodiment of the present invention.
  • FIG. 4 is a schematic diagram illustrating a pose recognition model according to one embodiment of the present invention.
  • FIG. 5 is a block diagram showing the configuration of a photographing device including an artificial intelligence-based content utilization advertising function according to one embodiment of the present invention.
  • FIG. 6 is a schematic flowchart of a method for providing a photo shooting service performed in a photo shooting service system according to one embodiment of the present invention.
  • FIG. 7 is an exemplary diagram showing an interface screen of a photographing device that provides a photography service including a content utilization advertising function according to one embodiment of the present invention.
  • FIG. 8 is a schematic flowchart of a method for providing a photo shooting service performed in a photo shooting service system according to another embodiment of the present invention.
  • FIGS. 9a, 9b, 9c and 9d are exemplary diagrams showing interface screens of a user device that provides a photo shooting service including a content utilization advertising function according to one embodiment of the present invention.
  • the expressions "have,” “can have,” “include,” or “may include” indicate the presence of a given feature (e.g., a numerical value, function, operation, or component such as a part), but do not exclude the presence of additional features.
  • the expressions "A or B,” “at least one of A and/or B,” or “one or more of A or/and B” can include all possible combinations of the listed items.
  • “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to (1) including at least one A, (2) including at least one B, or (3) including both at least one A and at least one B.
  • first,” “second,” “first,” or “second,” etc. used in this document can describe various components, regardless of order and/or importance, and are only used to distinguish one component from another, but do not limit the components.
  • a first user device and a second user device can represent different user devices, regardless of order or importance.
  • a first component can be referred to as a second component, and similarly, a second component can also be referred to as a first component.
  • a component e.g., a first component
  • another component e.g., a second component
  • the component can be directly coupled to the other component, or can be connected via another component (e.g., a third component).
  • a component e.g., a first component
  • another component e.g., a second component
  • no other component e.g., a third component
  • a processor configured (or set) to perform A, B, and C can mean a dedicated processor (e.g., an embedded processor) to perform those operations, or a generic-purpose processor (e.g., a CPU or an application processor) that can perform those operations by executing one or more software programs stored in a memory device.
  • a dedicated processor e.g., an embedded processor
  • a generic-purpose processor e.g., a CPU or an application processor
  • the term 'instant output image' used in this specification may be an image captured by a shooting device and output immediately after being captured.
  • the instant output image may include at least one user with a facial pose.
  • the instant output image may be composed of one cut of an image including the same user or may be composed of multiple images.
  • the instant output image may be mapped with identification data of the shooting device that captured the image, date data regarding the shooting time, and identification data of the user included in the image.
  • the term 'advertisement learning model' used in this specification may be a model learned to detect a user pose by inputting advertisement content.
  • the advertisement content may be an image or video including a person who is a target of promotion, such as a movie, a drama, a stage video, a video advertisement, an image advertisement, etc.
  • the advertisement learning model may detect a pose that other users can follow in the image or video.
  • the advertisement learning model may detect a user pose within an overlapping section based on text data or audio data.
  • the advertisement learning model may detect a user pose within a section in which specific lyrics, lines, or melody are detected.
  • the term 'pose recognition model' used in this specification may be a model trained to input an image and output whether or not it includes an advertisement pose.
  • the image may be an instant output image acquired through a photographing device, and the pose recognition model may output a probability that a user's pose included in the instant output image corresponds to a predefined advertisement pose.
  • the user's pose may be determined based on body feature points, and for example, the body feature points may include a plurality of points matching the center or edges of the head, body, limbs, hands, fingers, etc.
  • the advertisement learning model and the pose recognition model may be composed of at least one model or two or more ensemble models among VGG net, R, DenseNet based on CNN (Convolutional Neural Network), FCN (Fully Convolutional Network) with encoder-decoder structure, SegNet, DeconvNet, DeepLAB V3+, DNN (deep neural network) such as U-net, SqueezeNet, Alexnet, ResNet18, MobileNet-v2, MobileNet-v3, GoogLeNet, Resnet50, Resnet101, Inception-v3, Efficientnet.
  • CNN Convolutional Neural Network
  • FCN Fast Convolutional Network
  • SegNet DeconvNet
  • DeepLAB V3+ Deep neural network
  • DNN deep neural network
  • FIG. 1 is a block diagram showing the configuration of a photo shooting service system including an artificial intelligence-based content utilization advertising function according to one embodiment of the present invention.
  • a photography service system (1000) including an artificial intelligence-based content utilization advertising function may be a photography service system that analyzes a user’s pose in an instantly captured photo (hereinafter referred to as an “instant output image”) through an artificial neural network model and provides a reward to the user based on whether the analyzed pose matches a predefined advertising pose.
  • the photography service system (1000) of the present invention may include a photography service providing device (100), a photographing device (200), and a user device (300).
  • the photo shooting service providing device (100) is a server device of a service provider that analyzes a user pose in an instant output image and determines whether to provide a reward based on the analysis result, and may include a general-purpose computer, a laptop, a data server, etc. Specifically, the photo shooting service providing device (100) may receive an instant output image in which a user is included from a shooting device (200) or a user device (300). The photo shooting service providing device (100) may determine whether participation in an advertising event is possible based on at least one of identification data of a shooting device mapped to an instant output image, date data on the shooting time, and identification data of a user included in the corresponding image.
  • whether participation in an advertisement is possible may be understood as a result of determining whether an advertisement is currently in progress through the photo shooting service system (1000), whether the provided instant output image was shot by another shooting device, or whether it is an instant output image shot a long time ago.
  • the photography service providing device (100) can determine the type of advertisement event based on the graphic object included in the instant output image. For example, the photography service providing device (100) can detect an advertisement event frame or an advertisement event object from the instant output image, and determine the type of advertisement matching the advertisement event frame or object.
  • the advertisement type can be understood as advertisement content
  • the photography service providing device (100) can determine an advertisement pose to be detected based on the advertisement event frame or object.
  • the frame included in the instant output image may include text data such as a title of the advertisement content, or may include image data such as a representative image representing the advertisement content.
  • the photography service providing device (100) can determine whether an advertisement pose is included in an instant output image. For example, the photography service providing device (100) can input an instant output image into a pose recognition model to obtain a probability value indicating whether a pose of a user existing in the instant output image matches one of a plurality of pre-designated advertisement poses. The photography service providing device (100) can determine whether the pose of the user matches the advertisement pose according to the probability value.
  • the photography service providing device (100) can input an instant output image into a pose recognition model to obtain a result value indicating whether a pose of a user existing in the instant output image corresponds to one of a plurality of pre-designated advertisement poses.
  • the photo shooting service providing device (100) may provide a reward to the shooting device (200) or the user device (300) if an advertising pose is included in the instant output image.
  • the reward may be points that can be used in the photo shooting service.
  • the photo shooting service providing device (100) may provide a coupon number or two-dimensional barcode that can provide a reward to the shooting device (200), or may provide a reward to a user account through an application or web page installed or executed on the user device (300).
  • the reward provided by the photography service providing device (100) may further include a secret frame, an event lottery ticket, etc.
  • the photography service providing device (100) may transmit a reward selection request to the photography device (200) or the user device (300) to determine which reward to provide to the user among points, a secret frame, and an event lottery ticket. If the secret frame is selected as the reward, the photography service providing device (100) may provide an additional photography service to the photography device (200) or provide a coupon for using a paid photo frame to the user device (300).
  • the photography service providing device (100) may receive an advertisement event participation request from any one of the photography devices (200) before receiving an instant output image.
  • the advertisement event participation request may be a participation request for any one of the advertisements or events
  • the photography service providing device (100) may provide guidelines for the advertisement event to the photography device (200) according to the advertisement event participation request.
  • the photography service providing device (100) may receive an image that can be instantly output in real time from the photography device (200).
  • the photography service providing device (100) may provide guidelines for a full body exposure range for recognizing an advertisement pose, a rotation direction for each body part, a movement direction, and a size or direction change based on coordinates of body feature points to the photography device (200).
  • the photography device (200) can visually and audibly output guidelines such as 'Please raise both arms up', 'Please rotate your body to the left', and 'Please make a V-sign with your index and middle fingers' on the image being photographed.
  • these guidelines can be provided to all multiple users within the image being photographed by the photography device (200).
  • the photography service providing device (100) can provide a probability value indicating whether an advertising pose is included within an image that can be instantly output by the photography device (200).
  • the photography service providing device (100) can provide the photography device (200) with a probability value indicating whether a pose of the user included within an instantly output image is similar to any one advertising pose selected by the user.
  • the photo shooting service providing device (100) may identify content to be advertised based on the type of advertising event included in an advertising event participation request from one of the photo shooting devices (200) before receiving an instant output image.
  • the photo shooting service providing device (100) may provide preset text data or audio data for the identified advertising content to the photo shooting device (200). For example, if the identified advertising content is a music video, the chorus section may be provided to the photo shooting device (200) in the form of audio data, and in the case of a drama or movie, specific lines may be provided to the photo shooting device (200) in the form of text data.
  • the photography service providing device (100) may receive a plurality of instant output images composed of a plurality of frames.
  • the photography service providing device (100) may divide each of the plurality of instant output images, input the divided plurality of instant output images into a pose recognition model, and determine whether or not an advertisement pose is included in each image.
  • the photography service providing device (100) may provide a reward when an advertisement pose matching an advertisement event participation request is included in at least one instant output image among the plurality of instant output images.
  • the photography service providing device (100) may include various DB servers for providing a photography service including an advertising function.
  • the photography service providing device (100) may include a device DB server that stores identification data of the photography device (200), the operating status of each photography device (200) (e.g., normal, idle, error), a CMS (Content manage system) DB server that stores various data (e.g., service UI, instant photography image frame, advertising event, payment data, etc.) related to the photography service provided through the photography device (200), a storage server that stores instant photography images taken by the photography device (200), a mobile DB server that stores a user account of a user using the photography service, etc.
  • a device DB server that stores identification data of the photography device (200), the operating status of each photography device (200) (e.g., normal, idle, error), a CMS (Content manage system) DB server that stores various data (e.g., service UI, instant photography image frame, advertising event, payment data, etc.) related to the photography
  • the photographing device (200) may be a photographing device installed in an unmanned photo studio providing a self-photography service.
  • the photographing device (200) may capture an instant output image including a user, and may provide the captured instant output image to the photo shooting service providing device (100) in response to the user's request for participation in an advertising event.
  • the advertisement event participation request provided by the photographing device (200) to the photo shooting service providing device (100) may include identification data of the photographing device (200), an instant output image, and user identification data, and may optionally include advertisement event selection data.
  • the photographing device (200) may provide an instant output image, including the user, to the user device (300) upon the user's request for provision of an instant output image.
  • the photographing device (200) may request user identification data (e.g., user phone number, ID, etc.) to be transmitted to the instant output image, or output a photo shooting service web page or application program access data that enables the instant output image to be downloaded.
  • user identification data e.g., user phone number, ID, etc.
  • the photographing device (200) may perform the content utilization advertising function of the photo shooting service providing device (100). In such a case, the photographing device (200) may determine whether to include an advertising pose in the user's instant output image without providing the instant output image to the photo shooting service providing device (100).
  • the user device (300) is a device possessed by a service user who uses a photo shooting service, and may include a smartphone, a tablet PC, a PC, a laptop, etc.
  • the user device (300) may install or execute a web or mobile application or program provided by the photo shooting service providing device (100) to output a user interface screen for requesting a photo shooting service.
  • the photo shooting service may include a service for downloading an instant output image captured by the shooting device (200), a service for participating in an advertising event through an instant output image, etc.
  • the user device (300) may transmit at least one instant output image in response to a request for participation in an advertising event to the photography service providing device (100).
  • the user device (300) may execute a web service page or application to select one of a plurality of advertising events currently in progress and upload an image captured by the photography device (200).
  • the user device (300) may receive a reward from the photography service providing device (100) according to whether an advertising pose is included in the instant output image.
  • the user device (300) may receive a reward selection request for selecting one of points, a secret frame, and an event raffle ticket from the photography service providing device (100), and may receive one type of reward through a user account according to the user's selection.
  • the photo shooting service system (1000) can reduce users' resistance to direct or participatory advertising promotion while increasing the advertising impression effect on the advertising target by using facial poses as an advertising medium.
  • FIG. 2 is a block diagram showing the configuration of a photography service providing device according to one embodiment of the present invention.
  • the photo shooting service providing device (100) may include a communication interface (110), a memory (120), an I/O interface (130), and a processor (140), and each component may communicate with each other through one or more communication buses or signal lines.
  • the communication interface (110) can be connected to the photographing device (200) and the user device (300) via a wired/wireless communication network to exchange data.
  • the communication interface (110) can receive an instant output image from the photographing device (200) and the user device (300), and transmit a reward to the photographing device (200) and the user device (300) according to whether the instant output image includes an advertisement pose.
  • the communication interface (110) can receive an image that can be instantly output in real time from the photographing device (200), and transmit a probability value indicating whether an advertisement pose is included in the image that can be instantly output to the photographing device (200).
  • the communication interface (110) that enables transmission and reception of such data includes a wired communication port (111) and a wireless circuit (112), wherein the wired communication port (111) may include one or more wired interfaces, for example, Ethernet, a universal serial bus (USB), FireWire, etc.
  • the wireless circuit (112) may transmit and receive data with an external device via an RF signal or an optical signal.
  • the wireless communication may use at least one of a plurality of communication standards, protocols, and technologies, for example, GSM, EDGE, CDMA, TDMA, Bluetooth, Wi-Fi, VoIP, Wi-MAX, or any other suitable communication protocol.
  • the memory (120) can store various data used in the photo shooting service providing device (100).
  • the memory (120) can store identification data of the photographing device (200) and the user device (300), and user interface configuration data of the service provided through the photographing device (200) and the user device (300).
  • the memory (120) can store a pose recognition model configured to output whether an image is input and includes an advertisement pose, and its learning data, and can store an advertisement learning model trained to detect a user pose by inputting advertisement content, and its learning data.
  • the memory (120) may include a volatile or nonvolatile storage medium capable of storing various data, commands, and information.
  • the memory (120) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., an SD or XD memory, etc.), a RAM, an SRAM, a ROM, an EEPROM, a PROM, a network storage storage, a cloud, and a blockchain database.
  • the memory (120) may store configurations of at least one of an operating system (121), a communication module (122), a user interface module (123), and one or more applications (124).
  • An operating system (121) may include various software components and drivers to control and manage general system operations (e.g., memory management, storage device control, power management, etc.) and may support communication between various hardware, firmware, and software components.
  • embedded operating systems such as LINUX, UNIX, MAC OS, WINDOWS, VxWorks, etc.
  • general system operations e.g., memory management, storage device control, power management, etc.
  • general system operations e.g., memory management, storage device control, power management, etc.
  • the communication module (123) can support communication with other devices through the communication interface (110).
  • the communication module (120) can include various software components for processing data received by the wired communication port (111) or wireless circuit (112) of the communication interface (110).
  • the user interface module (123) can receive a user's request or input from a keyboard, touch screen, keyboard, mouse, microphone, etc. through an I/O interface (130) and provide a user interface on the display.
  • the application (124) may include a program or module configured to be executed by one or more processors (140).
  • the application for advertising service using instant output images may be implemented on a server farm.
  • the I/O interface (130) can connect at least one of input/output devices (not shown) of the photo shooting service providing device (100), such as a display, a keyboard, a touch screen, and a microphone, to the user interface module (123).
  • the I/O interface (130) can receive user input (e.g., voice input, keyboard input, touch input, etc.) together with the user interface module (123) and process a command according to the received input.
  • the processor (140) is connected to a communication interface (110), a memory (120), and an I/O interface (130) to control the overall operation of the photo shooting service providing device (100), and can perform various commands for performing a photo shooting service including an artificial intelligence-based content utilization function through an application or program stored in the memory (120).
  • the processor (140) may correspond to a computational device such as a CPU (Central Processing Unit) or an AP (Application Processor).
  • the processor (140) may be implemented in the form of an integrated chip (IC) such as a SoC (System on Chip) in which various computational devices are integrated.
  • the processor (140) may include a module for calculating an artificial neural network model such as an NPU (Neural Processing Unit).
  • FIG. 3 is a schematic flowchart of a method for providing a photo shooting service performed in a photo shooting service providing device according to one embodiment of the present invention.
  • the processor (140) may receive at least one instant output image from the photographing device (200) or the user device (300) (S110). Specifically, the processor (140) may determine whether participation in an advertising event is possible based on at least one of the identification data of the photographing device mapped to the instant output image, the date data for the shooting time, and the identification data of the user included in the corresponding image.
  • whether participation in the advertisement is possible may be understood as the result of determining whether an advertisement through the photo shooting service system (1000) is currently in progress, whether the provided instant output image was taken by another photographing device, or whether it is an instant output image taken a long time ago.
  • the processor (140) may determine whether an advertisement pose is included in a valid instant output image.
  • the processor (140) inputs the instant output image into a pose recognition model configured to output whether an advertisement pose is included by taking an image as input and determine whether an advertisement pose is included in the instant output image (S120).
  • the processor (140) can determine whether the user's posture or hand gesture in the instant output image is similar to the posture or hand gesture of the person in the advertisement content.
  • FIG. 4 is a schematic diagram for explaining a pose recognition model according to one embodiment of the present invention.
  • the processor (140) inputs an instant output image (12) into a pose recognition model (11-1) configured to output whether an image is input and includes an advertisement pose, thereby obtaining a probability value (13) indicating whether the user's pose matches one of a plurality of pre-designated advertisement poses.
  • the processor (140) can determine which advertisement pose the user's pose matches based on the probability value output from the pose recognition model (11-1).
  • the processor (140) can identify which advertising event the user wants to participate in at the time of receiving the instant output image. For example, the processor (140) can determine the type of advertising event based on the graphic object (14-1) included in the instant output image (14). As another example, the processor (140) can check whether a certain advertising event has been selected by the user in the advertising event participation request.
  • the processor (140) can input the instant output image (14) into a pose recognition model (11-2) configured to output whether an advertising pose is included by taking an image as input and obtain a probability (15) that the user's pose existing in the instant output image (14) corresponds to a predefined advertising pose.
  • the processor (140) can determine whether an instant output image matches an advertisement pose in specific advertisement content (15) by combining the probability value output through the pose recognition model (11-2) and the type of advertisement event previously identified.
  • the processor (140) may provide a reward to the photographing device (200) or the user device (300) (S130).
  • the reward may be points available for a photo shooting service.
  • the processor (140) may provide a coupon number or two-dimensional barcode that can provide a reward to the photographing device (200), or may provide a reward to a user account through an application or web page installed or executed on the user device (300).
  • the reward provided by the processor (140) may further include a secret frame, an event lottery ticket, etc.
  • the processor (140) may transmit a reward selection request to the photographing device (200) or the user device (300) to determine which reward to provide to the user among points, a secret frame, and an event lottery ticket. If the secret frame is selected as the reward, the processor (140) may provide an additional photographing service to the photographing device (200) or provide a coupon for using a paid photo frame to the user device (300).
  • the processor (140) may receive an advertisement event participation request from any one of the photographing devices (200) prior to receiving an instant output image.
  • the advertisement event participation request may be a participation request for any one of the advertisements or events
  • the processor (140) may provide a guideline for the advertisement event to the photographing device (200) according to the advertisement event participation request.
  • the processor (140) may receive an image that can be instantly output in real time from the photographing device (200).
  • the processor (140) may provide the photographing device (200) with a guideline for a full body exposure range for recognizing an advertisement pose, a rotation direction for each body part, a movement direction, and a size or direction change based on coordinates of body feature points.
  • the photographing device (200) can visually and audibly output guidelines such as 'Extend both arms diagonally upward', 'Rotate your body to the left', 'Make a V-shape with your index and middle fingers', and 'Put one arm against the wall' on the image being photographed.
  • these guidelines can be provided to all multiple users within the image being photographed by the photographing device (200).
  • the processor (140) can provide a probability value indicating whether an advertisement pose is included in an image that can be instantly output by the photographing device (200).
  • the processor (140) can provide a probability value indicating whether a pose of the user included in an instantly output image is similar to one advertisement pose selected by the user to the photographing device (200).
  • the processor (140) may identify content to be advertised based on the type of an advertising event included in an advertising event participation request from one of the photographing devices (200) prior to receiving an instant output image.
  • the processor (140) may provide preset text data or audio data for the identified advertising content to the photographing device (200). For example, if the identified advertising content is a music video, the chorus section may be provided to the photographing device (200) in the form of audio data, and in the case of a drama or movie, specific lines may be provided to the photographing device (200) in the form of text data.
  • the processor (140) may receive a plurality of instant output images composed of a plurality of frames.
  • the processor (140) may segment each of the plurality of instant output images, input the segmented plurality of instant output images into a pose recognition model, and determine whether an advertisement pose is included in each image.
  • the processor (140) may provide a reward if an advertisement pose matching an advertisement event participation request is included in at least one of the plurality of instant output images.
  • a photo shooting service providing device (100) according to one embodiment of the present invention has been described.
  • a photo shooting device (200) and a user device (300) in which such a photo shooting service is actually implemented will be described.
  • FIG. 5 is a block diagram showing the configuration of a photographing device including an artificial intelligence-based content utilization advertising function according to one embodiment of the present invention.
  • the photographing device (200) may include a communication interface (210), a memory (220), an I/O interface (230), and a processor (240), and each component may communicate with each other through one or more communication buses or signal lines.
  • the communication interface (210) can be connected to the photography service providing device (100) and the user device (300) via a wired/wireless communication network to exchange data.
  • the communication interface (210) can transmit an instant output image to the photography service providing device (100) and receive data indicating whether the instant output image includes an advertisement pose or a reward according to whether the instant output image includes an advertisement pose from the photography service providing device (100).
  • the communication interface (210) can receive user identification data from the user device (300) and transmit an instant output image or a reward according to whether the instant output image includes an advertisement pose to the user device (300).
  • the communication interface (210) that enables transmission and reception of such data includes a wired communication port (211) and a wireless circuit (212), wherein the wired communication port (211) may include one or more wired interfaces, for example, Ethernet, a universal serial bus (USB), FireWire, etc.
  • the wireless circuit (212) may transmit and receive data with an external device via an RF signal or an optical signal.
  • the wireless communication may use at least one of a plurality of communication standards, protocols, and technologies, for example, GSM, EDGE, CDMA, TDMA, Bluetooth, Wi-Fi, VoIP, Wi-MAX, or any other suitable communication protocol.
  • the memory (220) can store various data used in the photographing device (200).
  • the memory (220) can store identification data, user interface configuration data for performing an artificial intelligence-based content utilization advertising function.
  • the memory (220) can store a pose recognition model configured to input an image and output whether an advertising pose is included.
  • the memory (220) can store graphic objects for each advertising content that can be inserted into an instant output image, guidelines (images, audio, text, etc.) for taking an advertising pose, etc.
  • the graphic objects can include frames for each advertising content, human images, etc., and the frames can include text data such as a title of the advertising content, or image data such as a representative image representing the advertising content.
  • the memory (220) may include a volatile or nonvolatile storage medium capable of storing various data, commands, and information.
  • the memory (220) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., an SD or XD memory, etc.), a RAM, an SRAM, a ROM, an EEPROM, a PROM, a network storage storage, a cloud, and a blockchain database.
  • the memory (220) may store at least one configuration of an operating system (221), a communication module (222), a user interface module (223), one or more applications (224), a payment module (225), a camera module (226), and a photo printing module (227).
  • An operating system (221) may include various software components and drivers to control and manage general system operations (e.g., memory management, storage device control, power management, etc.) and may support communication between various hardware, firmware, and software components.
  • embedded operating systems such as LINUX, UNIX, MAC OS, WINDOWS, VxWorks, etc.
  • general system operations e.g., memory management, storage device control, power management, etc.
  • general system operations e.g., memory management, storage device control, power management, etc.
  • the communication module (223) can support communication with other devices through the communication interface (210).
  • the communication module (220) can include various software components for processing data received by the wired communication port (211) or wireless circuit (212) of the communication interface (210).
  • the user interface module (223) can receive a user's request or input from a keyboard, touch screen, keyboard, mouse, microphone, etc. through an I/O interface (230) and provide a user interface on the display (231).
  • the application (224) may include a program or module configured to be executed by one or more processors (240).
  • the application for capturing an instant output image and providing an advertising service using the same may be implemented on a server farm.
  • the payment module (225) can perform payment corresponding to a photo shooting service request according to a user's request or input obtained through the I/O interface (230).
  • the payment module (225) can perform contact or contactless payment.
  • the payment module (225) can perform payment using MST (Magnetic Secure Transmission), IC chip, NFC (Near Field Communication), RFID (Radio Frequency Identification), and EMV methods.
  • the payment module (225) can perform payment corresponding to a photo shooting service request through cash or a two-dimensional barcode.
  • the camera module (226) can capture instantaneous images and videos.
  • the camera module (226) can capture images or videos including a user through a light sensor (232) placed on the front of the photographing device (200), and the image being captured can be displayed on the display (231).
  • the photo printing module (227) can generate at least one image among a plurality of images captured by the camera module (226) according to a user's request or input obtained through the I/O interface (230), and can print the image through the printer (233).
  • the photo printing module (227) can generate an instant shooting image by combining a frame, background, and graphic object according to advertising content with an image or video captured by the camera module (226).
  • the photo printing module (227) can output an image code containing a link for downloading the instant shooting image from the user device (300) together with the instant shooting image.
  • the link can be understood as a web page provided by the photo shooting service providing device (100) or an application installation or execution link.
  • the I/O interface (230) can connect at least one of input/output devices (not shown) of the photographing device (200), such as a display (231), a keyboard, a touch screen, and a microphone, to the user interface module (223).
  • the I/O interface (230) can receive user input (e.g., voice input, keyboard input, touch input, etc.) together with the user interface module (223) and process commands (e.g., selecting an advertisement event, capturing an image, etc.) according to the received input.
  • the I/O interface (230) may include a display (231), a light sensor (232), and a printer (233).
  • the display (231) may display an image being captured by the camera module (226) and may detect a user's contact and movement or cessation of contact and movement using any one of a plurality of touch sensing technologies, such as capacitive, resistive, infrared, surface acoustic wave technology, proximity sensor array, etc.
  • the light sensor (232) may receive light from the surrounding environment projected through one or more lenses and convert the light into data representing the image. Accordingly, the light sensor (232) may capture a still image or video including the user.
  • the printer (233) may develop an instant capture image generated by the photo development module (227) into an actual photograph.
  • the processor (240) is connected to a communication interface (210), a memory (220), and an I/O interface (230) to control the overall operation of the photographing device (200), and can perform various commands for performing a photo shooting service including an artificial intelligence-based content utilization function through an application or program stored in the memory (220).
  • the processor (240) may correspond to a computational device such as a CPU (Central Processing Unit) or an AP (Application Processor).
  • the processor (240) may be implemented in the form of an integrated chip (IC) such as a SoC (System on Chip) in which various computational devices are integrated.
  • the processor (240) may include a module for calculating an artificial neural network model such as an NPU (Neural Processing Unit).
  • the processor (240) may obtain at least one image including a user's request for participation in an advertising event through the I/O interface (230). For example, the user's request for taking a photo and a request for participation in an event may be obtained through the display (231).
  • the processor (240) may display an image of the user obtained through the camera module (226) through the display (231), and may capture an image according to a user request to obtain an instant output image including the user.
  • the processor (240) may input an instant output image into a pose recognition model configured to output whether an advertisement pose is included by taking an image as input and determining whether an advertisement pose is included in the instant output image.
  • the processor (240) may provide a reward to a user matching the instant output image through the communication interface (210).
  • the processor (240) may provide an additional photo shooting service using a secret frame as a reward through the display (231), or provide points that can be used in a subsequent photo shooting service to the user account.
  • a photographing device (200) providing an AI-based content utilization function according to one embodiment of the present invention has been described.
  • a photographing device (200) providing a self-photography service can induce a user to take a specific pose related to an advertisement target, and when the pose is detected, provide the user with a corresponding reward, thereby inducing active participation of the user.
  • FIG. 6 is a schematic flowchart of a method for providing a photo shooting service performed in a photo shooting service system according to one embodiment of the present invention.
  • a method for providing a photo shooting service performed in a photo shooting service system is an embodiment of a method for providing a reward as soon as an instant output image is acquired through a shooting device (200).
  • the photo shooting service providing device (100) can provide an advertising event participation guideline to the shooting device (200) (S11).
  • the photo shooting service providing device (100) can output a music video included in an advertising event, or output a video including specific lines and poses as a guideline.
  • FIG. 7 is an exemplary diagram showing an interface screen of a photographing device that provides a photography service including a content utilization advertising function according to one embodiment of the present invention.
  • the photographing device (200) may receive a guide line (21) indicating an advertising pose matched to an advertising event from the photography service providing device (100) and display it through the display (231), and may display an image including an image of a user currently being photographed in an adjacent area (22).
  • the guide line (21) may be a music video or a dance video included in the advertising event.
  • the photographing device (200) may receive an object that can be inserted into an instant output image from the photography service providing device (100) and display it through the display (231).
  • the object may include a frame for each advertising content, a human image, etc.
  • the photographing device (200) may provide a guide text for changing a position and angle in the user's pose based on a real-time user image displayed on the display (231).
  • the photographing device (200) may display a plurality of advertising events currently in progress in the photo shooting service through the display (231).
  • the advertising events may include an event of imitating a unique pose of a character in a drama, an event of imitating a signature pose of a celebrity, an event of imitating an idol's choreography, etc.
  • the photographing device (200) can capture an instant output image (S12) and transmit the instant output image together with a request for participation in an advertising event to the photographing service providing device (100) (S13).
  • the photographing service providing device (100) can determine whether an advertising pose is included in the instant output image (S14). If an advertising pose is included, the photographing service providing device (100) can determine through which device the reward will be provided via the photographing device (200).
  • the photographing service providing device (100) can provide various types of rewards to the photographing device (200) or the user device (300) according to the user's selection via the photographing device (200) (S15).
  • FIG. 8 is a schematic flowchart of a method for providing a photo shooting service performed in a photo shooting service system according to another embodiment of the present invention.
  • a method for providing a photo shooting service performed in a photo shooting service system is an embodiment of a method for providing a reward based on an instant image provided by a user device (300).
  • a shooting device (200) can capture an instant output image and provide it to a user device (300) (S21).
  • the user device (300) can store the instant output image and transmit a request for participation in an advertising event including the instant output image to a photo shooting service providing device (100) (S22).
  • FIGS. 9a, 9b, 9c and 9d are exemplary diagrams showing an interface screen of a user device that provides a photo shooting service including a content utilization advertising function according to one embodiment of the present invention.
  • the user device (300) can install and execute an application provided by the photo shooting service providing device (100).
  • the interface screen executed on the user device (300) can include information (31) about a user account and an advertising event (32) in which the user can participate.
  • the user device (300) can display an interface screen including an area (33) in which an instant output image can be uploaded, as shown in FIG. 9b, and an instant output image (34) uploaded by the user can be displayed in one area.
  • the user selects the upload button (35) the user device (300) can transmit a request for participation in an advertising event including an instant output image to the photo shooting service providing device (100).
  • the photo shooting service providing device (100) can determine whether participation in an advertising event using an instant output image transmitted from a user device (300) is possible (S23). For example, the photo shooting service providing device (100) can determine whether the instant output image transmitted from the user device (300) was taken by another photographing device or whether it is an instant output image taken a long time ago. As a result of the determination, the photo shooting service providing device (100) can determine whether an advertising pose is included in the valid instant output image (S24). If an advertising pose is included, the photo shooting service providing device (100) can check what kind of reward will be provided through the user device (300). For example, as shown in FIG. 9d, the photo shooting service providing device (100) can provide points that can be used in a photo shooting service as a reward to the user device (300).
  • a photo shooting service system according to one embodiment of the present invention has been described.
  • a signature pose or choreography as an advertising point in various contents and incorporating it into a photo shooting service, the effect of active participation in an advertising event by users can be obtained, and advertising content can be imprinted.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • Accounting & Taxation (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Development Economics (AREA)
  • Marketing (AREA)
  • Finance (AREA)
  • Multimedia (AREA)
  • General Business, Economics & Management (AREA)
  • Primary Health Care (AREA)
  • Human Resources & Organizations (AREA)
  • Entrepreneurship & Innovation (AREA)
  • General Engineering & Computer Science (AREA)
  • Game Theory and Decision Science (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

La présente invention concerne un procédé mis en oeuvre par un processeur d'un appareil de fourniture de service de photographie, le procédé comprenant les étapes suivantes: la réception d'au moins une image de sortie instantanée selon une demande de participation à un événement de publicité provenant d'un dispositif de photographie ou d'un dispositif utilisateur; la détermination pour savoir si une pose de publicité est incluse dans l'image de sortie instantanée en entrant l'image de sortie instantanée dans un modèle de reconnaissance de pose configuré pour émettre en sortie si la pose de publicité est incluse en utilisant l'image en tant qu'entrée; et la fourniture d'une récompense au dispositif de photographie ou au dispositif utilisateur si la pose de publicité est incluse dans l'image de sortie instantanée.
PCT/KR2024/013828 2023-09-27 2024-09-11 Procédé et appareil pour fournir un service de photographie comprenant une fonction de publicité d'utilisation de contenu sur la base de l'intelligence artificielle Pending WO2025071085A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR10-2023-0130896 2023-09-27
KR20230130896 2023-09-27
KR1020240117657A KR20250047125A (ko) 2023-09-27 2024-08-30 인공지능 기반의 콘텐츠 활용 광고 기능을 포함한 사진 촬영 서비스 제공 방법 및 장치
KR10-2024-0117657 2024-08-30

Publications (1)

Publication Number Publication Date
WO2025071085A1 true WO2025071085A1 (fr) 2025-04-03

Family

ID=95203445

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2024/013828 Pending WO2025071085A1 (fr) 2023-09-27 2024-09-11 Procédé et appareil pour fournir un service de photographie comprenant une fonction de publicité d'utilisation de contenu sur la base de l'intelligence artificielle

Country Status (1)

Country Link
WO (1) WO2025071085A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110123088A (ko) * 2010-05-06 2011-11-14 엔에이치엔(주) 포즈 템플릿을 제공하는 촬영 장치 및 방법
KR20140135378A (ko) * 2013-05-16 2014-11-26 엘지전자 주식회사 휴대 단말기 및 그 제어 방법
KR20200128220A (ko) * 2019-04-18 2020-11-12 주식회사 픽업 인공지능을 이용한 성과 기반 콘텐츠 스타일 추천방법
KR102278680B1 (ko) * 2020-03-04 2021-07-16 안태욱 사진 포즈 제공 시스템, 방법, 및 컴퓨터로 판독가능한 기록매체
KR20220124928A (ko) * 2021-03-04 2022-09-14 김학웅 사진 인화 서비스 제공 장치 및 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110123088A (ko) * 2010-05-06 2011-11-14 엔에이치엔(주) 포즈 템플릿을 제공하는 촬영 장치 및 방법
KR20140135378A (ko) * 2013-05-16 2014-11-26 엘지전자 주식회사 휴대 단말기 및 그 제어 방법
KR20200128220A (ko) * 2019-04-18 2020-11-12 주식회사 픽업 인공지능을 이용한 성과 기반 콘텐츠 스타일 추천방법
KR102278680B1 (ko) * 2020-03-04 2021-07-16 안태욱 사진 포즈 제공 시스템, 방법, 및 컴퓨터로 판독가능한 기록매체
KR20220124928A (ko) * 2021-03-04 2022-09-14 김학웅 사진 인화 서비스 제공 장치 및 방법

Similar Documents

Publication Publication Date Title
WO2019156332A1 (fr) Dispositif de production de personnage d'intelligence artificielle pour réalité augmentée et système de service l'utilisant
US20100260373A1 (en) Mobile image-based information retrieval system
JP4569578B2 (ja) 画像転送システム、写真撮影プリント装置、画像保存サーバ、画像転送方法、および画像転送プログラム
US20160232402A1 (en) Methods and devices for querying and obtaining user identification
CN111601115B (zh) 一种视频检测的方法、相关装置、设备及存储介质
CN113052025B (zh) 图像融合模型的训练方法、图像融合方法及电子设备
EP3234747A1 (fr) Galerie de vidéos définie par rapport à une ligne de temps audio
CN111738769B (zh) 视频处理方法及装置
US9607094B2 (en) Information communication method and information communication apparatus
KR20110047398A (ko) 영상제공시스템 및 그 영상제공방법
CN111723746A (zh) 场景识别模型生成方法、系统、平台、设备及介质
CN109785229B (zh) 基于区块链实现的智能合影方法、装置、设备和介质
WO2014148691A1 (fr) Dispositif mobile et son procédé de commande
JP2008198135A (ja) 情報配信システム、情報配信装置および情報配信方法
WO2019066231A1 (fr) Génération d'image représentative
WO2016186325A1 (fr) Système et procédé de service de réseau social par image
JP2019118021A (ja) 撮影制御システム、撮影制御方法、プログラムおよび記録媒体
JP2018074281A (ja) 画像プリントシステム
WO2020231211A1 (fr) Procédé et système pour induire une participation à un événement
WO2020045909A1 (fr) Appareil et procédé pour logiciel intégré d'interface utilisateur pour sélection multiple et fonctionnement d'informations segmentées non consécutives
WO2025071085A1 (fr) Procédé et appareil pour fournir un service de photographie comprenant une fonction de publicité d'utilisation de contenu sur la base de l'intelligence artificielle
WO2025071084A1 (fr) Procédé et dispositif pour la fourniture d'un service de photographie comprenant une fonction de publicité d'utilisation d'expression basée sur l'intelligence artificielle
WO2017090949A1 (fr) Silhouette et système de transmission d'informations l'utilisant
WO2019172463A1 (fr) Procédé, système et support d'enregistrement non transitoire lisible par ordinateur pour recommander une photo d'un profil
WO2015147545A1 (fr) Procédé et système pour fournir à des utilisateurs d'un réseau social en ligne un support concernant l'activité hors ligne favorisant à la fois l'activité sociale en ligne et l'activité hors ligne, et support d'enregistrement lisible par ordinateur

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24872793

Country of ref document: EP

Kind code of ref document: A1