[go: up one dir, main page]

WO2011080639A1 - Système de reconnaissance d'images - Google Patents

Système de reconnaissance d'images Download PDF

Info

Publication number
WO2011080639A1
WO2011080639A1 PCT/IB2010/055719 IB2010055719W WO2011080639A1 WO 2011080639 A1 WO2011080639 A1 WO 2011080639A1 IB 2010055719 W IB2010055719 W IB 2010055719W WO 2011080639 A1 WO2011080639 A1 WO 2011080639A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
audio
access layer
recognition system
processor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2010/055719
Other languages
English (en)
Inventor
Mehmet Emin Ozgul
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Turkcell Teknoloji Arastirma Ve Gelistirme AS
Original Assignee
Turkcell Teknoloji Arastirma Ve Gelistirme AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Turkcell Teknoloji Arastirma Ve Gelistirme AS filed Critical Turkcell Teknoloji Arastirma Ve Gelistirme AS
Publication of WO2011080639A1 publication Critical patent/WO2011080639A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/17—Image acquisition using hand-held instruments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging

Definitions

  • the present invention relates to processing, recognition of images using video call becoming widespread by third generation networks and an image recognition system which is easy to use and enjoyable by taking actions depending on the image recognized.
  • Third generation networks is a name given to a version of GSM wireless communication systems and uses cellular network system. Wireless telephone calls, video calls, data transfer and many more applications in wide area are among services which are provided to mobile users in third generation networks. Third generation networks support synchronous talk and data service and higher data rates. Video call is another service started to be provided by third generation networks. Besides innovations brought by third generation networks, another improvement occurred on mobile devices and these devices got opportunities of camera, high-capability processors and storage. Upon softwares having these capabilities became widespread; an increase arose in number of image recognition applications too. Prior arts of the image recognition application are softwares which are installed into the mobile device and interactive service development media that do not have feature of image recognition and run upon keyboard, mouse and audio entries of the user are recognized.
  • the United States patent document no. US2009147990 discloses an image recognition system.
  • picture or video which is sent by a mobile device and comprises identification information, is sent to a processing and authentication server by means of a communication network.
  • the processing and authentication server searches contents such as symbol, logo or character which are included in the picture or video information that it has received and converts the contents it has found into a digital format.
  • Objective of the present invention is to realize an image recognition system which enables an image to be recognized by searching images such as symbol, logo, photo that are defined on the system from live images recorded by phone cameras, using capability of making video call provided in 3G phones.
  • Another objective of the present invention is to realize an image recognition system which enables a live image to be sent back to the mobile device by being enriched with data associated with the image recognized.
  • a further objective of the present invention is to realize an image recognition system which enables functions of sending SMS, MMS to the device or establishing communication with another device to be fulfilled.
  • Figure 1 is the schematic view of the image recognition system.
  • Figure 2 is the flowchart of the image recognition method.
  • the inventive image recognition system (1) essentially comprises: at least one mobile device (2); at least one access layer (3) which is in communication with the mobile device (2) and has call control component, audio and image access layer, audio and image transfer layer and network control component; at least one image processor (4) which consists of access layer input, picture decoder, symbol database and image mapper part; at least one response processor (5) which cooperates with the image processor (4) and at least one control unit (6) which regulates the communication between the response processor (5) and the image processor (4).
  • the said mobile device (2) is any mobile device which has capability of video call.
  • a transmitter mobile device (2) and a receiver mobile device (21 ) are used.
  • the access layer (3) has: call control component which detects the call sent by the mobile device (2), access layer which opens the related media channel, access layer which decodes the call, audio and image access layer which separates the call into its audio and image components, audio and image transfer layer which transfers the audio and the image to the related network component and network control component which controls the audio and image transfer layer.
  • the image processor (4) has components of: network access layer input which receives the audio and the image from the access layer (3), picture decoder which separates the audio and image information into its singular components, defined symbol database which contains defined patterns in itself, image mapper which searches for defined patterns within every picture decoded, video database which has videos, time signal which is a time signal generator, video player for playing video, network access layer output which transfers the obtained audio and image to the access layer (3).
  • the response processor (5) has components of other remote access which has capability of remote function call, journal record, messaging which sends e- mail/MMS/SMS, content enrichment which enriches content of the image recognized.
  • the symbol enrichment process of which has been completed is transferred to the image processor (4) by the control unit (6).
  • the inventive image recognition system (1) uses an image recognition method (100) comprising the steps of:
  • the access layer (3) consists of sublayers which use 3G (Third Generation) H.324m and TDM protocols.
  • video call is conveyed to the image processor (4) by ISUP (Integrated Services User Part) markup and switching system.
  • ISUP Integrated Services User Part
  • the ISUP defines setting up, terminating voice and data calls and processes thereof on circuit-switching networks.
  • the incoming ISUP call is received by the call control component in the ISUP access layer (3).
  • the media channel related to the incoming call is opened by the TDM (Time Division Multiplexing) access layer (3) and access to this channel is provided.
  • the call transmitted by the TDM access layer (3) is decoded by the H.324m access layer (3).
  • Audio and image carried in the call are separated into their components by the audio and image access layer (3).
  • the components of audio and image, which are accessed independently are transferred to the network component stated by the network transfer layer that is located in the audio and image access layer (3) controlled by the network control component in the access layer. If there is call, audio and image transfer from the access layer (3) towards the mobile device (2) these data are transmitted to the audio and image access layer by being received from the related network component via the network transfer layer which is controlled by the network control component located in the access layer (3) and located in the audio and image access layer (3).
  • the call, audio and image are separated into audio and image components thereof in the audio and image access layer (3).
  • the audio and the image can be accessed independently of time.
  • the audio and the image are transferred to the mobile device (21) by the access layer (3).
  • the audio and image information transmitted by the network layer (3) is received by the network access layer input located in the image processor (4).
  • the audio and image information received is separated into its singular components by the picture decoder in the image processor (4).
  • Defined patterns in the symbol database which is located in the image processor (4) are searched within every decoded picture. This search process is carried out by the image mapper which is located in the image processor (4). If one of the defined symbols exists in the picture being processed at that moment, a process which is stated in the record found in the symbol database that is owned by the image processor (4) is carried out with respect to this symbol. There is at least one process defined for each symbol in the symbol database.
  • a plurality of process is defined for a symbol these processes are carried out by the image processor (4) or transmitted to the response processor (5) so that the processes are carried in order of priorities.
  • the image processor (4) cooperates with the response processor (5).
  • a process comprises one of: other remote access, journal record, e-mail/MMS/SMS messaging or content enrichment processes these processes are carried out by interaction of the response processor (5).
  • Communication between the response processor (5) and the image processor (4) is provided by the communication control unit (6).
  • the response processor (5) can enable a component located outside the system to decide how the process will be continued, by means of remote access component.
  • methods of remote function call such as web service/CORBA (Common Object Request Broker Architecture) are used as remote access component.
  • Function to be fulfilled as a result of the decision given is transferred to the image processor (4) by the control unit (6). If there is process of determining the video to be shown to the user regarding the symbol recognized in the symbol database, this video is searched in the video database located in the image processor (4) and it is accessed.
  • the video accessed is transmitted to the component of network access layer output located in the image processor (4) in accordance with the time signal generated by the time signal generator located in the image processor (4), by the video player located in the image processor (4).
  • the network access layer output transmits these audio and video packages to the audio and video transfer layer.
  • Audio and image received by the network access layer output are transmitted to the audio and image access layer.
  • the audio and the image are separated into audio and image components thereof in the access layer.
  • the audio and image access layer transmits the audio and image information to the access layer (3) with an appropriate timing.
  • the audio and image information is transferred to the mobile device (21) making video call by the access layer (3).
  • the symbol content enrichment process of which has been completed is transferred to the image processor (4) by the control unit (6).
  • the video player transmits the content to the network access layer output by embedding it onto live images that it received from the picture decoder.
  • the network access layer output transmits these audio and video packages to the audio and video transfer layer.
  • the audio and the image are separated into audio and image components thereof in the access layer. Thus, the audio and the image can be accessed independently of time.
  • the audio and image access layer transmits the audio and image information to the access layer with an appropriate timing.
  • the audio and image information is transferred to the mobile device (21) making video call by the access layer (3). If a process of connection to another device is defined regarding the symbol recognized in the defined symbol database, the image processor (4) enables to make call towards the mobile device (21) by warning the access layer (3) with the address of the mobile device (21) to be connected via the control unit (6). If one of the mobile devices (2 and 21) terminates the call both calls and related sources are cleaned.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Telephonic Communication Services (AREA)
  • Telephone Function (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

La présente invention concerne un système de reconnaissance d'images (1) qui réalise un système de reconnaissance d'images permettant la reconnaissance d'une image par la recherche d'images telles qu'un symbole, un logo, une photo définies sur le système à partir d'images réelles enregistrées par des caméras de téléphone, au moyen d'une capacité de réalisation d'appel vidéo fournie dans des téléphones 3G ; et active des fonctions de retransmission d'une image réelle vers le dispositif mobile enrichie de données associées à l'image reconnue et la transmission de message texte, de message multimédia vers le dispositif ou la réalisation d'établissement de communications avec un autre dispositif.
PCT/IB2010/055719 2009-12-31 2010-12-10 Système de reconnaissance d'images Ceased WO2011080639A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TR2009/10111A TR200910111A2 (tr) 2009-12-31 2009-12-31 Bir görüntü tanıma sistemi
TR2009/10111 2009-12-31

Publications (1)

Publication Number Publication Date
WO2011080639A1 true WO2011080639A1 (fr) 2011-07-07

Family

ID=43821900

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2010/055719 Ceased WO2011080639A1 (fr) 2009-12-31 2010-12-10 Système de reconnaissance d'images

Country Status (2)

Country Link
TR (1) TR200910111A2 (fr)
WO (1) WO2011080639A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104978586A (zh) * 2015-06-29 2015-10-14 百度在线网络技术（北京）有限公司 商标识别方法和装置
US9317913B2 (en) 2011-12-21 2016-04-19 Sca Hygiene Products Ab Method for measuring the absorption of fluid in an absorbent product
US9402771B2 (en) 2011-12-21 2016-08-02 Sca Hygiene Products Ab Method and computer program for monitoring use of an absorbent product
US9931252B2 (en) 2011-12-21 2018-04-03 Sca Hygiene Products Ab Method and computer program for monitoring use of an absorbent product

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003041000A1 (fr) * 2001-11-05 2003-05-15 Evryx Technologies Saisie d'image, système et procédé d'identification
US20060182311A1 (en) * 2005-02-15 2006-08-17 Dvpv, Ltd. System and method of user interface and data entry from a video call
US20090147990A1 (en) 2004-12-06 2009-06-11 Dspv. Ltd. System and Method of Generic Symbol Recognition and User Authentication Using a Communication Device with Imaging Capabilities
US20090298517A1 (en) * 2008-05-30 2009-12-03 Carl Johan Freer Augmented reality platform and method using logo recognition

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003041000A1 (fr) * 2001-11-05 2003-05-15 Evryx Technologies Saisie d'image, système et procédé d'identification
US20090147990A1 (en) 2004-12-06 2009-06-11 Dspv. Ltd. System and Method of Generic Symbol Recognition and User Authentication Using a Communication Device with Imaging Capabilities
US20060182311A1 (en) * 2005-02-15 2006-08-17 Dvpv, Ltd. System and method of user interface and data entry from a video call
US20090298517A1 (en) * 2008-05-30 2009-12-03 Carl Johan Freer Augmented reality platform and method using logo recognition

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9317913B2 (en) 2011-12-21 2016-04-19 Sca Hygiene Products Ab Method for measuring the absorption of fluid in an absorbent product
US9402771B2 (en) 2011-12-21 2016-08-02 Sca Hygiene Products Ab Method and computer program for monitoring use of an absorbent product
US9931252B2 (en) 2011-12-21 2018-04-03 Sca Hygiene Products Ab Method and computer program for monitoring use of an absorbent product
CN104978586A (zh) * 2015-06-29 2015-10-14 百度在线网络技术（北京）有限公司 商标识别方法和装置

Also Published As

Publication number Publication date
TR200910111A2 (tr) 2011-07-21

Similar Documents

Publication Publication Date Title
US12231473B2 (en) Call processing system and call processing method
US8339437B2 (en) Video communication method, video communication system and integrated media resource server
CN103765850B (zh) 用于将多媒体内容关联至通信的方法和装置
EP1860841B1 (fr) Procédé et système pour remplacer la diffusion multimédia dans un procédé de communication d'un terminal
CN101675639A (zh) 用于向用户设备提供辅助信息的方法、系统和用户设备
KR20120018708A (ko) 커뮤니케이션 서비스 수행 도중 멀티미디어 콘텐츠 제공 방법 및 시스템
WO2011080639A1 (fr) Système de reconnaissance d'images
RU2438246C2 (ru) Усовершенствованная передача по сети
JP4190946B2 (ja) 複合コンテンツ同期配信方法、サーバ及びプログラム
CN103023880B (zh) 视频通信业务与dlna业务融合的装置及方法
CN102984596B (zh) 视频通信业务与iptv业务融合的装置及方法
JP5802116B2 (ja) データ共有機能を有した通話システム
US20070232286A1 (en) Apparatus and method for storing/calling telephone number in mobile terminal
CN105519148B (zh) 主叫方控制被叫铃声转换输出系统及其方法
CN100591172C (zh) 监控手机及其远程监控方法
US20070072648A1 (en) Method and apparatus for identifying a calling party
JP2010525627A (ja) エンドユーザの端末システムにおけるデータベース更新を通知するための方法および装置
CN101110786B (zh) 一种基于软交换网络实现的统一消息系统
KR100593989B1 (ko) 휴대용 단말기의 동영상 표시방법
JP2009130644A (ja) 通信装置、通信方法、プログラム、および記憶媒体
CN118233438B (zh) 综合实时音视频多媒体通信平台、系统、管理系统及介质
US9641672B2 (en) Multimedia communication
KR101423827B1 (ko) 선호 컨텐츠와 관련된 정보에 기초하여 모바일 보이스 오버 인터넷 프로토콜 서비스를 제공하는 ｍＶｏＩＰ 서버 및 어플리케이션의 동작 방법
RU2431942C2 (ru) Способ, система и устройство для реализации преобразования между сигналом обратного вызова и звонком вызова
CN108984190B (zh) 一种数据处理方法、装置和电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10810921

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10810921

Country of ref document: EP

Kind code of ref document: A1