CN105916029A - Audio playing control equipment, video display equipment and audio and video playing system - Google Patents
Audio playing control equipment, video display equipment and audio and video playing system Download PDFInfo
- Publication number
- CN105916029A CN105916029A CN201510958715.2A CN201510958715A CN105916029A CN 105916029 A CN105916029 A CN 105916029A CN 201510958715 A CN201510958715 A CN 201510958715A CN 105916029 A CN105916029 A CN 105916029A
- Authority
- CN
- China
- Prior art keywords
- audio
- video
- video signal
- signal
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/458—Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/458—Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations
- H04N21/4586—Content update operation triggered locally, e.g. by comparing the version of software modules in a DVB carousel to the version stored locally
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
- G06F8/65—Updates
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本申请实施例提供音频播放的控制设备、视频显示设备及播放系统,所述系统包括主体部分和显示设备,所述主体部分包括电连接的主处理器与音频设备,所述主处理器接收第一音视频信号,将所述第一音视频信号中的第一音频信号转换并发送至所述音频设备进行播放;所述主体部分与所述显示设备通过自定义接口连接,将所述第一音视频信号中的第一视频信号转换并发送至所述显示设备进行显示音视频播放系统。
The embodiment of the present application provides an audio playback control device, a video display device, and a playback system. The system includes a main part and a display device. The main part includes a main processor electrically connected to an audio device, and the main processor receives the first An audio and video signal, converting the first audio signal in the first audio and video signal and sending it to the audio device for playback; the main part is connected to the display device through a custom interface, and the first The first video signal among the audio and video signals is converted and sent to the display device for display by the audio and video playback system.
Description
技术领域technical field
本申请实施例涉及音视频技术领域,尤其涉及音频播放的控制设备、视频显示设备及音视频播放系统。The embodiments of the present application relate to the field of audio and video technologies, and in particular, to an audio playback control device, a video display device, and an audio and video playback system.
背景技术Background technique
音视频播放系统(例如智能电视)是基于互联网浪潮冲击形成的新产品,其目的是带给用户更便捷的体验,目前已经成为电视的潮流趋势。智能电视,是具有全开放式平台,搭载了操作系统,用户在欣赏普通电视内容的同时,可自行安装和卸载各类应用软件,持续对功能进行扩充和升级的新电视产品。智能电视能够不断给用户带来有别于,使用有线数字电视接收机(机顶盒)的、丰富的个性化体验。The audio and video playback system (such as smart TV) is a new product based on the impact of the Internet wave. Its purpose is to bring users a more convenient experience, and it has become the trend of TV at present. Smart TV is a new TV product with a fully open platform and equipped with an operating system. Users can install and uninstall various application software by themselves while enjoying ordinary TV content, and continuously expand and upgrade functions. Smart TVs can continue to bring users rich and personalized experiences that are different from those using cable digital TV receivers (set-top boxes).
在国内,各大彩电巨头也早已经开始了对智能电视的探索。另外智能电视盒生产厂家也紧随其后,以电视盒搭载安卓系统的方式来实现电视智能化提升。In China, major color TV giants have already begun to explore smart TVs. In addition, smart TV box manufacturers are also following closely behind, and realize the improvement of TV intelligence by installing the Android system on the TV box.
而且智能电视拥有传统电视厂商所不具备的应用平台优势。连接网络后,能提供IE浏览器、全高清3D体感游戏、视频通话、家庭KTV以及教育在线等多种娱乐、资讯、学习资源,并可以无限拓展,还能分别支持组织与个人、专业和业余软件爱好者自主开发、共同分享数以万计的实用功能软件。它将实现网络搜索、IP电视、视频点播(VOD)、数字音乐、网络新闻、网络视频电话等各种应用服务。用户可以搜索电视频道和网站,录制电视节目,能够播放卫星和有线电视节目以及网络视频。智能电视将为广大用户打造一个可加载无限的内容、无限的应用的开放的系统平台,并可以根据自身需要进行个性化安装,使电视永不过时。Moreover, smart TVs have application platform advantages that traditional TV manufacturers do not have. After connecting to the network, it can provide various entertainment, information and learning resources such as IE browser, full HD 3D somatosensory games, video calls, family KTV and online education, and can be expanded infinitely. It can also support organizations and individuals, professional and amateur respectively Software enthusiasts independently develop and share tens of thousands of practical software. It will realize various application services such as network search, IP TV, video on demand (VOD), digital music, network news, and network video calls. Users can search for TV channels and websites, record TV programs, and can play satellite and cable TV programs as well as Internet videos. Smart TV will create an open system platform that can load unlimited content and unlimited applications for the majority of users, and can be personalized and installed according to their own needs, so that the TV will never be outdated.
目前已上市的智能3D电视使用的智能系统可大体分为三类:Androi d、Windows及企业自建系统。对于搭载操作系统的智能视频设备,无论采用何种系统,在线软件升级已经成了普遍的应用。如,几年前使用安卓2.0的系统,目前已经升级到5.0或更高。软件系统升级和硬件系统是密切相关的,当初满足安卓2.0的硬件系统,对于安卓5.0已经不适合。此时要进行软件升级就必须更换硬件。The smart systems used by smart 3D TVs currently on the market can be roughly divided into three categories: Android, Windows and self-built systems by enterprises. For smart video devices equipped with operating systems, no matter what kind of system is used, online software upgrades have become a common application. For example, a system that used Android 2.0 a few years ago has been upgraded to 5.0 or higher. The software system upgrade is closely related to the hardware system. The hardware system that met Android 2.0 at the beginning is no longer suitable for Android 5.0. To upgrade the software at this time, the hardware must be replaced.
图1是现有技术的音视频播放系统结构示意图。根据图1所示,外接的音视频信号,如HDMI信号传送至处理器,处理器对信号处理之后将视频信号传送至显示屏显示,处理器对信号处理之后将音频信号传送至音频模块,同时主处理器还对显示屏进行控制,此外,该音视频播放系统包括以太网接口,WIFI以及蓝牙接口,内置有存储器模块,电源管理模块等。现有技术的音视频播放系统处理器和显示屏是一体的,因此不方便对处理器单独升级。FIG. 1 is a schematic structural diagram of an audio and video playback system in the prior art. As shown in Figure 1, external audio and video signals, such as HDMI signals, are sent to the processor, and the processor sends the video signal to the display screen after processing the signal, and the processor sends the audio signal to the audio module after processing the signal. The main processor also controls the display screen. In addition, the audio and video playback system includes Ethernet interface, WIFI and Bluetooth interface, built-in memory module, power management module and so on. In the prior art, the processor and the display screen of the audio and video playback system are integrated, so it is inconvenient to upgrade the processor separately.
现有技术中智能视频系统方案处理器的主板和显示设备一般是组装成一体,如果想对系统硬件升级需要拆装外壳才能取出内部主板进行更换,操作复杂,升级成本较高。而单纯的更换整机成本又比较昂贵。In the prior art, the motherboard and the display device of the intelligent video system solution processor are generally assembled into one body. If you want to upgrade the system hardware, you need to disassemble the shell to take out the internal motherboard for replacement. The operation is complicated and the upgrade cost is high. And the cost of simply replacing the whole machine is relatively expensive.
发明内容Contents of the invention
本申请实施例提供音频播放的控制设备、视频显示设备及音视频播放系统,用以解决现有技术中对硬件系统升级困难或者成本高的问题。Embodiments of the present application provide an audio playback control device, a video display device, and an audio and video playback system, so as to solve the problem of difficulty or high cost in hardware system upgrades in the prior art.
本申请提供一种音频播放的控制设备,包括:电连接的主处理器与音频设备,所述主处理器接收第一音视频信号,将所述第一音视频信号中的第一音频信号转换并发送至所述音频设备进行播放;The present application provides an audio playback control device, including: a main processor electrically connected to an audio device, the main processor receives a first audio and video signal, and converts the first audio signal in the first audio and video signal and sent to the audio device for playback;
所述主处理器与显示设备通过自定义接口连接,将所述第一音视频信号中的第一视频信号转换并发送至所述显示设备进行显示。The main processor is connected to the display device through a custom interface, and converts the first video signal in the first audio-video signal and sends it to the display device for display.
本申请还提供一种视频显示设备,所述视频显示设备通过自定义接口与主体部分连接,接收并显示主体设备根据接收的第一音视频信号进行处理获得的第一视频信号,并将所述第一视频信号进行处理与显示。The present application also provides a video display device, the video display device is connected to the main part through a custom interface, receives and displays the first video signal obtained by the main device according to the received first audio and video signal processing, and the The first video signal is processed and displayed.
本申请还提供一种音视频播放系统,包括主体部分和显示设备,The present application also provides an audio and video playback system, including a main part and a display device,
所述主体部分包括电连接的主处理器与音频设备,所述主处理器接收第一音视频信号,将所述第一音视频信号中的第一音频信号转换并发送至所述音频设备进行播放;The main part includes an electrically connected main processor and audio equipment, the main processor receives the first audio and video signal, converts the first audio signal in the first audio and video signal and sends it to the audio equipment for further processing. play;
所述主体部分与所述显示设备通过自定义接口连接,将所述第一音视频信号中的第一视频信号转换并发送至所述显示设备进行显示。The main body part is connected to the display device through a custom interface, and the first video signal in the first audio and video signal is converted and sent to the display device for display.
音视频播放系统音视频播放系统本申请实施例提供的音视频播放系统的主处理器和音频设备构成了该音视频播放系统的主体部分,主处理器能够将接收的音视频信号转换发送给音频设备,从而能够独立播放音频。因此,本申请对主处理器进行升级处理时,仅需对主体部分进行升级处理,减少了显示设备进行升级处理的硬件成本。并且,本申请显示设备可以连接不同的主体部分,使用更加灵活。Audio and video playback system Audio and video playback system The main processor and audio equipment of the audio and video playback system provided in the embodiment of this application constitute the main part of the audio and video playback system. The main processor can convert the received audio and video signals and send them to the audio device, enabling independent audio playback. Therefore, when the main processor is upgraded in the present application, only the main part needs to be upgraded, which reduces the hardware cost of the display device for upgrading. Moreover, the display device of the present application can be connected to different main parts, making the use more flexible.
附图说明Description of drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are some embodiments of the present application. Those skilled in the art can also obtain other drawings based on these drawings without creative work.
图1为现有技术中音视频播放系统结构示意图;Fig. 1 is the structural representation of audio-video playback system in the prior art;
图2为本申请一种音频播放的控制设备一实施例的结构示意图;FIG. 2 is a schematic structural diagram of an embodiment of an audio playback control device of the present application;
图3为本申请一种音频播放的控制设备另一实施例的结构示意图;FIG. 3 is a schematic structural diagram of another embodiment of an audio playback control device of the present application;
图4为本申请一种视频显示设备一实施例的结构示意图;FIG. 4 is a schematic structural diagram of an embodiment of a video display device of the present application;
图5为本申请一种视频显示设备另一实施例的结构示意图;FIG. 5 is a schematic structural diagram of another embodiment of a video display device of the present application;
图6为本申请一种视频显示设备再一实施例的结构示意图;FIG. 6 is a schematic structural diagram of another embodiment of a video display device of the present application;
图7为本申请音视频播放系统结构示意图。FIG. 7 is a schematic structural diagram of the audio and video playback system of the present application.
具体实施方式detailed description
为使本申请实施例的目的、技术方案和优点更加清楚,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.
参见图2,本申请实施例提供一种音频播放的控制设备,包括:电连接的主处理器21与音频设备22音视频播放系统。Referring to FIG. 2 , the embodiment of the present application provides an audio playback control device, including: an electrically connected main processor 21 and an audio device 22 audio and video playback system.
在本申请实施例中,音视频播放系统所述音频设备22可以是但并不局限于音视频播放系统音箱。In the embodiment of the present application, the audio device 22 in the audio and video playback system may be, but is not limited to, a speaker in the audio and video playback system.
所述主处理器21接收第一音视频信号,将所述第一音视频信号中的第一音频信号转换并发送至所述音频设备22进行播放。The main processor 21 receives the first audio-video signal, converts the first audio signal in the first audio-video signal and sends it to the audio device 22 for playback.
具体的,所述主处理器21将所述第一音频信号转换为I2S信号,并发送至所述音频设备22进行播放。Specifically, the main processor 21 converts the first audio signal into an I2S signal, and sends it to the audio device 22 for playback.
所述主处理器21与所述显示设备22通过自定义接口连接,将所述第一音视频信号中的第一视频信号转换并发送至显示设备进行显示。The main processor 21 is connected to the display device 22 through a custom interface, and converts the first video signal in the first audio and video signals and sends it to the display device for display.
具体的,所述主处理器21将所述第一视频信号转换为HDMI格式数据,发送至所述显示设备。Specifically, the main processor 21 converts the first video signal into HDMI format data and sends it to the display device.
本申请实施例中,第一音视频数据输入到本申请音频播放的控制设备时,第一音视频数据中的第一音频数据直接由本申请中的主处理器21进行处理,并由主处理器21发送至音视频播放系统音频设备22进行播放音视频播放系统。从而,本申请能够独立对接收的音视频数据中的音频数据进行播放。In the embodiment of the present application, when the first audio-video data is input to the control device for audio playback of the present application, the first audio data in the first audio-video data is directly processed by the main processor 21 in the present application, and the main processor 21 is sent to the audio and video playback system audio equipment 22 to play the audio and video playback system. Therefore, the present application can independently play the audio data in the received audio and video data.
本申请实施例中,第一音视频数据输入到本申请音频播放的控制设备时,第一音视频数据中的第一视频数据直接由本申请音频播放的控制设备中的主处理器21进行处理,然后发送至显示设备22进行显示。In the embodiment of the present application, when the first audio-video data is input to the control device for audio playback of the present application, the first video data in the first audio-video data is directly processed by the main processor 21 in the control device for audio playback of the present application, Then it is sent to the display device 22 for display.
本申请主处理器需要进行升级处理时,仅需对本申请进行升级处理即可,无需对本申请连接的显示设备进行升级,降低了主处理器升级处理的硬件成本。并且,本申请显示设备可以连接不同的音频播放的控制设备,令显示设备22的使用更加灵活。When the main processor of the present application needs to be upgraded, only the present application needs to be upgraded, and the display device connected to the present application does not need to be upgraded, which reduces the hardware cost of the main processor upgrade. Moreover, the display device of the present application can be connected to different audio playback control devices, making the use of the display device 22 more flexible.
在本申请另一个实施例中,参见图3,本申请还包括:In another embodiment of the present application, referring to Fig. 3, the present application also includes:
音频格式转换桥片23,用于接收所述显示设备通过所述自定义接口发送的第二音频信号,并将转化后的第二音频信号发送至所述主处理器21,所述主处理器21将所述第二音频信号发送至所述音频设备22进行播放。The audio format conversion bridge 23 is used to receive the second audio signal sent by the display device through the custom interface, and send the converted second audio signal to the main processor 21, and the main processor 21 Send the second audio signal to the audio device 22 for playing.
具体的,所述音频格式转换桥片23为SPD IF转I2S芯片,将接收的SPD IF格式音频数据转变为I2S格式音频数据,并将转化后的I2S格式音频数据发送至所述主处理器21,所述主处理器21将所述I2S格式音频数据发送至所述音频设备22进行播放。Specifically, the audio format conversion bridge 23 is an SPD IF to I2S chip, which converts the received SPD IF format audio data into I2S format audio data, and sends the converted I2S format audio data to the main processor 21 , the main processor 21 sends the I2S format audio data to the audio device 22 for playing.
本申请实施例中,第二音视频数据输入到所述显示设备时,所述显示设备将接收的第二音视频数据中的第二音频数据发送至本申请所述音频格式转换桥片23。所述音频格式转换桥片23对接收的第二音频数据进行格式转换后发送至所述主处理器21。In the embodiment of the present application, when the second audio and video data is input to the display device, the display device sends the second audio data in the received second audio and video data to the audio format conversion bridge 23 of the present application. The audio format conversion bridge 23 performs format conversion on the received second audio data and sends it to the main processor 21 .
所述第二音频数据由本申请主处理器21进行处理,并由主处理器21发送至音频设备22进行播放。因此,本申请能够对显示设备传送的音频数据进行播放。The second audio data is processed by the main processor 21 of the present application, and sent to the audio device 22 by the main processor 21 for playback. Therefore, the present application can play the audio data transmitted by the display device.
本申请实施例中,第二音视频数据输入到所述显示设备时,第二音视频数据中的第二视频数据直接由显示设备进行处理与显示。In the embodiment of the present application, when the second audio and video data is input to the display device, the second video data in the second audio and video data is directly processed and displayed by the display device.
在本申请又一个实施例中,所述主处理器21还用于根据接收的输入指令,将屏幕菜单式调节方式数据转换为第三视频信号发送至所述显示设备。In yet another embodiment of the present application, the main processor 21 is further configured to convert the screen menu adjustment mode data into a third video signal and send it to the display device according to the received input instruction.
本申请实施例中,当用户按动遥控器或按键对本申请进行控制时,由本申请所述主处理器21将根据用户输入指令生成的屏幕菜单式调节方式数据(OSD数据)转换为第三视频数据,具体为HDMI格式数据,输出至显示设备进行处理与显示。In the embodiment of the application, when the user presses the remote control or the button to control the application, the main processor 21 of the application converts the screen menu adjustment mode data (OSD data) generated according to the user input instruction into a third video The data, specifically HDMI format data, is output to a display device for processing and display.
参见图4,本申请还提供一种视频显示设备,所述视频显示设备41通过自定义接口与主体部分连接,接收并显示主体设备根据接收的第一音视频信号进行处理获得的第一视频信号,并将所述第一视频信号进行处理与显示。Referring to Fig. 4, the present application also provides a video display device, the video display device 41 is connected to the main part through a custom interface, receives and displays the first video signal obtained by the main device according to the received first audio and video signal processing , and process and display the first video signal.
在本申请实施例中,所述视频显示设备可以是但并不局限于电视机。In the embodiment of the present application, the video display device may be, but is not limited to, a television.
本申请所述视频显示设备与所述主体部分连接,主处理器设置于主体部分。主处理器需要进行升级处理时,仅需对主体部分进行升级处理即可,无需对本申请进行升级,降低了主处理器升级处理的硬件成本。并且,本申请可以连接不同的主体部分,令本申请的使用更加灵活。The video display device described in this application is connected to the main body, and the main processor is arranged on the main body. When the main processor needs to be upgraded, only the main part needs to be upgraded, and the application does not need to be upgraded, which reduces the hardware cost of the main processor upgrade. Moreover, the application can be connected with different main parts, making the use of the application more flexible.
在本申请又一个实施例中,参见图5,所述视频显示设备41包括:视频处理器411、视频格式转换桥片412、运动补偿帧率转换器413以及显示屏414。In yet another embodiment of the present application, referring to FIG. 5 , the video display device 41 includes: a video processor 411 , a video format conversion bridge 412 , a motion compensation frame rate converter 413 and a display screen 414 .
本申请实施例中,第一音视频数据输入到主体部分时,第一音视频数据中的第一视频数据直接由主体部分中的主处理器进行处理,然后发送至本申请进行处理与显示。In this embodiment of the application, when the first audio and video data is input to the main body, the first video data in the first audio and video data is directly processed by the main processor in the main body, and then sent to the application for processing and display.
所述视频处理器411接收所述第一视频信号,并将处理后的第一视频信号发送至所述视频格式转换桥片412,所述视频格式转换桥片412将转换获得的数据发送至所述运动补偿帧率转换器413进行帧率转换及运动补偿处理,所述帧率转换及运动补偿处理后的数据通过所述显示屏414进行播放。The video processor 411 receives the first video signal, and sends the processed first video signal to the video format conversion bridge 412, and the video format conversion bridge 412 sends the converted data to the The motion compensation frame rate converter 413 performs frame rate conversion and motion compensation processing, and the data after the frame rate conversion and motion compensation processing is played through the display screen 414 .
具体的,所述视频格式转换桥片412将接收的HDMI格式第一视频信号转化为V-by-One格式视频数据。所述视频格式转换桥片412输出的V-by-One格式视频数据进行帧率转换转变为高帧率视频数据及运动补偿处理,并以V-by-One格式视频数据送给显示屏414播放。Specifically, the video format conversion bridge 412 converts the received first video signal in HDMI format into video data in V-by-One format. The V-by-One format video data output by the video format conversion bridge 412 performs frame rate conversion into high frame rate video data and motion compensation processing, and sends the V-by-One format video data to the display screen 414 for playback .
在本申请又一个实施例中,参见图6,所述视频显示设备还包括视频信号多路输入开关模块415。In yet another embodiment of the present application, referring to FIG. 6 , the video display device further includes a video signal multiple input switch module 415 .
第二音视频数据输入到本申请视频显示设备时,所述视频信号多路输入开关模块415用以接收第二音视频信号,并向视频格式转换桥片412发送所述第二音视频信号,所述视频格式转换桥片412将所述第二音视频信号中的第二视频信号发送至所述运动补偿帧率转换器413进行帧率转换及运动补偿处理,所述帧率转换及运动补偿处理后的数据通过所述显示屏414进行播放。When the second audio and video data is input to the video display device of the present application, the video signal multi-channel input switch module 415 is used to receive the second audio and video signal, and send the second audio and video signal to the video format conversion bridge 412, The video format conversion bridge 412 sends the second video signal in the second audio and video signal to the motion compensation frame rate converter 413 for frame rate conversion and motion compensation processing, the frame rate conversion and motion compensation The processed data is played through the display screen 414 .
具体的,所述视频格式转换桥片412将接收的HDMI格式第一视频信号转化为V-by-One格式视频数据。所述视频格式转换桥片412输出的V-by-One格式视频数据进行帧率转换转变为高帧率视频数据及运动补偿处理,并以V-by-One格式视频数据送给显示屏414播放。Specifically, the video format conversion bridge 412 converts the received first video signal in HDMI format into video data in V-by-One format. The V-by-One format video data output by the video format conversion bridge 412 performs frame rate conversion into high frame rate video data and motion compensation processing, and sends the V-by-One format video data to the display screen 414 for playback .
因此,第二音视频数据输入到本申请视频显示设备时,第二音视频数据中的第二视频数据直接由显示设备进行处理与显示。Therefore, when the second audio and video data is input to the video display device of the present application, the second video data in the second audio and video data is directly processed and displayed by the display device.
在本申请又一个实施例中,所述视频格式转换桥片412将所述第二音视频信号中的第二音频信号通过所述自定义接口发送至所述主体部分。In yet another embodiment of the present application, the video format conversion bridge 412 sends the second audio signal in the second audio-video signal to the main body through the self-defined interface.
第二音视频数据输入到本申请视频显示设备时,所述视频格式转换桥片412输出SPD IF格式第二音频数据,通过所述自定义接口发送给所述主体部分。When the second audio and video data is input to the video display device of this application, the video format conversion bridge 412 outputs the second audio data in SPD IF format, and sends it to the main part through the self-defined interface.
在本申请又一个实施例中,所述视频处理器411接收所述第三视频信号,并将格式转换后的数据发送至所述运动补偿帧率转换器413,所述运动补偿帧率转换器将处理后的数据与所述第二视频信号处理后的数据进行叠加与格式转换后,通过所述显示屏414进行显示。In yet another embodiment of the present application, the video processor 411 receives the third video signal, and sends the format-converted data to the motion compensation frame rate converter 413, and the motion compensation frame rate converter The processed data and the processed data of the second video signal are superimposed and format-converted, and then displayed on the display screen 414 .
本申请实施例中,当用户按动遥控器或按键对所述主体部分进行控制时,由所述主体部分的主处理器将根据用户输入指令生成的屏幕菜单式调节方式数据(OSD数据)转换为HDMI格式的第三视频数据输出至本申请视频处理器411。视频处理器411把HDMI格式的第三视频数据转变为LVDS格式数据,送给运动补偿帧率转换器413,OSD数据和第二视频信号进行处理后的数据在运动补偿帧率转换器413中叠加,并转变为V-by-One格式数据送到显示屏414播放。In the embodiment of the present application, when the user presses the remote control or the button to control the main part, the main processor of the main part converts the screen menu adjustment mode data (OSD data) generated according to the user input instruction to The third video data in HDMI format is output to the video processor 411 of the present application. The video processor 411 converts the third video data in the HDMI format into LVDS format data, and sends it to the motion compensation frame rate converter 413, and the OSD data and the processed data of the second video signal are superimposed in the motion compensation frame rate converter 413 , and converted into V-by-One format data and sent to the display screen 414 for playback.
图7为本申请音视频播放系统结构示意图。根据图7所示,本申请一种音视频播放系统包括:主处理器、显示设备和音频设备,其中,主处理器110,显示设备包括显示屏40、视频处理器130、视频格式转换桥片120以及运动补偿帧率转换器140,音频设备包括音频格式转换桥片150,主处理器与音频设备电连接形成音视频播放系统的主体部分10,主体部分10与显示设备20通过自定义接口连接并传送音视频数据,其中,处理器110通过I2C(Inter-Integrated Circuit,内部整合电路)总线分别耦接于视频格式转换桥片120、视频处理器130与运动补偿帧率转换器140。并且,在音视频播放系统内还配置有以太网模块190、有线和/或无线通信模块160(例如蓝牙模块、wifi模块、2.4G通信模块等)、电源管理模块170、存储器模块180及其组合其中之一,分别耦接于主处理器110。FIG. 7 is a schematic structural diagram of the audio and video playback system of the present application. As shown in FIG. 7 , an audio and video playback system of the present application includes: a main processor, a display device, and an audio device, wherein the main processor 110, and the display device include a display screen 40, a video processor 130, and a video format conversion bridge 120 and a frame rate converter for motion compensation 140, the audio equipment includes an audio format conversion bridge 150, the main processor is electrically connected with the audio equipment to form the main part 10 of the audio and video playback system, and the main part 10 is connected to the display device 20 through a custom interface And transmit audio and video data, wherein the processor 110 is respectively coupled to the video format conversion bridge 120 , the video processor 130 and the motion compensation frame rate converter 140 through an I 2 C (Inter-Integrated Circuit) bus. Moreover, an Ethernet module 190, a wired and/or wireless communication module 160 (such as a Bluetooth module, a wifi module, a 2.4G communication module, etc.), a power management module 170, a memory module 180 and combinations thereof are also configured in the audio and video playback system One of them is respectively coupled to the main processor 110 .
主处理器110耦接于音视频播放系统的第一音视频信号20,并且通过I2S(Inter-IC Sound)音频总线(又称集成电路内置音频总线)耦接于音频设备。The main processor 110 is coupled to the first audio and video signal 20 of the audio and video playback system, and is coupled to the audio device through an I 2 S (Inter-IC Sound) audio bus (also called an integrated circuit audio bus).
主处理器110用于接收第一音视频信号,例如,从配置于音视频播放系统内的以太网模块190与有线和/或无线通信模块160其中之一发送至主处理器110的音视频信号或者是主处理器110从存储器模块180内读取的第一音视频信号。The main processor 110 is used to receive the first audio-video signal, for example, the audio-video signal sent to the main processor 110 from one of the Ethernet module 190 and the wired and/or wireless communication module 160 configured in the audio-video playback system Or it is the first audio and video signal read by the main processor 110 from the memory module 180 .
主处理器110将第一视频信号发送至显示设备的视频处理器130,主处理器110发送的第一视频信号可以是但并不局限于移动终端高清影音标准信号(mobile high-definition link,MHL;简称MHL)、HDMI信号、低压差分信号(Low Voltage Differential Signaling,LVDS)、DP信号(displayport)、EDP信号(Embedded DisplayPort)、MIPI DSI信号(Mobile IndustryProcessor Interface-Display Serial Interface,移动行业处理器及显示器串行接口)、逻辑门电路(Transistor-Transistor Logic,TTL;简称TTL)及其组合其中之一。The main processor 110 sends the first video signal to the video processor 130 of the display device. The first video signal sent by the main processor 110 may be, but not limited to, a mobile high-definition link (MHL) standard signal. ; referred to as MHL), HDMI signal, Low Voltage Differential Signaling (Low Voltage Differential Signaling, LVDS), DP signal (displayport), EDP signal (Embedded DisplayPort), MIPI DSI signal (Mobile IndustryProcessor Interface-Display Serial Interface, mobile industry processor and Display serial interface), logic gate circuit (Transistor-Transistor Logic, TTL; TTL for short) and a combination thereof.
主处理器110将第一音频信号发送至音频设备,主处理器110还用于接收视频格式转换桥片120发送的第二音频信号并发送至音频设备,主处理器110具有屏幕显示选单功能模块,用以产生屏幕显示选单数据,并将屏幕显示选单数据转化发送至视频处理器130。The main processor 110 sends the first audio signal to the audio device, and the main processor 110 is also used to receive the second audio signal sent by the video format conversion bridge 120 and send it to the audio device. The main processor 110 has an on-screen display menu function module , for generating on-screen display menu data, and converting the on-screen display menu data to the video processor 130 .
此外,处理器110上设有处理模块112以及屏幕显示选单功能模块113。其中,处理模块112包括中央处理单元(central processing unit,CPU)111和/或图形处理单元(graphic processing unit,GPU)。In addition, the processor 110 is provided with a processing module 112 and an on-screen display menu function module 113 . Wherein, the processing module 112 includes a central processing unit (central processing unit, CPU) 111 and/or a graphics processing unit (graphic processing unit, GPU).
屏幕显示选单功能模块113用以根据主处理器110所接收到的操作指令产生相应的屏幕显示选单数据。例如,在需要使用菜单的场景下,主处理器110根据外部的输入指令控制屏幕显示选单功能模块113产生屏幕显示选单数据,例如在本申请的音视频播放系统为电视机的场景中,通过遥控器传送出要求显示控制菜单的功能指令至主处理器110,主处理器110的处理模块112即依据此功能指令通知屏幕显示选单功能模块113产生相应的屏幕显示选单数据,并且传送至视频处理器130。The screen display menu function module 113 is used for generating corresponding screen display menu data according to the operation instruction received by the main processor 110 . For example, in the scene where the menu needs to be used, the main processor 110 controls the screen display menu function module 113 to generate the screen display menu data according to the external input command. The controller transmits a function command requiring display of the control menu to the main processor 110, and the processing module 112 of the main processor 110 informs the screen display menu function module 113 to generate corresponding screen display menu data according to the function command, and transmits it to the video processor 130.
音频格式转换桥片150,用于接收视频格式转换桥片120发送的转化后的第二音频信号,并将转化后的第二音频信号转化并发送到主处理器110,以及,通过光纤接口接收SPDIF格式音频信号,将通过光纤接口接收SPDIF格式音频信号转化并发送到主处理器。The audio format conversion bridge piece 150 is used to receive the converted second audio signal sent by the video format conversion bridge piece 120, convert and send the converted second audio signal to the main processor 110, and receive through the optical fiber interface SPDIF format audio signal, convert the SPDIF format audio signal received through the optical fiber interface and send it to the main processor.
视频处理器130,用于接收主处理器110传输的第一视频信号,并将所接受的第一视频信号传输给视频格式转换桥片120,视频处理器130还用于接收主处理器110发送的转化后的屏幕显示选单数据,并将屏幕显示选单数据转化发送给运动补偿帧率转换器140。The video processor 130 is used to receive the first video signal transmitted by the main processor 110, and transmit the accepted first video signal to the video format conversion bridge chip 120, and the video processor 130 is also used to receive the video signal sent by the main processor 110. The converted on-screen display menu data, and the converted on-screen display menu data is sent to the motion compensation frame rate converter 140 .
视频格式转换桥片120,用于接收视频处理器130传输的第一视频信号,转换第一视频信号,并将转换后的第一视频信号发送至运动补偿帧率转换器140,视频格式转换桥片120还用于接收第二音视频信号,转化第二音视频信号中的第二视频信号,并将转化后的第二视频信号发送到运动补偿帧率转换器140,视频格式转换桥片120还用于转化第二音视频信号中的第二音频信号,并将转化后的第二音频信号发送至音频格式转换桥片150。Video format conversion bridge 120, used to receive the first video signal transmitted by video processor 130, convert the first video signal, and send the converted first video signal to motion compensation frame rate converter 140, video format conversion bridge Sheet 120 is also used for receiving the second audio-video signal, converting the second video signal in the second audio-video signal, and sending the converted second video signal to motion compensation frame rate converter 140, video format conversion bridge sheet 120 It is also used to convert the second audio signal in the second audio-video signal, and send the converted second audio signal to the audio format conversion bridge 150 .
运动补偿帧率转换器140,用于接收视频格式转换桥片120发送的转化后的第一视频信号,将转化后的第一视频信号处理为高分辨率和高帧率视频信号,并且传送至显示屏40,运动补偿帧率转换器140用于接收视频格式转换桥片120发送的转化后的第二视频信号,将转化后的第二视频信号处理为高分辨率和高帧率视频信号,并且传送至显示屏40,运动补偿帧率转换器140还用于接收视频处理器130发送的屏幕显示选单数据,将屏幕显示选单数据转化为高分辨率和高帧率视频信号并传送至显示屏40。The motion compensation frame rate converter 140 is used to receive the converted first video signal sent by the video format conversion bridge 120, process the converted first video signal into a high-resolution and high frame rate video signal, and transmit it to The display screen 40, the motion compensation frame rate converter 140 is used to receive the converted second video signal sent by the video format conversion bridge 120, and process the converted second video signal into a high-resolution and high frame rate video signal, And transmitted to the display screen 40, the motion compensation frame rate converter 140 is also used to receive the screen display menu data sent by the video processor 130, convert the screen display menu data into a high-resolution and high frame rate video signal and send it to the display screen 40.
运动补偿帧率转换器140分别耦接于视频格式转换桥片120、视频处理器130以及显示屏40,用以从视频格式转换桥片120接收转换后的第一视频信号,并且基于运动检测与运动补偿(motion estimation and motioncompensation,MEMC)原理对转换后的第一视频信号进行帧频转换(framerate conversion,FRC),从而将转换后的第一视频信号处理为高分辨率和高帧率视频信号,例如从普通60Hz刷新率的视频内容提升到120Hz或者240Hz刷新率的视频内容,然后将此高分辨率和高帧率视频信号传送至显示屏40进行播放,从而提高运动画面的清晰程度。The motion compensation frame rate converter 140 is respectively coupled to the video format conversion bridge 120, the video processor 130 and the display screen 40, for receiving the converted first video signal from the video format conversion bridge 120, and based on motion detection and The motion compensation (motion estimation and motion compensation, MEMC) principle performs frame rate conversion (framerate conversion, FRC) on the converted first video signal, thereby processing the converted first video signal into a high-resolution and high frame rate video signal For example, the video content with a refresh rate of 60 Hz is upgraded to a video content with a refresh rate of 120 Hz or 240 Hz, and then the high resolution and high frame rate video signal is transmitted to the display screen 40 for playback, thereby improving the clarity of the moving picture.
值得说明的是,在运动补偿帧率转换器140还用以从视频处理器130接收屏幕显示选单数据,并且将所接收的屏幕显示选单数据与转换后的第二视频信号进行叠加,并且在叠加操作上,可以是先进行屏幕显示选单数据与转换后的视频信号的叠加,然后再将叠加有屏幕显示选单数据的第二视频信号处理为高分辨率和高帧率视频信号;或者是在将转换后的第二视频信号处理为高分辨率和高帧率视频信号后,再进行屏幕显示选单数据的叠加。以上仅是叠加操作的顺序不同,并且都能产生在显示屏40上呈现带有屏幕显示选单数据的高清晰度画面,因此上述的叠加顺序并非用以限制本申请。可以理解的是,第一音视频数据通过主处理器转化成例如HDMI格式数据之后发送给视频处理器,由于主处理器110发送给视频处理器130的数据中就可以叠加了屏幕显示选单数据,具体的,通过遥控器传送出要求显示控制菜单的功能指令至主处理器110,主处理器110的处理模块112即依据此功能指令通知屏幕显示选单功能模块113产生相应的屏幕显示选单数据,主处理器110将屏幕显示选单数据与第一视频信号进行叠加,然后再将叠加有屏幕显示选单数据的第一视频信号传送至视频处理模块130,因此,此时不需要在运动补偿帧率转换器140叠加屏幕显示选单数据。It is worth noting that the motion compensation frame rate converter 140 is also used to receive the on-screen display menu data from the video processor 130, and superimpose the received on-screen display menu data with the converted second video signal, and In operation, it is possible to superimpose the on-screen display menu data and the converted video signal first, and then process the second video signal superimposed with the on-screen display menu data into a high-resolution and high frame rate video signal; After the converted second video signal is processed into a high-resolution and high-frame-rate video signal, the screen display menu data is superimposed. The above are only different in the sequence of the superimposing operation, and both can produce a high-definition picture with on-screen display menu data on the display screen 40 , so the above superimposing sequence is not intended to limit the present application. It can be understood that the first audio and video data is converted into, for example, HDMI format data by the main processor and then sent to the video processor. Since the data sent by the main processor 110 to the video processor 130 can be superimposed on the screen display menu data, Specifically, the remote controller transmits a function instruction requiring display of the control menu to the main processor 110, and the processing module 112 of the main processor 110 notifies the screen display menu function module 113 to generate corresponding screen display menu data according to the function instruction. The processor 110 superimposes the on-screen display menu data and the first video signal, and then transmits the first video signal superimposed with the on-screen display menu data to the video processing module 130. 140 superimposed screen display menu data.
本申请实施例提供的音视频播放系统的主处理器和音频设备构成了该音视频播放系统的主体部分,主处理器能够将接收的第一音视频信号转换发送给音频设备,从而能够独立播放音频。此外,本申请实施例可选择性的通过主处理器接收第一音视频信号,或者是通过视频格式转换桥片接收第二音视频信号,并且根据信号源的不同而选择相应的处理模式,从而使得本申请的音视频播放系统既能够单独通过主体部分播放音频,又能够接收外界的HDMI信号源发送的第二音视频信号。通过视频格式转换桥片对视频信号进行数据格式转换以及通过视频处理模块作为屏幕显示选单数据与第一频信号的传送媒介,让主处理器所接收的第一视频信号或视频格式转换桥片所接收的第二视频信号可以在显示屏上进行播放,并同时呈现屏幕显示选单数据。此外,通过运动补偿帧率转换器对转换后的视频信号进行优化,可以提供高分辨率和高帧率视频信号至显示屏,从而提升显示画面的质量,同时增进用户体验。The main processor and audio equipment of the audio and video playback system provided by the embodiment of the present application constitute the main part of the audio and video playback system, and the main processor can convert and send the received first audio and video signal to the audio equipment, so that it can play audio. In addition, the embodiment of the present application can selectively receive the first audio and video signal through the main processor, or receive the second audio and video signal through the video format conversion bridge, and select the corresponding processing mode according to the different signal sources, so that This makes the audio and video playback system of the present application not only play audio through the main part alone, but also receive the second audio and video signal sent by the external HDMI signal source. The data format of the video signal is converted by the video format conversion bridge, and the video processing module is used as the transmission medium of the screen display menu data and the first frequency signal, so that the first video signal received by the main processor or the video format conversion bridge The received second video signal can be played on the display screen, and the screen display menu data can be displayed at the same time. In addition, optimizing the converted video signal through the motion compensation frame rate converter can provide high-resolution and high frame rate video signals to the display screen, thereby improving the quality of the display screen and enhancing user experience at the same time.
进一步的,本申请实施例一种音视频播放系统,还包括视频信号多路输入开关模块220,用以接收第二音视频信号,并向视频格式转换桥片120发送第二音视频信号。Further, an audio and video playback system in the embodiment of the present application further includes a video signal multiple input switch module 220 for receiving the second audio and video signal and sending the second audio and video signal to the video format conversion bridge 120 .
视频信号多路输入开关模块220可以接收多路视频信号,接收视频信号的端口数可以选择。The video signal multiple input switch module 220 can receive multiple video signals, and the number of ports for receiving video signals can be selected.
视频信号多路输入开关模块220接收的第二音视频数据为HDMI格式音视频数据。The second audio and video data received by the video signal multiplex input switch module 220 is audio and video data in HDMI format.
进一步的,本申请实施例一种音视频播放系统,视频处理器130设有第一视频格式输出接口;运动补偿侦率转换器140设有第二视频格式输入接口;以及,视频格式转换桥片120设有第一视频格式输入接口与第二视频格式输出接口;Further, the present application embodiment is a kind of audio and video playing system, video processor 130 is provided with the first video format output interface; Motion compensation rate converter 140 is provided with the second video format input interface; And, video format conversion bridge piece 120 is provided with a first video format input interface and a second video format output interface;
其中,视频格式转换桥片120的第一视频格式输入接口耦接于视频处理器130的第一视频格式输出接口,用以接收视频处理器130的第一视频信号,视频格式转换桥片120的第二视频格式输出接口耦接于运动补偿侦率转换器140的第二视频格式输入接口,用以将转换后的第一视频信号传送至运动补偿帧率转换器。Wherein, the first video format input interface of the video format conversion bridge piece 120 is coupled to the first video format output interface of the video processor 130, in order to receive the first video signal of the video processor 130, the video format conversion bridge piece 120 The second video format output interface is coupled to the second video format input interface of the motion compensation frame rate converter 140 for transmitting the converted first video signal to the motion compensation frame rate converter.
视频格式转换桥片120上设有第一视频格式输入接口、第二视频格式输出接口以及音频输出接口。视频格式转换桥片120的第一视频格式输入接口耦接于视频处理器130的第一视频格式输出接口,用以接收视频处理器130的第一视频信号。此外,视频格式转换桥片120的第二视频格式输出接口耦接于运动补偿侦率转换器140的第二视频格式输入接口,用以将转换后的第一视频信号传送至运动补偿帧率转换器。The video format conversion bridge 120 is provided with a first video format input interface, a second video format output interface and an audio output interface. The first video format input interface of the video format conversion bridge 120 is coupled to the first video format output interface of the video processor 130 for receiving the first video signal from the video processor 130 . In addition, the second video format output interface of the video format conversion bridge chip 120 is coupled to the second video format input interface of the motion compensation rate converter 140 for transmitting the converted first video signal to the motion compensation frame rate conversion device.
其中,视频格式转换桥片120的第一视频格式输入接口121的数据格式与视频处理器130的第一视频格式输出接口的数据格式相同,例如同样为HDMI数据格式;视频格式转换桥片120的第二视频格式输出接口的数据格式与视频处理器130的第一视频格式输出接口的数据格式相异,例如为V-by-One数据格式。可以理解的是,由于视频格式转换桥片120的第二视频格式输出接口与运动补偿帧率转换器140的第二视频格式输入接口为数据格式相对应的视频信号输出接口与视频信号输入接口,因此,在本实施例中,运动补偿帧率转换器140的第二视频格式输入接口的数据格式同样为V-by-One数据格式。Wherein, the data format of the first video format input interface 121 of the video format conversion bridge piece 120 is identical with the data format of the first video format output interface of the video processor 130, for example, is also the HDMI data format; The data format of the second video format output interface is different from the data format of the first video format output interface of the video processor 130 , such as a V-by-One data format. It can be understood that, since the second video format output interface of the video format conversion bridge 120 and the second video format input interface of the motion compensation frame rate converter 140 are video signal output interfaces and video signal input interfaces corresponding to the data format, Therefore, in this embodiment, the data format of the second video format input interface of the motion compensation frame rate converter 140 is also the V-by-One data format.
视频格式转换桥片的第一格式音频信号输出接口耦接于音频格式转换桥片150的第一格式音频信号输入接口,将第二音频信号发送给音频格式转换桥片150。The first-format audio signal output interface of the video format conversion bridge is coupled to the first-format audio signal input interface of the audio format conversion bridge 150 , and sends the second audio signal to the audio format conversion bridge 150 .
进一步的,本申请实施例一种音视频播放系统,主处理器110设有屏幕选单输出接口;视频处理器130设有屏幕选单输入接口和屏幕选单输出接口;运动补偿帧率转换器设有屏幕选单输入接口;其中,视频处理器130的屏幕选单输入接口耦接于主处理器110的屏幕选单输出接口,用以接收主处理器110转化后的屏幕显示选单数据,运动补偿帧率转换器的屏幕选单输入接口耦接于视频处理器130的屏幕选单输出接口,用以接收视频处理器130转化后的屏幕显示选单数据。Further, the embodiment of the present application is an audio and video playback system, the main processor 110 is provided with a screen menu output interface; the video processor 130 is provided with a screen menu input interface and a screen menu output interface; the motion compensation frame rate converter is provided with a screen menu input interface; wherein, the screen menu input interface of the video processor 130 is coupled to the screen menu output interface of the main processor 110 to receive the screen display menu data converted by the main processor 110, and the motion compensation frame rate converter The on-screen menu input interface is coupled to the on-screen menu output interface of the video processor 130 for receiving the on-screen display menu data converted by the video processor 130 .
进一步的,本申请实施例一种音视频播放系统,视频格式转换桥片120设有第一格式音频信号输出接口;音频格式转换桥片150设有第一格式音频信号输入接口和第二格式音频信号输出接口;主处理器110设有第二格式音频信号输入接口;其中,音频格式转换桥片150的第一格式音频信号输入接口耦接于视频格式转换桥片120的第一格式音频信号输出接口,用于接收第二音频信号,音频格式转换桥片150第二格式音频信号输出接口耦接于主处理器110的第二格式音频信号输入接口,用户将转化后的第二音频信号发送至主处理器110。Further, the embodiment of the present application is an audio and video playback system, the video format conversion bridge 120 is provided with a first format audio signal output interface; the audio format conversion bridge 150 is provided with a first format audio signal input interface and a second format audio signal Signal output interface; the main processor 110 is provided with a second format audio signal input interface; wherein, the first format audio signal input interface of the audio format conversion bridge piece 150 is coupled to the first format audio signal output of the video format conversion bridge piece 120 The interface is used to receive the second audio signal, the audio format conversion bridge 150 second format audio signal output interface is coupled to the second format audio signal input interface of the main processor 110, and the user sends the converted second audio signal to main processor 110 .
音频格式转换桥片150的第二格式音频信号输出接口通过I2S总线耦接于主处理器110,用以在视频格式转换桥片120将所接收的第二音频信号进行格式转换后,将转换后的第二音频信号传送至音频格式转换桥片150再由音频格式转换桥片150转化之后发送给主处理器110,以便于提供至音频设备30进行播放。例如,将HDMI数据格式的第二音频信号转换为I2S数据格式的外部音频信号后,通过I2S总线将其传送至主处理器110;或者是在某些情况下,先将HDMI数据格式的外部音频信号转换为SPDIF数据格式,然后再从SPDIF数据格式转换为I2S数据格式后,接着再传送至主处理器110。The second format audio signal output interface of the audio format conversion bridge 150 is coupled to the main processor 110 through the I2S bus, so that after the video format conversion bridge 120 converts the format of the received second audio signal, the converted The second audio signal is transmitted to the audio format conversion bridge 150 and then converted by the audio format conversion bridge 150 and sent to the main processor 110 so as to be provided to the audio device 30 for playback. For example, after the second audio signal in the HDMI data format is converted into an external audio signal in the I2S data format, it is sent to the main processor 110 through the I2S bus; or in some cases, first the external audio signal in the HDMI data format The signal is converted to SPDIF data format, and then converted from SPDIF data format to I2S data format, and then sent to the main processor 110 .
此外,音频格式转换桥片150还可以通过光纤接口接收SPDIF格式音频信号,将通过光纤接口接收SPDIF格式音频信号转化为I2S格式音频数据并发送到主处理器,由主处理器发送到音频设备进行播放。可以理解的是,音频设备可以包括功率放大器和扬声器等,为说明更突出,附图中没有示出。In addition, the audio format conversion bridge 150 can also receive the SPDIF format audio signal through the optical fiber interface, convert the SPDIF format audio signal received through the optical fiber interface into I2S format audio data and send it to the main processor, and the main processor sends it to the audio device for further processing. play. It can be understood that the audio device may include a power amplifier, a speaker, etc., which are not shown in the drawings for the sake of clarity.
进一步的,本申请实施例一种音视频播放系统,第一视频格式为MHL、HDMI、LVDS、DP、EDP、MIPI DSI、TTL及其组合其中之一。Further, the embodiment of the present application is an audio and video playback system, the first video format is one of MHL, HDMI, LVDS, DP, EDP, MIPI DSI, TTL and combinations thereof.
具体的第一视频格式可以为移动终端高清影音标准信号(mobilehigh-definition link,MHL;简称MHL)、HDMI信号、低压差分信号(LowVoltage Differential Signaling,LVDS)、DP信号(display port)、EDP信号(Embedded DisplayPort)、MIPI DSI信号(Mobile Industry ProcessorInterface-Display Serial Interface,移动行业处理器及显示器串行接口)、逻辑门电路(Transistor-Transistor Logic,TTL;简称TTL)及其组合其中之一The specific first video format may be mobile high-definition link (MHL; MHL for short), HDMI signal, Low Voltage Differential Signaling (LowVoltage Differential Signaling, LVDS), DP signal (display port), EDP signal ( Embedded DisplayPort), MIPI DSI signal (Mobile Industry Processor Interface-Display Serial Interface, mobile industry processor and display serial interface), logic gate circuit (Transistor-Transistor Logic, TTL; TTL for short) and one of its combinations
进一步的,本申请实施例一种音视频播放系统,第二视频格式为V-by-One。Further, the embodiment of the present application is an audio and video playback system, and the second video format is V-by-One.
v-by-one接口主要用在大屏显示、摄像机安全方面。v-by-one接口的意思是“video by one”,即通过“一根线”来传输低压差动小型计算机系统接口信号(全称low voltage differential SCSI,简称LVDS)或晶体管-晶体管逻辑(全称TransistorTransistorLogIC,简称TTL)信号,通俗的说就是减少了印刷电路板(全称Printed Circuit Board,简称PCB)布线,因此在大屏上的应用尤其突出。The v-by-one interface is mainly used in large-screen display and camera security. The v-by-one interface means "video by one", that is, through "one line" to transmit low-voltage differential small computer system interface signals (full name low voltage differential SCSI, LVDS for short) or transistor-transistor logic (full name TransistorTransistorLogIC , referred to as TTL) signal, in layman's terms is to reduce the printed circuit board (full name Printed Circuit Board, referred to as PCB) wiring, so the application on the large screen is particularly prominent.
进一步的,本申请实施例一种音视频播放系统,音视频播放系统为电视机,其中,第一音视频信号为主处理器110接收的电视信号源、来自互联网的信号源、本地端下载的信号源或外接于音视频播放系统的影音装置的音视频信号源,例如SD卡数据或者USB数据,第二音视频信号为视频系统中的视频格式转换桥片通过HDMI信号源接收的HDMI信号源。Further, the embodiment of the present application is an audio and video playback system, and the audio and video playback system is a TV, wherein the first audio and video signal is the TV signal source received by the main processor 110, the signal source from the Internet, and the The signal source or the audio and video signal source of the audio-visual device externally connected to the audio and video playback system, such as SD card data or USB data, the second audio and video signal is the HDMI signal source received by the video format conversion bridge in the video system through the HDMI signal source .
进一步的,本申请实施例一种音视频播放系统,运动补偿帧率转换器,用于叠加转化后的第二视频信号与屏幕显示选单数据Further, the embodiment of the present application is an audio and video playback system, a motion compensation frame rate converter, which is used to superimpose the converted second video signal and the screen display menu data
运动补偿帧率转换器140分别耦接于视频格式转换桥片120、视频处理器130以及显示屏40,用以从视频格式转换桥片120接收转换后的第一视频信号或转换后的第二视频信号,并且基于运动检测与运动补偿(motionestimation and motion compensation,MEMC)原理对转换后的主视频信号或转换后的外部视频信号进行帧频转换(frame rate conversion,FRC),从而将转换后的第一视频信号或转换后的第二视频信号处理为高分辨率和高帧率视频信号,例如从普通60Hz刷新率的视频内容提升到120Hz或者240Hz刷新率的视频内容,然后将此高分辨率和高帧率视频信号传送至显示屏40进行播放,从而提高运动画面的清晰程度。The motion compensation frame rate converter 140 is respectively coupled to the video format conversion bridge piece 120, the video processor 130 and the display screen 40, in order to receive the converted first video signal or the converted second video signal from the video format conversion bridge piece 120. Video signal, and based on motion detection and motion compensation (motionestimation and motion compensation, MEMC) principle, frame rate conversion (frame rate conversion, FRC) is performed on the converted main video signal or converted external video signal, so that the converted The first video signal or the converted second video signal is processed into a high-resolution and high frame rate video signal, for example, video content with a refresh rate of 60 Hz is upgraded to a video content with a refresh rate of 120 Hz or 240 Hz, and then the high-resolution and the high frame rate video signal are transmitted to the display screen 40 for playback, thereby improving the clarity of the moving picture.
值得说明的是,在运动补偿帧率转换器140还用以从视频处理器130接收屏幕显示选单数据,并且将所接受的屏幕显示选单数据与转后后的第二视频信号进行叠加,并且在叠加操作上,可以是先进行屏幕显示选单数据与转换后的第二视频信号的叠加,然后再将叠加有屏幕显示选单数据的第二视频信号处理为高分辨率和高帧率视频信号;或者是在将转换后的第二视频信号处理为高分辨率和高帧率视频信号后,再进行屏幕显示选单数据的叠加。以上仅是叠加操作的顺序不同,并且都能产生在显示屏40上呈现带有屏幕显示选单数据的高清晰度画面,因此上述的叠加顺序并非用以限制本申请。It is worth noting that the motion compensation frame rate converter 140 is also used to receive the on-screen display menu data from the video processor 130, and superimpose the received on-screen display menu data with the converted second video signal, and In the superposition operation, the superimposition of the screen display menu data and the converted second video signal can be performed first, and then the second video signal superimposed with the screen display menu data is processed into a high-resolution and high frame rate video signal; or After the converted second video signal is processed into a high resolution and high frame rate video signal, the screen display menu data is superimposed. The above are only different in the sequence of the superimposing operation, and both can produce a high-definition picture with on-screen display menu data on the display screen 40 , so the above superimposing sequence is not intended to limit the present application.
进一步的,本申请实施例一种音视频播放系统,其特征在于,还包括耦接于主处理器110的电源管理模块和存储器模块。Further, an audio and video playback system according to an embodiment of the present application is characterized in that it further includes a power management module and a memory module coupled to the main processor 110 .
主处理器110通过I2C接口耦接与视频处理器130、视频格式转换桥片120以及频系统包括音频格式转换桥片150,并与它们进行通信。The main processor 110 is coupled with the video processor 130 , the video format conversion bridge 120 and the audio system including the audio format conversion bridge 150 through the I2C interface, and communicates with them.
以下通过一具体实施方式对本申请实施例所揭露的音视频播放系统的运作方式作举例说明。The operation of the audio and video playback system disclosed in the embodiment of the present application will be illustrated below through a specific implementation manner.
当第一音视频数据由主处理器播放时;When the first audio and video data is played by the main processor;
由主处理器播放的音视频,其第一音视频数据转变为HDMI格式数据输出,其音频数据转变为I2S送给音频设备播放。主处理器的HDMI格式数据输出,送给视频处理器,视频处理器输出HDMI格式数据。视频处理器输出HDMI格式数据送给HDMI转V-by-One桥片,HDMI转V-by-One桥片输出V-by-One格式第一音视频数据。HDMI转V-by-One桥片输出的V-by-One格式第一音视频数据送给FRC/MEMC芯片,进行帧率转换转变为高帧率音视频数据及运动补偿处理,并以V-by-One格式送给显示屏播放。For the audio and video played by the main processor, the first audio and video data is converted into HDMI format data output, and the audio data is converted into I2S and sent to the audio device for playback. The HDMI format data output of the main processor is sent to the video processor, and the video processor outputs the HDMI format data. The video processor outputs HDMI format data to the HDMI to V-by-One bridge, and the HDMI to V-by-One bridge outputs the first audio and video data in V-by-One format. The first audio and video data in V-by-One format output by the HDMI to V-by-One bridge chip is sent to the FRC/MEMC chip for frame rate conversion into high frame rate audio and video data and motion compensation processing, and V- The by-One format is sent to the display screen for playback.
以下通过另一具体实施方式对本申请实施例所揭露的音视频播放系统的运作方式作举例说明。The operation of the audio and video playback system disclosed in the embodiment of the present application will be illustrated below through another specific implementation manner.
当第二音视频数据由视频信号多路输入开关模块220HDMI接口输入时,第二音视频信号为可以HDMI格式音视频信号,由多路输入开关模块HDMI输入,HDMI多路开关可以连接多个HDMI输入,一般2-3端口个开放给客户。HDMI格式数据由HDMI多路开关送到HDMI转V-by-One桥片,第二音视频数据在HDMI转V-by-One桥片中转变为V-by-One格式数据;HDMI转V-by-One桥片输出的V-by-One格式第二音视频数据送给FRC/MEMC芯片,进行帧率转换转变为高帧率音视频数据及运动补偿处理,并以V-by-One格式送给显示屏播放。When the second audio and video data is input by the video signal multi-channel input switch module 220HDMI interface, the second audio and video signal is an audio and video signal in HDMI format, which is input by the multi-channel input switch module HDMI, and the HDMI multi-channel switch can connect multiple HDMI For input, generally 2-3 ports are open to customers. The HDMI format data is sent to the HDMI to V-by-One bridge by the HDMI multi-channel switch, and the second audio and video data is converted into V-by-One format data in the HDMI to V-by-One bridge; HDMI to V- The V-by-One format second audio and video data output by the by-One bridge chip is sent to the FRC/MEMC chip for frame rate conversion into high frame rate audio and video data and motion compensation processing, and the V-by-One format Send it to the display to play.
其音频数据在HDMI转V-by-One桥片中输出SPDIF格式音频数据,通过音视频播放系统的主体部分和显示设备部分之间的自定义连接线送给音响系统中的SPD IF转I2S芯片,并把SPDIF格式音频数据转变为I2S格式音频数据送给主处理器,主处理器输出I2S数据给音频设备播放。Its audio data outputs SPDIF format audio data in the HDMI to V-by-One bridge chip, and sends it to the SPD IF to I2S chip in the audio system through the custom connection line between the main part of the audio and video playback system and the display device part , and convert SPDIF format audio data into I2S format audio data and send it to the main processor, and the main processor outputs I2S data to the audio device for playback.
当用户按动遥控器或按键进行控制时,菜单的OSD数据,由主处理器把OSD音视频数据转变为HDMI格式输出,送给视频处理器,视频处理器把HDMI格式数据转变为LVDS格式数据送给FRC/MEMC芯片,OSD数据和第二视频数据在FRC/MEMC芯片中叠加,并转变为V-by-One格式数据送到显示屏播放。When the user presses the remote control or the button to control, the OSD data of the menu is converted into HDMI format by the main processor for output, and sent to the video processor, and the video processor converts the HDMI format data into LVDS format data Send to FRC/MEMC chip, OSD data and second video data are superimposed in FRC/MEMC chip, and converted into V-by-One format data and sent to the display screen for playback.
以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性的劳动的情况下,即可以理解并实施。The device embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network elements. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. It can be understood and implemented by those skilled in the art without any creative effort.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到各实施方式可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件。基于这样的理解,上述技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在计算机可读存储介质中,如ROM/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行各个实施例或者实施例的某些部分所述的方法。Through the above description of the implementations, those skilled in the art can clearly understand that each implementation can be implemented by means of software plus a necessary general hardware platform, and of course also by hardware. Based on this understanding, the essence of the above technical solution or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products can be stored in computer-readable storage media, such as ROM/RAM, magnetic discs, optical discs, etc., including several instructions to make a computer device (which may be a personal computer, server, or network device, etc.) execute the methods described in various embodiments or some parts of the embodiments.
最后应说明的是:以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, rather than limiting them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the present application.
Claims (15)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510958715.2A CN105916029A (en) | 2015-12-18 | 2015-12-18 | Audio playing control equipment, video display equipment and audio and video playing system |
| PCT/CN2016/088793 WO2017101361A1 (en) | 2015-12-18 | 2016-07-06 | Audio playback control device, video display device and audio and video playback system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510958715.2A CN105916029A (en) | 2015-12-18 | 2015-12-18 | Audio playing control equipment, video display equipment and audio and video playing system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105916029A true CN105916029A (en) | 2016-08-31 |
Family
ID=56744334
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510958715.2A Pending CN105916029A (en) | 2015-12-18 | 2015-12-18 | Audio playing control equipment, video display equipment and audio and video playing system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105916029A (en) |
| WO (1) | WO2017101361A1 (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106454153A (en) * | 2016-09-08 | 2017-02-22 | 青岛海信电器股份有限公司 | Touch terminal and display method thereof |
| CN106911983A (en) * | 2017-01-10 | 2017-06-30 | 硅谷数模半导体(北京)有限公司 | The control method and system of audio frequency and video protocol conversion chip |
| CN111083496A (en) * | 2019-12-25 | 2020-04-28 | Oppo广东移动通信有限公司 | Data processing methods and related products |
| CN112399246A (en) * | 2019-08-18 | 2021-02-23 | 海信视像科技股份有限公司 | Sound processing method of display equipment and display equipment |
| CN113225611A (en) * | 2021-04-26 | 2021-08-06 | 深圳创维-Rgb电子有限公司 | Audio and video transmitting method, playing method, display device and main system |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108174259A (en) * | 2018-03-02 | 2018-06-15 | 四川长虹电器股份有限公司 | Ultra-thin LCD TV based on Wireless Display |
| TWI692975B (en) * | 2019-04-16 | 2020-05-01 | 瑞昱半導體股份有限公司 | Method for processing multi-media signal, and associated multi-media device |
| CN112073796B (en) * | 2019-06-10 | 2023-10-24 | 海信视像科技股份有限公司 | Image motion compensation method and display device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070035663A1 (en) * | 2005-08-12 | 2007-02-15 | Samsung Electronics Co., Ltd. | Display apparatus to output an audio signal and method thereof |
| CN102111650A (en) * | 2011-02-28 | 2011-06-29 | 中兴通讯股份有限公司 | Method and device for achieving mobile television functions on video fixed telephone |
| CN104243853A (en) * | 2014-08-25 | 2014-12-24 | 青岛歌尔声学科技有限公司 | High-definition multimedia interface (HDMI) double-display device and display method |
| CN204836436U (en) * | 2015-08-21 | 2015-12-02 | 乐视致新电子科技(天津)有限公司 | Audio frequency and video playback devices |
| CN204836435U (en) * | 2015-08-21 | 2015-12-02 | 乐视致新电子科技(天津)有限公司 | Audio frequency and video playback devices |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6490002B1 (en) * | 1999-02-03 | 2002-12-03 | Sony Corporation | Supplemental data path for supporting on-screen displays from external sources in a monitor/TV receiver using a secondary analog signal path |
| CN202818522U (en) * | 2012-09-29 | 2013-03-20 | 广东海博威视电子科技股份有限公司 | A device with video input and output |
| CN104767950B (en) * | 2014-11-08 | 2019-01-08 | 晶晨半导体(上海)股份有限公司 | Card insert type TV |
| CN204887293U (en) * | 2015-08-21 | 2015-12-16 | 乐视致新电子科技(天津)有限公司 | Audio and video playback equipment |
| CN204859440U (en) * | 2015-08-21 | 2015-12-09 | 乐视致新电子科技(天津)有限公司 | Audio frequency and video playback devices |
-
2015
- 2015-12-18 CN CN201510958715.2A patent/CN105916029A/en active Pending
-
2016
- 2016-07-06 WO PCT/CN2016/088793 patent/WO2017101361A1/en not_active Ceased
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070035663A1 (en) * | 2005-08-12 | 2007-02-15 | Samsung Electronics Co., Ltd. | Display apparatus to output an audio signal and method thereof |
| CN102111650A (en) * | 2011-02-28 | 2011-06-29 | 中兴通讯股份有限公司 | Method and device for achieving mobile television functions on video fixed telephone |
| CN104243853A (en) * | 2014-08-25 | 2014-12-24 | 青岛歌尔声学科技有限公司 | High-definition multimedia interface (HDMI) double-display device and display method |
| CN204836436U (en) * | 2015-08-21 | 2015-12-02 | 乐视致新电子科技(天津)有限公司 | Audio frequency and video playback devices |
| CN204836435U (en) * | 2015-08-21 | 2015-12-02 | 乐视致新电子科技(天津)有限公司 | Audio frequency and video playback devices |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106454153A (en) * | 2016-09-08 | 2017-02-22 | 青岛海信电器股份有限公司 | Touch terminal and display method thereof |
| CN106454153B (en) * | 2016-09-08 | 2019-09-17 | 青岛海信电器股份有限公司 | A kind of display methods and touch control terminal of touch control terminal |
| CN106911983A (en) * | 2017-01-10 | 2017-06-30 | 硅谷数模半导体(北京)有限公司 | The control method and system of audio frequency and video protocol conversion chip |
| CN106911983B (en) * | 2017-01-10 | 2020-05-08 | 硅谷数模半导体(北京)有限公司 | Control method and system of audio and video protocol conversion chip |
| CN112399246A (en) * | 2019-08-18 | 2021-02-23 | 海信视像科技股份有限公司 | Sound processing method of display equipment and display equipment |
| CN111083496A (en) * | 2019-12-25 | 2020-04-28 | Oppo广东移动通信有限公司 | Data processing methods and related products |
| CN113225611A (en) * | 2021-04-26 | 2021-08-06 | 深圳创维-Rgb电子有限公司 | Audio and video transmitting method, playing method, display device and main system |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2017101361A1 (en) | 2017-06-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105916029A (en) | Audio playing control equipment, video display equipment and audio and video playing system | |
| EP3169075A1 (en) | Audio and video playback device | |
| CN204836434U (en) | Audio frequency and video playback devices | |
| CN204836435U (en) | Audio frequency and video playback devices | |
| JP2017532795A (en) | Audio video reproduction facility, data display method, and storage medium | |
| US8869214B2 (en) | Device control apparatus, device control method and computer program | |
| CN204887293U (en) | Audio and video playback equipment | |
| WO2017032072A1 (en) | Audio/video playing device | |
| CN204859440U (en) | Audio frequency and video playback devices | |
| WO2014141425A1 (en) | Video display system, source device, sink device, and video display method | |
| KR20130066168A (en) | Apparatas and method for dual display of television using for high definition multimedia interface in a portable terminal | |
| US20170055028A1 (en) | Device for playing audio and video | |
| CN105979118A (en) | Video processing system and multimedia playing device provided with same | |
| US20170054939A1 (en) | Audio and video player | |
| CN204836436U (en) | Audio frequency and video playback devices | |
| CN103188534B (en) | Display device, attachable external peripheral and the method for showing image | |
| WO2017032115A1 (en) | Audio and video playback device and audio and video playback method | |
| CN205584413U (en) | Audio playback's controlgear , video presentation equipment and audio frequency and video broadcast system | |
| CN106210843A (en) | The play handling method of TV and device | |
| JP4970607B1 (en) | Transmitting apparatus, receiving apparatus, and transmission method | |
| WO2017084260A1 (en) | Audio and video playing device and method | |
| KR20140106885A (en) | An apparatus for converting a transmission type of hdmi signal | |
| CN205232392U (en) | Audio frequency and video playback devices | |
| US20170055027A1 (en) | Device and method for playing audios and videos | |
| CN105898452A (en) | Mobile video device, audio and video playing device and multimedia system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160831 |
|
| WD01 | Invention patent application deemed withdrawn after publication |