CN100466695C - Multimedia home gateway and its implementation method for program recording, recovery, suspension - Google Patents
Multimedia home gateway and its implementation method for program recording, recovery, suspension Download PDFInfo
- Publication number
- CN100466695C CN100466695C CNB2004100510640A CN200610157448A CN100466695C CN 100466695 C CN100466695 C CN 100466695C CN B2004100510640 A CNB2004100510640 A CN B2004100510640A CN 200610157448 A CN200610157448 A CN 200610157448A CN 100466695 C CN100466695 C CN 100466695C
- Authority
- CN
- China
- Prior art keywords
- video
- multimedia
- channel
- interface
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 22
- 238000011084 recovery Methods 0.000 title 1
- 239000000725 suspension Substances 0.000 title 1
- 230000008569 process Effects 0.000 claims abstract description 7
- 238000012545 processing Methods 0.000 claims description 20
- 238000004891 communication Methods 0.000 claims description 15
- 238000006243 chemical reaction Methods 0.000 claims description 13
- 230000003993 interaction Effects 0.000 claims description 9
- 238000012217 deletion Methods 0.000 claims description 2
- 230000037430 deletion Effects 0.000 claims description 2
- 238000003780 insertion Methods 0.000 claims description 2
- 230000037431 insertion Effects 0.000 claims description 2
- 230000006870 function Effects 0.000 abstract description 15
- 230000005540 biological transmission Effects 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 11
- 238000011161 development Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 239000003999 initiator Substances 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000006798 recombination Effects 0.000 description 1
- 238000005215 recombination Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Landscapes
- Television Signal Processing For Recording (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
Abstract
This invention relates to multi-media house network gate, which comprises the following parts: CPU, tuner, blue interface, AV output interface, FLASH memory with hardware initial codes and operation system core, Ethernet interface, infrared receiver, hardware, digital television receive module, record module, real-time program play back, step and pause module, multi-media management module, program index module, wireless connection module and middle parts. This invention adopts imbed operation system for strong data process function and establishes integral multi-media data process center for data transmission and memory.
Description
Technical Field
The invention relates to a home gateway, provides a concept of a Multimedia Home Gateway (MHG) and provides a design scheme and a specific implementation of the multimedia home gateway.
Background
Through the rapid development of decades, computers have smaller and smaller volumes, stronger and stronger performances, wider and wider application fields, simpler and simpler operation and cheaper prices. The original computer is bulky, the management operation is complex, and the maintenance is carried out by professional technicians, but now, ordinary people can quickly learn the basic computer operation. It (information technology) technology has evolved so dramatically that it has become a reality that computers have gone from the wealthy of large corporations and institutions to individual homes. With the development and the popularization of PC, notebook PC, PDA and Smart Phone, the development trend of computer from host to desktop to palm shows that the cost performance ratio of computer is rapidly improved, the field of computer function is gradually expanded to common families, and a revolution of household appliances is called. From older VCRs to Walkman to home Video cassette recorders VCR using magnetic cassettes to current Digital cameras, Digital Video, Digital TV and VCD, DVD players, multimedia products are moving from analog to Digital, and home users are increasingly demanding on multimedia processing capabilities. From the playing of simple audio and video to the comprehensive processing of sound, text and image information, how to improve the multimedia data processing capability inside a family becomes a difficult problem to be solved urgently. The embedding of the computation provides a good solution to this problem. The embedding of the calculation is to expand the calculation into the devices which do not have the calculation originally (such as a television, a telephone, an air conditioner, a microwave oven and the like), and the embedding greatly expands the meaning of the computer. With the improvement of the processing capacity of the embedded chip, the processing capacity of the multimedia data in the home can be correspondingly improved.
On the other hand, the rapid development of the Internet interconnects the world, ubiquitous networks and ubiquitous computing become the trend of computer technology development, and families have played the role of "terminals" in the Internet. However, with the emergence of digital home appliances, the demand for information communication inside the home is increasing, and a home network system is urgently needed to meet the increasing demand for information communication. The home network system connects various information-related communication devices, household appliances and security devices in a home to a home intelligent system through a home bus technology to perform centralized or remote monitoring, control and home affair management, and keeps organic connection among various devices in the home to keep harmony and coordination of the home facilities and the residential environment. Through the home network system, the management, the use and the maintenance of the household appliances are more centralized, convenient and intelligent.
Disclosure of Invention
The invention aims to provide a multimedia home gateway, which provides a strong data processing function through an embedded system, establishes a uniform multimedia data processing center in a home, and can manage the transmission and storage of multimedia data in the home through a home network.
The invention relates to a multimedia home gateway based on an embedded system, which comprises: an embedded processor (CPU), a tuner, a Bluetooth interface, and an AV output interface connected to the CPU, and,
FLASH memory, which is connected with CPU through External Bus Interface Unit (EBIU), and the internal memory stores the initial hardware initialization code and the kernel of operating system,
an Ethernet interface connected with the CPU through the EBIU,
an infrared receiver connected with the CPU for receiving the signal from the remote controller,
a hard disk connected with the CPU via an IDE interface,
also comprises the following steps of (1) preparing,
the digital television receiving module outputs the input digital television signal from the AV output interface after demodulation, demultiplexing, decoding and digital-to-analog conversion processing in sequence;
the digital television recording and storing module demodulates the input digital television signal, and then decodes the video and audio data streams of the selected program from at least two channels through the multi-channel demultiplexer, wherein the video and audio data streams output by the first channel are sent to the decoder for decoding, then are output from the AV output interface after digital coding and digital-to-analog conversion, and the same video and audio data streams output by the second channel are stored in the hard disk;
the module is used for controlling the playback and fast forward at will by a user at any time when the television program is played, playing the television segments which are not clearly seen or repeatedly watching the favorite wonderful shots;
the multimedia library management module is used for managing the video and audio data stored on the hard disk;
the electronic program guide module provides preview information of television programs for users, and is convenient for the users to select programs which the users want to watch, listen or want to participate in;
the wireless connection module based on Bluetooth is used for realizing the control of a home internal network, and the communication mode is single-point one-way communication;
and the middleware provides standard API interface call for the application program upwards, accesses hardware through system call downwards and obtains hardware resources required by the operation of the application program.
The invention also provides a digital television recording method for the multimedia home gateway, which comprises the following steps: demodulating the input digital television signal, demodulating the video and audio data streams of the selected program from at least two channels by a multi-channel demultiplexer, wherein the video and audio data stream output by one channel is sent to a decoder for decoding, then is output from an AV output interface after digital coding and digital-to-analog conversion, and the same video and audio data stream output by the second channel is stored in a hard disk.
The above method may further comprise: the multichannel demultiplexer decodes the same video and audio data stream through the third channel, and the video and audio data stream decoded by the third channel is sent to a standard IEEE1394 interface or a USB interface through a PLB bus and is used for storing program data into a mobile storage device connected with the IEEE1394 interface or the USB interface.
The invention also provides a method for realizing real-time program playback, fast forward and pause in any time slot for the multimedia home gateway, and a user can randomly control playback and fast forward by using the method to play an unobserved television segment or repeatedly watch favorite wonderful shots at any time when a television program is played, and the specific realization method comprises the following steps:
the method for realizing the playback comprises the following steps,
a certain space of cache area is opened up on the local hard disk,
processing the input digital television signal and outputting the same video and audio data streams from two channels of the multi-channel demultiplexer, wherein the video and audio data stream output by the first channel is sent to a decoder for decoding, is output from an AV output interface after digital coding and digital-to-analog conversion, the same video and audio data stream output by the second channel is recorded in the buffer area on the hard disk in real time and updates the buffer area in real time,
when a user sends a playback request through a human-computer interaction interface, the system finds a playback starting position specified by the user in the video and audio data of the program recorded in the cache area on the hard disk, directs the input of a video and audio decoder to the EBIU, and the hard disk sends a video and audio data stream to the video and audio decoder through the EBIU to start playing the program from the position specified by the user,
when the playback mode exits, the system redirects the input of the video and audio decoder back to the first channel of the demultiplexer, continues to read the video and audio data from the demultiplexer, and restores to normal play;
the method for implementing fast forward comprises the steps of,
in a playback mode, a user sends a fast forward request through a human-computer interaction interface, a system finds a fast forward starting position appointed by the user in program video and audio data recorded in a cache region on the hard disk, the hard disk sends a video and audio data stream to a video and audio decoder through an EBIU, and the program is played from the position appointed by the user;
the implementation method of the pause comprises the steps of,
the user sends a pause request through the man-machine interaction interface,
the system controls the first channel of the demultiplexer to stop demultiplexing, so that the decoder fixedly outputs the received last frame image to the television, simultaneously, a buffer area with a certain space is opened up on the local hard disk, the audio and video signal stream output by the second channel of the demultiplexer is recorded into the buffer area,
when the user cancels the pause, the system firstly directs the input of the video and audio decoder to the EBIU, and the local hard disk transmits the data stream to the video and audio decoder through the EBIU, and the program is played from the pause position.
The multimedia home gateway of the invention adopts an embedded operating system to provide a powerful data processing function, establishes a uniform multimedia data processing center in the home and can manage the transmission and storage of the multimedia data in the home through the home network. Its functions include: digital television reception, digital television recording and storage, real-time program playback at any time period, fast forward, pause, media library management, electronic program guide service, management and control of various digital home appliances, Web browsing, Email transmission and reception, and the like.
Drawings
Fig. 1 is a general structural diagram of a multimedia home gateway according to the present embodiment;
fig. 2 is a system data flow diagram of the multimedia home gateway according to the embodiment;
fig. 3 is a schematic block diagram of the multimedia home gateway according to the embodiment;
fig. 4 is a schematic block diagram of a digital tv receiving module in the multimedia home gateway according to the embodiment;
fig. 5 is a schematic block diagram of a digital tv recording and storing module in the multimedia home gateway according to the embodiment;
fig. 6 is a flowchart of bluetooth communication in the multimedia home gateway according to the embodiment;
fig. 7 is a schematic block diagram of playback of a real-time program in the multimedia home gateway according to this embodiment in any time period;
fig. 8 is a schematic block diagram of a multimedia library management module in the multimedia home gateway according to the embodiment;
fig. 9 is a flowchart of parsing EPG basic information in the multimedia home gateway according to this embodiment;
fig. 10 is a software architecture diagram of the multimedia home gateway according to the embodiment;
fig. 11 is a software development flowchart of the multimedia home gateway according to the embodiment;
fig. 12 is a schematic diagram of a system initialization process of the multimedia home gateway according to this embodiment.
Detailed description of the preferred embodiments
The invention provides a concept of a Multimedia Home Gateway (MHG), functional modules and a system structure of a multimedia home gateway system are designed according to application requirements, system analysis is carried out according to the functional modules and the system structure, and main chips of all the functional modules are determined. A hardware system conforming to the functional module of the multimedia home gateway system is designed. The software structure of the whole multimedia home gateway system is planned from the whole, and the hardware initialization code, the embedded operating system, the middleware and the upper application program are arranged from bottom to top in sequence. The initial hardware initialization code Openbios is realized, the necessity of the embedded operating system to the multimedia home gateway system is analyzed, and the overall design of the upper-layer application software is carried out on the basis.
Based on the continuously developing and updated concept of "digital home" (3C converged application mode, converged three services, three networks, three personal information terminals in one stove), the MHG should be a multimedia processing center, which should have the capability of processing various media information, and in addition to the basic functions of receiving digital tv, the MHG should also have the following media processing functions:
(1) and receiving and processing basic control instruction data.
(2) And storing, coding and decoding image graphic data.
(3) The storage, decoding and playing of the digital video and audio data and even the conversion coding between different code rates and coding formats.
(4) Browsing Web and receiving and transmitting Email.
(5) Certain game functions.
In addition to serving as a media processing center, it is desirable that the MHG can serve as a connection control center for various digital home appliances in a home, manage and control various digital home appliances, and even be considered to serve as a transfer station for remote home monitoring, which is a genuine gateway.
MHG requirements for hardware platform:
(1) and (4) stronger processing capacity.
(2) Multimedia processing capabilities.
(3) Abundant peripheral interfaces.
MHG requirements for software platform:
(1) the resource requirements are minimized.
(2) The operating efficiency is maximized.
(3) And (4) real-time performance.
(4) And (4) expandability.
The multimedia home gateway of the present embodiment is described in detail below with reference to the accompanying drawings.
Fig. 1 shows a general structural diagram of the MHG of the present embodiment. It is divided into hardware, hardware driver, system software and application layer.
Fig. 2 shows a system data flow diagram of the MHG. The external input of the MHG system comprises: satellite (or cable) digital television signals, user input, ethernet input; and outputting the data to TV or Ethernet of various standard systems.
Referring to fig. 3, the multimedia home gateway includes: an embedded processor (CPU) STB405, a tuner connected to the CPU, a bluetooth interface, an SDRAM memory, and an AV output interface, and,
FLASH memory, which is connected with CPU through External Bus Interface Unit (EBIU), and the internal memory stores the initial hardware initialization code and the kernel of operating system,
an Ethernet interface connected with the CPU through the EBIU,
an infrared receiver connected with the CPU for receiving the signal from the remote controller,
the hard disk is connected with the CPU through an IDE interface;
also comprises the following steps of (1) preparing,
a digital television receiving module, referring to fig. 4, that outputs the input digital television signal from the AV output interface after demodulation, demultiplexing, decoding, and digital-to-analog conversion in sequence;
a digital television recording and storing module, referring to fig. 5, demodulating the input digital television signal, and then decoding the video and audio data streams of the selected program from at least two channels by using a multi-channel demultiplexer, wherein the video and audio data streams output by the first channel are sent to a decoder for decoding, then output from an AV output interface after digital coding and digital-to-analog conversion, and the same video and audio data streams output by the second channel are stored in a hard disk; the multichannel demultiplexer also decodes the same video and audio data stream through a third channel, and the video and audio data stream decoded by the third channel is sent to a standard IEEE1394 interface or a USB interface through a PLB bus and is used for storing program data into a mobile storage device connected with the IEEE1394 interface or the USB interface;
the module is used for controlling the playback and fast forward at will by a user at any time when the television program is played, playing the television segments which are not clearly seen or repeatedly watching the favorite wonderful shots;
the multimedia library management module is used for managing the video and audio data stored on the hard disk;
the electronic program guide module provides preview information of television programs for users, and is convenient for the users to select programs which the users want to watch, listen or want to participate in;
the wireless connection module based on bluetooth, referring to fig. 6, is used for realizing the control of the home internal network, and the communication mode is single-point one-way communication, namely: a request initiator firstly calls a Service Discovery Protocol (SDP) of a local Bluetooth module to search for a pair-capable Bluetooth device in a certain radio frequency range, and records a Bluetooth address after the search is successful; meanwhile, an initiator retrieves available services of a responder, establishes connection, then sends a communication data packet by a serial port simulation protocol (RFcomm), the data packet is encapsulated into a Bluetooth packet by a logic connection and adaptation control protocol (L2CAP) and a connection management protocol (LMP), packet transmission is carried out by a communication link established by a baseband protocol, the responder receives the data packet, decapsulates and analyzes the packet header, recovers the original communication data packet, then sends the packet to a response program, processes the packet and then sends a corresponding data packet to the initiator;
and the middleware provides standard API interface call for the application program upwards, accesses hardware through system call downwards and obtains hardware resources required by the operation of the application program.
The multimedia home gateway also comprises an IEEE1394 interface and a USB interface, wherein a multichannel demultiplexer of the digital television recording storage module resolves the same video and audio data stream through a third channel, and the video and audio data stream resolved by the third channel is sent to the standard IEEE1394 interface or the USB interface through a PLB bus. The USB interface can also be used for completing functions such as household appliance control and the like.
The multimedia home gateway also comprises an intelligent card which is connected with the CPU to realize condition receiving.
The STB04500 provides a serial interface module, and is assisted by an SP3243 level conversion chip to complete the function.
In the multimedia home gateway of this embodiment, the embedded os is an embedded Linux os, the embedded processor employs an IBM STB04500 microprocessor, and the STB04500 microprocessor is embedded in a PowerPC405D4 kernel, which integrates a 16KB instruction cache and a 16KB data cache. The SDRAM memory provides the memory for system operation, and is an MT48LC16M16A24 chip from MICRON. The FLASH memory is used for storing initial hardware initialization code and an operating system kernel, if the FLASH is large enough (or the file system program is cut small enough), the whole file system can be considered to be placed in the FLASH, and because the MHG system comprises support for a hard disk, the FLASH part only selects 4MB FLASH of AMD company to store the initial hardware initialization code and the operating system kernel image. The STB04500 chip is matched with a FLASH memory and an SDRAM memory to complete basic data processing functions.
The audio frequency/analog conversion adopts CS4329-KS chip of CRYSTAL. The ethernet interface selects LAN91C111 as the ethernet control chip.
Infrared transmission/reception is One of The main means of user input, and All The One infrared remote controller and GP1U281 receiver are selected here.
Tuners are used for receiving satellite (cable) digital television signals and many alternatives are available on the market, where the full receive front end BS2F7VZ0624 tuner of the shrarp is chosen.
At present, the transport stream of digital tv is in MPEG2 standard coding format, MPEG2 decoding is required in MHG, this part of function is mainly completed by decoding module inside STB04500 chip, so no external decoding chip is needed, and of course, this function can be completed by external decoding chip.
IDE Interface and EBIU (external Bus Interface Unit) buffer circuitry. The IDE interface provides the system support for the hard disk, can be used for storing large-capacity media files, and provides hardware support for the implementation of PVR (personal Video recorder). The EBIU is a channel of the STB04500 externally connected with the SRAM, and supports 8 memory blocks at most, and each memory block can reach 128MB at most.
Referring to fig. 7, the real-time program playback at any time slot, fast forward, and pause module, the method for playing back the real-time program at any time slot includes:
a certain space of cache area is opened up on the local hard disk,
processing the input digital television signal and outputting the same video and audio data streams from two channels of a multi-channel demultiplexer, wherein the video and audio data stream output by the first channel is sent to a decoder for decoding, is output from an AV output interface after digital coding and digital-to-analog conversion, the same video and audio data stream output by the second channel is recorded in the cache area on the hard disk in real time and updates the cache area in real time according to a certain algorithm,
when a user sends a playback request through a human-computer interaction interface, the system finds a playback starting position specified by the user in the video and audio data of the program recorded in the cache area on the hard disk, directs the input of a video and audio decoder to the EBIU, and the hard disk sends a video and audio data stream to the video and audio decoder through the EBIU to start playing the program from the position specified by the user,
when the playback mode exits, the system redirects the input of the video and audio decoder back to the first channel of the demultiplexer, continues to read the video and audio data from the demultiplexer, and resumes normal play.
The above real-time program playback, fast forward, pause module in any time slot carries out fast forward method in any time slot of real-time program, which includes: in a playback mode, a user sends a fast forward request through a human-computer interaction interface, the system finds a fast forward starting position specified by the user in video and audio data of a program recorded in a cache area on the hard disk, and the hard disk sends a video and audio data stream to a video and audio decoder through an EBIU to start playing the program from the position specified by the user.
The above real-time program playback, fast forward, pause module in any time slot, the method for realizing pause includes:
the user sends a pause request through the man-machine interaction interface,
the system controls the first channel of the demultiplexer to stop demultiplexing, so that the decoder fixedly outputs the received last frame image to the television, simultaneously, a buffer area with a certain space is opened up on the local hard disk, the audio and video signal stream output by the second channel of the demultiplexer is recorded into the buffer area,
when the user cancels the pause, the system firstly directs the input of the video and audio decoder to the EBIU, and the local hard disk transmits the data stream to the video and audio decoder through the EBIU, and the program is played from the pause position.
Referring to fig. 8, the multimedia library management module manages multimedia data stored on the hard disk in a manner of combining a file system with a relational database, the multimedia data being stored in the file system, and the media type, application name, media attribute, keyword, etc. being stored in the relational database. The data units in the figure are the basic units of a relational database for performing various processes, and each data unit generally comprises two parts: a data structure containing various attributes of media data and a multimedia file. This data structure containing the attributes can also be considered as a header of multimedia data, which contains the following fields:
ID: the attribute field and numerical data of the multimedia data can be uniquely marked in the database.
name: name of multimedia data, character string.
type: the multimedia data includes multimedia file types such as video files, audio files, image files, and the like.
content: a brief introduction of the content of a multimedia file, a piece of text.
size: the size of the multimedia data.
And (3) date: date of multimedia data creation.
And dir: the absolute path of the multimedia file contained in the file system.
owner: the user to which the multimedia file belongs.
ext: fields for augmenting other temporary attributes.
The header of the multimedia data is treated as a sub item of the table in the relational database, all multimedia data in the MHG use uniform data header, and the attribute fields are the same, so that only one large table is needed, the ID field in the table is used as a main key field, and the operations of inserting, inquiring, sorting, deleting and the like can be conveniently and efficiently carried out through the operation of the relational database.
Multimedia files in the multimedia data are stored in a hard disk of the MHG and are managed through a file system. The data header and the multimedia file are associated through a dir attribute field of the data header. For query, sorting, etc. operations, no operations are performed on multimedia files in the file system. But for insert operations, first create a multimedia file in the file system, and then take the path of the file as a child in the dir attribute field creation table of the header. The deletion operation is basically the reverse order of the insertion operation, and needs to obtain the position of the multimedia file from the dir attribute field of the data header, delete the multimedia file through the file system, and finally delete the corresponding sub-entry in the table of the relational database.
The electronic Program guide module epg (electronic Program guide) provides preview information of tv programs for users, so that users can conveniently select programs that they want to watch, listen or participate in. Referring to fig. 9, in the MHG, the most basic functions of the EPG service are realized, that is, parsing and processing of the program Association table pat (program Association table) and the program Map table pmt (program Map table) in the channel service information data si (service information). The PAT table and the PMT table are extracted by a demultiplexer through a filter and a buffer queue, the PID number corresponding to the PMT can be obtained after the PAT table is analyzed, the PMT table is extracted, the PID number corresponding to the final ES (elementary stream) stream can be obtained after the PMT table is analyzed, and the final video and audio data stream or the user data stream can be filtered out through filter recombination. Further, the EPG allows a user to search according to the composition of a service-provided program.
The software system of the MHG is constructed on the basis of a bottom hardware system, the hardware system resources are called downwards through a driver, and rich interfaces are provided upwards to provide support for application software, as shown in fig. 10, the whole software system is sequentially OpenBios (i.e., board initialization program), an operating system, middleware, and an application program from bottom to top.
The whole software development process is carried out in a host/target board mode, a development environment of cross compiling is configured on the host, the host and the target board are communicated through JTAG, a serial port and Ethernet (JTAG is used for debugging and initial bare board code downloading, the serial port is used for communication and monitoring, the Ethernet is used for downloading files), program development and cross compiling are carried out on the host, and then the programs are downloaded to the target board for testing and running, and the basic development flow is shown in figure 11.
OpenBios plays the role of operating system wizards in the present multimedia home gateway. Referring to fig. 12, after the STB04500 is powered on, the PowerPC405 reads a first instruction from the address 0 xffffffffc, and at this time, the initialization code downloaded to the OpenBios image at the Flash bottom address starts to be executed sequentially, first initializes the control registers of MUXIO and GPIO, then initializes other function registers such as EBIU and SDRAM in sequence, and after completing basic hardware initialization, enters a menu to wait for a user to select an operation, or directly starts a kernel according to configuration.
The MHG system mainly has the following devices that need drivers: the device comprises a digital television signal tuning/demodulation receiving module, a transport stream demultiplexing module, an infrared signal receiving module, an on-screen display output module, a video decoder, an audio decoder, an EEPROM storage device, a digital encoder, a USB device, a Bluetooth device and the like.
In the embedded application, the middleware mainly plays a role in shielding the heterogeneity of bottom hardware and an operating system platform, and simultaneously provides a uniform standard API interface for upper-layer applications. The middleware in the MHG mainly aims at processing video and audio data and home network communication.
Claims (4)
1. The multimedia home gateway based on the embedded system is characterized by comprising: a CPU, a tuner connected to the CPU, a bluetooth interface, and an AV output interface, and,
the FLASH memory is connected with the CPU through an external bus interface unit, the internal part of the FLASH memory stores an initial hardware initialization code OpenBios and an operating system kernel,
an Ethernet interface connected with the CPU through an external bus interface unit,
an infrared receiver connected with the CPU for receiving the signal from the remote controller,
a hard disk connected with the CPU via an IDE interface,
further comprising:
the digital television receiving module outputs the input digital television signal from the AV output interface after demodulation, demultiplexing, decoding and digital-to-analog conversion processing in sequence;
the digital television records the memory module, the module demodulates the digital television signal input, and then solve the video audio data flow of the selected program from at least two channels by the multiplexer of the multichannel, wherein, the video audio data flow that the first channel outputs is sent to the audio decoder of the video, decode, export from AV output interface after digital coding, digital-to-analog conversion, the identical video audio data flow that the second channel outputs is sent to the interface unit of the external bus, and then store the video audio data to the hard disk through IDE interface by the interface unit of the external bus;
the module is used for controlling the playback and fast forward at will by a user at any time when the television program is played, playing the television segments which are not clearly seen or repeatedly watching the favorite wonderful shots; wherein,
the method for realizing the playback comprises the following steps:
a certain space of cache area is opened up on the local hard disk,
processing the input digital television signal and outputting the same video and audio data streams from two channels of the multi-channel demultiplexer, wherein the video and audio data stream output by the first channel is transmitted to a video and audio decoder for decoding, then is output from an AV output interface after digital coding and digital-to-analog conversion, the same video and audio data stream output by the second channel is recorded in the buffer area on the hard disk in real time and updates the buffer area in real time,
when a user sends a playback request through a human-computer interaction interface, the system finds a playback starting position appointed by the user in the program video and audio data recorded in the cache region on the hard disk, directs the input of a video and audio decoder to an external bus interface unit, the hard disk sends a video and audio data stream to the video and audio decoder through the external bus interface unit, starts playing the program from the position appointed by the user,
when the playback mode exits, the system redirects the input of the video and audio decoder to the first channel of the multi-channel demultiplexer, continues to read the video and audio data from the multi-channel demultiplexer, and restores to normal play;
the implementation method of fast forward comprises the following steps:
in a playback mode, a user sends a fast forward request through a human-computer interaction interface, a system finds a fast forward starting position appointed by the user in program video and audio data recorded in a cache region on the hard disk, the hard disk sends video and audio data streams to a video and audio decoder through an external bus interface unit, and the program is played from the position appointed by the user;
the method for realizing the pause comprises the following steps:
the user sends a pause request through the man-machine interaction interface,
the system controls the first channel of the multi-channel demultiplexer to stop demultiplexing, so that the video and audio decoder fixedly outputs the received last frame image to the television, simultaneously, a buffer area with a certain space is opened up on the local hard disk, the audio and video signal stream output by the second channel of the multi-channel demultiplexer is recorded into the buffer area,
when the user cancels the pause, the system firstly directs the input of the video-audio decoder to the external bus interface unit, the local hard disk transmits data stream to the video-audio decoder through the external bus interface unit, and the program is played from the pause position;
the multimedia management module manages multimedia data stored on a hard disk in a mode of combining a file system and a relational database, the multimedia data are stored and managed by the file system, a data head of the multimedia data is stored by the relational database, the data head is treated as a sub item of a table in the relational database, the data head is associated with the multimedia file through a dir attribute field of the data head, and the dir attribute refers to an absolute path of the contained multimedia file in the file system; the relational database performs various processes with data units as basic units, each data unit including: a data head containing various attributes of the multimedia data and a multimedia file; for query and sort operations, no operations are performed on multimedia files in the file system; for the insertion operation, firstly establishing a multimedia file in a file system, and then obtaining the path of the file as dir attribute fields of a data header to establish sub-items in a relational database table; for deletion operation, acquiring the position of the multimedia file from the dir attribute field of the data header, deleting the multimedia file through a file system, and finally deleting the corresponding sub-item in the table of the relational database;
the electronic program guide module provides preview information of television programs for users, and is convenient for the users to select programs which the users want to watch, listen or want to participate in;
the wireless connection module based on Bluetooth is used for realizing the control of a home internal network, and the communication mode is single-point one-way communication;
and the middleware provides standard API interface call for the application program upwards, accesses hardware through system call downwards and obtains hardware resources required by the operation of the application program.
2. The embedded system based multimedia home gateway of claim 1, wherein: the embedded operating system is an embedded Linux operating system.
3. The embedded system based multimedia home gateway of claim 1, wherein: the CPU is an IBM company STB04500 embedded processor.
4. The embedded system based multimedia home gateway of claim 1, wherein: the multichannel demultiplexer of the digital television recording storage module resolves the same video and audio data stream through a third channel, the video and audio data stream resolved by the third channel is sent to a standard IEEE1394 interface or a USB interface through a PLB bus, and a DMA control module is adopted for controlling the three channels.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100510640A CN100466695C (en) | 2006-12-08 | 2006-12-08 | Multimedia home gateway and its implementation method for program recording, recovery, suspension |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100510640A CN100466695C (en) | 2006-12-08 | 2006-12-08 | Multimedia home gateway and its implementation method for program recording, recovery, suspension |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1972395A CN1972395A (en) | 2007-05-30 |
| CN100466695C true CN100466695C (en) | 2009-03-04 |
Family
ID=38112951
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2004100510640A Expired - Fee Related CN100466695C (en) | 2006-12-08 | 2006-12-08 | Multimedia home gateway and its implementation method for program recording, recovery, suspension |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100466695C (en) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101998146A (en) * | 2009-08-10 | 2011-03-30 | 中兴通讯股份有限公司 | Media recommendation method, media control method and user gateway |
| JP5833034B2 (en) * | 2010-02-26 | 2015-12-16 | トムソン ライセンシングＴｈｏｍｓｏｎ Ｌｉｃｅｎｓｉｎｇ | System and method for synchronizing an electronic program guide with a paused program |
| CN102300060A (en) * | 2010-06-25 | 2011-12-28 | 深圳Tcl新技术有限公司 | Infrared control time-shifting system of television and time-shifting control method thereof |
| CN102036111A (en) * | 2010-11-18 | 2011-04-27 | 广州广联数字家庭产业技术研究院 | Home gateway and digital television as well as method for selecting programs by remotely controlling home gateway |
| FR2971111B1 (en) * | 2011-01-27 | 2013-01-18 | Viaccess Sa | METHOD FOR ACCESSING MULTIMEDIA CONTENTS IN A HOME |
| CN102185743A (en) * | 2011-03-24 | 2011-09-14 | 东莞中山大学研究院 | A Digital Home Network System Based on Intelligent Gateway |
| US10206014B2 (en) | 2014-06-20 | 2019-02-12 | Google Llc | Clarifying audible verbal information in video content |
| US9805125B2 (en) | 2014-06-20 | 2017-10-31 | Google Inc. | Displaying a summary of media content items |
| US9838759B2 (en) | 2014-06-20 | 2017-12-05 | Google Inc. | Displaying information related to content playing on a device |
| CN104994422B (en) * | 2015-07-02 | 2018-03-06 | 广东威创视讯科技股份有限公司 | Vision signal display methods and system |
| US10349141B2 (en) | 2015-11-19 | 2019-07-09 | Google Llc | Reminders of media content referenced in other media content |
| CN107770599B (en) * | 2017-10-27 | 2020-11-20 | 海信电子科技（深圳）有限公司 | Method and device for playing recorded audio and video and storage medium |
| CN110996160B (en) * | 2019-11-15 | 2022-10-28 | 广州方硅信息技术有限公司 | Video processing method and device, electronic equipment and computer readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020146233A1 (en) * | 1998-07-30 | 2002-10-10 | Barton James M. | Multimedia time warping system |
| EP1333670A2 (en) * | 2002-02-01 | 2003-08-06 | Canon Kabushiki Kaisha | Receiving apparatus and receiving method and storage medium |
| CN2586306Y (en) * | 2002-09-09 | 2003-11-12 | 中国科学院软件研究所 | Family gate |
| CN1459957A (en) * | 2002-05-18 | 2003-12-03 | 联想(北京)有限公司 | Digital home network system |
| CN1859551A (en) * | 2005-04-30 | 2006-11-08 | 联想(北京)有限公司 | Time translation realizing method based on multiple tuner system |
-
2006
- 2006-12-08 CN CNB2004100510640A patent/CN100466695C/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020146233A1 (en) * | 1998-07-30 | 2002-10-10 | Barton James M. | Multimedia time warping system |
| EP1333670A2 (en) * | 2002-02-01 | 2003-08-06 | Canon Kabushiki Kaisha | Receiving apparatus and receiving method and storage medium |
| CN1459957A (en) * | 2002-05-18 | 2003-12-03 | 联想(北京)有限公司 | Digital home network system |
| CN2586306Y (en) * | 2002-09-09 | 2003-11-12 | 中国科学院软件研究所 | Family gate |
| CN1859551A (en) * | 2005-04-30 | 2006-11-08 | 联想(北京)有限公司 | Time translation realizing method based on multiple tuner system |
Non-Patent Citations (6)
| Title |
|---|
| 基于SC2005的数字机顶盒PVR功能实现. 冯卓明，刘卫忠，郑立新.有线电视技术，第148期. 2004 |
| 基于SC2005的数字机顶盒PVR功能实现. 冯卓明，刘卫忠，郑立新.有线电视技术，第148期. 2004 * |
| 家庭网络中蓝牙技术的研究与实施. 韩江洪，黄丽，张利，张建军.合肥工业大学学报，第26卷第4期. 2003 |
| 家庭网络中蓝牙技术的研究与实施. 韩江洪，黄丽，张利，张建军.合肥工业大学学报，第26卷第4期. 2003 * |
| 数字电视机顶盒PVR功能和用户界面的设计与实现. 杨春霞.天津大学硕士学位论文. 2004 |
| 数字电视机顶盒PVR功能和用户界面的设计与实现. 杨春霞.天津大学硕士学位论文. 2004 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1972395A (en) | 2007-05-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101325666B (en) | Telecontrol system for intelligent mobile terminal television | |
| US8327410B2 (en) | Networked-enabled mass storage dongle with networked media content aggregation | |
| CN100466695C (en) | Multimedia home gateway and its implementation method for program recording, recovery, suspension | |
| CN103402134B (en) | The system of association, customization and the automation of content from multiple sources on individual monitor, method and apparatus | |
| US20120197977A1 (en) | Information processing apparatus, information processing method, and program | |
| CN102572606A (en) | Streaming digital content with flexible remote playback | |
| US20040143622A1 (en) | Information processing apparatus and communication control method for use in the apparatus | |
| WO2000065835A1 (en) | Image recording system | |
| US20040205220A1 (en) | Information processing apparatus and data transfer method for use in the same | |
| US20100040212A1 (en) | Information processing apparatus, information processing method and information processing system | |
| CN101742065B (en) | Integrated set-top box device and integration method thereof | |
| CN101068305B (en) | Remote control device, multimedia system and method for operating mobile storage device | |
| CN114566144A (en) | Voice recognition method and device, server and electronic equipment | |
| CN101562708A (en) | Television capable of recording and playing | |
| WO2025167638A1 (en) | Display device and audio playback method | |
| US20100174825A1 (en) | Internet radio systems and methods thereof | |
| CN101465882A (en) | Playback method and playback system of contents | |
| WO2014161420A1 (en) | Television data card, television playing system and method for playing television programmes | |
| US20080192658A1 (en) | Media distribution system with wireless local area network module | |
| CN101222591A (en) | TV channel switching and jumping method of intelligent mobile terminal TV remote control system | |
| KR101501923B1 (en) | Method and system for Adaptive Data Transmission based on DLNA network | |
| JP2008271393A (en) | Data record transfer device, data record transfer method, and data record transfer program | |
| CN101340250A (en) | Broadcast scheduling method and broadcast receiving device using the method | |
| CN103037267B (en) | The method of handover network video, system and intelligent terminal between multiple intelligent terminal | |
| KR100678901B1 (en) | Apparatus and method for playing media content on a portable storage device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090304 Termination date: 20191208 |