US20140146195A1 - Data processing apparatus for transmitting/receiving compression-related indication information via camera interface and related data processing method - Google Patents
Data processing apparatus for transmitting/receiving compression-related indication information via camera interface and related data processing method Download PDFInfo
- Publication number
- US20140146195A1 US20140146195A1 US13/965,210 US201313965210A US2014146195A1 US 20140146195 A1 US20140146195 A1 US 20140146195A1 US 201313965210 A US201313965210 A US 201313965210A US 2014146195 A1 US2014146195 A1 US 2014146195A1
- Authority
- US
- United States
- Prior art keywords
- data processing
- interface
- indication information
- bitstream
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H04N5/23241—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/12—Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/815—Camera processing pipelines; Components thereof for controlling the resolution by using a single image
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/325—Power saving in peripheral device
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/325—Power saving in peripheral device
- G06F1/3278—Power saving in modem or I/O interface
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/154—Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/179—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scene or a shot
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/184—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/65—Control of camera operation in relation to power supply
- H04N23/651—Control of camera operation in relation to power supply for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/02—Handling of images in compressed format, e.g. JPEG, MPEG
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Definitions
- the disclosed embodiments of the present invention relate to transmitting and receiving multimedia data over a camera interface, and more particularly, to a data processing apparatus for transmitting/receiving compression-related indication information via a camera interface and related data processing method.
- a camera interface is disposed between a first chip and a second chip to transmit multimedia data from the first chip to the second chip for further processing.
- the first chip may include a camera module
- the second chip may include an image signal processor (ISP).
- the multimedia data may include image data (i.e., a single still image) or video data (i.e., a video sequence composed of images).
- image data i.e., a single still image
- video data i.e., a video sequence composed of images.
- the camera module and the ISP are both located at a portable device (e.g., a smartphone) powered by a battery device, the battery life is shortened due to the increased power consumption of the camera interface.
- a portable device e.g., a smartphone
- the battery life is shortened due to the increased power consumption of the camera interface.
- a data processing apparatus for transmitting/receiving compression-related indication information via a camera interface and related data processing method are proposed.
- an exemplary data processing apparatus has a compressor and an output interface.
- the compressor is arranged for generating a compressed multimedia data by compressing a multimedia data according to a compression algorithm.
- the output interface is arranged for recording indication information in an output bitstream and outputting the output bitstream via a camera interface, wherein the output bitstream is derived from the compressed multimedia data, and the indication information is set in response to the compression algorithm employed by the compressor.
- an exemplary data processing apparatus has a de-compressor and an input interface.
- the de-compressor is arranged for de-compressing a compressed multimedia data derived from an input bitstream.
- the input interface is arranged for receiving the input bitstream via a camera interface, parsing indication information included in the input bitstream, and configuring the de-compressor to employ a de-compression algorithm as indicated by the indication information.
- an exemplary data processing method includes at least the following steps: generating a compressed multimedia data by compressing a multimedia data according to a compression algorithm; and recording indication information in an output bitstream and outputting the output bitstream via a camera interface, wherein the output bitstream is derived from the compressed multimedia data, and the indication information is set in response to the compression algorithm.
- an exemplary data processing method includes at least the following steps: de-compressing a compressed multimedia data derived from an input bitstream; and receiving the input bitstream via a camera interface, parsing indication information included in the input bitstream, and configuring the de-compressing step to employ a de-compression algorithm as indicated by the indication information.
- FIG. 1 is a block diagram illustrating a data processing system according to an embodiment of the present invention.
- FIG. 2 is a diagram illustrating a data structure of the output bitstream generated from the camera module to the ISP according to an embodiment of the present invention.
- FIG. 3 is a diagram illustrating an example of information handshaking between the camera module and the ISP.
- FIG. 4 is a flowchart illustrating a control and data flow of the data processing system shown in FIG. 1 when interface compression is enabled.
- FIG. 5 is a block diagram illustrating a data processing system according to another embodiment of the present invention.
- FIG. 6 is a diagram illustrating a data structure of the output bitstream generated from the camera module to the ISP according to another embodiment of the present invention.
- FIG. 7 is a flowchart illustrating a control and data flow of the data processing system shown in FIG. 5 when interface compression is enabled.
- the present invention proposes applying data compression to a multimedia data and then transmitting a compressed multimedia data over a camera interface.
- the data size/data rate of the compressed multimedia data is smaller than that of the original un-compressed multimedia data, the power consumption of the camera interface is reduced correspondingly.
- the de-compression algorithm employed by a receiving end which receives and de-compresses a compressed multimedia data is required to be compliant with the compression algorithm employed by a transmitting end which generates and transmits the compressed multimedia data; otherwise, the receiving end fails to correctly de-compress the compressed multimedia data. Therefore, the present invention further proposes transmitting/receiving the compression-related indication information via the camera interface, such that the de-compression algorithm of the receiving end is properly configured based on the compression-related indication information. Further details will be described as below.
- FIG. 1 is a block diagram illustrating a data processing system according to an embodiment of the present invention.
- the data processing system 100 includes a plurality of data processing apparatuses such as a camera module 102 and an image signal processor (ISP) 104 .
- the camera module 102 and the ISP 104 may be different chips, and the camera module 102 communicates with the ISP 104 via a camera interface 103 .
- the camera interface 103 may be a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- CSI camera serial interface
- MIPI Mobile Industry Processor Interface
- the camera module 102 is coupled to the camera interface 103 , and supports un-compressed data transmission and compressed data transmission.
- the camera module 102 When the camera module 102 is used to transmit un-compressed data to the ISP 104 , the camera module 102 generates the un-compressed multimedia data D 1 according to an input multimedia data derived from capturing the incident light, and transmits the un-compressed multimedia data D 1 over the camera interface 103 .
- the camera module 102 is used to transmit compressed data to the ISP 104 , the camera module 102 generates a compressed multimedia data D 1 ′ according to the input multimedia data derived from capturing the incident light, and transmits the compressed multimedia data D 1 ′ over the camera interface 103 .
- the input multimedia data obtained by capturing the incident light and used for generating the un-compressed multimedia data D 1 /compressed multimedia data D 1 ′ may be an image data or a video data.
- the camera module 102 includes a camera controller 112 , an output interface 114 and a processing circuit 116 .
- the processing circuit 116 includes circuit elements required for processing the input multimedia data to generate the un-compressed data D 1 or the compressed data D 1 ′.
- the processing circuit 116 has a compressor 117 and other circuitry 118 , where the other circuitry 118 may have a lens module, a camera sensor, a camera buffer, multiplexer(s), etc.
- the lens module guides the incident light to the camera sensor, and the camera sensor obtains the input multimedia data correspondingly.
- the input multimedia data obtained by the camera sensor may be a single captured image or a video sequence composed of a plurality of captured images.
- the input multimedia data obtained by the camera sensor may be single view data for 2D display or multiple view data for 3D display.
- the camera buffer is arranged to buffer the input multimedia data obtained by the camera sensor.
- the compressor 117 performs data compression.
- the multiplexer receives the un-compressed multimedia data D 1 and the compressed multimedia data D 1 ′, and selectively outputs the un-compressed multimedia data D 1 or the compressed multimedia data D 1 ′ according to the operation mode of the camera module 102 .
- the camera controller 112 controls the operation of the camera module 102 .
- the multiplexer When the camera module 102 is operated under a compression mode, the multiplexer outputs the compressed multimedia data D 1 ′; and when the camera module 102 is operated under a non-compression mode, the multiplexer outputs the un-compressed multimedia data D 1 .
- the present invention focuses on the handshaking mechanism between the camera module 102 and the ISP 104 , further description of the other circuit 118 is omitted here for brevity.
- the output interface 114 is arranged for packing/packetizing the un-compressed multimedia data D 1 /compressed multimedia data D 1 ′ into an output bitstream according to the transmission protocol of the camera interface 103 , and transmits the output bitstream to the ISP 104 via the camera interface 103 .
- the compressor 117 When the compression mode of the camera module 102 is enabled, the compressor 117 further sets indication information INFO in response to the compression algorithm employed. Besides, the output interface 114 further records the indication information INFO in the output bitstream. In this way, when the output bitstream is transmitted from the camera module 102 to the ISP 104 , the compression-related indication information (e.g., the indication information INFO) is also transmitted via the camera interface 103 .
- the ISP 104 it communicates with the camera module 102 via the camera interface 103 .
- the ISP 104 is coupled to the camera interface 103 , and supports un-compressed data reception and compressed data reception.
- the camera module 102 transmits the un-compressed data D 1 to the ISP 104
- the ISP 104 is operated under a non-decompression mode to receive an un-compressed data D 2 from the camera interface 103 , generate a processed multimedia data according to the un-compressed data D 2 , and send the processed multimedia data to one or multiple processors, such as a display processor 106 _ 1 , a video processor 106 _ 2 , and/or a graphic processor 106 _ 3 , for further processing.
- the ISP 104 When the camera module 102 transmits the compressed data D 1 ′ to the ISP 104 , the ISP 104 is operated under a de-compression mode to receive a compressed multimedia data D 2 ′ from the camera interface 103 , generate a processed multimedia data according to the compressed data D 2 ′, and send the processed multimedia data to one or multiple processors, such as the display processor 106 _ 1 , the video processor 106 _ 2 , and/or the graphic processor 106 _ 3 , for further processing.
- processors such as the display processor 106 _ 1 , the video processor 106 _ 2 , and/or the graphic processor 106 _ 3 , for further processing.
- the un-compressed data D 1 transmitted under the non-compression mode should be identical to the un-compressed data D 2 received under the non-decompression mode, and the compressed data D 1 ′ transmitted under the compression mode should be identical to the compressed data D 2 ′ received under the de-compression mode.
- the ISP 104 includes an ISP controller 122 , an input interface 124 and a processing circuit 126 .
- the processing circuit 126 may include circuit elements required for generating the processed multimedia data according to an internal transmission mode (e.g., an on-the-fly mode or an off-line mode).
- the other circuitry 128 may have a write direct memory access (DMA) controller, a read DMA controller, an image processor, multiplexers, etc.
- the de-compressor 127 generates the de-compressed multimedia data by de-compressing the compressed multimedia data D 2 ′ according to a de-compression algorithm, where the compressed multimedia data D 2 ′ is derived from an input bitstream received from the camera interface 103 .
- the write DMA controller is arranged for storing a multimedia data into an external image buffer of the ISP 104 , where the multimedia data may be an un-compressed multimedia data, a compressed multimedia data or a de-compressed multimedia data.
- the read write DMA controller is arranged for reading a buffered multimedia data from the external image buffer of the ISP 104 .
- the image processor is arranged to support several image processing operations, including resizing/scaling, rotation, quality enhancement, etc., where the processed multimedia data is generated from the image processor.
- the multiplexers control interconnections of the de-compressor 127 , the image processor, the write DMA controller, and the read DMA controller. As the present invention focuses on the handshaking mechanism between the camera module 102 and the ISP 104 , further description of the other circuitry 128 is omitted here for brevity.
- the input interface 124 is arranged for receiving the input bitstream from the camera interface 103 , and un-packing/un-packetizing the input bitstream into un-compressed multimedia data D 2 /compressed multimedia data D 2 ′ according to the transmission protocol of the camera interface 103 .
- the input interface 124 is further arranged for parsing the indication information INFO included in the input bitstream, and configuring the de-compressor 127 to employ a de-compression algorithm as indicated by the indication information INFO.
- information handshaking is realized through the camera interface 103 . Therefore, with the help of the indication information INFO supplied from the camera module 102 , the de-compressor 127 of the ISP 104 is properly configured to employ an adequate de-compression algorithm needed for de-compressing the compressed data D 2 ′ correctly.
- the output interface 114 records the indication information INFO by setting a command set in a payload portion of the output bitstream transmitted over the camera interface 103
- the input interface 124 obtains the indication information INFO by parsing a command set in a payload portion of the input bitstream received from the camera interface 103 .
- FIG. 2 is a diagram illustrating a data structure of the output bitstream generated from the camera module 102 to the ISP 104 according to an embodiment of the present invention.
- the information handshaking between the camera module 102 and the ISP 104 may be realized by defining a set of commands in the transmitted payload.
- these commands can be specified in vendor-specific commands based on MIPI camera command set (CCS) specification, where each command in a command set may be an 8-bit code, and the command set can be used to communicate between the camera module 102 and the ISP 104 about the compression capability and compression/de-compression algorithms they support.
- CCS MIPI camera command set
- FIG. 3 is a diagram illustrating an example of information handshaking between the camera module 102 and the ISP 104 .
- the compressor 117 supports four compression algorithms
- the de-compressor 127 supports four de-compression algorithms compliant with the compression algorithms, respectively.
- the different compression algorithms may handle different compression ratios, different compression unit sizes, different color formats (e.g.
- the indication information INFO is adjusted when at least one of a compression ratio, a compression unit size, a color format, and a bit depth of a compression algorithm employed is changed.
- the camera module 102 may check a de-compression capability of the ISP 104 by sending a request to the ISP 104 through the camera interface 103 , and the ISP 104 may inform the camera module 102 of its de-compression capability by sending a response to the camera module 102 through the camera interface 103 .
- the camera module 102 can detect whether the ISP 104 has the ability of performing data de-compression, and can further detect what kinds of de-compression algorithms the ISP 104 supports if the ISP 104 is equipped with the de-compression capability.
- the compressor 117 at the camera module 102 is configured to use the compression algorithm #4, and the indication information INFO is set correspondingly.
- the indication information INFO is carried by the command set transmitted from the camera module 102 to the ISP 104 via the camera interface 103 .
- the ISP 104 receives the indication information INFO through the camera interface 103 , and configures the de-compressor 127 to employ the de-compression algorithm #4 as indicated by the indication information INFO.
- FIG. 4 is a flowchart illustrating a control and data flow of the data processing system 100 shown in FIG. 1 when interface compression is enabled. Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown in FIG. 4
- the exemplary control and data flow may be briefly summarized by following steps.
- Step 400 Start.
- Step 402 Configure the compressor 117 to employ a compression algorithm.
- Step 404 Set the indication information INFO in response to the compression algorithm employed by the compressor 117 .
- Step 406 Record the indication information INFO in an output bitstream.
- the indication information INFO is recorded by setting a command set in a payload portion of the output bitstream.
- Step 408 Transmit the output bitstream over the camera interface 103 .
- Step 410 Receive an input bitstream from the camera interface 103 .
- Step 412 Parse the indication information INFO included in the input bitstream.
- the indication information INFO is obtained by parsing a command set in a payload portion of the input bitstream.
- Step 414 Configure the de-compressor 127 to employ a de-compression algorithm as indicated by the indication information INFO.
- Step 416 End.
- steps 402 - 408 are performed by the camera module 102
- steps 410 - 414 are performed by the ISP 104 .
- steps 402 - 408 are performed by the camera module 102
- steps 410 - 414 are performed by the ISP 104 .
- FIG. 5 is a block diagram illustrating a data processing system according to another embodiment of the present invention.
- the data processing system 500 includes a channel detector 502 , a channel controller 504 , and a plurality of data processing apparatuses such as the aforementioned camera module 102 and ISP 104 shown in FIG. 1 .
- the output stream generated from the camera module 102 may be composed of interleaved data streams with different data formats.
- the camera module 102 may have multiple camera sensors and support different compression algorithms.
- a first data stream included in the output stream is generated based on a first compression algorithm and an input multimedia data obtained by a first camera sensor using a first color format (e.g., Bayer); and a second data stream included in the output stream is generated based on a second compression algorithm and an input multimedia data obtained by a second camera sensor using a second color format (e.g., RGBW).
- a first color format e.g., Bayer
- a second data stream included in the output stream is generated based on a second compression algorithm and an input multimedia data obtained by a second camera sensor using a second color format (e.g., RGBW).
- the camera module 102 assigns different channel identification (ID) numbers to the first stream and the second stream.
- ID channel identification
- the virtual channel is to provide separate channels (e.g., 506 _ 1 and 506 _ 2 ) for different data flows that are interleaved in the data stream transmitted over the camera interface 103 .
- the receiving end will monitor the channel ID numbers and de-multiplex the interleaved data streams (e.g., the aforementioned first data stream and second data stream) to their appropriate channels 506 _ 1 , 506 _ 2 .
- the channel controller 504 is arranged to direct data streams to individual channels 506 _ 1 , 506 _ 2 under the control of the channel detector 502 .
- the output interface 114 of the camera module 102 is further arranged for recording a channel ID number ID CH in a header portion of the output bitstream to indicate which one of the channels 506 _ 1 , 506 _ 2 should be connected for receiving the output bitstream.
- FIG. 6 is a diagram illustrating a data structure of the output bitstream generated from the camera module 102 to the ISP 104 according to another embodiment of the present invention.
- the information handshaking between the camera module 102 and the ISP 104 is realized by defining a set of commands in the transmitted payload.
- the channel detector 502 is implemented for receiving an input bitstream from the camera interface 103 , and identifying the channel ID number ID CH from the header portion of the input bitstream.
- the channel controller 504 dispatches the input bitstream, including the header portion and the payload portion shown in FIG. 6 , to a selected channel with the channel ID number ID CH .
- the information handshaking as illustrated in FIG. 3 for configuring the compression and de-compression algorithms is also performed between the camera module 102 and the ISP 104 . Further description is omitted here for brevity.
- FIG. 7 is a flowchart illustrating a control and data flow of the data processing system 500 shown in FIG. 5 when interface compression is enabled. Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown in FIG. 7 .
- the exemplary control and data flow may be briefly summarized by following steps.
- Step 700 Start.
- Step 702 Configure the compressor 117 to employ a compression algorithm.
- Step 704 Set the indication information INFO in response to the compression algorithm employed by the compressor 117 .
- Step 706 Set the channel ID number ID CH indicative of which channel should be connected for data transmission.
- Step 708 Record the channel ID number ID CH and the indication information INFO in an output bitstream.
- the indication information INFO is recorded by setting a command set in a payload portion of the output bitstream
- the channel ID number ID CH is recorded by setting a header portion of the output bitstream.
- Step 710 Transmit the output bitstream over the camera interface 103 .
- Step 712 Get the channel ID number ID CH from an input bitstream.
- the channel ID number ID CH is obtained by parsing a header portion of the input bitstream.
- Step 714 Dispatch the input bitstream to a selected channel with the channel ID number ID CH .
- Step 716 Receive the input bitstream dispatched from the channel controller 504 .
- Step 718 Parse the indication information INFO included in the input bitstream.
- the indication information INFO is obtained by parsing a command set in a payload portion of the input bitstream.
- Step 720 Configure the de-compressor 127 to employ a de-compression algorithm as indicated by the indication information INFO.
- Step 722 End.
- steps 702 - 710 are performed by the camera module 102
- step 712 is performed by the channel detector 502
- step 714 is performed by the channel controller 504
- steps 716 - 720 are performed by the ISP 104 .
- steps 702 - 710 are performed by the camera module 102
- step 712 is performed by the channel detector 502
- step 714 is performed by the channel controller 504
- steps 716 - 720 are performed by the ISP 104 .
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Discrete Mathematics (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Television Signal Processing For Recording (AREA)
- Telephone Function (AREA)
Abstract
A data processing apparatus has a compressor and an output interface. The compressor generates a compressed multimedia data by compressing a multimedia data according to a compression algorithm. The output interface records indication information in an output bitstream, and outputs the output bitstream via a camera interface, wherein the output bitstream is derived from the compressed multimedia data, and the indication information is set in response to the compression algorithm employed by the compressor. Another data processing apparatus has a de-compressor and an input interface. The de-compressor de-compresses a compressed multimedia data derived from an input bitstream. The input interface receives the input bitstream via a camera interface, parses indication information included in the input bitstream, and configures the de-compressor to employ a de-compression algorithm as indicated by the indication information.
Description
- This application claims the benefit of U.S. provisional application No. 61/729,426, filed on Nov. 23, 2012 and incorporated herein by reference.
- The disclosed embodiments of the present invention relate to transmitting and receiving multimedia data over a camera interface, and more particularly, to a data processing apparatus for transmitting/receiving compression-related indication information via a camera interface and related data processing method.
- A camera interface is disposed between a first chip and a second chip to transmit multimedia data from the first chip to the second chip for further processing. For example, the first chip may include a camera module, and the second chip may include an image signal processor (ISP). The multimedia data may include image data (i.e., a single still image) or video data (i.e., a video sequence composed of images). When a camera sensor with a higher resolution is employed in the camera module, the multimedia data transmitted over the camera interface would have a larger data size/data rate, which increases the power consumption of the camera interface inevitably. If the camera module and the ISP are both located at a portable device (e.g., a smartphone) powered by a battery device, the battery life is shortened due to the increased power consumption of the camera interface. Thus, there is a need for an innovative design which can effectively reduce the power consumption of the camera interface.
- In accordance with exemplary embodiments of the present invention, a data processing apparatus for transmitting/receiving compression-related indication information via a camera interface and related data processing method are proposed.
- According to a first aspect of the present invention, an exemplary data processing apparatus is disclosed. The exemplary data processing apparatus has a compressor and an output interface. The compressor is arranged for generating a compressed multimedia data by compressing a multimedia data according to a compression algorithm. The output interface is arranged for recording indication information in an output bitstream and outputting the output bitstream via a camera interface, wherein the output bitstream is derived from the compressed multimedia data, and the indication information is set in response to the compression algorithm employed by the compressor.
- According to a second aspect of the present invention, an exemplary data processing apparatus is disclosed. The exemplary data processing apparatus has a de-compressor and an input interface. The de-compressor is arranged for de-compressing a compressed multimedia data derived from an input bitstream. The input interface is arranged for receiving the input bitstream via a camera interface, parsing indication information included in the input bitstream, and configuring the de-compressor to employ a de-compression algorithm as indicated by the indication information.
- According to a third aspect of the present invention, an exemplary data processing method is disclosed. The exemplary data processing method includes at least the following steps: generating a compressed multimedia data by compressing a multimedia data according to a compression algorithm; and recording indication information in an output bitstream and outputting the output bitstream via a camera interface, wherein the output bitstream is derived from the compressed multimedia data, and the indication information is set in response to the compression algorithm.
- According to a fourth aspect of the present invention, an exemplary data processing method is disclosed. The exemplary data processing method includes at least the following steps: de-compressing a compressed multimedia data derived from an input bitstream; and receiving the input bitstream via a camera interface, parsing indication information included in the input bitstream, and configuring the de-compressing step to employ a de-compression algorithm as indicated by the indication information.
- These and other objectives of the present invention will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings.
-
FIG. 1 is a block diagram illustrating a data processing system according to an embodiment of the present invention. -
FIG. 2 is a diagram illustrating a data structure of the output bitstream generated from the camera module to the ISP according to an embodiment of the present invention. -
FIG. 3 is a diagram illustrating an example of information handshaking between the camera module and the ISP. -
FIG. 4 is a flowchart illustrating a control and data flow of the data processing system shown inFIG. 1 when interface compression is enabled. -
FIG. 5 is a block diagram illustrating a data processing system according to another embodiment of the present invention. -
FIG. 6 is a diagram illustrating a data structure of the output bitstream generated from the camera module to the ISP according to another embodiment of the present invention. -
FIG. 7 is a flowchart illustrating a control and data flow of the data processing system shown inFIG. 5 when interface compression is enabled. - Certain terms are used throughout the description and following claims to refer to particular components. As one skilled in the art will appreciate, manufacturers may refer to a component by different names. This document does not intend to distinguish between components that differ in name but not function. In the following description and in the claims, the terms “include” and “comprise” are used in an open-ended fashion, and thus should be interpreted to mean “include, but not limited to . . . ”. Also, the term “couple” is intended to mean either an indirect or direct electrical connection. Accordingly, if one device is coupled to another device, that connection may be through a direct electrical connection, or through an indirect electrical connection via other devices and connections.
- The present invention proposes applying data compression to a multimedia data and then transmitting a compressed multimedia data over a camera interface. As the data size/data rate of the compressed multimedia data is smaller than that of the original un-compressed multimedia data, the power consumption of the camera interface is reduced correspondingly. Besides, the de-compression algorithm employed by a receiving end which receives and de-compresses a compressed multimedia data is required to be compliant with the compression algorithm employed by a transmitting end which generates and transmits the compressed multimedia data; otherwise, the receiving end fails to correctly de-compress the compressed multimedia data. Therefore, the present invention further proposes transmitting/receiving the compression-related indication information via the camera interface, such that the de-compression algorithm of the receiving end is properly configured based on the compression-related indication information. Further details will be described as below.
-
FIG. 1 is a block diagram illustrating a data processing system according to an embodiment of the present invention. Thedata processing system 100 includes a plurality of data processing apparatuses such as acamera module 102 and an image signal processor (ISP) 104. Thecamera module 102 and theISP 104 may be different chips, and thecamera module 102 communicates with theISP 104 via acamera interface 103. In this embodiment, thecamera interface 103 may be a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI). - The
camera module 102 is coupled to thecamera interface 103, and supports un-compressed data transmission and compressed data transmission. When thecamera module 102 is used to transmit un-compressed data to theISP 104, thecamera module 102 generates the un-compressed multimedia data D1 according to an input multimedia data derived from capturing the incident light, and transmits the un-compressed multimedia data D1 over thecamera interface 103. When thecamera module 102 is used to transmit compressed data to theISP 104, thecamera module 102 generates a compressed multimedia data D1′ according to the input multimedia data derived from capturing the incident light, and transmits the compressed multimedia data D1′ over thecamera interface 103. By way of example, but not limitation, the input multimedia data obtained by capturing the incident light and used for generating the un-compressed multimedia data D1/compressed multimedia data D1′ may be an image data or a video data. - As shown in
FIG. 1 , thecamera module 102 includes acamera controller 112, anoutput interface 114 and aprocessing circuit 116. Theprocessing circuit 116 includes circuit elements required for processing the input multimedia data to generate the un-compressed data D1 or the compressed data D1′. For example, theprocessing circuit 116 has acompressor 117 andother circuitry 118, where theother circuitry 118 may have a lens module, a camera sensor, a camera buffer, multiplexer(s), etc. The lens module guides the incident light to the camera sensor, and the camera sensor obtains the input multimedia data correspondingly. The input multimedia data obtained by the camera sensor may be a single captured image or a video sequence composed of a plurality of captured images. Besides, the input multimedia data obtained by the camera sensor may be single view data for 2D display or multiple view data for 3D display. The camera buffer is arranged to buffer the input multimedia data obtained by the camera sensor. Thecompressor 117 performs data compression. The multiplexer receives the un-compressed multimedia data D1 and the compressed multimedia data D1′, and selectively outputs the un-compressed multimedia data D1 or the compressed multimedia data D1′ according to the operation mode of thecamera module 102. For example, thecamera controller 112 controls the operation of thecamera module 102. When thecamera module 102 is operated under a compression mode, the multiplexer outputs the compressed multimedia data D1′; and when thecamera module 102 is operated under a non-compression mode, the multiplexer outputs the un-compressed multimedia data D1. As the present invention focuses on the handshaking mechanism between thecamera module 102 and theISP 104, further description of theother circuit 118 is omitted here for brevity. - The
output interface 114 is arranged for packing/packetizing the un-compressed multimedia data D1/compressed multimedia data D1′ into an output bitstream according to the transmission protocol of thecamera interface 103, and transmits the output bitstream to theISP 104 via thecamera interface 103. When the compression mode of thecamera module 102 is enabled, thecompressor 117 further sets indication information INFO in response to the compression algorithm employed. Besides, theoutput interface 114 further records the indication information INFO in the output bitstream. In this way, when the output bitstream is transmitted from thecamera module 102 to theISP 104, the compression-related indication information (e.g., the indication information INFO) is also transmitted via thecamera interface 103. - Regarding the
ISP 104, it communicates with thecamera module 102 via thecamera interface 103. In this embodiment, theISP 104 is coupled to thecamera interface 103, and supports un-compressed data reception and compressed data reception. When thecamera module 102 transmits the un-compressed data D1 to theISP 104, theISP 104 is operated under a non-decompression mode to receive an un-compressed data D2 from thecamera interface 103, generate a processed multimedia data according to the un-compressed data D2, and send the processed multimedia data to one or multiple processors, such as a display processor 106_1, a video processor 106_2, and/or a graphic processor 106_3, for further processing. When thecamera module 102 transmits the compressed data D1′ to theISP 104, theISP 104 is operated under a de-compression mode to receive a compressed multimedia data D2′ from thecamera interface 103, generate a processed multimedia data according to the compressed data D2′, and send the processed multimedia data to one or multiple processors, such as the display processor 106_1, the video processor 106_2, and/or the graphic processor 106_3, for further processing. If there is no error introduced during the data transmission, the un-compressed data D1 transmitted under the non-compression mode should be identical to the un-compressed data D2 received under the non-decompression mode, and the compressed data D1′ transmitted under the compression mode should be identical to the compressed data D2′ received under the de-compression mode. - As shown in
FIG. 1 , theISP 104 includes anISP controller 122, aninput interface 124 and aprocessing circuit 126. Theprocessing circuit 126 may include circuit elements required for generating the processed multimedia data according to an internal transmission mode (e.g., an on-the-fly mode or an off-line mode). For example, theother circuitry 128 may have a write direct memory access (DMA) controller, a read DMA controller, an image processor, multiplexers, etc. The de-compressor 127 generates the de-compressed multimedia data by de-compressing the compressed multimedia data D2′ according to a de-compression algorithm, where the compressed multimedia data D2′ is derived from an input bitstream received from thecamera interface 103. The write DMA controller is arranged for storing a multimedia data into an external image buffer of theISP 104, where the multimedia data may be an un-compressed multimedia data, a compressed multimedia data or a de-compressed multimedia data. The read write DMA controller is arranged for reading a buffered multimedia data from the external image buffer of theISP 104. The image processor is arranged to support several image processing operations, including resizing/scaling, rotation, quality enhancement, etc., where the processed multimedia data is generated from the image processor. The multiplexers control interconnections of the de-compressor 127, the image processor, the write DMA controller, and the read DMA controller. As the present invention focuses on the handshaking mechanism between thecamera module 102 and theISP 104, further description of theother circuitry 128 is omitted here for brevity. - The
input interface 124 is arranged for receiving the input bitstream from thecamera interface 103, and un-packing/un-packetizing the input bitstream into un-compressed multimedia data D2/compressed multimedia data D2′ according to the transmission protocol of thecamera interface 103. When the de-compression mode of theISP 104 is enabled, theinput interface 124 is further arranged for parsing the indication information INFO included in the input bitstream, and configuring the de-compressor 127 to employ a de-compression algorithm as indicated by the indication information INFO. In addition to the compressed data transmission between thecamera module 102 and theISP 104, information handshaking is realized through thecamera interface 103. Therefore, with the help of the indication information INFO supplied from thecamera module 102, the de-compressor 127 of theISP 104 is properly configured to employ an adequate de-compression algorithm needed for de-compressing the compressed data D2′ correctly. - In one exemplary design, the
output interface 114 records the indication information INFO by setting a command set in a payload portion of the output bitstream transmitted over thecamera interface 103, and theinput interface 124 obtains the indication information INFO by parsing a command set in a payload portion of the input bitstream received from thecamera interface 103. Please refer toFIG. 2 , which is a diagram illustrating a data structure of the output bitstream generated from thecamera module 102 to theISP 104 according to an embodiment of the present invention. The information handshaking between thecamera module 102 and theISP 104 may be realized by defining a set of commands in the transmitted payload. For example, these commands can be specified in vendor-specific commands based on MIPI camera command set (CCS) specification, where each command in a command set may be an 8-bit code, and the command set can be used to communicate between thecamera module 102 and theISP 104 about the compression capability and compression/de-compression algorithms they support. Please refer toFIG. 3 , which is a diagram illustrating an example of information handshaking between thecamera module 102 and theISP 104. In this example, thecompressor 117 supports four compression algorithms, and the de-compressor 127 supports four de-compression algorithms compliant with the compression algorithms, respectively. The different compression algorithms may handle different compression ratios, different compression unit sizes, different color formats (e.g. Bayer or RGBW), and/or different bit depths (8-bit, 10-bit or 12-bit). Hence, the indication information INFO is adjusted when at least one of a compression ratio, a compression unit size, a color format, and a bit depth of a compression algorithm employed is changed. Thecamera module 102 may check a de-compression capability of theISP 104 by sending a request to theISP 104 through thecamera interface 103, and theISP 104 may inform thecamera module 102 of its de-compression capability by sending a response to thecamera module 102 through thecamera interface 103. In this way, thecamera module 102 can detect whether theISP 104 has the ability of performing data de-compression, and can further detect what kinds of de-compression algorithms theISP 104 supports if theISP 104 is equipped with the de-compression capability. In this example, thecompressor 117 at thecamera module 102 is configured to use thecompression algorithm # 4, and the indication information INFO is set correspondingly. The indication information INFO is carried by the command set transmitted from thecamera module 102 to theISP 104 via thecamera interface 103. Hence, theISP 104 receives the indication information INFO through thecamera interface 103, and configures the de-compressor 127 to employ thede-compression algorithm # 4 as indicated by the indication information INFO. -
FIG. 4 is a flowchart illustrating a control and data flow of thedata processing system 100 shown inFIG. 1 when interface compression is enabled. Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown inFIG. 4 The exemplary control and data flow may be briefly summarized by following steps. - Step 400: Start.
- Step 402: Configure the
compressor 117 to employ a compression algorithm. - Step 404: Set the indication information INFO in response to the compression algorithm employed by the
compressor 117. - Step 406: Record the indication information INFO in an output bitstream. For example, the indication information INFO is recorded by setting a command set in a payload portion of the output bitstream.
- Step 408: Transmit the output bitstream over the
camera interface 103. - Step 410: Receive an input bitstream from the
camera interface 103. - Step 412: Parse the indication information INFO included in the input bitstream. For example, the indication information INFO is obtained by parsing a command set in a payload portion of the input bitstream.
- Step 414: Configure the de-compressor 127 to employ a de-compression algorithm as indicated by the indication information INFO.
- Step 416: End.
- It should be noted that steps 402-408 are performed by the
camera module 102, and steps 410-414 are performed by theISP 104. As a person skilled in the art can readily understand details of each step shown inFIG. 4 after reading above paragraphs, further description is omitted here for brevity. - It should be noted that the same handshaking mechanism may be applied to a data processing system equipped with virtual channel capability. Please refer to
FIG. 5 in conjunction withFIG. 1 .FIG. 5 is a block diagram illustrating a data processing system according to another embodiment of the present invention. Thedata processing system 500 includes achannel detector 502, achannel controller 504, and a plurality of data processing apparatuses such as theaforementioned camera module 102 andISP 104 shown inFIG. 1 . The output stream generated from thecamera module 102 may be composed of interleaved data streams with different data formats. For example, thecamera module 102 may have multiple camera sensors and support different compression algorithms. Hence, a first data stream included in the output stream is generated based on a first compression algorithm and an input multimedia data obtained by a first camera sensor using a first color format (e.g., Bayer); and a second data stream included in the output stream is generated based on a second compression algorithm and an input multimedia data obtained by a second camera sensor using a second color format (e.g., RGBW). To make a receiving end able to distinguish between the first data stream and the second stream interleaved in the output stream, thecamera module 102 assigns different channel identification (ID) numbers to the first stream and the second stream. - The virtual channel is to provide separate channels (e.g., 506_1 and 506_2) for different data flows that are interleaved in the data stream transmitted over the
camera interface 103. Thus, the receiving end will monitor the channel ID numbers and de-multiplex the interleaved data streams (e.g., the aforementioned first data stream and second data stream) to their appropriate channels 506_1, 506_2. More specifically, thechannel controller 504 is arranged to direct data streams to individual channels 506_1, 506_2 under the control of thechannel detector 502. In this embodiment, theoutput interface 114 of thecamera module 102 is further arranged for recording a channel ID number IDCH in a header portion of the output bitstream to indicate which one of the channels 506_1, 506_2 should be connected for receiving the output bitstream.FIG. 6 is a diagram illustrating a data structure of the output bitstream generated from thecamera module 102 to theISP 104 according to another embodiment of the present invention. As mentioned above, the information handshaking between thecamera module 102 and theISP 104 is realized by defining a set of commands in the transmitted payload. In this embodiment, the virtual channel capability of thedata processing system 500 is realized by defining the channel ID number in the transmitted header. For example, the channel 506_1 is connected for data transmission/reception when IDCH=#1, and the channel 506_2 is connected for data transmission/reception when IDCH=#2. - The
channel detector 502 is implemented for receiving an input bitstream from thecamera interface 103, and identifying the channel ID number IDCH from the header portion of the input bitstream. Next, thechannel controller 504 dispatches the input bitstream, including the header portion and the payload portion shown inFIG. 6 , to a selected channel with the channel ID number IDCH. The information handshaking as illustrated inFIG. 3 for configuring the compression and de-compression algorithms is also performed between thecamera module 102 and theISP 104. Further description is omitted here for brevity. -
FIG. 7 is a flowchart illustrating a control and data flow of thedata processing system 500 shown inFIG. 5 when interface compression is enabled. Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown inFIG. 7 . The exemplary control and data flow may be briefly summarized by following steps. - Step 700: Start.
- Step 702: Configure the
compressor 117 to employ a compression algorithm. - Step 704: Set the indication information INFO in response to the compression algorithm employed by the
compressor 117. - Step 706: Set the channel ID number IDCH indicative of which channel should be connected for data transmission.
- Step 708: Record the channel ID number IDCH and the indication information INFO in an output bitstream. For example, the indication information INFO is recorded by setting a command set in a payload portion of the output bitstream, and the channel ID number IDCH is recorded by setting a header portion of the output bitstream.
- Step 710: Transmit the output bitstream over the
camera interface 103. - Step 712: Get the channel ID number IDCH from an input bitstream. For example, the channel ID number IDCH is obtained by parsing a header portion of the input bitstream.
- Step 714: Dispatch the input bitstream to a selected channel with the channel ID number IDCH.
- Step 716: Receive the input bitstream dispatched from the
channel controller 504. - Step 718: Parse the indication information INFO included in the input bitstream. For example, the indication information INFO is obtained by parsing a command set in a payload portion of the input bitstream.
- Step 720: Configure the de-compressor 127 to employ a de-compression algorithm as indicated by the indication information INFO.
- Step 722: End.
- It should be noted that steps 702-710 are performed by the
camera module 102,step 712 is performed by thechannel detector 502,step 714 is performed by thechannel controller 504, and steps 716-720 are performed by theISP 104. As a person skilled in the art can readily understand details of each step shown inFIG. 7 after reading above paragraphs, further description is omitted here for brevity. - Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.
Claims (18)
1. A data processing apparatus comprising:
a compressor, arranged for generating a compressed multimedia data by compressing a multimedia data according to a compression algorithm; and
an output interface, arranged for recording indication information in an output bitstream and outputting the output bitstream via a camera interface, wherein the output bitstream is derived from the compressed multimedia data, and the indication information is set in response to the compression algorithm employed by the compressor.
2. The data processing apparatus of claim 1 , wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
3. The data processing apparatus of claim 1 , wherein the output interface records the indication information by setting a command set in a payload portion of the output bitstream.
4. The data processing apparatus of claim 3 , wherein a first end of the camera interface is coupled to the output interface of the data processing apparatus, and a second end of the camera interface is allowed to be coupled to another data processing apparatus via any of a plurality of channels; the output interface further records a channel identification (ID) number in a header portion of the output bitstream to indicate which one of the channels is connected for receiving the output bitstream.
5. A data processing apparatus comprising:
a de-compressor, arranged for de-compressing a compressed multimedia data derived from an input bitstream; and
an input interface, arranged for receiving the input bitstream via a camera interface, parsing indication information included in the input bitstream, and configuring the de-compressor to employ a de-compression algorithm as indicated by the indication information.
6. The data processing apparatus of claim 5 , wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
7. The data processing apparatus of claim 5 , wherein the input interface obtains the indication information by parsing a command set in a payload portion of the input bitstream.
8. The data processing apparatus of claim 7 , wherein one end of the camera interface is allowed to be coupled to the data processing apparatus via any of a plurality of channels; and a specific channel selected from the channels according to a channel identification (ID) number recorded in a header portion of the input bitstream is connected for receiving the input bitstream.
9. A data processing method comprising:
generating a compressed multimedia data by compressing a multimedia data according to a compression algorithm; and
recording indication information in an output bitstream and outputting the output bitstream via a camera interface, wherein the output bitstream is derived from the compressed multimedia data, and the indication information is set in response to the compression algorithm.
10. The data processing method of claim 9 , wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
11. The data processing method of claim 9 , wherein the step of recording the indication information in the output bitstream comprises:
recording the indication information by setting a command set in a payload portion of the output bitstream.
12. The data processing method of claim 11 , wherein a first end of the camera interface is coupled to the output bitstream, and a second end of the camera interface is allowed to be coupled to a data processing apparatus via any of a plurality of channels; and the data processing method further comprises:
recording a channel identification (ID) number in a header portion of the output bitstream to indicate which one of the channels is connected for receiving the output bitstream.
13. The data processing method of claim 9 , wherein the indication information is adjusted when at least one of a compression ratio, a compression unit size, a color format, and a bit depth of the compression algorithm is changed.
14. A data processing method comprising:
de-compressing a compressed multimedia data derived from an input bitstream; and
receiving the input bitstream via a camera interface, parsing indication information included in the input bitstream, and configuring the de-compressing step to employ a de-compression algorithm as indicated by the indication information.
15. The data processing method of claim 14 , wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
16. The data processing method of claim 14 , wherein the step of parsing the indication information included in the input bitstream comprises:
obtaining the indication information by parsing a command set in a payload portion of the input bitstream.
17. The data processing method of claim 16 , wherein one end of the camera interface is allowed to be coupled to any of a plurality of channels; and the data processing method further comprises:
receiving the input bitstream from the camera interface via a specific channel selected from the channels according to a channel identification (ID) number recorded in a header portion of the input bitstream.
18. The data processing method of claim 14 , wherein the indication information is adjusted when at least one of a compression ratio, a compression unit size, a color format, and a bit depth of the compression algorithm is changed.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US13/965,210 US20140146195A1 (en) | 2012-11-23 | 2013-08-13 | Data processing apparatus for transmitting/receiving compression-related indication information via camera interface and related data processing method |
| CN201310594147.3A CN103841318A (en) | 2012-11-23 | 2013-11-21 | Data processing apparatus and data processing method thereof |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201261729426P | 2012-11-23 | 2012-11-23 | |
| US13/965,210 US20140146195A1 (en) | 2012-11-23 | 2013-08-13 | Data processing apparatus for transmitting/receiving compression-related indication information via camera interface and related data processing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| US20140146195A1 true US20140146195A1 (en) | 2014-05-29 |
Family
ID=50772955
Family Applications (8)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US13/964,102 Active US9568985B2 (en) | 2012-11-23 | 2013-08-11 | Data processing apparatus with adaptive compression algorithm selection based on visibility of compression artifacts for data communication over camera interface and related data processing method |
| US13/965,169 Abandoned US20140146187A1 (en) | 2012-11-23 | 2013-08-12 | Data processing apparatus for configuring camera interface based on compression characteristic of compressed multimedia data and related data processing method |
| US13/965,225 Abandoned US20140146188A1 (en) | 2012-11-23 | 2013-08-13 | Data processing apparatus with adaptive compression algorithm selection for data communication based on sensor input/sensor configuration/display configuration over camera interface and related data processing method |
| US13/965,203 Active 2034-01-11 US9535489B2 (en) | 2012-11-23 | 2013-08-13 | Data processing system for transmitting compressed multimedia data over camera interface |
| US13/965,210 Abandoned US20140146195A1 (en) | 2012-11-23 | 2013-08-13 | Data processing apparatus for transmitting/receiving compression-related indication information via camera interface and related data processing method |
| US14/022,203 Abandoned US20140146874A1 (en) | 2012-11-23 | 2013-09-09 | Data processing apparatus with adaptive compression/de-compression algorithm selection for data communication over camera interface and related data processing method |
| US15/292,145 Abandoned US20170034517A1 (en) | 2012-11-23 | 2016-10-13 | Data processing apparatus for configuring camera interface based on compression characteristic of compressed multimedia data and related data processing method |
| US15/361,006 Active US10200603B2 (en) | 2012-11-23 | 2016-11-24 | Data processing system for transmitting compressed multimedia data over camera interface |
Family Applications Before (4)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US13/964,102 Active US9568985B2 (en) | 2012-11-23 | 2013-08-11 | Data processing apparatus with adaptive compression algorithm selection based on visibility of compression artifacts for data communication over camera interface and related data processing method |
| US13/965,169 Abandoned US20140146187A1 (en) | 2012-11-23 | 2013-08-12 | Data processing apparatus for configuring camera interface based on compression characteristic of compressed multimedia data and related data processing method |
| US13/965,225 Abandoned US20140146188A1 (en) | 2012-11-23 | 2013-08-13 | Data processing apparatus with adaptive compression algorithm selection for data communication based on sensor input/sensor configuration/display configuration over camera interface and related data processing method |
| US13/965,203 Active 2034-01-11 US9535489B2 (en) | 2012-11-23 | 2013-08-13 | Data processing system for transmitting compressed multimedia data over camera interface |
Family Applications After (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US14/022,203 Abandoned US20140146874A1 (en) | 2012-11-23 | 2013-09-09 | Data processing apparatus with adaptive compression/de-compression algorithm selection for data communication over camera interface and related data processing method |
| US15/292,145 Abandoned US20170034517A1 (en) | 2012-11-23 | 2016-10-13 | Data processing apparatus for configuring camera interface based on compression characteristic of compressed multimedia data and related data processing method |
| US15/361,006 Active US10200603B2 (en) | 2012-11-23 | 2016-11-24 | Data processing system for transmitting compressed multimedia data over camera interface |
Country Status (2)
| Country | Link |
|---|---|
| US (8) | US9568985B2 (en) |
| CN (7) | CN103841415B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9491495B2 (en) * | 2015-01-16 | 2016-11-08 | Analog Devices Global | Method and apparatus for providing input to a camera serial interface transmitter |
| US10331564B2 (en) * | 2017-11-29 | 2019-06-25 | Intel Corporation | Technologies for secure I/O with MIPI camera device |
| US20220337747A1 (en) * | 2018-12-07 | 2022-10-20 | Samsung Electronics Co., Ltd. | Apparatus and method for operating multiple cameras for digital photography |
Families Citing this family (40)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104011775A (en) * | 2011-12-26 | 2014-08-27 | 英特尔公司 | Techniques for managing three-dimensional graphics display modes |
| US9568985B2 (en) * | 2012-11-23 | 2017-02-14 | Mediatek Inc. | Data processing apparatus with adaptive compression algorithm selection based on visibility of compression artifacts for data communication over camera interface and related data processing method |
| CN103369142B (en) * | 2013-07-09 | 2015-02-04 | 广东欧珀移动通信有限公司 | Method and system for avoiding call-up malfunction |
| JP2015053644A (en) * | 2013-09-09 | 2015-03-19 | オリンパス株式会社 | Imaging device |
| US10080018B2 (en) * | 2014-03-25 | 2018-09-18 | Owtware Holdings Limited, BVI | Video content classification |
| CN106462202A (en) * | 2014-06-12 | 2017-02-22 | 联发科技股份有限公司 | Thermal management method and electronic system with thermal management mechanism |
| CN105404331A (en) * | 2014-09-10 | 2016-03-16 | 联想(北京)有限公司 | Control method and device, and electronic equipment |
| US9536045B1 (en) | 2015-03-16 | 2017-01-03 | D.R. Systems, Inc. | Dynamic digital image compression based on digital image characteristics |
| CN104717433A (en) * | 2015-03-27 | 2015-06-17 | 电子科技大学 | Distributed transmission device for video stream signal processing system |
| JP6355595B2 (en) * | 2015-06-02 | 2018-07-11 | キヤノン株式会社 | IMAGING ELEMENT, IMAGING DEVICE, IMAGING ELEMENT CONTROL METHOD, PROGRAM, AND STORAGE MEDIUM |
| US20170094190A1 (en) * | 2015-09-30 | 2017-03-30 | Microsoft Technology Licensing, Llc | Processing display of digital camera readout with minimal latency |
| US10827039B1 (en) * | 2015-10-19 | 2020-11-03 | Quest Software Inc. | Systems and methods for dynamic compression of time-series data |
| JP6743427B2 (en) * | 2016-03-08 | 2020-08-19 | 株式会社リコー | Information processing apparatus, imaging system, and data transfer method |
| KR102510708B1 (en) * | 2016-07-25 | 2023-03-16 | 삼성전자주식회사 | Electronic device and method for diplaying image |
| KR102778992B1 (en) | 2016-09-16 | 2025-03-07 | 소니 세미컨덕터 솔루션즈 가부시키가이샤 | Image pickup device and electronic apparatus |
| WO2018139947A1 (en) * | 2017-01-24 | 2018-08-02 | Huawei Technologies Co., Ltd. | Apparatus and method for data compression |
| US10229322B2 (en) | 2017-04-06 | 2019-03-12 | Ants Technology (Hk) Limited | Apparatus, methods and computer products for video analytics |
| US10453221B2 (en) * | 2017-04-10 | 2019-10-22 | Intel Corporation | Region based processing |
| CN107241600B (en) * | 2017-04-20 | 2018-07-03 | 中国科学技术大学 | A kind of static background inner frame coding method and device |
| CN107176100A (en) * | 2017-05-12 | 2017-09-19 | 深圳市京弘全智能科技股份有限公司 | Car-mounted terminal and its distance-finding method with distance measurement function |
| KR102204596B1 (en) * | 2017-06-02 | 2021-01-19 | 삼성전자주식회사 | Processor, image processing device comprising the same, and method for image processing |
| KR102434417B1 (en) | 2017-07-20 | 2022-08-22 | 삼성전자주식회사 | Method for transmitting image data and data associated with control of image capture based on sizes of image data and data associated with control of image capture and electronic device for supporting the same |
| TWI640957B (en) | 2017-07-26 | 2018-11-11 | 聚晶半導體股份有限公司 | Image processing wafer and image processing system |
| KR102301940B1 (en) | 2017-12-01 | 2021-09-14 | 삼성전자주식회사 | Method and apparatus for image fusion |
| CN108205320A (en) * | 2017-12-18 | 2018-06-26 | 深圳市奇虎智能科技有限公司 | Map data processing method and device |
| TWI653886B (en) | 2017-12-21 | 2019-03-11 | 鴻海精密工業股份有限公司 | Picture transmision method and photographic device |
| US10739838B2 (en) * | 2017-12-28 | 2020-08-11 | Omnivision Technologies, Inc. | Quality-driven dynamic frequency scaling for energy optimization of smart camera systems |
| KR102499033B1 (en) | 2018-01-31 | 2023-02-13 | 삼성전자주식회사 | Image sensor and electronic device including the image sensor |
| KR102499286B1 (en) | 2018-02-23 | 2023-02-14 | 삼성전자주식회사 | Electronic device for compressing image based on compression loss data associated with compression of a plurality of blocks into which image has been segmented and method for operating thefeof |
| US11432187B2 (en) * | 2018-04-04 | 2022-08-30 | Charter Communications Operating, Llc | Dynamic use of header compression in a wireless network |
| GB2575463B (en) * | 2018-07-10 | 2022-12-14 | Displaylink Uk Ltd | Compression of display data |
| CN110971943B (en) * | 2018-09-30 | 2021-10-15 | 北京微播视界科技有限公司 | Video code rate adjusting method, device, terminal and storage medium |
| CN111756963B (en) * | 2019-03-29 | 2022-01-14 | 华为技术有限公司 | Image shooting module and electronic terminal |
| KR20210009255A (en) | 2019-07-16 | 2021-01-26 | 삼성전자주식회사 | Image sensor and image processing system comprising thereof |
| CN112243090B (en) | 2019-07-16 | 2024-10-18 | 三星电子株式会社 | Image sensor and image processing system |
| TWM600051U (en) * | 2020-04-15 | 2020-08-11 | 聯詠科技股份有限公司 | Image device and image processing integrated circuit thereof |
| WO2023008605A1 (en) * | 2021-07-28 | 2023-02-02 | 엘지전자 주식회사 | Image display device |
| CN113918298B (en) * | 2021-10-12 | 2024-05-14 | 北京字节跳动网络技术有限公司 | Multimedia data processing method, system and equipment |
| CN114020385A (en) * | 2021-11-01 | 2022-02-08 | 联想(北京)有限公司 | A data processing method, device and system |
| US12375101B1 (en) * | 2024-03-31 | 2025-07-29 | AtomBeam Technologies Inc. | Distributed system and method for adaptive neural network-based data compression |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030165200A1 (en) * | 2001-08-30 | 2003-09-04 | Pugel Michael Anthony | Method and apparatus for simultaneously retrieving portions of a data stream from different channels |
| US20080025412A1 (en) * | 2006-07-28 | 2008-01-31 | Mediatek Inc. | Method and apparatus for processing video stream |
Family Cites Families (97)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5502485A (en) | 1993-06-23 | 1996-03-26 | Nikon Corporation | Camera which compresses digital image data in correspondence with the focus control or the stop value of the camera |
| CA2163556C (en) | 1994-04-22 | 2006-07-11 | Tetsuji Kawashima | System and method for transmitting compressed data or pre-compressed data based on a preset compression ratio |
| US5553160A (en) * | 1994-09-01 | 1996-09-03 | Intel Corporation | Method and apparatus for dynamically selecting an image compression process based on image size and color resolution |
| US5778191A (en) | 1995-10-26 | 1998-07-07 | Motorola, Inc. | Method and device for error control of a macroblock-based video compression technique |
| US6031929A (en) * | 1996-07-18 | 2000-02-29 | University Of Pittsburgh | Image facsimile with real time image segmentation |
| WO1998009436A1 (en) * | 1996-08-30 | 1998-03-05 | Sony Corporation | Device, method, and medium for recording still picture and animation |
| JPH1093918A (en) | 1996-09-17 | 1998-04-10 | Nikon Corp | Image recording device |
| US6201834B1 (en) | 1996-12-20 | 2001-03-13 | Intel Corporation | Method and apparatus for packet loss recovery with standard-based packet video |
| US7110025B1 (en) | 1997-05-28 | 2006-09-19 | Eastman Kodak Company | Digital camera for capturing a sequence of full and reduced resolution digital images and storing motion and still digital image data |
| US6507672B1 (en) | 1997-09-10 | 2003-01-14 | Lsi Logic Corporation | Video encoder for digital video displays |
| US6614934B1 (en) * | 1998-03-06 | 2003-09-02 | Divio, Inc. | Method and apparatus for concatenating bits of odd-length words |
| JP2000232649A (en) * | 1998-12-10 | 2000-08-22 | Fujitsu Ltd | MPEG video decoder and MPEG video decoding method |
| US6704310B1 (en) | 1999-06-30 | 2004-03-09 | Logitech Europe, S.A. | Header encoding method and apparatus for packet-based bus |
| US6995794B2 (en) | 1999-06-30 | 2006-02-07 | Logitech Europe S.A. | Video camera with major functions implemented in host software |
| US6956971B1 (en) | 1999-07-20 | 2005-10-18 | Lg Electronics Inc. | Terminal and method for transporting still picture |
| US6300973B1 (en) | 2000-01-13 | 2001-10-09 | Meir Feder | Method and system for multimedia communication control |
| JP3849461B2 (en) | 2001-06-07 | 2006-11-22 | ソニー株式会社 | Imaging apparatus and imaging method |
| US7088398B1 (en) * | 2001-12-24 | 2006-08-08 | Silicon Image, Inc. | Method and apparatus for regenerating a clock for auxiliary data transmitted over a serial link with video data |
| KR20030097310A (en) * | 2002-06-20 | 2003-12-31 | 삼성전자주식회사 | method and system for adjusting image size of display apparatus and recording media for computer program therefor |
| JP2004040548A (en) * | 2002-07-04 | 2004-02-05 | Minolta Co Ltd | Image pickup device |
| US7069394B2 (en) | 2002-12-05 | 2006-06-27 | International Business Machines Corporation | Dynamic data routing mechanism for a high speed memory cloner |
| US7403660B2 (en) | 2003-04-30 | 2008-07-22 | Nokia Corporation | Encoding picture arrangement parameter in picture bitstream |
| KR100513274B1 (en) | 2003-07-30 | 2005-09-09 | 이디텍 주식회사 | A controlling method for a high speed DVI using compression technique and a DVI transmitter and Receiver using the method |
| US20050073586A1 (en) * | 2003-10-06 | 2005-04-07 | Songnian Li | Digital camera interface |
| CN1309258C (en) * | 2003-12-19 | 2007-04-04 | 联想(北京)有限公司 | A method of lossless image compression applied to real time transmission |
| US7394410B1 (en) | 2004-02-13 | 2008-07-01 | Samplify Systems, Inc. | Enhanced data converters using compression and decompression |
| US20050195205A1 (en) * | 2004-03-03 | 2005-09-08 | Microsoft Corporation | Method and apparatus to decode a streaming file directly to display drivers |
| US7539218B2 (en) * | 2004-03-04 | 2009-05-26 | Nvidia Corporation | Media processing engine framework |
| US7570270B2 (en) * | 2004-05-21 | 2009-08-04 | Broadcom Corporation | Buffer for driving display with asynchronous display engine |
| US7656561B2 (en) | 2004-05-31 | 2010-02-02 | Phase One A/S | Image compression for rapid high-quality imaging |
| CN101002477A (en) * | 2004-08-13 | 2007-07-18 | 皇家飞利浦电子股份有限公司 | System and method for compression of mixed graphic and video sources |
| CN2724334Y (en) | 2004-08-27 | 2005-09-07 | 马晨阳 | Cell phone video frequency image monitor |
| US20060104356A1 (en) * | 2004-11-15 | 2006-05-18 | Microsoft Corporation | Timing for decoder buffer examination |
| US20060176960A1 (en) * | 2005-02-07 | 2006-08-10 | Paul Lu | Method and system for decoding variable length code (VLC) in a microprocessor |
| US8311088B2 (en) * | 2005-02-07 | 2012-11-13 | Broadcom Corporation | Method and system for image processing in a microprocessor for portable video communication devices |
| KR101199498B1 (en) | 2005-03-31 | 2012-11-09 | 삼성전자주식회사 | Apparatus for encoding or generation of multi-view video by using a camera parameter, and a method thereof, and a recording medium having a program to implement thereof |
| JP4368835B2 (en) | 2005-08-29 | 2009-11-18 | 富士通マイクロエレクトロニクス株式会社 | Image processing apparatus, imaging apparatus, and image processing system |
| KR100744120B1 (en) | 2006-01-10 | 2007-08-01 | 삼성전자주식회사 | Image signal scaler and image signal processing apparatus having the same |
| US8296156B2 (en) * | 2006-02-07 | 2012-10-23 | Lg Electronics, Inc. | Apparatus and method for encoding/decoding signal |
| US7873224B2 (en) | 2006-03-01 | 2011-01-18 | Qualcomm Incorporated | Enhanced image/video quality through artifact evaluation |
| US20070286277A1 (en) * | 2006-06-13 | 2007-12-13 | Chen Xuemin Sherman | Method and system for video compression using an iterative encoding algorithm |
| JP4250648B2 (en) | 2006-09-21 | 2009-04-08 | 株式会社東芝 | Information processing device |
| EP1921867B1 (en) * | 2006-10-17 | 2016-05-25 | Harman Becker Automotive Systems GmbH | Sensor assisted video compression |
| BRPI0718951A2 (en) * | 2006-12-28 | 2013-12-17 | Thomson Licensing | METHOD AND APPARATUS FOR AUTOMATIC ANALYSIS OF VISUAL ARTFACTS AND ARTIFICATION REDUCTION |
| TW200830170A (en) | 2007-01-04 | 2008-07-16 | Benq Corp | Data processing system and method |
| KR20080066408A (en) | 2007-01-12 | 2008-07-16 | 삼성전자주식회사 | 3D image processing device and method |
| JP4858294B2 (en) * | 2007-05-09 | 2012-01-18 | ソニー株式会社 | Imaging device, imaging circuit, and image processing circuit |
| FR2917919B1 (en) | 2007-06-21 | 2010-06-11 | Canon Kk | METHOD AND DEVICE FOR TRANSMITTING IMAGES |
| US20090074058A1 (en) | 2007-09-14 | 2009-03-19 | Sony Corporation | Coding tool selection in video coding based on human visual tolerance |
| US20090086174A1 (en) | 2007-09-28 | 2009-04-02 | Sanyo Electric Co., Ltd. | Image recording apparatus, image correcting apparatus, and image sensing apparatus |
| US8049761B1 (en) | 2007-11-08 | 2011-11-01 | Nvidia Corporation | Bus protocol for transferring pixel data between chips |
| JP2009129484A (en) | 2007-11-21 | 2009-06-11 | Hitachi Ltd | Information recording / reproducing device |
| DE102007058724B3 (en) | 2007-12-06 | 2009-05-14 | Fujitsu Siemens Computers Gmbh | Data processing system |
| CN201127091Y (en) | 2007-12-20 | 2008-10-01 | 唐斌 | Mobile phone having function of preventing wireless video from watching |
| CN101217623B (en) | 2007-12-26 | 2012-07-11 | 广东威创视讯科技股份有限公司 | A quick manual focusing method |
| CN101472190B (en) * | 2007-12-28 | 2013-01-23 | 华为终端有限公司 | Multi-visual angle filming and image processing apparatus and system |
| JP5593596B2 (en) | 2008-02-04 | 2014-09-24 | ソニー株式会社 | Video signal transmitting apparatus and video signal transmitting method |
| TW201026056A (en) | 2008-12-16 | 2010-07-01 | Quanta Comp Inc | Image capturing device and image delivery method |
| AU2010206977B2 (en) * | 2009-01-26 | 2016-02-25 | Interdigital Vc Holdings, Inc. | Frame packing for video coding |
| US8157738B2 (en) * | 2009-06-02 | 2012-04-17 | Samplify Systems, Inc. | Ultrasound signal compression |
| US20100309987A1 (en) | 2009-06-05 | 2010-12-09 | Apple Inc. | Image acquisition and encoding system |
| TWM378589U (en) * | 2009-07-10 | 2010-04-11 | Jetcom Technology Inc | Video conference device in combination with camera lens |
| JP2011045039A (en) * | 2009-07-21 | 2011-03-03 | Fujifilm Corp | Compound-eye imaging apparatus |
| CN102063265A (en) * | 2009-11-17 | 2011-05-18 | 智微科技股份有限公司 | Memory device and memory controller for accessing non-volatile memory |
| CN101702778B (en) * | 2009-11-30 | 2011-04-13 | 公安部第一研究所 | Network video encoder using PS encapsulation technology to carry OSD information |
| CN102118791B (en) * | 2009-12-31 | 2014-01-08 | 华为技术有限公司 | Method and device for transmitting data packets |
| CN102118792B (en) * | 2009-12-31 | 2015-01-21 | 华为技术有限公司 | Method and device for transmitting data packets |
| JP5131286B2 (en) | 2010-01-04 | 2013-01-30 | 株式会社ニコン | Image processing apparatus and image processing program |
| CN101778161A (en) * | 2010-01-19 | 2010-07-14 | 中兴通讯股份有限公司 | Mobile Internet terminal |
| US8588536B2 (en) | 2010-02-22 | 2013-11-19 | Texas Instruments Incorporated | Guaranteed-rate tiled image data compression |
| US9973768B2 (en) | 2010-03-16 | 2018-05-15 | Texas Instruments Incorporated | CABAC decoder with decoupled arithmetic decoding and inverse binarization |
| US20110234200A1 (en) * | 2010-03-24 | 2011-09-29 | Kishan Shenoi | Adaptive slip double buffer |
| US8233534B2 (en) * | 2010-04-09 | 2012-07-31 | Newport Media, Inc. | Frame buffer compression and memory allocation in a video decoder |
| US8446484B2 (en) | 2010-04-21 | 2013-05-21 | Nokia Corporation | Image processing architecture with pre-scaler |
| US8599316B2 (en) | 2010-05-25 | 2013-12-03 | Intellectual Ventures Fund 83 Llc | Method for determining key video frames |
| US20120120083A1 (en) * | 2010-11-12 | 2012-05-17 | Novatek Microelectronics Corp. | Display apparatus, and display controller and operating method thereof |
| JP2012105188A (en) | 2010-11-12 | 2012-05-31 | Sony Corp | Image output device, image output method, image processing system, image processing method, program, and imaging apparatus |
| KR20120058057A (en) | 2010-11-29 | 2012-06-07 | 삼성전자주식회사 | Offset canceling circuit, sampling circuit and image sensor |
| GB201020983D0 (en) * | 2010-12-10 | 2011-01-26 | Apical Ltd | Display controller and display system |
| CN102647611A (en) | 2011-02-18 | 2012-08-22 | 安凯(广州)微电子技术有限公司 | Chip camera interface function testing method and chip camera interface function testing system |
| JP5822544B2 (en) * | 2011-06-08 | 2015-11-24 | キヤノン株式会社 | Imaging apparatus and imaging system |
| US9077917B2 (en) * | 2011-06-09 | 2015-07-07 | Apple Inc. | Image sensor having HDR capture capability |
| US8879826B2 (en) * | 2011-07-05 | 2014-11-04 | Texas Instruments Incorporated | Method, system and computer program product for switching between 2D and 3D coding of a video sequence of images |
| CN102523446B (en) * | 2011-12-26 | 2014-06-04 | 南京鹏力系统工程研究所 | Adaptive compression method of radar video in vessel traffic navigation system |
| TW201408071A (en) * | 2012-04-09 | 2014-02-16 | Vid Scale Inc | Weighted prediction parameter signaling for video coding |
| CN202551178U (en) | 2012-04-25 | 2012-11-21 | 东北石油大学 | Portable image acquisition and compression device |
| US9532080B2 (en) * | 2012-05-31 | 2016-12-27 | Sonic Ip, Inc. | Systems and methods for the reuse of encoding information in encoding alternative streams of video data |
| CN102685532B (en) * | 2012-06-04 | 2014-04-16 | 山东大学 | Coding method for free view point four-dimensional space video coding system |
| CN102843566B (en) | 2012-09-20 | 2015-06-17 | 歌尔声学股份有限公司 | Communication method and equipment for three-dimensional (3D) video data |
| US20140092439A1 (en) | 2012-09-28 | 2014-04-03 | Scott A. Krig | Encoding images using a 3d mesh of polygons and corresponding textures |
| US9355613B2 (en) | 2012-10-09 | 2016-05-31 | Mediatek Inc. | Data processing apparatus for transmitting/receiving compression-related indication information via display interface and related data processing method |
| US20140098111A1 (en) | 2012-10-09 | 2014-04-10 | Mediatek Inc. | Data processing system for transmitting compressed display data over display interface |
| US9077965B2 (en) | 2012-10-12 | 2015-07-07 | Mediatek Inc. | Method and apparatus for performing lossy image compression through source quantization and lossless compression kernel, and related method and apparatus for image decompression |
| US9568985B2 (en) * | 2012-11-23 | 2017-02-14 | Mediatek Inc. | Data processing apparatus with adaptive compression algorithm selection based on visibility of compression artifacts for data communication over camera interface and related data processing method |
| CN103220492A (en) | 2013-03-25 | 2013-07-24 | 东莞市久益通信科技有限公司 | Mobile Video Conference System Based on 3G Network |
| CN103294038A (en) | 2013-06-10 | 2013-09-11 | 中山市拓维电子科技有限公司 | Dynamic quality remote monitoring system of stabilized soil and cement stabilized gravel production process |
| CN103338354A (en) | 2013-06-17 | 2013-10-02 | 青岛海信电子设备有限公司 | Small-sized video encoding equipment, and video capture, coding and transmission system |
-
2013
- 2013-08-11 US US13/964,102 patent/US9568985B2/en active Active
- 2013-08-12 US US13/965,169 patent/US20140146187A1/en not_active Abandoned
- 2013-08-13 US US13/965,225 patent/US20140146188A1/en not_active Abandoned
- 2013-08-13 US US13/965,203 patent/US9535489B2/en active Active
- 2013-08-13 US US13/965,210 patent/US20140146195A1/en not_active Abandoned
- 2013-09-09 US US14/022,203 patent/US20140146874A1/en not_active Abandoned
- 2013-11-04 CN CN201310539313.XA patent/CN103841415B/en active Active
- 2013-11-05 CN CN201310544279.5A patent/CN103841417B/en not_active Expired - Fee Related
- 2013-11-05 CN CN201310541485.0A patent/CN103841315B/en active Active
- 2013-11-05 CN CN201710412700.5A patent/CN107277347A/en not_active Withdrawn
- 2013-11-21 CN CN201310594147.3A patent/CN103841318A/en active Pending
- 2013-11-21 CN CN201310593750.XA patent/CN103841316B/en not_active Expired - Fee Related
- 2013-11-21 CN CN201310593889.4A patent/CN103841317A/en active Pending
-
2016
- 2016-10-13 US US15/292,145 patent/US20170034517A1/en not_active Abandoned
- 2016-11-24 US US15/361,006 patent/US10200603B2/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030165200A1 (en) * | 2001-08-30 | 2003-09-04 | Pugel Michael Anthony | Method and apparatus for simultaneously retrieving portions of a data stream from different channels |
| US20080025412A1 (en) * | 2006-07-28 | 2008-01-31 | Mediatek Inc. | Method and apparatus for processing video stream |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9491495B2 (en) * | 2015-01-16 | 2016-11-08 | Analog Devices Global | Method and apparatus for providing input to a camera serial interface transmitter |
| US10331564B2 (en) * | 2017-11-29 | 2019-06-25 | Intel Corporation | Technologies for secure I/O with MIPI camera device |
| US20220337747A1 (en) * | 2018-12-07 | 2022-10-20 | Samsung Electronics Co., Ltd. | Apparatus and method for operating multiple cameras for digital photography |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103841315B (en) | 2017-07-07 |
| CN103841316B (en) | 2018-04-17 |
| CN103841317A (en) | 2014-06-04 |
| CN107277347A (en) | 2017-10-20 |
| CN103841417B (en) | 2018-03-06 |
| CN103841417A (en) | 2014-06-04 |
| US20170078567A1 (en) | 2017-03-16 |
| US20140146188A1 (en) | 2014-05-29 |
| CN103841315A (en) | 2014-06-04 |
| US20140146194A1 (en) | 2014-05-29 |
| CN103841415A (en) | 2014-06-04 |
| CN103841318A (en) | 2014-06-04 |
| CN103841316A (en) | 2014-06-04 |
| US10200603B2 (en) | 2019-02-05 |
| US20140146874A1 (en) | 2014-05-29 |
| US20140146187A1 (en) | 2014-05-29 |
| US20170034517A1 (en) | 2017-02-02 |
| US9535489B2 (en) | 2017-01-03 |
| US20140146186A1 (en) | 2014-05-29 |
| US9568985B2 (en) | 2017-02-14 |
| CN103841415B (en) | 2017-08-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20140146195A1 (en) | Data processing apparatus for transmitting/receiving compression-related indication information via camera interface and related data processing method | |
| US9355613B2 (en) | Data processing apparatus for transmitting/receiving compression-related indication information via display interface and related data processing method | |
| US20150049105A1 (en) | Data processing apparatus for transmitting/receiving indication information of pixel data grouping setting via display interface and related data processing method | |
| CN105637849A (en) | Data processing device for sending/receiving random access compressed pixel data group and related data processing method | |
| WO2015139629A1 (en) | Data processing apparatus for performing display data compression/decompression with color format conversion and related data processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: MEDIATEK INC., TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:JU, CHI-CHENG;LIU, TSU-MING;REEL/FRAME:030993/0522 Effective date: 20130808 |
|
| STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |