JP2001177788A - Method and device for reproducing information signal - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a method and a device for reproducing an information signal, which efficiently recognize desired contents in a short time by recording a broadcasting program and selectively reproducing scenes similar to an arbitrary designated scene in the program to perform the skimming operation when reproduced. SOLUTION: An information signal is reproduced from a prescribed recording medium, and a first characteristic signal is detected from this reproduced information signal, and a desired point of the reproduced information signal is designated, and a second characteristic signal is detected from the information signal in a prescribed section including the designated point of time, and the first and second characteristic signals are compared and discriminated on the basis of prescribed operation processing, and reproducing is so controlled that a desired section of the information medium may be reproduced in accordance with the result of this comparison and discrimination.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information signal reproducing method and an information signal reproducing apparatus, and more particularly, to recording an information signal such as a video signal and an audio signal on a recording medium such as a magneto-optical disk, a hard disk, and a semiconductor memory. In a recording device that performs, for example, when a broadcast program is recorded and reproduced, a scene similar to an arbitrary specified scene in the program is selectively reproduced to perform a skimming operation, and desired contents can be efficiently grasped in a short time. The present invention relates to an information signal reproducing method and an information signal reproducing device.

[0002]

2. Description of the Related Art In recent years, information recording media such as a tape recording medium, a hard disk, and a magneto-optical disk have been widely used because their recording capacity has been increased and their prices have been reduced. Further, with the development of data compression methods such as MPEG, the price of signal processing LSIs has become relatively low, and various recording / reproducing devices have come out. There are various types of broadcast programs, and users can easily record those programs.

Another problem is that while it is possible to easily record various programs, it takes too much time to view all the recorded broadcast programs when reproducing them. In order to solve this problem, a conventional VTR or DVD device has a special reproduction function such as a high-speed reproduction function in the forward direction, so that an overview of a recorded broadcast program or the like can be viewed in a short time.

[0004]

However, in such a conventional high-speed reproduction, although the outline of a broadcast program recorded in a relatively short time can be grasped, a scene desired to be watched is skipped or the reproduction speed is reduced. However, there is a problem that the contents are too early to understand.

Therefore, there is a problem that a desired scene must be solved so that it can be selectively and easily reproduced.

[0006]

In order to solve the above problems, an information signal reproducing method and an information signal reproducing apparatus according to the present invention have the following configurations.

(1) A predetermined information signal is reproduced from a predetermined recording medium, a first characteristic signal is detected from the reproduced information signal, and a desired time point of the reproduced information signal is designated. A second characteristic signal is detected from the information signal in a predetermined section including a time point, and the detected first characteristic signal and the detected second characteristic signal are compared and determined based on predetermined arithmetic processing. An information signal reproducing method, comprising: performing reproduction control so as to reproduce a desired section of the information medium in accordance with a result of the comparison determination. (2) The information signal reproducing method according to (1), wherein the information signal is a video signal and / or an audio signal. (3) The first characteristic signal and the second characteristic signal are:
The information signal reproducing method according to (1), wherein the information signal is formed by a signal other than a real-time area that can be substituted for the detected information signal. (4) The information signal reproducing method according to (1), wherein the comparison / determination process is an error function calculation process or a correlation function calculation process.

(5) reproducing means for reproducing a predetermined information signal from a predetermined recording medium; first detecting means for detecting a first characteristic signal from the information signal reproduced by the reproducing means;
Specifying means for designating a desired time point of the predetermined information signal reproduced by the reproducing means; and a second means for detecting a second characteristic signal from the information signal in a predetermined section including the time point specified by the specifying means.
Detecting means, comparing means for comparing and discriminating the first characteristic signal and the second characteristic signal based on predetermined arithmetic processing, and reproducing a desired section according to the result of the discriminating means. An information signal reproducing apparatus, comprising: a reproduction control means for performing reproduction control as described above. (6) The information signal reproducing device according to (5), wherein the information signal is a video signal and / or an audio signal. (7) The first characteristic signal and the second characteristic signal detected by the first detecting means and the second detecting means are formed by signals other than the real time domain which can be replaced with the detected information signal. The information signal reproducing device according to (5), which is characterized in that: (8) The information signal reproducing device according to (5), wherein the discriminating means for performing the comparison discriminating process performs an error function calculating process or a correlation function calculating process.

As described above, when an information signal, for example, a broadcast program is recorded and reproduced, a scene similar to an arbitrary specified scene in the program is selectively reproduced to perform skimming operation, thereby efficiently and quickly. It becomes possible to grasp desired contents.

[0010]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, an embodiment of an information signal reproducing method and an information signal reproducing apparatus according to the present invention will be described in the following order with reference to the drawings. [1] Outline and principle of information signal reproducing method and information signal reproducing apparatus [2] Configuration diagram of information signal reproducing apparatus [3] Information signal characteristic detecting method [4] Operation flowchart of information signal reproducing apparatus

[1] Outline and Principle of Information Signal Reproducing Method and Information Signal Reproducing Apparatus The present invention reproduces a signal such as a broadcast program recorded from an information signal recording medium such as a magneto-optical disk, a hard disk or a semiconductor memory. Then, a time point of a certain scene is designated, and a reproduction signal in a predetermined section including the time point is subjected to signal analysis in a predetermined frequency region to detect a predetermined characteristic signal (second characteristic signal). Similarly, a reproduction signal in a section not specified is analyzed in a predetermined frequency region to detect a predetermined characteristic signal (first characteristic signal). Efficiently by detecting a similarity by performing a predetermined error function operation or a cross-correlation operation with a characteristic detection signal (second characteristic signal) of a section including the previously specified time point and selectively outputting the similar scene. You can skim the scenes you want to see.

Next, the principle of the information signal reproducing method and the information signal reproducing apparatus of the present invention having the functions described above will be described with reference to FIG.

As shown in FIG. 1, video sequences 1, 2, 3, and 4 of a certain broadcast program reproduced from a predetermined recording medium.
It is assumed that there are -n, n + 1, n + 2, n + 3, ---, and n + 10. It is assumed that the broadcast program being reproduced is, for example, a broadcast program such as baseball.
When watching the section of the scene of f1 in (a), the scene is just a baseball hit scene, and if the user wants to digest-play only such a hit scene, the f1 section of that scene It is assumed that the designation a1 is made at the time of the video sequence 3 in the middle of (1) (see FIG. 1B).

Therefore, as shown in FIG. 1C, a predetermined characteristic signal p1 (first characteristic signal) in the f1 section is detected.
It is stored in a predetermined memory such as a RAM. here,
The characteristic signal is a signal outside the real time domain that can be substituted for an information signal of a broadcast program or the like, and is a coefficient such as FFT (fast Fourier transform) analysis, DCT (discrete cosine transform) analysis, or wavelet analysis. When such a coefficient is used as a characteristic signal, the data amount is smaller than the data amount in the real-time area, so that the signal processing time and the calculation time are reduced, which is efficient.

Therefore, predetermined sections f2, f3, ------ fm, fm + other than the f1 section including the designated time point.
1, fm + 2, characteristic signals p2, p3, p4, -----, pm, p in the second characteristic signal
A cross-correlation function between m + 1, pm + 2 ---- and the characteristic signal p1 detected in advance is sequentially calculated. Thereafter, a scene section having a predetermined correlation is detected by comparison with a predetermined threshold value. The detected section is a section similar to the scene of the section including the previously specified video, and includes a hitting scene specified by the user. Therefore, by reproducing the detected scene section, only the section including the desired scene can be digest-reproduced.

Further, as shown in FIG. 1 (d), another designation b1 may be specified, and the predetermined sections --- f2, f3, --- fm- 1, fm + 1,
fm + 2, characteristic signals p2, p3, p at ----
4, --- pm-1, pm + 1, pm + 2 ----
Then, a cross-correlation function between-and a previously detected characteristic signal pm is sequentially calculated. Thereafter, a scene section having a predetermined correlation is detected by comparison with a predetermined threshold value. This detected section is a section similar to the scene of the section including the previously specified video,
Includes a blow scene as specified by the user. Therefore, by reproducing the detected scene section, only the section including the desired scene can be digest-reproduced.

Although a plurality of designations may be made in this way,
If the specified number becomes too large, digest reproduction, which is one of the objects of the present invention, becomes inefficient, so the specified number may be limited. For example, if it takes about 20 minutes or 30 minutes even though the recording time is about 10 minutes, it may become difficult to perform an efficient operation. For example, the recording time is specified according to the recording time as shown in the characteristic diagram of FIG. An upper limit for the number may be set.

Here, FIG. 3 is a conceptual explanatory view of a predetermined section processing method. For example, a series of video sequences 1, 2, 3,
Considering that the user wants to specify the image sequence 9 and sends a command to the system controller while looking at 4, ---, ---, 21, the time t has already been specified by the user.
Has passed, and the image sequence 12 of FIG. 3 may be designated. In addition, although it does not seem so at the moment of watching a certain broadcast program or the like, it is conceivable that the user wants to specify after a few seconds.

Therefore, as shown in FIG. 3, for example, the image sequence 9 at the time when the user really wants to specify the image sequence 1
By setting the image series 6 to 14, which are the sections before and after the backward section tb and the forward section tf with respect to the designated time point including the second section, as predetermined sections, it is possible to prevent a scene that one wants to see from being overlooked. Here, if the predetermined section is too long, the redundancy increases, so that the sections tb and tf are set to approximately 2 minutes or less.

[2] Configuration diagram of information signal reproducing device FIG. 4 is an example showing a configuration diagram of an information signal reproducing device according to the present invention. The information signal reproducing apparatus includes a data recording medium 1 such as a hard disk or a magneto-optical disk, a reproduction signal processing system 2 for reproducing video data and audio data recorded on the data recording medium 1, and a reproduction signal processing system 2. The reproduced signal is amplified to a predetermined level, subjected to a predetermined reproduction equalization process, further digitized and subjected to a predetermined error correction process, and a buffer memory system 3 to which data is inputted and inputted. A demultiplexer system 4 for extracting video data and audio data of the video signal as an elementary stream, a video signal processing system 5 for decoding video data detected by the demultiplexer system 4, and video data decoded by the video signal processing system 5. And a video signal processing system 6 which can store the data by performing predetermined compression processing such as MPEG. And a memory for storing data analyzed by the video signal characteristic analysis system 7 for detecting a predetermined characteristic signal by a method described below ([3] information signal characteristic detection method). System 8, an audio signal processing system 9 for decoding audio data detected by the demultiplexer system 4, a memory system 10 for storing the audio data processed by the audio signal processing system 9, and an audio signal processing system 9. An audio signal characteristic analysis system 11 which receives a signal and detects a predetermined characteristic signal by a method described later ([3] information signal characteristic detection method).
A memory system 12 for storing data analyzed by the audio signal characteristic analysis system 11, a characteristic signal comparison processing system 13 for comparing characteristics of video data and audio data,
The recording medium system 1 includes a system controller 14 that controls the buffer memory system 3, the demultiplexer system 4, and the recording medium drive system 15 by controlling the signal from the characteristic signal comparison processing system 13 according to a scene designation user input signal from the user. A recording medium drive system 15 to be driven, a video signal D / A processing system 16 for converting a video signal from the video signal processing system 5 into an analog video signal and outputting the video signal to a video / audio monitor system 18, and an audio signal processing system 9. An audio signal D / A processing system 17 that converts an audio signal into an analog audio signal and outputs it to a video / audio monitor system 18.

The data flow in the information signal reproducing apparatus having such a configuration will be described. First, video data and audio data recorded on a recording medium system 1 for recording data such as a hard disk or a magneto-optical disk are reproduced and input to a reproduction signal processing system. In the reproduction signal processing system 2, the reproduced signal is amplified to a predetermined level, subjected to predetermined reproduction equalization processing, digitized, subjected to predetermined error correction processing, and input to the buffer memory system 3. Data is reproduced from the recording medium 1 so that predetermined reproduction data is accumulated in the buffer memory system 3. A signal from the system controller 14 is input to a recording medium drive system 15 to control the operation of the recording medium system 1. Buffer memory system 3
Is input to a demultiplexer processing system 4, and predetermined video data and audio data are extracted as an elementary stream. The video data is input to a video signal processing system 9, and the audio data is input to an audio signal processing system 11. .

The video data is decoded by a video signal processing system 5 and a memory system 6 into video data which has been subjected to predetermined compression processing such as MPEG. The signal in the video signal processing system 5 is input to the video signal characteristic analysis system 7, and a predetermined characteristic signal is detected by a method described later ([3] Information signal characteristic detection method). The detected characteristic signal from the video signal characteristic analyzing system 7 in the predetermined section including the desired time point designated by the user is stored in the memory system 8, and is input to the characteristic signal comparison processing system 13 at each predetermined reading time and is input to the predetermined Operation processing is performed.

The audio data is decoded by the audio signal processing system 9 and the memory system 10 into predetermined audio data such as MPEG audio. The signal in the audio signal processing system 9 is input to an audio signal characteristic analysis system 11, and a predetermined characteristic signal is detected by a method described later. The detected characteristic signal from the audio signal characteristic analysis system 11 in a predetermined section including the desired time point designated by the user is stored in the memory system 12 and is input to the characteristic signal comparison processing system 13 at each predetermined reading time point. The input audio signal is sequentially input to the audio signal characteristic analysis system 11 and the characteristic is detected. The characteristic signal of the detected input audio signal is input to the characteristic signal comparison processing system 13 and a predetermined correlation operation is performed.

The video data signal from the video signal processing system 5 is input to a video signal D / A processing system 16, which converts video data having a predetermined sampling frequency and a predetermined number of quantization bits into an analog signal. input. The audio data signal from the audio signal processing system 9 is an audio signal D / A
The audio data having a predetermined sampling frequency and a predetermined number of quantization bits is input to the processing system 17, converted into an analog signal, and input to the video / audio monitoring system 18. The user is watching the video / audio monitor system 18, specifies a desired point in time by the system controller 14, and performs the above-described predetermined signal processing for each specification specified by the user.

[3] Information Signal Characteristic Detection Method Here, characteristic signals are detected by FFT analysis, DCT analysis, wavelet analysis, or the like. For example, the signal f in the specified section
If (t) is analyzed by FFT analysis into F (ω),
Fn (t) is FFT of a signal in a predetermined section n other than the specified section.
It is assumed that Fn (ω) is analyzed by the analysis. Here, consider a square error signal Gn between F (ω) and Fn (ω) within a predetermined section.

[0026]

(Equation 1)

Next, this is compared with a predetermined threshold value Pth to determine whether a predetermined similarity is recognized.

[0028]

(Equation 2)

These signal analyzes are performed on the luminance signal and the chrominance signal for the video signal, but may be performed on only the luminance signal in some cases. Alternatively, the determination may be performed on the audio signal, and the determination may be made comprehensively with the calculation result of the video signal.
As described above, a DCT analysis may be used in addition to the FFT analysis.

Consider the case where wavelet analysis is used. The signal f (t) in the specified section is analyzed level k
Is analyzed as Ck (x), and the signal fn (t) in a predetermined section other than the designated section is similarly analyzed as Cnk (x) at the analysis level k. Here, the square error signal Rn shown in the following Expression 3
Consider k.

[0031]

(Equation 3)

The comparison processing is performed with a predetermined threshold value. Alternatively, the analysis level having a large energy may be selected and the comparison processing may be performed only on this level.

The error signal calculation may be performed for all analysis levels. In that case, the values of error calculation for all analysis levels are added as follows.

[0034]

(Equation 4)

Next, this is compared with a predetermined threshold value Qth to determine whether a predetermined similarity is recognized.

[0036]

(Equation 5)

For example, a Haar wavelet may be used as a wavelet function for a video signal so that arithmetic processing is easy, but other wavelet functions may be used.

Here, in addition to the square error function as described above, it is conceivable to use a correlation function. For example, FF
Consider a cross-correlation function m (ω, ω + τ) between F (ω) and Fn (ω) by T analysis or DCT analysis.

[0039]

(Equation 6)

Here, τ is further regarded as a time variable and FF
Assume that T analysis is performed and M (ω) is obtained.

If a predetermined correlation is detected, this M (ω)
Since a spectrum peak is recognized, a predetermined threshold value Nth is set, and the spectrum peak value M (ωpk) is compared.

[0042]

(Equation 7)

It is also conceivable to perform the correlation function processing for the wavelet analysis as described above. C
For k (x) and Cnk (x), consider the cross-correlation function (ω, ω + τ) shown in Equation 8 below.

[0044]

(Equation 8)

Here, assuming that Nk (ω) is obtained in consideration of the FFT analysis, if a predetermined correlation is detected, a spectrum peak Nk (ωpk) is recognized. Equation 9 below
As shown in (5), a predetermined threshold value Sth is set, and the difference signal Wk at the analysis level k is obtained.

[0046]

(Equation 9)

Here, the analysis may be compared with the predetermined threshold value by focusing only on the analysis level having the largest energy among the analysis levels. Here, considering all the analysis levels, Is obtained.

[0048]

(Equation 10)

Next, as shown in the following Expression 11, the difference signal Wall is compared with a predetermined threshold value Eth.

[0050]

[Equation 11]

As described above, a scene similar to a desired scene can be detected by performing the analysis and comparison process.

[4] Operational Flowchart of Information Signal Reproducing Apparatus FIG. 5 is an operational flowchart of the information signal reproducing method of the present invention. Starting from step ST1 and step ST
In step 2, an initial value 0 for counting the number of processing loops is set.

In step ST3, a predetermined section for calculating a predetermined characteristic is detected, and in step ST4, a characteristic signal is detected. In step ST5, the number of the section in which the characteristic is detected is incremented by one, and the correlation between the designated scene and the detected section is sequentially calculated to count the number of times.

In step ST6, it is determined whether or not the user has specified. If it is determined that the user has been specified, the process proceeds to step ST7, where it is determined whether or not the detection of the predetermined section is two or more. If the detection section is one section, the designated section and the detection section coincide with each other, so that the process jumps to step ST21.

If it is determined in step ST6 that no designation has been made, the process proceeds to step ST8, and it is determined whether or not the designation has been made before that. If not, the process proceeds to step ST21. If it is determined in step ST8 that it has been specified before, the process proceeds to step ST10, which is a processing routine for performing a correlation operation.

In step ST7, the number of times of detection of the predetermined section is 2
If it is determined as above, the process proceeds to step ST9, and it is determined whether the number is equal to or less than a predetermined number n1. This is because if the designated number is too large, the processing takes too much time, and if the designated number is large, there is a possibility that the digest reproduction or skimming operation, which is one of the objects of the present invention, cannot be performed well. .

If the number is larger than the predetermined number n1, the user is warned by display or voice in step ST12, and the process proceeds to step ST21.

If it is determined in step ST9 that the designated number is equal to or smaller than a predetermined value, the designated number n is set to 1 in step ST10.
The process proceeds to step ST11 after incrementing, and the detected predetermined characteristic data is stored in a predetermined memory such as a RAM. In step ST13, the detected number is substituted for another variable K in order to use the stored characteristic values for the sequential operation.

In step ST14, a correlation operation is performed between the designated scene section and the characteristic value of the sequentially detected predetermined section, and
In step ST15, the calculated value is compared with a predetermined threshold value to determine whether there is a predetermined correlation. Step ST1
In step 6, predetermined reproduction processing is performed according to the correlation, and when it is determined that there is no predetermined correlation, the process jumps to step ST17. In step ST17, the number of the predetermined detection sections is decremented by 1, and the process proceeds to step ST18. In step ST18, it is determined whether or not the correlation calculation processing has been performed for all of the designated scene section K and the predetermined section. If it is determined that the processing has not been completed, the above-described steps ST14 to ST14 are performed.
The process jumps to Step ST14 to repeat the process of Step 18.

If it is determined in step ST18 that the processing of the designated scene K has been completed, the process proceeds to step ST19, and the number m of predetermined sections detected is again determined in order to repeat the correlation calculation of the predetermined sections sequentially detected in step ST17. Variable L
And decrement the number K of designated scenes by one. In step ST20, it is determined whether all the predetermined correlation calculations for the designated scene have been completed. If it is determined that all of the predetermined correlation calculations have not been completed, the process jumps to step ST14 to repeat the processing of steps ST14 to ST20.

If it is determined in step ST20 that all the processes have been completed, the process proceeds to step ST21, and it is determined whether or not the operation is to be stopped.
If the stop is not detected at step 22, the process jumps to step ST3 and repeats the above processing.

[0062]

As described above, according to the present invention, it is possible to selectively reproduce only a scene designated by the user, such as a hitting scene, a base scene, or an approach scene, in a sports program such as baseball or sumo recorded for a long time. As a result, there is an effect that a broadcast program recorded for a long time can be skimmed efficiently in a short time, and the contents can be grasped effectively.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating the operation principle of the present invention.

FIG. 2 is a conceptual diagram of an upper limit characteristic of a designated number of settings.

FIG. 3 is an explanatory diagram of a predetermined section processing method.

FIG. 4 is an example of a block diagram of an information signal reproducing apparatus according to the present invention.

FIG. 5 is an operation flowchart of an information signal reproducing method according to the present invention.

[Description of Signs] 1: Recording medium, 2: Playback signal processing system, 3: Buffer memory system, 4: Demultiplexer system, 5: Memory system,
6: video signal processing system, 7: video signal D / A processing system, 8:
Video signal characteristic analysis system, 9: memory system, 10: recording medium drive system, 11: audio signal processing system, 12: audio signal D / A
Processing system, 13: audio signal characteristic analysis system, 14: system controller system, 15: video / audio monitor system, 16: characteristic signal comparison processing system, 17: memory system, 18: memory system

Claims (8)

[Claims] An information signal is reproduced from a predetermined recording medium, a first characteristic signal is detected from the reproduced information signal, a desired time point of the reproduced information signal is designated, and the designated time point is designated. A second characteristic signal is detected from the information signal in a predetermined section including the second characteristic signal, and the detected first characteristic signal is compared with the detected second characteristic signal based on a predetermined arithmetic processing. An information signal reproducing method, comprising: performing reproduction control so as to reproduce a desired section of the information medium according to a result of the determination. 2. The information signal reproducing method according to claim 1, wherein the information signal is a video signal and / or an audio signal. 3. The information signal reproducing apparatus according to claim 1, wherein the first characteristic signal and the second characteristic signal are formed of signals other than a real-time domain that can be replaced with a detected information signal. Method. 4. The information signal reproducing method according to claim 1, wherein the comparison / determination processing is an error function calculation processing or a correlation function calculation processing. 5. A reproducing means for reproducing a predetermined information signal from a predetermined recording medium; a first detecting means for detecting a first characteristic signal from the information signal reproduced by the reproducing means; Specifying means for specifying a desired time point of the predetermined information signal, a second detecting means for detecting a second characteristic signal from an information signal in a predetermined section including the time point specified by the specifying means, Determining means for performing comparison and determination processing on the characteristic signal and the second characteristic signal based on a predetermined calculation processing; and reproduction control means for performing reproduction control so as to reproduce a desired section according to the result of the determination means. An information signal reproducing device comprising: 6. The information signal reproducing apparatus according to claim 5, wherein said information signal is a video signal and / or an audio signal. 7. The first characteristic signal and the second characteristic signal detected by the first detection means and the second detection means,
6. The information signal reproducing apparatus according to claim 5, wherein the information signal reproducing apparatus is formed by a signal other than a real time domain that can be substituted for the detected information signal. 8. The information signal reproducing apparatus according to claim 5, wherein the discriminating means for performing the comparison discriminating process performs an error function calculating process or a correlation function calculating process.