WO2004095841A1 - Content reproduction method - Google Patents

Abstract

A content reproduction method includes a link generation step (244) for generating a link between a plurality of contents by using a common time axis defined commonly to a plurality of contents and reproduction steps (248, 250, 252, 254, 256) for reproducing the plurality of contents by using the link generated between the plurality of contents.

Description

 Description Content playback method Technical field

 The present invention relates to a method for reproducing content, and more particularly to a content reproducing method for reproducing a plurality of contents such as multimedia data in association with each other. Background art

 In this specification, programs broadcast by terrestrial and satellite broadcasting, streams distributed via the Internet, CD-ROMs (Communication Disks), and DVDs (Digital Versatile Disks) The so-called content data stored in package media such as video and audio are called “contents (Co 11 tent)” regardless of their format.

 With the development of computer hardware, image and audio processing technology, and communication technology, it has become possible to play back various types of content linked to each other. A typical example of such a system is a browser program connected to the so-called Internet and running on a computer having various storage devices. Another typical system is a hard disk recording / playback device that has a hard disk device and can play back a recorded program while recording it.

 For example, by pressing a button displayed on a certain web page on the Internet, a stream broadcast can be viewed, and another button is displayed on the screen of the stream broadcast. In addition, it is possible to play other stream broadcasts.

In the conventional technology for enabling the reproduction of such content, when trying to link from one content to another content, the following is common. For example, the script of the link destination page Address (Unifom rm Resource Locator: Generally represented by a URL). This address can be used as tag data to move from one content to another. A typical example is a browser using SMI L (Synchronized Multimedia Integration Language).

 SMI L is an XML (Ex tended Markup Language) tag for creating interactive presentations that combine multimedia data such as audio, video, still images, text, 'and animations. Language. By describing the relationship between multiple contents in SMIL, it is possible to link from one content to another and switch from displaying the first content to displaying the linked content.

 However, for links using SMIL, it is necessary to define a script-based tag language to specify the link destination of the content. In addition, it is not possible to play multiple contents in synchronization.

 As described above, when a plurality of contents are reproduced, especially when the contents are moving images or music, there is a technology for synchronizing and reproducing them. A conventional example of a method for synchronously reproducing a plurality of contents using a script file has been proposed in Japanese Patent Application Laid-Open No. 2002-125214. In JP-A-2002-125214, a scenario for reproducing a plurality of contents is created in advance as a script file. This scenario includes information on what content will be played from when and when. By playing back the content according to this scenario, it is possible to play back a plurality of content in synchronization.

 As a method for synchronizing contents, a method using non-linear video editing software has been proposed in Japanese Patent Application Laid-Open No. H10-316161. In this method, the contents are arranged in time and the contents are synchronized by manipulating a graphical user interface (GUI). In short, this method is to create a scenario corresponding to the “scenario” described in JP-A-2002-125214 by using GUI.

In addition, GPS (Global Positioning System) reception A device for synchronizing a plurality of videos using a universal time code (UTC: Universal Time Code) given from a device has been proposed in JP-A-2002-32978. This device is, for example, a video tape recorder with a camera, which receives UTC from a GPS receiver at the time of shooting and adds it to the video as a time stamp. It is said that adding UTC, which can be called absolute time, to an image has the effect of making it easier to edit video shot with similar devices.

 However, in the method described in Japanese Patent Application Laid-Open No. 2002-125214, a scenario is required to synchronize contents, and for that purpose, a relative time between a plurality of contents needs to be defined. Scenarios can also be defined so that they can move along a scenario from one point of content to another point of another content. However, in that case, you can only play back in accordance with that scenario. It is not possible to play content while synchronizing in a different way from the scenario.

 The system described in Japanese Patent Application Laid-Open No. Hei 10-3 1661 is also essentially a

It is the same as that described in the 125214 publication. That is, in the method described in Japanese Patent Application Laid-Open No. Hei 10-31661, the user defines the synchronization between contents by arranging the contents on a time axis provided by the system. Therefore, it is possible to play multiple contents according to the equivalent of the “sinario” created in that way, but it is not possible to play it in any other format.

 In the system described in Japanese Patent Laid-Open No. Hei 10-3 1661, it is necessary for editing software to manage the plurality of contents in order to specify synchronization. Therefore, a user who wants to define synchronization must have all content in the system. Therefore, it is basically difficult to synchronize and play back separately prepared contents.

By using the technology described in JP-A-2002-125214 or JP-A-10-31611, if a third party describes the relationship between contents as a scenario and provides it to the user, including its tag information, etc. The user can synchronize and play back the multiple contents according to the scenario. But such China If the Rio is not prepared, it is not easy to realize a playback method in which even if a general user independently obtains multiple contents and plays them in synchronization.

 According to the technique described in Japanese Patent Application Laid-Open No. 2002-32978, a global time stamp obtained from GPS is attached when a video is created. This is certainly convenient when editing between multiple contents, but it is not easy for users to use. Also, a method for synchronizing and playing back a plurality of contents using this is not described in JP-A-2002-32978.

 For example, suppose a user records a television broadcast of a World Cup soccer game with English and Japanese commentary on his hard disk recording and playback device. It is assumed that a commentary in French is broadcast separately for the same game, and the data of the broadcast content is placed on the Internet and made accessible. In this case, it would be convenient if it was possible to easily add a commentary in French prepared on the Internet to the recorded television broadcast video and synchronize them for viewing. However, such a technique of synchronizing and reproducing a plurality of contents is impossible with the technology described in JP-A-2002-125214, JP-A-10-31661, or JP-A-2002-32978.

 In short, in the prior art, a link format that moves from a predetermined point of one content to another predetermined point of another content is possible, but from an arbitrary point of the certain content. A link that goes to a point in another content that corresponds to that arbitrary point (this is referred to herein as a “continuous link” as opposed to a discrete link in the prior art). Impossible. If such a continuous link becomes possible, it would be possible to synchronize multiple contents and switch at any point to display them alternately, or to synchronize multiple contents and display them simultaneously. Will be able to do so. Disclosure of the invention

Therefore, the purpose of this invention is to set a continuous link between multiple contents And a content reproduction method capable of reproducing a plurality of contents in synchronization.

 Another object of the present invention is to provide a content reproduction method capable of setting a continuous link between a plurality of contents and synchronizing and displaying a plurality of contents prepared independently of each other. That is.

 Still another object of the present invention is to provide a content reproduction method capable of setting a continuous link between a plurality of contents and switching and reproducing the plurality of contents at an arbitrary point while synchronizing the plurality of contents. is there.

 Another object of the present invention is to set a continuous link between a plurality of contents so as to synchronize and display a plurality of contents prepared independently of each other in a desired format. Is to provide a way.

 A content reproduction method according to the present invention includes: a link generation step of generating a link between a plurality of contents by using a common time axis commonly defined for a plurality of contents; and a link generated between the plurality of contents. And a reproducing step of reproducing a plurality of contents by using.

 A link between contents is generated using a common time axis that is defined in common for multiple contents. By introducing a common time axis, links between contents can be defined discretely or continuously. These definitions can be made as discrete or continuous functions. It is also possible to link a location of a certain content to a corresponding location of another content via a common time axis and dynamically link it. Preferably, the link generation step includes a step of dynamically determining a link between a plurality of contents using a common time axis.

 More preferably, the reproducing step includes a step of reproducing a plurality of contents by synchronizing the contents with time using a link generated using a common time axis. The common time axis may be a time axis defined by an absolute time according to a predetermined reference.

Multiple contents are played back in time synchronization using links generated using a common time axis. Even if the contents are prepared separately, they can be synchronized with each other by defining a common time axis. Preferably, for each of the plurality of contents, a playback time axis for playback is further defined separately from the common time axis. The reproducing step includes a first content reproducing step of reproducing a selected one of the plurality of contents according to a reproduction time axis defined in relation to the selected one of the contents, and a plurality of contents. Of the different content that is different from the selected one of the selected content, the location linked to the playback location in the first content playback step is linked to the content playback in the first content playback step and played back And a second content reproduction step.

 Both contents are played based on the playback time of one of the two contents. When a part of one content is being played, a part of the other content that is linked to that part is played at the same time. At the same time as one content, the other content can be played at the playback speed determined by the link

 More preferably, the content reproduction method further includes an operation signal generating step for generating a predetermined operation signal. The reproducing step includes a step of reproducing the contents by switching a plurality of contents according to the link in response to the operation signal. The content reproduction method further includes a step of recording, in a predetermined storage device, an operation signal and a time point on the common time axis of the content being reproduced by the reproduction step when the operation signal is generated; Generating an operation signal recorded in the storage device in response to the operation reproduction signal at a time point on a common time axis when each operation signal is generated.

 As a result, the operation signal and the playback point of the content on the common time axis at that time are recorded, and this can be reproduced by the playback step. As a result, the reproduction of the content according to the operation of the operator is reproduced.

 A recording medium according to another aspect of the present invention stores a computer program which, when executed by a computer, causes the computer to operate as the content reproduction method described above.

 The content reproduction method described above can be realized by a computer.

BRIEF DESCRIPTION OF THE FIGURES FIG. 1 and FIG. 2 are diagrams for explaining the concept of link time adopted in the device according to the embodiment of the present invention.

 FIG. 3 is a functional block diagram of the device according to one embodiment of the present invention. FIG. 4 is a diagram showing the structure of a content record.

 FIG. 5 is a hardware configuration diagram of the device according to the embodiment of the present invention.

 FIG. 6 is a block diagram of a remote control input device of the device according to one embodiment of the present invention.

 FIG. 7 is a flowchart showing an overall control structure of software when the apparatus according to the embodiment of the present invention is realized by a computer.

 FIG. 8 is a flowchart of a content selection and registration process.

 FIG. 9 is a flowchart of processing for registering content in the content registration unit.

 FIG. 10 is a flowchart of a default reproduction time calculation program. FIG. 11 is a flowchart of the default link time calculation program. C FIG. 12 is a flowchart of a process of selecting the content having the earliest start link time as the reproduction content.

 FIG. 13 is a flowchart of the link generation process.

 FIG. 14 is a flowchart of the content reproduction process.

 FIG. 15 is a flowchart of another example of the reproduction time calculation program.

 FIG. 16 is a flowchart of another example of the link time calculation program. FIG. 17 is a diagram showing an example of content reproduction in the first operation example.

 FIGS. 18 to 23 are diagrams showing the configuration of a content record in the first operation example.

 FIG. 24 is a diagram showing an example of content reproduction in the second operation example.

 FIGS. 25A to 28C are diagrams showing the configuration of a content record in the second operation example.

 FIG. 29 is a diagram showing an example of content reproduction in the third operation example.

FIG. 30 to FIG. 33 are diagrams showing the configuration of a content record in the third operation example. BEST MODE FOR CARRYING OUT THE INVENTION

 The content is supplied from a broadcast medium or a storage device connected to a network such as the Internet to a device for reproduction by wire and wireless as a digital signal and an analog signal. The content may be temporally continuous or discontinuous, and a reproduction time for that may be assumed. For example, in the case of a moving image, a time axis for reproduction can be considered. The same applies to music. A still image can be considered to be the same as a moving image that displays the same image at any time along the time axis.

 Just as the reproduction time can be assumed for each content, it is possible to specify a link time separately from the reproduction time. Although the link time has a predetermined relationship with the reproduction time, the concept of the link time does not exist in the conventional technology as described below.

 Link time is a concept introduced to establish a "continuous link" between one content and another. Consider the link time axis separately from the playback time axis as a time axis that is set in common among multiple contents. Each content has its own link time.

 The link time can be determined based on an absolute time, such as UTC, or based on a time system based on another point in time. In addition, the link time may be defined in each content in a form different from the time that can be considered as usual.

 Link time allows a correspondence between a point in time in one piece of content and a point in time in another piece of content. For example, if the playback speed of a rainy person is adjusted so that the link times of multiple contents are always the same, multiple contents can be played simultaneously in synchronization. Typically, one content may be selected, and the other content may be played back based on the link time while the content is played back at a normal playback speed.

Also, even when playing multiple contents exclusively, when switching from one content to another, the link time in the former content is known and the switching is performed. After the content is obtained, it can be reproduced from the link time at the time of switching according to the link time defined for the content. By doing so, for example, it is possible to realize a reproduction method in which one sight is viewed while switching from two or more viewpoints while actually switching two contents recorded at the same time.

In addition, it is possible to define the link time to be a special way, which is different from the one in which the link time advances gradually at a fixed rate like the usual idea of time. The concept relating to _c- link time, which can be associated and reproduced in a unique format, will be described with reference to FIGS. 1 and 2. FIG. For example, referring to FIG. 1, consider the link time between the first content and the second content. It is assumed that a link time indicated by a link time 52 of the first content is defined in the first content. Usually, the first content is reproduced at a speed indicated by the reproduction time axis 50. Similarly, it is assumed that a link time 54 of the second content is defined in the second content, and the content is normally reproduced at a speed indicated by a reproduction time axis 56. The playback time axes 54 and 56 indicate the elapsed time during playback.

 In the example shown in FIG. 1, the link time of the first content is equal to the link time of the second content. Therefore, if you try to play the second content in synchronization with the first content while it is playing at normal speed, the second content will play at normal speed as a result. Become.

 On the other hand, with reference to FIG. 2, consider a case where the link time 74 defined for the second content is different from the link time 72 in the first content. Referring to FIG. 2, for example, the content of the link time t0 to t3 of the second content is normally multiplied by the playback time T0 to T6 as indicated by the playback time 76. It shall be reproduced. On the other hand, the reproduction of the first content is the same as that shown in FIG.

In this case, if both are simultaneously and independently played, at the playback time Τ6, the first content is played until the link time t6, and the second content is played only until the link time t3. This is not a synchronization. In the present embodiment, in the case described above, the reproduction speeds of the two contents are adjusted so that the link times of the two contents are always equal to each other. “Synchronous playback” in the present embodiment means that a plurality of contents are respectively played back at such a speed that the link times of the plurality of contents become equal.

In the example shown in FIG. 2, if the first content is the main playback content, for example, the content of t0 to t6 of the second content is played during the playback time TO to T3. The second content will be played at twice the speed of playing it alone. Conversely, assuming that the second content is the main playback content, the content at t0 to t3 of the first content is played during the playback time TO to T6. In this case, the first content, D _0, such a Shito to be played to a rate of 1 Z 2 compared to when it is played alone

 The link time may be automatically generated from the link start time and the reproduction time. In addition, as one expression method of link time, it is conceivable to use absolute time such as UTC and world standard time as described above. By using the link time specified in content playback as an argument, it is possible to play back a specific part of another content corresponding to the link time. In this way, a continuous link can be established between a plurality of contents by defining the correspondence of the link time continuously or calculating the correspondence.

 FIG. 3 shows a functional block diagram of the content reproducing apparatus according to the present embodiment. This content playback device is for playing back the content existing in the content database 104. The content database 104 is representative of various content sources.

Referring to FIG. 3, this content reproduction device 90 controls an input / output device (not shown), and when receiving a trigger from the input device, sends a signal to each section according to the type of the trigger and the input / output mode. When a command to select a specific content in the content database 104 is given from the user interface unit 100 and the user interface unit 100, a content selection unit 102 to select the content, and a user An instruction to register a certain content is given from the interface section 100. Then, a content registration unit 106 for holding information on the content such as the content data, the reproduction time of the content data, and the link time as a content record is included.

 The content reproduction device 90 further stores the content stored in the content registration unit 106 when an instruction to reproduce one or a plurality of contents registered in the content registration unit 106 is given from the user interface unit 100. According to the information, a content reproduction unit 110 for displaying the content on a display device (not shown) via a user interface unit 100, and a specific content link from the content registration unit 106. When an instruction for defining is given, a link definition unit 108 for defining link information such as a link start time and a link end time of the content and registering it in the content storage unit 112, and a content reproduction unit 1 In response to receiving the command to play the content from the user interface unit 100 from the user interface unit 100, a link time at the time of playback is generated according to a method described later, And a link generation unit 114 for registration in the content registration unit 106. · ■

 The content reproduction device 90 also has a function of recording a user operation and reproducing the operation in accordance with an instruction. Recording and reproduction are instructed to the content reproduction device 90 by a recording / reproduction signal 116. The recording / playback signal 1 16 is set by a switch not shown in the present embodiment.

Therefore, the content reproduction device 90 further stores each event from the user interface unit 100 and the link time at the time of occurrence as a pair when the recording 'reproduction signal 1 16 is a value indicating recording. When the recording / playback signal 1 16 is a value indicating playback, an operation storage / playback unit 112 is provided for giving these events to the same destination according to the link time when the events occurred. . To perform this switching, a selector 118 is provided for input from the user interface 100 to the content selection unit 102, the content registration unit 106, and the content reproduction unit 110. . The selector 118 supplies an event from the user interface section 100 to each section when the recording / playback signal 118 is on the recording side, and an operation memory and an event from the playback section 112 to each section when the playback side is on the playback side. It is configured to give. The content reproduction device 90 is substantially composed of a computer as described later, and includes programs described for each of the above-described units, data of the content registered in the content registration unit 106, and The program is loaded into the memory and processed by the arithmetic unit. The user interface unit 100 generates input / output data between the input device and the display device, and controls the input device and the display device. The user interface unit 100 generates a signal in response to a trigger received from the input / output device and sends the signal to each functional unit, and each functional unit performs data processing according to the signal.

 FIG. 4 shows the structure of a content record stored in the content storage unit 112. As shown in FIG. The record 140 of each content includes a playback time 140 that defines the length of the content, a playback time 144 that indicates the time at which the content is being played, and synchronized playback with other content. Link start time 1 4 4 that defines the start time of the period for setting the switch, link end time 1 4 6 that also defines the end time of the period, and link time that indicates the link time of the content that changes with playback 1 48, a simultaneous display flag 150 indicating whether or not to play simultaneously with other content, and a pointer to a record of the next content of this content in a series of content set for synchronous playback 15 2, a playback time calculation unit 15 that stores a program for calculating the content playback time, and a link time calculation unit 15 6 that stores a program for calculating the link time. Ceiling contents of the data of (this is referred to as the "near point Ddeta".) And a 1 5 8. The playback time and link start time are usually already given.

The content reproduction device 90 is substantially composed of a computer as described above. Fig. 5 shows the hardware configuration in block diagram form. Referring to FIG. 5, the hardware of the content reproducing device 90 includes an input device 172, a display device 174, a content storage device 170 composed of a hard disk, a content storage device 170, It includes a control device 176 connected to the input devices 172 and 174 for controlling them according to a predetermined program described later. Content storage device 170, input device 172, display device 174 and control device 176 can exchange data 'with each other The control unit 176 has an arithmetic unit 192 including a CPU (central processing unit) having a function of performing arithmetic processing, a memory unit 194 mainly composed of semiconductor memory, and a non-volatile memory composed of a hard disk or the like. Secondary storage device 196, a bus 198 interconnecting them, an input device 1Ί2, a display device 174, and a bus 198. An input / output unit 190 for controlling the display device 174 to input and output data between the display device 174 and the control device 176 is included.

 Generally, the user uses the input device 17 2 to select the content by the content reproduction device 90, the content registration function, and the user interface function (link function, return function, time designation function, simultaneous display Functions and character input functions) can be operated interactively.

 FIG. 6 shows an external appearance of a remote control device (hereinafter simply referred to as “remote control input device”) 210 as the input device 17 2 in the device of the present embodiment. Referring to FIG. 6, remote control input device 210 includes a display device 232 made of liquid crystal. In the display area of the display device 232, information that assists the operation or all or a part of the content to be reproduced is displayed.

 The remote control input device 210 further includes a selection button 2 12 operated by the user when selecting content, and a registration button 2 1 operated by the user when registering the content in the content registration unit 106. 4, a link button 2 16 used by the user when instructing switching of the reproduction by a content link in the present embodiment, such as switching of the reproduction content, and a jog switch operated when the user specifies the reproduction time and the like. 218, the return button 220 operated by the user when returning to the display of the immediately preceding content, and the user when instructing whether or not to reproduce one content at the same time as another content when registering the content. The simultaneous display button 2 2 2 operated by the user, the home button 2 2 4 used by the user when displaying the predetermined home screen, and the input of alphabets and numbers, etc. It includes a character button 228 and a power button 230 used by the user when performing the operation.

Referring again to FIG. 5, the control device 176 includes a content selection unit 102, a content registration unit 106, a link definition unit 108, and a user interface unit 100 shown in FIG. , Content playback unit 110, operation storage and playback unit 112, and link generation The functions corresponding to the units 114 are realized by executing a predetermined computer program.

 The display device 174 has a function of displaying data such as characters, images, moving images, graphics, and audio provided from the control device 176. In the present specification, “display” and “reproduction” include not only visual information such as images, videos, and characters but also output of auditory information such as sound or olfactory information such as smell. Is a concept

 The user can use the input device 172 to input any content from the content database 104, which is a set of contents existing at an arbitrary place such as the Internet or an external storage device, to the secondary storage device 1 shown in FIG. 9 and can be displayed on the display device 1 74. This is realized by the content selection unit 102 and the content reproduction unit 110 shown in FIG. The user determines whether to register the displayed content in the content registration unit 106. To register, the user uses the function of the input device 172 to register the displayed content in the content registration unit 106.

 If it is necessary to add link information to the content to be registered, the user manually defines the link start time and the link end time and registers them in the record in the content registration unit 106. When the user completes the registration of the content, selects the content to be reproduced from the registered content, and executes the reproduction, one or a plurality of the registered content is displayed in accordance with the content information and the four dog mode of the device. It is reproduced by the playback unit 110 and displayed on the display device 174.

The content is supplied as a digital signal and an analog signal from a storage device connected to a network such as a broadcast medium or the Internet to the content reproduction device 90 as a digital signal or an analog signal by wire or wirelessly. 102 is input as digital data or analog data. The content selection unit 102 has a function of accepting a plurality of inputs at the same time, just like a television receiver having a function of receiving signals from a plurality of broadcast stations. For example, a case where a plurality of input terminals are present in the content selection unit 102 and different contents are supplied to each terminal may be assumed. The user presses the button corresponding to the content selection function. Then, an instruction to select the content is sent to the content selection unit 102 via the user interface unit 100. When the content selection unit 102 receives the content switching data, the content input terminal is switched, and the content supplied to the switched input terminal is selected. This is exactly the same as switching channels in television broadcasting.

 In addition, using a character button 228 shown in FIG. 6, a broadcast channel or a content URL (Unif rm Resource Locator) is input, and the content specified by the URL is input to the content selection unit 102. Can also be selected.

 The selected content is played back via the function of the content playback unit 110 of the control device 176, and is displayed on the display device 174 in the form of characters, images, videos, or graphics, or is it played back by sound? , Or both.

 Hereinafter, a control structure of a program for realizing the content reproduction device 90 of this embodiment will be described.

FIG. 7 shows an overall flowchart of a program ¹ for realizing this apparatus. Referring to FIG. 7, the program includes a step 240 for selecting and registering a content, a step 242 for setting a content to be reproduced first (reproduced content) among a plurality of contents, and a link time to start the reproduction. In step 244, a link time is generated at the start of playback, and it is determined whether or not the link time generated in step 244 is an error within the link time set in the content. Return to step 242, otherwise include step S246 to advance control to the next step S246.

 At step 246, the content selected at steps 240 and 242 is played. If any event occurs during the execution of the regeneration, the process of step 248 is interrupted, and the control proceeds to step 250.

At step 250, it is determined whether or not the detected event is a link event. The link event occurs when the user operates the link button 216. If it is a link event, control proceeds to step 252; otherwise, control proceeds to step 254. In step 2 52, the next content after the content being played in the series of content selected in step 240 is started to be played, and control is returned to step 2 44.

 On the other hand, in step 254, it is determined whether or not the detected event is a return event. The return event occurs when the user operates the return button 220. If the event is a return event, control proceeds to step 258; otherwise, control returns to step S224.

 In step 258, the reproduction of the content before the event that has been reproduced in the series of contents selected in step 240 is started, and the control returns to step 244.

 The content selection and registration process performed in step 240 of FIG. 7 will be described with reference to FIG. Referring to FIG. 8, this processing includes a step of receiving a content selection by a user and a step of determining whether or not registration of the received content has been designated by a user. And The method of selecting content is as described above. The instruction to register the content is generated by operating the registration button 214 shown in FIG.

 If registration is instructed, control proceeds to step 274. Otherwise, the process ends. In step 274, a process of registering all of the selected content, the — unit, or information for identifying the content in the content registration unit 106 is performed. Subsequently, in step 276, processing for updating the registered content list is executed. The registered content list means that data in the format shown in FIG. 4 is recorded in the content registration section 106 in a list format by the pointer 1502. In the data of the last content in the list, NIL is stored in pointer 1532.

 Subsequently, in step 278, link registration for setting the link time and the reproduction time is performed on the content registered in step 274. The details are shown in Fig. 9, which will be described later.

After step 278, step 280 further receives information as to whether the user is about to enter the next content. Enter the following content If so, control returns to step 270. Otherwise, the process ends. With reference to FIG. 9, a description will be given of a control flow of a program for realizing the link registration process performed in step 278 of FIG. First, in step 300, the link start time of the content to be processed is set. The link start time refers to the beginning of a period for setting to perform synchronized playback with another content. Next, in step 302, the reproduction time of this content is set. The playback time is the time required to play the entire content. This setting is made using the character button 228.

 Further, in step 304, processing for setting a simultaneous display flag is performed. This setting is toggled by pressing the simultaneous display button 222 of FIG. The simultaneous display flag is a flag indicating whether or not to display this content simultaneously when switching to another content. If this flag is on, the display of this content will continue when switching to another content. That is, multiple contents are displayed simultaneously. If this flag is off, the display of this content will be interrupted if there is a switch.

 Next, in step 306, a process of loading a program for calculating a playback time when the content is played back into a memory is performed. This program is a program stored in the reproduction time calculation unit 154 of FIG. For normal playback, use the default program. An example of this program will be described later.

 At step 308, a process of similarly loading a program for calculating a link time at the time of reproducing the content into the memory is performed. This memory is

This is a program stored in the link time calculation unit 156 of FIG. The link time is calculated by a predetermined calculation method in relation to a link start time, a reproduction time, and the like between a plurality of contents to be reproduced. Normally, when the link start time and the reproduction time of a plurality of contents are the same, the program for calculating the link time uses the default program. However, depending on the content, it may be necessary to use something other than the default. An example of this program will be described later.

In step 310, a link end time is set. This process includes steps Use the link time calculation program loaded in step 308.

 FIG. 10 shows a flowchart of the default program among the reproduction time calculation programs loaded in the memory in step 310 of FIG. Referring to FIG. 10, this default program operates with the link time as an argument, and calculates the reproduction time by subtracting the link start time from the link time as shown in step 430. The link start time is the link start time 144 in FIG. The program ends with the calculated playback time as a return value.

 FIG. 11 shows a flowchart of the default program among the link time calculation programs loaded into the memory in step 308 of FIG. Referring to FIG. 11, the default program is a program that is called with a playback time as an argument and ends with a link time as a return value. In step 44, the link time is calculated by subtracting the reproduction time from the link start time. The link start time is the link start time 144 in FIG. After step 44, the program ends.

 The link end time of the content calculated in step 310 of FIG. 9 is set by using a program for calculating the link time.

 When the processing up to step 310 ends, the registration processing for this content ends.

In Step 2 4 2 of FIG. 7, by specifying the content to be reproduced to the user ^force? First to start playing. At this time, the user specifies which content is to be reproduced from where. If the user has not specified the link start time, the link start time and the content to start reproduction are specified by the processing shown in FIG.

 Referring to FIG. 12, in this process, the link time is first set to 0 (step 330). Subsequently, the processing of steps 334 to 338 is repeated for all registered contents. In the following description, “start link time” refers to the link time assigned to the head of each content.

That is, in step 334, it is determined whether or not the link time is later than the start link time of the content to be processed. If the result of the determination is YES, the control proceeds to step 336. Otherwise, control transfers to the process for the next content. In step 336, the start link time of the content to be processed is substituted for the link time. Subsequently, in step 338, the playback content is set as the content to be currently processed.

 When the processing of steps 3 3 4 to 3 38 has been completed for all registered contents, the content with the earliest start link time has been selected as the playback content, and the start link time is set as the link time. That is to say. The process is ended with the playback content and the link time determined in step 340 as arguments.

 Subsequently, a link generation process is executed in step 244 of FIG. This processing corresponds to the function of the link generation unit 114 in FIG. Fig. 13 shows the details of step 244 in Fig. 7.

 Referring to FIG. 13, first, in step 360, it is determined whether or not a link time to start reproduction is designated. If a link time has been specified, control proceeds to step 362, otherwise control proceeds to step 368.

 In step 362, the link start time of the content designated as the first to be played is set as the link time. Thereafter, in step 364, the reproduction time is set to 0, and the reproduction time is set as a return value, and the processing is terminated.

 In step 368, it is determined whether the specified link time is after the link start time and before the link end time. If the result of this determination is YES, control proceeds to step 370; otherwise, the process ends with a value indicating an error as the return value. In step 370, the content designated to be played first A link is generated based on this data. That is, the reproduction time is calculated by the reproduction time calculation program using the specified link time. Thereafter, in step 372, the reproduction time is set as a return value, and the processing is terminated.

Referring again to FIG. 7, it has been described above that if the processing in step 244 is an error, control returns to step 242. If there is no error, the content is played back in step 246. FIG. 14 shows the contents of the process of step 2 46. Referring to FIG. 14, first in step 390, the content data corresponding to the reproduction time is set. Display data. Further, for all of the other registered contents, the processing from step 394 to step 398 is repeatedly executed in step 392.

 First, in step 394, it is determined whether or not the simultaneous display flag of the next content data among the registered contents is on. If the simultaneous display flag is ON, the control proceeds to step 396, otherwise the process proceeds to the next content. In step 396, a link is generated using the link time as an argument for the content for which the simultaneous display flag is determined to be on in step 394. Subsequently, in step 398, a process of displaying this content simultaneously with the first content from the reproduction time is performed. Thereafter, the processing of step 394 is executed for the next content. By the processing of steps 396 and 3998, the display of the link time that is the same as the link time of the currently reproduced content is performed for other contents (limited to those for which the simultaneous display flag is ON).

 When the processing of steps 394 to 398 is completed for all the registered contents, the control proceeds to step 400. In step 400, processing for updating the reproduction time is performed. For this process, a playback time calculation program for the content being played is used. Variations in the playback time vary depending on the content and the display processing capacity of the device. In this example, it is assumed that 30 frames per second video can be displayed within that time. Then, the updated playback time is obtained by adding 1/30 seconds to the current playback time, and that time is set as the playback time. Next, when the process of step 360 is executed, the content data is displayed using the reproduction time. Further, in step 402, the link time is calculated by the link time calculation program based on the updated playback time. After step 402, whether or not any event has occurred in step 404 Is determined. If there is any event, the control moves to step 406, the reproduction is temporarily suspended, and the processing is terminated with the link time at this time as a return value. If there is no event, control returns to step 390. Hereinafter, the content reproduction display is repeated until an event such as a link is input.

If any event is detected in step 404 and the event is a link event, after ending this process, steps 250 to 250 in FIG. In the process 2, the reproduction of the next content during the registration event is started. At this time, the content following the content that has been played back is extracted from the pointer 152 of the record (see FIG. 4) relating to the content that has been played back. The above is the hardware configuration, functional block configuration, and program configuration of the content reproduction device 90 according to the present embodiment.

 The programs stored in the reproduction time calculation unit 154 and the link time calculation unit 156 shown in FIG. 4, respectively, are described in FIG. 10 and FIG. 11, respectively. In addition to the default program, various programs can be considered according to the content reproduction. For example, if a piece of content includes a part that behaves differently than normal time (ie, if such link times are defined for this content), The relationship between the playback time and the link time cannot be defined by the default programs shown in FIGS. 10 and 11, respectively. In this case, a reproduction time and link time calculation program corresponding to the content reproduction speed is created and stored in the reproduction time calculation section 154 and the link time calculation section 156 in FIG. 4, respectively. There is a need. An actual example will be described later. Hereinafter, the operation of the above-described device will be described with reference to an example. It is assumed that the recording / reproducing signal 1 16 is a value indicating recording, except for the operation example 6.

 -Operation example 1-The first operation example is an example in which a baseball game is watched while switching between two video contents shot from two different angles. Let's call them the first content and the second content. The first content is a video of the notter, and the second content is a video of the entire ground taken from above the stadium. By watching the second content, you can follow the movement of the fielder on the ground.

In this case, for example, the user mainly watches the movement of the batter by watching the first content, and when the notter hits, the displayed content is changed from the first content to the second content. You can switch to content. With this viewing method, it is possible to check the batter's movement and the movement of the fielder when he hits the ball, while usually closely watching the movement of the batter. Referring to FIG. 7, when the user intends to perform such a viewing method, the first content and the second content are selected and registered (step 240 in FIG. 7). Regarding the processing at this time, a specific operation of the apparatus will be described with reference to FIG.

 FIG. 17 schematically shows the reproduction of the first and second contents and the contents thereof. First

Referring to FIG. 7, the first content is a video of a grasshopper, and the second content is a video from above the stadium. The playback time of the first content is 300.0 000 seconds, and was produced at 20:20:00 on September 14, 1998. The same shall apply to the second content. In the following description, as shown in FIG. 17, playback is assumed to start from the first content. Then, as shown by the arrow 5 10, the user operates the link button 2 16 to move to the reproduction of the second content at 60 seconds from the start of the reproduction, and further, at 120 seconds after the start of the reproduction. It is assumed that the link button 2 16 is operated again to return to the display of the first content, as indicated by the arrows 5 1 2 by dots.

 Referring to FIG. 8, first, the user selects the first content by a selection operation using remote control input device 210 shown in FIG. 6 (step 270 in FIG. 8). By pressing the registration button 2 14 of the remote controller input device 210 (step 2722 in FIG. 8), the content is registered in the content registration section 106 shown in FIG. 3 (step in FIG. 8). 2 7 4). Here, for the first content, a record 130 of the content shown in FIG. 4 is created in the content registration unit 106. This record is designated as record 13 OA.

 Next, the registered content list is updated (step 276 in FIG. 8). At this point, since the registered content is only the first content, the pointer 152 to the content following the first content is NIL.

 Next, perform link registration to set the link of the first content コ ン テ ン ツ the playback time

(Step 278 in FIG. 8). Referring to Fig. 9, set the link start time of the first content to 1/98/9/14 20: 20: 00: 00 (Step 3 in Fig. 9) ). Next, the playback time of the first content is set to 30.0.000 seconds (step 302 in FIG. 9). In this example, if there is a link operation, the display is always the first Set the simultaneous display flag to off so that the content is switched between the content and the second content (step 304 in FIG. 9).

 In this example, the reproduction time and the link start time of the first content are equal to the reproduction time and the link start time of the second content, respectively. Therefore, the default program shown in FIG. 10 is used as the program for calculating the playback time of the first content (step 306 in FIG. 9). For the same reason, the program that calculates the link time of the first content uses the default program power shown in Fig. 11 (step 3108 in Fig. 9).

 The link end time of the first content is set using the above program for calculating the link time (step 310 in FIG. 9). In this case, the link end time is set to 20:25:00, September 14, 1998. This completes the registration of the first content.

 Since there is more content to be registered (Y E S at step 280 in FIG. 8), the second content is selected and registered. That is, the second content is selected in the same manner as the first content (Step 270 in FIG. 8). When the user presses the registration button 2 14 of the remote controller input device 210 (YES in step 272 in FIG. 8), the second content is registered in the content registration unit 106 (see FIG. 8). Steps 2 7 4). The content registration unit 106 creates a record 130 (FIG. 4) of the second content. This is record 130B.

 Next, the registered content list is updated (Step 276 in FIG. 8). At this point, the registered contents are the first content and the second content. Therefore, the first content data pointer 15 2 (FIG. 4) is set to the second content, and the second content data pointer 15 2 is set to the first content. .

Next, link registration of the second content is performed (step 278 in FIG. 8). Referring to FIG. 9, it is assumed here that the link start time of the second content is set to September 14, 1998, 20: 20: 20: 00 (see FIG. 9). Step 300). Next, the reproduction time of the second content is set to 30.0.000 seconds (step 302 in FIG. 9). The simultaneous display flag is set to off as in the case of the first content. (Step 304 in FIG. 9). The programs that calculate the playback time and link time use the default programs (Fig. 10 and Fig. 11), respectively, as in the case of the first content (steps 306 and 308 in Fig. 9).

 In step 310 of FIG. 9, the link end time of the second content is set using a program for calculating the link time loaded in step 308 (step 310 of FIG. 9). In this case, the link end time is set to 20:25:00, September 14, 1998. This completes the registration of the second content. FIG. 18 shows the structure and value of each record 130A and 130B at the time when the registration of the first content and the second content is completed. Each of the records 130A and 130B has the same structure as the content record 130 shown in FIG. In Fig. 18, each item shall use the same reference numerals as those shown in Fig. 4, with an `` A '' at the end of each reference sign for the first content, and for the second content. "B" shall be appended to each.

 As shown in Fig. 18, at this time, the playback time, link start time, and link end time of the record 13 OA of the first content are set, and the simultaneous display negative flag 15 OA is off. Is set to The same applies to the record 130B of the second content.

Returning to FIG. 8 again, in step 280, since there is no content to be added after this, the processing of FIG. 8 ends, and the control returns to step 242 of FIG. With reference to FIG. 7, user force either by reproducing any contents from where in Step 2 4 ^2? Specify. In this example, the user sets the playback content to the first content, and specifies the playback start time from the beginning of the first content. As a result, the link time is set to the first time of the first content, that is, 20:20:00, September 14, 1998, and the reproduction of the first content is started. Here, the user may not specify the link start time. In this case, the link start time is set by the processing shown in FIG.

Subsequently, the link start time of the first content is set to the link time (step 244 in FIG. 7). Referring to Fig. 13, here the link time is 1998 Since September 14th, 20: 00: 20: 00 is specified, control proceeds from step 360 to step 368. The link time is the link start time (September 19, 1998, 20:20:00) and the link end time (September 19, 1998, 02:00, 25:00) ), The control proceeds from step 368 to step 370. In step 372, the playback time is calculated from the link time by the default playback time calculation program. The playback time in this case is 0 seconds. The process ends with the playback time calculated in this way as a return value.

 Referring again to FIG. 7, since no error was returned in the link generation processing of step 244, the control proceeds to step 248 of step 246. In step 248, content playback of the first content is performed.

 Referring to FIG. 14, the content data of the first content at a playback time of 0 second is loaded from the content registration unit 106 to the memory unit 194, and processed by the input / output unit 190. Then, the data is displayed on the display device 174 (step 390 in FIG. 14). The content data may be recorded in advance in the memory unit as a cache.

 In the repetition processing in step 392, it is determined whether or not the simultaneous display flag is turned on for the second content (step 394 in FIG. 14). Since the simultaneous display flag of the second content is off, the display of the second content is not performed. Since there is no registered content other than the first content and the second content, the control proceeds to step 400.

 In step 400, the reproduction time of the first content is updated. In this example, the video is 30 frames per second, and the display of all the first contents is completed within that time. In step 400, the reproduction time is updated with a value obtained by adding 130 seconds to the current reproduction time of 0 seconds, that is, 1 to 30.

Next, in step 402, the link time is calculated by the link calculation program of the first content using the playback time (1Z30 seconds). In this example, the link time is set at 20: 20: 1/1/30 seconds, September 14, 1998. Then, the processing from step 390 to step 402 is repeated until an event is input. In this example, as shown in Fig. 17, a link is triggered one minute after the content is displayed and displayed. Therefore, the first content is displayed on the display device for one minute.

 The data structure and value of the content before the link trigger is applied after one minute are as shown in Fig. 19. As shown in Fig. 19, the record of the first content, 13 OA, has a playback time of 60.0 seconds, and a link time of September 1, 1998, 20:20, 21:00. It is 0.0000 seconds. The record 130B of the second content is the same as the original.

 When the link trigger is activated, control proceeds to step 406 in the judgment of step 404, and control proceeds to step 250 of FIG. From step 246, the link time at that time (September 1, 1998, 20: 21: 01: 00) is returned. Subsequently, in step 250, this event is determined to be a link event, and control proceeds to step 250.

 In step 252, a pointer to the next content after the first content, that is, a pointer to the second content is extracted from the pointer 15A of the first content. Subsequently, in step 244, a link is generated based on the data of the second content. The current link time is 20: 21: 01: 00 on September 14, 1998. Therefore, in this process, control proceeds from step 360 to step 3688 in FIG. The link time (September 19, 1998, 20:21:00) is linked to the link start time (September 19, 1998, 00:20:00). It is within the end time (September 19, 1998, 20:25:00). Therefore, the control proceeds to step 370, and the reproduction time is calculated by the reproduction time calculation program based on the link time. The playback time in this case is 60 seconds. Using this value as the playback time as a return value, control returns to step 246 of FIG. The data structure and values of the content at this time are as shown in FIG.

 Referring to FIG. 20, here, at the time of reproducing the record 130 B of the second content, the playback time ij 143 B and the link time 148 B are updated.

Referring to FIG. 7, in step 246, since no error was returned in the link generation processing, control proceeds to step 248. In steps 2 4 8 the second container Performs content playback.

 Referring to FIG. 14, the content data of the second content at a playback time of 60 seconds is loaded from the content registration section 106 to the memory section 194, processed by the input / output section 190, and displayed. It is displayed on the device 174 (step 390). Subsequently, it is determined whether or not the simultaneous display flag of the first content is on (step 394). Since the simultaneous display flag of the first content is off, the first content is not displayed. Since there is no registered content other than the first content and the second content, the control proceeds from step 394 to step 400.

 In step 246, the reproduction time of the second content is updated. The video of the second content is also assumed to be 30 frames per second. Then, the playback time is updated to the current playback time of 60 seconds plus 1/30 seconds, and that time is set as the playback time to the playback time 14 2 B shown in Fig. 20 etc. You. Then, using the playback time (60 + 1/30 seconds), the link time is calculated by the link calculation program for the second content (step 402 in FIG. 14). The time is set to 9/98/98/14/20: 21/1/30. This display of the second content is repeated until an event such as a link is input.

 In this example, it is assumed that a link is triggered two minutes after the reproduction and display of the second content is started as shown in FIG. Therefore, the second content is displayed for two minutes before that. The data structure and values of the content before the trigger is applied are as shown in Figure 21.

 When a link trigger is applied, an event occurs in content reproduction, and control branches from step 404 in FIG. 14 to step 406, and further proceeds to step 250 in FIG. In step 406, the link time at that time, 20:23:00, September 14, 1998, is returned.

 In step 250 of FIG. 7, since the event is a link, the control proceeds to step 2.

Go to 5 2. In step 25, the content next to the second content is extracted from the pointer of the content next to the second content. The content following the second content is the first content.

Control again proceeds to step 244 of FIG. 7, and is performed based on the data of the first content. Link generation. At this time, the link time is 20:23:00, September 14, 1998. Accordingly, the control at this time proceeds from step 360 shown in FIG. 13 to step 365. The link time (September 19, 1998 20:23:00) is linked to the link start time (September 19, 1998 20:20:00). It is within the end time (September 19, 1998, 20:25:00). Accordingly, control proceeds from step 368 to step 370.

 In step 370, the reproduction time is calculated by the reproduction time calculation program using the link time. The playback time in this case is 180 seconds. With the playback time as a return value, the processing shown in FIG. 13 is terminated, and control proceeds to step 2 46 in FIG. The data structure and values of the content at this time are as shown in FIG.

The reproduction and display of the first content is performed in the same manner as the above processing. Since the playback time of the first content is 300 seconds (5 minutes), in this example, as shown in FIG. 17, the first content is played back and displayed for another 2 minutes, and the process ends. When the regeneration ends, a termination event occurs. Control force from the first 4 Figure in step 4 0 ^6? Proceed, control returns to step 2 5 0 of FIG. 7. At this time, the data structure and value of the content are as shown in FIG.

 The end event is neither a link event nor a return event. Therefore, in FIG. 7, the control returns to step 242 via steps 250 and 252. Thus, the reproduction of the first content and the second content in this example ends. In step 242, the next playback content and its start time are set. .

 As a matter of course, the user can start a new process from the start time of FIG. 7 at any time in the process.

As shown in this example, the user can switch and display multiple contents at any time. Moreover, in that case, the switching is performed so that the progress of the two different contents is synchronized. After watching a scene with the first content, you can see the continuation of the scene in the second content. When viewing multiple video content shot from different angles with multiple cameras in this way, the user is watching the video and watching the video of the camera angle suitable for the scene in real time. In the same way, the user can watch the screen while freely switching the screen. Operation example 2—

 As a second operation example, a case where a soccer game is to be viewed in two languages will be described. The content to be used is one video content and two audio contents related to the same soccer game. The video is from a soccer match. One of the audio contents is in Spanish and the other is in French. The content was created by independent authors. For example, the video was recorded from what was broadcast in Japanese, and the audio content was downloaded from the Internet and used.

 In this example, the user can watch a commentary in Spanish or French at the same time as watching the video of soccer. As described below, the language is switched using a link operation and a return operation. The description can be switched from Spanish to French by link operation and from French to Spanish by return operation. Make sure the video is always displayed. Hereinafter, these contents will be referred to as third, fourth, and fifth contents, respectively, in order to prevent confusion with the operation example 1 above.

 The first content is the content of a soccer match, which is a 2-hour and 10-minute video medium produced at 12:50 on June 10, 2002. The link start time is set to the date and time when the link was created, 12:00:06, June 10, 2002. In this example, it is assumed that the actual soccer game started at 13:00 on June 10, 2002. The fourth content is a Spanish-language commentary recorded based on the video content, which is a two-hour content that has been commented on at the start of a soccer game. The link start time is set to the soccer match start time, 13:00, June 10, 2002. The fifth content, like the fourth content, is a French commentary recorded based on the video content, and is a two-hour content that began commentary at the start of a soccer game. The link start time is set to the start time of the soccer match, 13:00, June 10, 2002. Fig. 24 shows an example of playback of these contents by the user.

When performing the above-described display, the user first selects and registers these contents in the content registration unit according to the processing flow of FIG. 8 (see FIG. 7). (Step 240). Figures 25A to 25C show the data structure of these three contents at the end of registration. The details are not described here. However, it should be noted that the simultaneous display flag is turned on because the first content is always displayed. The flag for simultaneous display of the other two contents is off. In the following description, the reference numerals for each record and item shall be given C, D, and E, respectively (for example, “Record 130 C”).

 Next, the user sets the playback content and the link time (step 242 in FIG. 7) and starts viewing the content. In this example, since the user wants to start playback from the oldest registered content, it is assumed that the playback content and the link time are not specified. In this case, the processing shown in FIG. 12 is executed in step 242, and the playback content is set to the third content and the link start time is set to the link time of the third content.

 As shown in Fig. 24, there is no audio content until 13:00 on June 10, 2002, so the video is displayed silently for 10 minutes until then. After 10 minutes, when the user presses the link button, the video of the soccer and the commentary in Spanish can be viewed simultaneously. In this case, the playback content is switched to the fourth content. Since the simultaneous display flag is on for the third content, the content playback processing steps P394 to P398 in Fig. By the loop processing, the third content is displayed on the display device in synchronization with the fourth content. Further, in this example, it is assumed that the user switches to the explanation of the French language (the fifth content) 20 minutes after the start of the reproduction of the third content. In this case, as shown in Fig. 24, the user presses the link button 2 16 at that point to view the commentary in French with the video. Figures 26A to 26C and 27A to 27C show the state of the content before and after this link, respectively.

 FIGS. 28A to 28C show the state of the content 30 minutes after the start of the reproduction of the third content. The user can return to the Spanish explanation by pressing the return button.

One operation example 3— The device according to the present embodiment is not only capable of synchronously displaying only ordinary contents. C It is also possible to synchronize contents with special time lapses with other ordinary contents and display them. For example, consider video content that includes a soccer goal scene and audio content that describes the scene and is prepared independently of the video content. The audio commentary was given while watching the video of soccer, but it was assumed that the commentary was made while playing back part of the video in slow motion.

 Figure 29 shows the data of each content. Hereinafter, in order to avoid confusion with other content, video content including a goal scene of soccer is referred to as sixth content, and audio content is referred to as seventh content. The seventh content is an audio-only description. These records are similar to those shown in FIG. In the following, these records and items shall be the ones with F and G added to the end of the reference numerals shown in FIG.

 As shown in Fig. 29, for the scene from 60 seconds to 180 seconds after the start of the playback of the sixth content, the seventh content is synchronized with the slow motion video at that time. Has commentary. In other words, the seventh content explains the scene where the video of the sixth content is reproduced in normal speed at 120 seconds, twice as long as 240 seconds.

 Even in such a case, the apparatus of the present embodiment can simultaneously display both the sixth content and the seventh content while synchronizing them. In other words, video and audio are always played back synchronized with the link time.

FIG. 30 shows data values at the time of content registration. Regarding the record 13F of the sixth content, the reproduction time calculation program stored in the reproduction time calculation unit 15F and the link time calculation program stored in the link time calculation unit 15F are as follows. These are the default programs shown in FIGS. 10 and 11, respectively. On the other hand, the reproduction time calculation program stored in the reproduction time calculation unit 1544G of the record 13G related to the seventh content and the link time calculation program stored in the link time calculation unit 1556G Is a program whose flowcharts are shown in Fig. 15 and Fig. 16, respectively. Referring to FIG. 15, the reproduction time calculation program in this case is a program that calls the link time as an argument and returns the reproduction time. First, at step 460, it is determined whether or not this link time is before 15:21:00 on August 10, 2002. If the result of the determination is YES, in step 462, the link time-link start time is set as the reproduction time, and the process ends. If the result of the determination is NO, the control proceeds to step 464.

 In step 464, it is determined whether or not the link time is earlier than 15:23:00 on August 10, 2002. If the result of the determination is YES, in step 466, the playback time is set to "1 minute + 2 * (link time-15:21:00, August 10, 2002)", and the process ends. If the judgment result is NO, in step 468, the reproduction time is set to "5 minutes + (link time-15:23:00 on August 10, 2002)" and the process is terminated.

 Referring to FIG. 16, the link time calculation program is a program that is called with the playback time as an argument and returns the link time. First, it is determined in step 490 whether or not the reproduction time is before one minute. If the determination is YES, control proceeds to step 492; otherwise, control proceeds to step 494.

 In step 492, the link time is calculated in accordance with the formula "link time = link start time-reproduction time", and the process ends.

 At step 494, it is determined whether or not the reproduction time is before 5 minutes. If the judgment result is YES, the link time is calculated in step 496 according to a calculation formula of “link time = 15:21:00, August 10, 2002 + (reproduction time-1 minute) / 2”, and the processing ends. I do. If the decision result in the step 494 is NO, in the step 498 the link time is calculated according to the formula "link time = 15:23:00, August 10, 2002 + (reproduction time-5 minutes)" And terminate the processing.

This is so that if the playback time of the sixth content is equal to the link time, the slow-motion description section of the seventh content is displayed in synchronization with the corresponding video. Here, the link time is used for synchronization between the two. As explained below, in this example, the description of the seventh content is 2 minutes (the playback time of the sixth content) and the video is 4 minutes (the playback time of the seventh content). I have.

 In this example, suppose that the user first wants to hear the commentary on the seventh content. The user selects the seventh content as the playback content. As shown in Fig. 29, the sixth content and the seventh content start at the same time because the link start time is the same, and are played simultaneously while the sixth content is synchronized with the playback speed of the seventh content Is done. At this time, video and audio are reproduced at normal speed until 60 seconds later. However, after 60 seconds, the video is played in slow motion and the audio is played at normal speed. This is because the main playback content here is the seventh content, and the playback speed of the sixth content is adjusted such that its link time is equal to the link time of the seventh content. .

 The data values after 60 seconds are shown in FIG. Fig. 32 shows the data values 120 seconds after the explanation of the slow motion started (180 seconds after the total playback). The link time at this time is 15:22:00, August 10, 2002. The slow motion description lasts 4 minutes, which corresponds to a 2 minute video of the sixth content (see Figure 29). When the explanation of the slow motion is over, the seventh content is explained again in synchronization with the normal speed of the video. Figure 33 shows the data values at the end of the slow motion.

 As described above, according to the present invention, the synchronization of a plurality of contents is expressed as the relationship between the link time and the reproduction time using a program as shown in FIGS. 15 and 16. It is also possible to control while continuously changing the link from one content to the other.

 Operation example 41

As described above, the content includes still image data such as a photograph. For example, it is possible to simultaneously display a photograph and a video taken by yourself at the link time and at the same time. At the same time, you can watch the pictures you took during a baseball game and the video obtained by recording the baseball broadcast at the appropriate time. In this case, turn on the simultaneous display flag of the photo content and play the video. Then, the pictures will be displayed one after another in synchronization with the link time as the video is played. In this case, the display time of each photo is set as the playback time of each photo. In the case of a photo, the shooting date and time can be used as the link start time. In a digital camera or the like often shooting date is automatically appended to the de one data, _c them available, however, in some cases such data is not added. Therefore, in the device of the present embodiment, the user can manually input the reproduction time using the character button 228 of the remote control input device 210 shown in FIG. 6 (step 3 in FIG. 9). 0 2)

 One operation example 5—

 It is also possible with this device to play back the playback time in the reverse direction using the jog dial 218 of the remote control input device 210. If the playback time is decreased instead of increased in the playback time update (step 400 in FIG. 14) of the content playback processing (FIG. 14), the content is played in the reverse direction. As a result, the link time is also calculated, and the registered contents are synchronized according to the link time.

 —Operation example 6—

 Normally, the user uses this device to switch and play multiple contents in synchronization by link operation or return operation. In this device, the history of the link operation and the return operation is stored by using the operation storage / reproduction unit 112 shown in FIG. 3, and the operation is reproduced later to be the same as the first reproduction operation. The operation can be repeated.

 That is, by setting the recording / reproducing signal 116 as the recording side, an event such as a link operation or a return operation is given to each unit in FIG. 3 via the user interface unit 100. When the recording / reproducing signal is the value on the recording side, the operation memory'reproducing unit 112 sequentially stores pairs of these events and the link time at which the event occurred.

When the recording / playback signal 1 16 is a value indicating playback, the selector 118 gives an event from the operation memory / playback unit 112 to a predetermined destination. Thus, the pair of the event and the link time stored in the operation memory / reproducing unit 112 can be used as a so-called macro program for a series of reproducing. Also, using this history, it is possible to play the content in the opposite direction from the first recording. It is. At this time, the reproduction is performed in the reverse direction including the link operation and the return operation. For example, it is assumed that two contents (these are called an eighth content and a ninth content) are registered. Further, suppose that during reproduction of the eighth content, the user presses the link button 10 minutes after the reproduction starts, and the ninth content is reproduced for 5 minutes according to the link time. Using the history, the user can play back the eighth content and the ninth content in the same manner as when recording. Since operations such as link buttons during playback are played back from the history, the same playback can be performed automatically without the need for such operations.

 It is easy to see that by reverse tracing the history and generating an event, it is possible to automatically play in the opposite direction. In this case, the ninth content is played back for 5 minutes in the reverse direction from the end of the display of the ninth content, and the eighth time is played back for 10 minutes using the link time. .

 The above series of operations can be performed using a jog dial 218 of the remote control input device 210 shown in FIG. In this case, since the update of the playback time may be manually input from the input device, the playback is performed in the same order, but the playback time may not always be equal.

 As described above, according to the present embodiment, a link between a plurality of contents is generated using a common time axis, and a location of one content can be associated with a corresponding location of another content using the link. . By using this link, it is possible to play multiple contents in synchronization with each other. In addition, it is possible to realize a reproduction in which a plurality of contents are switched to each other and the reproduced contents are temporally continuous.

 The embodiment disclosed this time is merely an example, and the present invention is not limited to the above-described embodiment. The scope of the present invention is indicated by each claim in the claims, taking into account the description of the detailed description of the invention, and all changes within the meaning and scope equivalent to the language described therein are set forth. including.

Industrial applicability

The present invention asks for the type of content such as digital or analog, audio or video. The present invention can be applied to an apparatus for reproducing a plurality of contents.

Claims

The scope of the claims 1. A link generating step (2444) for generating a link between the plurality of contents by using a common time axis commonly defined for a plurality of contents; and a link generated between the plurality of contents. And a reproduction step (2480, 250, 255, 255, 256) of reproducing the plurality of contents by using the content reproduction method.  2. The content reproduction method according to claim 1, wherein the link generation step includes a step of dynamically determining a link between the plurality of contents using the common time axis.  3. The content reproduction method according to claim 1, wherein the reproduction step includes a step of reproducing the plurality of contents while synchronizing time between the contents using a link generated using the common time axis. .  4. The content reproduction method according to claim 1, wherein the common time axis is a time axis defined by an absolute time according to a predetermined reference.  5. In each of the plurality of contents, a playback time axis for playback is further defined separately from the common time axis,  The reproducing step includes:  A first content reproduction step for reproducing a selected one of the plurality of contents according to a reproduction time axis defined in association with the selected one content;  Of the plurality of contents, a portion of another content different from the selected one content, which is linked to a playback location in the first content playback step, is defined as a content of the content in the first content playback step. The content reproduction method according to claim 4, further comprising a second content reproduction step for performing reproduction in association with reproduction.  6. For each of the plurality of contents, a relationship between the playback time axis and the common time axis is defined, The link generation step includes: the reproduction time axis of each of the plurality of contents; Generating a link between a point on the playback time axis of a first content and a point on the playback axis of a second content using a relationship between the common time axis. Item 5. The content reproduction method according to Item 5.  7. The content reproduction method according to claim 6, wherein a relationship between the common time axis and the reproduction time axis is defined independently for each of the plurality of contents.  8. The second content playback step includes a step of playing back, in parallel with the playback of the first content, a location of the other content that is linked to the playback location of the first content playback step. The content reproduction method according to claim 5.  9. The first content reproduction step is a step of selecting a content having a first time as a time on the common time axis from among the plurality of contents, and defining the content in relation to the selected content. The content reproduction method according to claim 5, further comprising a step of performing reproduction according to a reproduction time axis.  10. The content playback method according to claim 5, wherein the playback step further includes a selection step for selecting a content to be played back by the first content playback step from the plurality of contents. .  11. The content reproduction method according to claim 10, further comprising: a content registration step of registering the plurality of contents in a predetermined content storage device.  12. The content reproducing method according to claim 11, wherein the selecting step includes a step of selecting an arbitrary content from the plurality of contents registered in the content registration step.  13. The method further comprising, in response to a predetermined content switching signal, selecting the other content as an object to be reproduced by the first content reproduction step, instead of the selected content. The content playback method described in 5.  14. The method according to claim 13, further comprising a step of controlling reproduction of the content in the second content reproduction step so as to reproduce the selected one content in response to the content switching signal. The content playback method described. 15. The method of claim 1, further comprising the step of generating the content switching signal. 3. The content reproduction method described in 3.  16. The content registration step includes a step of registering the plurality of contents in a predetermined order.  The selecting step includes:  Generating a predetermined content switching signal in response to a user operation;  11. The method according to claim 11, further comprising, in response to the content switching signal, selecting the content registered next to the selected content in the content registration step instead of the selected content. Content playback method described in.  1 7. The selection step further comprises:  Generating a predetermined return signal in response to an operation of a user; and responding to the return signal, in place of the selected content, in the content registration step, And a step of selecting the content registered before the content reproduction method.  18. The method according to claim 17, further comprising: calculating a reproduction time of the previous content based on the link from a reproduction time of the selected content at a time when the return signal is generated. Content playback method.  19. The content playback method according to claim 5, further comprising the step of setting the playback time axis for content.  20. The content playback method according to claim 1, further comprising the step of setting the common time axis for content.  21. The reproduction step further includes a step of instructing a reproduction direction of the content,  The method according to claim 5, wherein the first content reproduction step includes a step of reproducing along the reproduction direction along a reproduction time axis defined in association with the selected one content. Content playback method. 22. The method further includes the step of generating a predetermined operation signal. The reproducing step includes a step of, in response to the operation signal, switching and reproducing the plurality of contents according to the link;  The content reproducing method further includes a step of recording, in a predetermined storage device, the operation signal and a time point on the common time axis of the content being reproduced in the reproducing step when the operation signal is generated. ,  In response to a predetermined operation reproduction signal, an operation signal recorded in the predetermined storage device by the recording step is generated at a time point on the common time axis when each of the operation signals is generated. 2. The content reproduction method according to claim 1, further comprising a step of giving the reproduction step, whereby the reproduction of the content according to the operation of the operator is reproduced by the reproduction step.  23. In the step of reproducing the operation signal, the common time axis is traced in a direction opposite to the recording in the recording step, and the operation signal is transmitted at a time corresponding to each operation signal on the common time axis. Including the steps that occur,  23. The content reproducing method according to claim 22, wherein the reproduction of the content according to the operation of the operator is reproduced in a temporally reverse order by the reproduction step.  24. The content playback method according to claim 1, further comprising a step of designating an arbitrary location of the content being played as the playback location in the playback step.  25. A computer-readable recording medium that records a computer program that, when executed by a computer, causes the computer to execute all the steps of the content reproduction method according to claim 1.