JP2002008052A - Presentation system and recording medium - Google Patents

Abstract

(57) Abstract: The present invention relates to a presentation system and a recording medium for recording and presenting multimedia information, and adds and records time information to multimedia information such as a presentation, and separates the multimedia information at an operation timing. The object is to create an object, set the settings and priorities in the object table, emphasize important points as a record, make it easy for a viewer to understand, and enhance the usability. SOLUTION: Means for adding time information to multimedia information such as images and sounds and recording the same, and for multimedia information to which the recorded time information is added, the multimedia information is separated at a main operation timing to create an object. It is configured to include a means for creating, and a means for setting the created object to create an object table and setting a priority to the object as necessary.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a presentation system and a recording medium for performing presentation by recording multimedia information.

[0002]

2. Description of the Related Art In the past, lectures, lectures, and various presentations were recorded on videotape and edited as a record or cut as it was or used as a teaching material. .

[0003]

However, the contents of the above-mentioned presentation and the like are merely recorded and used as they are. Difficult to use,
There was a problem that it was difficult to capture important points as records and the usage was low.

[0004] The present invention solves these problems,
Adds time information to multimedia information such as presentations and records it, creates objects separately at the operation timing, sets and sets priority in the object table, emphasizes important points as a record, and gives viewers Its purpose is to make it easy to understand and to increase usability.

[0005]

Means for solving the problem will be described with reference to FIG. In FIG. 1, an image recording device 2 records an image.

[0006] The voice recording device 3 is for recording voice. The information processing device 4 captures multimedia information to which time information is added, separates the multimedia information at a main operation timing, generates an object, and creates an object table 5 and the like.

The object table 5 is a table in which objects and priorities are set in association with a time axis. Next, the operation will be described.

[0008] The image recording device 2 and the audio recording device 3 add time information to the multimedia information consisting of the image and audio during the presentation and record it, and the information processing device 4 reads the recorded multimedia information and outputs the time information. With respect to the multimedia information to which is added, the multimedia information is separated at the main operation timing to create an object, the created object is set in the object table 5, and the priority is set to the corresponding object as necessary. I have.

At this time, when recording the multimedia information,
Instead of adding time information, specific images or specific sounds are sequentially added and recorded. Further, a section in which the multimedia information is not present or does not change is extracted from the recorded multimedia information, and is set in the object table 5 as a skip section.

[0010] Further, based on the created object table 5, each set object is emphasized on the screen according to the set priority, or the sound is output with emphasis.

A keyword is extracted from each of the separated objects, set in association with the corresponding object in the object table 5, and is displayed or output as sound in association with the object on the screen.

Further, based on the multimedia information or the image taken of the student, the material watched by the student or a part of the material is extracted, and the priority of the object in the object table 5 is set high. I am trying to do it.

Further, based on the multimedia information or the image of the presenter, an image which the presenter is watching,
Materials or uttered voices are extracted, and the priority of the corresponding object in the object table is set high.

[0014] Therefore, by recording multimedia information such as presentations with time information added thereto, creating objects separately at operation timing, and setting and setting priorities in an object table, important points for recording are obtained. Can be emphasized and the viewer can be easily understood, and the usability can be improved.

[0015]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, embodiments and operations of the present invention will be sequentially described in detail with reference to FIGS.

FIG. 1 shows a system configuration diagram of the present invention.
In FIG. 1, an information display processing device 1 is for displaying an image, explaining by sound, and giving a presentation (lecture or the like). In this example, an information display unit 11, a demo / presentation unit 12, operation recording means 13,
It comprises time management means 14 and the like.

The information display means 11 is for displaying information such as images and characters such as video images, slide images, graphic images by a computer, and the like on a screen, for explanation to a viewer.

The demonstration / presentation means 12 includes images, characters,
Demonstrations and presentations are performed using audio and the like. The operation recording means 13 is for recording various operations in demonstrations and presentations.

The time management means 14 is for adding and recording time information to images and sounds used in demonstrations and presentations. The image recording device 2 is for recording time information added to images used in demonstrations and presentations, and is composed of a recording means 21, a time management means 22, and the like.

The recording means 21 records images used for demonstrations and presentations with time information added thereto. The time management unit 22 records the image with the time information added when the recording unit 21 records the image.

The voice recording means 3 is for recording the voice used in the demonstration or the presentation with time information added thereto.
1. It comprises a time management means 32 and the like.

The recording means 31 records the sound used in a demonstration or a presentation with time information added thereto. The time management means 32 adds the time information when the recording means 31 records the sound and causes the sound to be recorded.

The information processing apparatus 4 takes in multimedia information to which time information is added, generates an object by separating multimedia information at a main operation timing, and creates an object table 5 and the like. Here, the input means 41, the image / audio processing means 4
2, demo / presentation reproducing means 43, information integrating means 44,
It comprises an object table 5 and the like.

The input means 41 captures (inputs) multimedia information such as images and sounds recorded with the time information added and recorded. The image / sound processing means 42 generates an object by separating the image and the sound to which the time information is added at the main operation timing, sets the object in the object table 5, extracts the keyword from the object, sets the object, and sets the priority. The degree, the degree of emphasis, the degree of appeal, the degree of change, and the like are set.

The demo / presentation reproducing means 43 reproduces a demonstration or a presentation based on the object table 5. The information integrating means 44 integrates multimedia information such as images and sounds based on time information.

The object table 5 is a table in which multimedia information to which time information has been added is created and set separately at the main operation timing, and priority, emphasis, appeal, and change are set. It is.

FIG. 2 is an explanatory view (part 1) of the present invention. This means that the presenter operates the information display device 1 to display an image, outputs sound, and demonstrates to the viewer.
He gives presentations and lectures. At that time, the information display device 1 records the various operations with time information added thereto, and the image recording device 2, the voice recording device 3, and the image / voice recording device 6 add the time information to the image and the voice, respectively. Record. These recorded operation information, image information,
The information processing device 4 takes in multimedia information including audio information and the like as shown by the arrows in the figure. Then, as will be described with reference to FIGS. 3 to 12, which will be described later, objects are created by separating image information, audio information, and the like at the main operation timing, these created objects are set in the object table 5, and keywords are extracted from the objects. And set the object in the object table 5 to a corresponding object, or assign priority, emphasis,
Set appeal level, change, etc. Then, by reproducing based on the object table 5 in which these pieces of information are set, it is possible to emphasize important points as a record, make it easy for a viewer to understand, and improve usability.

FIG. 3 shows an explanatory diagram (part 2) of the present invention. FIG. 3A shows an example in which recorded images and sounds are schematically displayed. Here, the information display processing device 1 of FIG.
(For example, 1P display (display one page)), an image (for example, image A-1) recorded by the image recording device 2, a sound (for example, sound B-1) recorded by the sound recording device 3, The image / audio recorded by the audio recording device 6 (for example, image / audio
The sound C-1) is displayed as an image.

FIG. 3B shows a time axis of FIG.
The following shows an example in which the information recorded by is expanded. Here, the operation of the information display device 1 on the time axis is switched in the order of 1P display, 2P display, and so on.
The time information added to the image, audio, and image / audio recorded by the image recording device 2, the audio recording device 3, and the image / audio recording device 6 in association with this operation (main operation timing) is displayed on the time axis. When expanded, it becomes as shown in the figure.

As described above, on the time axis, the image and sound recorded by the image recording device 2, the sound recording device 3, and the image / sound recording device 6 in association with the operation (main operation timing) of the information display processing device 1. , Image / audio can be developed respectively.

FIG. 4 is an explanatory view (part 3) of the present invention. This is to add time information to images and sounds so that they can be synchronized with each other. If time information (time stamp) at the time of directly recording an image or sound can be added, the time information is added. In the case of a recording apparatus in which time information cannot be directly added to an image or a sound, the illustrated recording time instructor 7 emits a pulse and emits a pulse for a certain period of time, and records the image and the sound by adding a synchronizing signal. Then, time information is created on the basis of the pulse-like signals at predetermined time intervals in the recorded images and sounds, and added to the images and sounds.

As described above, the recording device for recording is an image,
If time information cannot be added directly to the sound, pulsed light emission / pronunciation is recorded in the image or sound, and time information is created based on the recorded image or pulsed signal in the sound. , It is possible to add time information to the voice.

FIG. 5 is an explanatory view (part 4) of the present invention. FIG. 5A shows operations, images, and images recorded on the time axis.
FIG. 3B shows a state in which voice and image / voice have been developed.
Same as).

FIG. 5B shows the objects (1), (2), and (4) separated at the main operation timing shown in FIG.
(3)... Are shown. The objects (1), (2), (3),... Are separated at main operation timings (here, main operation timings of 1P display, 2P display, and 3P display).

FIG. 5C shows how to specify skip and fast forward. Here, indicates that immediately after the page is switched by the display switch, there is a period during which no operation is performed, and there is a period during which the image and the sound are silent. Therefore, skip designation is set in the object table 5 (not shown) for the period. Then, the meaningless portion is skipped so that the content can be quickly reproduced.

Since there is a period in which no operation is performed and a period in which the sound is silent immediately after the material instruction operation is performed, the fast-forward designation is set in the object table 5 (not shown) for that period, and there is no change. The part is fast-forwarded so that it can be played back quickly.

Indicates that during the writing operation, there is a sound silence period, so that the fast-forward designation is set in the object table 5 (not shown) for that period, and the portion without sound is fast-forwarded, It can be played back.

As described above, by setting skip designation and fast-forward designation in the object table 5 for a portion having no operation, no image, and no sound, it is possible to reproduce quickly and efficiently.

FIG. 6 is a flowchart (recording) for explaining the operation of the present invention. Here, FIG. 6A shows a flowchart when recording is performed by the image / audio recording device, and FIG. 6B shows a flowchart when performing presentation using the presentation device.

In FIG. 6A, S1 determines whether there is time management means. In the case of YES, synchronization is performed with the presentation device in S2, and the process proceeds to S3. On the other hand, in the case of NO, the process proceeds to S3.

In step S3, recording starts. this is,
Since the presentation device has started the presentation, recording of the state is started.
S4 records.

In step S5, it is determined whether there is a time management unit.
In the case of YES, the time stamp is added to the image and the sound and recorded in S6, and the process proceeds to S8. On the other hand, in the case of NO, the synchronization information is recorded in S7, for example, the above-described light pulse of FIG. 4 is recorded in the image, and the audio pulse is recorded in the audio, and the process proceeds to S8.

In step S8, the recording is stopped. S9 is
It is determined whether the recording is completed. If YES, the process ends. If NO, the process returns to S3 and repeats.

Through the above steps S1 to S9, a time stamp is added to the image and audio during the presentation, or the light emission pulse is recorded in the image and the audio pulse is recorded in the audio, and time information is added to the image, audio and operation. Can be recorded.

In FIG. 6B, in step S11, synchronization is performed. In this case, synchronization is performed with the image / sound recording device corresponding to S2 in FIG. 6A described above. S12
Starts the presentation. In this case, the presenter operates the presentation device (the information display processing device 1 in FIG. 1) to start the presentation.

In step S13, the progress of the presentation is recorded. In this method, the presenter operates the presentation device to switch the page display to the next page display, and records the operation by adding a time stamp.

In step S14, synchronization information is generated. S15
Determines whether the presentation is over. If YES, the process ends. If NO, the process returns to S13 and repeats.

According to the above S11 to S15, the presenter operates the presentation device to display an image and utters a voice to perform various presentations.
The operation at that time can be recorded with a time stamp added.

FIG. 7 shows an example of a presentation progress record table according to the present invention. This corresponds to the already described FIG.
When the presenter operates the presentation device to give a presentation, the main operation, the event, the time (time stamp), and the content are recorded.

FIG. 8 shows a flowchart (creation) for explaining the operation of the present invention. In FIG. 8, S21 reads a presentation progress record table and image / audio record information. This is an operation (main operation) to which the time information recorded in the presentation progress recording table of FIG. 7 is added, an image to which the recorded time information is added,
Load audio.

In step S22, the main operation and the recorded information are developed on the time axis. S23 takes out the main operation and starts (T
s) / End (Te) time is extracted. These S22, S
Reference numeral 23 denotes, for example, as shown in FIG. 5A described above, the main operation, the image, and the sound are developed on the time axis based on the time information added thereto, and the developed main operation is started ( T
The time of s) and the end (Te) are extracted respectively.

In step S24, recording information (image and sound) existing between Ts and Te is extracted. For example, as shown in the previously described objects (1), (2), (3),... In FIG. 5B, the image and the sound corresponding to the main operation are respectively extracted.

In step S25, the analysis processing in steps S31 to S36 is performed based on the main operation. In step S31, presentation data analysis, recorded image recognition / analysis, and recorded voice recognition / analysis are performed.

In step S32, a keyword is extracted. This extracts keywords from images and voices based on the analysis and recognition in S31. S33 determines the priority. The priority is determined, for example, as follows.

Material display by the information display processing device Image of the presenter Image of the attendee Voice of the presenter Voice of the audience is recorded, and the priority is set as follows.

At the start, the image has a high priority set for the voice. The voice has a high priority set for the voice. After that, when the presenter speaks, the highest priority of the image is set to the voice. Set the highest value of the priority of the other to the previous priority.If the presenter operates the information display processing device, the priority of the image is set to the highest value.The priority of the sound is set to the highest value. Set to a value If the viewer utters a question or the like, the image priority is set to the highest value The audio priority is set to the highest value S34 determines the degree of emphasis. This is based on the position of the viewer's line of sight by analyzing the viewer's image, the position of the presenter and the line of sight of the presenter by analyzing the image of the presenter, and the material display position in the venue. , The degree of emphasis of the image and sound at the position where the viewer and the presenter are gazing is set high.

In step S35, the degree of appeal is determined. In this method, the appeal degree of an image or sound to be appealed based on the facial expression or sound in the image of the presenter is set high. S3
6 determines the degree of change. This is set by analyzing the image and the sound to determine the degree of change of the image and the sound.

In step S26, the information is converted into an object based on the analysis result. This means that an object to be set in the object table example of FIG. 9 described later has been created.

In the step S27, it is determined whether or not the processing is completed. If YES, an object table is created in S28. NO
In the case of, the process returns to S23 and is repeated. As described above, the main operation, the image, and the sound to which the recorded time information is added are read, the image and the sound are separated at the main operation timing, the separated images and the sound are analyzed, and the keywords are extracted. The object can be created by determining the degree, appeal degree, change degree, etc., and setting the object in the object table 5.

FIG. 9 shows an example of an object table according to the present invention. In the object table 5, the horizontal axis represents the time axis, and the vertical axis sets the following items shown in the figure. -OHP content:-Image / audio 1:-Image 2:-Audio 2:-Priority-OHP content:-Image / audio 1:-Image 2:-Audio 2:-Emphasis:-Appeal:-Change : ・ Keyword: ・ Memo: As described above, the object table 5 as shown in FIG. 8 is automatically created based on the recorded main operation timing, image, and sound according to the procedure shown in the flowchart of FIG. It is possible to do.

FIG. 10 is an explanatory diagram of the present invention. This shows an example of a scenario outline when automatically creating an object table (corresponding to content) 5, and an example in which a multi-window screen configuration is determined. Here, the scenario outline transitions as shown below.

• Cover: • Regime: • Multi-window screen: • Index Also, the multi-window screen is arranged as shown on the right.

FIG. 11 is a flow chart for explaining the operation of the present invention (automatic creation). In FIG. 11, S41 extracts an object list. S42 is title / date / time /
Create the cover screen by extracting the instructor name. For example, a cover screen is created as shown on the right side.

A step S43 arranges the object names (titles) and the links on the time axis to create a regime. This is created, for example, as shown in a creation example of a registration screen indicated by an arrow on the right side.

In step S44, each object is extracted. S
Reference numeral 45 assigns the in-object information to a corresponding window to create a multi-window screen. For example, it is created as shown in an example of creating a main screen indicated by an arrow on the right side.

In step S46, a screen structure corresponding to the priority is created. For example, it is created as shown in an enlarged display example of a priority window indicated by an arrow on the right side. In step S47, an emphasized expression corresponding to the degree of emphasis is added. For example, as shown in a flash expression example of an emphasis portion indicated by an arrow on the right side, an emphasis expression is added.

In S48, it is determined whether the processing is over. In the case of YES, an index screen is created from keywords of each object in S49. On the other hand, if NO, the process returns to S44 and repeats.

As described above, the object list is fetched, the title, date and time, etc. are extracted to create a cover screen, object names and links are arranged on the time axis to create a register, and the information in the object is assigned to the corresponding window to create a multi-window screen. , Create a screen configuration according to the priority, add an emphasis expression according to the degree of emphasis, and create an index screen from keywords of each object, thereby automatically creating content (object table 5). It becomes possible.

FIG. 12 is an explanatory diagram of the present invention. This explains the creation of the digest content. FIG. 12A shows an example of a basic scenario. Here, the following scenario shown in the figure is created.

(1) Keyword push display: (2) Presenter flash display: (3) Emphasis screen switching and push display: (4) Title screen display: (5) Fade out: FIG. The state of object conversion is shown. Here, the entire part is made into objects 1, 2, 3, 4,... Separated at the main operation timing described above. The degree of emphasis and the degree of appeal are set in correspondence with the objects 1, 2, 3, 4,. In addition, each object 1,
As shown in the figure, images are cut out from 2, 3, 4,..., And keywords are extracted and set.

FIG. 12C shows an example in which content is created. This corresponds to the scenario (1) in FIG.
According to (2), (3) and (4), screens (1) and (1) automatically created based on the images 1, 2, 3, 4, 5,... Extracted in FIG. 2), (3),
The example of (4) is shown.

[0072]

As described above, according to the present invention,
Multimedia information including presentations is recorded by adding time information to multimedia information such as presentations, separating objects at operation timing, creating objects, setting the object table, and setting priorities. With regard to the media information, it is possible to emphasize important points as a record, make it easy for a viewer to understand, and enhance usability.

[Brief description of the drawings]

FIG. 1 is a system configuration diagram of the present invention.

FIG. 2 is an explanatory view (No. 1) of the present invention.

FIG. 3 is an explanatory view (No. 2) of the present invention.

FIG. 4 is an explanatory view (No. 3) of the present invention.

FIG. 5 is an explanatory view (No. 4) of the present invention.

FIG. 6 is a flowchart (recording) for explaining the operation of the present invention.

FIG. 7 is an example of a presentation progress record table of the present invention.

FIG. 8 is a flowchart (creation) for explaining the operation of the present invention.

FIG. 9 is an example of an object table according to the present invention.

FIG. 10 is an explanatory diagram of the present invention.

FIG. 11 is a flowchart illustrating the operation of the present invention.

FIG. 12 is an explanatory diagram of the present invention.

[Explanation of symbols]

 1: information display processing device 2: image recording device 3: audio recording device 4: information processing device 5: object table

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 5/91 H04N 5/91 N 5/93 5/93 EZ F term (Reference) 5B049 FF07 5B050 CA09 FA10 FA17 5C053 FA14 FA30 HA21 JA01 JA22 JA30 KA04 KA05 LA05 LA11 5C082 AA01 AA03 AA37 BA02 BA12 BB26 CA76 CB05 DA61 DA87 MM09 MM10 5E501 AA01 AA20 AB13 AC14 AC15 BA03 BA06 CA02 CA06 CB15 DA11 DA12 EA21 FA

Claims (8)

[Claims] 1. A presentation system for performing presentation by recording multimedia information, means for adding and recording time information to multimedia information such as images and sounds, and a multimedia to which the recorded time information is added. Means for creating an object by separating multimedia information at main operation timing, and means for setting the created object, creating an object table, and setting the priority of the object as necessary. A presentation system characterized by the following. 2. The presentation system according to claim 1, wherein at the time of recording the multimedia information, a specific image or a specific sound is sequentially added and recorded instead of adding the time information. 3. The apparatus according to claim 1, further comprising means for extracting a section where the multimedia information does not exist or does not change from the recorded multimedia information, and setting the extracted section as a skip section in the object table. Item 3. The presentation system according to Item 2. 4. A system according to claim 1, further comprising means for highlighting on a screen or outputting sound by emphasizing the set objects based on the set priority based on the created object table. The presentation system according to claim 1. 5. A method for extracting a keyword from each of the separated objects, setting the keyword in association with the object in the object table, and displaying or outputting the sound in association with the object on a screen. The presentation system according to any one of claims 1 to 4, characterized in that: 6. A material watched by the student or a portion of the material is extracted based on the multimedia information or the image of the student, and the priority of the object in the object table is increased. The presentation system according to any one of claims 1 to 5, further comprising a setting unit. 7. An image, a document, or a voice uttered by the presenter is extracted based on the multimedia information or the image obtained by photographing the presenter, and the corresponding object in the object table is extracted. 7. The presentation system according to claim 1, further comprising means for setting a high priority. 8. A means for recording by adding time information to multimedia information such as an image and a sound, and separating the multimedia information with the recorded time information by a main operation timing. A computer-readable recording medium recording a means for creating an object, and a program for setting the priority of the created object to function as a means for creating an object table.