WO2025213221A1

WO2025213221A1 - Media playout system and method

Info

Publication number: WO2025213221A1
Application number: PCT/AU2025/050340
Authority: WO
Inventors: Grant Petty
Original assignee: Blackmagic Design Pty Ltd
Current assignee: Blackmagic Design Pty Ltd
Priority date: 2024-04-08
Filing date: 2025-04-08
Publication date: 2025-10-16
Anticipated expiration: 2026-10-08

Abstract

A media playout system is disclosed. The media playout system comprises a computer system, a video output on which a video stream can be played to a connected device, a memory storing instructions which when executed by the data processing system is configured to provide a non-linear editing application which is configured to provide a user interface. The user interface includes a media bin for displaying indicia representing a respective media file, a timeline in which media files represented in the media bin can be arranged and edited to create a media project, a viewing window in which media files in the media bin may be played back. The non-linear editing application may include a multiple source viewing mode. Also disclosed herein is a method in a non-linear editing system.

Description

MEDIA PLAYOUT SYSTEM AND METHOD

Related applications

[0001] The present application claims priority to Australian patent applications 2024900975 and 2024900976, both filed on 8 April 2024. The entire disclosure of both applications is incorporated herein by reference for any jurisdiction in which such an incorporation is allowable.

Field

[0002] The present disclosure relates to live or near-live video production, methods and systems. In one example the methods and systems can be used as a replay system but the present disclosure should not be considered as being limited to playout in this situation.

Background

[0003] In live or near-live video production situations, such as broadcasting live events (e.g. sport, public events, concerts or the like) it is common to provide replays of events that have just occurred. Replays may show an event that was previously shown live, e.g. to show a different point of view of the action, or they show events that were not previously shown live because another shot was being shown. Replays are typically handled by dedicated replay systems. Modern replay systems comprise disk recorders that receive a plurality of channels of video from connected sources. Clips in the channels can be indexed and saved for later use, or temporarily stored for near- real-time playback as a replay.

[0004] Some replay systems have 2 output channels, and in use a user can cue up a clip for playback on each channel (e.g. different angles of the same action). Then to play a playout sequence having each view in series, the user may send a first channel to air, then manually switch to the second at the appropriate time. Moreover, if a third view in the playout sequence is desired, this needs to be cued on the first played channel while the second channel is being output to air. Because a replay is typically being played to air during a break in live action, or as a cut away from live action, the replay can only be short (on the order of seconds) and the time available for the operator to perform selection, cueing etc. must essentially be performed within this time and sometimes while the clip is being played live to air. This means that conventional replay systems require highly skilled operators. Another drawback of using specialised and dedicated hardware for replay is cost. Conventional replay systems may cost more than $100,000 and even lower specification systems can be in tens of thousands of dollars. [0005] Playout of media in real time or near real time in other situations, such as on large scale video screens at sporting or cultural or other public events or in public places may also present similar challenges.

[0006] The systems, devices, methods and approaches described in this section, and components thereof are known to the inventors. Therefore, unless otherwise indicated, it should not be assumed that any of such systems, devices, methods, approaches or their components described are citable as prior art merely by virtue of their inclusion in this section, or that such systems, devices, methods, approaches and components would ordinarily be known to a person of ordinary skill in the art.

Summary

[0007] According to a first aspect of the disclosure, there is provided a media editing system comprising: a computer system in data communication with a data storage system storing a plurality of media files containing a time sequence of media content, said computer system including: a data processing system arranged to execute software instructions; a memory storing instructions which when executed by the data processing system is configured to provide a non-linear editing application, said non-linear editing application being arranged to provide a user interface simultaneously including: a media bin for displaying indicia representing one or more respective media files that may be included in a media project; a timeline in which media files represented in the media bin can be arranged and edited to create a media project; a viewing window in which media files in the media bin may be played back; wherein the non-linear editing application provides a multiple source viewing mode in which the user interface is configured to display one or more media files in the viewing window, wherein all displayed media files are displayed relative to a common time clock, and wherein all media files in the media bin that have media content at a given instant on the time clock are simultaneously displayed in a respective portion of the viewing window.

[0008] In some embodiments in the multiple source viewing mode the non-linear editing application is further configured to enable synchronised scrolling through all clips displayed in the viewing window.

[0009] In some embodiments in the multiple source viewing mode the non-linear editing application is further configured to enable selection of one of the media files displayed in the viewing window. [0010] In some embodiments in the multiple source viewing mode the non-linear editing application is further configured to enable marking of a point of interest relative to the common time clock in a selected media file.

[0011] In some embodiments in the multiple source viewing mode the non-linear editing application is further configured to mark the same point of interest relative to the common time clock in all media files containing content at the time of the point of interest.

[0012] In some embodiments the non-linear editing application is further configured to enable insertion of a clip from one of said media files into said timeline based on said point of interest.

[0013] In some embodiments in the multiple source viewing mode the non-linear editing application is further configured to enable insertion of a corresponding clip from another one of said media files into said timeline based on said same point of interest.

[0014] In some embodiments, the viewing window may be configured to play back a live view of a media file in the media bin showing new media content that is being written to said media file in the data storage system by a media source.

[0015] In some embodiments the computer system further includes a video output on which a video stream can be played to a connected device; and wherein the non-linear editing software is configured to cause playout of a video stream including a portion of at least one of said media files on said video output, while new media content is being written to said media file in the storage system by a media source.

[0016] In some embodiments the non-linear editing software is configured to playout said video stream prior to generation of a final media file representing a media project in the timeline.

[0017] In some embodiments the video stream plays out the media project represented in the timeline.

[0018] In some embodiments the media project in the timeline includes at least two media files arranged and edited to create a media project; and wherein at least one of said media files included in the media project is still having new media content being written to said media file in the storage system by a media source.

[0019] In some embodiments the system includes a playback trigger to cause play out on the video output.

[0020] In some embodiments the system includes a stop trigger to stop playback on the video output. [0021] In some embodiments the non-linear editing software includes a playout speed control that causes a change of playout speed of a video stream wherein said playout speed control is operable during playout on the video output.

[0022] In some embodiments the non-linear editing software includes in its graphical user interface any one or more of the following: an indicia that is activated when playout of a video stream is in progress; an indication of a total playout time of a project in a timeline; an indication that a media file in the media bin is having new media content written to it in the storage system by a media source; an indication that a media file displayed in said viewing window is having new media content written to it in the storage system by a media source.

[0023] In some embodiments the media editing system further includes an editing controller comprising a user interface including one or more buttons and at least one variable input control, said variable input control being selected from a list comprising: a manual slider, manual control wheel; rotary input controller; or a representation of any one or more of the foregoing on a touchscreen.

[0024] In some embodiments the multiple source viewing mode is activated or deactivated by a user input.

[0025] According to a second aspect of the disclosure, there is provided a method in a non-linear editing system comprising: providing a graphical user interface simultaneously showing: a media bin for displaying indicia representing one or more media files that may be included in a media project; a timeline in which media files represented in the media bin can be arranged and edited to create a media project; a viewing window in which media files in the media bin may be played back; operating the non-linear editing application in a multiple source viewing mode comprising: displaying one or more media files in the viewing window, wherein all displayed media files are displayed relative to a common time clock, and wherein all media files in the media bin that have media content at a given instant on the time clock are simultaneously displayed in a respective portion of the viewing window.

[0026] In some embodiments the method further includes: receiving a user input to scroll through one of said simultaneously displayed media items; and performing synchronised scrolling through all clips displayed in the viewing window.

[0027] In some embodiments the method further includes: receiving a user input to mark a point of interest relative to the common time clock in a selected media file. [0028] In some embodiments the method further includes marking the same point of interest relative to the common time clock in all simultaneously displayed media files.

[0029] In some embodiments the method further includes responsive to a user input, inserting of a clip from one of said media files into said timeline based on said point of interest.

[0030] In some embodiments the method further includes responsive to a user input, inserting a corresponding clip from a simultaneously displayed media file into said timeline based on said same point of interest.

[0031] In some embodiments, the viewing window may be configured to play back a live view of one or more media files in the media bin showing new media content that is being written to said media file in the data storage system by a media source.

[0032] In some embodiments the method further includes playing a video stream on a video output including media content from at least one media file displayed in said media bin; while new media content is being written to at least one of said media files displayed in said media bin.

[0033] In some embodiments the playing out of the video stream occurs prior to generation of a final media file representing a media project in the timeline corresponding to the video stream.

[0034] In some embodiments the video stream corresponds to a media project represented in the timeline.

[0035] In some embodiments the method further includes receiving a user input indicating a change in a play out speed of the video stream during play out, and changing the play out speed of the media stream accordingly.

[0036] In some embodiments the method further includes displaying any one or more of the following features on the graphical user interface: an indication that playout of a video stream is in progress; an indication of a total playout time of a project in a timeline and/or a video stream currently being played out; an indication that a media file in the media bin is having new media content written to it in a storage system by a media source; an indication that a media file displayed in said viewing window is having new media content written to it in a storage system by a media source.

[0037] In some embodiments the method further includes receiving a user input activating or deactivating said multiple source viewing mode.

[0038] According to a third aspect of the disclosure, there is provided a media playout system comprising: a computer system in data communication with a data storage system, said computer system including: a data processing system arranged to execute software instructions; a memory storing instructions which when executed by the data processing system is configured to provide a non-linear editing application, said non-linear editing application being configured to provide a user interface including: a media bin for displaying indicia representing a respective media file, containing media content, that may be included in a media project; a timeline in which media files represented in the media bin can be arranged and edited to create a media project; a viewing window in which media files in the media bin may be played back; a video output on which a video stream can be played to a connected device; wherein the non-linear editing application is configured to cause playout of a video stream including a portion of at least one of said media files on said video output, while new media content is being written to said media file in the data storage system by a media source.

[0039] In some embodiments, the viewing window may be configured to play back a live view of a media file in the media bin showing new media content that is being written to said media file in the data storage system by a media source.

[0040] In some embodiments the non-linear editing application is configured to playout of a video stream including a portion of at least one of said media files on said video output, while new media content is being written to said media file in the storage system by a media source, prior to generation of a final media file representing a media project in the timeline.

[0041] In some embodiments the video stream plays out the media project represented in the timeline.

[0042] In some embodiments a media project in the timeline includes least two media files arranged and edited to create a media project; and wherein at least one of said media files included in the media project is still having new media content being written to said media file in the storage system by a media source.

[0043] In some embodiments the system includes a playback trigger to cause play out of the video output.

[0044] In some embodiments the system includes a stop trigger to stop playback on the video output.

[0045] In some embodiments the non-linear editing application includes a playback speed control that causes a change of playout speed of a video stream wherein said playback speed control is operable during playout.

[0046] In some embodiments the non-linear editing application includes in its graphical user interface any one or more of the following: an indicia that is activated when playout of a video stream is in progress; an indication of a total playout time of a project in a timeline; an indication that a media file in the media bin is having new media content written to it in the storage system by a media source.

[0047] In some embodiments the non-linear editing application includes in its graphical user interface an indication that a media file displayed in said viewing window is having new media content written to it in the storage system by a media source. Preferably the viewing window displays the new media content of the media file that is being written to it in the storage system by a media source.

[0048] In some embodiments the media playout system further includes an editing controller comprising a user interface including one or more buttons and at least one variable input control, said variable input control being selected from a list comprising: a manual slider, manual control wheel; rotary input controller; or a representation of any one or more of the foregoing on a touchscreen.

[0049] According to a fourth aspect of the disclosure, there is provided a method in a non-linear editing system, said non-linear editing system comprising, a computer system in data communication with a data storage system storing media files thereon, said method comprising: providing a graphical user interface for the non-linear editing system simultaneously showing: a media bin for displaying indicia representing one or more media files that may be included in a media project; a timeline in which media files represented in the media bin can be arranged and edited to create a media project; a viewing window in which media files in the media bin may be played back; and causing playout of a video stream including a portion of at least one of said media files on said video output while new media content is being written to said media file in the data storage system by a media source.

[0050] In some embodiments playout of said video stream occurs prior to generation of a final media file representing a media project in the timeline.

[0051] In some embodiments, the viewing window may be configured to play back a live view of one or more media files in the media bin showing new media content that is being written to said media file in the data storage system by a media source.

[0052] In some embodiments the video stream plays out the media project represented in the timeline.

[0053] In some embodiments a media project in the timeline includes at least two media files arranged and edited to create a media project; and wherein at least one of said media files included in the media project is still having new media content being written to said media file in the storage system by a media source. [0054] In some embodiments the method further includes: causing playout of the video stream in response to a user input to trigger playout.

[0055] In some embodiments the method further includes: stopping play out of the video stream in response to a user input to stop playout.

[0056] In some embodiments the method includes: changing a playout speed of the video stream during playout in response to receiving a user speed control during playout.

[0057] In some embodiments the method further includes displaying any one or more of the following on the graphical user interface: an indication of that playout of a video stream is in progress; an indication of a total playout time of a project in a timeline and/or a video stream currently being played out; an indication that a media file in the media bin is having new media content written to it in a storage system by a media source; an indication that a media file displayed in said viewing window is having new media content written to it in a storage system by a media source.

[0058] According to a fifth aspect of the disclosure, there is provided a media playout system comprising: a computer system in data communication with a data storage system, said computer system including: a data processing system arranged to execute software instructions; a memory storing instructions which when executed by the data processing system is configured to provide a non-linear editing application, said non-linear editing application being configured to provide a user interface including: a media bin for displaying indicia representing a respective media file, containing media content, that may be included in a media project; a timeline in which media files represented in the media bin can be arranged and edited to create a media project; a viewing window in which media files in the media bin may be displayed, wherein display comprises playing of new media content that is being written to said media file in the data storage system by a media source to provide a live view of the content of the media file; a video output on which a video stream can be played to a connected device; wherein the non-linear editing application is configured to cause playout of a video stream including a portion of at least one of said media files on said video output, while new media content is being written to said media file in the data storage system by a media source.

[0059] Preferably the viewing window enables display of multiple media files in the media bin simultaneously wherein display of at least one of the multiple media files comprises playout of new media content that is being written to said media file in the data storage system. Further embodiments may include optional or preferred features of the third aspect of the present disclosure. [0060] According to a sixth aspect of the disclosure, there is provided a method in a non-linear editing system, said non-linear editing system comprising, a computer system in data communication with a data storage system storing media files thereon, said method comprising: providing a graphical user interface for the non-linear editing system simultaneously showing: a media bin for displaying indicia representing one or more media files that may be included in a media project; a timeline in which media files represented in the media bin can be arranged and edited to create a media project; a viewing window in which media files in the media bin may be played back such that new media content that is being written to said media file in the data storage system by a media source is played to provide a live view of the content of the media file; causing playout of a video stream including a portion of at least one of said media files on said video output while new media content is being written to said media file in the data storage system by a media source.

[0061] In some embodiments playout of said video stream occurs prior to generation of a final media file representing a media project in the timeline. Preferably the viewing window enables display of multiple media files in the media bin simultaneously wherein display of at least one of the multiple media files comprises playout of new media content that is being written to said media file in the data storage system. Further embodiments may include optional or preferred features of the fourth aspect of the present disclosure.

[0062] According to a seventh aspect of the disclosure, there is provided a computer readable medium storing instructions that, when executed by a computer processor, cause the computer processor to perform the method of the second, fourth, or sixth aspect or any embodiment thereof.

[0063] According to an eighth aspect of the invention, there is provided a software product including a computer readable medium storing instructions which when executed by a processor provide the non-linear editing application according to the first, third, or fifth aspect or any embodiment thereof.

[0064] Reference throughout this specification to "some embodiments" or "an embodiment" or "various embodiments" or similar means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one disclosed embodiment. Thus, the phrases "an embodiment", "some embodiments" or "various embodiments" throughout this specification are not necessarily all referring to the same embodiment or embodiments. Furthermore, while some embodiments described herein include some, but not other features included in other embodiments, combinations of features of different embodiments are meant to be within the scope of the disclosure, and form different embodiments, as would be understood by those skilled in the art. For example, in the above summary, and the following description and claims, any of the features of any one the embodiments may be used in any combination. Further, any embodiment of one aspect of the disclosure may be combined with any consistent embodiment of another aspect of the invention.

[0065] While the invention(s) disclosed herein are amenable to various modifications and alternative forms, specific embodiments are shown by way of example in the drawings and are described in detail. It should be understood, however, that the drawings and detailed description are not intended to limit the invention(s) to the particular form disclosed. Furthermore, all alternative combinations of two or more of the individual features mentioned or evident from the text or drawings comprise additional aspects or inventive disclosures, which may form the subject of claims.

Brief description of the Drawings

[0066] Figure 1 is a schematic block diagram of a first embodiment.

[0067] Figure 2 shows a graphical user interface for a NLE software application according to an embodiment.

[0068] Figure 3 shows a graphical user interface for a NLE software application according to an embodiment.

[0069] Figure 4 shows a graphical user interface for a NLE software application according to an embodiment.

[0070] Figure 5 shows a graphical user interface for a NLE software application according to an embodiment.

[0071] Figure 6 shows a graphical user interface for a NLE software application according to an embodiment.

[0072] Figure 7 is a view of a control panel adapted for use in an embodiment of the present disclosure.

[0073] Figure 8 a schematic block diagram of a first embodiment of a computer system.

Detailed description

[0074] In the following description numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, that the present invention may be practiced without these specific details. In some instances, well-known structures and devices are shown in block diagram form in order to avoid unnecessary obfuscation of salient details. [0075] Figure 1 shows an exemplary system which may embody an aspect of the present disclosure. The media playout system 100 includes a computer system 1000 with an associated display 1012 (which may include multiple display screens or other output devices for showing a graphical user interface of the media playout). The computer system 1000 may additionally have a control panel as an input device 1014. The control panel 1014 may be a keyboard, touchscreen or a special purpose input device such as the Blackmagic DaVinci Resolve Speed editor, or other similar device adapted for providing user inputs to a non-linear editing application. The computer system also has an associated storage system 1060 /1010 comprising one or more data storage devices arranged to store media files and other data and files necessary to operate the media playout system. The computer system 1000 may additionally include (or be connected to) a video card or other media capture and playback interface 1020. This media capture and playback interface 1020 could include one or more of the Blackmagic Desktop Video products such as a Blackmagic Decklink Card, UltraStudio or the like. It may be integrated into the computer 100 (e.g. as a video card may be) or stand alone hardware unit(s).

[0076] In use the media playout system 100 receives a data representing media in real time from a plurality of media sources, e.g. camera 110A and HOB. The received media will be stored in files on associated storage system 1060 /1010, and will typically also be sent out for real time distribution or playback. In some embodiments the media capture and playback interface 1020 will be in data communication 1028 with the associated storage system 1060/1010 to allow direct reading and writing of media files to the storage system 1060/1010 without data passing through the computer system 1000.

[0077] Reading and writing to the associated data storage system 1060/1010 may be performed using a reading and/or writing technique that has relatively low latency between writes and reads and allows the media playout to have access to and replay the most recently stored version of media files. One example is described in the applicant's co-pending patent application entitled "Reading and/or writing media files" filed on or about the same day as the present specification, the contents of which are herein incorporated by reference.

[0078] As will be appreciated, the system diagram of figure 1 is highly simplified and many components used in a media distribution or live production system are omitted for clarity. Thus the real time distribution or playback of the media from the media sources may be via the media capture and playback interface 1020, or via other data distribution channels (not shown). For example the output of the cameras 110A and HOB may be sent to router or other device prior to input to the media capture and playback interface 1020, and they may additionally be sent to a broadcast switcher for broadcast. In use the output 1025 of the media capture and playback interface 1020 may be connected to a downstream device to enable transmission of its output, e.g. it may be connected to a broadcast switcher for broadcast.

[0079] In the context of the present disclosure, a non-linear editor (NLE) will typically include a nonlinear editing application running on a computer system, such as computer system 1000 in figure 1 and 8. The NLE application could be a dedicated application, or include one or more additional capabilities such as color correction, digital audio workstation (DAW) functions, special effects capability as a subset of its functionality. One such example of an NLE application is DaVinci Resolve ® from Blackmagic Design. In some embodiments the NLE may include a special purpose computer system (e.g., video processing appliance, video card or the like) configured to perform video processing or handle processing intensive tasks for the computer running the NLE application. The total functionality of DaVinci Resolve® is divided into a number of separate pages (each having their own graphical user interface). The DaVinci Resolve® pages include: Media (for media management and clip organization); Edit (a non-linear video editing interface); Cut (an alternative non-linear video editing interface); Color (for color correction and grading); Sound (a digital audio workstation); and Delivery (for final rendering i.e. output to a single final media file representing the media project in the timeline or the Cut or Edit page). In common with other non-linear video editors, the user interface of the Edit page and Cut page of DaVinci Resolve® includes a timeline that is a graphical representation of the project being edited. The timeline may include a plurality of timecode markings that are spaced apart in a horizontal direction across the length of the timeline user interface box. The timeline allows the constituent elements (e.g. media files, transitions, still images etc.) of the project to be arranged into a desired temporal order by positioning the element relative to the timeline's temporal markings and any other media elements in the timeline. Once placed in the timeline, elements can be edited by launching editing tools to perform operations such as trimming, splitting, inserting, merging, and moving of clips to a desired location.

[0080] Figure 2 illustrates an embodiment of a graphical user interface 200 for a non-linear editor that is adapted for use in for use in a media playout system. The NLE GUI 200 in this example is a modified form of the DaVinci Resolve Cut page, but the present disclosure should not be considered to be limited to this application. The GUI of the present embodiment includes:

• A media bin 202. The media bin 202 is a region of the GUI in which media that is imported into the NLE and that may be used for in a media project, is represented. Typically this is done by providing an indicium 210.1, 210.2, 210.3, 210.4 representing the various media files. Such indicium may be thumbnails or icons representing the media clip. A file name can additionally or alternatively be shown. In the context of replay or playback during a live broadcast or similar, each media file can be considered to represent a feed from a camera (although the source may not be a camera) and as such it may be convenient to name each file and its respective view with a camera number (or colour or any other easily distinguishable name) e.g. Camera 1, Camera 2. Since there is real-time action being captured (or created in the case of animation or gaming content) new media content will be being written to at least one of the media files in media bin 202. Moreover, the preview of the media content elements 210.1, 210.2, 210.3, 210.4 that are shown in preview window 206 can show the "live" shot from each camera.

• A timeline interface 204. The timeline is the primary NLE editing interface and contains tracks or lanes in which media files represented in the media bin can be arranged and edited to create a media project. The timeline 204 may include a plurality of timecode markings that are spaced apart in a horizontal direction across the length of the timeline user interface box. The timeline allows the constituent elements (e.g. media files, transitions, still images etc.) of the project to be arranged into a desired temporal order by positioning the element relative to the timeline's temporal markings and any other media elements in the timeline. Once placed in the timeline, media elements can be edited by launching editing tools to perform operations such as trimming, splitting, inserting, merging, and moving of clips to a desired location. The GUI can show multiple timelines with different levels of zoom and different representations of the media (suitable for the respective zoom levels). In this regard timeline 204.1 shows the same media project as timeline 204, but represents a longer time scale so that (optionally) the entire duration of the media project can be seen on the timeline 204.1, while an area currently being edited or reviewed can be shown in more detail in timeline 204. Each timeline 204 and 204.1 includes a playhead or current time indicator 232, 232.1 which may be used to show the point on the timeline that is currently being shown in the viewer/preview window.

• A preview window or viewing window 206 in which media files in the media bin may be viewed, either to preview the media files, for inspection by the user to determine edit points and actions, or to review the media project in the timeline. The viewing window 206 may have several panes, containing individual views of some or all of the media content elements 210.1, 210.2, 210.3, 210.4 contained in the media bin 202. As the files in the media bin 202 may being written in real-time as video is being captured (or created in the case of animation or gaming content) by a camera, the preview of the media content elements 210.1, 210.2, 210.3, 210.4 that are shown in preview window 206 can show the real-time or "live" shot from each camera. Each sub-window or pane 216.1, 216.2, 216.3, 216.4 of the viewing window 206 can display the timecode 250.1, 250.2, 250.3,

250.4 of the video frame currently being shown in it. In the event that multiple "live" views are being displayed at once in respective windows 216.1, 216.2, 216.3, 216.4 the timecodes 250.1,

250.2, 250.3, 250.4 will be closely (if not exactly synchronised).

• A waveform viewer 230 which represents a single media file in a single clip timeline illustrating the audio waveform of the media element that is currently active in the viewing window 206. This can be a useful visual indication of the temporal location of playback of the specific media file that is active in the viewing window, and includes a current time indicator 231 showing temporal location of the currently visible frame in the active clip.

• Audio meters 234 indicating audio levels of the active clip.

[0081] The present GUI 200 is adapted for use as part of a near real time playout system (e.g. a replay system). In this example the near-real-time functionality can be implemented as a mode of use within an editing page of an NLE. Activation of this mode is triggered by a user, e.g. by pressing a Ul interface button being icon 214. When in this mode the Ul may be adapted in certain ways to facilitate its use.

[0082] First, because there is real-time action being captured (or created in the case of animation or gaming content) new media content will be being written to at least one of the media files in media bin 202. In order to indicate this, the GUI can be adapted to show an indicator of the writing status of the media in the media bin 202. Such an indicator may be provided in both in the viewer window 206 and the media bin 202. In this regard each of the media content elements 210.1, 210.2, 210.3, 210.4 in media bin 202 are marked with a red indicator (e.g. 212) in one corner to indicate that the corresponding file is still being written to the storage system. A similar indicator 213 can also be provided in viewer window 206. The viewing window may be configured to play back the "live" view of the media files in the media bin as they are captured, that is, the viewing window 216.1 to 216.4 corresponding to each media content element 210.1, 210.2, 210.3, 210.4 can be showing the newest media content that is being written to said media file in the data storage system by the media source.

[0083] Next GUI 200 also includes playout controls 220. The playout controls can include a "cue" trigger button 226 that is used when setting up the next video stream to be played back. The "run" trigger button 222 is used to activate playout of the cued video stream on the system output. Finally a "dump" button 224 trigger is provided to stop playout of video stream on the system output. The dump button may cause an instant stop to playback, but it may be preferable for the "dump" trigger to either cause playback to stop at the next appropriate spot to minimise the chance of a harsh cut being played to air via the output. E.g. the "dump" trigger may cause playback to stop at the next edit or transition or the like. In other examples the "dump" button may cause the immediate insertion of a transition such as a fade or the like and then cease playback after the transition.

[0084] In many cases in which live or near-live video production is used multiple sources of media may be generating video files for use at the same time. For example, broadcasting live events (e.g. sport, public events, concerts or the like) may have multiple cameras (e.g. 110A and HOB of figure 1) capturing a scene from different angles, e-sports may have in-game virtual cameras providing media feeds, while real-world cameras may also provide feeds showing the competitors and their reactions. The interface of Figure 2 is specifically adapted to enable use of media files from multiple sources.

[0085] In Figure 2 the viewer window 206 is shown in a multiple source viewing mode. In this mode, all clips in the media bin 202 are played back with reference to a common time clock. Typically the common clock will be the time of day clock of the computer system running the non-linear editing application, but may be a clock generated or used by another connected device. At any given instant the viewer window 206 will display a view of all extant clips i.e. all media files in the media bin that have media content at that instant. To do this the viewer window in dynamically divided into portions to display all available clips. Turning to figure 2, the media bin 202 incudes 4 media files

210.1, 210.2, 210.3, 210.4 which correspond to media files that are each storing an output from one of 4 cameras (camera 1... camera 4). At the time shown in figure 2 clip 210.4 has been selected and is active, this is denoted by its red border. This clip is displayed in the bottom right portion of the viewer window as view 216.4. Its audio waveform is shown in the waveform viewer 230. The specific time instant of the frame shown in the view 216.4 is indicated at point 231 in the waveform viewer window 230. A time code 250.4 corresponding to this instant is also shown on the clip 216.4. The views shown of each of the media files 210.1, 210.2, 210.3, 210.4 may be the live feed from the respective camera, in which case the time code 250.4 will be the time code of the most recent frame of media received for that camera.

[0086] At the time indicated at the instant indicated in the time code 250.4 there are 3 additional media files 210.1, 210.2, 210.3 from the media bin 202 which have media contents. Views of these media files 210.1, 210.2, 210.3 are provided in respective portions of the viewer window 206 as clips

216.1, 216.2, 216.3. These clips each display their time codes 250.1, 250.2, 250.3. As can be seen they are essentially synchronised (within a frame of each other). In use, when any of the files 210.1,

210.2, 210.3, 210.4 are played in the viewer, all of the extant clips 216.1, 216.2, 216.3, 216.4 are played in their portion of the viewer in a synchronised fashion. Moreover when a user scrolls forward or backwards through the clips 216.1, 216.2, 216.3, 216.4 e.g. using a scroll wheel on a control panel 1014 as described below all of the extant clips 216.1, 216.2, 216.3, 216.4 are scrolled together. If a different time instant was chosen in the active clip and one of the files 210.1, 210.2, 210.3 either did not exist or had no content at that point in time, that file would not be shown.

Conversely if an additional clip did exist, it would be added to the viewer window 206. In either case the viewer window may be automatically reconfigured to view all clips with optimal size.

[0087] As described a viewing time on the common clock is determined by a user's action (e.g. selection) in the viewer window 206 and the state of all available clips at that viewing time have the same action performed in them.

[0088] In some situations a user will wish to mark a point of interest in a clip. This can be done by a user making an input (e.g. mouse click, or key press on a control panel 1014) to mark the point of interest (POI) when it is shown in the viewer window. The POI mark (e.g., 400 as shown in figure 4) is set relative to the common time clock in the selected media file. In multiple source mode, the same point of interest relative to the common time clock is also set in the other extant media files. If at a later time additional files are added to the media bin, which when synchronised with the common time clock, did exist at the POI the same POI may be marked on that media file.

[0089] Because speed can be crucial in situations where near-real-time playout systems, such as when replay systems are used, embodiments of the present disclosure enable generation and playback of replays in various ways, some of which will be described below. Various embodiments may support only one, some or all of the following modes of operation.

[0090] Playout without using the timeline

[0091] In one mode of operation, called herein "playout without using the timeline", media to be played-out in a video stream are not first sent to the timeline for editing. Instead a user may simply select a media element from the media bin 202, and identify a start point within the media file, and then trigger play out with the "run" button 222. Figure 2 illustrates a state of the GUI 200 in which a user may perform this process.

[0092] First the user has selected file indicated by icon 210.4 within the media bin 202. The media bin 202 indicates by the red icon in the top right corner of the thumbnail of media file 210.4 that the corresponding file is being written to the storage system. Selection of the clip 210.4 is indicated by the presence of the red outline 215 on the clip icon 210.4. The viewer window also shows a viewing box (or pane) 216.4 showing the same clip selected. Again it has a red box around it indicating to the user it's selection. Selection of the media file (which represents "camera 4") 216.4 also means that the waveform viewer 230 shows the corresponding waveform of the selected clip. [0093] From this position the user can scrub through an active clip 216.4 to find a point from which the media file will be played out on the output. The current frame being shown in the viewer window box 216.4 is indicated by the indicator 231. In multiple source mode, all other extant clips 210.1, 210.2, 210.3 displayed in their respective portions 216.1, 216.2, 216.3 of the viewing window 206 will scroll simultaneously with the active clip 216.4. The time position of the current set of synchronised frames being shown in the viewer window boxes 216.1, 216.2, 216.3 216.4 is indicated by the indicator 231 in the waveform viewer 230. Once the correct point in time to begin playback is identified the user can trigger playout of the selected media file on said video output by activating the "Run" button 222.

[0094] Once the "Run" button 222 is used as a playback trigger to start play out of the media file 210.4 in the video stream on the output, the GUI switches to the mode shown in figure 3. The GUI 200 shown in figure 3 is the same as in Figure 2 and common features have the same reference number. However the GUI now displays an indicium that is activated to show that playout of a video stream is in progress. This takes the form of a red highlight bar 300. The on play out indicator 300 also assists in highlighting the active parameters of play out. First the "Dump" button 224 to trigger stopping of the playout is made active. The speed of playout is indicated at 302. This is represented as a percentage of normal playback speed of the active clip 216.4. Also a clip duration, or time to play indicator 304 is provided. This indicates how long the current clip will play until no more media is remaining. It should be noted that it may not be intuitive to the user how much time is remaining during playback because this time is calculated from a combination of the following factors: a) Whether or not new media is currently being written to the file being played; b) The speed of playback indicated at 302; and c) The position of the playback start point relative to the end of the clip when play out was started.

[0095] Once play out is active, it is possible for a user to change the content of the play out from the NLE. For example the user may cue additional media files for subsequent play out, switch to a new media file for playout, add transitions on these changes and the like.

[0096] In one form, the user may simply activate a different clip shown in the viewer, e.g. by selecting it with a pointer device or pressing the appropriate button(s) on an input device 1014, as will be described below in connection with figure 7. The form of the transition between these clips may be predetermined or user selected.

[0097] Playout using the timeline [0098] In another mode of operation, called herein "playout using the timeline", a playout sequence is created in a timeline prior to the media project represented in the timeline being played-out in a video stream on the system's output 1025.

[0099] In this mode of operation the first step is the selection of a segment of a media file to include in the timeline.

[0100] In a first example, a Point of interest (POI) is used to select a portion of a media file for insertion in the timeline 204. With reference to figure 4, the process may begin by selecting a media file (e.g. 216.4) to be the active clip, as discussed above. While the selected clip 210.4 is playing in viewer window portion 216.4 all other extant clips (e.g., 216.1, 216.2, 216.3) may also be played in the viewing window 206. This may be in real time, but optionally may occur during later playback or scrubbing through the media file. As described above, a point of interest (POI) to the user can be marked 400. That is, the viewing window 206 may preview one or more clips 216.1, 216.2, 216.3, 216.4, including in real time or near real time, as new media content is being respectively written to one or more of the corresponding media files 210.1, 210.2, 210.3, 210.4, and a POI can be marked.

[0101] The POI can be used by the operator as an indicator of a location in the media file at which an event occurred. The POI can be used as a navigation aid for the operator to add in and out points around the POI, to allow a portion of the media file so marked to be inserted into the timeline. As noted above, in multiple source display mode the POI mark 400 is set relative to the common time clock in the selected media file 210.4 and the same point of interest relative to the common time clock is also set in the other extant media files.

[0102] In another embodiment a predetermined portion of the selected media file proximate to the POI can be added to the timeline by an insertion action. The predetermined portion can be a clip of fixed or user-selected length of time with a fixed or user selected temporal location relative to the POI. For example a clip of x seconds with the POI at its centre may be inserted by the user performing an insertion action. The insertion action may be clicking a Ul button using a pointer device (e.g. mouse) or by using a predetermined action on an input device 1014. Several examples will be described below in connection with figure 7.

[0103] Additional portions of the same or different media files can also be inserted using any of these same mechanisms. In one embodiment an insertion action can be defined which causes insertion of a corresponding portion of a second media file into the timeline, adjacent to a previously inserted portion of a media file. Advantageously, because in multiple source a POI has been set with respect to all extant media files at the time of the POI, the same insertion action can be performed on more than one media file to insert corresponding clips (that were simultaneously captured, and stored in different media files) of the same event. E.g. in a sports broadcast a clip of the same event (e.g. a goal) may be caught on several cameras, by setting a POI on the goal in one camera's media file, a playout sequence can easily be created in a timeline showing the goal from different angles. The user inserts a clip of x seconds around the POI from camera 1 that shows the goal, then switches camera and goes back to the POI (which is set at the same time in a second camera's media file) and performs the same insertion action to append a view of the same goal into the timeline.

[0104] Figure 5 illustrates a timeline 204 and 204.1 in which 3 portions of media files have been inserted into the timeline to form a playout sequence. The top timeline 204.1 which shows the entire playout sequence includes three portions of media files 502.1, 502.2 and 502.3. As can be seen in the top timeline 204.1 the clips 502.1, 502.2 and 502.3 are all of different durations. The lower timeline has a different timescale to the first and as such only part of two of the media clips 502.2 and 502.3 are visible.

[0105] When the user presses the "run" button 222 playout of the timeline 204/204.1 on the output 1025 occurs, the clips 502.1, 502.2 and 502.3 may be arranged on the timeline with user selected or default transitions between them, such as dissolves or fades to, or the like. When the run button 222 is pressed and playout is active, the playout operates as discussed in connection with figure 3, namely the GUI switches to the mode shown in figure 3. The GUI now displays an indicium that is activated to show that playout of a video stream is in progress. This takes the form of a red highlight bar e.g. 300. The play out indicator 300 also assists in highlighting the active parameters of play out. First the "Dump" button 224, that can be used to trigger stopping of the playout is made active. The speed of playout is indicated at 302. This is represented as a percentage of normal playback speed of clip being played. Also a playout duration, or time to play indicator 304 is provided.

[0106] Figure 6 illustrates another example of a timeline 204 and 204.1 in which 2 portions of media files have been inserted into the timeline to form a playout sequence. The top timeline 204.1 which shows the entire playout sequence includes two portions of media files 602.1, 602.2. The lower timeline has a different timescale to the first but shows the same two of the media clips 602.1 and 602.2. As can be seen the portions of the media clips 602.1, 602.2 inserted into the timelines are of the same duration as each other. As noted above this may advantageously result from a selection method that causes insertion of corresponding portions (e.g. same duration and same time code) of a second media file into the timeline, adjacent to a previously inserted portion of a media file. Transitions between clips and playback can generally operate as described in other examples.

[0107] When the user presses the "run" button 222 playout of the timeline 204/204.1 on the output

1025 occurs, the clips 602.1 and 602.2 may be arranged on the timeline with user selected or default transitions between them, such as dissolves or fades to, or the like. When the run button 222 is pressed and playout is active, the playout operates as discussed in connection with figure 3, namely the GUI switches to the mode shown in figure 3. The GUI now displays an indicium that is activated to show that playout of a video stream is in progress. This takes the form of a red highlight bar e.g. 300. The play out indicator 300 also assists in highlighting the active parameters of play out. First the "Dump" button 224, that can be used to trigger stopping of the playout is made active. The speed of playout is indicated at 302. This is represented as a percentage of normal playback speed of clip being played. Also a playout duration, or time to play indicator 304 is provided.

[0108] After creation of a timeline a new event may occur in the action being captured that the operator would like to create a playout sequence for. In this case it is necessary to either delete the current timeline or create another. In one embodiment a new timeline can be created by a user input, such as pressing a key in an input device 1014, a keyboard shortcut or menu selection or the like. When this is done the previous timeline is closed. Each timeline may be automatically saved to a file with a system -defined name so as to not distract the operator with naming while media is still being captured. The system defined name may be any string of characters, but may advantageously be a user selected name (e.g. the overall project name) with an incrementing alphanumerical value appended to it.

Add to timeline mode

[0109] A further method of generating a playout sequence may also be provided, this is a combination of the "Playout without using the timeline" and "Playout using the timeline" possibilities described above. In this mode the NLE begins operating as described in connection with "Playout without using the timeline", except that the "Add to timeline" toggle switch 650 has been made active. In this mode the operator may (as disclosed in connection with figure 2) select a media element from the media bin 202, and identify a start point within the media file, and then trigger play out with the "run" button 222. They can also playout other clips, stingers or the like, modify playout speed etc. to create and playout a playout sequence in real time (or near real time) as it is being output as describe elsewhere herein.

[0110] To end playout the user hits the "Dump" button 224 to trigger stopping of the playout. When "Add to timeline" toggle switch 650 is activated, the Dump button not only triggers to stopping of playback on the video output, but also triggers the creation of a media project in the timeline representing all of the actions performed by the user during play out. This enables the same playout sequence to be replayed (e.g. using the "Playout using the timeline" process), or saved for refinement by editing in the timeline. The timeline can also be rendered as a conventional NLE output.

[0111] Figure 7 illustrates an input device 1014 usable with embodiments of the present disclosure. The input device is similar to editing keyboards or editing control panel such as the Davinci Resolve Speed Editor. The input device 1014 includes a series of keys which when operated in a particular manner interact with the NLE software and cause predefined actions to occur. It also includes: an input wheel 702 that can be used as a jog/shuttle input in certain contexts; a slider control 704 that is primarily used as a playout speed control.

[0112] The operation of some controls, e.g. keys are context sensitive. For example, some keys will have multiple modes of operation that are selected by pressing one or more other keys, some keys have different actions with single or multiple presses. Some keys actions are momentary and only active while pressed, others have actions that are turned on or off by a press.

[0113] The operation of selected controls on the control panel 1014 will now be described in the context of the example interface operations described above. Other actions and operations are also possible.

[0114] "New timeline" 706 - when pressed this button causes a new timeline to be created as discussed above. The old timeline that is replaced by the new is saved.

[0115] "Live speed" 708 enables the slider control 704 and alters the play speed of a clip to a user- defined speed.

[0116] "in" and "out" 710 are used to set in and out points within media files to allow insertion of the selected clip into a timeline.

[0117] The group of buttons 712 are used to set editing behaviours on the timeline, i.e. what point of a clip is edited and how the edit behaviour works. Actual changes in clip end points can be controlled by rotating the scroll wheel 702.

[0118] Button group 714 are used to set a transition type between clips in the timeline or while switching clips during playout directly from the viewer 206 (without an active timeline).

[0119] STOP/PLAY button 716, plays and stops playback of a clip on a viewer window.

[0120] CUE, RUN, DUMP (KILL on double press) are equivalent to the GUI buttons 220 with the same names 226, 222, 224.

[0121] SLOW, JOG and SCRL buttons 720 modulate what behaviour the scroll wheel 702 has. [0122] SOURCE, TIMELINE buttons 722 allow a user to select what mode of replay is active. If "source" is selected direct play out of a media file from the viewer 206 will occur, and if "timeline" is selected a playout sequence will be created in a timeline 204 and playout of the timeline is performed.

[0123] Buttons 724, "MULTI SRC" or "SINGLE CLIP" are used to set the mode of display in the viewing window 206 of the GUI. The operation of Multi source viewer and creation of a playout sequence using it may be as described above in respect of multiple extant clips (e.g., 216.1, 216.2, 216.3, 216.4) from respective sources.

[0124] "SET POI (CLEAR POI ON DOUBLE PRESS)", "GO TO POI" 726 are used to set a POI in a media file (or clear it), and to quickly navigate back to the POI for selection of a clip when making a playout sequence.

[0125] Bank of buttons "CAM 1" ... "CAM 8" 728 are used to select which media file (each of which notionally represents a camera feed) is active, or selected. In systems with more cameras, (up to 16 cameras can be accommodated) the range of camera numbers activated by the CAM buttons 728 are modulated by the "Cam 9-16" button in the row above.

[0126] Title buttons (and Stinger buttons) 730 are user to insert pre-stored title and stinger sequences.

[0127] "2 Sec (20%)" ... "7 Sec (70%)" buttons 732 indicate predetermined clip durations for insertion into a playout sequence, or the length of a clip to directly play out when the timeline is not in use. As discussed in connection with figure 5 each button selects a portion of the selected media having a duration determined by the button pressed. When using direct playout without using the timeline in multiple source mode, buttons 732 may also be used. In this case, if a POI has been set and "RUN" has been activated so that media from a given media file (e.g. Camera 1) is being played out, the operator may switch playout to part of a media file corresponding to a different camera. To do this a duration key 732 is held down or pressed (e.g. "5 sec") then the camera button corresponding with the desired media file is pressed. This switches the playout to the chosen camera's media file and begins play out from 5 seconds before the POI. This can be repeated to switch to further views of the POI captured in other media files from other cameras or with different start points.

[0128] The second function of these keys (denoted by % values) can be used to make a temporal selection of the clip about a POI, specifically denoting the temporal location of the POI in the clip, or as playback speed set points.

[0129] It is useful to describe a use of some of these functions in relation to an example. For example when a playout sequence is being created in a timeline of the GUI 200, and a user sees an action in the active media file (e.g. on camera 4 - as shown in the examples above) which they wish to add to the playout sequence in the timeline the operator may take the following actions using the control panel 1014. The user first scrolls back through the active clip using the scroll wheel 702. When the action of interest is shown in the viewing window 206 the user pressed the "set POI" button 726. This sets the POI in the active clip at the current time point being viewed. The user can then optionally press (or hold) the appropriate a duration button 732 then the selected camera button 728 to indicate which media file they wish to take a clip, If the duration button 732 is pressed a clip of the selected duration is inserted into the timeline 204, if no duration is selected a media clip of predetermined length may be inserted into the timeline 204. The clip that is inserted will be temporally arranged with respect to the POI so that it is at a predetermined position. In one embodiment the POI is at the middle of the clip inserted in the timeline 204. Further clips from the same or different media files (i.e. camera feeds) can be added to the sequence in a similar fashion or using any of the other techniques discussed herein.

[0130] To play out a playout sequence so created the user can then press the RUN button 718, to activate play out of the timeline to the video output.

[0131] Figure 8 provides a block diagram that illustrates one example of a system 1000 as illustrated in figure 1. Computer system 1000 includes a bus 1002 or other communication mechanism for communicating information, and a hardware processor 1004 coupled with bus 1002 for processing information. Hardware processor 1004 may be, for example, a general-purpose microprocessor, a graphics processing unit, FPGA, ASIC or other type of processing unit, or combinations thereof.

[0132] Computer system 1000 also includes a main memory 1006, such as a random access memory (RAM) or other dynamic storage device, coupled to bus 1002 for storing information and instructions to be executed by processor 1004. Main memory 1006 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 1004. Such instructions, when stored in non-transitory storage media accessible to processor 1004, render computer system 1000 into a special-purpose machine that is customized and configured to perform the operations specified in the instructions.

[0133] Computer system 1000 may further include a read only memory (ROM) 1008 or other static storage device coupled to bus 1002 for storing static information and instructions for processor 1004. A storage device 1010, such as a SSD, magnetic disk, optical disk or other storage medium, or array of such media, may be provided and coupled to bus 1002 for storing information and instructions including the media files, descriptor files and applications as discussed described above.

[0134] The computer system 1000 may be coupled via bus 1002 to a display 1012 (such as an one or more LCDs, LEDs, touch screen displays, or other displays) for displaying information to a computer user, such as the graphical user interface described and illustrated above. An input device 1014, including alphanumeric and/or other keys, may be coupled to the bus 1002 for communicating information and command selections to processor 1004. In some embodiments the input device 1014 may be an editing control panel such as a Davinci Resolve Speed Editor or similar device such as that that illustrated in figure 7. Another type of user input device is cursor control 1016, such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor 1004 and for controlling cursor movement on display 1012.

[0135] According to at least one embodiment, the techniques herein are performed by computer system 1000 in response to processor 1004 executing one or more sequences of one or more instructions contained in main memory 1006. Such instructions may be read into main memory 1006 from another storage medium, such as storage device 1010, 1060 or other system such as a remote database. Execution of the sequences of instructions contained in main memory 1006 causes processor 1004 to perform the process steps described herein. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions.

[0136] Computer system 1000 may also include a communication interface 1018 coupled to bus 1002. Communication interface 1018 provides a two-way data communication coupling to a network link 1020 that is connected to communication network 1050. For example, communication interface 1018 may be an integrated services digital network (ISDN) card, cable modem, satellite modem, etc. As another example, communication interface 1018 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN. Wireless links may also be implemented. In any such implementation, communication interface 1018 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information. In embodiments in which the computer system is (or forms part of) a media processing appliance the communications interface 1018 and consequently network link 1018 may be adapted to operate according to a network protocol specialise for media transmission such as HDMI, SDI or other SMPTE standard.

[0137] The computer system 1000 may additional be connected to an external storage system 1060 e.g. via the network link 1020 (and optionally network 1050). The external storage system may be an external disk, or array of storage media, network attached storage, SAN or other large scale data storage which may be accessed via a network or communications connection.

[0138] The terms "storage media" or "storage medium" as used herein refers to any non-transitory media that stores data and/or instructions that cause a machine to operate in a specific fashion. Such storage media may comprise non-volatile media and/or volatile media. Non-volatile media includes, for example, optical or magnetic disks, such as storage device 1010, and storage devices forming parts of external storage system 1060. Volatile media includes dynamic memory, such as main memory 1006. Common forms of storage media include, for example, a floppy disk, a flexible disk, hard disk, solid state drive, magnetic tape, or any other magnetic data storage medium, flash memory, a CD-ROM, any other optical data storage medium, any physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, NVRAM, any other memory chip or cartridge.

[0139] Any definitions expressly provided herein for terms contained in the appended claims shall govern the meaning of those terms as used in the claims. No limitation, element, property, feature, advantage or attribute that is not expressly recited in a claim should limit the scope of the claim in any way.

[0140] As used herein the terms "include" and "comprise" (and variations of those terms, such as "including", "includes", "comprising", "comprises", "comprised" and the like) are intended to be inclusive and are not intended to exclude further features, components, integers or steps.

[0141] For aspects of the disclosure that have been described using flowcharts, a given flowchart step could potentially be performed in various ways and by various devices, systems or system modules.

A given flowchart step could be divided into multiple steps and/or multiple flowchart steps could be combined into a single step, unless the contrary is specifically noted as essential. Furthermore, the order of the steps can be changed without departing from the scope of the present disclosure, unless the contrary is specifically noted as essential.

Claims

1. A media editing system comprising: a computer system in data communication with a data storage system storing a plurality of media files containing a time sequence of media content, said computer system including: a data processing system arranged to execute software instructions; a memory storing instructions which when executed by the data processing system is configured to provide a non-linear editing application, said non-linear editing application being arranged to provide a user interface simultaneously including: a media bin for displaying indicia representing one or more respective media files that may be included in a media project; a timeline in which media files represented in the media bin can be arranged and edited to create a media project; a viewing window in which media files in the media bin may be played back; wherein the non-linear editing application provides a multiple source viewing mode in which the user interface is configured to display one or more media files in the viewing window, wherein all displayed media files are displayed relative to a common time clock, and wherein all media files in the media bin that have media content at a given instant on the time clock are simultaneously displayed in a respective portion of the viewing window.

2. The media editing system of claim 1 wherein in the multiple source viewing mode the non-linear editing application is further configured to enable synchronised scrolling through all clips displayed in the viewing window.

3. The media editing system of any one of the preceding claims wherein in the multiple source viewing mode the non-linear editing application is further configured to enable selection of one of the media files displayed in the viewing window.

4. The media editing system of claim 3 wherein in the multiple source viewing mode the non-linear editing application is further configured to enable marking of a point of interest relative to the common time clock in a selected media file.

5. The media editing system of claim 4 wherein in the multiple source viewing mode the non-linear editing application is further configured to mark the same point of interest relative to the common time clock in all media files containing content at the time of the point of interest.

6. The media editing system as claimed in any one of the preceding claims wherein the non-linear editing application is further configured to enable insertion of a clip from one of said media files into said timeline based on said point of interest.

7. The media editing system as claimed in claim 6 wherein in the multiple source viewing mode the non-linear editing application is further configured to enable insertion of a corresponding clip from another one of said media files into said timeline based on said same point of interest.

8. A media editing system of any one of the preceding claims wherein the computer system further includes a video output on which a video stream can be played to a connected device; and wherein the non-linear editing software is configured to cause playout of a video stream including a portion of at least one of said media files on said video output, while new media content is being written to said media file in the storage system by a media source.

9. A media editing system as claimed in any one of the preceding claims wherein the non-linear editing software is configured to playout said video stream prior to generation of a final media file representing a media project in the timeline.

10. A media editing system as claimed in any one of claims 8 or 9 wherein the video stream plays out the media project represented in the timeline.

11. A media editing system as claimed in any one of claims 1 to 10 wherein the media project in the timeline includes at least two media files arranged and edited to create a media project; and wherein at least one of said media files included in the media project is still having new media content being written to said media file in the storage system by a media source.

12. A media editing system as claimed in any one of claims 8 to 11 wherein the system includes a playback trigger to cause play out on the video output.

13. A media editing system as claimed in any one of claims 8 to 12 wherein the system includes a stop trigger to stop playback on the video output.

14. A media editing system as claimed in any one of claims 8 to 13 wherein the non-linear editing software includes a playout speed control that causes a change of playout speed of a video stream wherein said playout speed control is operable during playout on the video output.

15. A media editing system as claimed in any one of claims 8 to 14 wherein the non-linear editing software includes in its graphical user interface any one or more of the following: an indicia that is activated when playout of a video stream is in progress; an indication of a total playout time of a project in a timeline; an indication that a media file in the media bin is having new media content written to it in the storage system by a media source; an indication that a media file displayed in said viewing window is having new media content written to it in the storage system by a media source.

16. A media editing system as claimed in any one of claims 1 to 15 which further includes an editing controller comprising a user interface including one or more buttons and at least one variable input control, said variable input control being selected from a list comprising: a manual slider, manual control wheel; rotary input controller; or a representation of any one or more of the foregoing on a touchscreen.

17. A media editing system as claimed in any one of the preceding claims wherein the multiple source viewing mode is activated or deactivated by a user input.

18. A method in a non-linear editing system comprising: providing a graphical user interface simultaneously showing: a media bin for displaying indicia representing one or more media files that may be included in a media project; a timeline in which media files represented in the media bin can be arranged and edited to create a media project; a viewing window in which media files in the media bin may be played back; operating the non-linear editing application in a multiple source viewing mode comprising: displaying one or more media files in the viewing window, wherein all displayed media files are displayed relative to a common time clock, and wherein all media files in the media bin that have media content at a given instant on the time clock are simultaneously displayed in a respective portion of the viewing window.

19. The method as claimed in claim 18 which further includes: receiving a user input to scroll through one of said simultaneously displayed media items; and performing synchronised scrolling through all clips displayed in the viewing window.

20. The method as claimed in claim 18 or 19 which further includes: receiving a user input to mark a point of interest relative to the common time clock in a selected media file.

21. The method as claimed in claim 20 which further includes marking the same point of interest relative to the common time clock in all simultaneously displayed media files.

22. The method as claimed in any one of claims 20 or 21 which further includes responsive to a user input, inserting of a clip from one of said media files into said timeline based on said point of interest.

23. The method as claimed in claim 22 which further includes responsive to a user input, inserting a corresponding clip from a simultaneously displayed media file into said timeline based on said same point of interest.

24. A method as claimed in any one of claims 18 to 23 which further includes playing a video stream on a video output including media content from at least one media file displayed in said media bin; while new media content is being written to at least one of said media files displayed in said media bin.

25. The method of claim 24 wherein said playing out said video stream occurs prior to generation of a final media file representing a media project in the timeline corresponding to the video stream.

26. The method of claim 24 wherein the video stream corresponds to a media project represented in the timeline.

27. A method as claimed in any one of claims 24 to 26 which further includes receiving a user input indicating a change in a play out speed of the video stream during play out, and changing the play out speed of the media stream accordingly.

28. A method as claimed in any one of claims 18 to 27 which further includes displaying any one or more of the following features on the graphical user interface: an indication that playout of a video stream is in progress; an indication of a total playout time of a project in a timeline and/or a video stream currently being played out; an indication that a media file in the media bin is having new media content written to it in a storage system by a media source; an indication that a media file displayed in said viewing window is having new media content written to it in a storage system by a media source.

29. A method as claimed in any one of claims 18 to 28 which further includes receiving a user input activating or deactivating said multiple source viewing mode.

30. Non-transitory computer readable storage, storing instructions that, when executed by a computer processor, cause the computer processor to perform the method of any one of claims 18 to 29.

31. A software product including a computer readable medium storing instructions which when executed by a processor provide a non-linear editing application, wherein the non-linear editing application includes a user interface simultaneously including: a media bin for displaying indicia representing one or more respective media files that may be included in a media project; a timeline in which media files represented in the media bin can be arranged and edited to create a media project; a viewing window in which media files in the media bin may be played back; wherein the non-linear editing application provides a multiple source viewing mode in which the user interface is configured to display one or more media files in the viewing window, wherein all displayed media files are displayed relative to a common time clock, and wherein all media files in the media bin that have media content at a given instant on the time clock are simultaneously displayed in a respective portion of the viewing window.

32. A media playout system comprising: a computer system in data communication with a data storage system, said computer system including: a data processing system arranged to execute software instructions; a memory storing instructions which when executed by the data processing system is configured to provide a non-linear editing application, said non-linear editing application being configured to provide a user interface including: a media bin for displaying indicia representing a respective media file, containing media content, that may be included in a media project; a timeline in which media files represented in the media bin can be arranged and edited to create a media project; a viewing window in which media files in the media bin may be played back; a video output on which a video stream can be played to a connected device; wherein the non-linear editing application is configured to cause playout of a video stream including a portion of at least one of said media files on said video output, while new media content is being written to said media file in the data storage system by a media source.

33. A media playout system as claimed in claim 32 wherein the non-linear editing application is configured to playout of a video stream including a portion of at least one of said media files on said video output, while new media content is being written to said media file in the storage system by a media source, prior to generation of a final media file representing a media project in the timeline.

34. A media playout system as claimed in claim 33 wherein a media project in the timeline includes least two media files arranged and edited to create a media project; and wherein at least one of said media files included in the media project is still having new media content being written to said media file in the storage system by a media source.

35. A media playout system as claimed in any one of claims 32 to 34 wherein the system includes either or both of: a playback trigger to cause play out of the video output; a stop trigger to stop playback on the video output.

36. A media playout system as claimed in any one of claims 32 to 35 wherein the non-linear editing application includes a playback speed control that causes a change of playout speed of a video stream wherein said playback speed control is operable during playout.

37. A media playout system as claimed in any one of claims 32 to 36 wherein the non-linear editing application includes in its graphical user interface any one or more of the following: an indicia that is activated when playout of a video stream is in progress; an indication that a media file in the media bin is having new media content written to it in the storage system by a media source;

38. A media playout system as claimed in any one of claims 32 to 37 which further includes an editing controller comprising a user interface including one or more buttons and at least one variable input control, said variable input control being selected from a list comprising: a manual slider, manual control wheel; rotary input controller; or a representation of any one or more of the foregoing on a touchscreen.

39. A media playout system as claimed in any one of claims 32 to 38 wherein the viewing window displays a live view of a media file in the media bin showing new media content that is being written to said media file in the data storage system by a media source.

40. A method in a non-linear editing system, said non-linear editing system comprising, a computer system in data communication with a data storage system storing media files thereon, said method comprising: providing a graphical user interface for the non-linear editing system simultaneously showing: a media bin for displaying indicia representing one or more media files that may be included in a media project; a timeline in which media files represented in the media bin can be arranged and edited to create a media project; and a viewing window in which media files in the media bin may be played back; and causing playout of a video stream including a portion of at least one of said media files on said video output while new media content is being written to said media file in the data storage system by a media source.

41. The method as claimed in claim 40 wherein playout of said video stream occurs prior to generation of a final media file representing a media project in the timeline.

42. The method as claimed in claim 40 or 41 wherein a media project in the timeline includes at least two media files arranged and edited to create a media project; and wherein at least one of said media files included in the media project is still having new media content being written to said media file in the storage system by a media source.

43. The method as claimed in any one of claims 40 to 42 which further includes one or both of: causing playout of the video stream in response to a user input to trigger playout; and stopping play out of the video stream in response to a user input to stop playout.

44. The method as claimed in any one of claims 40 to 43 which includes: changing a playout speed of the video stream during playout in response to receiving a user speed control during playout.

45. The method as claimed in any one of claims 40 to 44 which further includes displaying any one or more of the following on the graphical user interface: an indication of that playout of a video stream is in progress; an indication of a total playout time of a project in a timeline and/or a video stream currently being played out; an indication that a media file in the media bin is having new media content written to it in a storage system by a media source; an indication that a media file displayed in said viewing window is having new media content written to it in a storage system by a media source.

46. The method of any one of claims 40 to 45 wherein the method includes playing, in the viewing window, a live view of one or more media files in the media bin showing new media content that is being written to said media file in the data storage system by a media source.

47. A non-transitory computer readable medium storing instructions that, when executed by a computer processor, cause the computer processor to perform the method of any one of claims 40 to

46.