JP6851683B2 - Multi-layer image synthesizer - Google Patents

Description

The present invention relates to a multilayer image compositing device for inputting a plurality of images having different expression formats such as radar video and target information into a plurality of image layers and creating a composite image obtained by synthesizing the images of the plurality of image layers.

As a multilayer image synthesizer for inputting a plurality of images having different expression formats such as radar video and target information into a plurality of image layers, a radar video display device is disclosed in Japanese Patent Application Laid-Open No. 7-31155 (Patent Document 1). ing. As shown in FIG. 1, this radar video display device inputs a plot map image and a sweep video into separate image layers, synthesizes the two, and displays the composite image on the CRT.

In the radar video display device disclosed in Patent Document 1, a radar image to be displayed on a CRT is synthesized by a deflection system (3) and a luminance system (4). Patent Document 1 does not describe a specific circuit configuration of the deflection system (3) and the luminance system (4). As an apparatus for synthesizing a plurality of images, for example, an image synthesizing processing apparatus is disclosed in Japanese Patent Application Laid-Open No. 2003-244726 (Patent Document 2). This image composition processing device is a multilayer image composition device that synthesizes an image input to two image layers, one for the right eye and the other for the left eye, and a virtual space image. In this image composition processing apparatus, a graphic board is used for compositing the images input to the two image layers and the virtual space image. The graphic board is also referred to as a video card, a video board, a graphic card, a graphics card, or the like.

Japanese Unexamined Patent Publication No. 7-31155 Japanese Unexamined Patent Publication No. 2003-2442726

FIG. 4 illustrates the configuration of a conventional multilayer image compositing device that uses a graphic board to generate a display image in a radar video display device as in Patent Document 1. The multilayer image compositing device 40 of FIG. 4 has servers SV1, SV2 and SV3, and an image compositing circuit 41. The server SV1 includes a main memory MM1, a CPU1, and a graphic board GB1. The servers SV2 and SV3 have the same configuration as the server SV1.

The main memory MM1 in the server SV1 holds the code and data of the application program executed by the CPU 1, and also holds the image to be displayed on the display 20. The CPU 1 inputs target information, processes the target information by an application program, generates a vector image of the target information, temporarily stores the vector image in the main memory MM1, reads it from the main memory MM1 at a predetermined timing, and then reads the vector image. The vector image is output to the graphic board GB1. A vector image is a type of data that expresses an image, and more specifically, it is data that is expressed as a set of drawing information such as the coordinates of points, the parameters of equations of lines and planes connecting them, and drawing information such as fills and special effects. is there. The CPU 1 supplies vector image data to the graphic board GB1 in the form of a drawing command. The input / output interface between the CPU 1 and the graphic board GB1 is a serial interface called PCIe (Peripheral Component Interconnect Express). The graphic board GB1 inputs a drawing command representing a vector image, performs rasterization processing on the vector image, and converts the vector image into a bitmap image. This bitmap image is supplied to the image synthesis circuit 41 by an interface called DVI (Digital Visual Interface).

The server SV2 operates in the same manner as the server SV1. However, in the server SV2, a radar signal is input to the CPU 2. The radar signal display method is a plan position display PPI (Plan Position Indication). In this display, the target that reflects the radar radio wave is represented by the polar coordinate position. The CPU 2 converts the polar coordinate image into a bitmap image, temporarily stores the bitmap image in the main memory MM2, reads it out from the main memory MM2 at a predetermined timing, and reads the bitmap image data in the form of a bitmap copy command. Supply to the graphic board GB2. The graphic board GB2 copies the bitmap image received by the bitmap copy command to the built-in bit memory and outputs it to the image synthesis circuit 41 as it is.

In the server SV3, the camera image is input to the CPU3. The camera image is a moving image in which data is compressed. Therefore, the CPU 3 decompresses the compressed moving image data, reproduces the original moving image data, and converts the original moving image data into a bitmap image. The CPU 3 temporarily stores the bitmap image in the main memory MM3, reads it from the main memory MM3 at a predetermined timing, and supplies the bitmap image data to the graphic board GB3 in the form of a bitmap copy command. The graphic board GB3 copies the bitmap image received by the bitmap copy command to the built-in bit memory and outputs it to the image synthesis circuit 41 as it is.

The image composition circuit 41 inputs different bitmap images from the three image layers GB1, GB2, and GB3 of the graphic boards, synthesizes them into one image layer, and supplies the composite image to the display 20.

FIG. 5 is a diagram showing a configuration of software 200 executed by CPU1, CPU2, and CPU3 in the multilayer image synthesizer 40 of FIG. The software 200 includes an application program application, a display server 202, a graphic driver 203, and a moving image decoder 101. However, although the target information, the radar signal, and the camera image are shown as input signals in FIG. 5, the target information is input to the application program application only when the software 200 is executed by the CPU 1, and the radar. The signal is input to the application program application only when the software 200 is executed by the CPU 2, and the camera image is input to the moving image decoder 101 only when the software 200 is executed by the CPU 3. That is, the software 200 is installed in the main memories MM1, MM2 and MM3, respectively, and is executed by the CPU1, CPU2 and CPU3, respectively.

The software 200 of FIG. 5 is executed by the CPU 1 of FIG. 4 as follows. At this time, as described above, the target information is input to the application program application of the software 200. The target information is a signal that is detected by a radar and represents information on a target such as an aircraft that is being tracked. Information on targets such as aircraft is information such as direction, distance, speed, altitude, and identification. Based on this information, the application program app generates information on symbols indicating position and identification, readers indicating direction and speed, and data blocks indicating altitude. Information on symbols, readers and data blocks is represented by vector images. Further, Xlib converts the information of these symbols, readers, and data blocks into commands such as character string commands and line commands. Commands such as character string commands and line commands are drawing commands. The drawing command is a command for drawing a line, a circle, or the like by designating XY coordinates. Drawing commands such as character string commands and line commands generated by Xlib are represented by the X protocol and are supplied to the display server 202. The display server 202 outputs drawing commands such as character string commands and line commands to the graphic driver 203 as they are. The graphic driver 203 inputs drawing commands such as character string commands and line commands (drawing commands representing symbols, readers, data blocks, etc.), and converts these drawing commands into dedicated drawing commands that match the specifications of the graphic board GB1. Then, it is supplied to the graphic board GB1.

The software 200 of FIG. 5 is executed by the CPU 2 of FIG. 4 as follows. At this time, as described above, the radar signal is input to the application program application of the software 200. Since the radar signal represents the target reflecting the radar radio wave at the polar coordinate position, the application program app converts the polar coordinate image into a bitmap image, and Xlib converts the bitmap image into a bitmap copy command. The bitmap copy command is supplied to the display server 202 by the X protocol. The display server 202 generates, stores, and supplies the stored bitmap image to the graphic driver 203 based on the input bitmap copy command. The graphic driver 203 inputs a bitmap copy command, converts the bitmap copy command into a dedicated bitmap copy command according to the specifications of the graphic board GB2, and supplies the bitmap copy command to the graphic board GB2.

The software 200 of FIG. 5 is executed by the CPU 3 of FIG. 4 as follows. At this time, as described above, the camera image is input to the moving image recorder 101 of the software 200. The moving image recorder 101 decodes the camera image which is a data-compressed moving image, reproduces the original moving image in the image format of the bitmap image, converts the bitmap image into the bitmap copy command, and converts the bitmap image into the bitmap copy command, and forms the data format of the X protocol. Supply to the display server 202. The display server 202 generates, stores, and supplies the stored bitmap image to the graphic driver 203 based on the input bitmap copy command. The graphic driver 203 inputs a bitmap copy command, converts the bitmap copy command into a dedicated bitmap copy command according to the specifications of the graphic board GB2, and supplies the bitmap copy command to the graphic board GB2.

The conventional multilayer image synthesizer described with reference to FIGS. 4 and 5 is provided with graphic boards GB1, GB2, GB3 corresponding to input information such as target information, radar signal, and camera image, and these graphics are provided. The board creates a bitmap image that represents the input information. The image format of the input image includes a vector image such as target information, a polar coordinate image such as a radar signal, and a moving image such as a camera image. In order to synthesize an image, it is necessary to convert each of these input images having different image formats into a bitmap image and superimpose the image data represented by the bitmap image to generate a composite image. Conventionally, a graphic board has been widely used as a means for creating this bitmap image at high speed. This is because it has been conventionally said that the drawing process of the graphic board is generally faster than the case of relying on software.

However, vector images such as target information, polar coordinate images such as radar signals, moving images such as camera images are input to different layers, and the images of each layer are converted into bitmap images, and these bitmap images are used. There are the following problems to be solved in using a graphic board in an aircraft-mounted display device or the like that synthesizes and displays on one screen, that is, a multi-layer display.
(1) A graphic board with high power consumption generally consumes a large amount of power and cannot be used in a device such as an aircraft-mounted display device that allows only limited power consumption, or its performance is lowered in order to reduce power consumption. I had no choice but to do it.
(2) The life of the model is short. Technological progress is rapid for graphic boards, and the current situation is that the manufacturing period of one model is about two years. In order to stabilize the supply of parts, it is necessary to constantly update to the latest model graphic board. However, since the specifications of the drawing command for driving the graphic board are different for each graphic board, the graphic driver 203 for generating the drawing command needs to be redesigned every time the graphic board is updated.
(3) Architecture-dependent For graphic boards, each supplier uses its own architecture. On the other hand, when trying to perform multi-layer display, it is often necessary to select a graphic board having a specific architecture according to the image format of the input image. Therefore, in a multilayer image synthesizer using a graphic board, the architecture of the graphic board must be considered in the product design of a graphic driver or the like, so that the options for product design are narrowed.
(4) A multi-layer image synthesizer having a graphic board that expands the range of compatible displays can display an image only on a display having a display resolution that the graphic board can support.

Therefore, an object of the present invention is to provide a multilayer image compositing apparatus capable of generating a multilayer image at high speed without using a graphic board in order to solve such a problem.

In order to solve the above-mentioned problems, the multilayer image synthesizer according to the present invention mainly adopts the following characteristic configurations.

(1) The multilayer image synthesizer according to the present invention is
In a multi-layer image synthesizer that synthesizes input multiple-layer images into one layer
When the input image to be combined is referred to as a composition target input image, the composition target input image is processed independently for each layer, and the composition target input image is bitten regardless of the image format of the composition target input image. It is represented by a map image, the bitmap images are temporarily stored in different memory areas in the main memory, the bitmap images temporarily stored in the different memory areas are synthesized by an image synthesis server, and the image synthesis server synthesizes the bitmap images. It is characterized by having an image synthesizing means for storing a composite bitmap image obtained by synthesizing in another memory area in the main memory.
(2) The multilayer image synthesizer according to the present invention is
When the image format of the input image to be synthesized is a vector image, a drawing command generating means for generating a drawing command representing the vector image by processing the vector image and the bitmap image based on the drawing command are generated. The one according to (1) above, wherein the image compositing means has a first virtual display server that is generated and temporarily stores the generated bitmap image in any of the different memory areas. But it may be.
(3) The multilayer image synthesizer according to the present invention is
When the drawing command generating means is target information including the direction, distance, speed, altitude, and identification of the target detected by the radar, the position and the identification are indicated based on the target information. Information on the symbol, the reader indicating the orientation and the speed, and the data block indicating the altitude is generated, and the information on the symbol, the reader, and the data block is represented by a vector image, and the symbol, the symbol, by Xlib (X library). The information of the reader and the data block is converted into a drawing command of a character string command or a line command, and the information is converted into a drawing command.
The first virtual display server generates the bitmap image based on the drawing command, sends the bitmap image to one of the memory areas in the form of a bitmap copy command, and the bitmap is sent to the memory area. The image may be described in (2) above, wherein the image is copied and the bitmap image is temporarily stored in the memory area.
(4) The multilayer image synthesizer according to the present invention is
When the composite target input image is a radar signal representing a target detected by radar radio waves in polar coordinate positions, the polar coordinate image is converted into a bitmap image, and the bitmap image is output as a bitmap copy command by Xlive. A bitmap image generation means and a second virtual display server that inputs the bitmap copy command and temporarily stores the bitmap image in one of the memory areas different from each other based on the input bitmap copy command. , Is described in any one of the above (1) to (3), which is characterized in that the image synthesizing means has.
(5) The multilayer image synthesizer according to the present invention is
When the input image to be synthesized is a camera image that is a data-compressed moving image, the camera image is decoded, the original moving image is reproduced in the image format of the bitmap image, and the bitmap image is copied by the bitmap copy command. A third virtual display in which a video recorder output in the format of (1) and the bitmap copy command are input, and the bitmap image is temporarily stored in any of the memory areas different from each other based on the input bitmap copy command. The server may be described in any one of (1) to (4) above, wherein the image compositing means has a server.

According to the present invention, it is possible to provide a multilayer image compositing device capable of generating a multilayer image at high speed without using a graphic board.

It is a figure which shows the structure of the multilayer image synthesizer which is one Embodiment of this invention. It is a figure which shows the structure of the software executed by the CPU 1 in the embodiment of FIG. It is a figure which shows the structure of the software executed by the CPU 2 in the embodiment of FIG. It is a figure which shows the structure of the conventional multilayer image composition apparatus. It is a figure which shows the structure of the software executed by the CPU in the conventional multilayer image synthesizer of FIG. It is a figure which shows the example of the plurality of images (A, B, C, D) which are in different layers, and the image (E) which combined these a plurality of images into one layer.

Hereinafter, preferred embodiments of the multilayer image synthesizer according to the present invention will be described with reference to the accompanying drawings. It goes without saying that the drawing reference reference numerals attached to the following drawings are added to each element for convenience as an example for assisting understanding, and the present invention is not intended to be limited to the illustrated embodiment. No.

FIG. 1 is a diagram showing a configuration of a multilayer image synthesizer according to an embodiment of the present invention. The multilayer image synthesizer 10 of FIG. 1 has main memories MM1, MM2, MM3, CPU1, CPU2, CPU3, a display circuit 11, a driver circuit 12, and an Ethernet (registered trademark) switch 13.

The main memory MM1 holds the code and data of the application program executed by the CPU 1, and also holds the image to be displayed on the display 20 in the form of a bitmap image. The CPU 1 inputs the target information T1, the radar signal R1, and the camera image V1 as images of different layers. The target information T1 is a signal that is detected by a radar and represents information on a target such as an aircraft that is being tracked. Information on targets such as aircraft is information such as direction, distance, speed, altitude, and identification. In the input target information, information such as these directions is represented by a vector image. The radar signal represents the direction, distance, and intensity of received radio waves of an object such as an aircraft in polar coordinate images. The camera image is a moving image. The CPU 1 converts all of the target information of the vector image, the radar image of the polar coordinate image, and the camera image of the moving image into a bitmap image, and temporarily saves it in the main memory MM1 in the form of a bitmap copy command representing this bitmap image. ..

Similar to the CPU 1, the CPU 2 inputs the target information T2, the radar signal R2, and the camera image V2, converts any of the image data into a bitmap image, and temporarily stores the bitmap image in the main memory MM2. .. Like the CPU2, the CPU3 inputs the target information T3, the radar signal R3, and the camera image V3, converts any of the image data into a bitmap image, and temporarily stores the bitmap image in the main memory MM3. ..

The display circuit 11 informs the CPU 1 of the display timing of the display 20. Upon receiving the display timing, the CPU 1 reads the target information T1 of the bitmap image, the radar signal R1, and the camera image V1, and the bits stored in the main memories MM2 and MM3 for the CPU2 and the CPU3 via the Ethernet switch 13, respectively. Send a command to read the map image. Upon receiving the command, the CPU 2 and the CPU 3 read the target information T2 and T3 of the bitmap image, the radar signals R2 and R3, and the camera images V2 and V3 stored in the main memories MM2 and MM3, respectively, and read them via the Ethernet switch 13. These bitmap images are sent to the CPU1.

The CPU 1 synthesizes the target information T1, T2, T3 of the bitmap image read from the main memories MM1, MM2, MM3, the radar signals R1, R2, R3, and the camera images V1, V2, V3, and sends them to the display circuit 11. The input / output interface between the CPU 1 and the display circuit 11 is a serial interface called PCIe (Peripheral Component Interconnect Express). The driver circuit 12 receives the bitmap image sent from the display circuit 11, generates a bitmap image in a format conforming to the specifications of the display 20, and sends the bitmap image to the display 20. The driver circuit 12 and the display 20 are connected by a DVI (Digital Visual Interface) interface. The display 20 displays a bitmap image obtained by synthesizing the target information T1, T2, T3, the radar signals R1, R2, R3, and the camera images V1, V2, V3.

FIG. 2 is a diagram showing a configuration of software 100 executed by the CPU 1 according to the embodiment of FIG. The software 100 includes application programs apps 1 and 2, a moving image decoder 101, virtual display servers VD1 to VD4, shared memories SM1 to SM4, an image synthesis server 102, and shared memory SM5. The software 100 and the CPU that executes the software 100 correspond to the above-mentioned image synthesizing means. The CPU 1 is composed of four CPU cores, and for example, the application program appp1, the virtual display server VD1, the shared memory SM1, the shared memory SM5, and the image synthesis server 102 are executed by the first CPU core, and the application program appp2 and the virtual display server are executed. The VD2 and the shared memory SM2 are executed by the second CPU core, the virtual display server VD3 and the shared memory SM3 are executed by the third CPU core, and the video decoder 101, the virtual display server VD4 and the shared memory SM4 are executed by the fourth CPU. It may be executed in the core. As will be described later, the shared memories SM1 to SM5 are realized by using the memory area of the main memory MM1.

The application program app1 inputs the target information T1 which is a vector image. The target information T1 is a signal that represents information on a target such as an aircraft that is detected and tracked by a radar, and the information on the target such as an aircraft is information such as direction, distance, speed, altitude, and identification. .. Based on this information, the application program app1 generates information on a symbol indicating position and identification, a reader indicating direction and speed, and a data block indicating altitude. Information on symbols, readers and data blocks is represented by vector images. Further, Xlib (X library) converts the information of these symbols, readers, and data blocks into commands such as character string commands and line commands. Commands such as character string commands and line commands are drawing commands. The drawing command is a command for drawing a line, a circle, or the like by designating XY coordinates. Drawing commands such as character string commands and line commands generated by Xlib are represented by the X protocol and are supplied to the virtual display server VD1. The application program application1 corresponds to the above-mentioned drawing command generation means.

The virtual display server VD1 inputs drawing commands such as character string commands and line commands, calculates bitmap memory addresses one pixel at a time based on these drawing commands, writes color information to each pixel, and creates a bitmap image. Generate. The display server VD1 sends the bitmap image to the shared memory SM1 in the form of a bitmap copy command, copies the bitmap image to the shared memory SM1, and saves the bitmap image. The virtual display server VD1 corresponds to the above-mentioned first virtual display server. The shared memory SM1 is realized as a storage area in the main memory MM1 on the hardware of FIG. The storage areas in the main memory MM1 that realizes the shared memory SM1 correspond to different memory areas in the above-mentioned main memory.

The radar signal R1 is input to the application program app2 of the software 100. Since the radar signal R1 represents a target that reflects radar radio waves in polar coordinate positions, the application program app2 converts the polar coordinate image into a bitmap image, and Xlib converts the bitmap image into a bitmap copy command. The bitmap copy command is supplied to the virtual display server VD2 by the X protocol. The virtual display server VD2 generates a bitmap image based on the input bitmap copy command, copies the bitmap image to the shared memory SM2, and saves the bitmap image. The application program app2 corresponds to the above-mentioned bitmap image generation means. Further, the virtual display server VD2 corresponds to the above-mentioned second virtual display server.

The camera image V1 is input to the moving image recorder 101 of the software 100. The moving image recorder 101 decodes the camera image V1 which is a data-compressed moving image, reproduces the original moving image in the image format of the bitmap image, converts the bitmap image into the bitmap copy command, and performs the data of the X protocol. It is supplied to the virtual display server VD4 in the form. The virtual display server VD4 generates a bitmap image based on the input bitmap copy command, copies the bitmap image to the shared memory SM4, and saves the bitmap image. The virtual display server VD4 corresponds to the above-mentioned third virtual display server.

FIG. 3 is a diagram showing a configuration of software 100A executed by the CPU 2 in the embodiment of FIG. The software 100A includes application programs ap1,2, a moving image decoder 101, virtual display servers VD1, VD2, VD4, shared memories SM1, SM2, SM4, an image synthesis server 102, shared memory SM5, and Ethernet transfer software 103. The software 100A of FIG. 3 lacks the virtual display server VD3 and the shared memory SM3 in the software 100 of FIG. 2, while the Ethernet transfer software 103 is added. The software 100A inputs the target information T2, the radar signal R2, and the camera image V2, processes these inputs in the same manner as the target information T1, the radar signal R1, and the camera image V1 input to the software 100, and inputs them. The corresponding bitmap image is generated and stored in the shared memories SM1, SM2, SM4, respectively. The image composition server 102 synthesizes these bitmap images and temporarily stores the composite bitmap image in the shared memory SM5.

When the display circuit 11 of FIG. 1 transmits the display timing of the display 20 to the software 100 (executed on the CPU 1), the software 100 that receives the display timing transmits the software 100A via the Ethernet switch 13. A command to read a bitmap image stored in the shared memory SM5 is sent to (executed on the CPU 2). The Ethernet transfer software 103 (software that operates the Ethernet switch 13) of the software 100A receives the command and reads out the target information T2, the radar signal R2, and the camera image V2 in the bitmap image format stored in the shared memory SM5. , Sends a bitmap copy command of these bitmap images to the virtual display server VD3 of software 100 via the Ethernet switch 13. The virtual display server VD3 copies the bitmap image represented by the bitmap copy command to the shared memory SM3 and saves it.

As described above, the multilayer image synthesizer software 100A shown in FIG. 3 processes the target information T2, the radar signal R2, and the camera image V2 input to the CPU 2 in FIG. 1 to generate a bitmap image corresponding to the input. Generated and saved the bitmap image in the shared memory SM1, SM2, SM4, respectively, the image synthesis server 102 synthesizes these bitmap images, temporarily saves the composite bitmap image in the shared memory SM5, and saves the composite bit. The map image was sent to the virtual display server VD3 in response to the read command of the software 100 of FIG. Similarly, the software 100A of FIG. 3 processes the target information T3, the radar signal R3, and the camera image V3 input to the CPU 3 in FIG. 1, synthesizes the images of these inputs, and reads out the software 100 of FIG. A composite bitmap image can also be sent to the virtual display server VD3 in response to an instruction. As shown in FIG. 1, the main memory MM and the CPU can be increased to an arbitrary number as the input increases, and the composite input to the Ethernet switch 13 according to the increased number of input information. Since it is possible to increase the number of bitmap images, in the multilayer image synthesizer of the present embodiment, there is no significant limitation on the number of image inputs to be combined, that is, the number of image layers.

For example, it is assumed that the CPU 2 and the CPU 3 of FIG. 1 both execute the software 100A of FIG. At this time, the composite bitmap image of the target information T2, the radar signal R2, and the camera image V2 is stored in the shared memory SM5 (in the software 100A executed by the CPU 2). At the same time, the composite bitmap image of the target information T3, the radar signal R3, and the camera image V3 is stored in the shared memory SM5 (in the software 100A executed by the CPU 3). When configuring such a multilayer image synthesizer, the routes of the virtual display server VD5 and the shared memory SM5 are provided in parallel with the routes of the virtual display server VD3 and the shared memory SM3 in FIG. Then, the synthetic bitmap image of the target information T2, the radar signal R2, and the camera image V2 is processed by the route of the virtual display server VD3 and the shared memory SM3, and the target information T3 and the radar are processed by the route of the virtual display server VD5 and the shared memory SM5. The composite bitmap image of the signal R3 and the camera image V3 may be processed.

Thus, according to the multilayer image synthesizer software 100, 100A of FIGS. 2 and 3, the shared memories SM1 to SM4 of FIG. 2 have target information T1, T2, T3, radar signals R1, R2, R3, and camera image V1. , V2, V3 bitmap images are temporarily saved. The image composition circuit 102 of FIG. 2 reads out the bitmap images stored in the shared memories SM1 to SM4, synthesizes the images, supplies the synthesized bitmap images to the shared memory SM5 in the form of a bitmap copy command, and shares the images. Copy the composite bitmap image to memory SM5. The shared memory SM5 copies and temporarily stores the bitmap image based on the bitmap copy command supplied from the image synthesis circuit 102, and temporarily stores the bitmap image at the display timing of the display 20 received from the display circuit 11. The bitmap image is read out and supplied to the display 20. Like the shared memory SM1, the shared memories SM2 to 5 are also realized as bitmap memories in the storage area in the main memory MM1. The storage area in the main memory MM1 that realizes the shared memories SM2 to 5 corresponds to different memory areas in the above-mentioned main memory, similarly to the shared memory SM1.

FIG. 6 is a diagram showing an example of a plurality of images (A, B, C, D) on different layers and an image (E) in which the plurality of images are combined into one layer. FIG. 6A is an image of a distance circle 50 and a direction line 51 that are displayed semi-fixedly and constantly, FIG. 6B is a diagram of target information shown in real time, and FIG. 6C is a target information for a certain period of time up to the present time. (D) is a diagram showing a radar video represented by a radar signal, and (E) is a diagram showing a composite image obtained by synthesizing the plane images of (A) to (E).

The figures shown in (A) to (E) are represented by bitmap images. In FIG. 6B, reference numeral 52 indicates a new target N. N represents the identification of the target, which means that the detection of the target is new, and the display position of N represents the position of the target. Reference numeral 53 indicates a line called a leader, the length of the line indicates the speed, and the direction of the line indicates the traveling direction. Reference numeral 54 is character information called a data block, and represents a track number, altitude, and the like. Reference numeral 56 indicates some unrecognized target, and reference numeral 55 indicates the expected course of the unrecognized target. In FIG. 6C, reference numeral 57 indicates a large target detected within a certain period of time, and reference numeral 58 indicates a small target detected within a certain time. In FIG. 6D, reference numerals A1 to A6 indicate radar video.

The images of the distance circle 50 and the direction line 51 shown in FIG. 6A are semi-fixed and constantly displayed images, and in the embodiment of the present invention shown in FIGS. 1 to 3, the target information T1 to T3 Similarly, it is input as a vector image and converted into a bitmap image by the multilayer image synthesizer 10 of the embodiment. Reference numerals 52 to 58 in FIGS. 6 (B) and 6 (C) are images of target information, which are input as vector images in the same manner as the target information T1 to T3, and are bitmaps in the multilayer image synthesizer 10 of the embodiment. It is converted into an image. The radar videos shown by the reference numerals A1 to A6 in FIG. 6D are images generated based on the radar signals, and are input as polar coordinate images as in the radar signals R1 to R3, and are the multilayer image synthesizer of the embodiment. It was converted into a bitmap image in 10. As described above, according to the multilayer image compositing device 10 of the present embodiment, images of a plurality of layers having different image formats are input, aligned with the bitmap image format, and the composite image of the bitmap image format is displayed. It can be displayed at 20.

As described in detail above with reference to the drawings, according to the multilayer image compositing apparatus of the present invention, the multilayer image is executed by the software (image compositing means) executed by the CPU without using the graphic board. A multilayer image synthesizer capable of high-speed generation can be provided. As described above, the multilayer image compositing apparatus of the present invention that generates a multilayer image by compositing a plurality of layers of images by software (image compositing means) executed by a CPU without using a graphic board It has the following effects.
(1) Since image composition is performed by a CPU with low power consumption instead of a graphic board with high power consumption, the power consumption is low even with high performance, and it can be mounted on an aircraft.
(2) It is not necessary to redesign the graphic board with a short update period every time the model is changed, and the maintenance cost of the multilayer image compositing device is saved, which is economical.
(3) Since a graphic board that adopts a unique architecture for each supplier is not used, design can be performed without considering the architecture of the graphic board, and product design options are expanded.
(4) A multilayer image synthesizer having a graphic board can display an image only on a display having a display resolution compatible with the graphic board, but the multilayer image synthesizer of the present invention having no graphic board can display an image. Since the display resolution can be arbitrarily designed, the image can be displayed on a display having an arbitrary display resolution.

The configuration of a preferred embodiment of the present invention has been described above. However, it should be noted that such embodiments are merely exemplary of the invention and do not limit the invention in any way. Those skilled in the art can easily understand that various modifications can be made according to a specific application without departing from the gist of the present invention. For example, the input information is not limited to the target information illustrated in FIGS. 1 to 3 and the image information from the radar such as the radar signal and the camera image, but also the image from another sensor such as an infrared sensor is input as an image of one layer. Is possible, and it can be combined with other input images and displayed as a bitmap image.

10, 40 Multi-layer image synthesizer 11 Display circuit 12 Driver circuit 13 Ethernet switch 20 Display 41 Image synthesis circuit 100, 100A, 200 Multi-layer image synthesizer software 101 Video decoder 102 Image synthesis server 103 Ethernet transfer software 202 Display server 203 Graphic driver MM1 to MM3 Main memory app, ap1 to app3 Application program VD1 to VD4 Virtual display server SM1 to SM5 Shared memory T1 to T3 Target information R1 to R3 Radar signal V1 to V3 Camera image GB1 to GB3 Graphic board

Claims (4)

In a multi-layer image synthesizer that synthesizes input multiple-layer images into one layer
When the input image of the plurality of layers to be combined is referred to as a composition target input image, the composition target input image is processed independently for each layer, and the composition is performed regardless of the image format of the composition target input image. The target input image is represented by a bitmap image, the bitmap image is temporarily stored in different memory areas in the main memory, and the bitmap image temporarily stored in each different memory area is synthesized by an image synthesis server. A multilayer image compositing apparatus characterized by having an image compositing means for storing a composite bitmap image obtained by compositing with the image compositing server in another memory area in the main memory.
When the image format of the input image to be synthesized is a vector image, the image synthesizing means includes a drawing command generating means for generating a drawing command representing the vector image by processing the vector image, and the drawing command. A multilayer image compositing apparatus comprising: a first virtual display server which generates the bitmap image based on the above and temporarily stores the generated bitmap image in any of the memory areas different from each other. When the vector image is target information including the direction, distance, speed, altitude, and identification of the target detected by the radar, the drawing command generating means is a symbol indicating the identification based on the target information. The information of the reader indicating the orientation and the speed, the data block indicating the altitude is generated, the information of the symbol, the reader and the data block is represented by a vector image, and the symbol, the reader and the information are represented by Xlib (X library). Convert the information of the data block into a drawing command of a character string command or a line command, and
The first virtual display server generates the bitmap image based on the drawing command, sends the bitmap image to one of the memory areas in the form of a bitmap copy command, and the bitmap is sent to the memory area. The multilayer image compositing apparatus according to claim 1, wherein the image is copied and the bitmap image is temporarily stored in the memory area.
In a multi-layer image synthesizer that synthesizes input multiple-layer images into one layer
When the input image of the plurality of layers to be combined is referred to as a composition target input image, the composition target input image is processed independently for each layer, and the composition is performed regardless of the image format of the composition target input image. The target input image is represented by a bitmap image, the bitmap image is temporarily stored in different memory areas in the main memory, and the bitmap image temporarily stored in each different memory area is synthesized by an image synthesis server. A multilayer image compositing apparatus characterized by having an image compositing means for storing a composite bitmap image obtained by compositing with the image compositing server in another memory area in the main memory.
When the compositing target input image is a radar signal representing a target detected by a radar radio wave at a polar coordinate position, the image compositing means converts the compositing target input image, which is a polar coordinate image , into a bitmap image and the bit. A bitmap image generation means that outputs a map image as a bitmap copy command by Xlib, and a bitmap image generation means that inputs the bitmap copy command, and based on the input bitmap copy command, outputs the bitmap image to any of the memory areas different from each other. A multilayer image compositing device characterized by having a second virtual display server for temporarily storing the image. In a multi-layer image synthesizer that synthesizes input multiple-layer images into one layer
When the input image of the plurality of layers to be combined is referred to as a composition target input image, the composition target input image is processed independently for each layer, and the composition is performed regardless of the image format of the composition target input image. The target input image is represented by a bitmap image, the bitmap image is temporarily stored in different memory areas in the main memory, and the bitmap image temporarily stored in each different memory area is synthesized by an image synthesis server. A multilayer image compositing apparatus characterized by having an image compositing means for storing a composite bitmap image obtained by compositing with the image compositing server in another memory area in the main memory.
When the input image to be synthesized is a camera image that is a data-compressed moving image, the image synthesizing means decodes the camera image, reproduces the original moving image in the image format of the bitmap image, and performs the bitmap. A video recorder that outputs an image in the form of a bitmap copy command and the bitmap copy command are input, and the bitmap image is temporarily saved in one of the different memory areas based on the input bitmap copy command. A multilayer image compositing device comprising a third virtual display server to be used.

Images