WO2000035204A1 - Afficheur stereoscopique a parallaxe integrale dynamiquement evolutif - Google Patents
Afficheur stereoscopique a parallaxe integrale dynamiquement evolutif Download PDFInfo
- Publication number
- WO2000035204A1 WO2000035204A1 PCT/US1999/029034 US9929034W WO0035204A1 WO 2000035204 A1 WO2000035204 A1 WO 2000035204A1 US 9929034 W US9929034 W US 9929034W WO 0035204 A1 WO0035204 A1 WO 0035204A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- lenslet
- pixel
- image
- array
- sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/232—Image signal generators using stereoscopic image cameras using a single 2D image sensor using fly-eye lenses, e.g. arrangements of circular lenses
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B3/0006—Arrays
- G02B3/0037—Arrays characterized by the distribution or form of lenses
- G02B3/0056—Arrays characterized by the distribution or form of lenses arranged along two different directions in a plane, e.g. honeycomb arrangement of lenses
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B3/0006—Arrays
- G02B3/0037—Arrays characterized by the distribution or form of lenses
- G02B3/005—Arrays characterized by the distribution or form of lenses arranged along a single direction only, e.g. lenticular sheets
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B3/0006—Arrays
- G02B3/0037—Arrays characterized by the distribution or form of lenses
- G02B3/0062—Stacked lens arrays, i.e. refractive surfaces arranged in at least two planes, without structurally separate optical elements in-between
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
- G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
- G02B30/30—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving parallax barriers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/225—Image signal generators using stereoscopic image cameras using a single 2D image sensor using parallax barriers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/229—Image signal generators using stereoscopic image cameras using a single 2D image sensor using lenticular lenses, e.g. arrangements of cylindrical lenses
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/296—Synchronisation thereof; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
- H04N13/305—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using lenticular lenses, e.g. arrangements of cylindrical lenses
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
- H04N13/307—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using fly-eye lenses, e.g. arrangements of circular lenses
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
- H04N13/31—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
- H04N13/32—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using arrays of controllable light sources; using moving apertures or moving light sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/349—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/398—Synchronisation thereof; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/189—Recording image signals; Reproducing recorded image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/194—Transmission of image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/218—Image signal generators using stereoscopic image cameras using a single 2D image sensor using spatial multiplexing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/25—Image signal generators using stereoscopic image cameras using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/257—Colour aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/286—Image signal generators having separate monoscopic and stereoscopic modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/324—Colour aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/346—Image reproducers using prisms or semi-transparent mirrors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/363—Image reproducers using image projection screens
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/365—Image reproducers using digital micromirror devices [DMD]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N2013/0074—Stereoscopic image analysis
- H04N2013/0081—Depth or disparity estimation from stereoscopic image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N2013/0074—Stereoscopic image analysis
- H04N2013/0085—Motion estimation from stereoscopic image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N2013/0074—Stereoscopic image analysis
- H04N2013/0092—Image segmentation from stereoscopic image signals
Definitions
- the present invention relates in general to large scale autostereoscopic displays and, more particularly, to a system and method which uses lenslet pixel modules to provide a dynamic, scalable, full -parallax three- dimensional electronic display.
- (3D) information design, visualization, and analysis is revolutionizing the communication of 3D information, especially through the emergence of the "virtual reality” paradigm. At present people can interactively experience
- Fly's eye lens sheets and related techniques were developed decades ago using optics and photographic technology. Fly's eye lens sheets possess many desirable qualities for use in 3D display such as autostereoscopy, high-resolution, full-color, high light efficiency (brightness) , full -parallax (both horizontal and vertical depth information) , and wide viewing angle (up to about forty-five (45) degrees) .
- Such displays often include a fly's eye lens sheet having a two-dimensional array of low f-number lenslets which are positioned m front of one or more two-dimensional (2D) images. The 2D image or images are projected into space by the fly's eye lens sheet. The sum of all rays of light projected from the lenslets approximates the directions and intensities of light rays coming from a real 3D object or scene corresponding with the 2D image or images .
- Fly's eye lens sheets are often considered functionally analogous to lenticular lens sheets which are typically 2D arrays of semi -cylindrical lenslets used m creating 3D images with horizontal parallax only.
- the resulting lenticular displays have enjoyed more popularity than displays using fly's eye lens sheets primarily because lenticular lens sheets are technically easier to create.
- the application of lens sheet techniques to electronic displays is still m an early development stage.
- Typically, only lenticular lens sheet methods have even been commercially attempted, and only with relatively low resolution displays capable of presenting stereo-image pair views to an observer at a strictly proscribed viewing distance and head positions.
- Large 3D electronic displays having fly's eye lens sheets have generally not been considered due to associated costs and difficulty in manufacture and assembly of the display.
- a system and method are provided to produce a scalable, 3D electronic display having a plurality of lenslet pixel modules.
- the display will produce a full parallax image.
- a 3D electronic display incorporating teaching of the present invention may be used to produce horizontal parallax only or vertical parallax only images.
- Each lenslet pixel module is designed in accordance with teaching of the present invention for optimal viewing characteristics such as wide output balanced with practical characteristics such as robustness and ease of manufacture.
- a large electronic display may be formed with as many of lenslet pixel modules as necessary to satisfy a given size or element resolution requirement. Fly's eye lens sheets may be used to form part of each lenslet pixel module.
- the modular approach of the present invention has many benefits related to image quality, flexibility, and reduced cost.
- One aspect of the present invention preferably includes using image display software within an electronic display to provide an independent 3D digital moving image transmission format along with a central control computer for producing and distributing appropriate image information to associated lenslet pixel modules.
- a sensor such as a charge coupled device (CCD) can be incorporated into some or all of the lenslet pixel modules so that the resulting 3D electronic display may function as a 3D camera as well as a 3D display.
- the 3D display may include an array of sensor elements interspersed with an array of lenslet pixel modules as opposed to combining sensor elements within respective lenslet pixel modules.
- Technical benefits of the present invention include providing autostereoscopic displays which are tailored to the human visual system in characteristics such as resolution and ergonomic ease of use.
- Technical benefits of such autostereoscopic displays also include presenting 3D information to an individual or group of observers using computer mediated 3D communications in accordance with teachings of the present invention without requiring each observer to wear special goggles or glasses.
- Forming an electronic display using one or more fly's eye lens sheets in accordance with teachings of the present invention provides vertical parallax information which may be very important when it is desirable to view an image from a variety of distances without distortions and when it is desirable to change an observer's vertical position relative to the display in order to view the associated image from different vertical positions.
- Fly's eye lens sheet designs are generally more scalable in resolution and size due to the inherently symmetrical and compact lenslets. Fly's eye lens sheets generally produce a more realistic, less distorting and easier to view 3D image as compared to a lenticular type display.
- the present invention allows using high resolution 2D image sources such as miniature cathode ray tubes (CRTS) , liquid crystal displays (LCDs) , digital micro device (DMD) mirrors, microelectronicmechanical systems (MEMS) and charge coupled device (CCD) sensors to provide a 2D image at each lenslet pixel module of a 3D electronic display at a reasonable cost.
- CRTS miniature cathode ray tubes
- LCDs liquid crystal displays
- DMD digital micro device
- MEMS microelectronicmechanical systems
- CCD charge coupled device
- a wide variety of light valves and/or light modulators may be satisfactorily used to provide the desired 2D image preferably in a digital format to each lenslet pixel module. Some of these images sources may be low resolution.
- Computer control systems and software may be used to provide an image production and distribution system which presents the desired 2D image behind each lenslet pixel module at a desired frame rate.
- Miniature CRTS, LCDs, CCD sensors, and other high resolution light valves and light modulators have all recently reached an adequate level of miniaturization and developed into commodities with costs decreasing at a constant rate such that a fly's eye lens sheet and multiple high resolution 2D image sources may be combined to form a dynamic 3D image display.
- Other technical benefits and advantages will be apparent to one of ordinary skill in the art after reviewing the specification, drawings and claims.
- FIGURE 1 is a schematic drawing showing an isometric view of a portion of a parallax barrier screen display
- FIGURE 2 is a schematic drawing showing a plan view of the parallax barrier screen display of FIGURE 1 ;
- FIGURE 3 is a schematic drawing showing an isometric view of a portion of a lenticular screen display
- FIGURE 4 is a schematic drawing showing a plan view of the lenticular screen display of FIGURE 3;
- FIGURE 5 is a schematic drawing showing a plan view of another lenticular screen display having a first lenticular lens sheet and a second lenticular lens sheet with a diffused surface disposed therebetween;
- FIGURE 6 is a schematic drawing showing an isometric view of a display screen formed m part by a fly's eye lens sheet ;
- FIGURE 7 is a schematic drawing showing a plan view of the display screen of FIGURE 6;
- FIGURE 8 is a schematic drawing showing a side view of a fly's eye lens sheet used to record an image on photosensitive recording material
- FIGURE 9 is a schematic drawing with portions broken away of a single lenslet pixel module incorporating teachings of the present invention for use m a 3D electronic display;
- FIGURE 10 is a schematic drawing with portions broken away of a display system having a multiple lenslet pixel modules incorporating teachings of the present invention
- FIGURE 11 is a schematic drawing with portions broken away of another display system having multiple lenslet pixel modules incorporating teachings of the present invention
- FIGURE 12 is a schematic drawing showing a plan view with portions broken away of a lenslet pixel module having both a projector element and a sensor element
- FIGURE 13 is a schematic drawing with portions broken away showing still another display system having a selected number of lenslet pixel modules with respective projector elements and a selected number of lenslet pixel modules with respective sensor elements in accordance with teachings with the present inventions;
- FIGURE 14 is a schematic drawing with portions broken away of a display system having multiple lenslet pixel modules which include both projector elements and sensor elements incorporating teachings of the present invention.
- FIGURE 15 is a schematic drawing with portions broken away showing still another display system having a selected number of lenslet pixel modules with high resolution and low resolution sensor elements and a selected number of lenslet pixel modules with a high resolution image display elements and low resolution image display elements.
- FIGURES 1-15 of the drawings like numerals being used for like and corresponding parts of the various drawings.
- the following written description discusses various embodiments of a scalable, full-parallax 3D electronic display formed in accordance with teachings of the present invention.
- the description begins with a brief explanation of two similar technologies for providing autostereoscopic 3D image displays: parallax barrier displays and lenticular lens sheet displays.
- the description includes a comparison of lenticular lens sheet displays with fly's eye lens sheet displays and the benefits resulting using a fly's eye lens sheet to form a display in accordance with teachings of the present invention.
- a single lenslet pixel module having a fly's eye lens is described, followed by a discussion of some parallel signal distribution techniques to enhance the resulting 3D electronic display.
- the description concludes with examples of optional image acquisition hardware and software modifications.
- Pixel is an abbreviation for picture element.
- 3D pixel will be used to refer to the smallest part of an electronically coded 3D graphic or 3D picture image. Pixel may also be used to refer to the smallest addressable element in an electronic display.
- Conventional LCD Projectors and CCD sensors typically have an array of 2D pixels.
- the present invention provides an electronic display which produces a 3D image having 3D pixels .
- lenslet pixel module and “lenslet pixel modules” are used to describe various components such as high resolution and low resolution 2D image sources, fly's eye lenslets and/or a sensor elements which may be combined in accordance with teachings of the present invention to form a 3D pixel in a resulting autostereoscopic image and/or detect a portion of a real 3D object.
- Various features of the present invention may be described with respect to "projector pixels” which form a portion of an electronic display and “sensor pixels” which detect electromagnetic radiation from one or more real 3D objects or from a scene adjacent to the electronic display.
- projector module or “projector modules” are used to refer to lenslet pixel modules which form a 3D pixel in a resulting autostereoscopic image.
- sensor module or “projector modules” are used to describe lenslet pixel modules which are responsive to electromagnetic radiation from a real 3D object or a real scene adjacent to an electronic display incorporating teachings of the present invention.
- high resolution is used to refer to a 2D image source and to a sensor element having a 2D array of at least 1280 by 1024 pixels.
- Various embodiments of the present invention will be described with respect to lens sheets and lenslets satisfactory for use in forming 3D displays incorporating teachings of the present invention may be formed from a wide variety of optically transparent materials such as plastics and glass. Lens sheets and lenslets are often formed using injection molding techniques. Commercially available optical design and fabrication methods may be used to form various components of an electronic display incorporating teachings of the present invention. Also, the selection of various optical elements, their respective locations and optical characteristics such as aperture, diameter and focal length may be determined in accordance with commercially available techniques associated with digital electronic and holographic displays.
- a basic characteristic distinguishing an autostereoscopic display from a 2D display is that an autostereoscopic display can generally control both light intensity and light directions emanating therefrom whereas a 2D display only modulates light intensity.
- a 2D photograph or a 2D television set is perceived as a flat surface because the image surface diffuses light indiscriminately, whereas autostereoscopic displays appear 3D because the observer's two eyes are presented with two different viewpoint -dependent images.
- the most natural kinds of autostereoscopic displays allow an observer to move around within a wide range of viewing positions, always presenting the correct information to the observer's eyes .
- FIGURES 1 and 2 are schematic diagrams showing one example of a typical parallax barrier screen display indicated generally at 20.
- a parallax barrier screen display such as display 20 generally includes a transparency or sheet 22 with fine parallel vertical opaque lines 24 which are placed at a defined distance in front of a specially prepared picture or film 28 as shown in FIGURE 2. Sheet 22 and opaque lines 24 cooperate with each other to form parallax barrier screen 26.
- Specially prepared picture or film 28 disposed adjacent to parallax barrier screen 26 generally includes 2D images (not expressly shown) from different viewpoints which are positioned in fine strips behind lines 24 of parallax barrier screen 26 such that only the appropriate strips are visible from a particular viewing angle.
- FIGURE 2 is a diagram of a top down view of one embodiment of parallax barrier screen display 20.
- the parallax barrier screen technique has a set of advantages and disadvantages compared to alternative techniques. Because of the offset printing industry's need for high-resolution, high-contrast black-and-white photographic transparencies used in producing printing plates, it is possible to inexpensively produce large raster barrier screens of any desired barrier pattern up to 2400 lines-per-inch.
- the essential drawbacks to raster barrier screen displays are in the unavoidable darkening of the image caused by the opaque barrier strips, and by the difficulties of registering the barrier screen with the specially prepared 2D image or images disposed adjacent thereto.
- the use of a lightbox (not expressly shown) to back illuminate a raster barrier screen can result in adequately bright images for certain viewing situations.
- a lenticular screen display is geometrically similar to a parallax barrier screen display.
- the relationship between the two types of displays is analogous to the relationship of a pin-hole camera to a normal convex lens camera.
- a lenticular screen display is analogously much more light efficient than a parallax barrier screen display.
- FIGURES 3 and 4 are schematic diagrams showing one example of a lenticular screen display indicated generally at 3D.
- a principle advantage of a lenticular screen display such as display 3D is its superior optical efficiency or brightness compared to a parallax barrier display.
- lenticular screen display 3D preferably includes lenticular lens sheet 32 have a plurality of parallel, vertical lenticules 34 form on one surface thereof.
- a specially prepared picture or film 38 may be disposed adjacent to lenticular lens sheet 32 opposite from lenticules 34 as shown in FIGURE 4.
- Picture or film 38 preferably includes one or more 2D images which will be projected from lenticular lens sheet 32 as a horizontal parallax only 3D image.
- Another disadvantage is the problem of displaying lenticular images in outdoor situations where sunlight may be concentrated by the associated lenticules on the 2D image plane behind the lenticules and cause damage to the picture or film having the 2D image.
- Both parallax barrier screen displays and lenticular screen displays unavoidably suffer from diffraction limited resolution related to the width of the parallax barrier slits or the lenticules in the case of a lenticular screen display.
- the static 2D image behind the parallax barrier screen or behind the lenticular screen may be replaced by a moving image screen or moving image source with specially prepared images composed of fine vertical strip images carefully matched to the geometrical design of the parallax barrier screen or lenticular screen. It is possible to generate these special moving images by real-time parallel computer processing of conventional video output from a line of video cameras (not expressly shown) or from synthesized views of a computer graphics animation rendering engine
- Parallax barrier screen display 20 and lenticular screen display 3D are horizontal parallax only displays. These displays may be modified to full parallax displays by replacing parallax barrier sheet 22 or lenticular lens sheet 32 with a pinhole array and a fly's eye lens sheet respectively.
- FIGURES 6 and 7 are schematic drawings showing one example of a typical fly's eye screen display shown generally at 50.
- a fly's eye screen display such as display 50 generally includes a fly's eye lens sheet 52 having an array of fly's eye lenslets 54 disposed on one surface thereof. The opposite surface of a fly's eye lens sheet 52 is preferably flat and smooth. Fly's eye lenslets 54 may be described as generally spherical bumps.
- Two-dimensional image source 58 is preferably disposed on fly's eye lens sheet 52 opposite from lenslets 54.
- Two- dimensional image source 58 may be a picture or film as previously described with respect to lenticular screen display 3D.
- 2D image source 58 may be a moving image screen or other moving image source .
- Full parallax displays such as display 50 provide more realistic 3D images as compared to horizontal parallax only displays such as displays 20 and 3D. The difference is most apparent when an observer moves in a vertical direction relative to the displays. Another benefit of a full parallax display is in the freedom it allows an observer to view a display from any distance without observing the anamorphic distortions which are inherent in horizontal parallax only displays. The reason for these anamorphic distortions in lenticular displays such as display 3D is the fact that the vertical dimension of the images behind lenticules 34 is fixed. The relative sizes of objects in the real world change with the viewing distance. Since the vertical dimension of objects in lenticular display 3D is fixed, there can only be one viewing distance for which the vertical dimensions of uhe resulting 3D image are correct .
- FIGURE 7 shows a cross-section of fly's eye screen display 50 where point A is imaged m front of display 50 and point B appears to be behind display 50 simply due to the apparent convergence of the rays projected by fly's eye lenslets 54.
- Image points which are recorded on 2D image source 58 disposed behind lenslets 54 are refracted by lenslets 54 and emerge m directions consistent with light from a corresponding real 3D object or scene.
- FIGURE 7 One method for creating synthetic 2D images for a fly's eye screen display can be inferred from FIGURE 7, namely computer graphic ray tracing.
- FIGURE 7 One method for creating synthetic 2D images for a fly's eye screen display can be inferred from FIGURE 7, namely computer graphic ray tracing.
- creating real -world images is more complicated due to a peculiar depth inversion problem which is briefly described below.
- FIGURE 8 depicts a side view of a model of a cat placed m front of fly's eye lens sheet 52.
- a layer of photosensitive recording material may be placed on lens sheet 52 at the surface previously occupied by 2D source image 58.
- Lenslets 52 appear to image the cat as one would expect from the laws of optics, namely a small inverted image of the cat from the perspective of each lenslet is imaged behind it on the photosensitive recording material at the 2D image source plane. Since the cat is facing fly's eye lens sheet 52, each lenslet 54 images a front view of the cat.
- the photosensitive recording material is developed and placed exactly back m the same position it was m during exposure, a reconstructed image of the cat will be presented, as the laws of optics would predict, in front of fly's eye lens sheet 52.
- the algorithm used can be a variation of an algorithm developed, which was the subject of a masters' degree thesis by M. Holzbach, "Three-dimensional Image Processing for Synthetic Holographic Stereograms , " MIT Master's Thesis, September, 1986. LENSLET PIXEL MODULES
- depth resolution Another measure of image quality of 3D images is depth resolution which depends on factors such as lenslet size and quality and image resolution behind each lenslet. Depth resolution for a fly's eye screen is not constant regardless of distance from the screen. Due to physical optical limits such as diffraction and the effects of lens aberrations and image misregistrations (which increase at a distance) , depth resolution is best for points close to the screen (on the order of the lenslet size) and decreases with the distance from the screen.
- Complete analysis of depth resolution during lenslet design phase is preferably conducted as part of forming a 3D electronic display in accordance with teachings of the present invention to optimize lenslet pixel module design to yield the best possible depth resolution.
- the image information for a fly's eye screen display originates on the source image plane behind the lenslets. If the 2D image source plane is positioned at the focal length of the lenslets, a point on the 2D image source plane behind a lenslet becomes a collimated (parallel light) beam which appears to completely fill the lenslet when observed at the correct angle relative to the lenslet. When the observed angle relative to the lenslet changes slightly, a neighboring image point from the 2D image source plane appears to completely fill the lenslet. From this it can be seen how the size and density of neighboring image points on the 2D image source plane are directly related to depth resolution.
- a high resolution 2D image source such as a miniature
- each lenslet behind each lenslet is often desirable to optimize the depth resolution.
- a less-costly lower resolution alternative may also be achieved by positioning multiple neighboring lenslets to share dedicated regions of a single CRT or LCD screen, or sections of a diffuser back-lit by a video projection system (not expressly shown) .
- a wide variety of light valves and light modulators may be satisfactorily used with lenslet pixel modules incorporating teachings of the present invention.
- high resolution 2D image sources are preferred, a 3D electronic display may be formed in accordance with teachings of the present invention using low resolution 2D image sources.
- a wide variety of electromagnetic sensor and detectors may be satisfactorily used with lenslet pixel modules incorporating teachings of the present invention.
- FIGURE 9 is a schematic diagram showing one embodiment of single lenslet pixel module 70 incorporating teachings of the present invention.
- Lenslet pixel module 70 preferably includes fly's eye lenslet 74 so that a 2D image may be projected from high resolution 2D image source 78 through fly's eye lenslet 74.
- Other types of lenslets satisfactory for use m forming a portion of a 3D image may be used.
- the present invention is not limited to fly's eye lenslet 74.
- Lenslet pixel module 70 may sometimes be referred to as a projection module or a projection pixel.
- high resolution 2D image source 78 may be a digital flat panel display (FPD) , an LCD or CRT.
- FPD digital flat panel display
- LED light emitting diodes
- DMD mirrors and MEMS may also be satisfactorily used to form lenslet pixel modules 70.
- a plurality of lenslet pixel modules 70 may be arranged relative to each other m a generally rectangular array to provide an electronic 3D display (not expressly shown) having a resolution of 640 x 480 3D pixels. The front of such an array may look similar to display 50 m FIGURE 6.
- fly's eye lenslet 74 may have a diameter less than one inch.
- a standard video source shown as NTSC or VGA may be connected to high resolution 2D image source 78.
- digital data may be supplied to high resolution 2D image source 78 which then converts the digital data into the desired 2D image.
- An important aspect of the present invention includes providing moving images or even live images to lenslet pixel modules 70.
- a 3D electronic display may be formed in accordance with teachings of the present invention by using fly's eye lens sheet 52 as shown in FIGURE 6 to form a generally rectangular, flat array.
- lenslet pixel modules 70 may be used to form a generally curved array (not expressly shown) .
- Lenslet pixel modules incorporating teachings of the present invention may be arranged in a wide variety of arrays and/or mosaics as desired to provide the resulting full parallax 3D image.
- a plurality of high resolution 2D image sources may be coupled with respective fly's eye lenslet 54 to form the desired lenslet pixel module array.
- two or more lenslets 74 may share dedicated regions of the same high resolution 2D image source 78 (not expressly shown) .
- a high resolution FPD may be combined with fly's eye lens sheet 52 in accordance with teachings of the present invention.
- FIGURE 10 is a schematic drawing showing system 80 incorporating teachings of the present invention for presenting a scalable, full parallax autostereoscopic image.
- System 80 preferably includes a plurality of lenslet pixel modules 70 which may be arranged relative to each other in a wide variety of arrays or mosaics .
- lenslet pixel modules 70 may be arranged to form an array similar to display 50 as shown in FIGURE 6.
- lenslet pixel module 70 may be arranged in various geometric configurations such as concave, convex, rectangular, square or cylindrical.
- System 80 also includes a plurality of slave computer processing units (CPU) 82 with one or more lenslet pixel modules 70 coupled with each slave CPU 82.
- CPU slave computer processing units
- a video output channel may be used to couple each slave CPU 82 with its associated lenslet pixel modules 70.
- each slave CPU 82 may have a digital connection with its associated lenslet pixel module 70.
- Digital data from each slave CPU 82 may be converted to the desired 2D image by high resolution 2D image source 78.
- System 80 preferably includes master computer processing unit (CPU) 84 which is preferably connected with and controls the operation of each slave CPU 82.
- CPU computer processing unit
- three lenslet pixel modules 70 are coupled with each slave CPU 82.
- the number of slave CPUs, master CPUs and lenslet pixel modules may be varied in accordance with teachings with the present inventions to provide the desired scalable, full parallax autostereoscopic image. If the cost of providing an individual 2D image source for each lenslet is too expensive, a larger FPD (not expressly shown) or a video screen (not expressly shown) may be divided into four equal regions and shared among four lenslet pixel modules 70. The schematic illustration for this would be similar to FIGURE 10, only with each slave CPU 82 providing the desired 2D image input for four lenslets pixel modules 70 instead of three lenslet pixel modules 70.
- each lenslet pixel module 70 may contain an internal CPU, a communications adapter, and video display circuitry so that each lenslet pixel module 70 may generate its own 2D image after being loaded with desired database and viewpoint information.
- FIGURE 11 is a schematic diagram showing system 90 having a plurality of lenslet pixel modules 70 wherein each high resolution 2D source 78 preferably includes a respective internal CPU (not expressly shown) , a communications adapter (not expressly shown) and associated video display circuitry (not expressly shown) along with the desired data base and viewpoint information.
- Master CPU 94 provides the desired digital data input to each lenslet pixel module 70.
- a CCD sensor or a miniature video camera may be incorporated into a lenslet pixel module having a partially silvered mirror and additional optics to virtually superimpose a 3D output image and a 2D sensor array. A consequence of this approach may be output brightness attenuation. Also, possibly increased bulk of the CCD sensor may require pixel module engineering to optimize lenslet pixel module packing density.
- 3D data could be used as the basis for virtual -reality computer-human interaction. For example, multiple human observers could have simulated computer-graphic objects tracking their moving bodies in real time. Perhaps some observers could have their images appear on the associated 3D display in real time, while other observers choose to remain invisible.
- FIG 12 is a schematic drawing showing lenslet pixel module 170 with projection element 78 and sensor element 172 combined in accordance with teachings of the present invention.
- Lenslet pixel module 170 preferably includes both high resolution 2D image source 78 and sensor element or detector element 172.
- Partially silvered mirror 176 is preferably provided to optically couple both high resolution 2D image source 78 and sensor element 172 with lenslet 74.
- sensors or detectors which respond to electromagnetic radiation from a real 3D object or scene may be satisfactorily used as sensor element 172.
- high resolution 2D image source 78 may be coupled with a source of moving video images.
- Sensor element 172 may be coupled with an appropriate recorder or a computer processing unit to record images corresponding with one or more real 3D objects (not expressly shown) disposed in front of lenslet 74.
- FIG 13 is a schematic drawing showing various portions of system 180 which may be satisfactorily used to form an autostereoscopic image in accordance with teachings of the present invention.
- System 180 preferably includes a plurality of lenslet pixel modules 70 and a plurality of lenslet pixel modules 170.
- lenslet pixel modules 70 may also be referred to as projector modules.
- Lenslet pixel modules 170 may be described as combined projector/sensor modules.
- Master CPU 94 is preferably provided to communicate digital data corresponding with a desired 2D image to both lenslet pixel modules 70 and lenslet pixel modules 170.
- Master CPU 94 is also preferably operable to receive digital information from lenslet pixel modules 170 which correspond with one or more objects disposed in front of the associated lenslets 74.
- system 180 may be formed from a plurality of lenslet pixel modules 70 having associated high resolution 2D image sources 78 or projector elements 78 and a plurality of lenslet pixel modules or sensor modules having only associated sensor elements.
- One example of such sensor modules may be formed by replacing projector element 78 of lenslet pixel module 70 as shown in FIGURE 9 with a desired sensor or detector element.
- System 180 may be satisfactorily formed with multiple projector modules, sensor modules and/or combined projector and sensor modules.
- FIGURE 14 is a schematic drawing showing system 190 which may be used to form an interactive autostereoscopic display in accordance with teachings of the present invention.
- System 190 preferably includes master CPU 94 coupled with a plurality of lenslet pixel modules 170.
- the resulting 3D array includes a plurality of lenslet pixel modules 170 having both a projector element or (high resolution 2D image source 78) and sensor element 172.
- FIGURE 15 is a schematic drawing showing system 200 which may be used to form an interaction autostereoscopic display in accordance with teachings of the present invention.
- System 200 preferably includes master CPU 94 and a plurality of lenslet pixel modules 70 and 170.
- system 200 also preferably includes a plurality of lenslet pixel modules 70a which have a low resolution 2D image source (not expressly shown) and a plurality of sensor of lenslet sensor modules 170a which preferably include a low resolution sensor (not expressly shown) .
- lens sheets and lenses may be satisfactorily used to form 3D autostereoscopic images.
- Lens sheets and lenslets satisfactory for use in forming 3D electronic displays in accordance with teachings of the present invention may be fabricated using refractive methods or diftractive methods.
- a wide variety of lens sheets having a suitable lens array formed on a first surface and a second generally smooth flat surface disposed opposite from the first surface may be satisfactorily used to form lenslet pixel modules in accordance with the teachings of the present invention.
- the lenslets may be cylindrical, convex, concave, gradient index, diftractive, refractive, holographic optical elements or any other suitable prism which will form a full parallax 3D image.
- a plurality of sensors or detectors may be dispersed within an array lenslet pixel modules having only projector elements.
- the lenslet pixel modules may cooperate with each other to form a projector array.
- the sensor elements may also cooperate with each other to form a sensor array.
- the lenslet pixel modules and each sensor may include a fly's eye lenslet.
- the sensor array may have a focal plane which corresponds approximately with a focal plane associated with the projector array.
- the sensor array may have a focal plane oriented substantially different from the focal plane of the projector array.
- one or more of the sensors may have a lenslet with a configuration different from the projector array.
- the lenslet pixel modules in the projector array may have different lenslets.
- the sensor array may cooperate with the projector array to allow an observer to interact with a 3D image formed by the projector array.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| AU21687/00A AU2168700A (en) | 1998-12-10 | 1999-12-08 | Dynamically scalable full-parallax stereoscopic display |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US11190698P | 1998-12-10 | 1998-12-10 | |
| US60/111,906 | 1998-12-10 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2000035204A1 true WO2000035204A1 (fr) | 2000-06-15 |
Family
ID=22341064
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US1999/029034 Ceased WO2000035204A1 (fr) | 1998-12-10 | 1999-12-08 | Afficheur stereoscopique a parallaxe integrale dynamiquement evolutif |
Country Status (2)
| Country | Link |
|---|---|
| AU (1) | AU2168700A (fr) |
| WO (1) | WO2000035204A1 (fr) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR2873457A1 (fr) * | 2004-07-23 | 2006-01-27 | Franck Andre Marie Guigan | Dispositif optique a reseau lenticulaire |
| WO2006015562A1 (fr) * | 2004-08-10 | 2006-02-16 | Seereal Technologies Gmbh | Dispositif de separation d'images a point ideal pour ecrans autostereoscopiques a utilisateurs multiples |
| WO2007062644A1 (fr) * | 2005-12-04 | 2007-06-07 | Siegbert Hentschke | Systeme de retroprojection multiperspective destine a la restitution autostereoscopique de representations tridimensionnelles |
| CN101377916B (zh) * | 2007-08-30 | 2010-12-15 | 索尼株式会社 | 信息表现系统,信息表现设备,信息表现方法 |
| EP2372469A4 (fr) * | 2008-12-25 | 2012-05-30 | Afc Technology Co Ltd | Système et procédé d'affichage tridimensionnel en temps réel par projection holographique |
| WO2019135088A1 (fr) * | 2018-01-05 | 2019-07-11 | Cambridge Enterprise Limited | Système d'affichage et de capture de champ lumineux à angles multiples |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US3852524A (en) * | 1968-07-22 | 1974-12-03 | Mitsubishi Electric Corp | Stereoscopic television system |
| WO1994006249A1 (fr) * | 1992-09-09 | 1994-03-17 | Eichenlaub Jesse B | Systeme d'eclairage stroboscopique pour affichage video |
| US5340978A (en) * | 1992-09-30 | 1994-08-23 | Lsi Logic Corporation | Image-sensing display panels with LCD display panel and photosensitive element array |
-
1999
- 1999-12-08 WO PCT/US1999/029034 patent/WO2000035204A1/fr not_active Ceased
- 1999-12-08 AU AU21687/00A patent/AU2168700A/en not_active Abandoned
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US3852524A (en) * | 1968-07-22 | 1974-12-03 | Mitsubishi Electric Corp | Stereoscopic television system |
| WO1994006249A1 (fr) * | 1992-09-09 | 1994-03-17 | Eichenlaub Jesse B | Systeme d'eclairage stroboscopique pour affichage video |
| US5340978A (en) * | 1992-09-30 | 1994-08-23 | Lsi Logic Corporation | Image-sensing display panels with LCD display panel and photosensitive element array |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR2873457A1 (fr) * | 2004-07-23 | 2006-01-27 | Franck Andre Marie Guigan | Dispositif optique a reseau lenticulaire |
| WO2006015562A1 (fr) * | 2004-08-10 | 2006-02-16 | Seereal Technologies Gmbh | Dispositif de separation d'images a point ideal pour ecrans autostereoscopiques a utilisateurs multiples |
| WO2007062644A1 (fr) * | 2005-12-04 | 2007-06-07 | Siegbert Hentschke | Systeme de retroprojection multiperspective destine a la restitution autostereoscopique de representations tridimensionnelles |
| US8011786B2 (en) | 2005-12-04 | 2011-09-06 | Siegbert Hentschke | Multi-perspective rear projection system for autostereoscopic reproduction of three-dimensional displays |
| CN101377916B (zh) * | 2007-08-30 | 2010-12-15 | 索尼株式会社 | 信息表现系统,信息表现设备,信息表现方法 |
| EP2372469A4 (fr) * | 2008-12-25 | 2012-05-30 | Afc Technology Co Ltd | Système et procédé d'affichage tridimensionnel en temps réel par projection holographique |
| WO2019135088A1 (fr) * | 2018-01-05 | 2019-07-11 | Cambridge Enterprise Limited | Système d'affichage et de capture de champ lumineux à angles multiples |
Also Published As
| Publication number | Publication date |
|---|---|
| AU2168700A (en) | 2000-06-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6795241B1 (en) | Dynamic scalable full-parallax three-dimensional electronic display | |
| US6798409B2 (en) | Processing of images for 3D display | |
| US6595644B2 (en) | Dynamic time multiplexed holographic screen with 3-D projection | |
| US5392140A (en) | Optical device with two lens arrays with the second array pitch an integral multiple of the first array pitch | |
| KR0145558B1 (ko) | 3차원 디스플레이장치 | |
| CA2284915C (fr) | Systeme de projection autostereoscopique | |
| US20050146788A1 (en) | Software out-of-focus 3D method, system, and apparatus | |
| US7492513B2 (en) | Autostereoscopic display and method | |
| US20050088749A1 (en) | Modular integral magnifier | |
| US20030038922A1 (en) | Apparatus and method for displaying 4-D images | |
| JP3269823B2 (ja) | 情報の2次元および3次元表示のための光学システム | |
| JPH08501397A (ja) | 三次元光学観察装置 | |
| CN1322353C (zh) | 渐变斜度微透镜阵列视差宽屏自动立体显示器 | |
| US20030137730A1 (en) | Autostereoscopic display | |
| McAllister | Display technology: stereo & 3D display technologies | |
| US6055100A (en) | Doublet based large aperture free space imaging system | |
| US20070139767A1 (en) | Stereoscopic image display apparatus | |
| US5629797A (en) | Autostereoscopic image system | |
| JP2001508553A (ja) | 立体ホログラムディスプレイ(holdisp) | |
| EP1083757A2 (fr) | Dispositif d'affichage d'images stéréoscopiques | |
| US8717425B2 (en) | System for stereoscopically viewing motion pictures | |
| EP0460314B1 (fr) | Moyen d'affichage | |
| WO2000035204A1 (fr) | Afficheur stereoscopique a parallaxe integrale dynamiquement evolutif | |
| US3501230A (en) | Three-dimensional display system | |
| Lipton | Future of autostereoscopic electronic displays |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG UZ VN YU ZA ZW |
|
| AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
| REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |
|
| 122 | Ep: pct application non-entry in european phase |