[go: up one dir, main page]

WO2013053876A2 - Système optoélectronique miniaturisé pour analyse spectrale - Google Patents

Système optoélectronique miniaturisé pour analyse spectrale Download PDF

Info

Publication number
WO2013053876A2
WO2013053876A2 PCT/EP2012/070236 EP2012070236W WO2013053876A2 WO 2013053876 A2 WO2013053876 A2 WO 2013053876A2 EP 2012070236 W EP2012070236 W EP 2012070236W WO 2013053876 A2 WO2013053876 A2 WO 2013053876A2
Authority
WO
WIPO (PCT)
Prior art keywords
light
optoelectronic system
miniaturized optoelectronic
miniaturized
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2012/070236
Other languages
German (de)
English (en)
Other versions
WO2013053876A3 (fr
Inventor
Nico Correns
Thomas Endress
Michael Rode
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to EP12816009.0A priority Critical patent/EP2766702A2/fr
Publication of WO2013053876A2 publication Critical patent/WO2013053876A2/fr
Publication of WO2013053876A3 publication Critical patent/WO2013053876A3/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02—Details
    • G01J3/0256—Compact construction
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/02—Details
    • G01J1/0204—Compact construction
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/02—Details
    • G01J1/0219—Electrical interface; User interface
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/02—Details
    • G01J1/0233—Handheld
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/02—Details
    • G01J1/0247—Details using a charging unit
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/02—Details
    • G01J1/0271—Housings; Attachments or accessories for photometers
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/02—Details
    • G01J1/04—Optical or mechanical part supplementary adjustable parts
    • G01J1/0407—Optical elements not provided otherwise, e.g. manifolds, windows, holograms, gratings
    • G01J1/0411—Optical elements not provided otherwise, e.g. manifolds, windows, holograms, gratings using focussing or collimating elements, i.e. lenses or mirrors; Aberration correction
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/02—Details
    • G01J1/04—Optical or mechanical part supplementary adjustable parts
    • G01J1/0407—Optical elements not provided otherwise, e.g. manifolds, windows, holograms, gratings
    • G01J1/0414—Optical elements not provided otherwise, e.g. manifolds, windows, holograms, gratings using plane or convex mirrors, parallel phase plates, or plane beam-splitters
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/42—Photometry, e.g. photographic exposure meter using electric radiation detectors
    • G01J1/4228—Photometry, e.g. photographic exposure meter using electric radiation detectors arrangements with two or more detectors, e.g. for sensitivity compensation
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02—Details
    • G01J3/0205—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
    • G01J3/0208—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows using focussing or collimating elements, e.g. lenses or mirrors; performing aberration correction
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02—Details
    • G01J3/0205—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
    • G01J3/021—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows using plane or convex mirrors, parallel phase plates, or particular reflectors
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02—Details
    • G01J3/0264—Electrical interface; User interface
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02—Details
    • G01J3/0272—Handheld
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02—Details
    • G01J3/0291—Housings; Spectrometer accessories; Spatial arrangement of elements, e.g. folded path arrangements
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28—Investigating the spectrum

Definitions

  • the invention relates to a miniaturized optoelectronic system for generating static or moving images of scenes or individual objects and for determining and evaluating the spectral properties of the objects within a scene or of individually imaged objects.
  • a mobile phone was coupled with a single-channel spectrometer, which has a bandwidth of 300 nm and a spectral resolution of less than 5 nm.
  • the determination of white light transmission spectra and fluorescence spectra is thus possible.
  • the use of this device combination referred to as a mobile phone spectrometer, is provided in connection with medically relevant applications.
  • the device base used was a GSM mobile phone suitable for media playback, which has a video camera, mobile Internet access with e-mail and GPS cards and is currently known under the trade name iPhone.
  • US 2010/0309454 A1 describes a compact spectrometer which is coupled to a mobile telephone or integrated in a miniaturized version in a mobile telephone. imp- The power supply, data memory, signal processing and real-time display of the measurement results are also indicated. The results can be communicated immediately via wireless communication to a remote station or to other mobile phones or their users. For example, for diabetics, it is possible to perform blood glucose measurements in a non-invasive manner at home and to transmit the results to the doctor.
  • a disadvantage of the aforementioned arrangements is that a comprehensive and precise determination of the spectral properties of imaged scenes or objects in real time is not possible and the output of inferential information, for example in the sense of recommendations for action for the user, which relate to the determination and evaluation results , not intended or - measured against existing needs - only limited and therefore insufficiently possible.
  • a miniaturized optoelectronic system of the type mentioned in the introduction comprises
  • optical components and beam paths for generating static or moving images of a scene or a single object optical components and beam paths for generating static or moving images of a scene or a single object
  • an information output unit designed to display the results sensually, preferably visually perceptible representation of the spectral properties in association with the objects, and
  • a handheld or handheld device is a portable electronic device with its own power supply for different applications. It is so small and light that it can be held in use in only one hand, hence the term Handheld, held by English in the hand (cited from Wikipedia, 31.08.201 1).
  • the paths of the light through the optical part of the system are to be understood.
  • the beam paths for image generation and the beam paths for determining the spectral properties run at least in sections separately or together, and the image generation and the spectral analysis are provided simultaneously or in chronological succession.
  • the optical means for determining the spectral properties are designed as multichannel spectrometers and intended to determine spectrums for several wavelengths of the illumination and / or measurement light independently of one another, preferably simultaneously with the generation of images of the scenes or objects, whose spectral properties are to be determined.
  • the inventive concept is the training in the form of a hyperspectral multi-channel spectrometer, which is suitable for spectral analysis in the wavelength range from ultraviolet to long-wave infrared and is provided in each of the channels with up to 250 different, each corresponding to a wavelength or a wavelength range support points.
  • Combinations of silicon-based and / or indium-gallium-arsenide-based polychromatic and monochromatic line or area sensors which also cover a specific wavelength range to be spectrally analyzed.
  • the system according to the invention is embodied in special embodiments for producing two- or three-dimensional images of scenes or objects, and the spectral analysis is carried out for one or more individual lines, for an area or for a volume of an object selected from a scene or individually recorded.
  • TOF Time Of Flight principle.
  • a photonic mixer also referred to as a PMD sensor, is advantageously used as the image sensor.
  • the means for imaging and the means for determining the spectral properties are either housed within a common compact housing or designed as separate modules. For both options embodiments are provided, which allow the one-handed holding and operating due to their size and weight.
  • a dispersive optics for example in the form of an optical grating, prism or filter, are arranged upstream of the optical elements for image generation, in particular an objective belonging to the imaging beam path.
  • Image stacks are taken from different focal planes, evaluated the individual images of these stacks with respect to the image sharpness of preferably relevant pixels and extracted from the results images of the scene or objects whose image sharpness is corrected.
  • the focus variation is made, for example, by stepwise changing the distance between the lens and the focal plane of the dispersion element.
  • an existing autofocusing device can be temporarily used for this purpose.
  • the use of DOE ' s or other optically correcting elements is conceivable in order to compensate the image blur.
  • the respective natural ambient light or the light emitted by an artificial source is provided.
  • the coupling of the measuring light coming from the scene or the object into the beam paths for the spectral analysis takes place, for example, by means of free-ray optics or optical waveguides.
  • the separate or integrated equipment of the opto-electronic system with an illumination light source that emits fluorescence exciting light is also provided.
  • artificial light sources are used, they are preferably connected to means for the defined influencing of the intensity, the wavelength and / or the polarization of the emitted light.
  • polarization elements enables the processing of phase information, which is particularly useful in spectral ellipsometry for the investigation of Layer thicknesses and optical properties of different materials is advantageous.
  • polarized light is irradiated onto the sample, and based on the amplitude and phase information or the ellipsometric parameters Y and D of the reflected beam is concluded that the polarizing properties of the sample.
  • the generation of instructions for action for the user is provided, which are generated in the form of conclusions from the results of the spectral analysis. Included in the concept of the invention is the additional linking of the results of the spectral analysis with further information relating to scenes and objects, such as metadata. These are either stored internally in the system, stored in an external data store assigned to the system, or made publicly accessible by communication and retrievable with the system.
  • the optoelectronic system according to the invention is equipped, for example, with means for wireless integration into a communications network, in particular for image and sound transmission, for transmission of measurement results to external data memories and / or for retrieving information from external data memories.
  • information is for example reference values for the calibration of the means for image generation, but preferably for the calibration of the means for spectral analysis.
  • the calibration of the intensity and / or the wavelength of the illumination light can be provided.
  • the optoelectronic system according to the invention is equipped with means for guiding the user in the search for such objects within arbitrary scenes which have certain spectral properties.
  • This route guidance is achieved by determining, for example by means of GPS and / or compass, the spatial orientation of the imaged scene or of the imaged object and correlating it with the temporal gradient of a change arbitrarily or deliberately caused by the user to the measured absolute or relative spatial spectral information becomes.
  • the return information thus obtained to the user allows the route guidance of the system to areas that are relevant to the user in connection with the respective application.
  • Further information supporting the context of the measurement is taken into account in the calculation of the gradient space information.
  • the real-time feedback of the measurement information takes place, for example, in the display by means of gratings, arrows, false-color areas offering support points, or also by means of haptic instant information to the user, for example acoustically and / or in the form of vibrations.
  • the feedback to the user does not necessarily have to be in the same place, that is to say the user can receive the information spatially separated via the communication interfaces of the system according to the invention, such as TCP / IP, Bluetooth etc.
  • the information output unit has, for example, an LED or OLED display for visually perceptible presentation of results.
  • the means for image generation are designed as a light field camera system.
  • Light field camera systems are known as plenoptic cameras. They detect the 4D light field of a scene, which not only knows the position and intensity of a light beam incident on the image sensor, but also its direction of incidence.
  • a grid of a plurality of microlenses is arranged in front of the image sensor.
  • the image-forming means preferably embodied as a camera, advantageously have a sensor matrix, for example embodied in the form of a CCD image sensor, which is connected to an interface for temporarily combining adjacent pixels to form pixel blocks in order to achieve a higher photosensitivity and at the same time a higher read-out speed.
  • This control can be made spatially and / or temporally staggered with respect to the pixels of the image sensor.
  • the equipment of the optoelectronic system with acceleration sensor, gyroscope and inclinometer as well as means for integration into the Global Positioning System (GPS) are optional as well.
  • GPS Global Positioning System
  • the inclinometer and GPS for example, the determination of the angle of incidence of the measuring and / or illumination light on an object to be imaged is provided in relation to the optical axis of the imaging optics.
  • illumination light is intended to mean the light directed onto the scene or the object under the term measuring light that of the scene or the object coming and corresponding to be evaluated by the respective application light to be understood.
  • artificial sources are provided for the illumination or measuring light, they can optionally be operated continuously or pulsed. If the system according to the invention is operated as a spectral video system, the sequence in which the moving images are recorded must be synchronized with the pulse frequency of the light source in such a way that the image is always taken when the scene or object is illuminated, so that periodically repetitive processes or periodically recurring events are made visible, for example, in order to be able to detect temporally progressive changes.
  • means are provided for classifying imaged objects on the basis of their spectral properties, the classification being carried out for example under chemically, medically or agronomically revealing aspects.
  • a superimposition of the live image can be carried out with a spectral measurement in which the sequence of image acquisition is greater than the sequence with which the spectral analysis takes place.
  • the image sensor is used in some areas for the spectral measurement and partially for the live image.
  • two cameras are preferably provided in the system, of which one of the spectral measurement and the second is reserved for the live image.
  • a marking of the image portion is made in which the spectral measurement takes place
  • a superimposition of the live image are made with a spectral measurement in which the sequence of image acquisition corresponds to the sequence with which the spectral analysis is performed.
  • the image and spectral information recorded in real time are processed and processed in the same image sequences.
  • the system according to the invention can be operated as a spectral video stroboscope system, wherein a synchronization to the operating frequency of the existing light sources for the purpose of time allocation of lighting and recording is provided.
  • applications using the time sequence are useful, in which the dynamic history is to be visualized.
  • the system according to the invention is additionally equipped with a shutter, which preferably has a reaction time in the nanosecond range.
  • the shutter serves to link the beam path for image generation with the beam path for spectral measurement and makes it possible to perform spectral measurement and image generation sequentially in time with the shutter control, which is advantageous in terms of time-resolved spectroscopy, especially in the case of rapid temporal changes to the measurement objects.
  • the optoelectronic system according to the invention is equipped with a 3D camera, which is preferably provided with the time-of-flight function, the spectral measurements can be carried out with time resolution.
  • the distance determination to the object is nevertheless possible. Furthermore, it is thereby possible to measure transit time differences for the measurement of information from the temporal signal behavior of certain substances and applications and to provide them for further processing, such as, for example, the so-called FLIM technique (Fluorescence Lifetime Imaging Microscopy), the ion-sensitive fluorescent dyes for measuring intracellular ion concentrations used.
  • FLIM Fluorescence Lifetime Imaging Microscopy
  • the fluorescence lifetime that is, the average residence time of the electrons in the excited state, changes with the ion concentration.
  • ambient light or artificial light can be used to illuminate the scenes or objects to be recorded.
  • the source of artificial light may be internal light sources, with optional optics, or external light sources that may also be pulsed, for example stroboscopic flashlights or TOF based 3D equipment.
  • the spectral resolution of the Total system can be realized by the number of light sources the entire spectral wavelength range - even outside the RGB color space - covers, use of a light source for fluorescence excitation in planar illumination, use of natural light sources for fluorescence spectroscopy excitation, - temporally successive illumination of the scene or of the object with light of different optical properties, such as polarization, intensity, wavelength or spectral range,
  • diffuse illumination for example by means of an interposed microlens array or inserted plane mirror optics, in order to avoid energy or light losses,
  • adaptive optical elements in the beam paths of the illumination and / or measurement light to influence the wavefront and thereby correct, for example, aberrations of the participating optical assemblies.
  • the reference is "white” on one channel during parallel referencing, and the measurement information on the other channels.From a region of the image sensor to which no light falls, the reference "black” is obtained. Depending on the applicative task to be solved, however, the measurement of an additional dark signal can also be provided.
  • the referencing preferably takes place simultaneously and with each image.
  • DE 195 28 855 A1 describes a device in which renewed referencing between the measurements is possible with little effort.
  • a separate reference beam path is used, and the measurement beam path is merged via a Y light guide with the reference beam path, wherein in each optical fiber branch a switchable shutter is arranged.
  • the Y-light guide with shutter serves as an optical switch, and the cross section of the common beam path between the switch and the spectrometer is split between the reference beam and the beam path. This common beam path is coupled into the inlet opening of the spectrometer.
  • a second camera for example with an installation position with respect to the detection or light entry direction offset by an angle of 180 ° to the first camera, can be used for reference measurement for the intensity of the ambient light, regardless of which light sources for object or Scene lighting are provided.
  • a use of the optoelectronic system according to the invention is also possible without a white reference, which - although not detrimental for certain applications - reduces the accuracy of measurement, but at the same time advantageously reduces the production costs.
  • the means for determining the spectral properties In order to calibrate the wavelength of the illumination light, it is provided, for example, to subject the means for determining the spectral properties to a one-time calibration immediately after the system has been manufactured. If necessary, or each time a predetermined period has elapsed, then e.g. be recalibrated with designed as line sources light sources. For this purpose, a selection is made manually or automatically from a data memory in which the parameters of a plurality of line sources are stored.
  • the transmission of information takes place between the individual functional groups or modules via interfaces within the system or bidirectionally by wired or wireless communication with external units, including subordinate evaluation routines and taking into account the application-related use.
  • the feedback to the user is realized by the following procedures:
  • Spectral information with, for example, chemometrically relevant statements are coupled with other information and represented as "augmented reality", which is to be understood in the sense of the present invention as the computer-aided extension of the perception of reality, which includes all human sensory perceptions
  • the information can be used for machine vision, and in the context of the invention all forms of computer-aided solution of tasks can be considered which are based on the capabilities of the human visual
  • the light coupled out of the observation beam path of an imaging optics for the micro, macro, near and far ranges is transmitted into the beam path for determining the spectral properties of one or more objects contained in the scene to be imaged, with the aim of obtaining the spectral information to determine and evaluate.
  • Unknown spectral properties of the object are measured and classified.
  • the spectral identification can be used for identical replication, that is to say for the storage of the data relating to the spectral properties obtained at several different locations and synchronization of these data sources.
  • FIG. 1 shows the optoelectronic system according to the invention in a first embodiment, consisting of a first, designed as a spectrometer intent assembly and a second module with the functions of a smartphone, in the camera of the smartphone only the coming of an object light passes, the Spectrometer intent has happened
  • FIG. 2 shows the basic illustration of a second exemplary embodiment, comprising a spectrometer intent, a smartphone having two cameras, an internal light source for object illumination and means for referencing the illumination light,
  • Figure 3 shows the schematic diagram of a third embodiment, formed from a spectrometer-intent and a smartphone with a camera, which comes directly into the imaging optics of the smartphone light coming from the object and at the same time separate light that has passed the spectrometer intent, and wherein the light entering the imaging optics is separated within the smartphone or directed together to an image sensor,
  • FIG. 4 shows the basic illustration of a fourth exemplary embodiment, consisting of two spectrometer attachments and a smartphone, which has two cameras, wherein an external natural or artificial light source for scene or object illumination is provided in the imaging optics of a first camera directly from the object coming light and light that has passed the first spectrometer intent, while in the second camera only light enters the second spectrometer intent has happened,
  • FIG. 5 shows the schematic representation of a fifth embodiment, consisting of a spectrometer intent and a smartphone having two cameras, both cameras, in contrast to the examples of Figure 2 and Figure 4 have the same light incident direction, in the first camera directly light coming from the object passes, and only light which has passed the spectrometer intent is passed into the second camera.
  • FIG. 6 is a schematic diagram of a sixth exemplary embodiment, consisting of a smartphone with a camera and an external spectrometer, with light coming directly from the object into the camera and into the spectrometer,
  • FIG. 7 shows the basic representation of a further exemplary embodiment, consisting of a smartphone with a camera and an integrated spectrometer, with light coming directly from the object into the camera and into the spectrometer in each case.
  • a multichannel prism spectrometer designed in the form of a spectrometer intent 1, has three channels 2, 3 and 4 by way of example, with which three different spectra of the measuring light beam 5 coming from an object 11 can be measured simultaneously.
  • the spectrometer comprises light columns S2, S3 and S4 associated with the individual channels, lens groups with collimator function L1 .2, L1 .3 and L1 .4, lens groups L2.2, L2.3 and L2.4 with telescope function and a prism P as a dispersive optical element.
  • Fig.1a a plan view of the said and symbolically indicated functional elements of the spectrometer, the lying in the plane of adjacent channels 2, 3, 4 can be seen.
  • 1b shows the same representation in a side view, in which the channels 2, 3, 4, concealing each other, lie behind one another.
  • the measuring light enters the light gaps S2, S3, S4 at the same time, passes through the channels 2, 3, 4, exits via an interface 5 from the spectrometer attachment 1 and subsequently into a camera which, for example, substantially an objective O, a zoom optics Z and a spatially resolving image sensor B.
  • the camera is preferably part of a smartphone 6.
  • the term "smart phone” is to be understood as meaning devices which have the functions and functional components of a mobile telephone with a PDA (personnel Digital Assistant). They are equipped with at least one digital camera, GPS and WLAN receivers and internal power supply, and in addition to the processor have several data memories, for example a very fast but volatile main memory (RAM), a non-volatile NAND flash memory for the operating system and programs. me, and optional removable media, for example in the form of mass storage. In addition to the operating system, the user can install application programs. The synchronization of data with external data storage and data processing equipment is possible.
  • the spectrometer intent 1 passes into the camera of the smartphone 6 as measurement light.
  • the image generation and the spectral analysis are carried out immediately in time.
  • the spectral analysis or the measurement of the three different spectra is carried out simultaneously using three different areas B1, B2 and B3 of the image sensor B.
  • the detection of the different spectra with separate sensors is possible and is within the scope of the invention.
  • the optoelectronic system according to the invention comprising a dual-channel spectrometer front attachment 1 and a smartphone 6.
  • the smartphone 6 has two cameras 7 and 8.
  • the cameras 7, 8 have 180 degrees offset from each other and thus opposite light incidence directions.
  • Both cameras 7, 8 are commercially equipped with the required for generating static or moving images of a scene or a single object optical components and beam paths.
  • the optoelectronic system according to the invention is equipped with an internal light source 9.
  • the camera 7 is preceded by the spectrometer intent 1, the camera 8 is used for image generation.
  • the light coming from the light source 9 is via a first beam path 10 as illuminating light to be imaged and spectrally analyzed object 1 1 and at the same time via a second beam path 12 as a reference light by means of mirror 13 in the spectrometer intent 1 and this subsequently in the camera. 7 directed.
  • the light coming from the object 1 1 passes as measuring light over a beam path 14 in the spectrometer intent 1 and at the same time as imaging light over a beam path 15, for example by means of mirrors 16 and 17 deflected into the second camera 8.
  • the image generation and spectral analysis are provided at the same time.
  • the optoelectronic system in one exemplary embodiment according to FIG. 3 consists of a spectrometer intent 1 and a smartphone 6 with a camera 7.
  • Ambient light is used to illuminate the object 11.
  • the measuring light coming from the object 1 1 passes via a beam path 18 in the spectrometer intent 1 and then into the camera 7 and at the same time as imaging light over a beam path 19 directly into the camera 7.
  • the beam paths for spectral analysis and the beam paths for image production run separately, and the image generation and spectral analysis are at the same time by means of a flat image sensor.
  • the light entering the imaging optics is separated within the smartphone or directed together at the image sensor.
  • a second spectrometer intent 20 is disposed upstream, which is used for referencing the illumination light.
  • a natural or artificial light source 21 is provided to illuminate the spectrally analyzed object 1 1.
  • the illumination light is directed via a beam path 22 through the spectrometer intent 20 in the camera 8 and at the same time on a beam path 23 to the object 1 1.
  • the measuring light coming from the object 11 is, as in FIG. 3, directed via a beam path 18 through the spectrometer intent 1 into the first camera 7 and at the same time directly into the camera 7 via a beam path 19.
  • FIG. 5 shows a further embodiment with a smartphone 6 which has two cameras 7 and 8. Both cameras 7, 8 have here - unlike in the examples of Figure 2 and Figure 4 - no opposite directions of light incidence.
  • To illuminate the object 1 1 ambient light is used.
  • the measuring light coming from the object 11 is directed via a beam path 18 through the spectrometer intent 1 into the first camera 7 and at the same time via a beam path 19 into the second camera 8.
  • the beam paths for spectral analysis and the beam paths for image generation run separately, and the image generation and the spectral analysis are carried out simultaneously by means of a flat image sensor or two flat image sensors. In the case of using an image sensor, separate area sections are used for spectral analysis and image generation. If two image sensors are used, one of them serves for spectral analysis, the second for image generation.
  • FIG. 6 shows an exemplary embodiment in which the optoelectronic system according to the invention is formed from a smartphone 6 with a camera 7 and an external spectrometer 24.
  • an artificial light source 25 is provided to illuminate the object 1 1.
  • the illumination light is directed onto the object 11 via a beam path 26.
  • the coupling of the spectrometer 24 to the smartphone 6 takes place via cable 27.
  • FIG. 7 shows the basic illustration of a further exemplary embodiment, consisting here of a smartphone 6 with a camera 7 and an integrated spectrometer 28.
  • a smartphone 6 with a camera 7 and an integrated spectrometer 28.
  • the beam paths for spectral analysis and the beam paths for image generation run separately, and the image generation and the spectral analysis are carried out simultaneously by means of a flat image sensor or two flat image sensors.
  • image sensor separate area sections are used for spectral analysis and image generation. If two image sensors are used, one of them serves the spectral analysis, the second of the image generation.
  • the weight of the optoelectronic system according to the invention is a maximum of 1 kg, so that in this respect, the conditions of a hand-held device are met.
  • the use of the optoelectronic system according to the invention takes place e.g. for the purpose of color determination in the context of
  • Color sensors for monitors, printing technology, video or digital projectors for the correction of color values, or
  • Color sensors for building applications for color determination of surfaces, objects, etc. and subsequent controlled color matching in various applications.
  • - military applications eg visualization of warfare agents, camouflage, etc., collection of food information regarding safety, condition, nutritional value, etc.
  • agronomic applications such as chlorophyll determination, plant status, rating, soil information, etc., where the reflection properties of derive information on vegetation indices and the health status of plants, eg
  • Skin protection detectors for the purpose of warning of health-damaging UV radiation instead of the known systems based on intensity measurements.
  • the spectrometer-based measuring system is used to differentiate the UV-A, UV-B and UV-C components and separate evaluation of the individual and sum signals over the course of time, thermography detectors, also connected to thermometer applications,
  • Fire and smoke detectors where the flames are detected due to their characteristic frequency and spectral radiation. Fire gases are detected by comparing a picture or spectrum of the same image with smoke. This can also be done in the NIR area so as not to affect the user.
  • the alarm message is preferably carried out on site acoustically or by radio.
  • An essential component of the inventive idea is the link with metadata such as time, location, angle of view, the high degree of mobility and the coupling in the feedback as an augmented reality system.
  • a particularly advantageous application consists in the route guidance of the user when searching for objects with specific spectral properties within arbitrary scenes.

Landscapes

  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Spectrometry And Color Measurement (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)

Abstract

L'invention concerne un système optoélectronique miniaturisé servant à la génération d'images statiques ou animées de scènes ou d'objets individuels (11) et à la détermination et évaluation des propriétés spectrales des objets (11) à l'intérieur d'une scène ou également des objets individuels reproduits (11). Selon l'invention, un système de ce genre comprend des composants optiques et des trajectoires de rayonnement servant à générer des images statiques ou animées d'une scène ou d'un objet individuel (11), des composants optiques et des trajectoires de rayonnement servant à déterminer les propriétés spectrales d'un ou de plusieurs objets (11) compris dans la scène ou de l'objet individuel (11), au moins un capteur d'image servant de convertisseur optoélectronique, des composants électroniques servant au traitement des signaux de sortie du capteur d'image, une unité de sortie d'informations, réalisée pour la représentation de résultats de manière sensorielle, de préférence pour la représentation perceptible de manière visuelle des propriétés spectrales avec affectation aux objets (11), et des moyens d'alimentation électrique des composants électroniques. La présente invention concerne en outre une réalisation du système sous la forme d'un appareil portatif.
PCT/EP2012/070236 2011-10-12 2012-10-12 Système optoélectronique miniaturisé pour analyse spectrale Ceased WO2013053876A2 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP12816009.0A EP2766702A2 (fr) 2011-10-12 2012-10-12 Système optoélectronique miniaturisé pour analyse spectrale

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE201110084348 DE102011084348A1 (de) 2011-10-12 2011-10-12 Miniaturisiertes optoelektronisches System zur Spektralanalyse
DE102011084348.5 2011-10-12

Publications (2)

Publication Number Publication Date
WO2013053876A2 true WO2013053876A2 (fr) 2013-04-18
WO2013053876A3 WO2013053876A3 (fr) 2013-08-01

Family

ID=47561521

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2012/070236 Ceased WO2013053876A2 (fr) 2011-10-12 2012-10-12 Système optoélectronique miniaturisé pour analyse spectrale

Country Status (3)

Country Link
EP (1) EP2766702A2 (fr)
DE (1) DE102011084348A1 (fr)
WO (1) WO2013053876A2 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105473999A (zh) * 2013-08-30 2016-04-06 富士胶片株式会社 光学特性测量装置及光学特性测量方法
CN112105983A (zh) * 2018-05-08 2020-12-18 苹果公司 增强的视觉能力
US20230003641A1 (en) * 2020-01-21 2023-01-05 Omya International Ag Detection of an amorphous and/or crystalline structure of phosphate and/or sulphate salts on the surface of a substrate or within a substrate with a lwir imaging system

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE202015100749U1 (de) * 2015-02-17 2016-05-18 Tridonic Jennersdorf Gmbh Drahtloses Farbtemperatur-Sensormodul
DE102019102873B4 (de) 2019-02-06 2022-01-20 Carl Mahr Holding Gmbh Sensorsystem und Verfahren zur Bestimmung von geometrischen Eigenschaften eines Messobjekts sowie Koordinatenmessgerät
CN110118750A (zh) * 2019-05-13 2019-08-13 江南大学 基于智能手机的手持式分光光度计

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19528855A1 (de) 1995-08-05 1997-02-06 Leybold Ag Verfahren und Vorrichtung zur spektralen Remissions- und Transmissionsmessung
US20100309454A1 (en) 2007-11-30 2010-12-09 Jingyun Zhang Spectrometers miniaturized for working with cellular phones and other portable electronic devices

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005008200A2 (fr) * 2003-07-18 2005-01-27 Chemimage Corporation Method and apparatus for compact dispersive imaging spectrometer
EP1880165A2 (fr) * 2005-03-24 2008-01-23 Infotonics Technology Center, Inc. Systeme d'imagerie par radiometrie spectrale et procedes associes
US7420663B2 (en) * 2005-05-24 2008-09-02 Bwt Property Inc. Spectroscopic sensor on mobile phone
US8081244B2 (en) * 2006-07-24 2011-12-20 Michael Golub Snapshot spectral imaging systems and methods
WO2009087617A1 (fr) * 2008-01-04 2009-07-16 Seethrough Ltd. Procédé et appareil de spectroscopie haute résolution et d'imagerie spectrale
US8305577B2 (en) * 2010-11-04 2012-11-06 Nokia Corporation Method and apparatus for spectrometry

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19528855A1 (de) 1995-08-05 1997-02-06 Leybold Ag Verfahren und Vorrichtung zur spektralen Remissions- und Transmissionsmessung
US20100309454A1 (en) 2007-11-30 2010-12-09 Jingyun Zhang Spectrometers miniaturized for working with cellular phones and other portable electronic devices

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ZACHARY J. SMITH, CENTER FOR BIOPHOTONICS SCIENCE AND TECHNOLOGY

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105473999A (zh) * 2013-08-30 2016-04-06 富士胶片株式会社 光学特性测量装置及光学特性测量方法
EP3040708A4 (fr) * 2013-08-30 2016-08-31 Fujifilm Corp Dispositif et procédé de mesure de caractéristiques optiques
CN105473999B (zh) * 2013-08-30 2018-01-19 富士胶片株式会社 光学特性测量装置及光学特性测量方法
CN112105983A (zh) * 2018-05-08 2020-12-18 苹果公司 增强的视觉能力
US11709370B2 (en) 2018-05-08 2023-07-25 Apple Inc. Presentation of an enriched view of a physical setting
US20230003641A1 (en) * 2020-01-21 2023-01-05 Omya International Ag Detection of an amorphous and/or crystalline structure of phosphate and/or sulphate salts on the surface of a substrate or within a substrate with a lwir imaging system

Also Published As

Publication number Publication date
WO2013053876A3 (fr) 2013-08-01
DE102011084348A1 (de) 2013-04-18
EP2766702A2 (fr) 2014-08-20

Similar Documents

Publication Publication Date Title
EP2443503B1 (fr) Dispositif et procédé pour la microscopie par fluorescence multiphotonique visant à recueillir des informations de tissus biologiques
EP2766702A2 (fr) Système optoélectronique miniaturisé pour analyse spectrale
DE102014226342B4 (de) Wärmebildkamera
WO2012034852A1 (fr) Système d'imagerie optique pour l'imagerie multispectrale
EP2851662A2 (fr) Dispositif et procédé d'enregistrement d'une image hyperspectrale
US9551613B2 (en) Mobile phone hyperspectral imager with single-frame spatial, spectral and polarization information
DE102015001032B4 (de) Raman-Spektroskopie-Beleuchtungs- und Auslesesystem
DE102011100507B4 (de) Tragbares optisches Analysegerät
EP2895844B1 (fr) Dispositif comprenant un agencement d'éléments optiques
WO2017133810A1 (fr) Spectromètre miniature et procédé de commutation d'un spectromètre miniature entre un mode de reproduction et un mode spectromètre
DE102011115717A1 (de) Handgehaltenes Fernglas mit Spektrometer
WO2022023474A1 (fr) Procédé de détection de lumière d'émission, dispositif de détection et microscope à balayage laser
US10395134B2 (en) Extraction of spectral information
DE102016219388A1 (de) Verfahren zur kontaktfreien Ermittlung einer zweidimensionalen Temperaturinformation sowie Wärmebildkamera
US11815462B2 (en) Broadband Raman excitation spectroscopy with structured excitation profiles
DE102019205512B4 (de) Vorrichtung und verfahren zur auswertung von spektralen eigenschaften eines messobjekts
DE102012016337B4 (de) Verfahren zum Bestimmen einer optischen Qualität eines Fotomoduls
Kutteruf et al. 9-band SWIR multispectral sensor providing full-motion video
DE102020127964B4 (de) Verfahren und Vorrichtung zum schnellen Erfassen eines hyperspektralen Kubus eines Objekts oder einer Szene
WO2013054162A1 (fr) Système d'imagerie
Hoover et al. Utilising ultrafast lasers for multiphoton biomedical imaging
DE102023120635A1 (de) System und Verfahren zur Erfassung von Lichtstrahlung
JP2019095280A (ja) 分光測定システム及び分光測定方法
Zakrzewski et al. Advances in hyperspectral imaging technologies for multichannel fiber sensing
EP4163621A1 (fr) Surveillance optique de l'indice de végétation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12816009

Country of ref document: EP

Kind code of ref document: A2

REEP Request for entry into the european phase

Ref document number: 2012816009

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2012816009

Country of ref document: EP