WO2018163641A1 - Dispositif d'observation, système d'observation, procédé de commande pour dispositif d'observation et support d'enregistrement enregistré avec un programme de commande pour dispositif d'observation - Google Patents
Dispositif d'observation, système d'observation, procédé de commande pour dispositif d'observation et support d'enregistrement enregistré avec un programme de commande pour dispositif d'observation Download PDFInfo
- Publication number
- WO2018163641A1 WO2018163641A1 PCT/JP2018/002305 JP2018002305W WO2018163641A1 WO 2018163641 A1 WO2018163641 A1 WO 2018163641A1 JP 2018002305 W JP2018002305 W JP 2018002305W WO 2018163641 A1 WO2018163641 A1 WO 2018163641A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- input
- unit
- observation
- imaging
- control unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- C—CHEMISTRY; METALLURGY
- C12—BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
- C12M—APPARATUS FOR ENZYMOLOGY OR MICROBIOLOGY; APPARATUS FOR CULTURING MICROORGANISMS FOR PRODUCING BIOMASS, FOR GROWING CELLS OR FOR OBTAINING FERMENTATION OR METABOLIC PRODUCTS, i.e. BIOREACTORS OR FERMENTERS
- C12M1/00—Apparatus for enzymology or microbiology
- C12M1/34—Measuring or testing with condition measuring or sensing means, e.g. colony counters
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
Definitions
- the present invention relates to an observation apparatus, an observation system, an observation apparatus control method, and a recording medium on which an observation apparatus control program is recorded.
- Japanese Patent Application Laid-Open No. 2007-110932 relates to a cell culture device that acquires images by photographing cells in culture using a color camera and manages a culture schedule based on the obtained images.
- This cell culture device judges the necessity of medium replacement or passage work based on an image obtained by photographing, and automatically performs medium replacement or passage work when necessary.
- an apparatus for controlling all of the operations such as management of culture schedule and medium exchange and subculture such as a cell culture apparatus disclosed in Japanese Patent Application Laid-Open No. 2007-110932, becomes large-scale.
- the structure of the apparatus becomes simpler when the observation is performed according to a predetermined observation schedule and the operations such as medium replacement and passage are performed according to the user's judgment and operation as necessary.
- An object of the present invention is to temporarily stop an operation sequence with a simple operation in an apparatus that performs imaging according to a predetermined operation sequence.
- an observation apparatus includes an imaging optical system and an imaging element, and an imaging unit that images a sample to generate image data, a moving mechanism that moves the imaging unit, and a temporary stop
- an operation input unit configured to input the operation, and according to a predetermined operation sequence
- the position of the imaging unit is moved by the moving mechanism, and the image data generated by causing the imaging unit to capture the image data is acquired.
- a control unit that acquires an input to the operation input unit and temporarily stops the operation sequence according to the input.
- an observation system includes an imaging optical system and an imaging element, and an imaging unit that images a sample to generate image data, a moving mechanism that moves the imaging unit, and a temporary stop
- an operation input unit configured to input the operation, and according to a predetermined operation sequence
- the position of the imaging unit is moved by the moving mechanism, and the image data generated by causing the imaging unit to capture the image data is acquired.
- an observation device having a first control unit for acquiring an input to the operation input unit, An instruction to move the position of the imaging unit to the control unit, an instruction to cause the imaging unit to perform imaging, and an instruction to temporarily stop the operation sequence in response to an input to the operation input unit.
- an imaging unit that includes an imaging optical system and an imaging element and captures a sample to generate image data, a moving mechanism that moves the imaging unit, and an operation for pause are input.
- the method for controlling an observation apparatus including an operation input unit configured to be generated by causing the moving mechanism to move the position of the imaging unit and causing the imaging unit to capture an image according to a predetermined operation sequence. Acquiring the processed image data, and acquiring an input to the operation input unit and temporarily stopping the operation sequence according to the input.
- the operation sequence in an apparatus that performs shooting according to a predetermined operation sequence, can be paused with a simple operation.
- FIG. 1 is a schematic diagram illustrating an outline of an appearance of an observation system according to an embodiment.
- FIG. 2 is a block diagram illustrating an outline of a configuration example of an observation system according to an embodiment.
- FIG. 3 is a schematic diagram for explaining observation of a sample by the image acquisition unit according to the embodiment.
- FIG. 4 is a timing chart for explaining an example of a project executed by the observation system according to the embodiment.
- FIG. 5 is a schematic diagram illustrating an outline of an example of a configuration of a project management file according to an embodiment.
- FIG. 6 is a flowchart illustrating an outline of an example of processing performed by the controller of the observation system according to the embodiment.
- FIG. 7 is a flowchart illustrating an outline of an example of processing performed by the observation device of the observation system according to the embodiment.
- FIG. 8A is a flowchart illustrating an outline of an example of a project control process performed by the observation apparatus according to an embodiment.
- FIG. 8B is a flowchart illustrating an outline of an example of a photographing operation process performed by the observation apparatus according to the embodiment.
- FIG. 8C is a flowchart illustrating an outline of an example of the interval operation process performed by the observation apparatus according to the embodiment.
- FIG. 8D is a flowchart illustrating an outline of an example of an interval stop process performed by the observation apparatus according to an embodiment.
- FIG. 8A is a flowchart illustrating an outline of an example of a project control process performed by the observation apparatus according to an embodiment.
- FIG. 8B is a flowchart illustrating an outline of an example of a photographing operation process performed by the observation apparatus according to the embodiment.
- FIG. 8C is a flowchart
- FIG. 8E is a flowchart illustrating an outline of an example of a stop process during photographing performed by the observation apparatus according to an embodiment.
- FIG. 9 is a timing chart for explaining an example of a project executed by the observation system according to the embodiment.
- FIG. 10 is a schematic diagram showing an outline of an example of the configuration of a project management file according to an embodiment.
- FIG. 11 is a schematic diagram illustrating an outline of an example of the configuration of a project management file according to an embodiment.
- FIG. 12 is a timing chart for explaining an example of a project executed by the observation system according to the embodiment.
- the observation system is a system for photographing a cell, a cell group, a tissue or the like in culture and recording the number, form, etc. of the cell or cell group.
- FIG. 1 is a schematic diagram showing an outline of the appearance of the observation system 1.
- FIG. 2 is a block diagram showing an outline of a configuration example of the observation system 1.
- the observation system 1 includes an observation device 100 and a controller 200.
- the observation apparatus 100 has a substantially flat plate shape.
- a sample 300 to be observed is arranged on the upper surface of the observation apparatus 100, and the observation apparatus 100 and the sample 300 are installed in, for example, an incubator.
- an X axis and a Y axis that are orthogonal to each other are defined in a plane parallel to the plane on which the sample 300 of the observation apparatus 100 is arranged, and a Z axis is defined to be orthogonal to the X axis and the Y axis. .
- the observation apparatus 100 includes a housing 101, a transparent plate 102, and an image acquisition unit 150.
- a transparent plate 102 is disposed on the upper surface of the housing 101.
- the image acquisition unit 150 is provided inside the housing 101, illuminates the sample 300 through the transparent plate 102, and captures an image of the sample 300.
- the controller 200 is installed outside the incubator, for example.
- the observation apparatus 100 and the controller 200 communicate with each other.
- the controller 200 transmits various instructions to the observation apparatus 100 and acquires and analyzes data obtained from the observation apparatus 100.
- the observation system 1 can photograph a wide range of the sample 300 by performing repeated photographing while the image acquisition unit 150 moves in the X-axis direction and the Y-axis direction in one observation operation. In addition, the observation system 1 repeatedly performs such an observation operation while providing intervals according to a predetermined sequence.
- a sample 300 that is a measurement target of the observation system 1 is, for example, as follows.
- the sample 300 includes, for example, a container 310, a culture medium 322, cells 324, and a reflection plate 360.
- a medium 322 is placed in the container 310, and cells 324 are cultured in the medium 322.
- the container 310 can be, for example, a petri dish, a culture flask, a multiwell plate, or the like.
- the container 310 is a culture container for culturing a biological sample, for example.
- the shape, size, etc. of the container 310 are not limited.
- the medium 322 may be a liquid medium or a solid medium.
- the cell 324 to be measured is, for example, a cultured cell, which may be an adhesive cell or a floating cell.
- the cell 324 may be a spheroid or a tissue.
- the cell 324 may be derived from any organism, and may be a fungus or the like.
- the sample 300 includes a biological sample that is a living organism or a sample derived from a living organism.
- the reflection plate 360 is for illuminating the cells 324 by reflecting the illumination light incident on the sample 300 via the transparent plate 102, and is disposed on the upper surface of the container 310.
- the transparent plate 102 disposed on the upper surface of the casing 101 of the observation apparatus 100 is made of, for example, glass.
- the sample 300 is placed on the transparent plate 102.
- FIG. 1 shows an example in which the entire upper surface of the housing 101 is formed of a transparent plate, but the observation apparatus 100 is provided with a transparent plate on a part of the upper surface of the housing 101. The other part of the upper surface may be configured to be opaque.
- the transparent plate 102 may be provided with a mark. Further, in order to unify the position where the sample 300 is arranged and to fix the sample 300, a fixing frame may be put on the transparent plate 102 and used.
- the image acquisition unit 150 provided inside the housing 101 includes an imaging unit 151, an illumination unit 155, and a support unit 165. As shown in FIG. 1, the illumination unit 155 is provided on the support unit 165. In addition, an imaging unit 151 is provided in the vicinity of the illumination unit 155 of the support unit 165.
- the illumination unit 155 includes an illumination optical system 156 and a light source 157.
- the illumination light emitted from the light source 157 is irradiated onto the sample 300 via the illumination optical system 156.
- the light source 157 includes, for example, an LED.
- the imaging unit 151 includes an imaging optical system 152 and an imaging element 153.
- the imaging unit 151 generates image data based on an image formed on the imaging surface of the imaging element 153 via the imaging optical system 152.
- the imaging optical system 152 is preferably a zoom optical system that can change the focal length.
- the imaging unit 151 captures the direction of the sample 300, that is, the Z-axis direction, and acquires an image of the sample 300.
- FIG. 3 is a schematic diagram showing an outline of a configuration example of the image acquisition unit 150 and a sample.
- the illumination light emitted from the illumination optical system 156 of the illumination unit 155 provided on the support unit 165 is irradiated toward the reflection plate 360 provided on the upper surface of the container 310, and the reflection plate 360. Reflect on.
- the reflected light illuminates the cell 324 and enters the imaging optical system 152 of the imaging unit 151.
- the imaging unit 151 performs a shooting operation on the light incident on the imaging optical system 152.
- the observation apparatus 100 includes a moving mechanism 160.
- the moving mechanism 160 includes an X feed screw 161 and an X actuator 162 for moving the support portion 165 in the X-axis direction.
- the moving mechanism 160 includes a Y feed screw 163 and a Y actuator 164 for moving the support portion 165 in the Y-axis direction.
- the shooting position in the Z-axis direction is changed by changing the focus position of the imaging optical system 152 of the imaging unit 151.
- the imaging optical system 152 includes a focusing adjustment mechanism for moving the focusing lens in the optical axis direction, for example.
- the moving mechanism 160 may include a Z feed screw and a Z actuator for moving the support portion 165 in the Z-axis direction.
- the observation apparatus 100 repeatedly captures images using the imaging unit 151 while acquiring the plurality of images at different positions while changing the position of the image acquisition unit 150 in the X direction and the Y direction using the moving mechanism 160.
- the observation apparatus 100 may generate an image representing one wide range by combining these images.
- the observation apparatus 100 performs repeated shooting while changing the position in the X direction and the Y direction while changing the shooting position in the Z-axis direction, and synthesizes them to form an image at each Z-direction position. May be acquired sequentially. In this way, an image in each three-dimensional part may be acquired.
- the housing 101 is provided with a first stop button 181 and a second stop button 182 as the operation input unit 180.
- the first stop button 181 is a button that is pressed when the user replaces the medium. When the first stop button 181 is pressed, the operation of the observation apparatus 100 is temporarily stopped.
- the second stop button 182 is a button that is pressed when the user performs substituting work, and when the second stop button 182 is pressed, the operation of the observation apparatus 100 is temporarily stopped.
- the subsequent operation of the observation apparatus 100 may be different when the first stop button 181 is pressed and when the second stop button 182 is pressed. In the following description, it is not necessary to distinguish between the first stop button 181 and the second stop button 182, and when any button is acceptable, it is simply described as a stop button.
- the observation apparatus 100 includes a circuit group 104.
- the circuit group 104 includes an observation-side control circuit 110, an image processing circuit 120, an observation-side recording circuit 130, an observation-side communication device 140, and a clock unit 172.
- the observation-side recording circuit 130 records, for example, a program used in each part of the observation apparatus 100, various control parameters, a movement pattern of the image acquisition unit 150, and the like.
- the observation-side recording circuit 130 records data obtained by the observation apparatus 100. This data includes a project management file, an image file, etc., which will be described later.
- the image processing circuit 120 performs various types of image processing on the image data obtained by the imaging unit 151. Data after image processing by the image processing circuit 120 is recorded in, for example, the observation-side recording circuit 130 or transmitted to the controller 200. Further, the image processing circuit 120 may perform various analyzes based on the obtained image. For example, the image processing circuit 120 may extract an image of a cell or cell group included in the sample 300 based on the obtained image, calculate the number of cells or cell groups, and the like. The analysis result obtained in this way is also recorded in the observation-side recording circuit 130 or transmitted to the controller 200, for example.
- the observation side control circuit 110 controls the operation of each unit included in the observation apparatus 100.
- the observation-side control circuit 110 includes functions as a position control unit 111, an imaging control unit 112, an illumination control unit 113, a communication control unit 114, a recording control unit 115, and a measurement control unit 116.
- the position control unit 111 controls the operation of the moving mechanism 160 and controls the position of the image acquisition unit 150.
- the imaging control unit 112 controls the imaging operation of the imaging unit 151.
- the illumination control unit 113 controls the operation of the illumination unit 155.
- the communication control unit 114 manages communication with the controller 200 via the observation side communication device 140.
- the recording control unit 115 controls recording of data obtained by the observation apparatus 100.
- the recording control unit 115 records an image file in the observation-side recording circuit 130, or creates or updates a project management file described later.
- the measurement control unit 116 performs various controls related to the execution of the project, such as observation and interval switching, operation pause and restart switching, and the like.
- the clock unit 172 generates time information and outputs it to the observation side control circuit 110.
- the observation side control circuit 110 records various operation histories as a project management file using the time information.
- the controller 200 is, for example, a personal computer (PC), a tablet information terminal, or the like.
- FIG. 1 illustrates a tablet information terminal.
- the controller 200 is provided with an input / output device 270 including a display device 272 such as a liquid crystal display and an input device 274 such as a touch panel.
- the input device 274 may include a switch, dial, keyboard, mouse, and the like in addition to the touch panel.
- the controller 200 is provided with a terminal side communication device 240.
- the terminal side communication device 240 is a device for communicating with the observation side communication device 140.
- the observation apparatus 100 and the controller 200 communicate with each other via the observation side communication apparatus 140 and the terminal side communication apparatus 240.
- the controller 200 includes a terminal side control circuit 210 and a terminal side recording circuit 230.
- the terminal side control circuit 210 controls the operation of each unit of the controller 200.
- the terminal-side recording circuit 230 records programs and various parameters used in the terminal-side control circuit 210, for example.
- the terminal-side recording circuit 230 records data obtained by the observation device 100 and received from the observation device 100.
- the terminal-side control circuit 210 has functions as a system control unit 211, a display control unit 212, a recording control unit 213, and a communication control unit 214.
- the system control unit 211 performs various calculations related to control for measurement of the sample 300.
- the display control unit 212 controls the operation of the display device 272.
- the recording control unit 213 controls information recording in the terminal-side recording circuit 230.
- the communication control unit 214 controls communication with the observation device 100 via the terminal side communication device 240.
- the terminal-side control circuit 210 may perform various analyzes based on images acquired from the observation apparatus 100. For example, the terminal-side control circuit 210 may extract a cell or cell group image included in the sample 300 based on the obtained image, calculate the number of cells or cell groups, and the like.
- the observation-side control circuit 110, the image processing circuit 120, and the terminal-side control circuit 210 include an integrated circuit such as Central Processing Unit (CPU), Application Specific Integrated Circuit (ASIC), or Field Programmable Gate Array (FPGA).
- the observation side control circuit 110, the image processing circuit 120, and the terminal side control circuit 210 may each be configured by one integrated circuit or the like, or may be configured by combining a plurality of integrated circuits. Further, the observation side control circuit 110 and the image processing circuit 120 may be configured by one integrated circuit or the like. The operation of these integrated circuits can be performed, for example, according to a program recorded in the observation-side recording circuit 130, the terminal-side recording circuit 230, or the integrated circuit.
- the observation-side recording circuit 130 and the terminal-side recording circuit 230 may include, for example, a non-volatile memory such as a flash memory, and a volatile memory such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM).
- SRAM Static Random Access Memory
- DRAM Dyna
- FIG. 4 is a timing chart showing an outline of an example of one project. In this project, n observations are made at intervals.
- the operation sequence includes a sequence related to an operation period in which the imaging unit 151 or the moving mechanism 160 is operated and a sequence related to an interval period in which the operation of the imaging unit 151 or the moving mechanism 160 is paused.
- the observation interval between observations can be set as appropriate by the user.
- a record relating to the implemented project is recorded in one project management file.
- a schematic diagram of an example of the project management file 610 is shown in FIG.
- various histories related to a project are sequentially recorded in one project management file 610.
- Each record that is sequentially recorded is referred to as management information.
- the project management file 610 includes a plurality of management information.
- Each piece of management information records time information.
- the time information may be, for example, information related to the date and time when an event to be recorded as management information occurs, or may be information on elapsed time based on the start of the project.
- information indicating how many times the observation is related is recorded in each management information.
- Each management information includes information regarding various operations, a file name of image data obtained by the operations, and the like.
- step S101 the terminal-side control circuit 210 determines whether or not there has been an input request for setting the project by the user. For example, when the user selects a setting input request using the input device 274, it is determined that there is a project setting input request. When there is no project setting input request, the process proceeds to step S103. On the other hand, when there is a project setting input request, the process proceeds to step S102.
- step S103 the terminal-side control circuit 210 determines whether or not there has been a request to start a project. For example, when the user selects a project start request using the input device 274, it is determined that there is a project start request. When there is no request to start a project, the process proceeds to step S105. On the other hand, when there is a request to start a project, the process proceeds to step S104.
- step S104 the terminal-side control circuit 210 performs a process of transmitting a project start instruction to the observation apparatus 100. That is, the controller 200 transmits a project start instruction to the observation device 100 via the terminal side communication device 240. At this time, the controller 200 transmits the project settings, operation sequence, and the like recorded in the terminal-side recording circuit 230 to the observation apparatus 100. Thereafter, the process proceeds to step S105.
- step S105 the terminal-side control circuit 210 determines whether or not there is a data analysis request. For example, when the user selects a data analysis request using the input device 274, it is determined that there is a data analysis request. When there is no data analysis request, the process proceeds to step S109. On the other hand, when there is a request for data analysis, the process proceeds to step S106.
- step S107 the terminal-side control circuit 210 acquires the data transmitted from the observation apparatus 100 to the controller 200 in response to the data transmission instruction described above via the terminal-side communication apparatus 240.
- step S108 the terminal-side control circuit 210 performs various analyzes on the acquired data. For example, the terminal-side control circuit 210 creates a composite image based on a plurality of images, or counts the number of cells included in the image. Thereafter, the process proceeds to step S109.
- step S109 the terminal-side control circuit 210 determines whether or not to end the processing of the controller.
- the process returns to step S101. That is, the above-described processing for performing processing according to the input from the user is repeated. On the other hand, when it is determined to end, the processing of the controller ends.
- step S201 the observation-side control circuit 110 determines whether a project start instruction has been received.
- This project start instruction is the project start instruction transmitted from the controller 200 to the observation apparatus 100 in step S104 of the controller process.
- the process proceeds to step S203.
- the process proceeds to step S202.
- step S202 the observation-side control circuit 110 performs a project control process for controlling a project executed by the observation apparatus 100.
- the observation apparatus 100 acquires observation data and the like.
- the project control process will be described in detail later. After the project control process, the process proceeds to step S203.
- step S203 the observation side control circuit 110 determines whether or not a data transmission instruction has been received.
- This data transmission instruction is a data transmission instruction transmitted from the controller 200 to the observation apparatus 100 in step S106 of the controller process.
- the process proceeds to step S205.
- the process proceeds to step S204.
- step S204 the observation-side control circuit 110 performs a data transmission process for transmitting data acquired by the observation apparatus 100 in the project to the controller 200. Based on the data transmitted here, for example, data analysis in step S108 of the controller process is performed. After the data transmission process, the process proceeds to step S205.
- step S205 the observation side control circuit 110 determines whether or not to end the processing of the observation apparatus. If the observation device process is not terminated, the process returns to step S201. That is, the above-described processing for performing processing according to the input from the controller 200 is repeated. On the other hand, when it is determined to end, the processing of the observation apparatus ends.
- the observation-side control circuit 110 performs project setting. For example, the observation-side control circuit 110 sets a project based on information acquired from the controller 200 together with a project start instruction. As described with reference to FIG. 4, for example, the following is set for the project. The start timing of the first observation is set. Also, the number of observation repetitions is set. In addition, an interval (observation interval) between observations when observation is repeatedly performed is set. Instead of the number of observations, a time indicating how long the observation is repeated, that is, a project end time or the like may be set. In addition, an observation range in each observation, a focal length of the imaging optical system 152, an exposure time, and the like can be set. If these settings are determined, the time required for one observation is determined.
- step S302 the observation side control circuit 110 starts a project.
- the observation side control circuit 110 performs various processes at the start of the project. This processing includes creation of a project management file.
- step S304 the observation side control circuit 110 performs a photographing operation process.
- photographing is repeated at different positions while the image acquisition unit 150 is moved by the moving mechanism 160.
- an image of the set observation range is acquired.
- the process proceeds to step S305.
- step S402 the observation-side control circuit 110 causes the imaging unit 151 to perform an AE / AF operation. That is, the imaging unit 151 adjusts the aperture position, shutter speed, and the like according to the exposure conditions, and adjusts the focus position.
- the observation-side control circuit 110 causes the imaging unit 151 to perform a shooting operation and generate image data.
- the observation side control circuit 110 causes the image processing circuit 120 to perform image processing on the generated image data, and causes the observation side recording circuit 130 to record the created image file.
- step S405 the observation side control circuit 110 determines whether or not the stop button has been pressed. When the stop button is pressed, the process proceeds to step S406. In step S ⁇ b> 406, the observation side control circuit 110 performs a photographing stop process. The stop processing during shooting will be described later. After the shooting stop process, the process returns to step S401.
- step S405 When it is determined in step S405 that the stop button has not been pressed, the process proceeds to step S407.
- step S407 the observation-side control circuit 110 determines whether or not the observation position has reached the end. That is, it is determined whether or not a series of observations in which a predetermined range of imaging is performed while moving the image acquisition unit 150 is completed. If the observation position has not reached the end, the process returns to step S401. That is, the image acquisition unit 150 moves, the imaging unit 151 performs shooting, and the project management file 610 is updated accordingly.
- management information is recorded in order of management information 613 of time information 3,... Management information 614 of time information n, management information 615 of time information n + 1. It will be done.
- the management information 615 of the time information n + 1 is management information regarding the photographing position n at the end of the observation position.
- step S407 When it is determined in step S407 that the observation position has reached the end, the shooting operation process ends, and the process returns to the project control process.
- step S305 the observation-side control circuit 110 changes the state of the observation apparatus 100 to the interval state. For example, the position of the image acquisition unit 150 is returned to the initial position by the moving mechanism 160. In addition, when the interval period is long, power supply to unnecessary portions is stopped for energy saving.
- step S306 the observation side control circuit 110 updates the project management file.
- the observation side control circuit 110 writes the management information 616 of the time information n + 2 in the project management file 610.
- the management information 616 includes information indicating that the photographing operation of the observation 1 has been completed at the time of the time information n + 2.
- step S307 the observation-side control circuit 110 performs interval operation processing.
- the interval operation process will be described with reference to FIG. 8C.
- FIG. 8C is a flowchart illustrating an outline of an example of the interval operation process.
- step S501 the observation side control circuit 110 determines whether or not the stop button has been pressed. When it is determined that the stop button has been pressed, the process proceeds to step S502. In step S502, the observation-side control circuit 110 performs a stop process during the interval. The stop processing during the interval will be described later.
- step S501 When it is determined in step S501 that the stop button has not been pressed, the process proceeds to step S503.
- the observation side control circuit 110 determines whether or not the interval period has elapsed. When it is determined that the interval period has not elapsed, the process returns to step S501. On the other hand, when it is determined that the interval period has elapsed, the interval operation process ends, and the process returns to the project control process. Thus, the process waits until the interval period elapses.
- step S307 the observation-side control circuit 110 determines whether or not to end the running project. For example, when the observation of a predetermined number of times or a period is finished, the project ends. If it is determined not to end the project, the process proceeds to step S309.
- step S309 the observation side control circuit 110 updates the project management file.
- the observation side control circuit 110 writes management information 617 of time information n + 3 in the project management file 610.
- the management information 617 information indicating that imaging of the second observation (observation 2) is started in the time information n + 3 is recorded.
- the interval between the time information n + 2 and the time information n + 3 is the length of the interval.
- step S310 the observation side control circuit 110 restarts the project. For this reason, the observation-side control circuit 110 restarts the supply of power to each unit that has been stopped, for example, during the interval period. Thereafter, the process returns to step S304. That is, the photographing operation process is performed again.
- shooting result information such as management information 618 of time information n + 4 is recorded in the project management file 610.
- the state of the observation apparatus 100 is stopped. In the stop state, the observation apparatus 100 does not perform the next observation operation even after the interval period has elapsed.
- the user changes the medium of the sample 300 or performs the subculture work of the sample 300.
- the user who has completed the medium exchange or subculture operation and installed the sample 300 in the observation apparatus 100 presses the stop button again. It is assumed that the stop button is pressed again at the time indicated by B2 in FIG. At this time, the observation apparatus 100 resumes the project. If the preset interval period has elapsed, the next observation (observation n + 1) is started when the stop button is pressed again. If the interval period has not elapsed when the stop button is pressed, the next observation (observation n + 1) is performed after the interval period has elapsed.
- the stop button is provided with a first stop button 181 and a second stop button 182.
- the first stop button 181 is a button that is pressed when the medium is exchanged.
- the second stop button 182 is a button that is pressed when performing the substituting work.
- the photographing conditions such as the exposure condition and the focus position are not changed before and after the pause. For this reason, when photographing conditions are determined, it is preferable to inherit the conditions even after a temporary stop. Even in the case of medium replacement, it is of course possible to change the imaging conditions.
- the photographing conditions such as the exposure condition and the focus position may be readjusted after the pause. Even in the case of the subculture work, it is of course possible not to change the photographing conditions.
- FIG. 8D is a flowchart illustrating an outline of an example of a stop process during an interval.
- step S601 the observation-side control circuit 110 updates the stop button information in which the history of pressing the first stop button 181 and the second stop button 182 is recorded.
- step S602 the observation side control circuit 110 updates the project management file.
- FIG. 10 shows an example of the project management file 620 when the stop button is pressed during the interval period after the completion of the m-th observation (observation m).
- records of the m-th observation (observation m) are recorded as management information 621 of time information n, management information 622 of time information n + 1, and management information 623 of time information n + 2. That is, when the m-th observation is completed, information indicating that the observation m has been completed is recorded in the project management file 620 as the management information 623 of the time information n + 2.
- step S603 the observation side control circuit 110 determines whether or not the interval period has elapsed. When the interval period has not elapsed, the process proceeds to step S604.
- step S604 the observation-side control circuit 110 determines whether or not the stop button has been pressed. If the stop button has not been pressed, the process returns to step S603. That is, the processing in steps S603 and S604 is repeatedly waited until the stop button is pressed or the interval period elapses.
- step S604 When it is determined in step S604 that the stop button has been pressed, the process proceeds to step S605.
- step S605 the observation side control circuit 110 updates the stop button information.
- step S606 the observation-side control circuit 110 refers to the stop button information and determines whether or not the pressed stop button is the same as the latest pressed stop button. That is, it is determined whether or not the same stop button has been pressed twice.
- the process returns to step S603.
- the process proceeds to step S607.
- step S607 the observation side control circuit 110 updates the project management file.
- FIG. 11 shows an example of the project management file 630 when the project management file is updated when a different stop button is pressed.
- management information 631 of time information n management information 632 of time information n + 1, management information 633 of time information n + 2, and information of observation m are recorded, and management information 634 of time information n + 3 is recorded for the first time.
- the pressed stop button is the first stop button 181, and information indicating that stop 1 has started is recorded.
- a second stop button 182 different from the first stop button 181 pressed for the first time is pressed to the time information n + 4
- the stop 1 ends and the stop 2 related to the second stop button 182 Is recorded in the management information 635.
- step S607 After the project management file is updated in step S607, the process returns to step S603. Thus, until the interval period elapses, the history of pressing the stop button is recorded as stop button information, and when a different stop button is pressed, that fact is recorded in the project management file.
- step S603 When it is determined in step S603 that the interval period has elapsed, the process proceeds to step S608.
- step S608 the observation-side control circuit 110 refers to the stop button information and determines whether or not the same stop button has been pressed even times. When the same stop button is pressed continuously even times, as shown in FIG. 9, the process proceeds to step S613 so as to end the stop state and move to the next observation operation. For example, when the same stop button as the first pressed stop button is pressed once before the interval period elapses, since the same stop button is continuously pressed twice, the process proceeds to step S613. .
- step S608 When it is determined in step S608 that the same stop button has not been pressed continuously evenly, the process proceeds to step S609.
- step S609 the observation-side control circuit 110 determines whether or not the stop button has been pressed. When the stop button is not pressed, the process repeats step S609 and waits. On the other hand, when the stop button is pressed, the process proceeds to step S610.
- step S610 the observation-side control circuit 110 refers to the stop button information and determines whether or not the pressed stop button is the same as the latest pressed stop button. That is, it is determined whether or not the same stop button has been pressed twice.
- the process proceeds to step S613 so as to end the stopped state and move to the next observation operation.
- the process proceeds to step S611.
- step S613 the observation-side control circuit 110 refers to the stop button information and determines whether the latest pressed stop button is the first stop button 181 or the second stop button 182. When the latest pressed stop button is the first stop button 181, the process proceeds to step S614.
- step S614 the observation side control circuit 110 sets the project setting to a value corresponding to the first stop button 181. Since the first stop button 181 is a button that is pressed when the medium is replaced, for example, the imaging conditions such as the exposure condition and the focus position are not changed. Thereafter, the process proceeds to step S616.
- step S613 when it is determined that the most recently pressed stop button is the second stop button 182, the process proceeds to step S615.
- step S615 the observation-side control circuit 110 sets the project setting to a value corresponding to the second stop button 182. Since the second stop button 182 is a button that is pressed during the substituting work, for example, photographing conditions such as an exposure condition and a focus position are changed. Thereafter, the process proceeds to step S616.
- step S616 the observation side control circuit 110 updates the project management file.
- the project management file 620 shown in FIG. 10 information indicating that the stop 1 has been completed is recorded as the management information 625 of the time information n + 4.
- information indicating that the stop 2 has been completed is recorded as the management information 636 of the time information n + 5.
- the process returns to the interval operation process shown in FIG. 8C and further returns to the project control process shown in FIG. 8A.
- the project management file is updated in step S309.
- information indicating that the shooting operation is started is recorded like the management information 626 of the time information n + 5, and then the management of the time information n + 6 is performed in the shooting operation processing in step S304.
- Shooting information such as information 627 and management information 628 of time information n + 7 is recorded.
- the example of the project management file 630 shown in FIG. 11 information indicating that the shooting operation is started is recorded as in the management information 637 of the time information n + 6, and then the time information is recorded in the shooting operation processing in step S304.
- Shooting information such as management information 638 of n + 7 is recorded.
- the project is paused, and when the same stop button is pressed, the project is resumed.
- the start and end times of the pause and information such as whether the pause is caused by pressing the first stop button 181 or the second stop button 182 are recorded in the project management file.
- FIG. 12 shows a timing chart when the stop button is pressed during the photographing operation.
- the example shown in FIG. 12 shows an example when the stop button is pressed during the n-th observation (observation n). It is assumed that the stop button is pressed at the timing indicated by B1 in FIG. At this time, the observation apparatus 100 stops the n-th observation and temporarily stops the project. The observation apparatus 100 once discards the image obtained by the n-th observation. Then, when the stop button is pressed again, the project is resumed. It is assumed that the stop button is pressed at the timing indicated by B2 in FIG. At this time, the observation apparatus 100 restarts the n-th observation (observation n) from the beginning. By discarding an image or the like obtained by photographing performed halfway, the state of the sample 300 can be prevented from changing during one observation.
- FIG. 8E is a flowchart illustrating an outline of an example of the stop processing during shooting.
- step S701 the observation side control circuit 110 updates the stop button information.
- step S702 the observation-side control circuit 110 deletes the image file obtained by, for example, the n-th observation (observation n) that is the observation in which the stop button is pressed. Further, for the project management file, the observation-side control circuit 110 deletes, for example, management information related to the n-th observation (observation n), and writes information related to the pressing of the stop button in the management information. For example, in the example of the project management file 620 shown in FIG. 10, if the stop button is pressed during the n-th observation after the observation m, the observation-side control circuit 110 records the management information 623 in which the photographing of the observation m is recorded. Information such as later shooting start and shooting information is once deleted. Thereafter, the observation-side control circuit 110 writes the stop information like the management information 624 of the time information n + 3.
- step S703 the observation side control circuit 110 determines whether or not the stop button has been pressed. When the stop button is not pressed, the process repeats step S703 and waits until the stop button is pressed. On the other hand, when the stop button is pressed, the process proceeds to step S704.
- step S704 the observation side control circuit 110 refers to the stop button information and determines whether or not the pressed stop button is the same as the latest pressed stop button. That is, it is determined whether or not the same stop button has been pressed twice. When the pressed stop button is not the same as the latest pressed stop button, the process proceeds to step S705.
- step S705 the observation-side control circuit 110 updates the stop button information for the pressed stop button.
- step S706 the observation side control circuit 110 updates the project management file. For example, as in the example of the management information 635 of the time information n + 4 of the project management file 630 shown in FIG. 11, the information on pressing the stop button is updated. Thereafter, the process returns to step S703 to wait for the next stop button to be pressed.
- step S704 when it is determined that the pressed stop button is the same as the latest pressed stop button, the process proceeds to step S707 so as to end the pause state and restart the observation operation.
- step S707 the observation-side control circuit 110 refers to the stop button information and determines whether the most recently pressed stop button is the first stop button 181 or the second stop button 182. When the most recently pressed stop button is the first stop button 181, the process proceeds to step S708. In step S708, the observation side control circuit 110 sets the project setting to a value corresponding to the first stop button 181. Thereafter, the process proceeds to step S710.
- step S707 when it is determined that the most recently pressed stop button is the second stop button 182, the process proceeds to step S709.
- step S ⁇ b> 709 the observation side control circuit 110 sets the project setting to a value corresponding to the second stop button 182. Thereafter, the process proceeds to step S710.
- step S710 the observation side control circuit 110 updates the project management file.
- the project management file 620 shown in FIG. 10 information indicating that the stop 1 has been completed is recorded as the management information 625 of the time information n + 4.
- information indicating that the stop 2 has been completed is recorded as the management information 636 of the time information n + 5.
- step S711 the observation side control circuit 110 restarts the project. Thereafter, the process returns to the photographing operation process shown in FIG. 8B, and the process returns to step S401. That is, the movement and photographing of the image acquisition unit 150 are repeated.
- the project is paused, and when the same stop button is pressed, the project is resumed.
- the acquired image file and management information related to the n-th observation in the middle are deleted, and the start and end times of the pause and whether the pause is caused by pressing the first stop button 181 are included in the project management file.
- Information about whether or not the second stop button 182 is temporarily stopped is recorded.
- the observation system 1 when a simple operation such as pressing the stop button is performed, the project is temporarily stopped.
- the observation schedule is determined in advance, for example, an inappropriate operation such as a photographing operation being performed when the sample 300 is not installed in the observation apparatus 100 is prevented, and observation at an appropriate timing is performed. Is done.
- the stop button is provided in the observation apparatus 100 as a first stop button 181 and a second stop button 182.
- the first stop button 181 is a stop button for exchanging the medium
- the second stop button 182 is a stop button for the subculture work.
- the observation apparatus 100 is provided with a stop button corresponding to the work performed by the user. For this reason, the operation after the resumption of the project after the first stop button 181 is pressed and the operation after the resumption of the project after the second stop button 182 is pressed are appropriately selected according to each work. Can be.
- the fact that the stop button has been pressed and whether the pressed stop button is the first stop button 181 or the second stop button 182 is recorded in the project management file. For this reason, referring to the project management file will reveal when and why the project was suspended.
- the stop is caused by any stop button.
- the information indicating whether or not is updated. For this reason, even if the user erroneously inputs the reason for the suspension, the information can be updated to correct information by an easy method.
- the number of medium exchanges may be recorded in the project management file.
- the observation-side control circuit 110 may count the number of times the first stop button 181 has been pressed, and record the counted result as the number of medium exchanges. Of the number of times that the first stop button has been pressed, the number of times determined to be valid excluding the number of times determined to be invalid due to a mistake in pressing or the like may be counted as the number of times of medium replacement.
- the number of medium exchanges is recorded, for example, in the management information 625 of the project management file 620 together with the recording of the stop end of stop 1. Thereafter, the number of medium exchanges updated together with the record of the stop end of stop 1 may be similarly recorded in the management information.
- the number of medium exchanges may be continuously recorded in the management information to be updated every time the first stop button is pressed and stop 1 occurs.
- the number of substituting operations may be recorded in the project management file.
- the observation-side control circuit 110 may count the number of times that the second stop button 182 has been pressed, and record the counted result as the number of subculture operations.
- the recording of the number of subculture operations can be performed in the same manner as the recording of the number of medium replacements.
- the number of medium exchanges or the number of subculture operations is manually input. May be.
- the user counts the number of times before or after pressing the first stop button 181 to end the stop 1 by the operation of the first stop button 181.
- An input operation may be performed.
- step S606 to step S607 the processing from step S610 to step S612
- the processing from step S704 to step S706, and the like can be deleted.
- operations that change the processing according to the type of the stop button such as the processing in steps S613 to S615 and the processing in steps S707 to S709, can be deleted.
- the project control process is performed by the observation-side control circuit 110.
- the terminal-side control circuit 210 of the controller 200 may perform project control processing.
- the observation apparatus 100 transmits various information to the controller 200.
- input information to the operation input unit 180 is also transmitted to the controller 200.
- the project management file may be recorded in the terminal-side recording circuit 230 or may be recorded in the observation-side recording circuit 130.
- the image file may be recorded in the observation-side recording circuit 130, or may be transmitted to the controller 200 and recorded in the terminal-side recording circuit 230.
- the stop button of the operation input unit 180 has been described as a button, the operation input unit 180 is not limited to a button, and may be any of various types of input means having the same function. Moreover, although the case where the instruction
- the analysis of the data obtained by the observation apparatus 100 may be performed by the controller 200 or the observation apparatus 100.
- the above-described function may be performed by either the observation apparatus 100 or the controller 200, and the above-described function may be realized as the entire observation system 1.
- the number of passages may be obtained by acquiring the number of times of temporary stop by the second stop button 182.
- the passage number can also be useful information as information related to the sample 300.
- control mainly described with reference to the flowchart can be realized using a program.
- This program can be stored in a recording medium or a recording unit.
- recording medium or recording unit There are various methods of recording on this recording medium or recording unit, which may be recorded at the time of product shipment, may be recorded using a distributed recording medium, or may be recorded using download via the Internet. May be.
Landscapes
- Chemical & Material Sciences (AREA)
- Engineering & Computer Science (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Zoology (AREA)
- Wood Science & Technology (AREA)
- Physics & Mathematics (AREA)
- Organic Chemistry (AREA)
- Biotechnology (AREA)
- Analytical Chemistry (AREA)
- General Engineering & Computer Science (AREA)
- Sustainable Development (AREA)
- Biochemistry (AREA)
- Microbiology (AREA)
- General Health & Medical Sciences (AREA)
- Genetics & Genomics (AREA)
- Biomedical Technology (AREA)
- Multimedia (AREA)
- Medicinal Chemistry (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Microscoopes, Condenser (AREA)
- Apparatus Associated With Microorganisms And Enzymes (AREA)
Abstract
L'invention concerne un dispositif d'observation (100) comprenant une unité d'imagerie (151), un mécanisme de déplacement (160), une unité d'entrée de fonctionnement (180) et un circuit de commande (110) côté observation. L'unité d'imagerie (151) comprend un système optique d'imagerie (152) et un élément d'imagerie (153) pour représenter en image un échantillon, générant ainsi des données d'image. Le mécanisme de déplacement (160) déplace l'unité d'imagerie (151). L'unité d'entrée de fonctionnement (180) est configurée pour recevoir une entrée pour le fonctionnement d'une suspension temporaire. L'unité de commande (110) côté observation amène le mécanisme de déplacement (160) à déplacer la position de l'unité d'imagerie (151) conformément à une séquence de fonctionnement prescrite, amène l'unité d'imagerie (151) à effectuer une imagerie pour acquérir les données d'image générées et acquiert une entrée à l'unité d'entrée de fonctionnement (180), la séquence de fonctionnement étant temporairement suspendue conformément à l'entrée.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2017-043727 | 2017-03-08 | ||
| JP2017043727A JP2018143200A (ja) | 2017-03-08 | 2017-03-08 | 観察装置及び観察システム |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2018163641A1 true WO2018163641A1 (fr) | 2018-09-13 |
Family
ID=63447636
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2018/002305 Ceased WO2018163641A1 (fr) | 2017-03-08 | 2018-01-25 | Dispositif d'observation, système d'observation, procédé de commande pour dispositif d'observation et support d'enregistrement enregistré avec un programme de commande pour dispositif d'observation |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP2018143200A (fr) |
| WO (1) | WO2018163641A1 (fr) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006011415A (ja) * | 2004-05-26 | 2006-01-12 | Olympus Corp | 培養顕微鏡、及び、培養顕微鏡を制御するコンピュータプログラム |
| JP2006220904A (ja) * | 2005-02-10 | 2006-08-24 | Olympus Corp | 顕微鏡写真装置および顕微鏡写真装置制御方法 |
| JP2008070259A (ja) * | 2006-09-14 | 2008-03-27 | Olympus Corp | 観察装置 |
| JP2009232710A (ja) * | 2008-03-26 | 2009-10-15 | Fujitsu Ltd | マイクロインジェクション装置、マイクロインジェクション方法、間欠撮影装置および間欠撮影方法 |
| WO2011021391A1 (fr) * | 2009-08-19 | 2011-02-24 | 国立大学法人名古屋大学 | Dispositif d'évaluation de cellules cultivées, incubateur et programme |
| WO2012127879A1 (fr) * | 2011-03-24 | 2012-09-27 | 株式会社ニコン | Équipement de culture, système d'équipement de culture, procédé et programme de gestion d'opération de culture |
| JP2012200181A (ja) * | 2011-03-24 | 2012-10-22 | Nikon Corp | 培養装置、培養管理方法およびプログラム |
-
2017
- 2017-03-08 JP JP2017043727A patent/JP2018143200A/ja active Pending
-
2018
- 2018-01-25 WO PCT/JP2018/002305 patent/WO2018163641A1/fr not_active Ceased
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006011415A (ja) * | 2004-05-26 | 2006-01-12 | Olympus Corp | 培養顕微鏡、及び、培養顕微鏡を制御するコンピュータプログラム |
| JP2006220904A (ja) * | 2005-02-10 | 2006-08-24 | Olympus Corp | 顕微鏡写真装置および顕微鏡写真装置制御方法 |
| JP2008070259A (ja) * | 2006-09-14 | 2008-03-27 | Olympus Corp | 観察装置 |
| JP2009232710A (ja) * | 2008-03-26 | 2009-10-15 | Fujitsu Ltd | マイクロインジェクション装置、マイクロインジェクション方法、間欠撮影装置および間欠撮影方法 |
| WO2011021391A1 (fr) * | 2009-08-19 | 2011-02-24 | 国立大学法人名古屋大学 | Dispositif d'évaluation de cellules cultivées, incubateur et programme |
| WO2012127879A1 (fr) * | 2011-03-24 | 2012-09-27 | 株式会社ニコン | Équipement de culture, système d'équipement de culture, procédé et programme de gestion d'opération de culture |
| JP2012200181A (ja) * | 2011-03-24 | 2012-10-22 | Nikon Corp | 培養装置、培養管理方法およびプログラム |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2018143200A (ja) | 2018-09-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4970869B2 (ja) | 観察装置および観察方法 | |
| US8497899B2 (en) | Biological sample image acquiring apparatus, biological sample image acquiring method, and program | |
| US20020089740A1 (en) | System for microscopic digital montage imaging using a pulse light illumination system | |
| US20050282268A1 (en) | Culture microscope and computer program controlling culture microscope | |
| JP2018022127A (ja) | 可変焦点距離撮像システム | |
| CN102027409A (zh) | 照相机系统 | |
| EP2924487B1 (fr) | Microscope optique et dispositif de mise au point automatique pour microscope optique | |
| US20200311922A1 (en) | Cell observation system and inference model generating method | |
| WO2014041820A1 (fr) | Microscope | |
| JP2017175517A (ja) | 撮像装置および撮像方法 | |
| CN111325785B (zh) | 高速tag透镜辅助3d计量和扩展景深成像 | |
| JP6698451B2 (ja) | 観察装置 | |
| CN107770419A (zh) | 观察装置、观察方法和观察系统 | |
| WO2018163641A1 (fr) | Dispositif d'observation, système d'observation, procédé de commande pour dispositif d'observation et support d'enregistrement enregistré avec un programme de commande pour dispositif d'observation | |
| US10275882B2 (en) | Observation apparatus, measurement system and observation method | |
| JP5909902B2 (ja) | オートフォーカス装置、顕微鏡装置 | |
| JP6330070B1 (ja) | 観察装置、観察システム及び観察装置の制御方法 | |
| JP6815787B2 (ja) | 観察装置、観察装置の制御方法及び観察装置の制御プログラム | |
| WO2021145347A1 (fr) | Dispositif de traitement d'image, machine-outil et procédé de traitement d'image | |
| JP2015082097A (ja) | 制御装置、顕微鏡システム、制御方法およびプログラム | |
| CN107151627A (zh) | 观察装置、测定系统、观察方法以及记录介质 | |
| US20170280051A1 (en) | Observation apparatus, measurement system, culture vessel and control method for observation apparatus | |
| JP6378869B2 (ja) | 顕微鏡、顕微鏡システム、制御方法およびプログラム | |
| JP2015072303A (ja) | 顕微鏡 | |
| CN115901749A (zh) | 尿液样本检测设备和尿液样本检测方法 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18764006 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 18764006 Country of ref document: EP Kind code of ref document: A1 |