[go: up one dir, main page]

WO2010113690A1 - Dispositif de traitement d'informations, procédé de traitement d'informations, et programme - Google Patents

Dispositif de traitement d'informations, procédé de traitement d'informations, et programme Download PDF

Info

Publication number
WO2010113690A1
WO2010113690A1 PCT/JP2010/054915 JP2010054915W WO2010113690A1 WO 2010113690 A1 WO2010113690 A1 WO 2010113690A1 JP 2010054915 W JP2010054915 W JP 2010054915W WO 2010113690 A1 WO2010113690 A1 WO 2010113690A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
slice
unit
group
slice information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2010/054915
Other languages
English (en)
Japanese (ja)
Inventor
恵 中尾
小太郎 湊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nara Institute of Science and Technology NUC
Original Assignee
Nara Institute of Science and Technology NUC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nara Institute of Science and Technology NUC filed Critical Nara Institute of Science and Technology NUC
Priority to JP2011507100A priority Critical patent/JP5493178B2/ja
Publication of WO2010113690A1 publication Critical patent/WO2010113690A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/003—Reconstruction from projections, e.g. tomography
    • G06T11/006—Inverse problem, transformation from projection-space into object-space, e.g. transform methods, back-projection, algebraic methods

Definitions

  • the present invention relates to an information processing apparatus or the like that can output an image showing a three-dimensional object or operate an image showing a three-dimensional object.
  • a surgical process is expressed using a medical image set (three-dimensional image) of a patient measured by CT, MRI, etc., and used for an operation plan, intraoperative support, clinical education, explanation to a patient, and the like.
  • a surgical simulation it is necessary to output information on the shape (structure), physical characteristics, and surgical content of a human body that is not included in the medical image set in a form desired by a doctor who is a user of the surgical simulation.
  • second mesh information acquisition is performed in which first mesh information of a stored three-dimensional object is deformed and second mesh information is acquired based on a deformation instruction that instructs deformation of the three-dimensional object.
  • a first slice information group that is a plurality of slice information based on the second mesh information and the color information of each point after deformation is determined from the stored 3D voxel information.
  • this information processing apparatus With this information processing apparatus, the change in the shape of the three-dimensional object can be depicted in real time with the color information on the surface and inside (see Patent Document 1).
  • WO 2006/013813 first page, FIG. 1 etc.
  • attribute values can be dynamically set for points (voxels) constituting a three-dimensional object, and output according to the attribute values cannot be performed.
  • attribute values can be dynamically set for points (voxels) constituting a three-dimensional object, and output according to the attribute values cannot be performed.
  • attribute values can be dynamically set for points (voxels) constituting a three-dimensional object, and output according to the attribute values cannot be performed.
  • voxels points constituting a three-dimensional object
  • the information processing apparatus is slice information that is information configured based on two-dimensional image data obtained by cutting out 3D voxel information, which is a volume texture of a three-dimensional object, in a plurality of planes.
  • a slice information group storage unit that stores a slice information group having a plurality of slice information composed of information of a plurality of points having position information that is information indicating a position and color information that is information about a color;
  • a slice information group output unit that outputs the slice information group, a reception unit that receives an instruction for the slice information group output by the slice information group output unit, and slice information corresponding to the instruction that the reception unit receives
  • the label information component constituting the label information which is the attribute value of the point to be changed, and the label information constituted by the label information component are changed.
  • An information processing apparatus for and a change object output portion that outputs the slice information group.
  • attribute values can be dynamically set for points (voxels) constituting a three-dimensional object, and output according to the attribute values becomes possible.
  • the information processing apparatus of the second invention is a first mesh information storage unit that stores first mesh information that is information of a three-dimensional mesh of a three-dimensional object, with respect to the first invention, Based on the instruction received by the receiving unit, the first mesh information is deformed, the second mesh information acquiring unit that acquires the second mesh information that configures the deformed shape, and the slice information group based on the second mesh information From the storage unit, each point of the first slice information group acquisition unit that acquires the first slice information group that is a plurality of slice information that does not have color information, and a plurality of slice information that constitutes the first slice information group, The color information determination unit that determines the color information of each point corresponding to the point of the 3D voxel information, and the first slice information group acquisition unit acquired based on the color information of each point determined by the color information determination unit Of slice information group A new color information is set for the point, and a second slice information group acquisition unit is provided for acquiring a second slice information group according to the label information configured by the label information
  • attribute values can be dynamically set for points (voxels) that make up a colored three-dimensional object, output according to the attribute value is possible, and deformation of a colored three-dimensional object is also possible. It becomes possible.
  • the object information storage unit 101 can store 3D voxel information that is a volume texture of a three-dimensional object.
  • the 3D voxel information is a set of two-dimensional images acquired by a medical device such as CT, MRI, or PET.
  • the 3D voxel information is, for example, a set of two-dimensional images obtained by photographing the human brain or the inside of the body by CT or MRI.
  • the 3D voxel information is, for example, information on a point configured by (x, y, z, col,), (x, y, z, col, elastic modulus), or the like.
  • (X, y, z) of (x, y, z, col, elastic modulus) is coordinate information in a three-dimensional space.
  • Cold is color information of the point.
  • Elastic modulus is a value indicating the elasticity of the point, and is an example of elasticity information.
  • the elastic modulus is, for example, Young's modulus, but may be a rigidity modulus, a volume elastic modulus, or the like.
  • Examples of elasticity information include, for example, Young's modulus, Poisson's ratio, rupture value, friction coefficient, and the like.
  • the point information may include transparency information that is information about transparency such as an alpha value.
  • the 3D voxel information is preferably information on points that are clogged with no interval between points, but may be information on discrete points.
  • the 3D voxel information is (x, y, z, col), and the elasticity information may be held as additional information to the 3D voxel information. In such a case, it may be considered that the 3D voxel information has elasticity information.
  • the object information storage unit 101 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium.
  • CT Computerputed Tomography
  • CT is a technique that scans an object using radiation or the like (X-rays) and processes it using a computer to construct an internal image of the object.
  • CT includes various inspection methods for obtaining cross-sectional images using a computer, such as positron tomography (PET), single photon emission tomography (SPECT), and nuclear magnetic resonance imaging (MRI).
  • the accepting unit 102 accepts an instruction for the slice information group output by the slice information group output unit 108.
  • the instruction received by the receiving unit 102 is, for example, an instruction for dividing the output three-dimensional object into a plurality of regions.
  • the plurality of regions may be three or more.
  • the instruction received by the receiving unit 102 is, for example, an instruction for specifying a cross section that divides the output three-dimensional object into a plurality of regions.
  • the cross section may be a curved surface.
  • the cross section may be two or more.
  • the accepting unit 102 usually accepts an instruction input by the input device 100.
  • reception means reception of information input from the input device 100 (input device such as a keyboard, mouse, touch panel), reception of information transmitted via a wired or wireless communication line, an optical disk or a magnetic disk, It is a concept including reception of information read from a recording medium such as a semiconductor memory.
  • the slice information is a set of information of points constituting the plane, and is usually packed with no space between the points.
  • the slice information group acquisition unit 103 can usually be realized by an MPU, a memory, or the like.
  • the processing procedure of the slice information group acquisition unit 103 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).
  • the slice information group storage unit 104 can store a slice information group having a plurality of slice information.
  • the slice information is information configured based on two-dimensional image data obtained by cutting out 3D voxel information, which is a volume texture of a three-dimensional object, on a plurality of planes.
  • the slice information includes position information that is information indicating a position and information on a plurality of points that have color information that is information about a color.
  • the points constituting the slice information may include position information, color information, and elasticity information.
  • the slice information group storage unit 104 may store a slice information group acquired from the 3D voxel information stored in the object information storage unit 101. Furthermore, the slice information group acquisition unit 103 may acquire the slice information group.
  • the slice information group storage unit 104 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium.
  • the process of storing the slice information group in the slice information group storage unit 104 does not matter.
  • a slice information group may be stored in the slice information group storage unit 104 via a recording medium, and a slice information group transmitted via a communication line or the like is stored in the slice information group storage unit 104.
  • the slice information group input via the input device may be stored in the slice information group storage unit 104.
  • the first mesh information storage unit 105 can store first mesh information that is information about a three-dimensional mesh of a three-dimensional object.
  • the three-dimensional mesh information is a set of information on points constituting the three-dimensional object.
  • the information of the three-dimensional mesh is a set of information on points that are spaced apart.
  • the point information here is usually information having a data structure of (x, y, z, col, elasticity information). However, the point information may be only coordinate information (x, y, z).
  • the first mesh information is preferably composed of a plurality of sampling position information described later.
  • the color information determination unit 1122 acquires the color information of each point in the 3D voxel information determined by the corresponding point determination unit 1121.
  • the color information determination unit 1122 can be usually realized by an MPU, a memory, or the like.
  • the processing procedure of the color information determination unit 1122 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).
  • the second slice information group acquisition unit 113 adds a new color to each point of the first slice information group acquired by the first slice information group acquisition unit 111 based on the color information of each point determined by the color information determination unit 112. Information is set, and the second slice information group is acquired according to the label information configured by the label information configuration unit 109. For example, when the label information is information indicating a cross section, the second slice information group acquisition unit 113 uses a predetermined method (may be referred to as a rule or algorithm) for color information of each point constituting the cross section. The color information of other points is acquired as the second slice information group that remains the color information (color) of each point of the first slice information group acquired by the first slice information group acquisition unit 111.
  • a predetermined method may be referred to as a rule or algorithm
  • the second slice information group acquisition unit 113 changes the color information of each point constituting the cross section to monochrome, and the other points.
  • the color information the second slice information group that remains the color information (color) of each point of the first slice information group acquired by the first slice information group acquisition unit 111 is acquired.
  • the label information is information indicating a cross section
  • the second slice information group acquisition unit 113 changes the color information of each point constituting the cross section to monochrome color information, and the label information is The color information is changed so that one region of the three-dimensional object divided by the indicated cross section is not displayed (here, the ⁇ value is 0), and the third order is divided by the cross section indicated by the label information.
  • FIG. 2 shows an image of the processing of the information processing apparatus 1 in such a case.
  • the color volume and the attribute volume are sent to the GPU, and the color volume (201) and the attribute volume (202) are rendered by the GPU.
  • a final output result (203) is obtained.
  • the processing until obtaining the color volume and the attribute volume is performed by the CPU (or MPU).
  • the processing until obtaining the color volume and the attribute volume may be performed by one CPU (MPU), or may be performed by two CPUs (MPU).
  • the means realized by the GPU is the second slice information group acquisition unit and the changed object output unit, or the changed object output unit.
  • the color volume is a group of 3D voxels after the density information of the 3D voxel group storing the density information of the three-dimensional object is converted into color information.
  • the attribute volume is a 3D voxel group in which label information is stored.
  • Step S301 The receiving unit 102 determines whether an instruction from the input device 100 (for example, a keyboard or a mouse) has been received. If an instruction is accepted, the process goes to step S302, and if no instruction is accepted, the process returns to step S301.
  • an instruction from the input device 100 for example, a keyboard or a mouse
  • Step S304 The receiving unit 102 determines whether or not the instruction received in Step S301 is an instruction to output a slice information group. If it is an output instruction, go to step S305, and if it is not an output instruction, go to step S307.
  • Step S305 The slice information group output unit 108 reads out the slice information group from the slice information group storage unit 104.
  • Step S307 The receiving unit 102 determines whether or not the instruction received in Step S301 is a rotation instruction for a three-dimensional object. If it is a rotation instruction, the process proceeds to step S308. If it is not a rotation instruction, the process proceeds to step S311.
  • Step S308 The slice information group acquisition unit 103 acquires a line-of-sight vector based on the rotation instruction received in step S301.
  • the line-of-sight vector is a vector perpendicular to the display surface of the display.
  • the rotation instruction is input by the input device 100 such as a mouse.
  • Step S310 The slice information group acquisition unit 103 at least temporarily accumulates the slice information group acquired in step S309 in the slice information group storage unit 104. Go to step S206.
  • Step S311 The label information configuration unit 109 determines whether or not the instruction received in step S301 is an instruction to configure label information. If the instruction constitutes label information, the process proceeds to step S312. If the instruction does not constitute label information, the process proceeds to step S314.
  • the instruction constituting the label information here is an instruction for designating a cross section.
  • the instruction to specify a cross section includes an instruction to rotate the cross section and an instruction to translate the cross section. An instruction to rotate the cross section or an instruction to translate the cross section is also an instruction to specify a new cross section.
  • Step S313 The second slice information group acquisition unit 113 acquires a second slice information group according to the label information configured in Step S312.
  • a slice information group configuration process that is a process of acquiring the second slice information group will be described with reference to the flowchart of FIG. Go to step S306.
  • step S303 Next, the mesh information accumulation process in step S303 will be described using the flowchart of FIG.
  • the sampling position information acquisition unit 106 acquires the division width x, y, z in the three-dimensional space.
  • the division widths x, y, and z are values indicating intervals when dividing the X axis, the Y axis, and the Z axis, respectively.
  • the sampling position information acquisition unit 106 acquires the maximum values of the X axis, the Y axis, and the Z axis in the three-dimensional space, reads a predetermined division number (n), and reads the X axis, the Y axis, and the Z axis.
  • a division width x, y, z that divides each maximum value into n equal parts is acquired.
  • Step S404 The sampling position information acquisition unit 106 substitutes 1 for the counter j.
  • Step S406 The sampling position information acquisition unit 106 substitutes 1 for the counter k.
  • the sampling position information acquisition unit 106 calculates sampling position information having position information that constitutes a point at which the three-dimensional space of the three-dimensional object is sampled.
  • the sampling position information acquisition unit 106 calculates sampling position information ((i ⁇ 1) ⁇ x, (i ⁇ 1) ⁇ y, (i ⁇ 1) ⁇ z).
  • Step S409 The sampling position information acquisition unit 106 determines that the point indicated by the sampling position information ((i ⁇ 1) ⁇ x, (i ⁇ 1) ⁇ y, (i ⁇ 1) ⁇ z) is within the three-dimensional object. It is determined whether or not it exists (including on its surface). If it exists in the three-dimensional object, it goes to step S410, and if it does not exist in the three-dimensional object, it goes to step S411.
  • the first mesh information accumulation unit 107 configures the first mesh information using the sampling position information acquired by the sampling position information acquisition unit 106, and stores the first mesh information in the first mesh information storage unit 105. accumulate.
  • the first mesh information has a structure of (x, y, z)
  • the first mesh information storage unit 107 performs sampling position information ((i ⁇ 1) ⁇ x, (i ⁇ 1) ⁇ y, (I-1) ⁇ z) is stored in the first mesh information storage unit 105 as it is.
  • Step S411 The sampling position information acquisition unit 106 increments the counter k by one. The process returns to step S407.
  • Step S413 The sampling position information acquisition unit 106 increments the counter i by one. The process returns to step S403.
  • FIG. 4 is merely an example of mesh information accumulation processing. It does not matter what algorithm is used to acquire the sampling position information constituting the first mesh information. Information indicating external points constituting the tetrahedron as described later may be used as the sampling position information.
  • step S409 is not essential.
  • Step S503 The second slice information group acquisition unit 113 substitutes 1 for the counter j.
  • Step S504 The second slice information group acquisition unit 113 determines whether there is an unprocessed j-th point in the i-th slice information. If the jth point exists, the process proceeds to step S505, and if the jth point does not exist, the process jumps to step S508. Note that “unprocessed” means that it has not been determined whether or not to make monochrome.
  • Step S505 The second slice information group acquisition unit 113 determines whether or not the j-th point is a point on the cross section indicated by the label information. If the j-th point exists on the cross section, the process proceeds to step S506. If the j-th point does not exist on the cross section, the process proceeds to step S508.
  • Step S508 The second slice information group acquisition unit 113 determines whether or not the j-th point exists in a predetermined region (for example, the right region) among the regions divided by the cross sections. . If it exists in the predetermined area, the process goes to step S509, and if it does not exist in the predetermined area, the process goes to step S507. Note that the predetermined region here is one side of the cross section.
  • Step S509 The second slice information group acquisition unit 113 sets the ⁇ value (transparency information) of the jth point to 0 (makes the jth point transparent). The point where the ⁇ value is 0 is transparent and is not displayed.
  • step S315 will be described using the flowchart of FIG.
  • Step S602 Based on the instruction received in Step S201, the second mesh information acquisition unit 110 deforms the first mesh information read in Step S601, and acquires second mesh information constituting the deformed shape. Since the process of deforming the mesh information based on the deformation instruction is a known technique (technique of the finite element method), detailed description thereof is omitted.
  • Step S702 The second slice information group acquisition unit 113 determines whether or not the i-th slice information (unprocessed slice information) exists in the first slice information group. If the i-th slice information exists, the process goes to step S703, and if the i-th slice information does not exist, the process returns to the upper function.
  • Step S704 The second slice information group acquisition unit 113 determines whether there is an unprocessed j-th point in the i-th slice information. If the jth point exists, the process goes to step S705, and if the jth point does not exist, the process jumps to step S709.
  • unprocessed means that no color information is set here.
  • Step S708 The second slice information group acquisition unit 113 increments the counter j by 1. The process returns to step S704.
  • the sampling position information acquisition unit 106 is a point in a three-dimensional space and automatically acquires position information of a point outside the tetrahedron. That is, organs such as the heart and lungs are three-dimensional objects and can be approximated by a set of tetrahedrons (regular tetrahedrons). Therefore, here, in order to simplify the description, a case where the tetrahedron shown in FIG. 9A is deformed will be described. In FIG. 9A, there are four points A, B, C, and O. Point P is a point inside the tetrahedron.
  • the sampling position information acquisition unit 106 divides the three-dimensional space into a set of tetrahedrons, and automatically acquires position information of the outer points constituting the tetrahedron. Note that the sampling position information acquisition unit 106 holds the length of each side of the regular tetrahedron in advance. Since the process of dividing the three-dimensional space into a set of regular tetrahedrons and automatically acquiring the position information of the outer points constituting the tetrahedron is a known technique, detailed description thereof is omitted.
  • the first mesh information accumulation unit 107 accumulates the sampling position information acquired by the sampling position information acquisition unit 106 in the first mesh information storage unit 105.
  • the first mesh information may be, for example, a set of information on the points outside and inside the tetrahedron (the points are spaced apart).
  • the reception unit 102 receives an output instruction for a slice information group.
  • the slice information group acquisition unit 103 is perpendicular to the line-of-sight vector and has a predetermined interval (the slice information group acquisition unit 103 holds the interval in advance).
  • a slice information group which is a plurality of slice information is acquired from the 3D voxel information.
  • the slice information group acquisition unit 103 obtains the positions “minD” and “maxD” of the three-dimensional object to be displayed, slices at a predetermined interval “D”, and acquires a plurality of slice information.
  • the slice information is a set of point information. Further, there is no interval between points constituting the slice information. That is, the plane indicated by the slice information is filled with point information.
  • the point information here has position information (x, y, z) and no color information.
  • the slice information group acquisition unit 103 acquires the slice information group shown in FIG.
  • the slice information group includes slice information S 1 , slice information S 2 , slice information S 3 and the like.
  • the slice information is acquired perpendicularly to the line-of-sight vector so that when the user looks at the set of slice information, even the thinned slice information can be seen stereoscopically.
  • the thinned slice information is acquired at a predetermined interval in order to speed up display processing. The reason why the slice information is acquired at regular intervals is to display a high-quality three-dimensional object.
  • the line-of-sight vector is a vector perpendicular to the screen, and changes according to the rotation instruction when the reception unit 102 receives the rotation instruction.
  • the slice information group acquisition unit 103 stores the acquired slice information group of FIG. 11 in the slice information group storage unit 104 at least temporarily.
  • the reception unit 102 receives a rotation instruction for the slice information group.
  • the slice information group acquisition unit 103 acquires a line-of-sight vector based on the received rotation instruction.
  • the slice information group acquisition unit 103 extracts, from the 3D voxel information stored in the object information storage unit 101, a plurality of slice information that is perpendicular to the line-of-sight vector and has a constant interval, and obtains a slice information group. get.
  • the slice information group acquisition unit 103 at least temporarily accumulates the acquired slice information group in the slice information group storage unit 104.
  • the slice information group output unit 108 outputs the acquired slice information group.
  • the user inputs an instruction for a predetermined point or region with respect to the output slice information group, and tries to deform the displayed three-dimensional tetrahedron.
  • Such an instruction is called a deformation instruction.
  • the deformation instruction is input by, for example, a phantom (a kind of input device 100) included in the information processing apparatus 1.
  • the input with the phantom is, for example, an input of pressing a tetrahedron point O shown in FIG. 9A to the left with a predetermined force.
  • the reception part 102 receives a deformation
  • the 2nd mesh information acquisition part 110 deform
  • the second mesh information is, for example, “A ′ (x ′ 1 , y ′ 1 , z ′ 1 )”, B (x ′ 2 , y ′ 2 , z ′ 2 ), C (x ′ 3 , y ′ 3 , z ′ 3 )... That is, the second mesh information is information indicating the tetrahedron in FIG.
  • transforms 1st mesh information and acquires 2nd mesh information is a well-known technique by a finite element method, detailed description is abbreviate
  • the corresponding point determination unit 1121 solves the equation (2) to obtain the parameters s, t, u defining the internal point P ′ from the deformed mesh, and the position P before the deformation from the equation (1). Get. Then, the color information corresponding to the position P is acquired from the 3D voxel information. Then, the color information determination unit 1122 acquires and sets color information of each point in the plurality of slice information constituting the first slice information group determined by the corresponding point determination unit 1121. As a result, each point constituting each piece of slice information after deformation in FIG. 14 has color information.
  • the changed object output unit 114 outputs the second slice information group.
  • the three-dimensional object after receiving the deformation instruction is output in real time.
  • biological function analysis in the medical field, real-time surgery simulation, and the like are possible.
  • FIG. 15 An example of output before deformation is shown in FIG. 15, and an example of output after deformation is shown in FIG. It is the output after deformation (FIG. 16) that the tip of the kidney before the deformation (FIG. 15) is pinched and deformed so as to extend to the spine side.
  • Such an input is, for example, an input for designating a cross section by pressing a “cross section” button using a mouse which is the input device 100.
  • the reception part 102 receives the input which designates a cross section.
  • the label information configuration unit 109 configures label information using the cross-section information corresponding to the received instruction.
  • the label information is position information (xa, ya, za) (xb, yb, zb) (xc, yc, zc) (xd, yd, zd) for specifying the cross section.
  • the second slice information group acquisition unit 113 is configured by position information (xa, ya, za) (xb, yb, zb) (xc, yc, zc) (xd, yd, zd) of four points.
  • the color information of the point on the cross section and on the three-dimensional object is changed to monochrome.
  • the second slice information group acquiring unit 113 leaves the color information of the points in one area of the three-dimensional area delimited by the cross section as the original color, and in the other area of the three-dimensional area delimited by the cross section.
  • the ⁇ value at the point is changed to 0 (not displayed).
  • the 2nd slice information group acquisition part 113 acquires the 2nd slice information group in which this change was performed.
  • attribute values can be dynamically set in accordance with a user instruction for points constituting a three-dimensional object. More specifically, according to the present embodiment, it is possible to output a three-dimensional object by cutting the three-dimensional object by a cross section and distinguishing color information of the cross section from others. In particular, by not displaying a part of the section of the section, the section of the three-dimensional object can be observed very well. This makes it extremely useful, for example, as a surgical simulation.
  • the cross section is monochrome, but the cross section may remain in color. Then, by making one of the cross sections undisplayed, the cross section can be observed in color.
  • the processing in the present embodiment may be realized by software. Then, this software may be distributed by software download or the like. Further, this software may be recorded on a recording medium such as a CD-ROM and distributed. This also applies to other embodiments in this specification. Note that the software that implements the information processing apparatus 1 in the present embodiment is the following program.
  • this program is slice information that is information configured based on two-dimensional image data obtained by cutting out 3D voxel information, which is a volume texture of a three-dimensional object, in a plurality of planes in a storage medium, A slice information group having a plurality of slice information composed of information on a plurality of points having position information which is information indicating positions and color information which is information on colors is stored, and a computer is stored in the storage medium.
  • a slice information group output unit that outputs the stored slice information group, a reception unit that receives an instruction for the slice information group output by the slice information group output unit, and a slice corresponding to the instruction that the reception unit receives
  • a label information constituting unit constituting label information which is an attribute value of a point constituting information, and a label constituted by the label information constituting unit.
  • a program to function as changing the object output portion that outputs the changed the slice information group.
  • the storage medium further stores first mesh information that is information of a three-dimensional mesh of a three-dimensional object
  • the computer is operated based on an instruction received by the receiving unit.
  • a second mesh information acquisition unit that deforms one mesh information and acquires second mesh information constituting the deformed shape, and a plurality of slices having no color information from the storage medium based on the second mesh information
  • a first slice information group acquisition unit for acquiring a first slice information group that is information, and a plurality of slice information constituting the first slice information group, each point corresponding to a point of the 3D voxel information
  • a first slice information acquired by the first slice information group acquisition unit based on the color information of each point determined by the color information determination unit Set new color information at each point of the group, and further function as a second slice information group acquisition unit that acquires a second slice information group according to the label information configured by the label information configuration unit
  • the changed object output unit is preferably a program for causing a computer to function as outputting the second slice information group.
  • the computer may further function as a sampling position information acquisition unit that acquires a plurality of sampling position information having position information that constitutes a point at which the three-dimensional space of the three-dimensional object is sampled, and the storage
  • the first mesh information stored in the medium is preferably a program composed of the plurality of sampling position information.
  • the label information is information indicating a cross section constituted by points output in an output manner different from other points.
  • the label information configuration unit 209 configures label information that is an attribute value of a point configuring one or more pieces of slice information in response to the instruction received by the reception unit 102.
  • the label information here is, for example, information for distinguishing between points to be output and points not to be output.
  • the label information here is, for example, a CT value at a boundary that distinguishes between points that are output and points that are not output. Further, the label information here may be information on a cross section indicating a boundary for distinguishing between a point to be output and a point not to be output.
  • each point of the plurality of slice information has a CT value or is associated with a CT value.
  • the plurality of slice information is slice information stored in the slice information group storage unit 104 and slice information to be output.
  • the second slice information group acquisition unit 213 adds a new color to each point of the first slice information group acquired by the first slice information group acquisition unit 111 based on the color information of each point determined by the color information determination unit 112. Information is set, and the second slice information group is acquired according to the label information configured by the label information configuration unit 209.
  • the second slice information group acquisition unit 213 holds information (transparent condition information) indicating a CT value condition for setting the ⁇ value to 0, and if a CT value at a certain point matches the transparent condition information, that point Set the ⁇ value to 0.
  • the operation of the information processing apparatus 2 is different from the operation of the information processing apparatus 1 (see FIG. 3) in the second slice information group configuration process in step S313.
  • the label information in the information processing apparatus 2 is information that distinguishes points that are output from points that are not output.
  • slice information group configuration processing of the information processing apparatus 2 will be described using the flowchart of FIG. In the flowchart of FIG. 21, the description of the same processing as that of the flowchart of FIG. 5 is omitted. It is assumed that the second slice information group acquisition unit 213 holds the transparency condition information in advance. Further, it is assumed that the transparency condition information can be changed by a user instruction.
  • Step S2101 The second slice information group acquisition unit 213 acquires the CT value of the j-th point.
  • Step S2102 The second slice information group acquisition unit 213 determines whether or not the CT value acquired in Step S2101 matches the transparency condition information. If it matches the transparency condition information, the process goes to step S2103, and if it does not match the transparency condition information, the process goes to step S2104.
  • a set of medical images (three-dimensional images) illustrated in FIG. 8 is stored in the object information storage unit 101 of the information processing apparatus 2.
  • the sampling position information acquisition unit 106 and the first mesh information storage unit 107 perform a mesh information storage process. Then, the first mesh information is accumulated in the first mesh information storage unit 105 by the mesh information accumulation process. Such processing has been described in the first embodiment.
  • the information processing apparatus 2 outputs an image as shown in FIG. FIG. 22 is an image in which the processing described in the first embodiment is performed and the kidney is cut by one cross section.
  • the point where the CT value matches the transparent condition information is not displayed by the processing described above in the second embodiment, and the blood vessels and the spine are not displayed. Only some of them are displayed. That is, the points constituting the skin, fat and the like whose CT value matches the transparent condition information are not displayed, and a part of the kidney whose CT value does not match the transparent condition information is displayed.
  • reference numeral 2301 denotes a bar indicating the boundary of CT values of points to be transparent.
  • 23 (a) and 23 (b) have a histogram of an image with grayscale values (CT values) on the x-axis in the background, and what color and opacity ( ⁇ value) each grayscale value is converted into.
  • CT values grayscale values
  • ⁇ value color and opacity
  • the map is such that the CT value is transparent up to about 100, and gradually becomes opaque as it approaches 200, and if it is 200 or more, it becomes completely opaque.
  • FIG. 23 (a) it is also defined that the color information of a point having a CT value of 200 or more is converted into white.
  • the accepting unit 102 accepts the change of the transparency condition information, and is temporarily stored in the second slice information group acquiring unit 213 via the label information configuring unit 209.
  • the second slice information group acquisition unit 213 reacquires the CT value of each point of each slice information. Then, the second slice information group acquisition unit 213 determines whether or not the CT value of each point matches the transparency condition information. Then, the second slice information group acquisition unit 213 sets the ⁇ value of a point having a CT value that matches the transparency condition information to 0.
  • the changed object output unit 214 outputs the image shown in FIG. In FIG. 24, the ⁇ values of the blood vessels and the spine are not 0 and are displayed.
  • this program is slice information that is information configured based on two-dimensional image data obtained by cutting out 3D voxel information, which is a volume texture of a three-dimensional object, in a plurality of planes in a storage medium, A slice information group having a plurality of slice information composed of information on a plurality of points having position information which is information indicating positions and color information which is information on colors is stored, and a computer is stored in the storage medium.
  • a slice information group output unit that outputs the stored slice information group, a reception unit that receives an instruction for the slice information group output by the slice information group output unit, and a slice corresponding to the instruction that the reception unit receives
  • a label information constituting unit constituting label information which is an attribute value of a point constituting information, and a label constituted by the label information constituting unit.
  • a program to function as changing the object output portion that outputs the changed the slice information group.
  • the label information configuration unit 309 configures label information that is an attribute value of a point configuring one or more pieces of slice information in response to the instruction received by the reception unit 102.
  • the label information here includes a time stamp.
  • the time stamp is information indicating when a point is output.
  • the time stamp may be information indicating time (date / time / minute / second) or information such as an index indicating the output order. That is, the time stamp may be information indicating an absolute time or information indicating a relative output order.
  • the label information configuration unit 309 can be usually realized by an MPU, a memory, or the like.
  • the processing procedure of the label information configuration unit 309 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).
  • Step S2601 The receiving unit 102 determines whether a time stamp recording instruction has been received. If a time stamp recording instruction is accepted, the process proceeds to step S2602. If a time stamp recording instruction is not accepted, the process proceeds to step S304.
  • the time stamp recording instruction is an instruction to record information related to an operation performed by the user or output information (slice information group) that changes according to the operation together with the time stamp.
  • the time stamp is added to the slice information group.
  • the time stamp may be added to a user instruction (output instruction, rotation instruction, deformation instruction, etc.), or label information (information indicating the cross section described in the first embodiment, in the second embodiment). It may be added to the described CT value).
  • the processing is ended by powering off or interruption for aborting the processing.
  • the reception unit 102 receives a moving image reproduction instruction, the slice information groups are displayed in the order indicated by the time stamps based on the accumulated slice information group and time stamp information. With this processing, the user operation in which the slice information group has been accumulated is reproduced.
  • the object information storage unit 101 of the information processing apparatus 3 stores, for example, a set of medical images (three-dimensional images) illustrated in FIG.
  • the reception unit 102 receives an activation instruction.
  • the reception unit 102 receives an output instruction for a slice information group.
  • the user inputs a time stamp recording instruction to the information processing apparatus 1.
  • the time stamp recording instruction is input by, for example, pressing a “record” button on a screen (not shown) of the information processing apparatus 3 with a mouse.
  • the accepting unit 102 accepts a time stamp recording instruction.
  • the label information configuration unit 309 acquires time stamps that are indexes while sequentially incrementing and adding them to the output slice information group.
  • the initial value of the time stamp is 0 and is incremented sequentially.
  • the changed object output unit 314 accumulates the slice information group to which the time stamp is added.
  • the slice information group management table shown in FIG. 27 is accumulated in the slice information group storage unit 104 of the information processing apparatus 3.
  • the slice information group management table manages a plurality of records having “ID”, “slice information group”, and “time stamp”.
  • “ID” is information for identifying a record.
  • the attribute value of “slice information group” is a still image for simplification, but is actually a slice information group.
  • information specifying a user operation other label information (information indicating a cross section, CT value serving as a display / non-display threshold value, or the like) may be used.
  • the “time stamp” is relative information.
  • the changed object output unit 314 displays the slice information group on the display. Thus, a reproducible video is prepared.
  • the reception unit 102 receives a moving image reproduction instruction.
  • the moving image output unit 315 reads and outputs the slice information group from the slice information group storage unit 104 (table in FIG. 27) in the order indicated by the time stamp. As a result, the user operation can be reproduced.
  • a time stamp can be set for a three-dimensional object. This makes it possible to record, for example, a simulation of a surgical procedure and contribute to the advancement of medical education and the advancement of medicine.
  • this program is slice information that is information configured based on two-dimensional image data obtained by cutting out 3D voxel information, which is a volume texture of a three-dimensional object, in a plurality of planes in a storage medium, A slice information group having a plurality of slice information composed of information on a plurality of points having position information which is information indicating positions and color information which is information on colors is stored, and a computer is stored in the storage medium.
  • a slice information group output unit that outputs the stored slice information group, a reception unit that receives an instruction for the slice information group output by the slice information group output unit, and a slice corresponding to the instruction that the reception unit receives
  • a label information constituting unit constituting label information which is an attribute value of a point constituting information, and a label constituted by the label information constituting unit.
  • a program to function as changing the object output portion that outputs the changed the slice information group.
  • the label information includes a time stamp that is information indicating time
  • the changed object output unit corresponds to the second slice information group and the label information configured by the label information configuration unit.
  • the computer further functions as a moving image output unit that outputs the second slice information group using a time stamp included in the label information.
  • the information processing apparatus described in this specification is a stand-alone apparatus, it goes without saying that the information processing apparatus may function as a server client server. In such a case, an instruction from the client-side terminal of the server client is transmitted to the information processing apparatus, and information output (in this case, “transmission”) by the information processing apparatus is displayed on the terminal.
  • each process may be realized by centralized processing by a single device (system), or by distributed processing by a plurality of devices. May be.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Algebra (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Mathematical Physics (AREA)
  • Pure & Applied Mathematics (AREA)
  • Image Generation (AREA)
  • Apparatus For Radiation Diagnosis (AREA)

Abstract

La présente invention se rapporte à un dispositif de traitement d'informations comprenant un module de délivrance de groupes d'informations de coupe qui est adapté pour délivrer en sortie des groupes d'informations de coupe stockés qui contiennent une pluralité d'informations de coupe. Lesdites informations de coupe sont des informations construites sur la base de données image en 2D obtenues à partir de captures sur une pluralité de plans d'informations de voxels en 3D représentant le volume et la texture d'un objet en 3D. Lesdites informations de coupe sont construites en outre à partir des informations d'une pluralité de points ayant des informations de position indiquant des positions et des informations de couleur appartenant à une couleur. Le dispositif de traitement d'informations selon l'invention comprend par ailleurs : un module de réception qui est adapté pour recevoir des instructions concernant le groupe d'informations de coupe délivré en sortie; un module de construction d'informations d'étiquette qui est adapté pour construire, en rapport avec les instructions reçues par le module de réception, des informations d'étiquette qui correspondent à la valeur d'attribut de points de construction pour les informations de coupe. Et le dispositif de traitement d'informations selon l'invention comprend d'autre part un module de délivrance d'objet modifié qui est adapté pour délivrer en sortie le groupe d'informations de coupe modifié en rapport avec les informations d'étiquette construites. Avec le dispositif de traitement d'informations, il est possible de réaliser des modifications sur le format de sortie d'une région spécifiée exclusivement, ce qui procure une solution au problème de l'art antérieur qui n'était pas apte à définir de façon dynamique des valeurs d'attributs pour la sortie d'objets en 3D.
PCT/JP2010/054915 2009-03-31 2010-03-23 Dispositif de traitement d'informations, procédé de traitement d'informations, et programme Ceased WO2010113690A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2011507100A JP5493178B2 (ja) 2009-03-31 2010-03-23 情報処理装置、情報処理方法、およびプログラム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2009-084221 2009-03-31
JP2009084221 2009-03-31

Publications (1)

Publication Number Publication Date
WO2010113690A1 true WO2010113690A1 (fr) 2010-10-07

Family

ID=42827985

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2010/054915 Ceased WO2010113690A1 (fr) 2009-03-31 2010-03-23 Dispositif de traitement d'informations, procédé de traitement d'informations, et programme

Country Status (2)

Country Link
JP (1) JP5493178B2 (fr)
WO (1) WO2010113690A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014021659A (ja) * 2012-07-17 2014-02-03 Fujitsu Ltd 描画処理プログラム、描画処理方法及び描画処理装置
WO2018030015A1 (fr) * 2016-08-08 2018-02-15 国立大学法人京都大学 Dispositif d'estimation de processus de résection et système de navigation de processus de résection
RU2845972C1 (ru) * 2024-12-09 2025-08-28 Федеральное государственное автономное образовательное учреждение высшего образования "Уральский федеральный университет имени первого Президента России Б.Н. Ельцина" Способ непрерывного наблюдения активности мозга мыши

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07230540A (ja) * 1994-02-21 1995-08-29 Ge Yokogawa Medical Syst Ltd ３次元画像表示方法および装置
JPH07271997A (ja) * 1994-03-29 1995-10-20 Toshiba Corp 画像処理装置
JP2000149064A (ja) * 1998-11-12 2000-05-30 Mitsubishi Electric Inf Technol Center America Inc カットプレ―ン変更バ―ジョンを表示するためのボリュ―ムデ―タ集合を実時間で変更する装置及び方法
JP2002329218A (ja) * 2001-03-16 2002-11-15 Mitsubishi Electric Research Laboratories Inc コンピュータ実現ツールを用いてグラフィクスオブジェクトのサーフェスを編集する方法
WO2006013813A1 (fr) * 2004-08-02 2006-02-09 Kyoto University Dispositif et programme de traitement d’informations

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07230540A (ja) * 1994-02-21 1995-08-29 Ge Yokogawa Medical Syst Ltd ３次元画像表示方法および装置
JPH07271997A (ja) * 1994-03-29 1995-10-20 Toshiba Corp 画像処理装置
JP2000149064A (ja) * 1998-11-12 2000-05-30 Mitsubishi Electric Inf Technol Center America Inc カットプレ―ン変更バ―ジョンを表示するためのボリュ―ムデ―タ集合を実時間で変更する装置及び方法
JP2002329218A (ja) * 2001-03-16 2002-11-15 Mitsubishi Electric Research Laboratories Inc コンピュータ実現ツールを用いてグラフィクスオブジェクトのサーフェスを編集する方法
WO2006013813A1 (fr) * 2004-08-02 2006-02-09 Kyoto University Dispositif et programme de traitement d’informations

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014021659A (ja) * 2012-07-17 2014-02-03 Fujitsu Ltd 描画処理プログラム、描画処理方法及び描画処理装置
WO2018030015A1 (fr) * 2016-08-08 2018-02-15 国立大学法人京都大学 Dispositif d'estimation de processus de résection et système de navigation de processus de résection
JPWO2018030015A1 (ja) * 2016-08-08 2019-07-04 国立大学法人京都大学 切離プロセス推定装置及び切離プロセスナビゲーションシステム
RU2845972C1 (ru) * 2024-12-09 2025-08-28 Федеральное государственное автономное образовательное учреждение высшего образования "Уральский федеральный университет имени первого Президента России Б.Н. Ельцина" Способ непрерывного наблюдения активности мозга мыши

Also Published As

Publication number Publication date
JP5493178B2 (ja) 2014-05-14
JPWO2010113690A1 (ja) 2012-10-11

Similar Documents

Publication Publication Date Title
US7397475B2 (en) Interactive atlas extracted from volume data
JP5130529B2 (ja) 情報処理装置およびプログラム
CA3018919A1 (fr) Systeme de simulation de realite mixte et methode de planification d'uneintervention medicale
JP6051158B2 (ja) 切削シミュレーション装置および切削シミュレーションプログラム
JP2020506452A (ja) Ｈｍｄｓに基づく医学画像形成装置
KR101293744B1 (ko) 복수의 2차원 영상들과 3차원 모델의 합성을 위한 방법 및 장치
JP5131790B2 (ja) 手術シミュレーション装置、手術シミュレーション方法およびプログラム
US20240394996A1 (en) Method for analysing 3d medical image data, computer program and 3d medical image data evaluation device
CN106934841A (zh) 生成彩色医学影像的方法及医学系统
Chaoui et al. 3D ultrasound in prenatal diagnosis: a practical approach
CN103299346A (zh) 用于从3d或4d数据集生成和显示2d投影的系统和方法
JP4337987B2 (ja) 情報処理装置およびプログラム
JP6457785B2 (ja) 生体質感モデル作製方法および生体質感モデル作製プログラム
JP5808004B2 (ja) 画像処理装置、画像処理方法、およびプログラム
JP5493178B2 (ja) 情報処理装置、情報処理方法、およびプログラム
KR101014559B1 (ko) 3차원 초음파 영상 제공 초음파 시스템 및 방법
Khatri et al. Unfolding the mysterious path of forensic facial reconstruction: Review of different imaging modalities
Chen et al. A new three-dimensional template for the fabrication and localization of an autogenous cartilage framework during microtia reconstruction
Santos et al. Augmented reality as a new perspective in dentistry: development of a complementary tool
JP2009506808A (ja) 多次元画像データセットにおけるナビゲーションと測定の方法及びその装置
Williams A method for viewing and interacting with medical volumes in virtual reality
US20160205390A1 (en) Method for displaying on a screen an object shown in a 3d data set
Limberg Osirix as a resource
Eilertsen Virtual reality for medical images
Gallo et al. User-friendly inspection of medical image data volumes in virtual environments

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10758464

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2011507100

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10758464

Country of ref document: EP

Kind code of ref document: A1