[go: up one dir, main page]

CN111324203A - Vibration texture touch information acquisition and display device - Google Patents

Vibration texture touch information acquisition and display device Download PDF

Info

Publication number
CN111324203A
CN111324203A CN202010112337.7A CN202010112337A CN111324203A CN 111324203 A CN111324203 A CN 111324203A CN 202010112337 A CN202010112337 A CN 202010112337A CN 111324203 A CN111324203 A CN 111324203A
Authority
CN
China
Prior art keywords
texture
vibration
display device
collected
power supply
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202010112337.7A
Other languages
Chinese (zh)
Inventor
刘倩
陈锐
杜伟强
张强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dalian University of Technology
Original Assignee
Dalian University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dalian University of Technology filed Critical Dalian University of Technology
Priority to CN202010112337.7A priority Critical patent/CN111324203A/en
Publication of CN111324203A publication Critical patent/CN111324203A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本发明技术领域为电子信息技术中的新型电子元器件,涉及一种振动纹理触觉信息采集与显示装置,可应用于纹理触觉信息的采集、数据压缩、虚拟与仿真渲染等领域。该装置包括采集装置和显示装置,由三轴加速度传感器、电源、NI数据采集卡、音圈马达、耳机线、功率放大器和上位机组成。本发明通过不同振动触觉信号描述不同物体表面纹理,操作简单易实现,并且采集到的振动触觉信号精度较高,有区分度,且可以直观看到采集的结果。本发明装置采集到的纹理觉可以作为训练集,进行特征提取后训练分类器,进而得到物体纹理识别器。该物体纹理识别器可以对现实中的物体纹理进行识别,可应用于VR/AR纹理触觉渲染,电商等领域,具有广泛的应用前景。

Figure 202010112337

The technical field of the present invention is a novel electronic component in electronic information technology, and relates to a vibration texture tactile information acquisition and display device, which can be applied to the fields of texture tactile information acquisition, data compression, virtual and simulation rendering, and the like. The device includes an acquisition device and a display device, and is composed of a three-axis acceleration sensor, a power supply, an NI data acquisition card, a voice coil motor, an earphone cable, a power amplifier and a host computer. The present invention describes different object surface textures through different vibrotactile signals, the operation is simple and easy to implement, and the collected vibrotactile signals have high precision and discrimination, and the collected results can be seen intuitively. The texture perception collected by the device of the present invention can be used as a training set, and after feature extraction is performed, a classifier is trained to obtain an object texture recognizer. The object texture recognizer can recognize the object texture in reality, and can be applied to VR/AR texture tactile rendering, e-commerce and other fields, and has broad application prospects.

Figure 202010112337

Description

振动纹理触觉信息采集与显示装置Vibration texture tactile information acquisition and display device

技术领域technical field

本发明技术领域为电子信息技术—新型电子元器件,更具体地,涉及一种振动纹理触觉信息采集与显示装置,可应用于纹理触觉信息的采集、数据压缩、虚拟与仿真渲染等领域。The technical field of the present invention is electronic information technology—new electronic components, and more particularly, relates to a vibration texture tactile information acquisition and display device, which can be applied to the fields of texture tactile information acquisition, data compression, virtual and simulation rendering, and the like.

背景技术Background technique

人类的触觉感知包括两部分,即动觉(由肌肉、关节和肌腱感知的力、扭矩、位置、速度等信息)和纹理觉(由皮肤上的机械性刺激感受器感知到的表面结构和摩擦等信息)。对比于较为成熟的视觉和听觉感知,对触觉的研究尚处于初级阶段,但是其产业应用前景广泛,例如VR/AR领域,加入触觉感知将大幅度增加真实感,提高用户的体验;电商领域,加入纹理触觉感知,可以使用户购买衣物时感受到衣服的材质。Human tactile perception consists of two parts, namely kinesthetic (force, torque, position, speed, etc. information sensed by muscles, joints and tendons) and texture sense (surface structure and friction sensed by mechanoreceptors on the skin, etc.) information). Compared with the more mature visual and auditory perception, the research on tactile is still in its infancy, but its industrial application prospects are broad, such as in the field of VR/AR, adding tactile perception will greatly increase the sense of reality and improve the user experience; e-commerce field , adding texture tactile perception, which can make users feel the material of clothes when they buy clothes.

纹理触觉与动觉不同,不能用速度和力等来描述。纹理触觉是人触摸到一个物体后对其材质表面光滑程度的描述。由于人接触到物体表面的纹理会产生摩擦力,进而产生振动,所以使用振动的大小度量人对物体表面纹理的触觉感受是纹理触觉的一种表征方法,也称为振动纹理触觉。振动纹理触觉信号反映了物体表面的粗糙程度,例如粗糙的物体,摩擦力大,振动触觉信息相对强烈;光滑的物体,则振动和缓。Texture touch is different from kinesthetic sense and cannot be described in terms of speed and force. Texture haptics is a description of how smooth the surface of an object is when a person touches it. Since people touch the texture of the surface of the object, they will generate friction and then vibration, so using the magnitude of the vibration to measure the tactile feeling of the surface texture of the object is a characterization method of texture tactile, also known as vibratory texture tactile sensation. Vibration texture tactile signals reflect the roughness of the surface of an object. For example, rough objects have a large friction force, and the vibration tactile information is relatively strong; smooth objects have gentle vibrations.

发明内容SUMMARY OF THE INVENTION

依据振动纹理触觉原理,本发明的目的在于提供一种振动纹理触觉信息采集与显示装置,使用加速度传感器测量不同物体表面纹理的振动触觉信号,采集到的振动触觉信号的显示可以通过音圈马达或电磁阀等设备来实现。According to the vibration texture tactile principle, the purpose of the present invention is to provide a vibration texture tactile information collection and display device, which uses an acceleration sensor to measure the vibration tactile signals of different object surface textures, and the collected vibration tactile signals can be displayed by a voice coil motor or a voice coil motor. Solenoid valve and other equipment to achieve.

一种振动纹理触觉信息采集与显示装置,包括采集装置和显示装置:A vibration texture tactile information collection and display device, comprising a collection device and a display device:

所述的采集装置包括三轴加速度传感器、电源、NI数据采集卡和上位机;所述的三轴加速度传感器在待测物体表面摩擦以采集振动触觉信号,并将采集到的加速度信息输出到NI数据采集卡,电源为NI数据采集卡供电;所述的NI数据采集卡,将采集到的数据经过模数转换后,以数字信号形式通过USB传输到上位机完成采集过程,上位机将采集到的振动触觉信号以音频文件形式保存。The acquisition device includes a triaxial acceleration sensor, a power supply, an NI data acquisition card and a host computer; the triaxial acceleration sensor rubs on the surface of the object to be measured to collect vibrotactile signals, and outputs the collected acceleration information to the NI Data acquisition card, the power supply is NI data acquisition card; the NI data acquisition card, after analog-to-digital conversion of the collected data, transmits the collected data to the host computer in the form of digital signals through USB to complete the acquisition process, and the host computer will collect the data. The vibrotactile signal is saved as an audio file.

所述的显示装置包括音圈马达、电源、耳机线和功率放大器;所述的上位机以音频的形式通过耳机线将采集到的振动触觉信号输出到功率放大器,振动触觉信号经过功率放大后由音圈马达以振动的形式完成振动触觉信号的显示,功率放大器由电源供电;所述的音圈马达能将输入的电信号转化为机械能,用于输出振动触觉信号。The display device includes a voice coil motor, a power supply, an earphone wire and a power amplifier; the host computer outputs the collected vibrotactile signal to the power amplifier in the form of audio through the earphone wire, and the vibrotactile signal is amplified by the power and sent to the power amplifier. The voice coil motor completes the display of the vibrotactile signal in the form of vibration, and the power amplifier is powered by the power supply; the voice coil motor can convert the input electrical signal into mechanical energy for outputting the vibrotactile signal.

本发明的有益效果:Beneficial effects of the present invention:

(1)本发明通过不同振动触觉信号描述不同物体表面纹理。操作简单易实现,并且采集到的振动触觉信号精度较高,有区分度,且可以直观看到采集的结果。(1) The present invention describes the surface texture of different objects through different vibrotactile signals. The operation is simple and easy to implement, and the collected vibrotactile signals have high precision and discrimination, and the collected results can be seen intuitively.

(2)本发明装置采集到的纹理觉可以作为训练集,进行特征提取后训练分类器,进而得到物体纹理识别器。该物体纹理识别器可以对现实中的物体纹理进行识别,可应用于VR/AR纹理触觉渲染,电商等领域,具有广泛的应用前景。(2) The texture perception collected by the device of the present invention can be used as a training set, and after feature extraction is performed, a classifier is trained, and an object texture recognizer is obtained. The object texture recognizer can recognize the object texture in reality, and can be applied to VR/AR texture tactile rendering, e-commerce and other fields, and has broad application prospects.

附图说明Description of drawings

图1为本发明的采集装置连接框图;Fig. 1 is the connection block diagram of the acquisition device of the present invention;

图2为实施例中三轴加速度传感器ADXL335的连接图;Fig. 2 is the connection diagram of three-axis acceleration sensor ADXL335 in the embodiment;

图3为本发明的显示装置连接框图;3 is a connection block diagram of a display device of the present invention;

图4为本发明的采集操作流程图;Fig. 4 is the collection operation flow chart of the present invention;

图5为本发明的显示操作流程图;Fig. 5 is the display operation flow chart of the present invention;

图6为本发明采集到的不同材质的振动触觉信号波形;Fig. 6 is the vibrotactile signal waveform of different materials collected by the present invention;

图7为本发明用于物体纹理识别的系统框图。FIG. 7 is a system block diagram of the present invention for object texture recognition.

具体实施方式Detailed ways

下面结合附图和技术方案进一步说明本发明的具体实施方式。The specific embodiments of the present invention are further described below with reference to the accompanying drawings and technical solutions.

1.按照图1和以下步骤连接采集装置:1. Connect the acquisition device according to Figure 1 and the following steps:

本实施例中选用三轴加速度传感器为ADXL335,其是一款高精度低功耗的小型三轴加速度计,输出为电压信号,可以测量运动、冲击或振动导致的动态加速度。选用NI数据采集卡为模数转换器,电源为其供5V电压,能将模拟信号转换为数字信号。选用上位机为计算机,其配置为:i7-8700@3.2GHz,win10操作系统,16GB RAM。The three-axis accelerometer selected in this embodiment is ADXL335, which is a small three-axis accelerometer with high precision and low power consumption. The output is a voltage signal, which can measure the dynamic acceleration caused by motion, shock or vibration. The NI data acquisition card is selected as the analog-to-digital converter, and the power supply provides 5V voltage for it, which can convert analog signals into digital signals. The host computer is selected as the computer, and its configuration is: i7-8700@3.2GHz, win10 operating system, 16GB RAM.

所述ADXL335三轴加速度传感器与100g砝码一面粘贴,砝码的另一面接触物体表面,砝码与物体的接触面应带有凸起,便于通过在物体表面来回摩擦模拟人轻触物体时所用的力。ADXL335的地线和火线与USB线的地线和火线相连,见图2。所述ADXL335加速度传感器包括三轴传感器、功率放大器、解调器、电阻;所述三轴传感器输出端口与功率放大器输入端相连,功率放大器输出端与解调器输入端相连,解调器有3个输出端,分别输出三个电流,输出电流分别经32千欧电阻至ADXL335加速度传感器的x轴、y轴、z轴输出,分别输出采集到的x轴、y轴、z轴的加速度。所述NI数据采集卡有八个输入端口,其中三个与三轴加速度传感器的输出相连,两个与电源相连,剩余三个输入口空闲。NI数据采集卡以USB形式输出,连接到计算机USB口。The ADXL335 triaxial acceleration sensor is pasted with a 100g weight on one side, and the other side of the weight is in contact with the surface of the object. The contact surface between the weight and the object should have protrusions, so that it can be used to simulate people touching the object by rubbing back and forth on the surface of the object. strength. The ground and fire wires of the ADXL335 are connected to the ground and fire wires of the USB cable, see Figure 2. The ADXL335 acceleration sensor includes a triaxial sensor, a power amplifier, a demodulator, and a resistor; the output port of the triaxial sensor is connected to the input end of the power amplifier, and the output end of the power amplifier is connected to the input end of the demodulator, and the demodulator has 3 Each output terminal outputs three currents respectively. The output currents are respectively output to the x-axis, y-axis and z-axis of the ADXL335 accelerometer through a 32 kΩ resistor, and the collected accelerations of the x-axis, y-axis and z-axis are respectively output. The NI data acquisition card has eight input ports, three of which are connected to the output of the three-axis acceleration sensor, two are connected to the power supply, and the remaining three input ports are free. The NI data acquisition card outputs in the form of USB and is connected to the USB port of the computer.

2.按照图4和以下步骤完成采集操作:2. Follow Figure 4 and the following steps to complete the acquisition operation:

开启上位机,运行驱动程序,提示等待三秒开始采集,接下来十秒内,首先将ADXL335水平悬空五秒校零,完成校零操作后五秒内将ADXL335在待测物体表面水平来回匀速摩擦三到五次,完成纹理觉采集,上位机将采集到的纹理觉信号保存为音频文件(如wav格式)。Turn on the host computer, run the driver program, and prompt to wait for three seconds to start the acquisition. In the next ten seconds, firstly suspend the ADXL335 horizontally for five seconds to calibrate the zero, and rub the ADXL335 horizontally back and forth on the surface of the object to be measured at a constant speed within five seconds after the zero calibration operation is completed. Three to five times, the texture sense acquisition is completed, and the host computer saves the collected texture sense signal as an audio file (such as wav format).

3.按照图3连接显示装置,按照图5的步骤显示纹理觉信号。3. Connect the display device according to Figure 3, and display the texture sensory signal according to the steps in Figure 5.

上位机的输出端口与功率放大器之间通过耳机线相连,功率放大器的输出通过两根导线与音圈马达相连,选用电压为12V电源为功率放大器供电。运行上位机的音频文件,纹理觉信号以音频形式先输出到功率放大器,调节功率放大器到合适放大倍率,输出到音圈马达,音圈马达将音频信号以振动形式输出。The output port of the host computer is connected with the power amplifier through the headphone cable, the output of the power amplifier is connected with the voice coil motor through two wires, and the power amplifier is powered by a 12V power supply. Run the audio file of the host computer, the texture sensory signal is first output to the power amplifier in the form of audio, adjust the power amplifier to the appropriate magnification, and output to the voice coil motor, and the voice coil motor outputs the audio signal in the form of vibration.

图6展示了使用本发明装置采集的不同纹理的物体的振动触觉波形,可以明显看出表面越粗糙,波形越强烈,比如花岗岩,它引起的振动触觉信号频率高且振幅较大,波动剧烈,表面光滑的软木,则波形平缓,频率低。Fig. 6 shows the vibrotactile waveforms of objects with different textures collected by the device of the present invention. It can be clearly seen that the rougher the surface, the stronger the waveform. The smooth surface of the cork, the waveform is flat, the frequency is low.

本发明装置采集到的纹理觉可以作为训练集,进行特征提取后训练分类器,进而得到物体纹理识别器。该物体纹理识别器可以对现实中的物体纹理进行识别,物体纹理识别系统框图见图7,所述物体纹理识别器包括特征提取和分类器训练两部分。其操作步骤为:将纹理觉采集装置在待测物体表面水平来回匀速摩擦,完成纹理觉采集工作后,纹理觉采集装置输出振动触觉信号至物体纹理识别器后输出物体材质。The texture perception collected by the device of the present invention can be used as a training set, and after feature extraction is performed, a classifier is trained to obtain an object texture recognizer. The object texture recognizer can recognize the object texture in reality. The block diagram of the object texture recognition system is shown in Figure 7. The object texture recognizer includes two parts: feature extraction and classifier training. The operation steps are: rubbing the texture sensory acquisition device horizontally back and forth on the surface of the object to be measured at a constant speed, after completing the texture sensory acquisition work, the texture sensory acquisition device outputs vibrotactile signals to the object texture recognizer and then outputs the object material.

Claims (1)

1. The utility model provides a vibrotexture sense of touch information acquisition and display device which characterized in that, includes collection system and display device:
the acquisition device comprises a three-axis acceleration sensor, a power supply, an NI data acquisition card and an upper computer; the three-axis acceleration sensor rubs on the surface of an object to be detected to acquire a vibration touch signal and outputs acquired acceleration information to the NI data acquisition card, and the power supply supplies power to the NI data acquisition card; the NI data acquisition card transmits acquired data to an upper computer in a digital signal form through a USB to finish the acquisition process after analog-to-digital conversion, and the upper computer stores the acquired vibration touch signal in an audio file form;
the display device comprises a voice coil motor, a power supply, an earphone wire and a power amplifier; the upper computer outputs the collected vibration touch signal to a power amplifier in an audio form through an earphone cable, the vibration touch signal is displayed in a vibration form by a voice coil motor after being subjected to power amplification, and the power amplifier is powered by a power supply; the voice coil motor converts the input electric signal into mechanical energy for outputting a vibration tactile signal.
CN202010112337.7A 2020-02-24 2020-02-24 Vibration texture touch information acquisition and display device Withdrawn CN111324203A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010112337.7A CN111324203A (en) 2020-02-24 2020-02-24 Vibration texture touch information acquisition and display device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010112337.7A CN111324203A (en) 2020-02-24 2020-02-24 Vibration texture touch information acquisition and display device

Publications (1)

Publication Number Publication Date
CN111324203A true CN111324203A (en) 2020-06-23

Family

ID=71172875

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010112337.7A Withdrawn CN111324203A (en) 2020-02-24 2020-02-24 Vibration texture touch information acquisition and display device

Country Status (1)

Country Link
CN (1) CN111324203A (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120026180A1 (en) * 2010-07-30 2012-02-02 The Trustees Of The University Of Pennsylvania Systems and methods for capturing and recreating the feel of surfaces
CN109696956A (en) * 2017-10-20 2019-04-30 意美森公司 Haptic profile is determined using built-in acceleration meter

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120026180A1 (en) * 2010-07-30 2012-02-02 The Trustees Of The University Of Pennsylvania Systems and methods for capturing and recreating the feel of surfaces
CN109696956A (en) * 2017-10-20 2019-04-30 意美森公司 Haptic profile is determined using built-in acceleration meter

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
JOSEPH M. ROMANO等: "《Creating Realistic Virtual Textures from Contact Acceleration Data》", 《IEEE TRANSACTIONS ON HAPTICS》 *

Similar Documents

Publication Publication Date Title
CN104898842B (en) The wearable fingerstall type force haptic interaction device and implementation method of facing moving terminal
KR101174450B1 (en) Virtual reality environment creating device, and controller device
JP6644466B2 (en) System and method for providing tactile notification
TWI306051B (en) Robotic apparatus with surface information displaying and interaction capability
CN107092353B (en) Hand touch parameter acquisition and simulation restoration system and method
WO2008067487A2 (en) Controlling a displayed presentation, such as a sexually explicit presentation
WO2009071919A1 (en) Controller
CN105138223B (en) A kind of object pliability reproducting method based on fingerstall type force haptic interaction device
CN104834380A (en) Flexible object tactile modeling and expressing method applied to mobile terminal
CN107831892B (en) A method for reproducing the three-dimensional shape of virtual objects based on a finger-sleeve device
Chen et al. FW-touch: A finger wearable haptic interface with an MR foam actuator for displaying surface material properties on a touch screen
CN109478089A (en) Multi-modal haptic effect
Mayol-Cuevas et al. A first approach to tactile texture recognition
CN111897427A (en) Hardness tactile reproduction method based on bionic properties of tactile perception
CN106292730A (en) Affective interaction formula robot
Adilkhanov et al. Vibero: Vibrotactile stiffness perception interface for virtual reality
CN115033101A (en) An airbag-driven fingertip texture tactile feedback device
CN111368251A (en) Quantitative evaluation method for realism of vibrotactile texture rendering based on root mean square error
EP3931668A1 (en) Virtual reality controller
CN111324203A (en) Vibration texture touch information acquisition and display device
Chen et al. A novel miniature multi-mode haptic pen for image interaction on mobile terminal
CN103488298B (en) A kind of based on tactile sense reproduction hand-type slot device that is flexible and that be slidably connected
Lim et al. Weight Perception Simulation in Virtual Reality with Passive Force using Force Sensing Resistors
KR101750506B1 (en) Controlling method and apparatus of haptic interface
CN103604439A (en) Pedometer capable of realizing function switching by clicking, colliding or vibrating

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20200623