[go: up one dir, main page]

TW202326634A - Intelligent railway monitoring system and method thereof - Google Patents

Intelligent railway monitoring system and method thereof Download PDF

Info

Publication number
TW202326634A
TW202326634A TW110147518A TW110147518A TW202326634A TW 202326634 A TW202326634 A TW 202326634A TW 110147518 A TW110147518 A TW 110147518A TW 110147518 A TW110147518 A TW 110147518A TW 202326634 A TW202326634 A TW 202326634A
Authority
TW
Taiwan
Prior art keywords
image
module
compared
abnormal
real
Prior art date
Application number
TW110147518A
Other languages
Chinese (zh)
Other versions
TWI804113B (en
Inventor
林邦傑
龔皇光
李順良
林聖傑
郭偉銘
黃一宸
Original Assignee
正修學校財團法人正修科技大學
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 正修學校財團法人正修科技大學 filed Critical 正修學校財團法人正修科技大學
Priority to TW110147518A priority Critical patent/TWI804113B/en
Application granted granted Critical
Publication of TWI804113B publication Critical patent/TWI804113B/en
Publication of TW202326634A publication Critical patent/TW202326634A/en

Links

Landscapes

  • Alarm Systems (AREA)
  • Electric Propulsion And Braking For Vehicles (AREA)

Abstract

An intelligent railway monitoring system includes: a cloud database module for storing the image data of driving rail vehicle; a central monitoring system connects to the cloud database module for data signal transmission; an on-board subsystem of the driving rail vehicle includes an image capturing module, a real-time image storage module, a data transmission module, an image reference module, an image recognition module, warning alert module and a control module can link to both cloud database module and central monitoring system. During the driving of the rail vehicle, the image capturing module can generate a set of real-time images to compare with the images from the image reference module. The difference of both sets of images can be retrieved and recorded in the computer system. When the image recognition module recognizes that there is an abnormal state between the image to be compared and the reference image, the warning alert module will send a warning signal to the controller.

Description

智慧軌道監控系統及其方法Intelligent track monitoring system and method thereof

本發明係關於一種智慧軌道監控系統及其方法,尤其是一種應用於軌道車輛,透過擷取軌道車輛行車紀錄影像,並經由影像辨識,比對軌道車輛行徑前方之影像畫面是否有異常狀態之智慧軌道監控系統及其方法。The present invention relates to a smart track monitoring system and its method, especially a smart track vehicle application, by capturing the driving record images of the track vehicles, and through image recognition, comparing the image screen in front of the track vehicles to see whether there is an abnormal state of intelligence Track monitoring system and method thereof.

目前關於軌道車輛行駛的安全,例如;高速鐵路、一般鐵路、輕軌列車及捷運,除了有賴駕駛員的警覺性及注意力,或是車站裡的行控中心經由監視器畫面來了解軌道的狀況外,大多數情況都是發生了意外狀況造成事故後,經通報才知道軌道哪一路段發生意外或異常,因此,較難做到及時性的危險預防工作。At present, the safety of rail vehicles, such as high-speed railways, general railways, light rail trains and rapid transit, depends on the vigilance and attention of the driver, or the traffic control center in the station understands the status of the track through the monitor screen In addition, in most cases, after an accident occurs, it is not known which section of the track has an accident or abnormality after the notification. Therefore, it is difficult to achieve timely risk prevention work.

習知技術中華民國公告專利號I318187主要在提供影像讓軌道車輛駕駛觀看,增加駕駛員的視野範圍,並減少軌道巡邏的人力支出。習知技術中華民國公告專利號I307325係透過在軌道上安裝微動感應器,利用震動頻率的差異性,藉此來判斷軌道本身是否有毀損、鬆脫或其他非正常狀況。習知技術中華民國公告專利號I304191透過一無人前導車來進行軌道前方路況的判斷,並將訊號傳回軌道車上。The known technology of the Republic of China Patent No. I318187 is mainly to provide images for rail vehicles to watch, increase the driver's field of vision, and reduce the manpower expenditure of rail patrols. The known technology of the Republic of China Patent No. I307325 is to install a micro-motion sensor on the track and use the difference in vibration frequency to judge whether the track itself is damaged, loose or other abnormal conditions. Known technology The Republic of China Announcement Patent No. I304191 carries out the judgment of the road condition ahead of the track through an unmanned leading vehicle, and sends the signal back on the rail car.

惟,技術中華民國公告專利號I318187仍須透過駕駛員的肉眼視力進行判斷,習知技術中華民國公告專利號I307325並無法知悉軌道上是否有異物阻礙,習知技術中華民國公告專利號I304191需要另一無人前導車進行判斷,其建置複雜、成本過高,且揭示透過影像辨識來辨識軌道異常之狀態。綜上所述,前述習知技術仍無達到由行車系統自動判斷前方軌道是否有異常或異常狀態及預警機制,因此,需要加以改良。本發明利用軌道車輛本身裝設影像辨識系統,來自動隨時辨識判定行徑前方軌道的狀況及軌道周遭是否有異狀,可以解決習知技術所不足之處。However, the technology published by the Republic of China Patent No. I318187 still needs to be judged by the driver's naked eyesight. The conventional technology published by the Republic of China Patent No. I307325 cannot know whether there is any foreign object on the track. The conventional technology published by the Republic of China Patent No. I304191 requires another Judging by an unmanned leading vehicle, its construction is complicated, the cost is too high, and it reveals the status of identifying track abnormalities through image recognition. To sum up, the above-mentioned conventional technology still does not achieve automatic judgment by the driving system of whether there is an abnormality or an abnormal state on the track ahead and an early warning mechanism. Therefore, it needs to be improved. The present invention uses the image recognition system installed on the rail vehicle itself to automatically identify and determine the status of the track ahead of the track and whether there is any abnormality around the track at any time, which can solve the shortcomings of the conventional technology.

本發明之一目的在提供一種智慧軌道監控系統及其方法,具有透過影像辨識預先判斷軌道前方某一路段是否有異常及何種異常狀況的功能。An object of the present invention is to provide a smart track monitoring system and its method, which has the function of pre-judging whether there is any abnormality and what kind of abnormal condition in a certain section of the track ahead through image recognition.

本發明之另一目的在提供一種智慧軌道監控系統及其方法,具有即時通報鄰近軌道車輛某一軌道路段有異常狀況發生的功能。Another object of the present invention is to provide an intelligent track monitoring system and its method, which has the function of immediately notifying the occurrence of abnormal conditions in a certain track section of adjacent track vehicles.

為達成上述及其他目的,本發明之智慧軌道監控系統,包含:一雲端資料庫模組,儲存軌道車輛行車紀錄影像資料;一中央監控主系統,電性連接該雲端資料庫模組,進行資料訊號傳輸;及至少一車載子系統,各該車載子系統分別設置於複數軌道車輛上,且分別電性連結該雲端資料庫模組及該中央監控主系統,該車載子系統包含:一影像擷取模組,紀錄軌道車輛行車影像,產生一即時行車紀錄影像,並擷取該即時行車紀錄影像產生一欲比對影像;一即時影像儲存模組,儲存該即時行車紀錄影像及該欲比對影像;一資料傳輸模組,將該即時行車紀錄影像上傳至該雲端資料庫模組及從該雲端資料庫模組下載一參考影像;一參考影像儲存模組,儲存該參考影像;一影像辨識模組,辨識該欲比對影像與該參考影像之差異;一異常警示模組,當該影像辨識模組辨識出該欲比對影像與該參考影像之間有異常狀態時,該異常警示模組發出一警示訊號;及一控制模組,分別電性連結該影像擷取模組、該即時影像儲存模組、該參考影像儲存模組、該資料傳輸模組、該影像辨識模組及該異常警示模組,並控制各模組間的運行機制,其中,該欲比對影像及該參考影像之影像資訊包含紀錄日期時間及經緯度座標。In order to achieve the above and other objectives, the intelligent track monitoring system of the present invention includes: a cloud database module, which stores the driving record image data of rail vehicles; a central monitoring main system, which is electrically connected to the cloud database module, and performs data Signal transmission; and at least one vehicle-mounted subsystem, each of which is installed on a plurality of rail vehicles and electrically connected to the cloud database module and the central monitoring main system, the vehicle-mounted subsystem includes: an image capture A module for recording rail vehicle driving images, generating a real-time driving record image, and capturing the real-time driving record image to generate an image for comparison; a real-time image storage module for storing the real-time driving record image and the desired comparison image Image; a data transmission module, uploading the real-time driving record image to the cloud database module and downloading a reference image from the cloud database module; a reference image storage module, storing the reference image; an image recognition A module for identifying the difference between the image to be compared and the reference image; an abnormality warning module, when the image recognition module recognizes that there is an abnormal state between the image to be compared and the reference image, the abnormality warning module a warning signal; and a control module electrically connected to the image capture module, the real-time image storage module, the reference image storage module, the data transmission module, the image recognition module and the An abnormal warning module, and controls the operation mechanism among the modules, wherein, the image information of the image to be compared and the reference image includes recording date and time and latitude and longitude coordinates.

為達成上述及其他目的,本發明之智慧軌道監控方法,包含:由一資料傳輸模組從一雲端資料庫模組下載一參考影像,將該參考影像儲存在一參考影像儲存模組;從一影像擷取摸組取得一即時行車紀錄影像,再從該即時行車紀錄影像擷取一欲比對影像,並將該欲比對影像儲存在一即時影像儲存模組;由該資料傳輸模組將該即時行車紀錄影像傳送至該雲端資料庫模組儲存;分別從該參考影像及該欲比對影像擷取一參考經緯度座標及一欲比對經緯度座標,利用該參考經緯度座標及該欲比對經緯度座標進行影像重疊校正,使該參考影像及該欲比對影像之影像比對基準點在一座標誤差範圍內,依據影像之座標位置將該欲比對影像及該參考影像之畫面進行影像差異比對;當執行影像差異比對時,經辨識比對後若該欲比對影像之畫面有異常,由設置於該軌道車輛上之一異常警示模組發出一異常警示訊號。In order to achieve the above and other purposes, the intelligent track monitoring method of the present invention includes: downloading a reference image from a cloud database module by a data transmission module, storing the reference image in a reference image storage module; The image capture module obtains a real-time driving record image, and then captures an image to be compared from the real-time driving record image, and stores the image to be compared in a real-time image storage module; the data transmission module will The real-time driving record image is sent to the cloud database module for storage; a reference latitude and longitude coordinate and a latitude and longitude coordinate to be compared are respectively extracted from the reference image and the image to be compared, and the reference latitude and longitude coordinate and the to be compared image are used Image overlap correction is performed on the latitude and longitude coordinates, so that the image comparison reference point of the reference image and the image to be compared is within the error range of the coordinates, and the image difference is performed on the frame of the image to be compared and the reference image according to the coordinate position of the image Comparison: When performing image difference comparison, if there is any abnormality in the image to be compared after identification and comparison, an abnormality warning module installed on the rail vehicle will send out an abnormality warning signal.

在本發明的一些實施例中,該影像辨識模組另包含一測距單元,計算前方障礙物與軌道車輛間之距離。In some embodiments of the present invention, the image recognition module further includes a distance measuring unit for calculating the distance between the obstacle ahead and the rail vehicle.

在本發明的一些實施例中,該異常警示模組另包含一即時通報單元,將該警示訊號傳送至該中央監控主系統或其他軌道車輛。In some embodiments of the present invention, the abnormal warning module further includes an instant notification unit, which transmits the warning signal to the central monitoring main system or other rail vehicles.

在本發明的一些實施例中,該控制模組另包含一制動單元,電性連接該軌道車輛之煞車系統,降低該軌道車輛行駛速度。In some embodiments of the present invention, the control module further includes a braking unit electrically connected to the braking system of the rail vehicle to reduce the speed of the rail vehicle.

在本發明的一些實施例中,該欲比對影像及該參考影像之畫面進行影像差異比對時,具有一比對週期。In some embodiments of the present invention, there is a comparison period when the images to be compared and the frames of the reference image are compared for image differences.

在本發明的一些實施例中,當執行影像差異比對時,經辨識比對後若該欲比對影像之畫面有異常,在該欲比對影像中界定出一異常範圍,依據軌道車輛當下之行駛速度及經緯度座標計算多久單位時間內到該達異範圍之座標位置。In some embodiments of the present invention, when performing image difference comparison, if there is an abnormality in the picture of the image to be compared after identification and comparison, an abnormal range is defined in the image to be compared, according to the current state of the rail vehicle. The driving speed and latitude and longitude coordinates calculate how long it takes to reach the coordinate position of the different range within a unit of time.

在本發明的一些實施例中,在該欲比對影像中界定出一異常範圍後,依據該異常範圍在該欲比對影像中之位置區域,判斷是否在行徑軌道上、對向軌道上或橫跨雙向軌道。In some embodiments of the present invention, after an abnormal range is defined in the image to be compared, it is judged whether the abnormal range is on the moving track, on the opposite track or across the two-way track.

在本發明的一些實施例中,當執行影像差異比對時,在該欲比對影像及該參考影像之畫面分別界定一比對範圍,經辨識比對後若該欲比對影像之畫面有異常點,但異常點位置落於該比對範圍外,則仍判定為無異常狀態。In some embodiments of the present invention, when image difference comparison is performed, a comparison range is respectively defined on the frame of the image to be compared and the frame of the reference image, and after identification and comparison, if the frame of the image to be compared has abnormal point, but the position of the abnormal point falls outside the comparison range, it is still judged as no abnormal state.

在本發明的一些實施例中,當執行影像差異比對時,經辨識比對後若該欲比對影像之畫面有異常,該異常警示模組啟動一制動單元,該制動單元降低軌道車輛行駛速度。In some embodiments of the present invention, when image difference comparison is performed, if there is an abnormality in the image to be compared after identification and comparison, the abnormality warning module activates a braking unit, and the braking unit reduces the speed of the rail vehicle. speed.

圖1為本發明之智慧軌道監控系統之一實施例架構圖,請參考圖1。本發明之智慧軌道監控系統,包含:一雲端資料庫模組(10)、一中央監控模組(20)及至少一車載子系統(30),該雲端資料庫模組(10)儲存軌道車輛行車紀錄影像資料,該中央監控主系統(20)電性連接該雲端資料庫模組(10),進行資料訊號傳輸,各該車載子系統(30)分別設置於複數軌道車輛(RV),且分別電性連結該雲端資料庫模組(10)及該中央監控主系統(20)。FIG. 1 is a structure diagram of an embodiment of the smart track monitoring system of the present invention, please refer to FIG. 1 . The intelligent track monitoring system of the present invention comprises: a cloud database module (10), a central monitoring module (20) and at least one on-board subsystem (30), and the cloud database module (10) stores rail vehicles Driving record image data, the central monitoring main system (20) is electrically connected to the cloud database module (10) for data signal transmission, each of the on-board subsystems (30) is respectively set on a plurality of rail vehicles (RV), and The cloud database module (10) and the central monitoring main system (20) are respectively electrically connected.

各該車載子系統(30)較佳具有一身分辨識碼,做為其所設置之軌道車輛身分識別,該車載子系統(30)包含:一影像擷取模組(31)、一即時影像儲存模組(32)、一資料傳輸模組(33)、一參考影像儲存模組(34)、一影像辨識模組(35)、一異常警示模組(36)及一控制模組(37),其中,該影像擷取模組(31)較佳為具有高倍數之遠距攝像器,用以紀錄軌道車輛行車影像,產生一即時行車紀錄影像,並進行畫面擷取產生一欲比對影像(IC)。Each of the on-board subsystems (30) preferably has a body identification code, as the identity identification of the rail vehicle provided by it, the on-board subsystem (30) includes: an image capture module (31), a real-time image storage Module (32), a data transmission module (33), a reference image storage module (34), an image recognition module (35), an abnormal warning module (36) and a control module (37) , wherein, the image capture module (31) is preferably a high-magnification telephoto camera for recording rail vehicle driving images, generating a real-time driving record image, and performing frame capture to generate a desired comparison image (IC).

該影像擷取模組(31)具有一衛星定位單元,當執行軌道車輛行車紀錄時,該衛星定位單元會同時將時間及經緯度座標記錄於行車紀錄的影像檔資料中,因此,該欲比對影像(IC)每一幀畫面(單位時間影像畫面)均同時具有時間序列及經緯度座標資訊,可以透過時間序列或經緯度座標鎖定特定時間點或特定座標的影像畫面。在本實施例中,依據實際需求,設定一影像擷取週期來擷取影像畫面產生該欲比對影像(IC),例如每5秒擷取一次,使得該欲比對影像(IC)具有時間及座標資訊,以作為影像比對之參考基準。另外,該欲比對影像(IC)也可依據行駛距離,例如每行駛10公尺擷取一次影像,其中行駛距離可以兩點之直線距離或是實際行駛距離計算。The image capture module (31) has a satellite positioning unit. When the track vehicle driving record is executed, the satellite positioning unit will simultaneously record the time and latitude and longitude coordinates in the image file data of the driving record. Therefore, the desired comparison Each frame of image (IC) (image frame per unit time) has time series and latitude and longitude coordinate information at the same time, and the image frame at a specific time point or specific coordinate can be locked through time series or latitude and longitude coordinates. In this embodiment, according to actual needs, an image capture cycle is set to capture image frames to generate the image to be compared (IC), for example, once every 5 seconds, so that the image to be compared (IC) has time and coordinate information as a reference for image comparison. In addition, the image to be compared (IC) can also be based on the driving distance, for example, an image is captured every 10 meters, and the driving distance can be calculated by the straight-line distance between two points or the actual driving distance.

該即時影像儲存模組(32)儲存該即時行車紀錄影像及該欲比對影像(IC)。該即時行車紀錄影像可以作為後續其他軌道車輛進行影像比對時的參考影像,當該影像擷取模組(31)擷取該欲比對影像(IC)後,依序將其儲存在該即時影像儲存模組(32),作為影像畫面比對使用來判斷行車軌道上是否有異常狀況。The real-time image storage module (32) stores the real-time driving record image and the image to be compared (IC). The real-time driving record image can be used as a reference image for subsequent image comparison of other rail vehicles. After the image capture module (31) captures the image to be compared (IC), it is sequentially stored in the real-time The image storage module (32) is used as an image frame comparison to determine whether there is an abnormal condition on the driving track.

該資料傳輸模組(33)將該即時行車紀錄影像上傳至該雲端資料庫模組(10)及從該雲端資料庫模組(10)下載一參考影像(IR)。該即時行車紀錄影像被上傳至該雲端資料庫模組(10)儲存備份,可供做為後續參考影像的來源,而該參考影像(IR)系作為影像比對之用,下載後儲存在該參考影像儲存模組(34),其中,該參考影像(IR)亦包含時間序列及經緯度座標等資訊。The data transmission module (33) uploads the real-time driving record image to the cloud database module (10) and downloads a reference image (IR) from the cloud database module (10). The real-time driving record image is uploaded to the cloud database module (10) for storage and backup, which can be used as a source of subsequent reference images, and the reference image (IR) is used for image comparison, and is stored in the A reference image storage module (34), wherein the reference image (IR) also includes information such as time series and latitude and longitude coordinates.

該影像辨識模組(35)辨識該欲比對影像(IC)與該參考影像(IR)之差異。由於軌道車輛所行駛之軌道及其周邊畫面原則上是固定的,不會有太大的變化,例如:高鐵軌道、台鐵軌道、捷運軌道或輕軌捷運軌道,利用高解析度之行車紀錄的影像畫面可以將辨識範圍往前推至數百公尺處,甚至更遠之處,再透過計算影像畫面像素中某一點或範圍與軌道車輛的相對位置或相距距離。在一般情況,相同座標位置下,該欲比對影像(IC)與該參考影像(IR)之影像畫面除了因為氣候因素或是白天晚上明亮度有差外,兩者影像畫面不會有異常變化,例如軌道本身及其周遭環境,除非軌道變形或軌道上有大型異物,亦或其他軌道車輛,如工程作業車。The image identification module (35) identifies the difference between the image to be compared (IC) and the reference image (IR). Since the track on which the rail vehicle travels and its surrounding images are fixed in principle, there will not be much change, such as: high-speed rail track, Taiwan Railway track, MRT track or light rail MRT track, using high-resolution driving records The image screen can push the recognition range forward to hundreds of meters, or even farther, and then calculate the relative position or distance between a certain point or range in the pixel of the image screen and the rail vehicle. Under normal circumstances, under the same coordinate position, the image frames of the image to be compared (IC) and the reference image (IR) will not have abnormal changes except for weather factors or differences in brightness during the day and night. , such as the track itself and its surroundings, unless the track is deformed or there are large foreign objects on the track, or other track vehicles, such as engineering vehicles.

該影像辨識模組(35)依據該欲比對影像(IC)與該參考影像(IR)中的座標位置選定比對座標點進行兩者畫面之比對,經由影像辨識比對出兩者之影像畫面是否有差異,並在該欲比對影像(IC)畫面中找出差異點所在之位置。例如,當軌道車輛來到某一座標位置時,即軌道某一段落點,經確定座標位置後,在正常情況下,該影像擷取模組(31)將所擷取之該欲比對影像(IC)與該參考影像(IR)之畫面重疊,兩者畫面內容是吻合的,即表示前方軌道路徑上並無異常狀況。The image recognition module (35) selects the comparison coordinate points according to the coordinate positions in the image to be compared (IC) and the reference image (IR) to compare the two frames, and compares the two images through image recognition. Whether there is a difference in the image screen, and find out the position of the difference point in the image to be compared (IC) screen. For example, when the rail vehicle comes to a certain coordinate position, that is, a certain section of the track, after the coordinate position is determined, under normal circumstances, the image capture module (31) captures the image to be compared ( IC) and the frame of the reference image (IR) overlap, and the content of the two frames is consistent, which means that there is no abnormal situation on the track path ahead.

圖4為本發明之智慧軌道監控方法之一實施例影像比對示意圖,請參考圖4。該影像辨識模組(35)依據該欲比對影像(IC)與該參考影像(IR)中的座標位置選定比對座標點進行兩者畫面之比對,若差異處為不重要或比對範圍以外之差異,舉例來說,該欲比對影像與該參考影像之差異處在影像畫面某一處,惟,該差異處在實際上之距離與行徑軌道相距甚遠,並不影響行車安全,因此,仍判定兩者畫面相同,並無異常狀況。FIG. 4 is a schematic diagram of image comparison of an embodiment of the smart track monitoring method of the present invention, please refer to FIG. 4 . The image recognition module (35) selects the comparison coordinate points according to the coordinate positions in the image to be compared (IC) and the reference image (IR) to compare the two images, if the difference is unimportant or compared The difference outside the range, for example, the difference between the image to be compared and the reference image is at a certain position in the image frame, but the actual distance of the difference is far from the track, which does not affect driving safety. Therefore, it is still judged that the two screens are the same, and there is no abnormal situation.

圖2為本發明之智慧軌道監控系統之另一實施例架構圖,請參考圖2。較佳地,該影像辨識模組(35)另包含一測距單元(350),若該比對影像(IC)之畫面有異常,透過計算影像畫面中某一點或某一區域範圍與軌道車輛的相對位置或距離,可依據該影像擷取模組(31)鏡頭之焦距、像素(Pixel)大小與障礙物(被攝體)之比例進行推算,計算出前方障礙物或異狀之位置與軌道車輛間之距離L,其中,距離L=焦距 ,被攝體為異物或障礙物,焦距及像素大小為已知,被攝體尺寸(長度或寬度)可以透過影像辨識判定被攝體屬於哪種物體來決定,例如先判定為小客車、卡車或軌道工程作業車,而該些車種之尺寸(長度或寬度)可事先依據車種設定幾組預設值來計算,例如同為小客車,尺寸誤差不大,不影響實際計算結果。或是,由於軌道寬度是固定尺寸,可以依據影像中異物或障礙物之長寬與軌道寬度之比例推算出被攝體尺寸實際大小,以作為計算數據,例如一些掉落物,如大石塊、鷹架之類。透過該測距單元(350)之功能,可以依據當時的車速採取相對的因應措施,例如減速,以進行緊急處理。 FIG. 2 is a structure diagram of another embodiment of the smart track monitoring system of the present invention, please refer to FIG. 2 . Preferably, the image recognition module (35) further includes a distance measuring unit (350), if there is an abnormality in the picture of the comparison image (IC), by calculating the distance between a certain point or a certain area in the image picture and the range of the rail vehicle The relative position or distance can be calculated according to the focal length of the lens of the image capture module (31), the size of the pixel (Pixel) and the ratio of the obstacle (subject), and the position and position of the obstacle or abnormal shape in front can be calculated. Distance L between rail vehicles, where, distance L = focal length , the subject is a foreign object or obstacle, the focal length and pixel size are known, and the subject size (length or width) can be determined through image recognition to determine what kind of object the subject belongs to. For example, first determine whether it is a passenger car or a truck Or track engineering vehicles, and the size (length or width) of these types of vehicles can be calculated in advance by setting several sets of preset values according to the types of vehicles. Or, since the width of the track is a fixed size, the actual size of the subject can be calculated based on the ratio of the length and width of the foreign object or obstacle in the image to the width of the track, as calculation data, such as some falling objects, such as large rocks , scaffolding and the like. Through the function of the distance measuring unit (350), relative response measures can be taken according to the vehicle speed at that time, such as deceleration, for emergency treatment.

圖3為本發明之智慧軌道監控系統之一實施例異物阻礙軌道示意圖。當該影像辨識模組(35)辨識出該欲比對影像與該參考影像之間有異常狀態時,該異常警示模組(36)發出一警示訊號。該警示訊號可以為聲音、燈光或電子訊號,用以通知軌道車輛駕駛人員。Fig. 3 is a schematic diagram of a foreign object obstructing the track according to an embodiment of the intelligent track monitoring system of the present invention. When the image recognition module (35) recognizes that there is an abnormal state between the image to be compared and the reference image, the abnormality warning module (36) sends out a warning signal. The warning signal can be sound, light or electronic signal to notify the rail vehicle driver.

請續參考圖2及圖3。較佳地,該異常警示模組(36)另包含一即時通報單元(360),將該警示訊號傳送至該中央監控主系統(20)或其他軌道車輛。該中央監控主系統(20)為所有軌道車輛之調度監控中心,當接收到該警示訊號時,可以立即進行緊急處理,例如;透過該身分辨識碼通知異常狀況發事地點即將經過之軌道車輛提高警覺,注意前方路況,或由發現異狀之軌道車輛直接通知其他即將經過該路段之軌道車輛提高警覺。Please continue to refer to FIG. 2 and FIG. 3 . Preferably, the abnormal warning module (36) further includes an instant notification unit (360), which transmits the warning signal to the central monitoring main system (20) or other rail vehicles. The central monitoring main system (20) is the dispatching and monitoring center of all rail vehicles. When receiving the warning signal, it can immediately carry out emergency treatment, for example; notify the rail vehicle that is about to pass by the abnormal situation through the identification code to improve Be vigilant, pay attention to the road conditions ahead, or directly notify other rail vehicles that are about to pass through the road section by the rail vehicle that finds an abnormal situation to raise their vigilance.

該控制模組(37)分別電性連結該影像擷取模組(31)、該即時影像儲存模組(32)、該參考影像儲存模組(33)、該資料傳輸模組(34)、該影像辨識模組(35) 及該異常警示模組(36),控制各模組間的運行機制,並藉由該控制模組(37)與該該中央監控主系統(20)網路連線,進行控制訊號與數據資料的傳輸。The control module (37) is electrically connected to the image capture module (31), the real-time image storage module (32), the reference image storage module (33), the data transmission module (34), The image recognition module (35) and the abnormal warning module (36) control the operation mechanism between the modules, and are connected to the central monitoring main system (20) network through the control module (37) Lines for the transmission of control signals and data data.

請續參考圖2。較佳地,該控制模組(37)另包含一制動單元(370),電性連接該軌道車輛(RV)之煞車系統,降低該軌道車輛(RV)行駛速度。當該異常警示模組(36)發出該警示訊號時,可以依據該制動單元(370)的設定,自行啟動降速的功能,使得該軌道車輛(RV)依據當下的車速自動適應性降速,例如;當該影像辨識模組(35)發現前方軌道上有異狀或異物,例如一般車輛卡在軌道上、或是軌道工程作業車執行作業時卻忘記通報,此時,該比對影像(IC)中即會被該影像辨識模組(35)辨識比對出異樣,因為在該參考影像(IR)中之該路段並不會有車輛在軌道上。因此,該制動單元(370)便可適應性的立即自動依據當下車速進行適當的減速動作,來確保該軌道車輛(RV)不會因為急煞或撞上前方的異物出軌或翻覆,可將傷亡降至最低。Please continue to refer to Figure 2. Preferably, the control module (37) further includes a braking unit (370), which is electrically connected to the braking system of the rail vehicle (RV) to reduce the speed of the rail vehicle (RV). When the abnormal warning module (36) sends out the warning signal, it can automatically start the deceleration function according to the setting of the braking unit (370), so that the rail vehicle (RV) can automatically decelerate adaptively according to the current vehicle speed, For example; when the image recognition module (35) finds that there are abnormalities or foreign objects on the track ahead, such as general vehicles stuck on the track, or when the track engineering vehicle performs operations, but forget to notify, at this time, the comparison image ( IC) will be identified and compared by the image recognition module (35) to be abnormal, because there is no vehicle on the track in the road section in the reference image (IR). Therefore, the braking unit (370) can immediately and automatically perform appropriate deceleration actions according to the current vehicle speed adaptively, so as to ensure that the rail vehicle (RV) will not derail or overturn due to sudden braking or hitting a foreign object in front, which can reduce casualties minimized.

本發明之智慧軌道監控方法,包含:由一資料傳輸模組從一雲端資料庫模組下載一參考影像,將該參考影像儲存在一參考影像儲存模組,作為參考比對影像之用,其中,該參考影像儲存模組設置在一軌道車輛上。The intelligent track monitoring method of the present invention includes: downloading a reference image from a cloud database module by a data transmission module, and storing the reference image in a reference image storage module for use as a reference comparison image, wherein , the reference image storage module is set on a rail vehicle.

從一影像擷取摸組取得一欲比對影像,其中,該影像擷取摸組設置在該軌道車輛上,並將該欲比對影像儲存在一即時影像儲存模組。該影像擷取模組較佳設置於軌道車輛車頭前方,紀錄該軌道車輛行進時之前方路況影像,產生一即時行車紀錄影像,並將該即時行車紀錄影像儲存在該即時影像儲存模組,該影像擷取摸組從該即時行車紀錄影像進行畫面擷取產生一欲比對影像,其中,該即時行車紀錄影像包含軌道及其週遭影像,且包含了時間序列及經緯度座標資訊。An image to be compared is obtained from an image capture module, wherein the image capture module is set on the rail vehicle, and the image to be compared is stored in a real-time image storage module. The image capture module is preferably arranged in front of the front of the rail vehicle, records the front road condition image when the rail vehicle is moving, generates a real-time driving record image, and stores the real-time driving record image in the real-time image storage module, the The image capture module performs frame capture from the real-time driving record image to generate an image to be compared, wherein the real-time driving record image includes the track and its surrounding images, and includes time series and latitude and longitude coordinate information.

較佳地,該欲比對影像及該參考影像之畫面進行影像差異比對時,具有一比對週期。該比對週期可以為單位時間或是單位距離,該欲比對影像依據實際需求從該即時行車紀錄影像中擷取,設定一週期或是一行車距離來進行影像擷取,例如每5秒或10秒擷取影像一次或是每10公尺或20公尺擷取影像一次,可以依據行駛路段環境調整擷取的方式、時間週期或行車距離,已取得較佳之欲比對影像,其中,所得之複數該欲比對影像也包含時間及經緯度座標資訊。Preferably, there is a comparison period when the images to be compared and the frames of the reference image are compared for image differences. The comparison cycle can be unit time or unit distance. The image to be compared is extracted from the real-time driving record image according to actual needs, and a cycle or driving distance is set for image acquisition, for example, every 5 seconds or Capture images once every 10 seconds or every 10 meters or 20 meters. You can adjust the capture method, time period or driving distance according to the environment of the driving section, and have obtained better images for comparison. Among them, the obtained The plural images to be compared also include time and latitude and longitude coordinate information.

該資料傳輸模組將該即時行車紀錄影像傳送至該雲端資料庫模組儲存。該即時行車紀錄影像被上傳至該雲端資料庫模組儲存備份,可供做為後續參考影像的來源,即較早行駛之軌道車輛所記錄之即時行車紀錄影像做為後續較晚行駛之軌道車輛之參考影像,因此,該參考影像亦包含時間序列及經緯度座標等資訊。The data transmission module transmits the real-time driving record image to the cloud database module for storage. The real-time driving record image is uploaded to the cloud database module for storage and backup, which can be used as a source of subsequent reference images, that is, the real-time driving record image recorded by the earlier rail vehicle is used as the subsequent later rail vehicle Therefore, the reference image also includes information such as time series and latitude and longitude coordinates.

接著,利用一影像辨識模組分別從該參考影像及該欲比對影像擷取一參考經緯度座標及一欲比對經緯度座標資訊,利用該參考經緯度座標及該欲比對經緯度座標進行影像重疊校正,使該參考影像及該欲比對影像之畫面比對基準點在一座標誤差範圍內,依據影像之座標位置將該欲比對影像及該參考影像之畫面進行影像差異比對。Then, using an image recognition module to extract a reference latitude and longitude coordinate and a latitude and longitude coordinate information to be compared from the reference image and the image to be compared respectively, and performing image overlap correction by using the reference latitude and longitude coordinate and the latitude and longitude coordinate to be compared Make the frame comparison reference point of the reference image and the image to be compared within the coordinate error range, and perform image difference comparison between the frames of the image to be compared and the reference image according to the coordinate positions of the images.

由於每一張影像畫面其所定位之座標會因為GPS定位系統本身、車速或其他干擾等因素而影響實際的經緯度座標,所以,當該參考影像之畫面及該欲比對影像之畫面進行比對時,較佳先進行座標校正,例如該座標誤差範圍為10公尺,則表示在比對座標點之前後10公尺內均為誤差合理範圍。在本實施例中,該座標誤差範圍為5公尺,即該影像辨識模組在辨識比對過程中,將針對該欲比對影像與該參考影像之比對座標點前後各5公尺的影像依序進行比對。若在該座標誤差範圍內比對後,該欲比對影像與該參考影像兩者間有出現至少一次以上相同畫面,則代表無異常狀況,若整個比對範圍區間均沒有相同畫面,則表示有異狀。另外,為了避免誤判,可以增加相同畫面出現次數的判定,在本實施例中,設定為比對出現兩次相同畫面才代表無異常狀況。Since the coordinates of each image frame will affect the actual latitude and longitude coordinates due to factors such as the GPS positioning system itself, vehicle speed or other interference, so when the frame of the reference image is compared with the frame of the image to be compared , it is better to perform coordinate correction first. For example, if the coordinate error range is 10 meters, it means that the error range within 10 meters before and after the coordinate point is within a reasonable error range. In this embodiment, the coordinate error range is 5 meters, that is, the image recognition module will, in the process of recognition and comparison, take the distance of 5 meters before and after the comparison coordinate point between the image to be compared and the reference image The images are compared sequentially. If there is at least one identical image between the image to be compared and the reference image after the comparison within the coordinate error range, it means that there is no abnormality; if there is no identical image in the entire comparison range, it means There are abnormalities. In addition, in order to avoid misjudgment, the determination of the number of occurrences of the same screen can be increased. In this embodiment, it is set to compare the appearance of the same screen twice to indicate that there is no abnormal situation.

請續參考圖4。當執行影像差異比對時,在該欲比對影像及該參考影像之畫面分別界定一比對範圍,經辨識比對後若該欲比對影像之畫面有異常點,但異常點位置落於該比對範圍外,則仍判定為無異常狀態。相同畫面之認定可依據影像辨識實際需求忽略不重要或在該比對範圍以外之差異,舉例來說,該欲比對影像與該參考影像之差異處在影像畫面某一處,惟,該差異處落於該比對範圍外,即表示該差異處在實際上之距離與行徑軌道相距甚遠,並不影響行車安全,因此,仍判定無異常。Please continue to refer to FIG. 4 . When performing image difference comparison, a comparison range is defined on the frame of the image to be compared and the frame of the reference image. If it is outside the comparison range, it is still judged to be in a non-abnormal state. The determination of the same picture can be based on the actual needs of image recognition and ignore the differences that are not important or outside the scope of the comparison. For example, the difference between the image to be compared and the reference image is in a certain part of the image frame, but the difference If it falls outside the comparison range, it means that the difference is far from the actual distance and the track, which does not affect driving safety. Therefore, it is still determined that there is no abnormality.

圖5為本發明之智慧軌道監控方法之一實施例異常狀態示意圖,請參考圖5。當執行影像差異比對時,經辨識比對後若該欲比對影像之畫面有異常,由設置於該軌道車輛上之一異常警示模組發出一異常警示訊號。當欲比對影像之畫面與該參考影像之畫面有不吻合之處時,該異常警示模組發出該異常警示訊號通知駕駛員注意,該警示訊號可以為聲音、燈光或電子訊號。FIG. 5 is a schematic diagram of an abnormal state of an embodiment of the smart track monitoring method of the present invention, please refer to FIG. 5 . When performing image difference comparison, if there is any abnormality in the image to be compared after identification and comparison, an abnormality warning module installed on the rail vehicle will send out an abnormality warning signal. When there is a discrepancy between the frame of the image to be compared and the frame of the reference image, the abnormality warning module sends out the abnormality warning signal to inform the driver to pay attention. The warning signal can be sound, light or electronic signal.

較佳地,當執行影像差異比對時,經辨識比對後若該欲比對影像之畫面有異常,該異常警示訊號被傳送至一中央監控主系統或其他軌道車輛。當異常狀況發生時,該異常警示訊號除了通知該軌道車輛之駕駛員外,該異常警示模組亦同時將該異常警示訊號之電子訊號傳送至該中央監控主系統或其他準備經過異常點或事故點之軌道車輛,由該中央監控主系統依據每一軌道車輛行駛路線及位置進行緊急通報,或由該軌道列車直接通報即將經過該異常點或事故點之其他軌道車輛,讓其他軌道車輛有所準備,避免連環事故發生。Preferably, when image difference comparison is performed, if there is an abnormality in the image to be compared after identification and comparison, the abnormality warning signal is sent to a central monitoring main system or other rail vehicles. When an abnormal situation occurs, the abnormal warning signal not only informs the driver of the rail vehicle, the abnormal warning module also transmits the electronic signal of the abnormal warning signal to the central monitoring main system or other preparations to pass through the abnormal point or accident point The central monitoring main system will make emergency notifications based on the route and location of each rail vehicle, or the rail train will directly notify other rail vehicles that are about to pass the abnormal point or accident point, so that other rail vehicles can prepare , to avoid serial accidents.

圖6為本發明之智慧軌道監控方法之另一實施例異常狀態示意圖,請續參考圖6,並續參考圖3。較佳地,當執行影像差異比對時,經辨識比對後若該欲比對影像之畫面有異常,在該欲比對影像中之異常區域界定出一異常範圍,依據軌道車輛當下之行駛速度及經緯度座標計算多久單位時間內到該達異範圍之座標位置。當該欲比對影像之畫面有異物出現時,將該異物範圍界定後得到該異常範圍數據,再經由在影像畫面中之位置依據像素(Pixel)比例計算實際距離,再經由軌道車輛當下經緯度座標及車速計算多內到該達異範圍之座標位置,藉此,可以提供駕駛人員進行緊急狀況之對應措施。軌道車輛與異物間之距離L=焦距 ,被攝體為異物或障礙物,焦距及像素大小為已知,被攝體尺寸(長度或寬度)可以由該異常範圍數據對造影像比例方式計算取得。另外,為了更精準計算多久到達異物之座標處之時間T,可以將從比對到異狀及計算出距離這段時間 ,依據軌道車前進之速度V計算此段時間之前進距離 ,其中, ,則T= FIG. 6 is a schematic diagram of an abnormal state of another embodiment of the smart track monitoring method of the present invention. Please continue to refer to FIG. 6 and continue to refer to FIG. 3 . Preferably, when performing image difference comparison, if there is an abnormality in the picture of the image to be compared after identification and comparison, an abnormal range is defined in the abnormal area in the image to be compared, according to the current driving of the rail vehicle The speed and latitude and longitude coordinates calculate how long it takes to reach the coordinate position of the range within a unit of time. When there is a foreign object on the image to be compared, the abnormal range data is obtained after defining the range of the foreign object, and then the actual distance is calculated according to the pixel (Pixel) ratio based on the position in the image screen, and then the current latitude and longitude coordinates of the rail vehicle And the coordinate position within the range within which the vehicle speed is calculated can provide drivers with corresponding measures for emergency situations. The distance between the rail vehicle and the foreign body L=focal length , the subject is a foreign object or an obstacle, the focal length and pixel size are known, and the subject size (length or width) can be obtained by calculating the ratio of the abnormal range data to the angiographic image. In addition, in order to more accurately calculate how long it takes to reach the coordinates of the foreign object T, the time from the comparison to the abnormality and the calculation of the distance can be calculated , according to the forward speed V of the rail car to calculate the forward distance during this period ,in, V , then T= .

請續參考圖3及圖5。較佳地,在該欲比對影像中界定出一異常範圍後,依據該異常範圍在該欲比對影像中之位置區域,判斷是否在行徑軌道上、對向軌道上或橫跨雙向軌道。一般軌道車輛所行使之軌道通常是兩個行進方向軌道緊靠,只保持兩反向軌道車輛車身行駛之安全距離,因此,可以從該欲比對影像畫面中之異常點或異常範圍之位置及範圍,來反推該異常點是否在行徑軌道上、對向軌道上或橫跨雙向軌道,例如異常點之範圍若是在軌道寬度內,則不影響對向車道,例如體積較小之不明物體掉落或是軌道工程修護車,若異常點之範圍較廣,已超過軌道寬度,則表示異物可能橫跨兩個車道,恐影響對向車道,例如大型卡車在軌道上拋錨,此時,透過該異常警示模組發出一異常警示訊號通知駕駛員。另外,若該欲比對影像畫面中之異常點或異常範圍之位置及範圍座落在對向軌道上,則該異常警示模組發出之異常警示訊號可將此狀況通知駕駛員,以利進行異常通報讓對向列車駕駛員知曉。Please continue to refer to FIG. 3 and FIG. 5 . Preferably, after an abnormal range is defined in the image to be compared, it is determined whether the abnormal range is on the moving track, on the opposite track or across the two-way track according to the position area of the abnormal range in the image to be compared. The track used by the general rail vehicle is usually close to the track in the two traveling directions, and only the safe distance between the two opposite rail vehicle bodies is maintained. Therefore, the location of the abnormal point or abnormal range in the image to be compared can be compared range, to deduce whether the abnormal point is on the track, on the opposite track or across the two-way track. For example, if the range of the abnormal point is within the width of the track, it will not affect the opposite lane. For example, if a small unknown object falls If the abnormal point is wider than the width of the track, it means that the foreign object may span two lanes and may affect the opposite lane. For example, a large truck breaks down on the track. At this time, through The abnormal warning module sends out an abnormal warning signal to notify the driver. In addition, if the position and range of the abnormal point or abnormal range in the image to be compared is located on the opposite track, the abnormal warning signal issued by the abnormal warning module can notify the driver of this situation, so as to facilitate The abnormal notification lets the driver of the opposite train know.

較佳地,當執行影像差異比對時,經辨識比對後若該欲比對影像之畫面有異常,該異常警示模組啟動一制動單元,該制動單元降低軌道車輛行駛速度。當該影像辨識模組發現前方軌道上有異狀,例如車輛卡在軌道上、或是軌道工程作業車執行作業時卻忘記通報,此時,該制動單元立即自動依據當下車速進行適當的減速動作,來確保該軌道車輛不會因為急煞或撞上前方的異物出軌或翻覆,將傷亡降至最低。Preferably, when image difference comparison is performed, if there is an abnormality in the image to be compared after identification and comparison, the abnormality warning module activates a braking unit, and the braking unit reduces the speed of the rail vehicle. When the image recognition module finds that there is an abnormality on the track ahead, such as a vehicle stuck on the track, or a track engineering vehicle forgets to notify when performing operations, the braking unit immediately and automatically performs an appropriate deceleration action according to the current vehicle speed , to ensure that the rail vehicle will not derail or overturn due to sudden braking or hitting a foreign object in front, so as to minimize casualties.

以上所述之實施例僅係為說明本發明之技術思想及特徵,其目的在使熟習此項技藝之人士均能了解本發明之內容並據以實施,當不能以此限定本發明之專利範圍,凡依本發明之精神及說明書內容所作之均等變化或修飾,皆應涵蓋於本發明專利範圍內。The above-mentioned embodiments are only to illustrate the technical ideas and characteristics of the present invention, and its purpose is to enable those who are familiar with this art to understand the content of the present invention and implement it accordingly, and should not limit the patent scope of the present invention. , all equivalent changes or modifications made in accordance with the spirit of the present invention and the content of the description shall be covered within the patent scope of the present invention.

10:雲端資料庫模組 20:中央監控主系統 30:車載子系統 31:影像擷取模組 32:即時影像儲存模組 33:資料傳輸模組 34:參考影像儲存模組 35:影像辨識模組 350:測距單元 36:異常警示模組 360:即時通報單元 37:控制模組 370:制動單元 RV:軌道車輛 IC:欲比對影像 IR:參考影像 10:Cloud database module 20: Central monitoring main system 30: On-board subsystem 31: Image capture module 32: Real-time image storage module 33: Data transmission module 34:Reference image storage module 35: Image recognition module 350: ranging unit 36: Abnormal warning module 360: instant notification unit 37: Control module 370: brake unit RV: rail vehicle IC: want to compare images IR: Reference Image

圖1為本發明之智慧軌道監控系統之一實施例架構圖; 圖2為本發明之智慧軌道監控系統之另一實施例架構圖; 圖3為本發明之智慧軌道監控系統之一實施例異物阻礙軌道示意圖; 圖4為本發明之智慧軌道監控方法之一實施例影像比對示意圖; 圖5為本發明之智慧軌道監控方法之一實施例異常狀態示意圖; 圖6為本發明之智慧軌道監控方法之另一實施例異常狀態示意圖。 Fig. 1 is a structure diagram of an embodiment of the smart track monitoring system of the present invention; FIG. 2 is a structural diagram of another embodiment of the smart track monitoring system of the present invention; Fig. 3 is a schematic diagram of foreign matter obstructing the track of one embodiment of the smart track monitoring system of the present invention; Fig. 4 is a schematic diagram of image comparison of an embodiment of the smart track monitoring method of the present invention; Fig. 5 is a schematic diagram of an abnormal state of an embodiment of the smart track monitoring method of the present invention; FIG. 6 is a schematic diagram of an abnormal state of another embodiment of the smart track monitoring method of the present invention.

10:雲端資料庫模組 10:Cloud database module

20:中央監控主系統 20: Central monitoring main system

30:車載子系統 30: On-board subsystem

31:影像擷取模組 31: Image capture module

32:即時影像儲存模組 32: Real-time image storage module

33:資料傳輸模組 33: Data transmission module

34:參考影像儲存模組 34:Reference image storage module

35:影像辨識模組 35: Image recognition module

36:影像辨識模組 36: Image recognition module

37:影像辨識模組 37: Image recognition module

RV:軌道車輛 RV: rail vehicle

IC:欲比對影像 IC: want to compare images

IR:參考影像 IR: Reference Image

Claims (10)

一種智慧軌道監控系統,包含: 一雲端資料庫模組(10),儲存軌道車輛行車紀錄影像資料; 一中央監控主系統(20),電性連接該雲端資料庫模組(10),進行資料訊號傳輸;及至少一車載子系統(30),各該車載子系統(30)分別設置於複數軌道車輛(RV)上,且分別電性連結該雲端資料庫模組(10)及該中央監控主系統(20), 其中,該車載子系統(30)包含: 一影像擷取模組(31),紀錄軌道車輛行車影像,產生一即時行車紀錄影像,並擷取該即時行車紀錄影像產生一欲比對影像(IC); 一即時影像儲存模組(32),儲存該即時行車紀錄影像及該欲比對影像(IC); 一資料傳輸模組(33),將該即時行車紀錄影像上傳至該雲端資料庫模組(10)及從該雲端資料庫模組(10)下載一參考影像(IR); 一參考影像儲存模組(34),儲存該參考影像(IR); 一影像辨識模組(35),辨識該欲比對影像與該參考影像之差異; 一異常警示模組(36),當該影像辨識模組(35)辨識出該欲比對影像與該參考影像之間有異常狀態時,該異常警示模組(36)發出一警示訊號;及 一控制模組(37),分別電性連結該影像擷取模組(31)、該即時影像儲存模組(32)、該參考影像儲存模組(33)、該資料傳輸模組(34) 、該影像辨識模組(35) 及該異常警示模組(36),並控制各模組間的運行機制,其中,該欲比對影像及該參考影像之影像資訊包含紀錄日期時間及經緯度座標。 A smart track monitoring system, comprising: A cloud database module (10), storing the driving record image data of rail vehicles; A central monitoring main system (20), electrically connected to the cloud database module (10), for data signal transmission; and at least one vehicle-mounted subsystem (30), each of which is installed on a plurality of tracks On the vehicle (RV), and electrically connected to the cloud database module (10) and the central monitoring main system (20), respectively, Wherein, the on-board subsystem (30) includes: An image capture module (31), records the running image of the rail vehicle, generates a real-time driving record image, and captures the real-time driving record image to generate an image to be compared (IC); A real-time image storage module (32), which stores the real-time driving record image and the image to be compared (IC); A data transmission module (33), uploads the real-time driving record image to the cloud database module (10) and downloads a reference image (IR) from the cloud database module (10); A reference image storage module (34), storing the reference image (IR); An image identification module (35), identifying the difference between the image to be compared and the reference image; An abnormal warning module (36), when the image recognition module (35) recognizes that there is an abnormal state between the image to be compared and the reference image, the abnormal warning module (36) sends a warning signal; and A control module (37), electrically connected to the image capture module (31), the real-time image storage module (32), the reference image storage module (33), and the data transmission module (34) , the image recognition module (35) and the abnormal warning module (36), and control the operating mechanism between the modules, wherein the image information of the image to be compared and the reference image includes the date and time of recording and the latitude and longitude coordinates . 如請求項1所述之智慧軌道監控系統,其中,該影像辨識模組(35)另包含一測距單元(350),計算前方障礙物與軌道車輛間之距離。The intelligent track monitoring system according to Claim 1, wherein the image recognition module (35) further includes a distance measuring unit (350), which calculates the distance between the obstacle in front and the rail vehicle. 如請求項1所述之智慧軌道監控系統,其中,該異常警示模組(36)另包含一即時通報單元(360),將該警示訊號傳送至該中央監控主系統(20)或其他軌道車輛。The intelligent track monitoring system as described in claim 1, wherein, the abnormal warning module (36) further includes an instant notification unit (360), which transmits the warning signal to the central monitoring main system (20) or other rail vehicles . 如請求項1所述之智慧軌道監控系統,其中,該控制模組(37)另包含一制動單元(370),電性連接該軌道車輛(RV)之煞車系統,降低該軌道車輛(RV)行駛速度。The smart track monitoring system as described in claim 1, wherein the control module (37) further includes a braking unit (370), which is electrically connected to the braking system of the rail vehicle (RV) to lower the rail vehicle (RV) Driving speed. 一種智慧軌道監控方法,包含: 藉由一資料傳輸模組從一雲端資料庫模組下載一參考影像,將該參考影像儲存在一參考影像儲存模組; 從一影像擷取摸組取得一即時行車紀錄影像,再從該即時行車紀錄影像擷取一欲比對影像,並將該欲比對影像儲存在一即時影像儲存模組; 藉由該資料傳輸模組將該即時行車紀錄影像傳送至該雲端資料庫模組儲存; 分別從該參考影像及該欲比對影像擷取一參考經緯度座標及一欲比對經緯度座標,利用該參考經緯度座標及該欲比對經緯度座標進行影像重疊校正,使該參考影像及該欲比對影像之影像比對基準點在一座標誤差範圍內,依據影像之座標位置將該欲比對影像及該參考影像之畫面進行影像差異比對; 當執行影像差異比對時,經辨識比對後若該欲比對影像之畫面有異常,由設置於該軌道車輛上之一異常警示模組發出一異常警示訊號。 A smart track monitoring method, comprising: downloading a reference image from a cloud database module via a data transfer module, and storing the reference image in a reference image storage module; Obtaining a real-time driving record image from an image capturing module, and then capturing an image to be compared from the real-time driving record image, and storing the image to be compared in a real-time image storage module; Using the data transmission module to transmit the real-time driving record image to the cloud database module for storage; Respectively extract a reference latitude and longitude coordinate and a latitude and longitude coordinate to be compared from the reference image and the image to be compared, and use the reference latitude and longitude coordinate and the latitude and longitude coordinate to be compared to perform image overlapping correction, so that the reference image and the latitude and longitude coordinate to be compared The image comparison reference point of the image is within the coordinate error range, and the image difference comparison between the image to be compared and the frame of the reference image is carried out according to the coordinate position of the image; When performing image difference comparison, if there is any abnormality in the image to be compared after identification and comparison, an abnormality warning module installed on the rail vehicle will send out an abnormality warning signal. 如請求項5所述之智慧軌道監控方法,其中,以較早記錄之即時行車紀錄影像做為較晚之參考影像。The smart track monitoring method as described in claim 5, wherein the earlier recorded real-time driving record image is used as the later reference image. 如請求項5所述之智慧軌道監控方法,其中,當執行影像差異比對時,經辨識比對後若該欲比對影像之畫面有異常,在該欲比對影像中界定出一異常範圍,依據軌道車輛當下之行駛速度及經緯度座標計算多久單位時間內到該達異範圍之座標位置。The smart track monitoring method as described in claim 5, wherein, when performing image difference comparison, if there is an abnormality in the picture of the image to be compared after identification and comparison, an abnormal range is defined in the image to be compared , according to the current speed of the rail vehicle and the latitude and longitude coordinates, calculate how long it takes to reach the coordinate position of the different range in a unit of time. 如請求項7所述之智慧軌道監控方法,其中,在該欲比對影像中界定出一異常範圍後,依據該異常範圍在該欲比對影像中之位置區域,判斷是否在行徑軌道上、對向軌道上或橫跨雙向軌道。The smart track monitoring method as described in Claim 7, wherein, after defining an abnormal range in the image to be compared, it is judged whether it is on the track or not according to the position area of the abnormal range in the image to be compared On opposite tracks or across two-way tracks. 如請求項5所述之智慧軌道監控方法,其中,當執行影像差異比對時,在該欲比對影像及該參考影像之畫面分別界定一比對範圍,經辨識比對後若該欲比對影像之畫面有異常點,但異常點位置落於該比對範圍外,則仍判定為無異常狀態。The smart track monitoring method as described in claim item 5, wherein, when performing image difference comparison, a comparison range is respectively defined on the frames of the image to be compared and the frame of the reference image, and if the image to be compared is identified and compared If there are abnormal points on the screen of the image, but the position of the abnormal point falls outside the comparison range, it is still judged as non-abnormal. 如請求項5所述之智慧軌道監控方法,其中,當執行影像差異比對時,經辨識比對後若該欲比對影像之畫面有異常,該異常警示模組啟動一制動單元,該制動單元降低軌道車輛行駛速度。The smart track monitoring method as described in claim 5, wherein, when image difference comparison is performed, if there is an abnormality in the screen of the image to be compared after identification and comparison, the abnormality warning module activates a brake unit, and the brake The unit reduces the speed of the rail vehicle.
TW110147518A 2021-12-17 2021-12-17 Intelligent railway monitoring system and method thereof TWI804113B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW110147518A TWI804113B (en) 2021-12-17 2021-12-17 Intelligent railway monitoring system and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW110147518A TWI804113B (en) 2021-12-17 2021-12-17 Intelligent railway monitoring system and method thereof

Publications (2)

Publication Number Publication Date
TWI804113B TWI804113B (en) 2023-06-01
TW202326634A true TW202326634A (en) 2023-07-01

Family

ID=87803295

Family Applications (1)

Application Number Title Priority Date Filing Date
TW110147518A TWI804113B (en) 2021-12-17 2021-12-17 Intelligent railway monitoring system and method thereof

Country Status (1)

Country Link
TW (1) TWI804113B (en)

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7999848B2 (en) * 2004-06-11 2011-08-16 Stratech Systems Limited Method and system for rail track scanning and foreign object detection
TWI317332B (en) * 2006-06-01 2009-11-21 Chung Chen Method, system, and device for a kind of railway vehicle travel safely
CN200964120Y (en) * 2006-09-25 2007-10-24 北京福斯达高科技公司 High speed vehicle mounted orbital image recognition system
EP3048559A1 (en) * 2015-01-21 2016-07-27 RindInvest AB Method and system for detecting a rail track
CN112319552A (en) * 2020-11-13 2021-02-05 中国铁路哈尔滨局集团有限公司 Rail car operation detection early warning system
CN113486783A (en) * 2021-07-02 2021-10-08 浙江省交通投资集团有限公司智慧交通研究分公司 Obstacle detection method and system for rail transit vehicle

Also Published As

Publication number Publication date
TWI804113B (en) 2023-06-01

Similar Documents

Publication Publication Date Title
CN105799740B (en) A kind of track foreign body intrusion automatic detection and method for early warning based on technology of Internet of things
US11039055B2 (en) Video system and method for data communication
CN111554124B (en) Right-turn collision avoidance warning system and warning method for large trucks at intersections
JP6944308B2 (en) Control devices, control systems, and control methods
CN104908782B (en) A kind of locomotive shunting job safety method for early warning and system and device
US20170255824A1 (en) Aerial camera system and method for identifying route-related hazards
CN110545380B (en) Video system and method for data communication
US20070291985A1 (en) Intelligent railyard monitoring system
CN108639108B (en) A safety protection system for locomotive operation
CN101559753A (en) Automobile active safety system based on monocular machine vision and control method thereof
CN114360210A (en) Vehicle fatigue driving early warning system
CN107399338A (en) Train contact network detection means and method
CN205601867U (en) Train contact net detection device
US11270130B2 (en) Route inspection system
CN105701453B (en) A kind of railway with obstacle identification system is with quarrel vehicle and its obstacle identification method
CN109874099B (en) Networking vehicle-mounted equipment flow control system
CN106199617A (en) Bullet train running environment based on infrared imagery technique monitoring system and method
CN106043298A (en) Active safety early-warning control system of vehicle
CN110395256A (en) A vehicle control method, system and vehicle
CN115903779A (en) Intelligent early warning system and method for shield tunnel electric locomotive
CN109895694B (en) Lane departure early warning method and device and vehicle
TWI804113B (en) Intelligent railway monitoring system and method thereof
CN115131957B (en) Road condition early warning method and device
CN213649544U (en) Auxiliary driving system of trackless rubber-tyred vehicle
CN116279663A (en) Vehicle-mounted intelligent anti-collision alarm control equipment