CN110266753A - Sea and land integration integrated control platform - Google Patents
Sea and land integration integrated control platform Download PDFInfo
- Publication number
- CN110266753A CN110266753A CN201910375293.4A CN201910375293A CN110266753A CN 110266753 A CN110266753 A CN 110266753A CN 201910375293 A CN201910375293 A CN 201910375293A CN 110266753 A CN110266753 A CN 110266753A
- Authority
- CN
- China
- Prior art keywords
- data
- center
- control
- server
- web
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000010354 integration Effects 0.000 title claims abstract description 15
- 238000004891 communication Methods 0.000 claims abstract description 25
- 238000007405 data analysis Methods 0.000 claims abstract description 13
- 238000013500 data storage Methods 0.000 claims abstract description 13
- 238000012545 processing Methods 0.000 claims description 21
- 238000003860 storage Methods 0.000 claims description 16
- 238000000034 method Methods 0.000 claims description 13
- 238000004458 analytical method Methods 0.000 claims description 9
- 230000008569 process Effects 0.000 claims description 8
- 239000000835 fiber Substances 0.000 claims description 6
- 230000003287 optical effect Effects 0.000 claims description 6
- 239000013307 optical fiber Substances 0.000 claims description 6
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims description 4
- 238000009826 distribution Methods 0.000 claims description 3
- 230000002093 peripheral effect Effects 0.000 claims description 2
- 239000002689 soil Substances 0.000 claims description 2
- 238000012544 monitoring process Methods 0.000 description 13
- 238000010801 machine learning Methods 0.000 description 9
- 238000004422 calculation algorithm Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 8
- 238000007726 management method Methods 0.000 description 8
- 238000012549 training Methods 0.000 description 8
- 230000005540 biological transmission Effects 0.000 description 5
- 238000013461 design Methods 0.000 description 5
- 238000010168 coupling process Methods 0.000 description 4
- 238000005859 coupling reaction Methods 0.000 description 4
- 238000013523 data management Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000012800 visualization Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 206010062575 Muscle contracture Diseases 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 208000006111 contracture Diseases 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000007418 data mining Methods 0.000 description 1
- 238000013079 data visualisation Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 239000003999 initiator Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 238000005086 pumping Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/78—Television signal recording using magnetic recording
- H04N5/781—Television signal recording using magnetic recording on disks or drums
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/22—Adaptations for optical transmission
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
A kind of sea and land integration integrated control platform, the control platform use data center, regional center and distributed control center Three Tiered Network Architecture, and data center, regional center and distributed control center are coupled by communication network.Data center possesses central application server, center WEB server and central database server, central application server receives the data of distributed control center and the data of regional center, data are cached and data storage service, center WEB server is for disposing WEB background service and front-end WEB application, and central database server is for storing control platform configuration data, big data analysis result.
Description
Technical field
The invention belongs to Ocean Development Technology field, in particular to a kind of sea and land integration integrated control platform.
Background technique
Patent document CN107888879A, discloses that " a kind of monitoring of coastline and unattended cloud system, feature exist
In, comprising: website side and cloud on duty manipulate side；The website side on duty includes multiple websites on duty；The website pair on duty
Coastline is monitored in real time and obtains data on duty；Cloud manipulation side includes: data center subsystem and terminal user
Subsystem；The data center subsystem includes: transmission and processing subsystem and cloud storage service device；The multiple website on duty
It is connected with data center subsystem by ethernet ring network；The data on duty upload of the multiple website acquisition on duty summarizes to biography
Defeated and processing subsystem；The center data on duty obtained after the transmission and processing subsystem processing pass through cloud storage service
Device carries out storage and operational administrative；Terminal user's subsystem is connected by local area network or internet and data center subsystem
It connects；By local area network access data center subsystem terminal user may have access to and/or operation center's data on duty；Pass through interconnection
The terminal user of net access data center subsystem may have access to center data on duty after authorization.The website on duty includes:
Coast defence radar subsystem, double light subsystem of video, local control centre and Ethernet interface ".As can be seen that it should from the document
Scheme may be implemented to consider the monitoring to a coastal region but more for many functional requirements needed for coastal management
It needs, the coastal surveillance and management for wider wide area still have many deficiencies.
Summary of the invention
The present invention provides a kind of sea and land integration integrated control platforms, it is therefore intended that the realization pair in the range of wide area network
The integrated monitoring of ocean water front.
One of embodiment of the present invention, a kind of sea and land integration integrated control platform, the control platform use data center, area
Domain center and distributed control center Three Tiered Network Architecture, data center, regional center and distributed control center are coupled by communication network,
Data center possesses central application server, center WEB server and central database server,
Central application server receives the data of distributed control center and the data of regional center, data are cached and
Data storage service,
Center WEB server is used to dispose WEB background service and front-end WEB application,
Central database server is for storing control platform configuration data, big data analysis result；
Regional center possesses region WEB server, regional database server, region application server,
Region application server receives the data of administered distributed control center, is cached to data and data store
Service, the video control instruction that receiving area WEB server sends over, and control instruction is transmitted to distributed control center,
Region WEB server disposes WEB background service and front-end WEB application,
Regional database server stores GIS data, plotted data, equipment and the project configuration of administered distributed control center
Data, ship target, equipment state historical record, operation flow data；
Distributed control center includes sub-control application server, sub-control WEB server, sub-control database server, video equipment, preceding
End equipment, front end processor,
The real time data that front end processor acquisition headend equipment sends over, is sent to sub-control application server processes, connects in real time
The control instruction that contracture control application server sends over, and control instruction is forwarded to headend equipment,
Sub-control application server receives the data that front end processor sends over, and is cached to data and data storage takes
Business, while data distribution is received into the control instruction that sub-control WEB server sends over to regional center and data center, and
Control instruction is transmitted to front end processor,
Sub-control WEB server disposes WEB background service and front-end WEB application,
Sub-control database server, stored GIS data, plotted data, equipment and project configuration data, ship target and sets
Standby state history records.
The present invention realizes the integrated monitoring to Yu Haiyang's water front by Three Tiered Network Architecture in wide area network level.
Detailed description of the invention
The following detailed description is read with reference to the accompanying drawings, above-mentioned and other mesh of exemplary embodiment of the invention
, feature and advantage will become prone to understand.In the accompanying drawings, if showing by way of example rather than limitation of the invention
Dry embodiment, in which:
Fig. 1 according to embodiments of the present invention one of sea and land integration integrated control platform composition schematic diagram.
Specific embodiment
According to one of one or more embodiment, divide as shown in Figure 1, a kind of sea and land integration integrated control platform uses
Control center, regional center and data center's three-layer network topological structure use data communication Middleware implementation between each center
The transmission of data with it is synchronous.
Distributed control center by headend equipment (including AIS, radar, monitor camera, sensor etc.), server in machine room (including
Front end processor, application server, WEB server, database server), video equipment (including hard disk video recorder, video server)
With monitoring large-size screen monitors composition.
Front end processor, acquisition headend equipment send over real time data (including AIS ship oceangoing ship state, radar parsing ARPA mesh
Mark state, sensor monitoring site real time data, equipment on-line state), these real-time status datas are converted into uniformly communicating
Agreement is sent to application server processes；The video control instruction that real-time reception application server sends over, and control is referred to
Order is forwarded to front-end camera.
Application server receives the unified communication format data that send over of front end processor, data are cached and
Data storage service, while device data is distributed to regional center sum number by the data communication middleware being erected on public network
According to center.The video control instruction that WEB server sends over is received, and control instruction is transmitted to front end processor.
WEB server, disposes WEB background service and front-end WEB application, and the administrative staff of distributed control center pass through browsing local
WEB page in net realizes the real time monitoring and management of equipment.
Database server, stored GIS data, plotted data, equipment and project configuration data, ship target and equipment shape
State historical record etc..
Hard disk video recorder stores the video file of head end video monitor camera, is set with storing 30 days video record capacity
Meter recycles covering after being more than.
Video server provides Video service for platform access video pictures, and distributed control center administrative staff can be directly in GIS
Video camera is selected on map and checks real-time video picture.Video server can also be regional center, data center and movement
End provides video data streaming service.
Large-size screen monitors are monitored, are connect with HD recording work station, show video monitoring large-size screen monitors picture.
According to one of one or more embodiment, onboard AIS is sent to surrounding using VHF channel and is broadcast the message, in land
Ground is equipped with AIS receiver, and AIS receiver provides RS232 communication interface, and in front-end configuration serial server, RS232 communication is connect
Mouth and data change into TCP/IP communication modes, and data are transferred to distributed control center via optical-fibre channel by fiber optical transceiver.
Scan image information is sent to radar transceiver, radar using the object of electromagnetic wave scanning peripheral region by radar
Analytical engine goes out ARPA target (position, movement velocity and direction including object etc.) by arithmetic analysis, and parsing result is led to
Cross fiber optical transceiver and be transferred to distributed control center via optical-fibre channel, power-supply controller of electric can the power supply of long-range control radar equipment return
Road can achieve the purpose of protection radar equipment in thunder and lightning weather.
Front end monitor camera be directly connected to using TCP/IP mode before in end switch, by fiber optical transceiver via
The hard disk video recorder that optical-fibre channel is transferred to distributed control center carries out video storage and processing, and the control instruction of video is via the channel
Reversely it is sent to front-end camera execution.
Sensor includes water quality, soil and air borne sensor, and GPRS communication module built in sensor periodically or will be by changing
Data the data communication middleware (MQTT server) on internet, the front end processor of distributed control center are sent to by the channel GPRS
Subscribe to the equipment theme in institute's compass of competency, the real-time status data of receiving sensor.
Regional center accesses internet, possesses the fixed IP of public network, by server in machine room (application server, WEB server,
Database server, middleware server) and data monitoring large-size screen monitors composition.
Application server: subscribing to the theme of data communication middleware, receives the device data of administered distributed control center, logarithm
According to being cached and data storage service.Receive the video control instruction that sends over of WEB server, and by control instruction
It is transmitted to distributed control center.
WEB server disposes WEB background service and front-end WEB application.The administrative staff of regional center pass through browsing local
WEB page in net realizes the management of the real time monitoring and operation flow of equipment.
Database server, GIS data, plotted data, equipment and the project configuration data of the administered distributed control center of storage,
Ship target, equipment state historical record, operation flow data etc..
Middleware server is deployed on the server for possessing the fixed IP of public network, is mainly used to realize data (device data
And business datum) transfer service.
Data monitoring large-size screen monitors, to the operation flow data of distributed control center data and regional center that one's respective area center is administered
Summarized and is counted.
Data center accesses internet, possesses the fixed IP of public network, by server in machine room (application server, WEB server,
Database server, disk array) and data monitoring large-size screen monitors composition.
Application server subscribes to the theme of data communication middleware, receives the device data of all distributed control centers and owns
The partial service data of regional center, are cached data and data storage service.
WEB server disposes WEB background service and front-end WEB application.The administrative staff of data center pass through browsing local
WEB page in net realizes statistical analysis and the management of data.
Database server, storage system configuration data, big data analysis result data.
Disk array is recorded persistence data (device status data, ship target data etc.), is mentioned for big data analysis
For basis.
Data monitoring large-size screen monitors are summarized and are counted to the data of all data centers, regional center and distributed control center.
Communication middleware
Wherein, communication middleware uses message-oriented middleware technology, and message-oriented middleware is made of following components:
(1)Broker
Message server provides message core service as server.
(2)Producer
The message producer, the initiator of business are responsible for production message and are transferred to broker.
(3)Consumer
Message consumer, the processing side of business are responsible for obtaining message from broker and carry out business logic processing.
(4)Topic
Theme, the message under publish-subscribe model uniformly collect ground, and the different producers send message to topic, taken by MQ
Business device is distributed to different subscribers, realizes the broadcast of message.
(5)Queue
Queue, under ptp mode, specific manufacturer sends message to specific queue, and it is complete that consumer subscribes to specific queue
At the reception of specified message.
(6)Message
Message body, according to the data packet that the fixed format that different communication protocol defines is encoded, to encapsulate business datum,
Realize the transmission of message.
The transmission of message is using Pub/Sub (subscribe to publication) mechanism, and the message producer (publication) is by news release to topic
In, while thering are multiple message consumers (subscription) to consume the message.
Message-oriented middleware has following advantage:
(1) system decoupling
It without direct call relation between interactive system, is transmitted simply by message, therefore system is not invasive strong, coupling
It spends low.
(2) system response time is improved
Pass through MQ architecture design, so that it may the business of urgent important (needing to respond at once) is put into the call method, rung
Use message queue of less demanding is answered, is put into MQ queue, is handled for consumer.
(3) service is provided for big data processing framework
By message as integrating, under the background of big data, message queue is also integrated with real-time processing framework, is at data
Reason provides performance and supports.
(4) Java Message Service --- JMS
Java Message Service (Java Message Service, JMS) application programming interfaces are closed in a Java platform
It is carried out in the API of Message Oriented Middleware (MOM) for sending message between two application programs or in distributed system
Asynchronous communication.
In the present embodiment, it is related to big data technology, specific steps include:
(1) big data acquisition and pretreatment
In the life cycle of big data, data acquisition is in first link.Answering for data is generated according to MapReduce
With genealogical classification, the acquisition of big data mainly has 3 kinds of sources: device status data, video stream data and operation flow data.It is right
In different data sets, it is understood that there may be different structures and mode, such as file, XML tree, relation table show as the different of data
Structure.To the data set of multiple isomeries, need to do further integrating processing or integration processing, by the data from different data collection
It collects, arrange, cleaning, after conversion, being generated to a new data set, providing unified data for subsequent query and analysis processing
View.
(2) big data storage and management
Traditional data storage and management are based on structural data, therefore relational database system (RDBMS) can be with one
System meets types of applications demand all over the world.Big data is often based on semi-structured and unstructured data, supplemented by structural data,
And various big data applications are usually to the retrieval of different types of data content, intersection compare, depth is excavated and comprehensive analysis.
In face of this kind of application demand, no matter technically or functionally all hard to carry on traditional database is.
Therefore, the situation for occurring oldSQL, NoSQL and NewSQL in recent years and depositing.Generally, not by data type
Together, the storage and management of big data use different technology paths, can substantially be divided into 3 classes.What the 1st class mainly faced is big
The structural data of scale.For this kind of big data, advanced database cluster is generallyd use.They are mixed by column storage or ranks
The technologies such as storage and coarseness index are closed, are efficiently divided in conjunction with MPP (Massive Parallel Processing) framework
Cloth calculates mode, realizes the storage and management to PB magnitude data.This type of cluster has the characteristics that high-performance and high scalability,
Enterprise diagnosis class application field has been widely applied.What the 2nd class mainly faced is semi-structured and unstructured data.Reply
This kind of application scenarios, the system platform based on Hadoop open source system are more good at.They pass through to Hadoop ecosystem
Technology extension and encapsulation, are realized to semi-structured and unstructured data storage and management.What the 3rd class faced be structuring and
Unstructured mixed big data, therefore realized using the mixing of MPP parallel database cluster and Hadoop cluster to hundred PB
The storage and management of magnitude, EB magnitude data.On the one hand, the structural data for calculating high quality is managed with MPP, is provided powerful
SQL and OLTP type service；On the other hand, it is realized with Hadoop to semi-structured and unstructured data processing, to support
Content retrieval, depth are excavated and the new applications such as comprehensive analysis.This kind of mixed mode will be big data storage and management not
Come the trend developed.
(3) big data calculates mode and system
So-called big data calculates mode, i.e., according to the different data feature of big data and calculates feature, from multifarious big
The various higher level of abstraction (abstraction) or model (model) refined and established in data computational problem and demand.For example,
MapReduce is that a parallel computation is abstract, " the distributed memory pumping in the famous Spark system of University of California Berkeley
" figure is parallel abstract " (Graph Parallel as RDD ", in CMU famous figure computing system GraphLab
Abstraction) etc..
The level of traditional parallel calculating method, architecture and programming language defines some more bottoms
Parallel computation is abstracted and model, but since big data processing problem has many high-rise data characteristicses and calculates feature,
Big data processing needs more these high-level characteristics to be combined to consider more high-rise calculating mode.
According to big data handle multifarious demand and more than different characteristic dimension, occur at present a variety of typical and again
The big data wanted calculates mode.Mode is calculated with these to be adapted, and many corresponding big data computing systems and tool occurs.
Due to describing merely, calculating model comparision is abstract and cavity is when describing different calculating modes will provide corresponding simultaneously
Typical computing system and tool, this will be helpful to the understanding of the mode of calculating and to the assurance of state-of-the-art, go forward side by side one
Step is conducive to use the selection of suitable computing technique and system tool in the processing application of practical big data.
(4) big data analysis and visualization
In big data era, people are highly desirable realized on the large-scale cluster being made of common machines it is high performance with
Machine learning algorithm is that the data of core are analyzed, and provides service and guidance for practical business, and then realize the final realization of data.
It is different from traditional online analysis process processing OLAP, large-scale machine learning skill is based primarily upon to the depth analysis of big data
Art, it is however generally that, the training process of machine learning model can be attributed to the mesh for optimizing and being defined on large scale training data
Scalar functions and the algorithm realization for passing through a loop iteration.Thus compared with traditional OLAP, based on the big of machine learning
Data analysis has the characteristics that oneself uniqueness.
Iterative: due to being used for optimization problem usually not closed solutions, thus simultaneously non-once energy is determined to model parameter
It is enough to complete, need the multiple Step wise approximation optimal value point of loop iteration.
Fault-tolerance: the presence of non-optimal value point is tolerated in the algorithm design and model evaluation of machine learning, while repeatedly repeatedly
The characteristic in generation also allows to generate some mistakes during circulation, and the finally convergence of model is unaffected.
The convergent heterogeneity of parameter: some parameters just no longer change after several wheel iteration in model, and have
A little parameters then take a long time to can be only achieved convergence.
These features determine that the design of ideal big data analysis system and the design of other computing systems have very very much not
Together, directly application traditional distributed computing system be applied to big data analysis, the resource of significant proportion be all wasted in communication, etc.
To, coordinate etc. in non-effective calculating.
Traditional distributed computing framework MPI (message passing interface, messaging interface) although
Programming interface is flexibly powerful, but since programming interface is complicated and it is not high to support fault-tolerance, can not be supported on extensive number
According to upper complex operations, researcher, which transfers to develop a series of strong distributed computing framework of the simple fault-tolerance of interfaces, to be served
Big data analysis algorithm, with MapReduce, Spark and parameter server ParameterServer etc. for representative.
Distributed computing framework MapReduce will be attributed to the operation of Map and Reduce two major classes to the processing of data, thus
It simplifies programming interface and improves the fault-tolerance of system.But MapReduce is limited by excessively simplified data manipulation and takes out
As, and do not support loop iteration, thus poor, the distribution based on MapReduce is supported to complicated machine learning algorithm
Machine learning library Mahout needs for interative computation to be decomposed into multiple continuous Map and Reduce operation, passes through read-write HDFS text
The operation result of last round of circulation is passed to next round and completes data exchange by part mode.
In the process, a large amount of training time is used for the read-write operation of disk, and training effectiveness is very inefficient.To understand
The certainly MapReduce above problem, Spark define the data manipulation more abundant including Map and Reduce based on RDD
Interface.
What it is different from MapReduce is that output and result can save in memory among Job, to no longer need to read and write
HDFS, these characteristics enable Spark to be preferably suitable for the big data analysis that data mining and machine learning etc. need iteration
Algorithm.Its advantage relative to Mahout has been had shown that based on the Spark machine learning algorithm library MLLIB realized, in reality
It is widely used in a variety of applications in the application system of border.
In recent years, with the rapid expansion of data scale to be analyzed, parameter of analytic model also rapid growth, to existing big
Data analytical model proposes challenge.Such as in extensive topic model LDA, it is intended that training obtains million or more
Topic, thus the model parameter to over ten billion even hundred billion may be needed to be updated in the training process, scale is much super
The processing capacity of individual node is gone out.
To solve the above-mentioned problems, researcher proposes the concept of parameter server (Parameter Server).?
In parameter server system, large-scale model parameter is centrally stored in a distributed server cluster, on a large scale
Training data be then distributed on different working nodes (worker), working node each so only need to save it calculate when
The small part parameter relied on, to efficiently solve the training problem of ultra-large big data analysis model.
In the application process of big data analysis, visualization helps people to explore in such a way that interactive visual shows
With the data for understanding complexity.Visualization and visual analysis can rapidly and efficiently simplify and refine data flow, and user is helped to hand over
A large amount of data are mutually screened, facilitates user and more rapid and better obtains new discovery from complex data, become user's understanding
Complex data is carried out and analyses in depth indispensable means.The visualization of large-scale data is mainly based upon design of Parallel Algorithms
Technology, rationally utilize limited computing resource, efficiently handle and analyze specific set of data characteristic.
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods, it can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit
It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components
It can be combined or can be integrated into another system, or some features can be ignored or not executed.In addition, shown or beg for
Opinion mutual coupling, direct-coupling or communication connection can be through some interfaces, the INDIRECT COUPLING of device or unit
Or communication connection, it is also possible to electricity, mechanical or other form connections.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.Some or all of unit therein can be selected to realize the embodiment of the present invention according to the actual needs
Purpose.
If the integrated unit is realized in the form of SFU software functional unit and sells or use as independent product
When, it can store in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially
The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words
It embodies, which is stored in a storage medium, including some instructions are used so that a computer
Equipment (can be personal computer, server or the network equipment etc.) executes the complete of each embodiment the method for the present invention
Portion or part steps.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only
Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. are various can store journey
The medium of sequence code.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can readily occur in various equivalent modifications or replace
It changes, these modifications or substitutions should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with right
It is required that protection scope subject to.
Claims (6)
1. a kind of sea and land integration integrated control platform, which is characterized in that the control platform using data center, regional center and
Distributed control center Three Tiered Network Architecture, data center, regional center and distributed control center are coupled by communication network,
Data center possesses central application server, center WEB server and central database server,
Central application server receives the data of distributed control center and the data of regional center, is cached to data and data
Storage service,
Center WEB server is used to dispose WEB background service and front-end WEB application,
Central database server is for storing control platform configuration data, big data analysis result；
Regional center possesses region WEB server, regional database server, region application server,
Region application server receives the data of administered distributed control center, is cached to data and data storage service,
The video control instruction that receiving area WEB server sends over, and control instruction is transmitted to distributed control center,
Region WEB server disposes WEB background service and front-end WEB application,
Regional database server, GIS data, plotted data, equipment and the project configuration data of the administered distributed control center of storage,
Ship target, equipment state historical record, operation flow data；
Distributed control center includes that sub-control application server, sub-control WEB server, sub-control database server, video equipment, front end are set
Standby, front end processor,
The real time data that front end processor acquisition headend equipment sends over, is sent to sub-control application server processes, real-time reception point
The control instruction that control application server sends over, and control instruction is forwarded to headend equipment,
Sub-control application server receives the data that send over of front end processor, is cached to data and data storage service,
Data distribution is received into the control instruction that sub-control WEB server sends over to regional center and data center simultaneously, and will control
System instruction is transmitted to front end processor,
Sub-control WEB server disposes WEB background service and front-end WEB application,
Sub-control database server, stored GIS data, plotted data, equipment and project configuration data, ship target and equipment shape
State historical record.
2. sea and land integration integrated control platform according to claim 1, which is characterized in that the headend equipment of distributed control center
Including AIS system, radar, monitor camera, sensor, video equipment includes hard disk video recorder, video server.
3. sea and land integration integrated control platform according to claim 2, which is characterized in that AIS system includes onboard AIS
With AIS receiver, onboard AIS is sent to surrounding using VHF channel and is broadcast the message, and is equipped with AIS receiver on land, AIS is received
Machine provides RS232 communication interface, and in front-end configuration serial server, RS232 communication interface and data are changed into TCP/IP communication
Mode, and data are transferred to via optical-fibre channel by fiber optical transceiver by distributed control center.
4. sea and land integration integrated control platform according to claim 2, which is characterized in that radar is scanned using electromagnetic wave
Scan image information is sent to radar transceiver by the object of peripheral region, and radar analytical engine goes out ARPA mesh by arithmetic analysis
Parsing result is transferred to distributed control center via optical-fibre channel by fiber optical transceiver by target position, movement velocity and direction.
5. sea and land integration integrated control platform according to claim 2, which is characterized in that monitor camera uses TCP/
Before IP agreement is directly connected in end switch, recorded by fiber optical transceiver via the hard disk that optical-fibre channel is transferred to distributed control center
Camera carries out video storage and processing, and the control instruction of video is reversely sent to monitor camera via the channel and executes.
6. sea and land integration integrated control platform according to claim 2, which is characterized in that sensor includes water quality, soil
Earth and air borne sensor, communication module built in sensor are periodically uploaded the data of variation by communication channel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910375293.4A CN110266753A (en) | 2019-05-07 | 2019-05-07 | Sea and land integration integrated control platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910375293.4A CN110266753A (en) | 2019-05-07 | 2019-05-07 | Sea and land integration integrated control platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110266753A true CN110266753A (en) | 2019-09-20 |
Family
ID=67914229
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910375293.4A Pending CN110266753A (en) | 2019-05-07 | 2019-05-07 | Sea and land integration integrated control platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110266753A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1561108A (en) * | 2004-03-10 | 2005-01-05 | 上海电信技术研究院 | Network vedio monitoring system |
| CN1913461A (en) * | 2006-08-30 | 2007-02-14 | 北京天地互连信息技术有限公司 | Remote vedio monitoring system based on next generation interconnection network and its implementing method |
| US20090248901A1 (en) * | 1997-03-05 | 2009-10-01 | At Home Corporation | Delivering Multimedia Services |
| CN102518553A (en) * | 2012-01-05 | 2012-06-27 | 山东电力研究院 | Remote real-time monitoring system used for wind power station group |
| CN103578240A (en) * | 2013-10-09 | 2014-02-12 | 无锡恺易物联网科技发展有限公司 | Security and protection service network based on Internet of Things |
| CN107888879A (en) * | 2017-11-20 | 2018-04-06 | 福建无线电设备有限公司 | Coastline monitors and unattended cloud system and application method |
-
2019
- 2019-05-07 CN CN201910375293.4A patent/CN110266753A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090248901A1 (en) * | 1997-03-05 | 2009-10-01 | At Home Corporation | Delivering Multimedia Services |
| US20110029642A1 (en) * | 1997-03-05 | 2011-02-03 | Medin Milo S | Delivering Multimedia Services |
| CN1561108A (en) * | 2004-03-10 | 2005-01-05 | 上海电信技术研究院 | Network vedio monitoring system |
| CN1913461A (en) * | 2006-08-30 | 2007-02-14 | 北京天地互连信息技术有限公司 | Remote vedio monitoring system based on next generation interconnection network and its implementing method |
| CN102518553A (en) * | 2012-01-05 | 2012-06-27 | 山东电力研究院 | Remote real-time monitoring system used for wind power station group |
| CN103578240A (en) * | 2013-10-09 | 2014-02-12 | 无锡恺易物联网科技发展有限公司 | Security and protection service network based on Internet of Things |
| CN107888879A (en) * | 2017-11-20 | 2018-04-06 | 福建无线电设备有限公司 | Coastline monitors and unattended cloud system and application method |
Non-Patent Citations (1)
| Title |
|---|
| 辛阳: "6.3.4 分布式深度学习", 《大数据技术原理与实践》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109492040B (en) | System suitable for processing mass short message data in data center | |
| CN111586091B (en) | Edge computing gateway system for realizing computing power assembly | |
| CN110549336A (en) | Transformer substation patrols and examines robot centralized control main website system | |
| CN111371830A (en) | Intelligent cooperative cloud architecture based on data driving under ten thousand network fusion scene | |
| CN107577805A (en) | A kind of business service system towards the analysis of daily record big data | |
| CN105045820A (en) | Method for processing video image information of mass data and database system | |
| CN113179190B (en) | Edge controller, edge computing system and configuration method thereof | |
| CN113868306A (en) | A data modeling system and method based on OPC-UA specification | |
| CN106547882A (en) | A kind of real-time processing method and system of big data of marketing in intelligent grid | |
| Ferry et al. | Towards a big data platform for managing machine generated data in the cloud | |
| CN110928694B (en) | Computer system | |
| CN107895046B (en) | Heterogeneous data integration platform | |
| CN113342874A (en) | Wind power big data analysis system and process based on cloud computing | |
| CN112559634A (en) | Big data management system based on computer cloud computing | |
| TW202344993A (en) | Method for creating shared pool of virtual services based on document baseboard of layout data stream | |
| Wang et al. | C3Meta: A context-aware cloud-edge-end collaboration framework toward green metaverse | |
| CN115981804A (en) | Industrial big data calculation task scheduling management system | |
| CN116362689A (en) | A Reservoir Safety Lifecycle Management System Based on Digital Twin | |
| CN110661999A (en) | Video monitoring system based on big data | |
| CN113489941A (en) | Design method of video monitoring system based on edge calculation | |
| CN110266753A (en) | Sea and land integration integrated control platform | |
| CN119719390A (en) | A multi-modal and multi-parameter intelligent operation and maintenance platform with real-time front-end perception and cloud-edge-end collaboration | |
| CN118824055A (en) | Real-time analysis system of vehicle-road collaboration based on deep neural network | |
| CN119065831A (en) | An edge computing optimization method based on big data network | |
| Plale et al. | Realizing distributed computational laboratories |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190920 |