[go: up one dir, main page]

WO2020057353A1 - Object tracking method based on high-speed ball, monitoring server, and video monitoring system - Google Patents

Object tracking method based on high-speed ball, monitoring server, and video monitoring system Download PDF

Info

Publication number
WO2020057353A1
WO2020057353A1 PCT/CN2019/103776 CN2019103776W WO2020057353A1 WO 2020057353 A1 WO2020057353 A1 WO 2020057353A1 CN 2019103776 W CN2019103776 W CN 2019103776W WO 2020057353 A1 WO2020057353 A1 WO 2020057353A1
Authority
WO
WIPO (PCT)
Prior art keywords
target
target object
speed ball
video
monitoring server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2019/103776
Other languages
French (fr)
Chinese (zh)
Inventor
饶丽光
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Jiuzhou Electric Appliance Co Ltd
Original Assignee
Shenzhen Jiuzhou Electric Appliance Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Jiuzhou Electric Appliance Co Ltd filed Critical Shenzhen Jiuzhou Electric Appliance Co Ltd
Publication of WO2020057353A1 publication Critical patent/WO2020057353A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/10Terrestrial scenes
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/41Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • G06V20/42Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items of sport video content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Definitions

  • the invention relates to the technical field of video surveillance, in particular to a high-speed ball-based object tracking method, a monitoring server, and a video monitoring system.
  • High-speed dome is a kind of intelligent camera.
  • the full name is high-speed intelligent dome camera.
  • High-speed dome has excellent video surveillance capabilities, so it is widely used in various industries.
  • the manager manages the video pictures uploaded by each high-speed ball in the monitoring background. When it is necessary to view the specific picture details of a certain character, the manager manually finds the video picture containing the character and zooms in on the character.
  • the inventor found that the traditional technology has at least the following problems: Because managers often look for the video picture containing the character after the fact, when the video picture is enlarged, although the detailed picture can be viewed, the details The sharpness of the picture is relatively poor and lacks targeted shooting.
  • An object of the embodiments of the present invention is to provide a high-speed ball-based object tracking method, a monitoring server, and a video monitoring system, which can automatically track a target object in real time for targeted shooting.
  • the embodiments of the present invention provide the following technical solutions:
  • an embodiment of the present invention provides a high-speed ball-based object tracking method, which is applied to a monitoring server, and the method includes:
  • the positioning instruction including a target object to be positioned
  • controlling the target high-speed ball to track the target object includes:
  • the target object is a person, and the number of the high-speed ball is at least two, and the high-speed ball can shoot the person from different angles;
  • the controlling the target high-speed ball to track the target object by using the target video frame as a tracking starting point includes:
  • an additional high-speed ball set opposite to the target high-speed ball is detected, and the additional high-speed ball is controlled to take a frontal image of the person, and track the person.
  • the method further includes:
  • the training video data set includes video data of multiple abnormal scenes
  • the preprocessed video data is processed by a convolution algorithm to establish the video detection abnormal model.
  • the receiving a positioning instruction includes:
  • An object corresponding to the image shape data is used as a target object to be positioned.
  • an embodiment of the present invention provides an object tracking device based on a target high-speed ball, which is applied to a monitoring server, and the device includes:
  • a receiving module configured to receive a positioning instruction, where the positioning instruction includes a target object to be positioned
  • a traversal module configured to traverse video data shot by the target high-speed ball according to the positioning instruction to detect the target object
  • a control module is configured to control the target high-speed ball to track the target object, and to reduce or enlarge a video picture including the target object.
  • control module includes:
  • a judging unit configured to judge whether a target video frame including the target object matches a preset video detection abnormal model
  • a control unit configured to control the target high-speed ball to track the target object by using the target video frame as a tracking starting point if matched;
  • a continuing judging unit configured to continue judging whether the target video frame of the next frame containing the target object matches a preset video detection abnormal model if there is no match;
  • an embodiment of the present invention provides a monitoring server, including:
  • At least one processor At least one processor
  • a memory connected in communication with the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processing
  • the device can be used to perform the high-speed ball-based object tracking method according to any one of the above.
  • an embodiment of the present invention provides a video monitoring system, including:
  • the monitoring server communicates with each of the high-speed domes.
  • an embodiment of the present invention provides a non-transitory computer-readable storage medium, where the non-transitory computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to cause a monitoring server to execute The high-speed ball-based object tracking method according to any one.
  • an embodiment of the present invention provides a computer program product.
  • the computer program product includes a computer program stored on a non-volatile computer-readable storage medium.
  • the computer program includes program instructions. When the instruction is executed by the monitoring server, the monitoring server is caused to execute the high-speed ball-based object tracking method according to any one of the above.
  • a positioning instruction is received, and the positioning instruction includes a target object to be positioned; second, according to the positioning instruction, the target high-speed ball is traversed Video data to detect the target object; again, control the target high-speed ball to track the target object, and reduce or enlarge the video frame containing the target object. Therefore, on the one hand, it can automatically detect the target object for targeted shooting. On the other hand, it can track the target object automatically, and can reduce or enlarge the video frame containing the target object, so as to provide a high-definition video frame or a larger field of view associated with the target object for the later phase.
  • FIG. 1 is a schematic structural diagram of an object tracking system based on a high-speed ball according to an embodiment of the present invention
  • FIG. 2 is a schematic flowchart of an object tracking method based on a high-speed ball according to an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of a high-speed ball-based object tracking device according to an embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of a control module in FIG. 3;
  • FIG. 5 is a schematic structural diagram of a monitoring server according to an embodiment of the present invention.
  • the high-speed ball-based object tracking method according to the embodiment of the present invention can be executed in any suitable type of electronic device with computing capability, such as a monitoring server, a desktop computer, a smart phone, a tablet computer, and other electronic products.
  • the monitoring server here may be a physical server or a logical server virtualized by multiple physical servers.
  • the server may also be a server group composed of multiple servers that can communicate with each other, and each functional module may be separately distributed on each server in the server group.
  • the high-speed ball-based object tracking device may be used as a software system, independently set in the above-mentioned client, or may be one of the functional modules integrated in the processor to execute the high-speed ball-based object of the embodiment of the present invention. Tracking method.
  • FIG. 1 is a schematic structural diagram of a video surveillance system according to an embodiment of the present invention.
  • the video surveillance system 100 includes a plurality of cameras 11, a surveillance server 12, and a mobile terminal 13.
  • the camera 11 is installed in a preset area for collecting video data. It can be understood that the camera 11 is fixedly installed in a preset area according to a preset rule, so as to cover the preset area as much as possible.
  • the camera is arranged on a wall surface, a ground, a roof, or an object surface of the preset area in combination with the specific structure and occlusion of the preset area.
  • Each camera forms a camera group, which is used to monitor a specific surveillance area.
  • Each camera is installed at a different position in a preset area.
  • Each camera is used to capture images of areas at different angles within a preset area.
  • the camera group can capture 360-degree objects in the preset area.
  • each camera in the camera group uploads the collected video data to the same monitoring server.
  • Different monitoring areas correspond to different monitoring servers.
  • the surveillance servers of the two do not share surveillance video with each other.
  • a combination of the camera 11 and a multi-dimensional rotating motor can be used to capture real-time capture of high-definition video frame images in the preset area.
  • a high-definition camera with a waterproof function, a small size, a high resolution, a long life, and a universal communication interface is selected.
  • the camera 11 is a network camera, and the camera 11 has a built-in network coding module.
  • the camera includes a lens, an image sensor, a sound sensor, an A / D converter, a controller, a control interface, a network interface, and so on.
  • the camera may be used to collect video data signals, and the video data signals are analog video signals.
  • the camera is mainly composed of a CMOS light-sensitive component and a peripheral circuit, and is used for converting an optical signal input from the lens into an electrical signal.
  • the network coding module has an embedded chip built therein, the embedded chip is used to convert the video data signals collected by the camera into digital signals, the video data signals are analog video signals, and the embedded chip also The digital signal may be compressed.
  • the embedded chip may be a Hi3516 high-efficiency compression chip.
  • the camera 11 sends the compressed digital signal to the monitoring server 12 through the WIFI network.
  • the monitoring server 12 may send the compressed digital signal to the mobile terminal 13.
  • the camera 11 further includes an infrared sensor, so that the camera 11 has a night vision function. Users on the network can directly view the camera image on the web server with a browser or directly access through the mobile terminal APP.
  • the camera 11 can more easily implement monitoring, especially remote monitoring, with simple construction and maintenance, better support for audio, Better support for alarm linkage, more flexible recording storage, richer product selection, higher-definition video effects and more perfect monitoring and management functions, and the camera can be directly connected to the local area network, which is the data collection and photoelectric signal
  • the conversion end is the data supply end of the entire network.
  • the monitoring server 12 is a device that provides computing services.
  • the composition of the monitoring server includes a processor, a hard disk, a memory, a system bus, and the like. Similar to a general computer architecture, the monitoring server is responsible for providing functions such as mobile terminal APP registration, user management, and device management. At the same time, it is responsible for the video data storage function of the camera, and remembers the IP and port of the mobile terminal and camera through the monitoring server, and transmits the IP and port of the corresponding mobile terminal and camera to each other, so that the camera and mobile end can know The other party's IP and port establish a connection and communication through the IP address and port.
  • the monitoring server obtains the video data of the camera and then analyzes the video data according to the artificial intelligence module. When abnormal video data is detected, it sends an alarm message to notify the mobile terminal.
  • the monitoring server 12 includes a processor, and the processor includes an artificial intelligence module.
  • the artificial intelligence module is responsible for real-time analysis of video data, detects abnormal times, and notifies the mobile terminal.
  • the specific implementation of the artificial intelligence module is divided into two parts, the establishment of a video anomaly detection model and the application of a video anomaly detection model.
  • the first is the establishment of the video anomaly detection model. There are three parts.
  • the first part training the video data set of the video anomaly detection model for the training and learning of the subsequent machines. It includes video data of various abnormal scenes, such as frequent crossing of vehicles, robbery, trailing theft, fights, group fights, screams, crying, smoke, noisy video data, and other abnormal scenes that need to be detected.
  • the training video dataset covers most application scenarios.
  • the second part the preprocessing of the video data set.
  • the video data is extracted 10 pictures per second, and each picture is converted into a picture of 255 pixels long and 255 pixels wide.
  • the third part the establishment of training model, using artificial intelligence convolution algorithm, Python code to build the training model.
  • the model includes an input layer, a hidden layer, and an output layer.
  • the input layer is an input pre-processed picture.
  • the hidden layer is used to calculate the features of the input picture.
  • the output layer is based on the calculated features of the hidden layer to output whether the video contains abnormal scenes.
  • the training process is.
  • the normal video is marked as 0, and the abnormal video is marked as 1.
  • the abnormal video and the normal video are input into the training system at the same time, and the data set is preprocessed and the training model is calculated to distinguish whether the video is abnormal or normal.
  • the model is transferred to the server, the data set is replaced with the video of the camera, and the model is run to detect whether the video of the camera is abnormal.
  • FIG. 2 is a schematic flowchart of an object tracking method based on a high-speed ball according to an embodiment of the present invention.
  • the high-speed ball-based object tracking method S200 includes:
  • the positioning instruction is used to instruct the monitoring server to detect and target objects in the video data.
  • a positioning instruction includes an object The target object corresponding to the name.
  • the user can pre-build the shape of the specific object on the monitoring server, so The user triggers the monitoring server to issue positioning instructions, and the subsequent monitoring server can generate image shape data according to the shape of the object, where the image shape data includes several image feature points of the object.
  • the monitoring server determines the shape of the object corresponding to the image shape data according to several image feature points in the image shape data.
  • the monitoring server uses the object corresponding to the image shape data as the target object to be positioned.
  • a user inputs image shape data of a vehicle at a monitoring server, and the monitoring server parses each image feature point according to the image shape data. Secondly, the monitoring server determines that the image is a vehicle shape image according to each image feature point. Third, the monitoring server regards the vehicle as a target object to be positioned.
  • the high-speed dome integrates a gimbal system, a communication system, and a camera system, which can implement functions such as target tracking, focus adjustment, position conversion, and the like.
  • the target high-speed ball is any camera in the camera group. It can be understood that the “target” in the target high-speed ball is used to distinguish other cameras.
  • the monitoring server selects the video data of a specific camera from the camera group for detection and analysis, This particular camera is the target speed dome.
  • the "target” in the target high-speed ball is not used to limit the protection scope of the present invention, but only used for differentiation.
  • the monitoring server sequentially traverses the video data captured by the target high-speed ball according to the monitoring time, and detects the target object therefrom.
  • the monitoring server controls the PTZ of the target high-speed ball to adjust the camera lens to follow the movement of the target object according to the movement of the target object.
  • the monitoring server may draw and save the walking path of the target object, so as to provide convenience when the target object is subsequently analyzed.
  • the monitoring server can enlarge the video image containing the target object in order to obtain a more detailed picture of the target object. Or, in order to fully restore the surrounding environment of the target object at a later stage, the monitoring server may also reduce the video image containing the target object to obtain a larger field of view including the target object as much as possible.
  • the target object can automatically detect a target object for targeted shooting.
  • it can track the target object automatically, and can reduce or enlarge the video frame containing the target object, so as to provide a high-definition video frame or a larger field of view associated with the target object for the later phase.
  • the monitoring server controls the target high-speed ball to track the target object, first, the monitoring server determines whether the target video frame containing the target object matches the preset video detection abnormal model; if it matches, the target video frame is used as the tracking starting point. Starting point, control the target high-speed ball to track the target object. If they do not match, continue to determine whether the next target video frame containing the target object matches the preset video detection abnormal model.
  • the target object is a person
  • the number of high-speed balls is at least two. Different high-speed balls can photograph people from different angles.
  • the monitoring server uses the target video frame as the tracking start point. When controlling the target high-speed ball to track the target object, the monitoring server first uses the target video frame as the tracking start point to obtain the target high-speed ball to shoot the person's image.
  • the monitoring server determines whether the person image is a front image of the person, and the front image includes a face image of the person. For example, A's Trailer B, Opportunity Pickpocket B's handbag, the camera monitors A's Trailing action behavior, and sends video data containing A's Trailing action behavior to the monitoring server.
  • the monitoring server detects A's Trailing action behavior and determines A is the target person.
  • the monitoring server then analyzes the person's image according to the image analysis algorithm to determine whether there are facial feature points associated with the target person in the video data.
  • the video data contains a frontal image of the target person; if it does not exist, it considers the video data The front image of the target person is not included, and the video data includes only the back image of the target person. For example, following the above example, if the monitoring server detects the face image of A in the video data, it is considered that the target high-speed ball has captured the front image of A. If the monitoring server does not detect the face image of nail A in the video data, it considers that the target high-speed ball captured the back image of nail A.
  • the monitoring server controls the target high-speed ball to track the person; if not, the monitoring server detects an additional high-speed ball set opposite the target high-speed ball, controls the additional high-speed ball to take a frontal image of the person, and tracks the person. For example, when the monitoring server detects that the video data does not include a frontal image of the target person, the monitoring server determines the current geographic location of the target person.
  • the monitoring server detects and covers all additional high-speed domes of the target person's current geographical position and determines the installation geographic positions of all the additional high-speed domes according to the current geographic position of the target person, and determines the installation locations from all of the additional high-speed domes.
  • the target high-speed dome is an additional high-speed dome that is relatively geographically installed.
  • the monitoring server controls the extra high-speed ball relative to the installed geographical position of the target high-speed ball to track the person and take a frontal image of the person.
  • the monitoring server detects additional high speeds that are set opposite the target high-speed ball.
  • the monitoring server obtains the light intensity in the preset area.
  • a light sensor set in the preset area collects the light intensity and transmits the light intensity to the monitoring server.
  • the monitoring server judges whether the light intensity is greater than a preset intensity threshold. If it is greater than that, it obtains the minimum illumination values of all the additional high-speed balls set opposite to the target high-speed ball, and traverses the lowest illumination value from the lowest illumination values of all the additional high-speed balls.
  • the extra high-speed ball is used as a high-speed ball that tracks and captures the front image of the character. Therefore, the surveillance server obtains the front image of the character as high-definition as possible. If it is less than that, an additional high-speed ball set opposite to the target high-speed ball is detected.
  • an embodiment of the present invention provides a high-speed ball-based object tracking device applied to a monitoring server.
  • the high-speed dome-based object tracking device according to the embodiment of the present invention may be used as one of the software functional units.
  • the high-speed dome-based object tracking device includes several instructions. The several instructions are stored in a memory, and the processor may access the memory and call the instructions for execution. To complete the above-mentioned high-speed ball-based object tracking method.
  • the high-speed ball-based object tracking device 300 includes a receiving module 31, a traversal module 32, and a control module 33.
  • the receiving module 31 is configured to receive a positioning instruction, where the positioning instruction includes a target object to be positioned;
  • the traversal module 32 is configured to traverse the video data captured by the target high-speed ball according to the positioning instruction to detect the target object;
  • the control module 33 is used for controlling the target high-speed ball to track the target object, and reducing or enlarging a video picture containing the target object.
  • the target object can automatically detect a target object for targeted shooting.
  • it can track the target object automatically, and can reduce or enlarge the video frame containing the target object, so as to provide a high-definition video frame or a larger field of view associated with the target object for the later phase.
  • control module 33 includes: a judging unit 331, a control unit 332, and a continuing judging unit 333.
  • the determining unit 331 is configured to determine whether a target video frame including the target object matches a preset video detection abnormal model
  • the control unit 332 is configured to control the target high-speed ball to track the target object by using the target video frame as a tracking starting point if matched;
  • the continuing determination unit 333 is configured to continue to determine whether the target video frame of the next frame including the target object matches a preset video detection abnormal model if there is no match.
  • the above-mentioned high-speed ball-based object tracking device can execute the high-speed ball-based object tracking method provided by the embodiment of the present invention, and has corresponding function modules and beneficial effects of the execution method.
  • the high-speed ball-based object tracking device can execute the high-speed ball-based object tracking method provided by the embodiment of the present invention, and has corresponding function modules and beneficial effects of the execution method.
  • the high-speed ball-based object tracking method provided in the embodiment of the present invention.
  • an embodiment of the present invention provides a monitoring server.
  • the monitoring server 500 includes: one or more processors 51 and a memory 52. Among them, one processor 51 is taken as an example in FIG. 5.
  • the processor 51 and the memory 52 may be connected through a bus or in other manners.
  • the connection through the bus is taken as an example.
  • the memory 52 is a non-volatile computer-readable storage medium, and can be used to store non-volatile software programs, non-volatile computer executable programs, and modules, such as the high-speed ball-based object tracking method in the embodiment of the present invention. Corresponding program instructions / modules.
  • the processor 51 executes various functional applications and data processing of the high-speed dome-based object tracking device by running non-volatile software programs, instructions, and modules stored in the memory 52, that is, the high-speed dome-based Object tracking method and functions of each module of the above device embodiment.
  • the memory 52 may include a high-speed random access memory, and may further include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage device.
  • the memory 52 may optionally include a memory remotely disposed with respect to the processor 51, and these remote memories may be connected to the processor 51 through a network. Examples of the above network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
  • the program instructions / modules are stored in the memory 52, and when executed by the one or more processors 51, perform the high-speed ball-based object tracking method in any of the above method embodiments, for example, execute the above-described Each step in FIG. 2; the functions of each module described in FIG. 3 and FIG. 4 can also be implemented.
  • An embodiment of the present invention also provides a non-volatile computer storage medium.
  • the computer storage medium stores computer-executable instructions, and the computer-executable instructions are executed by one or more processors, such as a process in FIG. 5.
  • the processor 51 may cause the one or more processors to execute the high-speed ball-based object tracking method in any of the foregoing method embodiments, for example, to execute the high-speed ball-based object tracking method in any of the foregoing method embodiments, for example, to execute
  • the above-mentioned execution performs the above-mentioned execution of the steps shown in FIG. 2 described above; the functions of the various modules described in FIG. 3 and FIG. 4 may also be implemented.
  • the embodiments of the device or device described above are only schematic, and the unit modules described as separate components may or may not be physically separated, and the components displayed as module units may or may not be physical units. , Can be located in one place, or can be distributed to multiple network module units. Some or all of the modules may be selected according to actual needs to achieve the objective of the solution of this embodiment.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Alarm Systems (AREA)
  • Image Analysis (AREA)

Abstract

The present application relates to the technical field of video monitoring, in particular to an object tracking method based on a high-speed ball, a monitoring server, and a video monitoring system. The method comprises: receiving a positioning instruction, wherein the positioning instruction comprises a target object that needs to be positioned; according to the positioning instruction, traversing video data captured by a target high-speed ball so as to detect the target object; and controlling the target high-speed ball to track the target object, and zooming in or out a video picture comprising the target object. On one hand, the present invention can automatically detect the target object for performing targeted capturing. On the other hand, the present invention can automatically track the target object, and can zoom in or out the video picture comprising the target object, thereby relatively providing a high definition video picture or a larger field of view associated with the target object for a later stage.

Description

基于高速球的物体跟踪方法、监控服务器、视频监控系统High-speed ball-based object tracking method, monitoring server, video monitoring system 技术领域Technical field

本发明涉及视频监控技术领域,特别是涉及一种基于高速球的物体跟踪方法、监控服务器、视频监控系统。The invention relates to the technical field of video surveillance, in particular to a high-speed ball-based object tracking method, a monitoring server, and a video monitoring system.

背景技术Background technique

高速球是一种智能化摄像机,全名称为高速智能化球型摄像机。高速球具有优秀的视频监控能力,因而被广泛应用于各行各业。High-speed dome is a kind of intelligent camera. The full name is high-speed intelligent dome camera. High-speed dome has excellent video surveillance capabilities, so it is widely used in various industries.

管理者在监控后台管理各个高速球上传的视频画面,当需要查看某个人物的具体画面细节时,管理者手动查找出包含该人物的视频画面,并对该人物作出放大查看。The manager manages the video pictures uploaded by each high-speed ball in the monitoring background. When it is necessary to view the specific picture details of a certain character, the manager manually finds the video picture containing the character and zooms in on the character.

发明人在实现本发明的过程中,发现传统技术至少存在以下问题:由于管理者往往是在事后才查找包含该人物的视频画面,当放大该视频画面后,虽然可以查看细节画面,但是该细节画面的清晰度比较差,缺乏针对性拍摄。In the process of implementing the present invention, the inventor found that the traditional technology has at least the following problems: Because managers often look for the video picture containing the character after the fact, when the video picture is enlarged, although the detailed picture can be viewed, the details The sharpness of the picture is relatively poor and lacks targeted shooting.

发明内容Summary of the Invention

本发明实施例一个目的旨在提供一种基于高速球的物体跟踪方法、监控服务器、视频监控系统,其能够自动实时跟踪目标物体作针对性地拍摄。An object of the embodiments of the present invention is to provide a high-speed ball-based object tracking method, a monitoring server, and a video monitoring system, which can automatically track a target object in real time for targeted shooting.

为解决上述技术问题,本发明实施例提供以下技术方案:To solve the above technical problems, the embodiments of the present invention provide the following technical solutions:

在第一方面,本发明实施例提供一种基于高速球的物体跟踪方法,应用于监控服务器,所述方法包括:In a first aspect, an embodiment of the present invention provides a high-speed ball-based object tracking method, which is applied to a monitoring server, and the method includes:

接收定位指令,所述定位指令包括需定位的目标物体;Receiving a positioning instruction, the positioning instruction including a target object to be positioned;

根据所述定位指令,遍历所述目标高速球拍摄的视频数据,以检测出所述目标物体;Traverse the video data captured by the target high-speed ball according to the positioning instruction to detect the target object;

控制所述目标高速球跟踪所述目标物体,并且缩小或放大包含所述目标物体的视频画面。Controlling the target high-speed ball to track the target object, and reducing or enlarging a video picture containing the target object.

可选地,所述控制所述目标高速球跟踪所述目标物体,包括:Optionally, the controlling the target high-speed ball to track the target object includes:

判断包含所述目标物体的目标视频帧是否匹配预设视频检测异常模型;Determining whether a target video frame containing the target object matches a preset video detection abnormal model;

若匹配,以所述目标视频帧为跟踪起始点,控制所述目标高速球跟踪所述目标物体;If they match, use the target video frame as a tracking start point, and control the target high-speed ball to track the target object;

若未匹配,继续判断包含所述目标物体的下一帧目标视频帧是否匹配预设视频检测异常模型。If there is no match, continue to determine whether the next target video frame containing the target object matches a preset video detection abnormal model.

可选地,所述目标物体为人物,高速球的数量为至少两个,不同所述高速球可从不同角度拍摄所述人物;Optionally, the target object is a person, and the number of the high-speed ball is at least two, and the high-speed ball can shoot the person from different angles;

所述以所述目标视频帧为跟踪起始点,控制所述目标高速球跟踪所述目标物体,包括:The controlling the target high-speed ball to track the target object by using the target video frame as a tracking starting point includes:

以所述目标视频帧为跟踪起始点,获取所述目标高速球拍摄所述人物的人物图像;Using the target video frame as a tracking starting point to obtain a person's image of the person being shot by the target high-speed ball;

判断所述人物图像是否是所述人物的正面图像,所述正面图像包括所述人物的人脸图像;Determining whether the person image is a front image of the person, and the front image includes a face image of the person;

若是,控制所述目标高速球跟踪所述人物;If yes, controlling the target high-speed ball to track the person;

若否,检测出与所述目标高速球相对设置的额外高速球,控制所述额外高速球拍摄所述人物的正面图像,并跟踪所述人物。If not, an additional high-speed ball set opposite to the target high-speed ball is detected, and the additional high-speed ball is controlled to take a frontal image of the person, and track the person.

可选地,所述方法还包括:Optionally, the method further includes:

获取训练视频数据集,所述训练视频数据集包括多种异常场景的视频数据;Obtaining a training video data set, where the training video data set includes video data of multiple abnormal scenes;

对所述多种异常场景的视频数据进行预处理;Preprocessing the video data of the multiple abnormal scenes;

通过卷积算法处理预处理后的视频数据,建立所述视频检测异常模型。The preprocessed video data is processed by a convolution algorithm to establish the video detection abnormal model.

可选地,所述接收定位指令,包括:Optionally, the receiving a positioning instruction includes:

接收用户输入的图像形状数据,所述图像形状数据包括若干图像特征点;Receiving image shape data input by a user, where the image shape data includes a number of image feature points;

根据所述图像形状数据中的若干图像特征点,确定所述图像形状数据对应的物体的形状;Determining a shape of an object corresponding to the image shape data according to a plurality of image feature points in the image shape data;

将对应于所述图像形状数据的物体作为需定位的目标物体。An object corresponding to the image shape data is used as a target object to be positioned.

在第二方面,本发明实施例提供一种基于目标高速球的物体跟踪装置,应用于监控服务器,所述装置包括:In a second aspect, an embodiment of the present invention provides an object tracking device based on a target high-speed ball, which is applied to a monitoring server, and the device includes:

接收模块,用于接收定位指令,所述定位指令包括需定位的目标物体;A receiving module, configured to receive a positioning instruction, where the positioning instruction includes a target object to be positioned;

遍历模块,用于根据所述定位指令,遍历所述目标高速球拍摄的视频数据, 以检测出所述目标物体;A traversal module, configured to traverse video data shot by the target high-speed ball according to the positioning instruction to detect the target object;

控制模块,用于控制所述目标高速球跟踪所述目标物体,并且缩小或放大包含所述目标物体的视频画面。A control module is configured to control the target high-speed ball to track the target object, and to reduce or enlarge a video picture including the target object.

可选地,所述控制模块包括:Optionally, the control module includes:

判断单元,用于判断包含所述目标物体的目标视频帧是否匹配预设视频检测异常模型;A judging unit, configured to judge whether a target video frame including the target object matches a preset video detection abnormal model;

控制单元,用于若匹配,以所述目标视频帧为跟踪起始点,控制所述目标高速球跟踪所述目标物体;A control unit, configured to control the target high-speed ball to track the target object by using the target video frame as a tracking starting point if matched;

继续判断单元,用于若未匹配,继续判断包含所述目标物体的下一帧目标视频帧是否匹配预设视频检测异常模型。A continuing judging unit, configured to continue judging whether the target video frame of the next frame containing the target object matches a preset video detection abnormal model if there is no match;

在第三方面,本发明实施例提供一种监控服务器,包括:In a third aspect, an embodiment of the present invention provides a monitoring server, including:

至少一个处理器;以及At least one processor; and

与所述至少一个处理器通信连接的存储器;其中,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够用于执行任一项所述的基于高速球的物体跟踪方法。A memory connected in communication with the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processing The device can be used to perform the high-speed ball-based object tracking method according to any one of the above.

在第四方面,本发明实施例提供一种视频监控系统,包括:In a fourth aspect, an embodiment of the present invention provides a video monitoring system, including:

若干高速球;Several high-speed balls;

所述的监控服务器,所述监控服务器与每个所述高速球通讯。In the monitoring server, the monitoring server communicates with each of the high-speed domes.

在第五方面,本发明实施例提供一种非暂态计算机可读存储介质,所述非暂态计算机可读存储介质存储有计算机可执行指令,所述计算机可执行指令用于使监控服务器执行任一项所述的基于高速球的物体跟踪方法。In a fifth aspect, an embodiment of the present invention provides a non-transitory computer-readable storage medium, where the non-transitory computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to cause a monitoring server to execute The high-speed ball-based object tracking method according to any one.

在第六方面,本发明实施例提供一种计算机程序产品,所述计算机程序产品包括存储在非易失性计算机可读存储介质上的计算机程序,所述计算机程序包括程序指令,当所述程序指令被监控服务器执行时,使所述监控服务器执行任一项所述的基于高速球的物体跟踪方法。In a sixth aspect, an embodiment of the present invention provides a computer program product. The computer program product includes a computer program stored on a non-volatile computer-readable storage medium. The computer program includes program instructions. When the instruction is executed by the monitoring server, the monitoring server is caused to execute the high-speed ball-based object tracking method according to any one of the above.

在本发明各个实施例提供的基于高速球的物体跟踪方法、监控服务器、视频监控系统中,首先,接收定位指令,定位指令包括需定位的目标物体;其次,根据定位指令,遍历目标高速球拍摄的视频数据,以检测出目标物体;再次,控制目标高速球跟踪目标物体,并且缩小或放大包含目标物体的视频画面。因 此,一方面,其能够自动检测出目标物体作针对性地拍摄。另一方面,其能够自动跟踪目标物体,并可以缩小或放大包含目标物体的视频画面,从而相对地为后期提供与目标物体关联的高清晰度视频画面或者更大视野范围。In the high-speed ball-based object tracking method, monitoring server, and video monitoring system provided by various embodiments of the present invention, first, a positioning instruction is received, and the positioning instruction includes a target object to be positioned; second, according to the positioning instruction, the target high-speed ball is traversed Video data to detect the target object; again, control the target high-speed ball to track the target object, and reduce or enlarge the video frame containing the target object. Therefore, on the one hand, it can automatically detect the target object for targeted shooting. On the other hand, it can track the target object automatically, and can reduce or enlarge the video frame containing the target object, so as to provide a high-definition video frame or a larger field of view associated with the target object for the later phase.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

一个或多个实施例通过与之对应的附图中的图片进行示例性说明,这些示例性说明并不构成对实施例的限定,附图中具有相同参考数字标号的元件表示为类似的元件,除非有特别申明,附图中的图不构成比例限制。One or more embodiments are exemplified by the pictures in the accompanying drawings. These exemplary descriptions do not constitute a limitation on the embodiments. Elements with the same reference numerals in the drawings are denoted as similar elements. Unless otherwise stated, the drawings in the drawings do not constitute a limitation on scale.

图1是本发明实施例提供一种基于高速球的物体跟踪系统的结构示意图;1 is a schematic structural diagram of an object tracking system based on a high-speed ball according to an embodiment of the present invention;

图2是本发明实施例提供一种基于高速球的物体跟踪方法的流程示意图;2 is a schematic flowchart of an object tracking method based on a high-speed ball according to an embodiment of the present invention;

图3是本发明实施例提供一种基于高速球的物体跟踪装置的结构示意图;3 is a schematic structural diagram of a high-speed ball-based object tracking device according to an embodiment of the present invention;

图4是图3中控制模块的结构示意图;4 is a schematic structural diagram of a control module in FIG. 3;

图5是本发明实施例提供一种监控服务器的结构示意图。FIG. 5 is a schematic structural diagram of a monitoring server according to an embodiment of the present invention.

具体实施方式detailed description

为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅用以解释本发明,并不用于限定本发明。In order to make the objectives, technical solutions, and advantages of the present invention clearer, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

本发明实施例的基于高速球的物体跟踪方法,可以在任何合适类型、具有运算能力的电子设备中执行,例如监控服务器、台式计算机、智能手机、平板电脑以及其他电子产品中。其中,此处的监控服务器可以是一个物理服务器或者多个物理服务器虚拟而成的一个逻辑服务器。服务器也可以是多个可互联通信的服务器组成的服务器群,且各个功能模块可分别分布在服务器群中的各个服务器上。The high-speed ball-based object tracking method according to the embodiment of the present invention can be executed in any suitable type of electronic device with computing capability, such as a monitoring server, a desktop computer, a smart phone, a tablet computer, and other electronic products. The monitoring server here may be a physical server or a logical server virtualized by multiple physical servers. The server may also be a server group composed of multiple servers that can communicate with each other, and each functional module may be separately distributed on each server in the server group.

本发明实施例的基于高速球的物体跟踪装置可以作为软件系统,独立设置在上述客户端中,也可以作为整合在处理器中的其中一个功能模块,执行本发明实施例的基于高速球的物体跟踪方法。The high-speed ball-based object tracking device according to the embodiment of the present invention may be used as a software system, independently set in the above-mentioned client, or may be one of the functional modules integrated in the processor to execute the high-speed ball-based object of the embodiment of the present invention. Tracking method.

请参阅图1,图1是本发明实施例提供一种视频监控系统的结构示意图。如图1所示,视频监控系统100包括若干摄像机11、监控服务器12及移动终 端13。Please refer to FIG. 1, which is a schematic structural diagram of a video surveillance system according to an embodiment of the present invention. As shown in FIG. 1, the video surveillance system 100 includes a plurality of cameras 11, a surveillance server 12, and a mobile terminal 13.

摄像机11安装于预设区域内,用于采集视频数据。可以理解的是,摄像机11按照预设规律固定安装于预设区域,尽可能地做到将所述预设区域全部覆盖。例如,在所述预设区域的墙面、地面、屋顶或者物体表面,结合所述预设区域的具体结构和遮挡等布设所述摄像机。The camera 11 is installed in a preset area for collecting video data. It can be understood that the camera 11 is fixedly installed in a preset area according to a preset rule, so as to cover the preset area as much as possible. For example, the camera is arranged on a wall surface, a ground, a roof, or an object surface of the preset area in combination with the specific structure and occlusion of the preset area.

其中,摄像机的数量为多个。各个摄像机组成一个摄像机群,用于监控特定监控区域范围,每个摄像机安装于预设区域内的不同位置。每个摄像机用于拍摄预设区域内不同角度的区域图像,例如,在一些实施例中,摄像机群能够360度地拍摄位于预设区域内的物体。Among them, there are multiple cameras. Each camera forms a camera group, which is used to monitor a specific surveillance area. Each camera is installed at a different position in a preset area. Each camera is used to capture images of areas at different angles within a preset area. For example, in some embodiments, the camera group can capture 360-degree objects in the preset area.

一般的,摄像机群中各个摄像机皆将采集的视频数据上传至同一监控服务器。不同监控区域范围,对应着不同监控服务器。对于管理不同监控区域的不同管理者,两者的监控服务器互不共享监控视频。Generally, each camera in the camera group uploads the collected video data to the same monitoring server. Different monitoring areas correspond to different monitoring servers. For different managers who manage different surveillance areas, the surveillance servers of the two do not share surveillance video with each other.

为提高摄像机11的拍摄角度和拍摄范围,减少摄像机11的布设,降低系统成本,可以采用摄像机11与多维旋转电机结合的方式对预设区域进行高清视频帧图像的实时捕抓。当然,可以选择一体化的摄像机11替代多维旋转电机与摄像机11结合的方式,比如,半球形一体机、快速球型一体机、结合云台的一体化高清摄像机或镜头内置的一体机等,上述的一体机可以实现自动聚焦。优选的,选择具有防水功能、体积较小、分辨率高、高寿命以及具有通用通信接口等的高清摄像机。In order to increase the shooting angle and shooting range of the camera 11, reduce the deployment of the camera 11, and reduce the system cost, a combination of the camera 11 and a multi-dimensional rotating motor can be used to capture real-time capture of high-definition video frame images in the preset area. Of course, you can choose an integrated camera 11 instead of the combination of the multi-dimensional rotating motor and the camera 11, such as a hemispherical all-in-one machine, a fast dome all-in-one machine, an integrated high-definition camera combined with a gimbal, or an integrated machine with a built-in lens. All-in-one can achieve automatic focusing. Preferably, a high-definition camera with a waterproof function, a small size, a high resolution, a long life, and a universal communication interface is selected.

在一些实施例中,摄像机11为网络摄像机,摄像机11内置有网络编码模块。In some embodiments, the camera 11 is a network camera, and the camera 11 has a built-in network coding module.

摄像机包括镜头、图像传感器、声音传感器、A/D转换器、控制器、控制接口、网络接口以及等等。所述摄像机可以用于采集视频数据信号,所述视频数据信号为模拟视频信号。所述摄像机主要由CMOS光敏元器件和外围电路组成,用于将所述镜头传入的光信号转换为电信号。The camera includes a lens, an image sensor, a sound sensor, an A / D converter, a controller, a control interface, a network interface, and so on. The camera may be used to collect video data signals, and the video data signals are analog video signals. The camera is mainly composed of a CMOS light-sensitive component and a peripheral circuit, and is used for converting an optical signal input from the lens into an electrical signal.

具体的,网络编码模块内置一嵌入式芯片,所述嵌入式芯片用于将所述摄像机采集到的视频数据信号转换为数字信号,所述视频数据信号为模拟视频信号,所述嵌入式芯片还可以将所述数字信号进行压缩。具体的,所述嵌入式芯片可以为Hi3516高效压缩芯片。Specifically, the network coding module has an embedded chip built therein, the embedded chip is used to convert the video data signals collected by the camera into digital signals, the video data signals are analog video signals, and the embedded chip also The digital signal may be compressed. Specifically, the embedded chip may be a Hi3516 high-efficiency compression chip.

摄像机11通过WIFI网络将压缩后的数字信号发送到监控服务器12。监控服务器12可以将压缩后的数字信号发送到移动终端13。其中,摄像机11还包括红外传感器,使得摄像机11具有夜视功能。网络上用户可以直接用浏览器观看Web服务器上的摄像机图像或者通过移动终端APP直接访问,摄像机11能更简单地实现监控,特别是远程监控,具有简单的施工和维护、更好的支持音频、更好的支持报警联动、更灵活的录像存储、更丰富的产品选择、更高清的视频效果和更完美的监控管理功能,并且可直接将摄像机接入本地局域网,是数据的采集和光电信号的转换端,是整个网络的数据提供端。The camera 11 sends the compressed digital signal to the monitoring server 12 through the WIFI network. The monitoring server 12 may send the compressed digital signal to the mobile terminal 13. The camera 11 further includes an infrared sensor, so that the camera 11 has a night vision function. Users on the network can directly view the camera image on the web server with a browser or directly access through the mobile terminal APP. The camera 11 can more easily implement monitoring, especially remote monitoring, with simple construction and maintenance, better support for audio, Better support for alarm linkage, more flexible recording storage, richer product selection, higher-definition video effects and more perfect monitoring and management functions, and the camera can be directly connected to the local area network, which is the data collection and photoelectric signal The conversion end is the data supply end of the entire network.

其中,监控服务器12是提供计算服务的设备。监控服务器的构成包括处理器、硬盘、内存、系统总线等,和通用的计算机架构类似,监控服务器负责提供移动终端APP的注册登录,用户的管理,设备管理等功能。同时负责摄像机的视频数据的存储功能,以及通过监控服务器记住移动终端和摄像机的IP和端口,将对应的移动终端和摄像机的IP和端口都传送给对方,从而使摄像机端和移动端能知道对方的IP和端口,通过IP地址和端口建立二者的连接通信。监控服务器获取摄像机的视频数据然后根据人工智能模块去分析视频数据,当检测到异常的视频数据时就会发送告警信息通知所述移动终端。The monitoring server 12 is a device that provides computing services. The composition of the monitoring server includes a processor, a hard disk, a memory, a system bus, and the like. Similar to a general computer architecture, the monitoring server is responsible for providing functions such as mobile terminal APP registration, user management, and device management. At the same time, it is responsible for the video data storage function of the camera, and remembers the IP and port of the mobile terminal and camera through the monitoring server, and transmits the IP and port of the corresponding mobile terminal and camera to each other, so that the camera and mobile end can know The other party's IP and port establish a connection and communication through the IP address and port. The monitoring server obtains the video data of the camera and then analyzes the video data according to the artificial intelligence module. When abnormal video data is detected, it sends an alarm message to notify the mobile terminal.

具体的,监控服务器12包括一处理器,所述处理器包括人工智能模块。所述人工智能模块负责对视频数据的实时分析,检测异常的时刻并通知移动终端。人工智能模块的具体实施方式分为,视频异常检测模型的建立和视频异常检测模型的应用两个部分。首先是视频异常检测模型的建立分这三个部分,第一部分:训练视频异常检测模型的视频数据集,用于后面的机器的训练和学习。包括各种异常场景的视频数据如行驶车辆频繁穿插并线、抢劫、尾随盗窃、打架斗殴、群殴、尖叫声,哭泣声、烟雾,嘈杂的视频数据等多种需要检测的异常场景。训练视频数据集覆盖大部分的应用场景。第二部分:视频数据集的预处理,将视频数据按一秒钟抽取10张图片,每张图片转换为长255像素和宽255像素的图片。第三部分:训练模型的建立,使用人工智能的卷积算法,Python代码建立训练的模型。模型包括输入层,隐藏层,输出层,输入层是输入预处理的图片,隐藏层用来计算输入图片的特征,输出层是通过隐藏层的计算特征输出该视频是否包含异常场景。训练的过程是。将正常的视频标记为0异常的 视频标记为1,然后将异常的视频和正常的视频同时输入训练系统,通过数据集预处理和训练模型的计算,分辨视频是异常视频还是正常的视频。重复上面的步骤,当系统分辨的正确率达到90%以上停止训练,保存模型。建立完模型后,将模型转移到服务器端,将数据集换成摄像机的视频,运行模型,检测摄像机的视频是否有异常的情况。Specifically, the monitoring server 12 includes a processor, and the processor includes an artificial intelligence module. The artificial intelligence module is responsible for real-time analysis of video data, detects abnormal times, and notifies the mobile terminal. The specific implementation of the artificial intelligence module is divided into two parts, the establishment of a video anomaly detection model and the application of a video anomaly detection model. The first is the establishment of the video anomaly detection model. There are three parts. The first part: training the video data set of the video anomaly detection model for the training and learning of the subsequent machines. It includes video data of various abnormal scenes, such as frequent crossing of vehicles, robbery, trailing theft, fights, group fights, screams, crying, smoke, noisy video data, and other abnormal scenes that need to be detected. The training video dataset covers most application scenarios. The second part: the preprocessing of the video data set. The video data is extracted 10 pictures per second, and each picture is converted into a picture of 255 pixels long and 255 pixels wide. The third part: the establishment of training model, using artificial intelligence convolution algorithm, Python code to build the training model. The model includes an input layer, a hidden layer, and an output layer. The input layer is an input pre-processed picture. The hidden layer is used to calculate the features of the input picture. The output layer is based on the calculated features of the hidden layer to output whether the video contains abnormal scenes. The training process is. The normal video is marked as 0, and the abnormal video is marked as 1. Then, the abnormal video and the normal video are input into the training system at the same time, and the data set is preprocessed and the training model is calculated to distinguish whether the video is abnormal or normal. Repeat the above steps, stop training when the accuracy of the system's discrimination reaches 90%, and save the model. After the model is established, the model is transferred to the server, the data set is replaced with the video of the camera, and the model is run to detect whether the video of the camera is abnormal.

请参阅图2,图2是本发明实施例提供一种基于高速球的物体跟踪方法的流程示意图。如图2所示,基于高速球的物体跟踪方法S200包括:Please refer to FIG. 2, which is a schematic flowchart of an object tracking method based on a high-speed ball according to an embodiment of the present invention. As shown in FIG. 2, the high-speed ball-based object tracking method S200 includes:

S21、接收定位指令,定位指令包括需定位的目标物体;S21. Receive a positioning instruction, where the positioning instruction includes a target object to be positioned;

在本实施例中,定位指令用于指示监控服务器在视频数据中检测与目标物体。定位指令的产生方式多种多样,例如,在一些实施例中,用户在监控服务器的用户交互界面上输入目标物体的物体名称,从而触发监控服务器分发出定位指令,其中,该定位指令包括与物体名称对应的目标物体。在另一些实施例中,由于物体种类及形状繁多,并且某些物体缺乏官方或者合乎常理地统一名称,因此,为了能够顺利检测出目标物体,用户可以在监控服务器预先构建特定物体的形状,于是用户便触发监控服务器分发出定位指令,后续监控服务器便可以根据该物体的形状生成图像形状数据,其中,图像形状数据包括该物体的若干图像特征点。In this embodiment, the positioning instruction is used to instruct the monitoring server to detect and target objects in the video data. There are various ways to generate a positioning instruction. For example, in some embodiments, a user enters an object name of a target object on a user interaction interface of a monitoring server, thereby triggering the monitoring server to issue a positioning instruction, where the positioning instruction includes an object The target object corresponding to the name. In other embodiments, because there are many types and shapes of objects, and some objects lack an official or common sense uniform name, in order to be able to detect the target object smoothly, the user can pre-build the shape of the specific object on the monitoring server, so The user triggers the monitoring server to issue positioning instructions, and the subsequent monitoring server can generate image shape data according to the shape of the object, where the image shape data includes several image feature points of the object.

其次,监控服务器根据图像形状数据中的若干图像特征点,确定图像形状数据对应的物体的形状。Secondly, the monitoring server determines the shape of the object corresponding to the image shape data according to several image feature points in the image shape data.

再次,监控服务器将对应于图像形状数据的物体作为需定位的目标物体。Again, the monitoring server uses the object corresponding to the image shape data as the target object to be positioned.

举例而言,用户在监控服务器输入车辆的图像形状数据,监控服务器根据图像形状数据解析出各个图像特征点。其次,监控服务器根据各个图像特征点确定该图像为车辆形状的图像。再次,监控服务器将车辆作为需定位的目标物体。For example, a user inputs image shape data of a vehicle at a monitoring server, and the monitoring server parses each image feature point according to the image shape data. Secondly, the monitoring server determines that the image is a vehicle shape image according to each image feature point. Third, the monitoring server regards the vehicle as a target object to be positioned.

S22、根据定位指令,遍历目标高速球拍摄的视频数据,以检测出目标物体;S22. According to the positioning instruction, traverse the video data captured by the target high-speed ball to detect the target object;

在本实施例中,高速球集成云台系统、通讯系统及摄像机系统,其能够实现目标跟踪、焦距调整、位置变换等等功能。In this embodiment, the high-speed dome integrates a gimbal system, a communication system, and a camera system, which can implement functions such as target tracking, focus adjustment, position conversion, and the like.

目标高速球为摄像机群中任意摄像机,可以理解的是,目标高速球中“目 标”是用于区分其它摄像机,当监控服务器从摄像机群中选择特定摄像机的视频数据作出检测分析时,此时,该特定摄像机便为目标高速球。目标高速球中“目标”并不用于限制本发明的保护范围,只是用于区分之用。The target high-speed ball is any camera in the camera group. It can be understood that the “target” in the target high-speed ball is used to distinguish other cameras. When the monitoring server selects the video data of a specific camera from the camera group for detection and analysis, This particular camera is the target speed dome. The "target" in the target high-speed ball is not used to limit the protection scope of the present invention, but only used for differentiation.

在本实施例中,监控服务器根据定位指令,按照监控时间,依次遍历目标高速球拍摄的视频数据,从中检测出目标物体。In this embodiment, according to the positioning instruction, the monitoring server sequentially traverses the video data captured by the target high-speed ball according to the monitoring time, and detects the target object therefrom.

S23、控制目标高速球跟踪目标物体,并且缩小或放大包含目标物体的视频画面。S23. Control the target high-speed ball to track the target object, and reduce or enlarge the video image containing the target object.

在本实施例中,监控服务器根据目标物体的移动,控制目标高速球的云台调整摄像镜头跟随着目标物体的移动而移动。在一些实施例中,目标高速球跟踪目标物体时,监控服务器可以绘制并保存目标物体的行走路径,以便后续分析目标物体时,提供便利。In this embodiment, the monitoring server controls the PTZ of the target high-speed ball to adjust the camera lens to follow the movement of the target object according to the movement of the target object. In some embodiments, when the target high-speed ball tracks the target object, the monitoring server may draw and save the walking path of the target object, so as to provide convenience when the target object is subsequently analyzed.

既然目标物体是监控服务器重点关注的对象,为了后期借助高清图像能够分析目标物体,监控服务器可以放大包含目标物体的视频画面,以便获得目标物体的更细节画面。或者,为了后期能够全面还原目标物体的周围环境,监控服务器还可以缩小包含目标物体的视频画面,以尽可能获得包含目标物体的更大视野范围。Since the target object is the focus of the monitoring server, in order to analyze the target object with the help of high-definition images later, the monitoring server can enlarge the video image containing the target object in order to obtain a more detailed picture of the target object. Or, in order to fully restore the surrounding environment of the target object at a later stage, the monitoring server may also reduce the video image containing the target object to obtain a larger field of view including the target object as much as possible.

综上,一方面,其能够自动检测出目标物体作针对性地拍摄。另一方面,其能够自动跟踪目标物体,并可以缩小或放大包含目标物体的视频画面,从而相对地为后期提供与目标物体关联的高清晰度视频画面或者更大视野范围。In summary, on the one hand, it can automatically detect a target object for targeted shooting. On the other hand, it can track the target object automatically, and can reduce or enlarge the video frame containing the target object, so as to provide a high-definition video frame or a larger field of view associated with the target object for the later phase.

一般的,当某个视频场景出现一些异常情况时,该视频场景中的物体更值得重点关注,例如在抢劫、尾随盗窃、打架斗殴、群殴、尖叫声、哭泣声、烟雾或嘈杂等异常场景中的物体是值得重点关注的。因此,在一些实施例中,监控服务器控制目标高速球跟踪目标物体时,首先,监控服务器判断包含目标物体的目标视频帧是否匹配预设视频检测异常模型;若匹配,以目标视频帧为跟踪起始点,控制目标高速球跟踪所述目标物体。若未匹配,继续判断包含目标物体的下一帧目标视频帧是否匹配预设视频检测异常模型。Generally, when there are some abnormal situations in a video scene, the objects in the video scene are more worthy of attention, such as anomalies such as robbery, trailing theft, fights, group fights, screams, crying, smoke or noisy. The objects in the scene are worth paying attention to. Therefore, in some embodiments, when the monitoring server controls the target high-speed ball to track the target object, first, the monitoring server determines whether the target video frame containing the target object matches the preset video detection abnormal model; if it matches, the target video frame is used as the tracking starting point. Starting point, control the target high-speed ball to track the target object. If they do not match, continue to determine whether the next target video frame containing the target object matches the preset video detection abnormal model.

在一些实施例中,目标物体为人物,高速球的数量为至少两个,不同高速球可从不同角度拍摄人物。监控服务器以目标视频帧为跟踪起始点,控制目标高速球跟踪目标物体时,首先监控服务器以目标视频帧为跟踪起始点,获取目 标高速球拍摄人物的人物图像。In some embodiments, the target object is a person, and the number of high-speed balls is at least two. Different high-speed balls can photograph people from different angles. The monitoring server uses the target video frame as the tracking start point. When controlling the target high-speed ball to track the target object, the monitoring server first uses the target video frame as the tracking start point to obtain the target high-speed ball to shoot the person's image.

其次,监控服务器判断人物图像是否是人物的正面图像,正面图像包括人物的人脸图像。例如,甲尾随乙,伺机扒手乙的手提包,摄像机监控到甲的尾随动作行为,并将包含甲的尾随动作行为的视频数据发送至监控服务器,监控服务器检测到甲的尾随动作行为,并确定甲为目标人物。监控服务器再根据图像分析算法分析甲的人物图像,判断视频数据是否存在与目标人物关联的人脸特征点,若存在,则认为视频数据包含目标人物的正面图像;若未存在,则认为视频数据未包含目标人物的正面图像,并且该视频数据只包含目标人物的背面图像。例如,承接上述例子,若监控服务器在视频数据检测出甲的人脸图像,则认为目标高速球拍摄到甲的正面图像。若监控服务器在视频数据未检测出甲的人脸图像,则认为目标高速球拍摄到甲的背面图像。Second, the monitoring server determines whether the person image is a front image of the person, and the front image includes a face image of the person. For example, A's Trailer B, Opportunity Pickpocket B's handbag, the camera monitors A's Trailing action behavior, and sends video data containing A's Trailing action behavior to the monitoring server. The monitoring server detects A's Trailing action behavior and determines A is the target person. The monitoring server then analyzes the person's image according to the image analysis algorithm to determine whether there are facial feature points associated with the target person in the video data. If it exists, it considers that the video data contains a frontal image of the target person; if it does not exist, it considers the video data The front image of the target person is not included, and the video data includes only the back image of the target person. For example, following the above example, if the monitoring server detects the face image of A in the video data, it is considered that the target high-speed ball has captured the front image of A. If the monitoring server does not detect the face image of nail A in the video data, it considers that the target high-speed ball captured the back image of nail A.

再次,若是人物的正面图像,监控服务器控制目标高速球跟踪人物;若否,监控服务器检测出与目标高速球相对设置的额外高速球,控制额外高速球拍摄人物的正面图像,并跟踪人物。例如,当监控服务器检测出视频数据未包含目标人物的正面图像时,监控服务器确定目标人物的当前地理位置。Again, if it is a frontal image of a person, the monitoring server controls the target high-speed ball to track the person; if not, the monitoring server detects an additional high-speed ball set opposite the target high-speed ball, controls the additional high-speed ball to take a frontal image of the person, and tracks the person. For example, when the monitoring server detects that the video data does not include a frontal image of the target person, the monitoring server determines the current geographic location of the target person.

其次,监控服务器根据目标人物的当前地理位置,检测与覆盖目标人物的当前地理位置的所有额外高速球并确定所有额外高速球的安装地理位置,并从所有额外高速球的安装地理位置中确定与目标高速球的安装地理位置相对的额外高速球。Secondly, the monitoring server detects and covers all additional high-speed domes of the target person's current geographical position and determines the installation geographic positions of all the additional high-speed domes according to the current geographic position of the target person, and determines the installation locations from all of the additional high-speed domes. The target high-speed dome is an additional high-speed dome that is relatively geographically installed.

再次,监控服务器控制与目标高速球的安装地理位置相对的额外高速球跟踪人物并拍摄人物的正面图像。Again, the monitoring server controls the extra high-speed ball relative to the installed geographical position of the target high-speed ball to track the person and take a frontal image of the person.

实际上,一些恶性事件发生时间大部分在光线弱等黑暗地方,为了严防非法分子,争取获得非法分子高清人脸图像,在一些实施例中,监控服务器检测出与目标高速球相对设置的额外高速球时,首先,监控服务器获取预设区域内的光照强度,例如,设置于预设区域内的光照传感器采集光照强度,并将光照强度传输至监控服务器。In fact, some vicious events occur mostly in dark places such as low light. In order to prevent illegal elements and strive to obtain high-definition face images of illegal elements, in some embodiments, the monitoring server detects additional high speeds that are set opposite the target high-speed ball. When the ball is used, first, the monitoring server obtains the light intensity in the preset area. For example, a light sensor set in the preset area collects the light intensity and transmits the light intensity to the monitoring server.

其次,监控服务器判断光照强度是否大于预设强度阈值,若大于,获取与目标高速球相对设置的所有额外高速球的最低照度值,从所有额外高速球的最低照度值中遍历出最低照度值最低的额外高速球作为跟踪并拍摄人物的正面 图像的高速球,于是,监控服务器便尽可能地获取到高清的人物正面图像。若小于,检测出与目标高速球相对设置的额外高速球。Secondly, the monitoring server judges whether the light intensity is greater than a preset intensity threshold. If it is greater than that, it obtains the minimum illumination values of all the additional high-speed balls set opposite to the target high-speed ball, and traverses the lowest illumination value from the lowest illumination values of all the additional high-speed balls. The extra high-speed ball is used as a high-speed ball that tracks and captures the front image of the character. Therefore, the surveillance server obtains the front image of the character as high-definition as possible. If it is less than that, an additional high-speed ball set opposite to the target high-speed ball is detected.

通过此种方式,其能够尽可能地获取到高清的人物正面图像,从而实现有效地视频监控。In this way, it can obtain high-definition frontal images of people as much as possible, thereby achieving effective video surveillance.

需要说明的是,在上述各个实施例中,上述各步骤之间并不必然存在一定的先后顺序,本领域普通技术人员,根据本发明实施例的描述可以理解,不同实施例中,上述各步骤可以有不同的执行顺序,亦即,可以并行执行,亦可以交换执行等等。It should be noted that, in the above embodiments, there is not necessarily a certain sequence between the above steps. Those skilled in the art can understand from the description of the embodiments of the present invention that the above steps in different embodiments There can be different execution orders, that is, execution can be performed in parallel, execution can be exchanged, and so on.

作为本发明实施例的另一方面,本发明实施例提供一种基于高速球的物体跟踪装置应用于监控服务器。本发明实施例的基于高速球的物体跟踪装置可以作为其中一个软件功能单元,基于高速球的物体跟踪装置包括若干指令,该若干指令存储于存储器内,处理器可以访问该存储器,调用指令进行执行,以完成上述基于高速球的物体跟踪方法。As another aspect of the embodiments of the present invention, an embodiment of the present invention provides a high-speed ball-based object tracking device applied to a monitoring server. The high-speed dome-based object tracking device according to the embodiment of the present invention may be used as one of the software functional units. The high-speed dome-based object tracking device includes several instructions. The several instructions are stored in a memory, and the processor may access the memory and call the instructions for execution. To complete the above-mentioned high-speed ball-based object tracking method.

请参阅图3,基于高速球的物体跟踪装置300包括:接收模块31、遍历模块32及控制模块33。Referring to FIG. 3, the high-speed ball-based object tracking device 300 includes a receiving module 31, a traversal module 32, and a control module 33.

接收模块31用于接收定位指令,所述定位指令包括需定位的目标物体;The receiving module 31 is configured to receive a positioning instruction, where the positioning instruction includes a target object to be positioned;

遍历模块32用于根据所述定位指令,遍历所述目标高速球拍摄的视频数据,以检测出所述目标物体;The traversal module 32 is configured to traverse the video data captured by the target high-speed ball according to the positioning instruction to detect the target object;

控制模块33用于控制所述目标高速球跟踪所述目标物体,并且缩小或放大包含所述目标物体的视频画面。The control module 33 is used for controlling the target high-speed ball to track the target object, and reducing or enlarging a video picture containing the target object.

综上,一方面,其能够自动检测出目标物体作针对性地拍摄。另一方面,其能够自动跟踪目标物体,并可以缩小或放大包含目标物体的视频画面,从而相对地为后期提供与目标物体关联的高清晰度视频画面或者更大视野范围。In summary, on the one hand, it can automatically detect a target object for targeted shooting. On the other hand, it can track the target object automatically, and can reduce or enlarge the video frame containing the target object, so as to provide a high-definition video frame or a larger field of view associated with the target object for the later phase.

在一些实施例中,请参阅图4,所述控制模块33包括:判断单元331、控制单元332及继续判断单元333。In some embodiments, referring to FIG. 4, the control module 33 includes: a judging unit 331, a control unit 332, and a continuing judging unit 333.

判断单元331用于判断包含所述目标物体的目标视频帧是否匹配预设视频检测异常模型;The determining unit 331 is configured to determine whether a target video frame including the target object matches a preset video detection abnormal model;

控制单元332用于若匹配,以所述目标视频帧为跟踪起始点,控制所述目标高速球跟踪所述目标物体;The control unit 332 is configured to control the target high-speed ball to track the target object by using the target video frame as a tracking starting point if matched;

继续判断单元333用于若未匹配,继续判断包含所述目标物体的下一帧目标视频帧是否匹配预设视频检测异常模型。The continuing determination unit 333 is configured to continue to determine whether the target video frame of the next frame including the target object matches a preset video detection abnormal model if there is no match.

需要说明的是,上述基于高速球的物体跟踪装置可执行本发明实施例所提供的基于高速球的物体跟踪方法,具备执行方法相应的功能模块和有益效果。未在基于高速球的物体跟踪装置实施例中详尽描述的技术细节,可参见本发明实施例所提供的基于高速球的物体跟踪方法。It should be noted that the above-mentioned high-speed ball-based object tracking device can execute the high-speed ball-based object tracking method provided by the embodiment of the present invention, and has corresponding function modules and beneficial effects of the execution method. For technical details not described in detail in the embodiment of the high-speed ball-based object tracking device, refer to the high-speed ball-based object tracking method provided in the embodiment of the present invention.

作为本发明实施例的又另一方面,本发明实施例提供一种监控服务器。如图5所示,该监控服务器500包括:一个或多个处理器51以及存储器52。其中,图5中以一个处理器51为例。As yet another aspect of the embodiments of the present invention, an embodiment of the present invention provides a monitoring server. As shown in FIG. 5, the monitoring server 500 includes: one or more processors 51 and a memory 52. Among them, one processor 51 is taken as an example in FIG. 5.

处理器51和存储器52可以通过总线或者其他方式连接,图5中以通过总线连接为例。The processor 51 and the memory 52 may be connected through a bus or in other manners. In FIG. 5, the connection through the bus is taken as an example.

存储器52作为一种非易失性计算机可读存储介质,可用于存储非易失性软件程序、非易失性计算机可执行程序以及模块,如本发明实施例中的基于高速球的物体跟踪方法对应的程序指令/模块。处理器51通过运行存储在存储器52中的非易失性软件程序、指令以及模块,从而执行基于高速球的物体跟踪装置的各种功能应用以及数据处理,即实现上述方法实施例基于高速球的物体跟踪方法以及上述装置实施例的各个模块的功能。The memory 52 is a non-volatile computer-readable storage medium, and can be used to store non-volatile software programs, non-volatile computer executable programs, and modules, such as the high-speed ball-based object tracking method in the embodiment of the present invention. Corresponding program instructions / modules. The processor 51 executes various functional applications and data processing of the high-speed dome-based object tracking device by running non-volatile software programs, instructions, and modules stored in the memory 52, that is, the high-speed dome-based Object tracking method and functions of each module of the above device embodiment.

存储器52可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实施例中,存储器52可选包括相对于处理器51远程设置的存储器,这些远程存储器可以通过网络连接至处理器51。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 52 may include a high-speed random access memory, and may further include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory 52 may optionally include a memory remotely disposed with respect to the processor 51, and these remote memories may be connected to the processor 51 through a network. Examples of the above network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

所述程序指令/模块存储在所述存储器52中,当被所述一个或者多个处理器51执行时,执行上述任意方法实施例中的基于高速球的物体跟踪方法,例如,执行以上描述的图2各个步骤;也可实现附图3与图4所述的各个模块的功能。The program instructions / modules are stored in the memory 52, and when executed by the one or more processors 51, perform the high-speed ball-based object tracking method in any of the above method embodiments, for example, execute the above-described Each step in FIG. 2; the functions of each module described in FIG. 3 and FIG. 4 can also be implemented.

本发明实施例还提供了一种非易失性计算机存储介质,所述计算机存储介质存储有计算机可执行指令,该计算机可执行指令被一个或多个处理器执行,例如图5中的一个处理器51,可使得上述一个或多个处理器可执行上述任意 方法实施例中的基于高速球的物体跟踪方法,例如,执行上述任意方法实施例中的基于高速球的物体跟踪方法,例如,执行以上描述的执行以上描述的执行以上描述的图2所示的各个步骤;也可实现附图3与图4所述的各个模块的功能。An embodiment of the present invention also provides a non-volatile computer storage medium. The computer storage medium stores computer-executable instructions, and the computer-executable instructions are executed by one or more processors, such as a process in FIG. 5. The processor 51 may cause the one or more processors to execute the high-speed ball-based object tracking method in any of the foregoing method embodiments, for example, to execute the high-speed ball-based object tracking method in any of the foregoing method embodiments, for example, to execute The above-mentioned execution performs the above-mentioned execution of the steps shown in FIG. 2 described above; the functions of the various modules described in FIG. 3 and FIG. 4 may also be implemented.

以上所描述的装置或设备实施例仅仅是示意性的,其中所述作为分离部件说明的单元模块可以是或者也可以不是物理上分开的,作为模块单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络模块单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。The embodiments of the device or device described above are only schematic, and the unit modules described as separate components may or may not be physically separated, and the components displayed as module units may or may not be physical units. , Can be located in one place, or can be distributed to multiple network module units. Some or all of the modules may be selected according to actual needs to achieve the objective of the solution of this embodiment.

通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到各实施方式可借助软件加通用硬件平台的方式来实现,当然也可以通过硬件。基于这样的理解,上述技术方案本质上或者说对相关技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在计算机可读存储介质中,如ROM/RAM、磁碟、光盘等,包括若干指令用直至得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行各个实施例或者实施例的某些部分所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the embodiments can be implemented by means of software plus a general hardware platform, and of course, also by hardware. Based on such an understanding, the above-mentioned technical solutions that are essentially or contribute to related technologies can be embodied in the form of software products, which can be stored in computer-readable storage media, such as ROM / RAM, magnetic disks , Optical discs, etc., including several instructions until a computer device (which may be a personal computer, a server, or a network device, etc.) executes the methods described in various embodiments or certain parts of the embodiments.

最后应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;在本发明的思路下,以上实施例或者不同实施例中的技术特征之间也可以进行组合,步骤可以以任意顺序实现,并存在如上所述的本发明的不同方面的许多其它变化,为了简明,它们没有在细节中提供;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。Finally, it should be noted that the above embodiments are only used to describe the technical solution of the present invention, but not limited thereto. Under the idea of the present invention, the technical features in the above embodiments or different embodiments can also be combined. The steps can be implemented in any order and there are many other variations of the different aspects of the invention as described above, for the sake of brevity they are not provided in the details; although the invention has been described in detail with reference to the foregoing embodiments, it is common in the art The skilled person should understand that they can still modify the technical solutions described in the foregoing embodiments, or equivalently replace some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions separate from the implementation of this application. Examples of technical solutions.

Claims (10)

一种基于高速球的物体跟踪方法,应用于监控服务器,其特征在于,所述方法包括:A high-speed ball-based object tracking method applied to a monitoring server is characterized in that the method includes: 接收定位指令,所述定位指令包括需定位的目标物体;Receiving a positioning instruction, the positioning instruction including a target object to be positioned; 根据所述定位指令,遍历所述目标高速球拍摄的视频数据,以检测出所述目标物体;Traverse the video data captured by the target high-speed ball according to the positioning instruction to detect the target object; 控制所述目标高速球跟踪所述目标物体,并且缩小或放大包含所述目标物体的视频画面。Controlling the target high-speed ball to track the target object, and reducing or enlarging a video picture containing the target object. 根据权利要求1所述的方法,其特征在于,所述控制所述目标高速球跟踪所述目标物体,包括:The method according to claim 1, wherein the controlling the target high-speed ball to track the target object comprises: 判断包含所述目标物体的目标视频帧是否匹配预设视频检测异常模型;Determining whether a target video frame containing the target object matches a preset video detection abnormal model; 若匹配,以所述目标视频帧为跟踪起始点,控制所述目标高速球跟踪所述目标物体;If they match, use the target video frame as a tracking start point, and control the target high-speed ball to track the target object; 若未匹配,继续判断包含所述目标物体的下一帧目标视频帧是否匹配预设视频检测异常模型。If there is no match, continue to determine whether the next target video frame containing the target object matches a preset video detection abnormal model. 根据权利要求2所述的方法,其特征在于,所述目标物体为人物,高速球的数量为至少两个,不同所述高速球可从不同角度拍摄所述人物;The method according to claim 2, wherein the target object is a character, and the number of high-speed balls is at least two, and the high-speed ball can shoot the character from different angles; 所述以所述目标视频帧为跟踪起始点,控制所述目标高速球跟踪所述目标物体,包括:The controlling the target high-speed ball to track the target object by using the target video frame as a tracking starting point includes: 以所述目标视频帧为跟踪起始点,获取所述目标高速球拍摄所述人物的人物图像;Using the target video frame as a tracking starting point to obtain a person's image of the person being shot by the target high-speed ball; 判断所述人物图像是否是所述人物的正面图像,所述正面图像包括所述人物的人脸图像;Determining whether the person image is a front image of the person, and the front image includes a face image of the person; 若是,控制所述目标高速球跟踪所述人物;If yes, controlling the target high-speed ball to track the person; 若否,检测出与所述目标高速球相对设置的额外高速球,控制所述额外高速球拍摄所述人物的正面图像,并跟踪所述人物。If not, an additional high-speed ball set opposite to the target high-speed ball is detected, and the additional high-speed ball is controlled to take a frontal image of the person, and track the person. 根据权利要求2所述的方法,其特征在于,The method according to claim 2, wherein: 所述方法还包括:The method further includes: 获取训练视频数据集,所述训练视频数据集包括多种异常场景的视频数据;Obtaining a training video data set, where the training video data set includes video data of multiple abnormal scenes; 对所述多种异常场景的视频数据进行预处理;Preprocessing the video data of the multiple abnormal scenes; 通过卷积算法处理预处理后的视频数据,建立所述视频检测异常模型。The preprocessed video data is processed by a convolution algorithm to establish the video detection abnormal model. 根据权利要求1至4任一项所述的方法,其特征在于,所述接收定位指令,包括:The method according to any one of claims 1 to 4, wherein the receiving a positioning instruction comprises: 接收用户输入的图像形状数据,所述图像形状数据包括若干图像特征点;Receiving image shape data input by a user, where the image shape data includes a number of image feature points; 根据所述图像形状数据中的若干图像特征点,确定所述图像形状数据对应的物体的形状;Determining a shape of an object corresponding to the image shape data according to a plurality of image feature points in the image shape data; 将对应于所述图像形状数据的物体作为需定位的目标物体。An object corresponding to the image shape data is used as a target object to be positioned. 一种基于高速球的物体跟踪装置,应用于监控服务器,其特征在于,所述装置包括:A high-speed ball-based object tracking device applied to a monitoring server is characterized in that the device includes: 接收模块,用于接收定位指令,所述定位指令包括需定位的目标物体;A receiving module, configured to receive a positioning instruction, where the positioning instruction includes a target object to be positioned; 遍历模块,用于根据所述定位指令,遍历所述目标高速球拍摄的视频数据,以检测出所述目标物体;A traversal module for traversing video data taken by the target high-speed ball according to the positioning instruction to detect the target object; 控制模块,用于控制所述目标高速球跟踪所述目标物体,并且缩小或放大包含所述目标物体的视频画面。A control module is configured to control the target high-speed ball to track the target object, and to reduce or enlarge a video picture including the target object. 根据权利要求6所述的装置,其特征在于,所述控制模块包括:The apparatus according to claim 6, wherein the control module comprises: 判断单元,用于判断包含所述目标物体的目标视频帧是否匹配预设视频检测异常模型;A judging unit, configured to judge whether a target video frame including the target object matches a preset video detection abnormal model; 控制单元,用于若匹配,以所述目标视频帧为跟踪起始点,控制所述目标高速球跟踪所述目标物体;A control unit, configured to control the target high-speed ball to track the target object by using the target video frame as a tracking starting point if matched; 继续判断单元,用于若未匹配,继续判断包含所述目标物体的下一帧目标视频帧是否匹配预设视频检测异常模型。A continuing judging unit, configured to continue judging whether the target video frame of the next frame containing the target object matches a preset video detection abnormal model if there is no match; 一种监控服务器,其特征在于,包括:A monitoring server, comprising: 至少一个处理器;以及At least one processor; and 与所述至少一个处理器通信连接的存储器;其中,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够用于执行如权利要求1至5任一项所述的基于高速球 的物体跟踪方法。A memory connected in communication with the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processing The device can be used to perform the high-speed ball-based object tracking method according to any one of claims 1 to 5. 一种视频监控系统,其特征在于,包括:A video surveillance system, comprising: 若干高速球;Several high-speed balls; 如权利要求8所述的监控服务器,所述监控服务器与每个所述高速球通讯。The monitoring server according to claim 8, said monitoring server communicating with each of said high-speed domes. 一种非暂态计算机可读存储介质,其特征在于,所述非暂态计算机可读存储介质存储有计算机可执行指令,所述计算机可执行指令用于使监控服务器执行如权利要求1至5任一项所述的基于高速球的物体跟踪方法。A non-transitory computer-readable storage medium, characterized in that the non-transitory computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to cause a monitoring server to execute the claims 1 to 5 The high-speed ball-based object tracking method according to any one.
PCT/CN2019/103776 2018-09-21 2019-08-30 Object tracking method based on high-speed ball, monitoring server, and video monitoring system Ceased WO2020057353A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811108443.7 2018-09-21
CN201811108443.7A CN109376601B (en) 2018-09-21 2018-09-21 Object tracking method based on high-speed ball, monitoring server and video monitoring system

Publications (1)

Publication Number Publication Date
WO2020057353A1 true WO2020057353A1 (en) 2020-03-26

Family

ID=65401703

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/103776 Ceased WO2020057353A1 (en) 2018-09-21 2019-08-30 Object tracking method based on high-speed ball, monitoring server, and video monitoring system

Country Status (2)

Country Link
CN (1) CN109376601B (en)
WO (1) WO2020057353A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112104842A (en) * 2020-09-15 2020-12-18 上海思源弘瑞自动化有限公司 Image acquisition equipment correction method
CN113810614A (en) * 2021-09-22 2021-12-17 广东小天才科技有限公司 Video recording method and device and wearable device
IT202000026882A1 (en) 2020-11-10 2022-05-10 Tech4sport Srl VIDEO TRACKING SYSTEM FOR SPORTS PRACTICE
CN116437216A (en) * 2023-06-12 2023-07-14 湖南博信创远信息科技有限公司 Engineering supervision method and system based on artificial intelligence data processing and visual analysis

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109376601B (en) * 2018-09-21 2021-05-11 深圳市九洲电器有限公司 Object tracking method based on high-speed ball, monitoring server and video monitoring system
CN112004053B (en) * 2020-07-20 2022-08-16 浙江大华技术股份有限公司 Method and device for electronically amplifying monitoring image and computer equipment
CN114972415B (en) * 2021-12-28 2023-03-28 广东东软学院 Robot vision tracking method, system, electronic device and medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202190348U (en) * 2011-04-01 2012-04-11 天津长城科安电子科技有限公司 Intelligent video camera capable of automatically tracking targets
US20150229841A1 (en) * 2012-09-18 2015-08-13 Hangzhou Hikvision Digital Technology Co., Ltd. Target tracking method and system for intelligent tracking high speed dome camera
CN105245851A (en) * 2015-10-27 2016-01-13 太原市公安局 A video surveillance system
CN107016367A (en) * 2017-04-06 2017-08-04 北京精英智通科技股份有限公司 A kind of tracking and controlling method and tracking control system
CN108174152A (en) * 2017-12-28 2018-06-15 深圳英飞拓科技股份有限公司 A kind of target monitoring method and target monitor system
CN109376601A (en) * 2018-09-21 2019-02-22 深圳市九洲电器有限公司 Object tracking methods, monitoring server based on clipping the ball, video monitoring system

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101719216B (en) * 2009-12-21 2012-01-04 西安电子科技大学 Movement human abnormal behavior identification method based on template matching
CN102854897A (en) * 2012-09-28 2013-01-02 上海元朔信息科技有限公司 Abnormal target finding and tracking system and method
US9197861B2 (en) * 2012-11-15 2015-11-24 Avo Usa Holding 2 Corporation Multi-dimensional virtual beam detection for video analytics
CN103856707B (en) * 2012-12-03 2017-04-19 联想(北京)有限公司 Camera switchover method and device and electronic device
US20160132722A1 (en) * 2014-05-08 2016-05-12 Santa Clara University Self-Configuring and Self-Adjusting Distributed Surveillance System
CN104253937B (en) * 2014-10-16 2017-11-21 宁波通视电子科技有限公司 Omnidirectional camera
US10719717B2 (en) * 2015-03-23 2020-07-21 Micro Focus Llc Scan face of video feed
CN104735422A (en) * 2015-04-02 2015-06-24 重庆天量电子科技有限公司 Multifunctional intelligent analysis and monitor system
CN107592507A (en) * 2017-09-29 2018-01-16 深圳市置辰海信科技有限公司 The method of automatic trace trap high-resolution front face photo

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202190348U (en) * 2011-04-01 2012-04-11 天津长城科安电子科技有限公司 Intelligent video camera capable of automatically tracking targets
US20150229841A1 (en) * 2012-09-18 2015-08-13 Hangzhou Hikvision Digital Technology Co., Ltd. Target tracking method and system for intelligent tracking high speed dome camera
CN105245851A (en) * 2015-10-27 2016-01-13 太原市公安局 A video surveillance system
CN107016367A (en) * 2017-04-06 2017-08-04 北京精英智通科技股份有限公司 A kind of tracking and controlling method and tracking control system
CN108174152A (en) * 2017-12-28 2018-06-15 深圳英飞拓科技股份有限公司 A kind of target monitoring method and target monitor system
CN109376601A (en) * 2018-09-21 2019-02-22 深圳市九洲电器有限公司 Object tracking methods, monitoring server based on clipping the ball, video monitoring system

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112104842A (en) * 2020-09-15 2020-12-18 上海思源弘瑞自动化有限公司 Image acquisition equipment correction method
CN112104842B (en) * 2020-09-15 2023-01-06 上海思源弘瑞自动化有限公司 Image acquisition equipment correction method, device, equipment and medium
IT202000026882A1 (en) 2020-11-10 2022-05-10 Tech4sport Srl VIDEO TRACKING SYSTEM FOR SPORTS PRACTICE
CN113810614A (en) * 2021-09-22 2021-12-17 广东小天才科技有限公司 Video recording method and device and wearable device
CN116437216A (en) * 2023-06-12 2023-07-14 湖南博信创远信息科技有限公司 Engineering supervision method and system based on artificial intelligence data processing and visual analysis
CN116437216B (en) * 2023-06-12 2023-09-08 湖南博信创远信息科技有限公司 Engineering supervision method and system based on artificial intelligence data processing and visual analysis

Also Published As

Publication number Publication date
CN109376601B (en) 2021-05-11
CN109376601A (en) 2019-02-22

Similar Documents

Publication Publication Date Title
WO2020057355A1 (en) Three-dimensional modeling method and device
WO2020057346A1 (en) Video monitoring method and apparatus, monitoring server and video monitoring system
WO2020057353A1 (en) Object tracking method based on high-speed ball, monitoring server, and video monitoring system
CN112911160B (en) Image capturing method, device, equipment and storage medium
TWI466545B (en) Image capturing device and image monitoring method using the image capturing device
WO2020029921A1 (en) Monitoring method and device
WO2020094091A1 (en) Image capturing method, monitoring camera, and monitoring system
KR101530255B1 (en) Cctv system having auto tracking function of moving target
JP2010009134A (en) Image processing system, image processing method, and program
JP2016100696A (en) Image processing device, image processing method, and image processing system
TW201313012A (en) Method and camera for determining an image adjustment parameter
CN103929592A (en) All-dimensional intelligent monitoring equipment and method
CN112073613A (en) Meeting portrait shooting method, interactive tablet, computer equipment and storage medium
CN105554443A (en) Method and device for positioning abnormal sound source in video image
CN107395957B (en) Photographing method, device, storage medium and electronic device
CN110177258A (en) Image processing method, image processing apparatus, server, and storage medium
CN109905641B (en) A target monitoring method, device, equipment and system
CN105915802A (en) A shooting range setting adjustment method of a rotary camera
CN117280708A (en) Shutter value adjustment of surveillance cameras utilizing AI-based object recognition
CN115240107A (en) Moving object tracking method and apparatus, computer readable medium and electronic device
JP2020053774A (en) Imaging device and image recording method
WO2016125946A1 (en) Panorama image monitoring system using plurality of high-resolution cameras, and method therefor
CN117178289A (en) Noise removal of surveillance camera images using AI-based object recognition
CN110267011B (en) Image processing method, image processing apparatus, server, and storage medium
CN110191324B (en) Image processing method, image processing apparatus, server, and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19862463

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS (EPO FORM 1205A DATED 10.08.2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19862463

Country of ref document: EP

Kind code of ref document: A1