CN109117381A - The adjusting, measuring method and device of processing task - Google Patents
The adjusting, measuring method and device of processing task Download PDFInfo
- Publication number
- CN109117381A CN109117381A CN201811243279.0A CN201811243279A CN109117381A CN 109117381 A CN109117381 A CN 109117381A CN 201811243279 A CN201811243279 A CN 201811243279A CN 109117381 A CN109117381 A CN 109117381A
- Authority
- CN
- China
- Prior art keywords
- algorithm
- commissioning
- processing task
- data
- breakpoint
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Prevention of errors by analysis, debugging or testing of software
- G06F11/362—Debugging of software
- G06F11/3624—Debugging of software by performing operations on the source code, e.g. via a compiler
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Stored Programmes (AREA)
Abstract
本发明公开了一种处理任务的调测方法及装置。该处理任务基于用户在图元化操作界面中输入的至少一个算法组件的组合关系而创建，该方法包括：监测用户针对任一算法组件的断点插入操作，为所述算法组件设置调测断点；在处理任务的执行过程中，采集设置有调测断点的算法组件的引擎输入数据和引擎输出数据；输出引擎输入数据和引擎输出数据，以供用户进行调测。本方案中以算法组件的形式进行业务处理，并通过为算法组件设置调测断点的方式，在任务执行过程中采取相应算法组件的引擎输入数据和引擎输出数据，从而避免了现有技术在对任务调测过程中无法获取中间节点调测数据的弊端，便于获得更为细粒度及精确的调测结果，并有利于调测效率的提升。
The invention discloses a debugging method and device for processing tasks. The processing task is created based on the combination relationship of at least one algorithm component input by the user in the graphical operation interface. The method includes: monitoring the user's breakpoint insertion operation for any algorithm component, and setting a debugging break for the algorithm component During the execution of the processing task, the engine input data and engine output data of the algorithm components with debugging breakpoints are collected, and the engine input data and engine output data are output for users to perform debugging. In this solution, business processing is carried out in the form of algorithm components, and by setting debugging breakpoints for the algorithm components, the engine input data and engine output data of the corresponding algorithm components are taken during the task execution process, thereby avoiding the need for existing technology. For the disadvantage of not being able to obtain the commissioning data of the intermediate nodes during the task commissioning process, it is convenient to obtain more fine-grained and accurate commissioning results, and is conducive to the improvement of commissioning efficiency.
Description
Technical field
The present invention relates to field of computer technology, and in particular to a kind of adjusting, measuring method and device of processing task.
Background technique
With the continuous development of science and technology and society, the quantity of all kinds of business is also constantly being promoted in computer field.Currently,
For the processing for realizing business, developer is usually needed to compile corresponding service code according to demand, and according to the business generation of compiling
Code carries out business processing.
However, business processing is carried out, thus existing skill due to needing developer voluntarily to compile service code in the prior art
Art can not obtain the test data of the intermediate node in business procession during carrying out commissioning to service code, thus
Commissioning precision is reduced, and increases the commissioning time.
Summary of the invention
In view of the above problems, it proposes on the present invention overcomes the above problem or at least be partially solved in order to provide one kind
State the adjusting, measuring method and device of the processing task of problem.
According to an aspect of the invention, there is provided a kind of adjusting, measuring method of processing task, the processing task is based on using
The syntagmatic at least one algorithm assembly that family inputs in pel operation interface and create, which comprises
The breakpoint insertion operation that user is directed to any algorithm assembly is monitored, commissioning breakpoint is set for the algorithm assembly；
In the implementation procedure of the processing task, capture setting has the engine input data of the algorithm assembly of commissioning breakpoint
With engine output data；
The engine input data and engine output data are exported, so that user carries out commissioning.
According to another aspect of the present invention, a kind of device for adjusting and measuring of processing task is provided, the processing task is based on using
The syntagmatic at least one algorithm assembly that family inputs in pel operation interface and create, described device includes:
Breakpoint setup module, the breakpoint insertion operation for being directed to any algorithm assembly suitable for monitoring user are the algorithm groups
Commissioning breakpoint is arranged in part；
Data acquisition module, suitable in the implementation procedure of the processing task, capture setting has the algorithm of commissioning breakpoint
The engine input data and engine output data of component；
Output module is suitable for exporting the engine input data and engine output data, so that user carries out commissioning.
According to another aspect of the invention, provide a kind of calculating equipment, comprising: processor, memory, communication interface and
Communication bus, the processor, the memory and the communication interface complete mutual communication by the communication bus；
For the memory for storing an at least executable instruction, it is above-mentioned that the executable instruction executes the processor
The corresponding operation of the adjusting, measuring method of processing task.
In accordance with a further aspect of the present invention, provide a kind of computer storage medium, be stored in the storage medium to
A few executable instruction, the executable instruction make processor execute the corresponding operation of adjusting, measuring method such as above-mentioned processing task.
The adjusting, measuring method and device of the processing task provided according to the present invention, the processing task are based on user and grasp in pelization
Make the syntagmatic of at least one algorithm assembly inputted in interface and create, during commissioning, monitoring user is directed to first
Commissioning breakpoint is arranged for algorithm assembly in the breakpoint insertion operation of any algorithm assembly；In the implementation procedure of processing task, acquisition
It is provided with the engine input data and engine output data of the algorithm assembly of commissioning breakpoint；Final output engine input data and draw
Output data is held up, so that user carries out commissioning.Business processing is carried out in this programme in the form of algorithm assembly, and by for algorithm
The mode of commissioning breakpoint is arranged in component, takes the engine input data of respective algorithms component and engine defeated in task implementation procedure
Data out, the drawbacks of intermediate node test data can not be obtained during to task commissioning so as to avoid the prior art, just
In obtaining more fine granularity and accurate commissioning as a result, and being conducive to the promotion of commissioning efficiency.
The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention,
And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can
It is clearer and more comprehensible, the followings are specific embodiments of the present invention.
Detailed description of the invention
By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field
Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the present invention
Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings:
Fig. 1 shows a kind of process signal of the adjusting, measuring method of the processing task provided according to an embodiment of the present invention
Figure；
Fig. 2 shows a kind of processes of the adjusting, measuring method of the processing task provided according to a further embodiment of the invention to show
It is intended to；
Fig. 3 shows a kind of operation interface schematic diagram provided according to a further embodiment of the invention；
Fig. 4 shows a kind of Debugging interface schematic diagram provided according to a further embodiment of the invention；
Fig. 5 shows another Debugging interface schematic diagram provided according to a further embodiment of the invention；
The structure that Fig. 6 shows a kind of adjusting, measuring method device of the processing task provided according to an embodiment of the present invention is shown
It is intended to；
Fig. 7 shows a kind of structural schematic diagram of the calculating equipment provided according to an embodiment of the present invention.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
It is fully disclosed to those skilled in the art.
Fig. 1 shows a kind of process signal of the adjusting, measuring method of the processing task provided according to an embodiment of the present invention
Figure.Processing task in the present invention is the combination of at least one algorithm assembly inputted in pel operation interface based on user
Relationship and create.As shown in Figure 1, this method comprises:
Step S110, monitoring user are directed to the breakpoint insertion operation of any algorithm assembly, and it is disconnected that commissioning is arranged for algorithm assembly
Point.
The present invention carries out modularization processing to business procession, i.e., forms industry by the combination of at least one algorithm assembly
Be engaged in logic, realize business processing without code, promote business processing efficiency, improve user experience.The present embodiment is based on as a result,
The business processing mode of the modularization can realize the fine granularity commissioning of processing task as unit of algorithm assembly, and then can obtain
Take the test data of intermediate node in business procession.
Specifically, during commissioning, the breakpoint insertion operation that user is directed to any algorithm assembly is monitored first.Wherein,
Without limitation to the concrete type of breakpoint insertion operation, those skilled in the art can be according to actual demand self-setting by the present invention
Breakpoint insertion operation.After monitoring breakpoint insertion operation of the user for any algorithm assembly, for algorithm assembly setting
Corresponding commissioning breakpoint.
Step S120, in the implementation procedure of processing task, capture setting has the engine of the algorithm assembly of commissioning breakpoint defeated
Enter data and engine output data.
Business processing set-up mode based on modularization capture setting can have in real time in the implementation procedure of processing task
The engine input data and engine output data of the algorithm assembly of commissioning breakpoint.
Step S130, output engine input data and engine output data, so that user carries out commissioning.
Collected engine input data and engine output data are exported, so that user can be according to output data
Judge whether the setting of the algorithm assembly meets preset need, to rapidly be adjusted to algorithm assembly for user.
It can be seen that business processing is carried out in the present embodiment in the form of algorithm assembly, and by being arranged for algorithm assembly
The mode of commissioning breakpoint takes the engine input data and engine output data of respective algorithms component in task implementation procedure,
The drawbacks of intermediate node test data can not be obtained during to task commissioning so as to avoid the prior art, it is readily available more
For fine granularity and accurate commissioning as a result, and being conducive to the promotion of commissioning efficiency.
Fig. 2 shows a kind of signals of the process of the adjusting, measuring method of the processing task provided according to an embodiment of the present invention
Figure.
Processing task in the present invention is at least one algorithm assembly inputted in pel operation interface based on user
Syntagmatic and create.Specifically, the present invention is that user is provided with pel operation interface, includes in the operation interface
The corresponding algorithm assembly pel of polyalgorithm component, the algorithm assembly pel are corresponding with the algorithm assembly constructed in advance.Wherein,
Algorithm assembly is that the algorithm packaging according to involved in business procession forms, and can be stored in preset algorithm assembly library
In.The algorithm assembly may include fine-grained basic algorithm component, to improve the operation convenience of user, and meet more use
The business processing demand at family.Wherein, which includes extracting class algorithm assembly, conversion class algorithm assembly and/or adding
Carry class algorithm assembly.Extract class algorithm assembly may include MySQL extraction assembly, HDFS extraction assembly and Hive extraction group again
Part；Conversion class algorithm assembly may include filter assemblies, replacement component, sequencing assembly, connection component, polymerizing component, and/or conjunction
And component；Loading classes algorithm assembly includes MySQL charging assembly, HDFS charging assembly and/or Hive charging assembly.Optionally,
The algorithm assembly can also include template algorithm component, which can be the collection of at least one basic algorithm component
It closes, for solving at least one specific business demand.For example, calculating PV (Page in actual business procession
View, page access amount)-UV (Unique Visitor, independent visitor) is usually a common business demand, to avoid user
The repetition compiling of business demand is commonly used to this, it can be based on basic algorithm component needed for calculating PV-UV, Yi Jisuo in the present embodiment
The logical relation between basic algorithm component needed, is encapsulated as PVUV template algorithm component, to be directly realized by by the component
Calculating to PV-UV.Optionally, which can also include custom algorithm component.The custom algorithm component can be by
User voluntarily compiles.Specifically, custom algorithm component can be generated by following steps: firstly, monitoring generates custom algorithm
The trigger action of component obtains user and compiles data according to provided by open system API, generates compiling data packet.Wherein, raw
It can be the clicking operation for default hot-zone, tool of the present invention to the trigger action at the trigger action of custom algorithm component
Body type is without limitation.Also, in compiling data packet generating process, system is provided at least one Compilation Method, the compiling
Method may include initial method, execution method and/or output method etc..The Compilation Method is to the primary of computing engines
The further encapsulation of interface, user can be compiled by least one Compilation Method of open system API to offer, to keep away
Exempt from user and certain unfavorable operations directly are carried out to the native interface of computing engines.So compiling data packet is specifically according to user
It is obtained by compilation operations of the open system API at least one Compilation Method of offer.Further, compiling data are being generated
After packet, by each processor of the compiling packet delivery to cluster, for using the custom algorithm component subsequent
When, call corresponding compiling data packet efficiently to be executed according to the path for the custom algorithm component Configuration.Further
It optionally, can also be the corresponding authority information of custom algorithm component Configuration after generating custom algorithm component, thus
Only in the matched situation of authority information of user identity and custom algorithm component, user is allowed to select custom algorithm component
Pel.
User can be selected by pel operation interface algorithm assembly pel and editing operation, then can be according to user
Selection and editing operation at least one algorithm assembly pel generate corresponding pel layout figure, and according to pel layout figure
Determine at least one corresponding algorithm assembly of pel layout figure and the syntagmatic of at least one algorithm assembly.
User can also input corresponding business scenario configuration information by the default input entrance in pel operation interface.
Wherein, business scenario configuration information includes business description information, data source information and computing engines information.Optionally, business
Scene configuration information can be presented in the form of json etc..
For example, pel operation interface as shown in Figure 3 includes in the 3-1 of region in the pel operation interface
There is polyalgorithm component pel, specifically, multiple algorithm assembly pel includes: basic algorithm component pel, template algorithm group
Part pel and custom algorithm component pel.The algorithm assembly in each component pel and system provided in pel operation interface
It is corresponding.Wherein, basic algorithm component pel includes: to extract class component pel, conversion class component pel and/or load class component
Pel.Extract class algorithm assembly pel may include that MySQL extraction assembly pel, HDFS extraction assembly pel and Hive are extracted again
Component pel；Conversion class algorithm assembly pel may include filter assemblies pel, replacement component pel, sequencing assembly pel, connect
Connected components pel, polymerizing component pel, and/or combining block pel；Loading classes algorithm assembly pel includes MySQL charging assembly
Pel, HDFS charging assembly pel and/or Hive charging assembly pel.Template algorithm in pel operation interface shown in Fig. 3
Component pel is PVUV template component pel.User can drag selection Hive extraction assembly pel, replacement component pel, PVUV mould
Board group part pel and MySQL charging assembly pel into region 3-2, user by Hive extraction assembly pel, replacement component drawings
In member, PVUV template component pel and MySQL charging assembly pel to region 3-2, that is, show that user has selected business processing institute
The algorithm assembly needed, i.e. Hive extraction assembly, replacement component, PVUV template component and MySQL charging assembly.Also, works as and selecting
In a certain selection algorithm assembly pel after, the business scenario configuration information for the algorithm assembly can be inputted, such as chosen
After Hive extraction assembly pel, the business scenario configuration information for Hive extraction assembly pel can be inputted in the 3-3 of region.
Further, since the optimal execution that the syntagmatic of at least one algorithm assembly is not business procession is patrolled
Volume, the execution of each algorithm assembly is directly carried out according to the syntagmatic of at least one algorithm assembly, easily business is caused to execute effect
The reduction of rate.So to further increase business processing efficiency, the present embodiment is closed in the combination for obtaining at least one algorithm assembly
After system, the syntagmatic of at least one algorithm assembly is parsed, obtains the corresponding service logic topology of at least one algorithm assembly
Relationship.Specifically, the syntagmatic for parsing at least one algorithm assembly of the forward direction sing data structure of acquisition, at least one calculation
Method component carries out topological sorting, obtains the corresponding service logic topology of at least one algorithm assembly according to topological sorting result and closes
System.Wherein, forward direction star belongs to one kind in DAG (Directed Acyclic Graph, directed acyclic graph), is one kind to store up
The mode on side is deposited to store the data structure of figure, without being directed toward lower a line with pointer as adjacency list, consequently facilitating mentioning
High business processing efficiency.The present embodiment to specific topological sorting method without limitation, for example, the AOE in DAG can be used
(Activity On Edge Network) algorithm carries out topological sorting.Here, it will be apparent to a skilled person that
The processing result of business processing is carried out according to service logic topological relation and directly according to the combination pass of at least one algorithm assembly
The processing result that system carries out business processing is identical, to promote business processing in the case where guaranteeing the identical situation of service processing result
Efficiency.For example, if the algorithm assembly of user's input has component A, B and C, the syntagmatic of component A, B and C of input are A
The ordinal relation of → B → C, however, by the data dependence relation between resolution component A, B and C and executing sequential dependency
It finding later, component A and component B is simultaneously not present data dependence and executes order dependent, i.e. component A and component B can be executed parallel,
Then service logic topological relation can be A → C ← B, can be had based on this service logic topological relation progress business processing higher
Treatment effeciency.
Further, task is handled according to business scenario configuration information and service logic topological relation creation.Specifically,
It is the execution for being converted at least one processing task by business procession, thus just by the execution of the processing task to creation
The processing to business can be achieved.Specifically, during creating processing task, by the preset kind of user's input in this step
The business scenario configuration information combination service logic topological relation of (such as json type) is created that the processing for engine identification is appointed
Information of being engaged in executes processing task for engine so that the processing mission bit stream is transferred to engine.
Finally, corresponding computing engines is called to execute processing task.Wherein, computing engines can be multiple, as Spark draws
It holds up, Flink engine, and/or Hive engine etc..It optionally, is the treatment effeciency of support mission and the accuracy of processing result,
Before computing engines formally execute processing task, the initialization of running environment can be carried out previously according to business scenario configuration information
Processing.Wherein, the present embodiment to specific init processing method without limitation.
In a kind of optional embodiment, after creating processing task, to keep reason task everywhere in creation orderly
It is effectively carried out, the processing task that can further create is scheduled processing, and corresponding computing engines is called to execute processing task.
Optionally, in scheduling process, place is not scheduled to postposition task when previous task does not complete to save scheduling resource
Reason only carries out the execution of postposition task after previous task processing is completed.
Summarize in another optional embodiment, during computing engines execute processing task, can acquire and deposit
Store up the engine output data of each algorithm assembly.For example, during computing engines execute processing task, gathering algorithm component
The engine output data of A, and the engine output data of algorithm assembly A is stored in default memory space, if computation module B number
According to algorithm assembly A is depended on, then in the processing task of execution computation module B, then the acquisition algorithm group from default memory space
The engine output data of part A executes processing task.It is further alternative, it can also be stored in default memory space defeated with engine
The corresponding source data of data out, to meet the data adaptation demand of different computing engines.Specifically, due to different meters
Data format needed for calculating engine etc. is not quite similar, and when same data circulate in different computing engines, need to be converted to corresponding
Engine data format, so that active data and corresponding engine data need to be carried during computing engines execute processing task
Two class data, thus increase the storage overhead of computing engines, and the present invention is then to be stored in source data and engine output data
In default memory space, is preset when computing engines need to obtain data from this and obtain corresponding data in memory space, to save
Province's system storage overhead.
In another optional embodiment, to realize business rule during handling task execution and executing logic
Decoupling, the present embodiment can also execute processing task by means of regulation engine.Specifically, rule base is constructed first, i.e., to obtaining
The regular data taken carries out syntactic verification, wherein regular data includes that rule condition data and rule condition data are corresponding
Rules results data；If regular data syntactic verification is qualified, regular data is stored in default rule library, then it is preset
It include at least one regular data in rule base；After constructing rule base, processing task data is obtained, number of tasks will be handled
It is matched according to at least one rule condition data in default rule library, what the determining and processing task data matched
Goal rule condition data；Rules results data corresponding with goal rule condition data are determined as and the processing number of tasks
According to corresponding processing result.It optionally, can be by least one rule condition in default rule library during rule match
Data are converted to the rule set of default tree structure (such as RETE tree structure), thus according to the rule set of default tree structure,
Determine the goal rule condition data to match with processing task data.It is further alternative, when determination and pending data phase
When matched goal rule condition data is a plurality of, then need to determine that pending data is corresponding using preset conflict resolution algorithm
Processing result.Wherein, preset collision algorithm can be PRI conflict solution annual reporting law, such as agenda conflict resolution algorithm
Deng.Optionally, corresponding access authority can be configured for each rule in rule set, thus according to access authority to processing task
Data carry out rule match.
After creating processing task, it can come to carry out commissioning to processing task by the following method:
Step S210, monitoring user are directed to the breakpoint insertion operation of any algorithm assembly, and it is disconnected that commissioning is arranged for algorithm assembly
Point.
Business processing mode of the present embodiment based on said modules is realized so can support as unit of algorithm assembly
The fine granularity commissioning of processing task, and then the test data of intermediate node in business procession can be obtained.
In the specific implementation process, a commissioning operation interface intuitively changed can be provided for user, presented in the interface
There is the corresponding algorithm assembly pel of at least one algorithm assembly, then can monitor user in the commissioning operation interface for presentation
Commissioning breakpoint is arranged for algorithm assembly in the breakpoint insertion operation of any algorithm assembly.
For example, commissioning interface as shown in Figure 4 presents Hive extraction assembly and HDFS in the commissioning interface
If monitor that user is directed to the clicking operation of HDFS charging assembly corresponding breakpoint option is presented, if user in charging assembly
Insertion breakpoint is clicked, then is carried in HDFS and commissioning breakpoint is set at component.
Optionally, it can further receive and be operated according to the modification that user is directed to the breakpoint being inserted into, be adjusted to algorithm groups
The commissioning breakpoint of part setting.To increase user's operation flexibility ratio, user experience is promoted.
Step S220, in the implementation procedure of processing task, capture setting has the engine of the algorithm assembly of commissioning breakpoint defeated
Enter data and engine output data.
Wherein, engine output data can be processing task result data, daily record data etc. in real time.Optionally, if
When the engine input data and larger engine output data data volume of acquisition, in a distributed fashion storage engines input data and
Engine output data.
The engine input data and engine output data of acquisition are presented from least one dimension by step S230.
After capture setting has the engine input data and engine output data of the algorithm assembly of commissioning breakpoint, Ke Yicong
The engine input data and engine output data of acquisition is presented at least one dimension, so that user adjusts according to the data of presentation
It surveys.
Wherein, at least one dimension includes time dimension, test data ratio dimension, and/or commissioning result dimension.User
Corresponding dimension can be selected according to self-demand, or further the dimension of selection is configured, to realize customization data
It presents.For example, as shown in figure 5, the test data ratio of user setting is 10%, data show that item number is 50, commissioning
It as a result is to run successfully.
It can be seen that business processing is carried out in the present embodiment in the form of algorithm assembly, and by being arranged for algorithm assembly
The mode of commissioning breakpoint takes the engine input data and engine output data of respective algorithms component in task implementation procedure,
The drawbacks of intermediate node test data can not be obtained during to task commissioning so as to avoid the prior art, it is readily available more
For fine granularity and accurate commissioning as a result, and being conducive to the promotion of commissioning efficiency；And it can be selected according to user from least one dimension
Test data is presented in degree, further promotes user experience.
Fig. 6 shows a kind of structural representation of the debugging apparatus of the processing task provided according to an embodiment of the present invention
Figure.The syntagmatic at least one algorithm assembly that the processing task is inputted in pel operation interface based on user and create
It builds.As shown in fig. 6, the device includes: breakpoint setup module 61, data acquisition module 62 and output module 63.
Breakpoint setup module 61, the breakpoint insertion operation for being directed to any algorithm assembly suitable for monitoring user are the algorithm
Commissioning breakpoint is arranged in component；
Data acquisition module 62, suitable in the implementation procedure of the processing task, capture setting has the calculation of commissioning breakpoint
The engine input data and engine output data of method component；
Output module 63 is suitable for exporting the engine input data and engine output data, so that user carries out commissioning.
Optionally, device further include: module (not shown) is presented, suitable for output is presented from least one dimension
The engine input data and engine output data.
Optionally, at least one described dimension includes: time dimension, test data ratio dimension, and/or debugging result dimension
Degree.
Optionally, device further include: modified module (not shown) has been inserted into suitable for receiving and being directed to according to user
Breakpoint modification operation, be adjusted to algorithm assembly setting commissioning breakpoint.
Optionally, at least one algorithm assembly that the processing task is inputted in pel operation interface based on user
Syntagmatic and create and further comprise: parse the syntagmatic of at least one algorithm assembly, obtain at least one described algorithm
The corresponding service logic topological relation of component；According to the business scenario configuration information and institute inputted by pel operation interface
State service logic topological relation creation processing task.
Wherein, the specific implementation process of each module can refer in Fig. 1 or embodiment illustrated in fig. 2 accordingly in the present embodiment device
The description of step, this will not be repeated here for the present embodiment.
It can be seen that business processing is carried out in the present embodiment in the form of algorithm assembly, and by being arranged for algorithm assembly
The mode of commissioning breakpoint takes the engine input data and engine output data of respective algorithms component in task implementation procedure,
The drawbacks of intermediate node test data can not be obtained during to task commissioning so as to avoid the prior art, it is readily available more
For fine granularity and accurate commissioning as a result, and being conducive to the promotion of commissioning efficiency.
A kind of nonvolatile computer storage media is provided according to an embodiment of the present invention, and the computer storage is situated between
Matter is stored with an at least executable instruction, which can be performed the processing in above-mentioned any means embodiment and appoint
The adjusting, measuring method of business.
Fig. 7 shows a kind of structural schematic diagram of the calculating equipment provided according to an embodiment of the present invention, present invention tool
Body embodiment does not limit the specific implementation for calculating equipment.The calculating equipment is used to execute processing task adjusting, measuring method,
The processing task is the syntagmatic of at least one algorithm assembly inputted in pel operation interface based on user and created
It builds.
As shown in fig. 7, the terminal may include: processor (processor) 702, communication interface (Communications
Interface) 704, memory (memory) 706 and communication bus 708.
Wherein:
Processor 702, communication interface 704 and memory 706 complete mutual communication by communication bus 708.
Communication interface 704, for being communicated with the network element of other equipment such as client or other servers etc..
Processor 702, for executing program 710, in the adjusting, measuring method embodiment that can specifically execute above-mentioned processing task
Correlation step.
Specifically, program 710 may include program code, which includes computer operation instruction.
Processor 702 may be central processor CPU or specific integrated circuit ASIC (Application
Specific Integrated Circuit), or be arranged to implement the integrated electricity of one or more of the embodiment of the present invention
Road.The one or more processors that equipment includes are calculated, can be same type of processor, such as one or more CPU；It can also
To be different types of processor, such as one or more CPU and one or more ASIC.
Memory 706, for storing program 710.Memory 706 may include high speed RAM memory, it is also possible to further include
Nonvolatile memory (non-volatile memory), for example, at least a magnetic disk storage.
Program 710 specifically can be used for so that processor 702 executes following operation:
The breakpoint insertion operation that user is directed to any algorithm assembly is monitored, commissioning breakpoint is set for the algorithm assembly；
In the implementation procedure of the processing task, capture setting has the engine input data of the algorithm assembly of commissioning breakpoint
With engine output data；
The engine input data and engine output data are exported, so that user carries out commissioning.
In a kind of optional embodiment, program 710 specifically can be used for so that processor 702 executes following operation:
The engine input data and engine output data of output are presented from least one dimension.
In a kind of optional embodiment, at least one described dimension includes: time dimension, test data scale dimension
Degree, and/or debugging result dimension.
In a kind of optional embodiment, program 710 specifically can be used for so that processor 702 executes following operation:
It receives and is operated according to the modification that user is directed to the breakpoint being inserted into, be adjusted to the commissioning breakpoint of algorithm assembly setting.
In a kind of optional embodiment, program 710 specifically can be used for so that processor 702 executes following operation:
The syntagmatic for parsing at least one algorithm assembly obtains the corresponding service logic of at least one described algorithm assembly
Topological relation；
According to the business scenario configuration information and the service logic topological relation inputted by pel operation interface
Create processing task.
Algorithm and display are not inherently related to any particular computer, virtual system, or other device provided herein.
Various general-purpose systems can also be used together with teachings based herein.As described above, it constructs required by this kind of system
Structure be obvious.In addition, the present invention is also not directed to any particular programming language.It should be understood that can use various
Programming language realizes summary of the invention described herein, and the description done above to language-specific is to disclose this hair
Bright preferred forms.
In the instructions provided here, numerous specific details are set forth.It is to be appreciated, however, that implementation of the invention
Example can be practiced without these specific details.In some instances, well known method, structure is not been shown in detail
And technology, so as not to obscure the understanding of this specification.
Similarly, it should be understood that in order to simplify the disclosure and help to understand one or more of the various inventive aspects,
Above in the description of exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes
In example, figure or descriptions thereof.However, the disclosed method should not be interpreted as reflecting the following intention: i.e. required to protect
Shield the present invention claims features more more than feature expressly recited in each claim.More precisely, as following
Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore,
Thus the claims for following specific embodiment are expressly incorporated in the specific embodiment, wherein each claim itself
All as a separate embodiment of the present invention.
Those skilled in the art will understand that can be carried out adaptively to the module in the equipment in embodiment
Change and they are arranged in one or more devices different from this embodiment.It can be the module or list in embodiment
Member or component are combined into a module or unit or component, and furthermore they can be divided into multiple submodule or subelement or
Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it can use any
Combination is to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so disclosed
All process or units of what method or apparatus are combined.Unless expressly stated otherwise, this specification is (including adjoint power
Benefit require, abstract and attached drawing) disclosed in each feature can carry out generation with an alternative feature that provides the same, equivalent, or similar purpose
It replaces.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments
In included certain features rather than other feature, but the combination of the feature of different embodiments mean it is of the invention
Within the scope of and form different embodiments.For example, in detail in the claims, embodiment claimed it is one of any
Can in any combination mode come using.
Various component embodiments of the invention can be implemented in hardware, or to run on one or more processors
Software module realize, or be implemented in a combination thereof.It will be understood by those of skill in the art that can be used in practice
One in the device for adjusting and measuring of microprocessor or digital signal processor (DSP) to realize processing task according to embodiments of the present invention
The some or all functions of a little or whole components.The present invention is also implemented as executing method as described herein
Some or all device or device programs (for example, computer program and computer program product).Such realization
Program of the invention can store on a computer-readable medium, or may be in the form of one or more signals.This
The signal of sample can be downloaded from an internet website to obtain, and is perhaps provided on the carrier signal or mentions in any other forms
For.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and ability
Field technique personnel can be designed alternative embodiment without departing from the scope of the appended claims.In the claims,
Any reference symbol between parentheses should not be configured to limitations on claims.Word "comprising" does not exclude the presence of not
Element or step listed in the claims.Word "a" or "an" located in front of the element does not exclude the presence of multiple such
Element.The present invention can be by means of including the hardware of several different elements and being come by means of properly programmed computer real
It is existing.In the unit claims listing several devices, several in these devices can be through the same hardware branch
To embody.The use of word first, second, and third does not indicate any sequence.These words can be explained and be run after fame
Claim.
The invention discloses: a kind of adjusting, measuring method of processing task of A1., the processing task are based on user and grasp in pelization
Make the syntagmatic of at least one algorithm assembly inputted in interface and create, which comprises
The breakpoint insertion operation that user is directed to any algorithm assembly is monitored, commissioning breakpoint is set for the algorithm assembly；
In the implementation procedure of the processing task, capture setting has the engine input data of the algorithm assembly of commissioning breakpoint
With engine output data；
The engine input data and engine output data are exported, so that user carries out commissioning.
A2. method according to a1, wherein the method also includes:
The engine input data and engine output data of output are presented from least one dimension.
A3. the method according to A2, wherein at least one described dimension includes: time dimension, test data scale dimension
Degree, and/or debugging result dimension.
A4. the method according to any one of A1-A3, wherein the method also includes:
It receives and is operated according to the modification that user is directed to the breakpoint being inserted into, the commissioning for being adjusted to algorithm assembly setting is disconnected
Point.
A5. the method according to any one of A1-A4, wherein the processing task is based on user and operates in pelization
The syntagmatic of at least one algorithm assembly inputted in interface and create and further comprise:
The syntagmatic for parsing at least one algorithm assembly obtains the corresponding service logic of at least one described algorithm assembly
Topological relation；
According to the business scenario configuration information and the service logic topological relation inputted by pel operation interface
Create processing task.
The invention also discloses: a kind of device for adjusting and measuring of processing task of B6., the processing task are based on user in pel
The syntagmatic of at least one algorithm assembly inputted in operation interface and create, described device includes:
Breakpoint setup module, the breakpoint insertion operation for being directed to any algorithm assembly suitable for monitoring user are the algorithm groups
Commissioning breakpoint is arranged in part；
Data acquisition module, suitable in the implementation procedure of the processing task, capture setting has the algorithm of commissioning breakpoint
The engine input data and engine output data of component；
Output module is suitable for exporting the engine input data and engine output data, so that user carries out commissioning.
B7. the device according to B6, wherein described device further include:
Module is presented, suitable for the engine input data and engine output data of output are presented from least one dimension.
B8. the device according to B7, wherein at least one described dimension includes: time dimension, test data scale dimension
Degree, and/or debugging result dimension.
B9. the device according to any one of B6-B8, wherein described device further include:
Modified module is adjusted to algorithm assembly suitable for receiving and operating according to the modification that user is directed to the breakpoint being inserted into
The commissioning breakpoint of setting.
B10. the device according to any one of B6-B9, wherein the processing task is based on user and operates in pelization
The syntagmatic of at least one algorithm assembly inputted in interface and create and further comprise:
The syntagmatic for parsing at least one algorithm assembly obtains the corresponding service logic of at least one described algorithm assembly
Topological relation；
According to the business scenario configuration information and the service logic topological relation inputted by pel operation interface
Create processing task.
The invention also discloses: a kind of calculating equipment of C11., comprising: processor, memory, communication interface and communication are total
Line, the processor, the memory and the communication interface complete mutual communication by the communication bus；
The memory executes the processor such as storing an at least executable instruction, the executable instruction
The corresponding operation of the adjusting, measuring method of processing task described in any one of A1-A5.
The invention also discloses a kind of computer storage medium of D12., being stored at least one in the storage medium can be held
Row instruction, the adjusting, measuring method that the executable instruction makes processor execute the processing task as described in any one of A1-A5 correspond to
Operation.
Claims (10)
1. a kind of adjusting, measuring method of processing task, the processing task are inputted at least in pel operation interface based on user
The syntagmatic of one algorithm assembly and create, which comprises
The breakpoint insertion operation that user is directed to any algorithm assembly is monitored, commissioning breakpoint is set for the algorithm assembly；
In the implementation procedure of the processing task, capture setting has the engine input data of the algorithm assembly of commissioning breakpoint and draws
Hold up output data；
The engine input data and engine output data are exported, so that user carries out commissioning.
2. according to the method described in claim 1, wherein, the method also includes:
The engine input data and engine output data of output are presented from least one dimension.
3. according to the method described in claim 2, wherein, at least one described dimension includes: time dimension, test data ratio
Dimension, and/or debugging result dimension.
4. method according to any one of claim 1-3, wherein the method also includes:
It receives and is operated according to the modification that user is directed to the breakpoint being inserted into, be adjusted to the commissioning breakpoint of algorithm assembly setting.
5. method according to any of claims 1-4, wherein the processing task is based on user and operates in pelization
The syntagmatic of at least one algorithm assembly inputted in interface and create and further comprise:
The syntagmatic for parsing at least one algorithm assembly obtains the corresponding service logic topology of at least one described algorithm assembly
Relationship；
According to the business scenario configuration information inputted by pel operation interface and service logic topological relation creation
Processing task.
6. a kind of device for adjusting and measuring of processing task, the processing task are inputted at least in pel operation interface based on user
The syntagmatic of one algorithm assembly and create, described device includes:
Breakpoint setup module, the breakpoint insertion operation for being directed to any algorithm assembly suitable for monitoring user, sets for the algorithm assembly
Set commissioning breakpoint；
Data acquisition module, suitable in the implementation procedure of the processing task, capture setting has the algorithm assembly of commissioning breakpoint
Engine input data and engine output data；
Output module is suitable for exporting the engine input data and engine output data, so that user carries out commissioning.
7. device according to claim 6, wherein described device further include:
Module is presented, suitable for the engine input data and engine output data of output are presented from least one dimension.
8. device according to claim 7, wherein at least one described dimension includes: time dimension, test data ratio
Dimension, and/or debugging result dimension.
9. a kind of calculating equipment, comprising: processor, memory, communication interface and communication bus, the processor, the storage
Device and the communication interface complete mutual communication by the communication bus；
The memory executes the processor as right is wanted for storing an at least executable instruction, the executable instruction
Ask the corresponding operation of the adjusting, measuring method of processing task described in any one of 1-5.
10. a kind of computer storage medium, an at least executable instruction, the executable instruction are stored in the storage medium
Processor is set to execute the corresponding operation of adjusting, measuring method of processing task according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811243279.0A CN109117381A (en) | 2018-10-24 | 2018-10-24 | The adjusting, measuring method and device of processing task |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811243279.0A CN109117381A (en) | 2018-10-24 | 2018-10-24 | The adjusting, measuring method and device of processing task |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109117381A true CN109117381A (en) | 2019-01-01 |
Family
ID=64855132
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811243279.0A Pending CN109117381A (en) | 2018-10-24 | 2018-10-24 | The adjusting, measuring method and device of processing task |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109117381A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113254350A (en) * | 2021-06-23 | 2021-08-13 | 深信服科技股份有限公司 | Flink operation testing method, device, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040268183A1 (en) * | 2003-06-20 | 2004-12-30 | Haselden J. Kirk | Debugging breakpoints on pluggable components |
| US20130179860A1 (en) * | 2008-12-08 | 2013-07-11 | Adobe Systems Incorporated | Graphical Event and Binding Editor for Software Development |
| CN106775749A (en) * | 2016-12-29 | 2017-05-31 | 东软集团股份有限公司 | The processing method and processing device of image |
| US20180267882A1 (en) * | 2017-03-20 | 2018-09-20 | Microsoft Technology Licensing, Llc | Enabling breakpoints on entire data structures |
-
2018
- 2018-10-24 CN CN201811243279.0A patent/CN109117381A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040268183A1 (en) * | 2003-06-20 | 2004-12-30 | Haselden J. Kirk | Debugging breakpoints on pluggable components |
| US20130179860A1 (en) * | 2008-12-08 | 2013-07-11 | Adobe Systems Incorporated | Graphical Event and Binding Editor for Software Development |
| CN106775749A (en) * | 2016-12-29 | 2017-05-31 | 东软集团股份有限公司 | The processing method and processing device of image |
| US20180267882A1 (en) * | 2017-03-20 | 2018-09-20 | Microsoft Technology Licensing, Llc | Enabling breakpoints on entire data structures |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113254350A (en) * | 2021-06-23 | 2021-08-13 | 深信服科技股份有限公司 | Flink operation testing method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109324793A (en) | Processing system and method supporting algorithm componentization | |
| CN109445774A (en) | Method for processing business and device based on pelization operation | |
| CN109445797A (en) | Handle task executing method and device | |
| US20210182036A1 (en) | Hardware platform specific operator fusion in machine learning | |
| CN109791492B (en) | Pipeline dependency tree query optimizer and scheduler | |
| CN110944048B (en) | Service logic configuration method and device | |
| US20160259023A1 (en) | Pipeline engine for specifying, visualizing, and analyzing mri image reconstructions | |
| CN112394942A (en) | Distributed software development compiling method and software development platform based on cloud computing | |
| CN108089982B (en) | Test method, test device, electronic equipment and computer readable storage medium | |
| EP1548581A2 (en) | Methods, apparatus and programs for system development | |
| US9396095B2 (en) | Software verification | |
| CN110019207A (en) | Data processing method and device and script display methods and device | |
| CN109343856A (en) | Method and device for generating custom algorithm components | |
| Kreitz et al. | A proof environment for the development of group communication systems | |
| CN113806231A (en) | Code coverage rate analysis method, device, equipment and medium | |
| CN113254350A (en) | Flink operation testing method, device, equipment and storage medium | |
| CN117743145A (en) | Test script generation method and device based on coding template and processing equipment | |
| Menzel et al. | A configuration crawler for virtual appliances in compute clouds | |
| Sokolowski et al. | Leveraging hybrid cloud hpc with multitier reactive programming | |
| CN109117381A (en) | The adjusting, measuring method and device of processing task | |
| CN118113587A (en) | Equivalence verification method and device | |
| CN110895460A (en) | Jenkins-based robot system integration method and device and terminal equipment | |
| CN111767219A (en) | Method and device for checking intelligent customer service conversation process | |
| CN107818501B (en) | Actuarial method and device | |
| CN112418930B (en) | Test method, system and computer equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190101 |
|
| RJ01 | Rejection of invention patent application after publication |