CN105637812A - Systems and methods for automated chat detection - Google Patents
Systems and methods for automated chat detection Download PDFInfo
- Publication number
- CN105637812A CN105637812A CN201480048931.7A CN201480048931A CN105637812A CN 105637812 A CN105637812 A CN 105637812A CN 201480048931 A CN201480048931 A CN 201480048931A CN 105637812 A CN105637812 A CN 105637812A
- Authority
- CN
- China
- Prior art keywords
- detection
- chat
- contact center
- data
- agent
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/02—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
- H04L12/1827—Network arrangements for conference optimisation or adaptation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/64—Hybrid switching systems
- H04L12/6418—Hybrid transport
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Debugging And Monitoring (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
相关申请的交叉引用Cross References to Related Applications
本申请是于2014年12月27日提交的题为“用于自动化的聊天检测的系统和方法”的美国专利申请序列号14/141,424的PCT申请并且要求其优先权,该申请(14/141,424)是于2013年7月6日提交的题为“用于自动化的聊天检测的系统和方法”的美国专利申请序列号13/936,186的继续申请,该申请(13/936,186)是于2013年12月24提交的题为“用于自动化的聊天检测的系统和方法”的美国专利申请序列号14/140,449的部分继续申请,该申请(14/140,449)是于2013年7月6日提交的题为“用于自动化的聊天检测的系统和方法”的13/936,147的继续申请,并且是于2009年12月22日提交的题为“用于联络中心的集成检测平台”的美国专利申请序列号12/644,343的部分继续申请,并且是于2012年8月6日提交的题为“用于语音生物识别系统环境下的说话者认证的自动化的修改以及改进的系统和方法”的美国专利申请序列号13/567,089的部分继续申请,每份申请的说明书通过引用的方式全部并入本申请中。本申请还要求于2013年12月25日提交的题为“用于自动化的语音质量检测的系统和方法”的美国专利申请序列号14/140,470的优先权,该申请(14/140,470)是于2013年7月6日提交的题为“用于自动化的语音质量检测的系统和方法”的13/936,183的继续申请,该申请(13/936,183)是于2009年12月22日提交的题为“用于联络中心的集成检测平台”的美国专利序列号12/644,343的部分继续申请,并且是于2012年8月6日提交的题为“用于语音生物识别系统环境下的说话者认证的自动化的修改以及改进的系统和方法”的美国专利申请序列号13/567,089的部分继续申请,每份申请的整个说明书通过引用的方式全部并入本申请中。This application is and claims priority from PCT Application Serial No. 14/141,424, filed December 27, 2014, entitled "System and Method for Automated Chat Detection," which application (14/141,424 ) is a continuation of U.S. Patent Application Serial No. 13/936,186, filed July 6, 2013, entitled "System and Method for Automated Chat Detection," which application (13/936,186) was filed on December 2013 A continuation-in-part of U.S. Patent Application Serial No. 14/140,449, filed July 24, 2013, entitled "System and Method for Automated Chat Detection" Continuation of 13/936,147 for "System and Method for Automated Chat Detection," and serial number of U.S. Patent Application entitled "Integrated Detection Platform for Contact Centers," filed December 22, 2009 12/644,343, and is a continuation-in-part of U.S. Patent Application Serial, entitled "Modified and Improved Systems and Methods for Automated Speaker Authentication in the Context of Voice Biometric Recognition Systems," filed August 6, 2012 13/567,089 continuation-in-part, the specification of each application is hereby incorporated by reference in its entirety. This application also claims priority to U.S. Patent Application Serial No. 14/140,470, filed December 25, 2013, entitled "System and Method for Automated Speech Quality Detection," which application (14/140,470) was filed on Continuation of 13/936,183, filed July 6, 2013, entitled "Systems and Methods for Automated Speech Quality Detection," which was filed on December 22, 2009, and entitled Continuation-in-Part of U.S. Patent Serial No. 12/644,343 for "Integrated Detection Platform for Contact Centers," and filed on August 6, 2012, entitled "Speaker Authentication for the Context of a Voice Biometric System Modified and Improved Systems and Methods for Automation," a continuation-in-part of US Patent Application Serial No. 13/567,089, the entire specification of each application is hereby incorporated by reference in its entirety.
背景技术Background technique
技术领域technical field
本发明涉及联络中心运行的领域,并且更具体地讲,涉及基于聊天的客户端交互软件系统的自动化检测的领域。The present invention relates to the field of contact center operations, and more particularly, to the field of automated detection of chat-based client interaction software systems.
现有技术current technology
在联络中心运行领域,传统上,代理者与客户之间的通信通过基于语音的系统进行,例如,传统电话或网络电话(VoIP)系统。然而,更多中心开始提供额外的基于文本的通信,例如,现有技术中常见的基于互联网的聊天软件,以更好地服务可能不能够或不希望利用语音连接的客户。这方面的常见实例是通过公司网站的在线目录浏览的客户。在这种情况下,客户可能对产品有疑问,并且客户和公司双方可以从网页内包括便捷的聊天界面而受益,从而允许客户在方便地从他们的电脑上浏览在线目录的同时与代理者进行直接通信。这允许更便捷且高速的通信,而不需要使用基于电话的交互式语音识别(IVR)系统来联系代理者或者排长队来等待代理者变得空闲。这还允许更灵活的通信,例如,可能在网络咖啡屋或类似公共场所浏览在线目录的客户,他们在这种地方可能无法使用电话或者可能不希望别人听到他们的交谈。In the field of contact center operations, communication between agents and customers has traditionally been conducted through voice-based systems, such as traditional telephones or Voice over Internet Protocol (VoIP) systems. However, more centers are beginning to offer additional text-based communications, such as Internet-based chat software common in the prior art, to better serve customers who may not be able or wish to utilize voice connections. A common example of this is a customer browsing through a company website's online directory. In this case, the customer may have questions about the product, and both the customer and the company would benefit from including a convenient chat interface within the web page, allowing the customer to chat with the agent while browsing the online catalog from the convenience of their computer. direct communication. This allows for more convenient and high-speed communication without the need to use a phone-based Interactive Voice Recognition (IVR) system to contact an agent or wait in long lines waiting for an agent to become available. This also allows for more flexible communications, for example, customers who may be browsing an online catalog at an Internet cafe or similar public place where they may not have access to a phone or may not want others to hear their conversations.
根据联络中心方法的这种变化,将明白的是,需要检测并评估基于聊天的系统以确保联络中心的可靠运行并且解决可能影响客户交互的问题,例如,冻结的聊天会话或文本传输延迟。应当理解,这种检测系统也应当适应各种端点,例如,嵌入网页中的聊天界面,运行在个人计算机上的专用聊天软件或移动聊天应用,而不影响检测结果的可靠性并且不要求人为交互或修改。From this change in contact center approach, it will become apparent that chat-based systems need to be tested and evaluated to ensure reliable contact center operation and to resolve issues that may affect customer interactions, such as frozen chat sessions or text transmission delays. It should be understood that such a detection system should also accommodate various endpoints, such as a chat interface embedded in a web page, a dedicated chat software or a mobile chat application running on a personal computer, without affecting the reliability of the detection results and requiring no human interaction or modify.
现有技术中存在用于语音通信的检测方法,但是应当理解,这些方法不能很好地转化到基于文本的系统。此外,尽管存在当前现有技术中实施了聊天检测系统,但是这些系统要求检测代理者交互以运行,这引入新的问题,例如检测中涉及的时间和人力的额外费用,可能影响检测协议的可靠性的人为错误因素以及与人为操作相关的各种不一致。Detection methods for voice communications exist in the prior art, but it should be understood that these methods do not translate well to text-based systems. Furthermore, although there are chat detection systems implemented in the current state of the art, these systems require detection agents to interact in order to function, which introduces new issues such as additional costs of time and manpower involved in detection, which may affect the reliability of the detection protocol. factors of human error and various inconsistencies associated with human operations.
需要一种用于基于聊天的通信的灵活的且可扩展的自动化的检测方案,该方案可以与生产环境并行运行,而不影响正在进行的客户交互,并且可以在未不利地影响检测可靠性的情况下适应各种端点和基础设施实施。There is a need for a flexible and scalable automated detection scheme for chat-based communications that can run in parallel to a production environment without affecting ongoing customer interactions and without adversely affecting detection reliability. Cases accommodate a variety of endpoint and infrastructure implementations.
发明内容Contents of the invention
因此,发明人在本发明的优选实施例中已经设想到并付诸实践一种用于自动化的聊天检测的方法以及用于实施这种方法的优选系统,所述方法并不依赖于具体的聊天软件或端点,并且是可扩展的以适应各种实施架构。Accordingly, the inventors have conceived and put into practice in a preferred embodiment of the present invention a method for automated chat detection and a preferred system for implementing such a method, said method not being dependent on a specific chat software or endpoints, and is extensible to accommodate various implementation architectures.
根据本发明的优选实施例,公开了一种用于处理联络中心自动化的聊天检测的系统,包括检测案例管理(TCM)平台、“聊天处理系统(chatcruncher)”、联络中心管理器(CCM)、聊天分类器和桌面自动化引擎(DAE)。根据实施例,TCM平台可以呈现基于网络的图形用户界面用于建立并管理检测案例并查看结果报告,如图6和图7详细地图示。这些功能可以允许用户输入附加检测协议、查看在先检测的结果、在检测被运行用于实时分析时查看检测以及运行检测结果报告(诸如例如,为了备份目的,选择具体的报告并将它们输出到数据库或其他存储介质)。根据实施例的“聊天处理系统”可以处理检测案例的加载和执行,包括(但不限于)以下功能,例如,生成模拟客户流量并且检测用于客户体验的各种聊天端点(诸如例如,网页中的嵌入式聊天界面)并且通过改变生成的流量来处理负载检测的自动化。CCM系统可以模拟代理者活动并且执行有关来自聊天处理系统的模拟客户流量的联络中心功能,并且可以通过直接运行由联络中心利用的聊天服务器来复制实际代理者活动,从而还包含对现有的中心架构的检测,例如,聊天服务器、CTI服务器或其他内部部件。应当理解,这些实施方式不依赖于任何特定的现有部件或构造,因此便于扩展成各种联络中心基础设施。根据实施例可以实施聊天分类器以根据它们的性质将聊天交互分成检测系统运行的模拟交互或实际客户-代理者交互。这样,聊天分类器可以用于强化联络中心内的检测环境与生产环境之间的边界,从而允许在不影响中心性能和客户体验的情况下同时运行检测。根据实施例可以使用DAE系统以直接运行代理者桌面环境,而非与聊天服务器直接交互,从而增加检测代理者体验的功能。因此,单个示例性的检测案例可以执行对内部联络中心系统(例如如上所述的CTI服务器或聊天服务器)、代理者桌面软件、入站流量管理和加载处理以及通过各种聊天交互端点的客户体验和所有执行的请求的总体路由效率的检测,然后存储检测案例结果数据用于查看和分析。本领域技术人员应当理解,所述的优选构造是示例性的并且根据本发明的替代构造是可行的,由于本领域继续演变新的功能,在本发明的范围内可以实施合适的检测协议。In accordance with a preferred embodiment of the present invention, a system for handling chat detection for contact center automation is disclosed, comprising a detection case management (TCM) platform, a "chatcruncher", a contact center manager (CCM), Chat Classifier and Desktop Automation Engine (DAE). According to an embodiment, the TCM platform may present a web-based graphical user interface for building and managing test cases and viewing result reports, as illustrated in detail in FIGS. 6 and 7 . These functions may allow the user to enter additional detection protocols, view the results of previous detections, view detections as they are run for real-time analysis, and run detection result reports (such as, for example, for backup purposes, select specific reports and export them to database or other storage media). A "chat processing system" according to an embodiment may handle the loading and execution of test cases, including (but not limited to) functions such as generating simulated customer traffic and testing various chat endpoints for customer experience (such as, for example, in web pages) embedded chat interface) and handles the automation of load detection by changing the traffic generated. A CCM system can simulate agent activity and perform contact center functions with respect to simulated customer traffic from a chat processing system and can replicate actual agent activity by directly running a chat server utilized by a contact center, thereby also including support for existing centers Detection of architecture, for example, chat server, CTI server or other internal components. It should be understood that these embodiments are not dependent on any particular existing components or configurations, thus facilitating scalability to a variety of contact center infrastructures. According to an embodiment, a chat classifier may be implemented to classify chat interactions into simulated interactions performed by the detection system or actual client-agent interactions according to their nature. In this way, chat classifiers can be used to harden the boundary between the detection environment and the production environment within a contact center, allowing detection to run concurrently without affecting center performance and customer experience. According to embodiments, a DAE system can be used to directly run the agent desktop environment, rather than directly interacting with the chat server, thereby adding the ability to monitor the agent's experience. Thus, a single exemplary detection case can be performed on internal contact center systems (such as CTI servers or chat servers as described above), agent desktop software, inbound traffic management and loading processing, and customer experience through various chat interaction endpoints and the detection of the overall routing efficiency of all executed requests, and then store the detection case result data for viewing and analysis. It will be appreciated by those skilled in the art that the preferred configurations described are exemplary and that alternative configurations are possible according to the invention and that suitable detection protocols may be implemented within the scope of the invention as the art continues to evolve new capabilities.
根据本发明的另一个优选的实施例,公开了一种用于自动化的聊天检测的方法。根据实施例,在初始步骤中,开始检测案例。这可以作为自动化任务执行,例如,计划的事件或周期性地或者在满足某些条件时运行的例程的一部分。这也可以可选地通过TCM平台由人为交互触发,用于建立并执行用于检测具体特征或过程或者在它被设置成自动运行之前执行新的检测案例的“试运行”可能需要的自定义检测案例。在执行检测案例时,建立多个虚拟客户和代理者,这些虚拟客户和代理者用作聊天检测的端点。此方法暗中检测在检测运行时聊天过程中涉及的每个系统。虚拟客户和代理者建立的结果可以存储在检测数据库或类似数据存储中,这些检测数据库或类似的数据存储可以位于本地作为联络中心基础设施的一部分或者可以是各种远程存储介质的任一种,例如,位于联络中心远程的并且通过互联网或其他数据网络访问的云端存储器。存储的数据可以随后用于生成用于查看检测结果的详细报告,该报告也可以继而存储用于后续检索。接着,根据正在执行的具体检测案例,一个或多个虚拟客户发起聊天会话。这种会话发起请求可以通过互联网或其他数据网络发送,并且进行与来自客户的实际入站请求类似的处理。为了强化联络中心内的边界并且防止检测案例影响运行,可以实施聊天分类器以分析穿过中心的聊天请求并且将它们酌情“标记”成与检测案例相关。这样,检测数据可以在不干涉联络中心运行(例如,发送虚拟客户的请求到实际代理者或者将检测数据显示给客户)的情况下按照类似途径到达实际客户交互。本领域技术人员应当理解,这个步骤可以是可选的,因为并非总是需要与正常的中心运行并列地运行检测——例如,当通知客户运行时间的自动化系统处理入站流量并且没有流量穿过中心时,可以在中心的运行时间以外运行检测。再者,从这个步骤所得的数据可以记录在数据存储中以在报告中使用。在会话已经发起并且可选地经过分类之后,根据正在运行的检测案例可以开始虚拟代理者响应和适当的聊天会话(本文所述的方法不采用特定的脚本,应当理解,这些检测案例可能大为不同)。客户和代理者根据检测交换聊天消息,相应地记录结果,并且可选地,CCM平台可以与代理者桌面交互以便于检测代理者体验并且检测联络中心软件的运行。这种代理者桌面可以是运行代理者桌面环境软件的物理计算机工作站,或者它可以是在不存在物理计算机的检测系统内运行的虚拟桌面。记录来自代理者桌面交互的结果(如有),并且最终所有记录的数据在完成检测案例时整理到结果报告中。所得的报告可以被存储以供随后检索,并且可以做成从TCM平台可见以供用户分析。这样,来自前一个检测的结果是可用的使得用户可以优化来自TCM平台的图形界面的任何未来的检测。According to another preferred embodiment of the present invention, a method for automated chat detection is disclosed. According to an embodiment, in an initial step the detection of cases is started. This can be performed as an automated task, for example, as part of a scheduled event or a routine that runs periodically or when certain conditions are met. This can also optionally be triggered by human interaction through the TCM platform to build and execute customizations that may be required to detect specific features or processes or to perform a "trial run" of a new detection case before it is set up to run automatically Detection case. When performing detection cases, multiple virtual clients and agents are established, which are used as endpoints for chat detection. This method implicitly detects every system involved in detecting runtime chat. Results created by virtual customers and agents may be stored in an inspection database or similar data store, which may be located locally as part of the contact center infrastructure or may be on any of a variety of remote storage media, For example, cloud storage located remotely from the contact center and accessed through the Internet or other data network. The stored data can then be used to generate a detailed report for viewing inspection results, which can then also be stored for subsequent retrieval. Next, depending on the specific detection case being performed, one or more virtual clients initiate a chat session. Such session initiation requests may be sent over the Internet or other data network and processed similarly to actual inbound requests from clients. To enforce boundaries within a contact center and prevent detection cases from impacting operations, a chat classifier can be implemented to analyze chat requests traversing the center and "flag" them as relevant to a detection case as appropriate. In this way, the sensed data can follow a similar path to the actual customer interaction without interfering with contact center operations (eg, sending a virtual customer's request to a real agent or displaying the sensed data to the customer). Those skilled in the art will appreciate that this step may be optional, as it is not always necessary to run detection in parallel with normal central operations—for example, when an automated system notifying customers of uptime is processing inbound traffic and no traffic is passing through When using a hub, it is possible to run tests outside of the hub's runtime. Again, the resulting data from this step can be recorded in a data store for use in reporting. After the session has been initiated and optionally triaged, a virtual agent response and appropriate chat session can begin based on the detection cases being run (the methods described herein do not employ specific scripts, it being understood that these detection cases may vary greatly different). The customer and agent exchange chat messages based on the detection, the results are recorded accordingly, and optionally the CCM platform can interact with the agent's desktop in order to monitor the agent experience and monitor the operation of the contact center software. This proxy desktop can be a physical computer workstation running the proxy desktop environment software, or it can be a virtual desktop running within the detection system where no physical computer exists. The results from the agent's desktop interaction (if any) are recorded, and eventually all recorded data is collated into the results report upon completion of the detection case. The resulting reports can be stored for later retrieval and made visible from the TCM platform for user analysis. In this way, the results from the previous inspection are available so that the user can optimize any future inspections from the graphical interface of the TCM platform.
根据本发明的另一个优选实施例,公开了一种用于对音频连接质量进行自动化检测并打分的系统,所述系统包括多个端点模拟器和呼叫引擎。根据实施例,可以与现有的联络中心架构一起实施系统元件,诸如(例如)可以运行网络界面或浏览器用于呼叫模拟建立的网络服务器、用于指导联络中心内的呼叫或其他数据的网关(例如,路由器或SIP服务器)或数据网络(例如,互联网或其他网络)。根据实施例,网络服务器可以连接到呼叫引擎上以建立呼叫模拟,该呼叫模拟可以利用现有的音频样本(以下称为“参考音频”)用于检测目的——此过程可以手动或自动运行。呼叫引擎然后可以模拟客户向联络中心生成入站呼叫请求,通过公共开关电话网络(PSTN)或者互联网或者可能适合用于模拟网络电话(VoIP)呼叫交互的其他数据网络发送音频或其他数据。在联络中心内,端点管理器可以类似地连接到网络服务器上,用于利用参考音频建立呼叫模拟,以模拟在客户交互中的代理者参与。端点模拟器可以类似地连接到联络中心架构的现有的部件上,包括(但不限于)以下元件,例如,可以指导呼叫到它们合适的目的地(例如,增强边界使得模拟的交互不与实际联络中心活动重叠,否则对联络中心的性能或客户体验具有潜在地不利影响)的路由器、可以存储音频检测结果或来自模拟的其他数据的数据库或其他存储介质、或者呼叫分类器,所述呼叫分类器可以检查穿过联络中心的音频或其他流量并且确定这些数据是否具有实际或模拟的性质,从而再次便于强化边界使得模拟不与联络中心运行重叠。本领域的普通技术人员应当理解,这种系统具有设计灵活性,并且可以适用于根据本发明的各种现有的联络中心架构的任一种,因为这种系统不依赖于除要求保护的联络中心部件之外的具体的联络中心部件。According to another preferred embodiment of the present invention, a system for automatically detecting and scoring audio connection quality is disclosed, and the system includes a plurality of endpoint simulators and a call engine. Depending on the embodiment, system elements can be implemented with existing contact center architecture such as, for example, a web server that can run a web interface or browser for call simulation setup, a gateway to direct calls or other data within the contact center ( For example, a router or a SIP server) or a data network (for example, the Internet or other network). According to an embodiment, a web server can be connected to the call engine to create a call simulation that can utilize existing audio samples (hereinafter referred to as "reference audio") for detection purposes - this process can be run manually or automatically. The call engine can then simulate a customer generating an inbound call request to the contact center, sending audio or other data over the public switched telephone network (PSTN) or the Internet or other data network that may be suitable for simulating a Voice over Internet Protocol (VoIP) call interaction. In a contact center, an endpoint manager can similarly be connected to a web server for building a call simulation with reference audio to simulate the agent's participation in a customer interaction. Endpoint simulators can similarly be connected to existing components of the contact center architecture, including (but not limited to) elements that, for example, can direct calls to their appropriate destinations (e.g., enhance boundaries so that simulated interactions do not differ from actual overlapping contact center activities that would otherwise have a potentially adverse impact on contact center performance or customer experience), databases or other storage media that may store audio detection results or other data from simulations, or call classifiers that classify calls An analyzer can examine audio or other traffic traversing the contact center and determine whether that data is of a real or simulated nature, again facilitating hardening boundaries so that simulation does not overlap with contact center operations. Those of ordinary skill in the art should understand that such a system has design flexibility and can be adapted to any of various existing contact center architectures according to the present invention, because such a system does not rely on contact information other than the claimed one. Specific contact center components other than the central component.
在本发明的另一个优选实施例中,公开了一种用于对音频质量进行自动化检测或打分的方法。根据实施例,可以利用参考音频通过网络界面在端点模拟器内建立呼叫模拟用于模拟联络中心代理者从客户接收交互。可以在呼叫引擎内通过网络界面建立具有参考音频的类似的呼叫模拟,用于模拟呼叫者使用联络中心发起呼叫以便与代理者交互。应当理解,根据本发明,这种呼叫模拟建立过程可以是手动或自动过程或两者的一些组合(例如,手动建立呼叫模拟,然后将其设置成以计划的间隔运行)。用于呼叫者模拟的参考音频然后可以通过现有的通道(例如,PSTN或数据网络,例如在VoIP呼叫模拟的情况下可以是互联网)从呼叫引擎发送到联络中心环境。在联络中心内,可以实施路由器或网关以适当地分配进来的呼叫并且确保来自呼叫引擎的模拟呼叫发送到合适的端点,即,不发送到可能等待接收来自实际客户的呼叫的实际联络中心代理者。当端点模拟器接收从呼叫引擎路由的进来的音频时,端点模拟器然后可以测量进来的音频的质量并且相应地生成得分或评级,从而模拟接收呼叫的联络中心代理者可以感知的音频质量。此得分可以存储在联络中心内的数据库或其他存储介质中供查看和进一步动作。端点模拟器然后可以用参考音频作为响应,该参考音频可选地经由如上所述的现有的通道(例如,路由器或PSTN或互联网或其他网络)发回到呼叫引擎。当音频到达呼叫引擎时,可以类似地对质量进行测量并打分,从而适当地模拟客户在与联络中心代理者交互期间可以感知的音频质量。呼叫模拟可以以下方式可选地继续,使得参考音频样本进一步在呼叫引擎与端点模拟器之间发送并且针对相应的质量进行测量或打分,直到有意地结束呼叫模拟或由于错误或故障(例如掉线)(然后可以进一步记录在数据库或其他存储介质中用于检测和分析目的)而结束呼叫模拟。In another preferred embodiment of the present invention, a method for automatic detection or scoring of audio quality is disclosed. According to an embodiment, a call simulation can be set up within an endpoint emulator through a web interface with reference audio for simulating a contact center agent receiving an interaction from a customer. A similar call simulation with reference audio can be built within the call engine through a web interface for simulating a caller using the contact center to initiate a call to interact with an agent. It should be understood that, in accordance with the present invention, such a call simulation setup process may be a manual or automatic process or some combination of both (eg, manually setup a call simulation and then set it to run at scheduled intervals). Reference audio for caller simulation can then be sent from the call engine to the contact center environment over an existing channel (eg, PSTN or data network, such as the Internet in the case of VoIP call simulation). Within a contact center, routers or gateways can be implemented to properly distribute incoming calls and ensure that simulated calls from call engines are sent to the appropriate endpoints, i.e. not to actual contact center agents who may be waiting to receive calls from actual customers . When the endpoint emulator receives incoming audio routed from the call engine, the endpoint emulator can then measure the quality of the incoming audio and generate a score or rating accordingly, simulating the audio quality that a contact center agent receiving the call could perceive. This score can be stored in a database or other storage medium within the contact center for review and further action. The endpoint emulator can then respond with reference audio, optionally sent back to the call engine via an existing channel (eg, router or PSTN or Internet or other network) as described above. When the audio reaches the call engine, the quality can be similarly measured and scored, properly simulating the audio quality a customer can perceive during an interaction with a contact center agent. The call simulation can optionally continue in a manner such that reference audio samples are further sent between the call engine and the endpoint emulator and measured or scored for corresponding quality, until the call simulation is ended intentionally or due to an error or malfunction such as a dropped call ) (which can then be further recorded in a database or other storage medium for detection and analysis purposes) to end the call simulation.
根据本发明的另外的实施例,公开了一种用于自动化的音频质量检测的系统,所述系统进一步包括多个音频生成设备。根据实施例,多个音频生成设备可以在联络中心内作为自动化音频检测系统的元件实施,该元件然后可以连接至代理者设备,例如,手持式受话器或头戴式受话器。在此前所述的音频检测模拟期间,当参考音频将要从端点模拟器发送以响应从呼叫引擎接收的音频时,可以通过音频生成设备播放该参考音频到代理者的设备中使得除检测联络中心架构上的音频质量之外,也便于代理者硬件的检测(例如,可能便于确定由于低质量或有缺陷的代理者耳机引起的任何音频质量损失)。应当理解,这种构造的性质可以是可变的,并且如果实施多个音频生成设备,它们可以连接至各种代理者硬件,例如,手持式受话器、头戴式受话器或任何组合形式的其他设备。这样,这种系统可以容易地适用于各种现有的联络中心架构以及代理者硬件技术,并且系统可以容易地适用于这种架构,或者技术可以发生变化(例如,当联络中心将代理者的头戴式受话器升级成不同的型号时)。应当进一步理解,音频生成设备的实施不需要使用实际代理者工作站,根据实施例,代理者硬件和音频生成设备可以以任何构造连接至联络中心架构,例如,联络中心通过利用与服务器连接上的各种代理者硬件或适合用于模拟代理者工作站的类似的计算硬件可以将特定的房间专用于代理者硬件检测,使得实际代理者工作站的环境可以不受检测的影响。这样,在不干涉联络中心运行并且不减少供使用的可用的物理代理者工作站的数量的情况下可以运行检测设备。According to further embodiments of the present invention, a system for automated audio quality detection is disclosed, the system further comprising a plurality of audio generating devices. According to an embodiment, multiple audio generating devices may be implemented within a contact center as elements of an automated audio detection system, which may then be connected to an agent device, such as a handset or headset. During the previously described audio detection simulation, when a reference audio is to be sent from the endpoint emulator in response to the audio received from the call engine, the reference audio can be played by the audio generation device into the agent's device so that in addition to detecting the contact center architecture In addition to the audio quality on the monitor, it also facilitates the detection of agent hardware (for example, it may facilitate determining any loss of audio quality due to low quality or defective agent headphones). It should be understood that the nature of this configuration may be variable, and if multiple audio generating devices are implemented, they may be connected to various agent hardware, e.g., handsets, headphones, or other devices in any combination . In this way, such a system can be easily adapted to a variety of existing contact center architectures as well as agent hardware technology, and the system can be easily adapted to this architecture, or the technology can change (for example, when the contact center integrates the agent's when the headset is upgraded to a different model). It should be further understood that the implementation of the audio generating device does not require the use of actual agent workstations, and that, according to embodiments, the agent hardware and audio generating device may be connected to the contact center architecture in any configuration, for example, the contact center may utilize various Such agent hardware or similar computing hardware suitable for simulating agent workstations can dedicate a specific room to agent hardware testing so that the environment of actual agent workstations can be unaffected by the testing. In this way, detection equipment can be operated without interfering with contact center operations and without reducing the number of physical agent workstations available for use.
根据本发明的另外的实施例,公开了一种用于自动化的音频质量检测的系统,所述系统进一步包括多个头部和躯干模拟器(HATS)设备。根据实施例,HATS设备可以是被设计成模拟人体的物理构造和/或声学特性的复制品或“仿制”躯干。这种设备可以与如此前所述用于自动化的音频质量检测的系统结合使用,并且为了以非常类似于实际代理者的方式生成并且/或者接收音频,可以包含如此前所述与HATS设备一体化或可拆卸地固定在HATS设备上的音频生成设备。在这种构造中,当端点模拟器接收参考音频时,参考音频可以通过代理者硬件(例如,头戴式受话器)传输,并且然后可以由与HATS设备一体化或可拆卸地附接在HATS设备上的音频传感器接收,这种头戴式受话器可以放置在HATS设备上。然后可以按照此前描述的方式对音频质量打分,并且新的参考音频然后可以通过与HATS设备一体化或可拆卸地附接在HATS设备上的音频生成设备传输以模拟代理者发声,然后代理者硬件(例如,手持式受话器或头戴式受话器)可以接收代理者发声,用于传输返回到如此前所述的呼叫引擎。这样,音频检测现在可以根据人类代理者的实际用途包含代理者硬件的检测,从而便于代理者硬件和客户体验的更彻底且精确的检测并且更贴切地模拟实际联络中心运行。应当理解,这种构造不需要使用物理代理者工作站,并且HATS设备可以以任何配置与其他元件一起使用以便于可以容易地适用于任何联络中心架构的灵活配置,并且适用于这种架构可能发生的变化。这样,在不影响联络中心运行或减少可用的物理代理者工作站的数量的情况下可以执行利用HATS设备的检测。According to further embodiments of the present invention, a system for automated audio quality detection is disclosed, the system further comprising a plurality of head and torso simulator (HATS) devices. According to an embodiment, a HATS device may be a replica or "dummy" torso designed to simulate the physical makeup and/or acoustic properties of the human body. Such a device may be used in conjunction with the system for automated audio quality detection as previously described, and may include integration with a HATS device as previously described in order to generate and/or receive audio in a manner very similar to an actual agent Or an audio generating device detachably secured to a HATS device. In this configuration, when the endpoint emulator receives the reference audio, the reference audio can be transmitted through the agent hardware (e.g., a headset) and can then be provided by the HATS device either integrally or detachably attached to the HATS device. Received by the audio sensor on the headset, this headset can be placed on the HATS device. The audio quality can then be scored in the manner previously described, and new reference audio can then be transmitted through an audio generation device integral to or detachably attached to the HATS device to simulate the agent vocalizing, and the agent hardware The agent utterance may be received (eg, a handset or headset) for transmission back to the call engine as previously described. In this way, audio testing can now include testing of agent hardware based on actual usage by human agents, thereby facilitating more thorough and accurate testing of agent hardware and customer experience and more closely simulating actual contact center operations. It should be understood that this configuration does not require the use of physical agent workstations, and that the HATS device can be used with other elements in any configuration to allow for a flexible configuration that can be easily adapted to any contact center architecture, and to suit the conditions that may occur with such an architecture. Variety. In this way, detection with HATS devices can be performed without impacting contact center operations or reducing the number of physical agent workstations available.
根据本发明的另一个实施例,可以针对压力检测、功能、可靠性、响应时间或其他有用的检测度量检测基于聊天的软件前端,使得在实际联络中心运行中实施之前可以检测特定的前端应用。根据实施例,检测方法可以允许使用各种第三方或外部前端软件,使得可以根据需要与任何前端软件一起利用单个检测系统。这样,可以针对在真实或模拟条件中的可行性检测新的或替代的前端以验证它们在部署之前的功能。根据实施例,可以利用基于互联网的或类似的互联网协议(IP)网络固有的特征以便于系统运行,例如,使用HTTP文件头(这是通过这种通信网络发送的数据包的关键特征)以识别聊天行为或参数,或者使用精心设计的URL来识别在检测中使用的聊天服务器(即,聊天前端可以请求具体的URL以便与检测服务器交互,而不是连接至电话号码)。通过这样利用文件头,可以基于接收的文件头中信息(例如如何路由聊天请求)作出决定来处理交互,而不在前端本身中增加特殊空间。可以通过利用所有的基于IP的通信固有的基本技术特征来利用此功能以使得检测能够用于各种网络,而不要求对于适当的功能利用特定的检测网络。这样,检测可以利用外部连接,例如,位于远程的联络中心代理者或担当代理者或客户的软件元件,并且可以利用相同的网络(即,互联网),客户可以通过该网络用于他们与联络中心的交互(与在联络中心内的内部网络上进行的检测相反)。应当理解,通过使用这种方法,检测可以利用相同的技术元件作为实际的客户,从而贴切地复制联络中心聊天交互的实际运行条件。According to another embodiment of the present invention, chat-based software front ends can be instrumented for stress detection, functionality, reliability, response time, or other useful instrumentation metrics such that specific front end applications can be instrumented prior to implementation in actual contact center operations. According to an embodiment, the detection method may allow the use of various third-party or external front-end software, so that a single detection system can be utilized with any front-end software as desired. In this way, new or alternative front ends can be tested for feasibility in real or simulated conditions to verify their functionality prior to deployment. Depending on the embodiment, features inherent to Internet-based or similar Internet Protocol (IP) networks may be exploited to facilitate system operation, for example, using HTTP headers (a key characteristic of data packets sent over such communications networks) to identify Chat behavior or parameters, or the use of well-crafted URLs to identify the chat server used in the detection (i.e., the chat frontend could request a specific URL in order to interact with the detection server, rather than connecting to a phone number). By utilizing headers in this way, decisions can be made to handle interactions based on information received in headers (such as how to route chat requests), without adding special space in the front end itself. This functionality can be exploited to enable detection for various networks by exploiting fundamental technical features inherent to all IP-based communications, without requiring utilization of a specific detection network for proper functionality. In this way, detection can utilize external connections, such as remotely located contact center agents or software elements acting as agents or customers, and can utilize the same network (i.e., the Internet) through which customers can communicate with the contact center interaction (as opposed to detection on the internal network within the contact center). It should be appreciated that by using this approach, detection can utilize the same technical elements as actual customers, thereby closely replicating the actual operating conditions of contact center chat interactions.
作为利用现有的通信技术便于运行的延伸,检测系统可以跨外部连接(例如,通过互联网或类似数据通信网络的远程聊天前端交互)运行。这样,检测系统可以利用实际客户可能利用的实际网络连接、物理硬件或位置,从而增加检测结果的相关性。此外,这种功能允许使用通过云端或远程前端运行的分布式联络中心代理者,如同本领域中云端或分布式联络中心运行的常见构造,并且可以在不需要任何特殊配置或硬件的情况下与中心检测系统交互。这样,远程代理者可以在利用端对端检测系统的全部功能的同时利用它们现有的硬件或类似的聊天前端。此外,分布式代理者可以参与自动化检测,例如,预定的聊天检测交互,例如,可以用于加载检测以确保特定的连接,或者前端足够健壮以处理实际运行的交互流量水平。另外的使用可以是代理者及其前端的周期性或随机检测,可以由模拟客户交互的检测系统发起周期性或随机检测,例如以执行周期性检测并且确保联络中心的一致性运行,以及在中心或检测系统内发生变化时(酌情)确保连续运行(例如,在改变配置时,可以发起批处理检测以确保运行)。As an extension of the ease of operation using existing communication technologies, the detection system can operate across external connections (eg, interacting with remote chat front-ends via the Internet or similar data communication networks). This way, the detection system can leverage actual network connections, physical hardware, or locations that actual customers might utilize, increasing the relevance of detection results. Furthermore, this capability allows the use of distributed contact center agents running through the cloud or remote head-ends, as is common in the art for cloud or distributed contact center operations, and can communicate with Central detection system interaction. In this way, remote agents can utilize their existing hardware or similar chat front ends while utilizing the full functionality of the end-to-end inspection system. Additionally, distributed agents can participate in automated detection, e.g. scheduled chat detection interactions, for example, can be used for load detection to ensure specific connections, or front-ends robust enough to handle actual operational interaction traffic levels. Additional uses could be periodic or random testing of agents and their front ends, which could be initiated by a testing system simulating customer interactions, for example to perform periodic testing and ensure consistent operation of contact centers, as well as Or to ensure continuous operation (as appropriate) when changes occur within the detection system (e.g. batch detection can be initiated to ensure operation when a configuration is changed).
另外,根据实施例,聊天交互可以在沿着连接的任意点或在交互期间的任意时刻利用多种通信技术(例如,物理连接、基于电缆或光纤的互联网连接、蜂窝通信网络或其他通信技术)。可以同时或依次或根据随机或可配置的模式利用这些技术。这样,可以检测在交互期间能够利用的任何通信技术,从而确保检测可以完全包含客户-代理者交互的任何可行的情形。Additionally, depending on the embodiment, the chat interaction may utilize a variety of communication technologies (e.g., a physical connection, a cable or fiber-based Internet connection, a cellular communication network, or other communication technology) at any point along the connection or at any point during the interaction. . These techniques can be utilized simultaneously or sequentially or according to a random or configurable pattern. In this way, any communication technology that can be utilized during the interaction can be detected, thereby ensuring that detection can fully encompass any feasible scenario of the client-agent interaction.
除在如上所述的实际的技术或网络上运行检测案例之外,这些检测案例还应当检测并且测量关键度量或测试功能以精确地表述实际的客户端-代理者交互。例如,检测案例可以测量连接至聊天服务器或第二聊天参与者(例如,联络中心代理者)的时间、等待代理者“拾取”并加入交互所花费的时间(即,“保持时间”度量,因为它涉及到基于聊天的交互),等待接收文本或等待发送响应(例如,用于模拟输入问题的客户,或查找信息以制定回复的代理者)的时间、选择响应串以返回到客户(或模拟客户)的时间或在不依赖任何特定的前端的情况下可以检测的其他功能。此外,因为客户或其他参与者可以使用具有不同的过程或功能的不同的前端应用,检测系统固有的基础软件元件应当能够以可兼容的方式处理来自前端的请求以及将要发送到前端的过程输出,而不论正在使用的特定的软件应用。这样,检测方案可以在不削弱功能的情况下扩展到各种大量的前端聊天程序。In addition to running test cases on actual technologies or networks as described above, these test cases should detect and measure key metrics or test functions to accurately represent actual client-agent interactions. For example, a detection case may measure the time to connect to a chat server or a second chat participant (e.g., a contact center agent), the time spent waiting for an agent to "pick up" and join the interaction (i.e., the "hold time" metric, since It involves chat-based interactions), time waiting to receive a text or waiting to send a response (e.g., for simulating a customer entering a question, or an agent looking up information to formulate a response), selecting a response string to return to the customer (or simulating client) or other features that can be detected without relying on any particular front end. Furthermore, since customers or other participants may use different front-end applications with different processes or functions, the underlying software elements inherent in the inspection system should be able to process requests from the front-end and process outputs to be sent to the front-end in a compatible manner, regardless of the particular software application being used. In this way, the detection scheme can be extended to a large variety of front-end chat programs without weakening the functionality.
此外,检测系统可以利用“活动”功能例如以便选择或配置用于运行的检测过程,例如,选择运行什么脚本,发送什么串、作为等待时间的这些变量的值以及可能期望存储以供将来参考或使用的其他配置。另外,当运行检测活动时,可以报告或记录有关特定的活动的结果,使得当检查检测结果时,活动的配置可以与该活动的此前的执行结果一起可用。这样,可以既配置检测的时序安排或周期性(“什么时候”检测运行),又配置控制特定的检测运行的配置参数,例如可变的等待时间、将要检测的网络、发送检测交互给什么代理者、检测错误或其他运行参数的边界,或如何报告检测结果(检测“如何”运行)。这样,可以配置各种检测及检测类型,并且通过编辑存储的活动而非手动配置单独的检测来改变或保持配置。此外,活动可以被链接以提供分层的检测方法——例如,如果“检测活动A”返回某些边界内的结果,那么运行“检测活动B”,但是如果“A”返回这些边界外的结果,那么运行“检测活动C”。这样,完全自主的检测制度可以被配置成可以适用于其自身的运行,并且在常规运行被配置成无人监督地进行时,才需要人为干涉来改变活动配置。应当理解,这种方法也可以使交互式报告(例如,编译并发送结果到合适的各方的活动(例如,如果检测到硬件故障,就提醒IT人员))的可能性待定,并且这些报告可以链接至活动或甚至执行特定的检测以增加报告的内容的相关性和可用性。应当进一步理解,通过使这些报告行为与此前描述的检测方法结合(例如,利用通信中的HTTP文件头或其他嵌入式数据),报告可以不仅显示系统运行,而且显示交互的“客户端的眼睛”视野——即,客户在交互期间看到什么或经历什么,例如,缓慢响应时间形成代理者。这样,检测可以甚至更相关并且可以找出传统检测运行中可能未出现的问题——继续上述实例,客户可能在检测系统在交互期间表现出来自真实或模拟代理者的快速响应时已经体验了缓慢的响应时间。这可以用于在客户与代理者之间的通信路径期间找出(例如)连接性或硬件的问题,从而便于更精确的系统诊断和运行的总效率。In addition, the detection system may utilize the "activity" function, for example, to select or configure the detection process for execution, e.g., select what script to run, what string to send, the values of these variables as latency and possibly desired storage for future reference or Other configurations used. Additionally, when a detection campaign is run, results may be reported or logged regarding a particular campaign so that when the detection results are reviewed, the configuration of the campaign may be available along with previous execution results of that campaign. In this way, it is possible to configure both the scheduling or periodicity of detection ("when" the detection runs), as well as the configuration parameters that control specific detection runs, such as variable wait times, networks to be detected, agents to send detection interactions to who, detection error or other operating parameters bounds, or how detection results are reported (the detection "how" to run). In this way, various detections and detection types can be configured and the configuration changed or maintained by editing stored campaigns rather than manually configuring individual detections. Additionally, activities can be chained to provide a layered detection approach - for example, if "Detection Activity A" returns results within certain boundaries, then "Detection Activity B" is run, but if "A" returns results outside of those boundaries , then run "Detect Activity C". In this way, a fully autonomous detection regime can be configured to be applicable to its own operations and only require human intervention to change the active configuration when routine operations are configured to proceed unsupervised. It should be appreciated that this approach can also make interactive reporting (e.g. activities compiling and sending results to appropriate parties (e.g. alerting IT staff if a hardware failure is detected)) pending and that these reports can Link to campaigns or even perform specific detections to increase the relevance and usability of reported content. It should be further understood that by combining these reporting activities with the previously described detection methods (e.g., utilizing HTTP headers or other embedded data in communications), reports can show not only system operation, but also a "client's eye" view of interactions – that is, what the customer sees or experiences during the interaction, for example, slow response times form agents. This way, inspections can be even more relevant and can find issues that may not have arisen in traditional inspection runs - continuing the above example, customers may have experienced slowness when the inspection system exhibited quick responses from real or simulated agents during interactions response time. This can be used to find, for example, connectivity or hardware issues during the communication path between the client and the agent, facilitating more accurate system diagnostics and overall efficiency of operation.
附图说明Description of drawings
附图说明了本发明的几个实施例并且与说明书一起解释根据实施例的本发明的原理。本领域技术人员将认识到附图中图示的具体实施例仅仅是示例性的,并且并非旨在限制本发明的范围。The drawings illustrate several embodiments of the invention and together with the description explain principles of the invention according to the embodiments. Those skilled in the art will appreciate that the specific embodiments illustrated in the figures are exemplary only and are not intended to limit the scope of the invention.
图1是图示了本发明的实施例中使用的计算设备的示例性硬件架构的框图。Figure 1 is a block diagram illustrating an exemplary hardware architecture of a computing device used in embodiments of the present invention.
图2是图示了根据本发明的实施例的用于客户端设备的示例性逻辑架构的框图。Figure 2 is a block diagram illustrating an exemplary logical architecture for a client device according to an embodiment of the present invention.
图3是图示了根据本发明的实施例的客户端、服务器和外部服务的示例性架构布置的框图。Fig. 3 is a block diagram illustrating an exemplary architectural arrangement of a client, a server and an external service according to an embodiment of the present invention.
图4是图示了根据本发明的优选实施例的与传统联络中心部件集成的用于自动化的聊天检测的示例性系统架构的框图。4 is a block diagram illustrating an exemplary system architecture for automated chat detection integrated with traditional contact center components according to a preferred embodiment of the present invention.
图5是根据本发明的优选实施例的用于自动化的聊天检测的方法的框图。FIG. 5 is a block diagram of a method for automated chat detection according to a preferred embodiment of the present invention.
图6是根据本发明的优选实施例的检测案例创建界面的图示。Fig. 6 is an illustration of a detection case creation interface according to a preferred embodiment of the present invention.
图7是根据本发明的优选实施例的检测结果汇总界面的图示。Fig. 7 is an illustration of a test result summary interface according to a preferred embodiment of the present invention.
图8是图示了根据本发明的优选实施例的用于自动化的语音质量检测的示例性系统的框图。FIG. 8 is a block diagram illustrating an exemplary system for automated speech quality detection according to a preferred embodiment of the present invention.
图9是根据本发明的优选实施例的用于自动化的语音质量检测的方法的框图。Fig. 9 is a block diagram of a method for automated speech quality detection according to a preferred embodiment of the present invention.
图10是图示了根据本发明的实施例的包含语音生成设备的用于自动化的语音质量检测的系统的框图。FIG. 10 is a block diagram illustrating a system for automated speech quality detection including a speech generating device according to an embodiment of the present invention.
图11是根据本发明的实施例的HATS设备及其用途的图示。Figure 11 is an illustration of a HATS device and its use according to an embodiment of the present invention.
图12是图示了根据本发明的实施例的用于可扩展的端对端聊天检测的示例性方法的框图。FIG. 12 is a block diagram illustrating an exemplary method for scalable peer-to-peer chat detection according to an embodiment of the present invention.
图13是图示了根据本发明的实施例的用于基于活动的检测的示例性方法的框图。FIG. 13 is a block diagram illustrating an exemplary method for activity-based detection according to an embodiment of the present invention.
具体实施方式detailed description
发明人已经想到并付诸实践一种用于基于聊天的联络中心交互检测的自动化的系统和方法,包括一种灵活且可扩展的架构和方法以便于可靠的自动化的检测并且改善联络中心运行。The inventors have conceived and put into practice an automated system and method for chat-based contact center interaction detection, including a flexible and scalable architecture and method to facilitate reliable automated detection and improve contact center operations.
在本申请中可以描述一个或多个不同的发明。另外,对于本文所述的一个或多个发明,可以描述众多替代实施例;应当理解,仅仅为了说明目的来展示这些实施例。所述实施例绝非旨在限制。一个或多个发明可以宽泛地适用于众多实施例,正如从本公开显而易见的。一般来讲,这些实施例被充分详细地描述以使得本领域的技术人员能够实施一个或多个发明,并且应当理解,可以利用其他实施例,并且在不脱离具体发明的范围的情况下可以作出结构、逻辑、软件、电子和其他方面的修改。因此,本领域技术人员将认识到,可以用各种修改和更改来实施一个或多个发明。可以参照构成本公开的一部分的一个或多个具体实施例或附图描述一个或多个发明的具体特征,并且附图中以说明方式示出了一个或多个发明的具体实施例。应当理解,然而,这些特征并不限于用于一个或多个具体实施例或进行描述所参照的附图。本公开既不是一个或多个发明的所有实施例的文字描述,也不是必须在所有实施例中表述的一个或多个发明的特征的列举。One or more different inventions may be described in this application. Additionally, numerous alternative embodiments may be described for one or more of the inventions described herein; it should be understood that these embodiments are presented for illustration purposes only. The examples are by no means intended to be limiting. One or more inventions may apply broadly to numerous embodiments, as is apparent from this disclosure. Generally, these embodiments are described in sufficient detail to enable those skilled in the art to practice the invention or inventions, and it is to be understood that other embodiments may be utilized and that other embodiments may be made without departing from the scope of the specific inventions. Structural, logical, software, electronic and other modifications. Accordingly, those skilled in the art will recognize that one or more inventions may be practiced with various modifications and alterations. Specific features of one or more inventions may be described with reference to one or more specific embodiments or the accompanying drawings, which form a part of this disclosure, and the drawings show by way of illustration one or more specific embodiments of the invention. It should be understood, however, that the features are not limited to the one or more particular embodiments or figures with reference to which the description is made. This disclosure is neither a literal description of all embodiments of one or more inventions nor is it an enumeration of features of one or more inventions that must be present in all embodiments.
本专利申请中提供的章节标题以及本专利申请的名称仅仅是为了方便,并且不应该被认为以任何方式限制本公开。The section headings and titles of this patent application are provided in this patent application for convenience only and should not be construed as limiting the disclosure in any way.
互相通信的设备不需要互相连续地通信,除非另外明确指明。此外,互相通信的设备可以通过一个或多个媒介(逻辑的或物理的)直接或间接进行通信。Devices that are in communication with each other need not be in continuous communication with each other, unless expressly indicated otherwise. In addition, devices that are in communication with each other may communicate directly or indirectly through one or more intermediaries (logical or physical).
具有互相通信的几个部件的实施例的描述并不意味着需要所有这些部件。相反,可以描述多种可选的部件以说明一个或多个发明的各种各样的可行的实施例并且以便更全面地说明本发明的一个或多个方面。类似地,尽管可以按照顺序描述过程步骤、方法步骤、算法等,但是这些过程、方法和算法一般可以被配置成以另选的顺序工作,除非有具体的相反说明。换句话讲,本专利申请中描述的步骤的任何序列或顺序本身并不表示要求按照该顺序执行步骤。所述过程的步骤可以按照任何实际顺序执行。另外,尽管一些步骤被描述或暗示为非同时发生(例如,因为一个步骤在另一个步骤之后进行描述),但是这些步骤也可以同时执行。此外,通过附图的描绘说明一个过程并不暗示所图示的过程不包括其他变化和修改,并不暗示所图示的过程或其任何步骤对于一个或多个发明是必需的,并且并不暗示所图示的过程是优选的。另外,每个实施例一般描述一次这些步骤,但是这并不意味着它们必须发生一次,或者每次在执行或运行过程、方法或算法时它们只能发生一次。在一些实施例或一些情形中可以省略一些步骤,或者在给定实施例或情形中,一些步骤可以执行超过一次。A description of an embodiment with several components in communication with each other does not imply that all such components are required. On the contrary, various optional components may be described to illustrate a wide variety of possible embodiments of one or more inventions and to more fully describe one or more aspects of the invention. Similarly, although process steps, method steps, algorithms, etc. may be described in a sequential order, these processes, methods and algorithms can generally be configured to operate in an alternative order unless specifically stated to the contrary. In other words, any sequence or order of steps described in this patent application does not in itself imply a requirement that the steps be performed in that order. The steps of the described processes may be performed in any order practical. Additionally, although some steps are described or implied as occurring non-concurrently (for example, because one step is described after another), these steps may also be performed concurrently. Furthermore, the depiction of a process by the drawing does not imply that the illustrated process does not include other changes and modifications, does not imply that the illustrated process or any step thereof is essential to one or more inventions, and does not It is implied that the illustrated process is preferred. Additionally, each embodiment generally describes these steps once, but this does not mean that they must occur once, or that they can only occur once each time a process, method, or algorithm is executed or run. Some steps may be omitted in some embodiments or in some situations, or some steps may be performed more than once in a given embodiment or situation.
当描述单个设备或物品时,应当容易明白,可以使用超过一个设备或物品来代替单个设备或物品。类似地,当描述超过一个设备或物品时,应当容易明白,可以使用单个设备或物品来代替超过一个的设备或物品。Where a single device or item is described, it should be readily understood that more than one device or item may be used in place of a single device or item. Similarly, where more than one device or item is described, it should be readily understood that a single device or item may be used instead of more than one device or item.
设备的功能或特征可以由并未明确描述具有这种功能或特征的一个或多个其他设备来替代实施。因此,一个或多个发明的其他实施例不需要包括设备本身。Functions or features of a device may instead be performed by one or more other devices not expressly described as having such functions or features. Accordingly, other embodiments of one or more inventions need not include the device itself.
为了清楚的目的,本文所描述或参考的技术和机制有时候将以单数形式描述。然而,应当注意,具体实施例包括多个技术重复或机制的多个实例,除非另外注明。图中的过程描述或方框应当理解成表示包括用于实施过程中的具体逻辑功能或步骤的一个或多个可执行的指令的模块、片段或部分代码。本领域的普通技术人员应当理解,替代实施方式也包括在本发明的实施例的范围内,其中例如可以根据所涉及的功能不按照图示或讨论的顺序执行功能,包括基本上同时或反向的顺序。For purposes of clarity, techniques and mechanisms described or referenced herein will sometimes be described in the singular. It should be noted, however, that specific embodiments include multiple repetitions of techniques or multiple instances of mechanisms unless otherwise noted. Process descriptions or blocks in the figures should be understood as representing modules, segments or partial codes including one or more executable instructions for implementing specific logical functions or steps in the process. Those of ordinary skill in the art will appreciate that alternative implementations are also within the scope of the embodiments of the present invention, in which, for example, functions may be performed out of the order shown or discussed, including substantially simultaneously or in reverse, depending on the functions involved. order of.
定义definition
如本文所用“聊天处理系统”是一种基于软件或硬件的系统,该系统被设计成接收检测案例信息的输入并且产生用于执行检测案例的基于聊天的输出。这样,通过以下方式,聊天处理系统可以被用来模拟基于聊天的交互:产生预定的聊天消息以发起交互,或者在交互期间响应接收到的输入,通过基于聊天的通信系统复制与另一个个体用户的交互效果。A "chat processing system" as used herein is a software or hardware based system designed to receive input of test case information and generate chat based output for carrying out the test case. Thus, a chat processing system can be used to simulate chat-based interactions by generating predetermined chat messages to initiate an interaction, or responding to input received during an interaction, by replicating a chat-based communication system with another individual user interaction effect.
如本文所用“聊天分类器”是一种基于软件或硬件的系统,该系统被设计成接收基于聊天的交互数据流并对其进行分析以确定其是检测案例的一部分还是实际客户交互的一部分。然后聊天分类器可以确定如何路由聊天数据,例如将交互聊天数据发送到联络中心代理者以供处理,同时将检测案例数据发送到其他检测系统。这样,聊天分类器可以负责边界强化(boundaryenforcement),从而防止任何检测数据与实际联络中心运行重叠或干涉。A "chat classifier" as used herein is a software or hardware-based system designed to receive a stream of chat-based interaction data and analyze it to determine whether it is part of a detection case or part of an actual customer interaction. The chat classifier can then determine how to route chat data, such as sending interactive chat data to contact center agents for processing, while sending detection case data to other detection systems. This way, chat classifiers can take care of boundary enforcement, preventing any detection data from overlapping or interfering with actual contact center operations.
如本文所用的“桌面自动化引擎”,缩写DAE,是一种基于软件的系统,该系统被设计成模拟联络中心代理者与代理者桌面软件元件的交互,以用于检测这些元件,该代理者桌面软件元件在联络中心运行期间可以像在代理者的桌面环境中一样正常运行。这样,可以在现有的代理者桌面上配置桌面自动化引擎以便与桌面环境的标准元件交互,而不用要求为了检测目的专门配置专用的或专门的桌面。A "Desktop Automation Engine", abbreviated DAE, as used herein, is a software-based system designed to simulate the interaction of a contact center agent with elements of an agent's desktop software for the purpose of detecting those elements, the agent Desktop software elements function as they would in an agent's desktop environment during contact center operations. In this way, the desktop automation engine can be deployed on existing agent desktops to interact with standard elements of the desktop environment, without requiring dedicated or dedicated desktops to be specially configured for detection purposes.
如本文所用的“参考音频”指的是代表客户和联络中心代理者交互要素(例如,问候、提问或响应)的预录制的音频样本。参考音频可以具有各种性质,比如关于音频质量的比特率、长度或其他音频质量,并且应当理解,使用具有不同质量的音频样本可能有益于检测,因为实际交互未必落入“理想”的运行条件内。As used herein, "reference audio" refers to pre-recorded audio samples that represent elements of a customer and contact center agent interaction (eg, greeting, question, or response). The reference audio can be of various properties, such as bitrate, length or other audio qualities with respect to audio quality, and it should be understood that using audio samples with different qualities may be beneficial for detection, as actual interactions do not necessarily fall into "ideal" operating conditions Inside.
如本文所用的“头部和躯干模拟器”,缩写HATS,指的是一种人的躯干的机械复制品,该机械复制品被设计成在检测期间作为真实的人类运行者的替身,用于例如检测包含代理者硬件(例如,电话头戴式受话器或头戴式受话器)的音频质量,或者通过麦克风检测音频传输的目的。这样,根据本发明的方法,客户-代理者交互过程的每个点都可以被检测并记录,从而去除可能对联络中心运行有害的未检测的变量。As used herein, "Head and Torso Simulator", the acronym HATS, refers to a mechanical replica of a human torso designed to serve as a stand-in for an actual human operator during testing for Examples include detecting the audio quality of hardware that includes an agent (eg, a phone headset or headset), or detecting the purpose of audio transmissions through a microphone. Thus, according to the method of the present invention, each point of the customer-agent interaction process can be monitored and recorded, thereby removing undetected variables that may be detrimental to the operation of the contact center.
硬件架构hardware architecture
一般来讲,本文公开的技术可以在硬件或软件和硬件的组合上实施。例如,它们可以在运行系统内核中、在单独的用户进程中、在绑定到网络应用中的库包中、在专门构造的机器上、在专用集成电路(ASIC)上或在网络接口卡上实施。In general, the techniques disclosed herein can be implemented on hardware or a combination of software and hardware. For example, they may be in the runtime kernel, in a separate user process, in a library package bundled into a network application, on a specially constructed machine, on an application-specific integrated circuit (ASIC), or on a network interface card implement.
本文公开的至少一些实施例的软件/硬件混合实施方式可以在可编程的网络驻留机器(应当理解成包括间歇连接的网络感知机器)上实施,该网络驻留机器由存储在存储器中的计算机程序选择性地激活或重新配置。这些网络设备可以具有能够被配置成或设计成利用不同类型的网络通信协议的多个网络接口。本文中可以公开用于这些机器中的一些机器的一般架构,以便示出能够实施给定的功能单元的一个或多个示例性装置。根据具体实施例,本文公开的各种实施例中的至少一些特征或功能可以在与一个或多个网络相关的一个或多个通用计算机上实施,例如,终端用户计算机系统、客户端计算机、网络服务器或其他服务器系统、移动计算设备(例如,平板计算设备、移动电话、智能手机、笔记本电脑等)、消费电子设备、音乐播放器或任何其他合适的电子设备、路由器、开关等或它们的组合。在至少一些实施例中,本文公开的各种实施例中的至少一些特征或功能可以在一个或多个虚拟化计算环境(例如,网络计算云、寄存在一个或多个物理计算机上的虚拟机等)中实施。Hybrid software/hardware implementations of at least some of the embodiments disclosed herein may be implemented on programmable network-resident machines (should be understood to include intermittently connected network-aware machines) powered by a computer stored in memory Programs are selectively activated or reconfigured. These network devices may have multiple network interfaces that can be configured or designed to utilize different types of network communication protocols. A general architecture for some of these machines may be disclosed herein in order to illustrate one or more exemplary means by which a given functional unit can be implemented. Depending on the particular implementation, at least some of the features or functionality of the various embodiments disclosed herein can be implemented on one or more general-purpose computers in connection with one or more networks, e.g., end-user computer systems, client computers, network Servers or other server systems, mobile computing devices (e.g., tablet computing devices, mobile phones, smartphones, laptops, etc.), consumer electronics devices, music players or any other suitable electronic devices, routers, switches, etc., or combinations thereof . In at least some embodiments, at least some of the features or functions of the various embodiments disclosed herein can be implemented in one or more virtualized computing environments (e.g., networked computing clouds, virtual machines hosted on one or more physical computers) etc.) are implemented.
现在参见图1,示出了框图,描绘了适用于实施本文公开的至少一部分特征或功能的示例性计算设备100。计算设备100可以例如是在前一段所列的计算机器中的任意一种,或者事实上是能够根据存储在存储器中的一个或多个程序执行基于软件或硬件的指令的任何其他电子设备。计算设备100可以适用于通过通信网络(例如,广域网、城域网、局域网、无线网、互联网或任何其他网络)利用用于这种通信的已知协议与多个其他的计算设备(例如,客户端或服务器)进行通信(不管是无线或有线)。Referring now to FIG. 1 , there is shown a block diagram depicting an example computing device 100 suitable for implementing at least some of the features or functions disclosed herein. Computing device 100 may be, for example, any of the computing machines listed in the preceding paragraph, or indeed any other electronic device capable of executing software- or hardware-based instructions according to one or more programs stored in memory. Computing device 100 may be adapted to communicate with multiple other computing devices (e.g., client terminal or server) to communicate (whether wireless or wired).
在一个实施例中,计算设备100包括一个或多个中央处理单元(CPU)102、一个或多个接口110以及一个或多个总线106(例如,外设部件互连(PCI)总线)。当在适当软件或固件的控制下运行时,CPU102可以负责实施与专门配置的计算设备或机器的功能相关的具体功能。例如,在至少一个实施例中,计算设备100可以被配置成或设计成用作利用CPU102、本地存储器101和/或远程存储器120和接口110的服务器系统。在至少一个实施例中,可以使CPU102在软件模块或部件的控制下执行一种或多种不同类型的功能和/或运行,所述软件模块或部件例如可以包括运行系统和任何合适的应用软件、驱动器等。In one embodiment, computing device 100 includes one or more central processing units (CPUs) 102, one or more interfaces 110, and one or more buses 106 (eg, Peripheral Component Interconnect (PCI) buses). When run under the control of appropriate software or firmware, CPU 102 may be responsible for implementing specific functions related to the functions of a specially configured computing device or machine. For example, in at least one embodiment, computing device 100 may be configured or designed to function as a server system utilizing CPU 102 , local memory 101 and/or remote memory 120 and interface 110 . In at least one embodiment, CPU 102 can be caused to perform one or more different types of functions and/or operations under the control of software modules or components, which can include, for example, a runtime system and any suitable application software , drive, etc.
CPU102可以包括一个或多个处理器103,诸如例如,来自Intel、ARM、Qualcomm和AMD微处理器家族之一的处理器。在一些实施例中,处理器103可以包括用于控制计算设备100的运行的专门设计的硬件,例如,专用集成电路(ASIC)、电可擦除可编程只读存储器(EEPROM)、现场可编程门阵列(FPGA)等。在具体实施例中,本地存储器101(例如非易失性随机存取存储器(RAM)和/或只读存储器(ROM),包括例如一个或多个登记的缓存存储器)也可以构成CPU102的一部分。然而,还可以采取许多不同的方式将存储器联接至系统100。存储器101可以用于各种目的,诸如例如,缓存和/或存储数据、编程指令等。CPU 102 may include one or more processors 103, such as, for example, a processor from one of the Intel, ARM, Qualcomm and AMD microprocessor families. In some embodiments, processor 103 may include specially designed hardware for controlling the operation of computing device 100, such as an application specific integrated circuit (ASIC), electrically erasable programmable read-only memory (EEPROM), field programmable Gate Array (FPGA), etc. In particular embodiments, local memory 101 , such as non-volatile Random Access Memory (RAM) and/or Read Only Memory (ROM), including, for example, one or more registered cache memories, may also form part of CPU 102 . However, memory can also be coupled to system 100 in many different ways. Memory 101 may be used for various purposes such as, for example, caching and/or storing data, programming instructions, and the like.
如本文所用,术语“处理器”不仅仅限于现有技术中被称为处理器、移动处理器或微处理器的这些集成电路,而是宽泛地指微控制器、微计算机、可编程逻辑控制器、专用集成电路和任何其他可编程电路。As used herein, the term "processor" is not limited to those integrated circuits known in the art as processors, mobile processors or microprocessors, but broadly refers to microcontrollers, microcomputers, programmable logic control devices, ASICs, and any other programmable circuits.
在一个实施例中,接口110被设置为网络接口卡(NIC)。一般来讲,NIC控制通过计算机网络的数据包的发送和接收;其他类型的接口110可以例如支持与计算设备100一起使用的其他外围设备。可以提供的接口为以太网接口、帧中继接口、电缆接口、DSL接口、令牌环接口、图形接口等。此外,可以提供各种类型的接口,诸如例如,通用串行总线(USB),串行,以太网,FIREWIRETM,PCI,并行,射频(RF),蓝牙(BLUETOOTH)TM,近场通信(例如,使用近场磁),802.11(WiFi),帧中继,TCP/IP,ISDN,快速以太网接口、千兆以太网接口、异步传输模式(ATM)接口、高速串行接口(HSSI)接口、销售点(POS)接口、光纤数据分布式接口(FDDIs)等。一般来讲,这种接口110可以包括适用于与合适的介质通信的端口。在一些情况下,它们还可以包括独立的处理器,并且在一些情况下,包括易失性和/或非易失性存储器(例如,RAM)。In one embodiment, interface 110 is configured as a network interface card (NIC). In general, the NIC controls the sending and receiving of data packets over the computer network; other types of interface 110 may, for example, support other peripheral devices for use with computing device 100 . The interfaces that can be provided are Ethernet interface, frame relay interface, cable interface, DSL interface, token ring interface, graphic interface and so on. Furthermore, various types of interfaces may be provided such as, for example, Universal Serial Bus (USB), Serial, Ethernet, FIREWIRE ™ , PCI, Parallel, Radio Frequency (RF), Bluetooth (BLUETOOTH) ™ , Near Field Communication (e.g. , using near-field magnetic), 802.11 (WiFi), Frame Relay, TCP/IP, ISDN, Fast Ethernet interface, Gigabit Ethernet interface, Asynchronous Transfer Mode (ATM) interface, High Speed Serial Interface (HSSI) interface, Point of Sale (POS) interfaces, Fiber Data Distributed Interfaces (FDDIs), etc. In general, such interface 110 may include ports adapted to communicate with a suitable medium. In some cases, they may also include a separate processor, and in some cases, volatile and/or non-volatile memory (eg, RAM).
尽管图1示出的系统图示了用于实施本文所述的一个或多个发明的计算设备100的一个具体架构,但是这绝非是可以实施本文所述的特征和技术的至少一部分的唯一的设备架构。例如,可以使用具有一个或任意数量的处理器103的架构,并且这种处理器103可以存在于单个设备中或者分布在任意数量的设备之间。在一个实施例中,单个处理器103处理通信以及路由计算,而在其他实施例中,可以提供单独的专用通信处理器。在各种实施例中,在根据本发明的系统中可以实施不同类型的特征或功能,所述系统包括客户端设备(例如,运行客户端软件的平板设备或智能手机)和服务器系统(例如,以下更详细地描述的服务器系统)。While the system shown in FIG. 1 illustrates one specific architecture for a computing device 100 for implementing one or more of the inventions described herein, this is by no means the only one in which at least a portion of the features and techniques described herein may be implemented. device architecture. For example, an architecture with one or any number of processors 103 may be used, and such processors 103 may be present in a single device or distributed among any number of devices. In one embodiment, a single processor 103 handles communications as well as routing calculations, while in other embodiments a separate dedicated communications processor may be provided. In various embodiments, different types of features or functions may be implemented in systems according to the invention, including client devices (e.g., tablet devices or smartphones running client software) and server systems (e.g., server system described in more detail below).
不论网络设备的配置,本发明的系统可以采用一个或多个存储器或存储模块(诸如例如,远程存储器块120和本地存储器101),该存储器或存储模块被配置成存储数据、用于通用网络运行的程序指令或与本文所述的实施例的功能相关的其他信息(或上述的任意组合)。程序指令可以控制例如运行系统和/或一个或多个应用的执行或者包括运行系统和/或一个或多个应用。存储器120或存储器101、120也可以被配置成存储数据结构、配置数据、加密数据、历史系统运行信息或本文所述的任何其他专门或通用的非程序信息。Regardless of the configuration of the network devices, the system of the present invention may employ one or more memory or storage modules (such as, for example, remote memory block 120 and local memory 101) configured to store data for general network operation program instructions or other information related to the functionality of the embodiments described herein (or any combination of the foregoing). Program instructions may control, for example, execute the execution system and/or one or more applications or include the execution system and/or one or more applications. Memory 120 or memory 101, 120 may also be configured to store data structures, configuration data, encrypted data, historical system operating information, or any other non-programmatic information, specific or general, as described herein.
因为可以采用这些信息和程序指令来实施本文所述的一个或多个系统或方法,所以至少一些网络设备实施例可以包括非瞬态机器可读的存储介质,所述存储介质例如可以被配置成或设计成存储用于执行本文所述的各种运行的程序指令、状态信息等。这种非瞬态机器可读的存储介质的实例包括,但不限于,磁介质,例如硬盘、软盘和磁带;光介质,例如CD-ROM盘;磁光介质,例如,光盘,和专门被配置成存储并执行程序指令的硬件设备,例如只读存储器装置(ROM)、闪存存储器、固态驱动器、忆阻存储器、随机存取存储器(RAM)等。程序指令的实例包括例如可以由编译器产生的目标代码,例如可以由编译器或链接器产生的机器代码,例如可以由例如JAVATM编译器产生的并且可以通过使用Java虚拟机或等同物执行的字节代码,或包含可以由使用解释器的计算机执行的高级代码(例如,用Python、Perl、Ruby、Groovy或任何其他脚本语言编写的脚本)的文件。Because such information and program instructions may be employed to implement one or more of the systems or methods described herein, at least some network device embodiments may include a non-transitory machine-readable storage medium that may, for example, be configured as Or designed to store program instructions, status information, etc. for performing the various operations described herein. Examples of such non-transitory machine-readable storage media include, but are not limited to, magnetic media, such as hard disks, floppy disks, and magnetic tape; optical media, such as CD-ROM disks; magneto-optical media, such as optical disks, and specially configured A hardware device that stores and executes program instructions, such as read-only memory (ROM), flash memory, solid-state drive, memristive memory, random access memory (RAM), and the like. Examples of program instructions include, for example, object code that can be generated by a compiler, such as machine code that can be generated by a compiler or a linker, such as can be generated by, for example, a JAVA ™ compiler and can be executed by using a Java virtual machine or equivalent. Byte code, or a file containing high-level code (such as a script written in Python, Perl, Ruby, Groovy, or any other scripting language) that can be executed by a computer using an interpreter.
在一些实施例中,根据本发明的系统可以在独立的计算系统上实施。现在参见图2,示出了框图,该框图描绘了在独立的计算系统上的一个或多个实施例或其部件的典型的示例性架构。计算设备200包括可以运行软件的处理器210,所述软件执行本发明的实施例一个或多个功能或应用,诸如例如,客户端应用230。处理器210可以在运行系统220(例如,Microsoft的WINDOWSTM运行系统、Apple的MacOS/X或iOS运行系统、Linux运行系统的一些变形、Google的ANDROIDTM运行系统等)的控制下执行计算指令。在许多情况下,一个或多和共享服务225可以在系统200中运行,并且可以用于向客户端应用230提供常见服务。服务225可以例如是WINDOWSTM服务、Linux环境中的用户空间常见服务或与运行系统210一起使用的任何其他类型的常见服务架构。输入设备270可以是适用于接收用户输入的任何类型,包括例如键盘、触摸屏、麦克风(例如,用于语音输入)、鼠标、触摸板、轨迹球或它们的任意组合。输出设备260可以是适用于向一个或多个用户(不论是系统200的远程用户或是本地用户)提供输出的任意类型,并且可以包括例如用于视觉输出的一个或多个屏幕、扬声器、打印机或它们的任意组合。存储器240可以是具有本领域中已知的任何结构或架构的随机存取存储器,以供处理器210使用,例如用于运行软件。存储设备250可以是用于以数字形式存储数据的任何磁、光、机械、忆阻或电存储设备。存储设备250的实例包括闪存、磁性硬盘驱动器、CD-ROM等。In some embodiments, a system according to the present invention may be implemented on a stand-alone computing system. Referring now to FIG. 2 , there is shown a block diagram depicting a typical exemplary architecture of one or more embodiments, or components thereof, on a stand-alone computing system. Computing device 200 includes a processor 210 that can execute software that performs one or more functions or applications of embodiments of the invention, such as, for example, client application 230 . The processor 210 may execute computing instructions under the control of an operating system 220 (eg, Microsoft's WINDOWS ™ operating system, Apple's MacOS/X or iOS operating system, some variants of the Linux operating system, Google's ANDROID ™ operating system, etc.). In many cases, one or more shared services 225 can run in system 200 and can be used to provide common services to client applications 230 . The service 225 may be, for example, a WINDOWS ™ service, a user-space common service in a Linux environment, or any other type of common service framework used with the runtime system 210 . Input device 270 may be of any type suitable for receiving user input including, for example, a keyboard, touch screen, microphone (eg, for voice input), mouse, touch pad, trackball, or any combination thereof. Output devices 260 may be of any type suitable for providing output to one or more users, whether remote or local to system 200, and may include, for example, one or more screens for visual output, speakers, printers or any combination of them. The memory 240 may be random access memory having any structure or architecture known in the art for use by the processor 210, eg, for running software. Storage device 250 may be any magnetic, optical, mechanical, memristive, or electrical storage device for storing data in digital form. Examples of storage device 250 include flash memory, magnetic hard drives, CD-ROMs, and the like.
在一些实施例中,本发明的系统可以在分布式计算网络(例如,具有任意数量的客户端和/或服务器的计算网络)上实施。现在参见图3,示出了框图,该框图描绘了用于在分布式计算网络上实施根据本发明的实施例的系统的至少一部分的示例性架构。根据实施例,可以提供任意数量的客户端330。每个客户端330可以运行用于实施本发明的客户端侧部分的软件;客户端可以包括例如图2中所示的系统200。此外,可以提供任意数量的服务器320用于处理从一个或多个客户端330接收的请求。客户端330和服务器320可以通过一个或多个电子网络310彼此通信,该电子网络在许多实施例中可以是互联网、广域网、移动电话网络、无线网(例如,WiFi、Wimax等)或局域网(或事实上本领域中已知的任何网络拓扑;本发明并不优选任何一种网络拓扑结构)中的任意一个。网络310可以通过使用任何已知的网络协议(包括例如有线和/或无线协议)来实施。In some embodiments, the system of the present invention can be implemented on a distributed computing network (eg, a computing network with any number of clients and/or servers). Referring now to FIG. 3 , there is shown a block diagram depicting an exemplary architecture for implementing at least a portion of a system according to an embodiment of the present invention over a distributed computing network. Depending on the embodiment, any number of clients 330 may be provided. Each client 330 may run software for implementing the client-side portion of the invention; a client may include, for example, the system 200 shown in FIG. 2 . Additionally, any number of servers 320 may be provided for processing requests received from one or more clients 330 . Client 330 and server 320 may communicate with each other over one or more electronic networks 310, which in many embodiments may be the Internet, a wide area network, a mobile phone network, a wireless network (e.g., WiFi, Wimax, etc.), or a local area network (or Virtually any network topology known in the art; the present invention does not prefer any one of them. Network 310 may be implemented using any known network protocols including, for example, wired and/or wireless protocols.
此外,在一些实施例中,服务器320在需要时可以呼叫外部服务370以获得额外的信息,或者参考有关具体呼叫的附加数据。与外部服务370的通信可以例如通过一个或多个网络310进行。在各种实施例中,外部服务370可以包括与硬件设备本身有关或安装在硬件设备本身上的网络可用的服务或功能。例如,在客户端应用230在智能手机或其他电子设备上实施的实施例中,客户端应用230可以获得存储在云端的服务器系统320中或者部署在有关在一个或多个特定的企业或用户的楼宇中的外部服务370上的信息。Additionally, in some embodiments, server 320 may call external service 370 to obtain additional information, or refer to additional data about a particular call, if desired. Communication with external services 370 may occur, for example, over one or more networks 310 . In various embodiments, external services 370 may include network-available services or functions associated with or installed on the hardware device itself. For example, in an embodiment where the client application 230 is implemented on a smart phone or other electronic device, the client application 230 may obtain information stored in the server system 320 in the cloud or be deployed on a server system related to one or more specific enterprises or users. Information on external services 370 in the building.
在本发明的一些实施例中,客户端330或服务器320(或两者)可以利用能够本地或横跨一个或多个网络310远程地部署的一个或多个专用服务或应用。例如,一个或多个数据库340可以供本发明的一个或多个实施例使用或者参考。本领域的普通技术人员应当理解,数据库340可以布置在各种各样的架构中并且使用各种各样的数据访问和运行装置。例如,在各种实施例中,一个或多个数据库340可以包括使用结构化查询语言(SQL)的相关数据库系统,而其他数据库可以包括另选的数据存储技术,例如在本领域中称为“NoSQL”(例如,HadoopCassandra、GoogleBigTable等)的数据存储技术。在一些实施例中,根据本发明可以使用变形的数据库架构,例如,面向列的数据库、内存数据库、集群数据库、分布式数据库、甚至平面文件的数据存储库。本领域的普通技术人员应当理解,可以酌情使用已知的或未来的数据库技术的任何组合,除非对于本文的具体实施例指定了具体的数据库技术和部件的具体布置。此外,应当理解,如本文所用的术语“数据库”可以指的是物理数据库机器、用作单个数据库系统的机器群或位于整个数据库管理系统中的逻辑数据库。除非对给定使用的术语“数据库”指明具体含义,否则“数据库”应当被理解成是指该词语这些含义中的任何一个,本领域的普通技术人员应该将所有这些含义都理解成术语“数据库”的简单含义。In some embodiments of the invention, client 330 or server 320 (or both) may utilize one or more dedicated services or applications that can be deployed locally or remotely across one or more networks 310 . For example, one or more databases 340 may be used or referenced by one or more embodiments of the invention. Those of ordinary skill in the art will appreciate that the database 340 can be arranged in a variety of architectures and using a variety of data access and execution devices. For example, in various embodiments, one or more databases 340 may comprise a relational database system using Structured Query Language (SQL), while other databases may comprise alternative data storage techniques, such as are known in the art as "SQL" NoSQL" (for example, Hadoop Cassandra, Google BigTable, etc.) data storage technology. In some embodiments, deformed database architectures may be used in accordance with the present invention, such as column-oriented databases, in-memory databases, clustered databases, distributed databases, or even flat-file data stores. Those of ordinary skill in the art will understand that any combination of known or future database technologies may be used as appropriate, unless a specific database technology and a specific arrangement of components is specified for a specific embodiment herein. Furthermore, it should be understood that the term "database" as used herein may refer to a physical database machine, a cluster of machines acting as a single database system, or a logical database located within an overall database management system. Unless a specific meaning is indicated for a given use of the term "database", "database" should be understood to refer to any of these meanings of the word, and those of ordinary skill in the art should understand all of these meanings to mean the term "database". The simple meaning of ".
类似地,本发明的大部分实施例可以利用一个或多个安全系统360和配置系统350。安全和配置管理是常见的信息技术(IT)和网络功能,并且每种技术在一定程度上通常与任何IT或网络系统相关。本领域的普通技术人员应当理解,本领域中现在或将来已知的任何配置或安全子系统可以不受限制地与本发明的实施例结合使用,除非任何具体实施例的描述专门要求具体的安全360或配置系统350或方法。Similarly, most embodiments of the invention may utilize one or more of security system 360 and configuration system 350 . Security and configuration management are common information technology (IT) and network functions, and each technology is typically associated with any IT or network system to some extent. Those of ordinary skill in the art will appreciate that any configuration or security subsystem known in the art, now or in the future, may be used in conjunction with embodiments of the present invention without limitation, unless the description of any particular embodiment specifically requires specific security 360 or configuration system 350 or method.
在各种实施例中,用于实施本发明的系统或方法的功能可以分布在任意数量的客户端和/或服务器部件中。例如,可以实施各种软件模块以执行与本发明有关的各种功能,并且这些模块可以以各种方式实施以在服务器和/或客户端部件上运行。In various embodiments, the functionality used to implement the systems or methods of the present invention may be distributed among any number of client and/or server components. For example, various software modules can be implemented to perform various functions related to the present invention, and these modules can be implemented in various ways to run on server and/or client components.
概念架构conceptual framework
图4是本发明的优选实施例的框图,图示了包含常见联络中心元件并且与实际的联络中心运行并列运行的用于自动化的聊天检测的系统。如图所示,联络中心400可以实施TCM平台401,该TCM平台可以用作检测案例的开始或开端。TCM平台401可以自动运行,或者可选地通过图形用户界面接收人类交互,该图形用户界面用于运行检测案例和查看可以存储在检测数据库402中的检测结果报告。当运行检测时,TCM平台401利用聊天处理系统403和CCM平台410发起检测案例,然后聊天处理系统403和CCM平台410均可以开始它们各自的自动化的检测过程。聊天处理系统403可以模拟多个虚拟客户405,该虚拟客户通过网络服务器404运行以经由互联网或其他数据通信网络406发送并接收数据,而CCM平台410可以类似地模拟虚拟联络中心代理者411,该虚拟联络中心代理者可以接收并响应数据请求。由模拟的客户405通过数据网络406发送的数据请求可以由路由器407接收并处理,该路由器可以通过数据网络407转发从客户到交互服务器408的请求以及从代理者到客户的请求。交互服务器408可以使用聊天分类器409验证数据请求,该聊天分类器可以将请求识别为检测案例或实际联络中心运行的一部分以确定处理协议。如果请求被确定为测试案例的一部分,交互服务器408就可以以检测案例处理继续。如果请求从路由器407入站,该请求可以被转发到CCM平台410以供虚拟代理者411处理,或者如果请求是来自虚拟代理者411的出站请求,该请求可以被发送到路由器407用于通过数据网络406输送到虚拟客户405。根据检测案例的具体属性,虚拟代理者411可以通过与交互服务器408直接交互或者与真实或模拟代理者桌面环境自动交互来进行运行。在执行检测案例期间和/或之后,数据可以由CCM平台410或聊天处理系统403存储在数据库402中,用于构建将要存储的检测报告,以供用户随后通过TCM平台401查看。这样,应当理解,检测案例内的数据请求流是双向的,即,可以从模拟客户405连续且非同步地将请求发送到模拟代理者411并且反之亦然,而不要求严格的数据流模式或节奏。应当理解,这样就能够模拟客户正在发送多个聊天请求而代理者等待发送响应,或者代理者发送多个请求而客户在等待。这种情形实际上司空见惯,并且这样,检测案例可以更精确地模拟实际联络中心运行,从而得到更相关且可靠的检测数据。Figure 4 is a block diagram of a preferred embodiment of the present invention illustrating a system for automated chat detection comprising common contact center elements and running in parallel with actual contact center operations. As shown, the contact center 400 can implement a TCM platform 401 that can be used to detect the initiation or initiation of a case. The TCM platform 401 can run automatically, or optionally receive human interaction through a graphical user interface for running test cases and viewing test result reports, which can be stored in the test database 402 . When running a test, the TCM platform 401 utilizes the chat processing system 403 and the CCM platform 410 to initiate a test case, and then both the chat processing system 403 and the CCM platform 410 can start their respective automated testing processes. The chat processing system 403 can emulate a plurality of virtual clients 405 running through a web server 404 to send and receive data via the Internet or other data communication network 406, while the CCM platform 410 can similarly emulate a virtual contact center agent 411, which Virtual contact center agents can receive and respond to data requests. Data requests sent by simulated clients 405 over data network 406 may be received and processed by router 407, which may forward requests from clients to interaction servers 408 and from agents to clients over data network 407. The interaction server 408 can validate the data request using a chat classifier 409, which can identify the request as part of a test case or actual contact center operation to determine a handling protocol. If the request is determined to be part of a test case, the interaction server 408 may continue with test case processing. If the request is inbound from router 407, the request can be forwarded to CCM platform 410 for processing by virtual agent 411, or if the request is an outbound request from virtual agent 411, the request can be sent to router 407 for processing by Data network 406 delivers to virtual guest 405 . Depending on the specific attributes of the test case, the virtual agent 411 may operate by interacting directly with the interaction server 408 or automatically interacting with a real or simulated agent desktop environment. During and/or after execution of a test case, data may be stored in database 402 by CCM platform 410 or chat processing system 403 for building test reports to be stored for subsequent viewing by users through TCM platform 401 . As such, it should be understood that the flow of data requests within a test case is bi-directional, i.e., requests can be sent continuously and asynchronously from the simulated client 405 to the simulated broker 411 and vice versa without requiring a strict data flow pattern or Rhythm. It should be appreciated that this enables the simulation of a customer sending multiple chat requests while the agent is waiting to send a response, or an agent sending multiple requests while the customer is waiting. Such situations are actually commonplace, and as such, test cases can more accurately simulate actual contact center operations, resulting in more relevant and reliable test data.
如图所示,根据实施例,在执行检测案例时,在联络中心400内的正常运行可以不被中断而继续。客户420可以继续正常地运行聊天界面421,根据图示的流程发送聊天请求到联络中心代理者422,而检测案例对客户体验没有任何影响。聊天请求可以通过数据网络406从聊天界面421发送,然后可以由联络中心内的路由器407接收并处理。路由器407然后可以将请求发送到交互服务器408,该交互路由器然后可以利用聊天分类器409验证请求以确定它们的性质为合法的客户交互。然后可以将请求发送到代理者421,并且沿着相反路径通过交互服务器408、路由器407返回请求,然后通过数据网络406从联络中心400向外到达客户的聊天界面421。这样,应当理解,正常的联络中心运行可以与检测案例并行运行,而对客户体验没有任何的影响。As shown, normal operations within the contact center 400 may continue without interruption while a test case is being executed, according to an embodiment. The customer 420 can continue to run the chat interface 421 normally, and send a chat request to the contact center agent 422 according to the illustrated flow, and the detection case has no impact on the customer experience. Chat requests may be sent from chat interface 421 over data network 406, and may then be received and processed by router 407 within the contact center. Router 407 may then send the requests to interaction server 408, which may then validate the requests with chat classifier 409 to determine their nature as legitimate customer interactions. The request may then be sent to the agent 421 and returned along the reverse path through the interaction server 408, the router 407, and then out through the data network 406 from the contact center 400 to the customer's chat interface 421. As such, it should be understood that normal contact center operations can run in parallel with detection cases without any impact on customer experience.
图8是本发明的优选实施例的框图,图示了在联络中心800内用于自动化的音频质量检测的系统。如图所示,网络服务器801可以将参考音频802(即,模拟客户与联络中心代理者的交互的音频样本)发送到呼叫引擎803。类似地,网络服务器807可以用于将代表联络中心代理者参与交互的音频样本的参考音频808发送到端点模拟器806。呼叫引擎803然后可以通过PSTN804或类似网络(例如,在VoIP呼叫的情况下,为互联网或类似数据网络)发起模拟呼叫,联络中心800内的路由器805可以连接至该网络。路由器805然后可以确定将呼叫模拟发送到端点模拟器806,该端点模拟器可以使用此前接收的参考音频808来模拟联络中心代理者对呼叫的响应。如图所示,可以在呼叫引擎803与端点模拟器807之间建立双向呼叫流,从而酌情便于持久交互的连续呼叫模拟。每次呼叫引擎803或端点模拟器807接收到音频时,可以基于音频的质量对其进行打分并且将此分数可选地存储在数据库809或类似的存储介质中,用于随后检索以便检查或分析。这样,方便了对于联络中心的系统的音频质量的自动化检测,并且这种检测结果被存储以便在各种进一步的应用的任一种中使用,例如(例如)生成详述检测结果的报告或者分析此前的检测结果以便于对将来的检测或联络中心运行进行优化。应当理解,图示的构造是示例性的,并且根据本发明可以利用各种额外或替代的元件,从而使此类系统能够具有灵活的性质并且容易适用于各种联络中心架构。FIG. 8 is a block diagram of a preferred embodiment of the present invention, illustrating a system for automated audio quality detection within a contact center 800 . As shown, web server 801 may send reference audio 802 (ie, audio samples simulating a customer's interaction with a contact center agent) to call engine 803 . Similarly, web server 807 may be used to send reference audio 808 to endpoint emulator 806 representing audio samples of contact center agents engaging in interactions. The call engine 803 can then initiate a simulated call over a PSTN 804 or similar network (eg, the Internet or similar data network in the case of a VoIP call) to which a router 805 within the contact center 800 can connect. Router 805 may then determine to send a call simulation to endpoint simulator 806, which may use previously received reference audio 808 to simulate a contact center agent's response to the call. As shown, a two-way call flow can be established between the call engine 803 and the endpoint emulator 807, facilitating continuous call simulation of persistent interactions as appropriate. Each time the call engine 803 or endpoint emulator 807 receives audio, it can be scored based on the quality of the audio and this score optionally stored in a database 809 or similar storage medium for later retrieval for inspection or analysis . In this way, automated testing of the audio quality of a system in a contact center is facilitated, and the results of such testing are stored for use in any of a variety of further applications, such as, for example, generating a report or analysis detailing the testing results Previous inspection results are used to optimize future inspections or contact center operations. It should be understood that the illustrated configurations are exemplary and that various additional or alternative elements may be utilized in accordance with the present invention, thereby enabling such systems to be flexible in nature and readily adaptable to various contact center architectures.
示例性实施例的详细描述Detailed Description of Exemplary Embodiments
图5是本发明的优选实施例的方法图示,图示了用于处理联络中心内的自动化的聊天检测的一般流程。在起始步骤501,检测案例开始。这种检测案例可以作为计划的事件或例程的一部分自动触发,或者可以通过如上所述的用户与TCM平台401的交互手动触发。在第二步骤502中,在检测系统内创建虚拟代理者和虚拟客户,并且他们的创建结果可以在记录步骤507期间记录在检测数据库402或者其他存储介质中。然后在步骤503中,虚拟客户发起聊天会话,并且在记录步骤507中可以再次记录结果。然后在步骤503中,聊天分类器将此聊天会话分类作为检测案例的一部分以确保边界强化,从而使得检测数据在联络中心运行期间不会与生产环境数据重叠或者另外干涉。一旦接收到检测聊天请求,虚拟代理者就可以在步骤504中进行响应,并且在记录步骤505中记录此响应的结果。根据检测案例,在步骤506中,CCM平台410可以与真实或虚拟代理者桌面进行交互以检测代理者体验并且对联络中心运行进行进一步评价,并且可以在记录步骤507中记录此交互的结果。最后,在报告步骤508中,可以对从检测案例的此前步骤记录的信息进行汇总并制定成结果报告,该结果报告可以进一步存储在数据库402或类似的存储介质中以供随后检索。应当理解,这种方法流程是示例性的,并且尽管发明人认为图示的流程是理想的方案,但是根据本发明,替代的实施方式也是可行的。应当进一步理解,检测案例可以包含替代或附加的部件,并且图示的流程不应当理解成将检测过程的范围限制在仅仅图示的要素,因为本发明的关键特征是可扩展性并且因此本发明可以容易地适应实施为插入如图所示的检测过程中的附加步骤的各种各样的联络中心架构。Figure 5 is a method diagram of a preferred embodiment of the present invention illustrating the general flow for handling automated chat detection within a contact center. In a start step 501, a detection case starts. Such detection cases may be automatically triggered as part of a scheduled event or routine, or may be manually triggered through user interaction with the TCM platform 401 as described above. In a second step 502, virtual agents and virtual clients are created within the detection system, and their creation results can be recorded during a recording step 507 in the detection database 402 or other storage medium. Then in step 503 the virtual customer initiates a chat session and in recording step 507 the results can be recorded again. Then in step 503, the chat classifier classifies this chat session as part of a detection case to ensure boundary hardening so that detection data does not overlap or otherwise interfere with production environment data during contact center operations. Upon receiving the detect chat request, the virtual agent may respond in step 504 and record the result of this response in recording step 505 . Depending on the detection case, in step 506 the CCM platform 410 may interact with real or virtual agent desktops to monitor agent experience and further evaluate contact center operations, and may record the results of this interaction in recording step 507 . Finally, in the reporting step 508, the information recorded from the previous steps of the detection case can be summarized and formulated into a result report, which can be further stored in the database 402 or similar storage medium for subsequent retrieval. It should be understood that this method scheme is exemplary, and that while the inventors believe that the illustrated scheme is an ideal solution, alternative implementations are possible in accordance with the invention. It should be further understood that test cases may contain alternative or additional components, and that the illustrated flow should not be construed as limiting the scope of the test process to only the illustrated elements, as a key feature of the present invention is scalability and therefore the present invention A wide variety of contact center architectures implemented as additional steps inserted into the detection process as shown can be easily adapted.
图6是根据本发明的优选实施例的用于在TCM平台内创建用户和修改检测案例的示例性的图形用户界面600的图示。如图所示,界面600可以包括多个部件,例如,用于建立新的检测步骤的交互式按钮或类似元件601,描述现有的检测步骤的要素的多个文本栏,例如步骤描述602,等待的文本串603,待发送的文本604、步骤之间的暂停长度的标准605,用于删除步骤的可点击的或交互式元件606或用于选择步骤以执行批处理运行的可点击的或交互式元件609,用于对步骤进行重新排序的可点击的或交互式元件607,用于对现有的步骤进行编辑的可点击的或交互式元件608,或者用于对选择的步骤进行运行的可点击的或交互式元件610,例如(如图所示)删除单个运行中的多个步骤。FIG. 6 is an illustration of an exemplary graphical user interface 600 for creating users and modifying detection cases within the TCM platform, according to a preferred embodiment of the present invention. As shown, the interface 600 may include a number of components, such as an interactive button or similar element 601 for creating a new test step, a number of text fields describing elements of an existing test step, such as a step description 602, Text string to wait 603, text to send 604, criteria 605 for pause length between steps, clickable or interactive element 606 for deleting a step or clickable or Interactive element 609, clickable or interactive element to reorder steps 607, clickable or interactive element 608 to edit an existing step, or to run a selected step Clickable or interactive elements 610 of , for example (as shown) delete multiple steps in a single run.
当创建步骤时,用户可以提供各种信息以识别并控制检测步骤的行为。例如,如图所示,可以实施描述栏602以识别步骤,以便容易理解此前建立的检测案例。如图所示的行为控制域可以包括检测代理者或客户在处理之前必须等待接收的文本串603,或者当发起步骤时应当发送的类似的文本串604。这样,每个步骤可以模拟“发送-接收”模式以模拟客户-代理者交互,或者步骤可以仅包括两个域中的一个以便模拟非对称交互,其中一方可能在接收响应之前发送多个聊天消息。如图进一步图示,可以实施数字的行为控制要素,例如,以便指明步骤之间的等待时间605,从而控制检测案例的步调。这可以实施以便于联络中心在高流量下的“压力检测”,或者对检测步调以分配系统负载以便在检测其他特征或系统时(即,在压力检测不是检测案例的目的时)避免基于负载的故障。When creating a step, the user can provide various information to identify and control the behavior of the detection step. For example, as shown, a description column 602 may be implemented to identify steps for easy understanding of previously established test cases. The behavior control field as shown may include a text string 603 that the detection agent or client must wait to receive before processing, or a similar text string 604 that should be sent when a step is initiated. This way, each step can emulate a "send-receive" pattern to simulate a client-agent interaction, or a step can include only one of the two domains in order to simulate an asymmetric interaction, where one party may send multiple chat messages before receiving a response . As further illustrated, numerical behavioral control elements may be implemented, for example, to specify wait times 605 between steps, thereby controlling the pace of detection cases. This can be implemented to facilitate "stress detection" of contact centers under high traffic, or to pace detection to distribute system load to avoid load-based Fault.
图7是根据本发明的优选实施例的用于查看检测结果报告的示例性的图形用户界面700的图示。如图所示,界面700可以包括旨在输送信息的各种元件,这些信息包含在如此前所述的此前运行或当前运行的检测案例的存储日志中,这些元件可选地包括可点击或交互式按钮701和707、文本显示域702、文本输入域706、图形或基于文本的表格或图表703、704和705或本领域中常见的多种其他用户界面元件中的任一种。如图所示的这些元件是示例性的,并且应当理解,根据本发明,利用替代、附加或较少元件的各种构造也是可行的,然而,图示的构造是作为发明人优选的向用户显示所需内容的有效方法。FIG. 7 is an illustration of an exemplary graphical user interface 700 for viewing a test result report in accordance with a preferred embodiment of the present invention. As shown, interface 700 may include various elements designed to convey information contained in a stored log of previously run or currently run test cases as previously described, these elements optionally including clickable or interactive Buttons 701 and 707, text display fields 702, text entry fields 706, graphical or text-based tables or charts 703, 704, and 705, or any of a variety of other user interface elements commonly known in the art. The elements shown are exemplary, and it should be understood that various configurations utilizing alternative, additional or fewer elements are possible in accordance with the invention, however, the illustrated configurations are presented as the inventor's preferred Efficient way to display desired content.
如图所示,可点击的或用户交互式元件,例如,按钮或下拉列表式菜单701可以显示并允许用户选择结果报告用于查看,这些结果报告选自存储介质(例如数据库402)中可用的各种报告。用户可以从这些元件选择报告,该元件然后可以动态更新界面700的显示内容以反映来自所选的报告的相关数据。可以实施文本显示域702来向用户呈现非交互的数据,即,与用户应当不需要或不能够运行的前一个检测案例有关的记录信息,因为可能需要该信息以防止由于人为篡改或失误引起的不一致或不可靠的数据。这样呈现的信息可以包括(但不限于)检测案例或检测活动名称、在检测案例期间执行的聊天会话或请求的量的计数以及时间戳数据,例如,运行检测或发起聊天的日期和时间。应当理解,根据检测案例的具体性质并且根据联络中心内的本发明的具体实施方式,这些信息可能极为不同,并且如图所示的这些信息是示例性的,并且根据本发明,可以显示替代、代替或附加的信息。As shown, a clickable or user-interactive element, such as a button or drop-down menu 701, may display and allow the user to select a result report for viewing, selected from those available in a storage medium (e.g., database 402). Various reports. A user can select a report from these elements, which can then dynamically update the display of interface 700 to reflect relevant data from the selected report. The text display field 702 can be implemented to present non-interactive data to the user, i.e., recorded information related to a previous test case that the user should not need or be able to run, as this information may be needed to prevent errors due to human tampering or error. Inconsistent or unreliable data. The information so presented may include, but is not limited to, detection case or detection activity names, counts of the amount of chat sessions or requests performed during the detection case, and timestamp data, such as the date and time the detection was run or the chat was initiated. It should be understood that this information may vary greatly depending on the specific nature of the detection case and depending on the particular implementation of the invention within the contact center, and that such information as shown is exemplary and that, in accordance with the invention, alternative, SUBSTITUTE OR ADDITIONAL INFORMATION.
界面700还可以包括(如图所示)许多图形的或基于文本的表格或图表703、704和705,用于向用户呈现制定或者另外组织的数据。涉及到图形表格703,例如,表示通过或失败的检测的相对百分比的圆形,或者可能适用于以图形呈现的其他统计,例如持续时间或数量。这种图形可能是可点击的或者用户交互式的,这种交互性可选地允许用户修改在图形内呈现的信息并且在作出选择时可选地对显示进行动态更新。这样,用户可以简洁地查看针对给定报告的多个统计资料,而不需要在界面700内混杂大量图形,并且用户能够仅查看感兴趣的数据,而不必浏览不相关或不需要的信息,从而减少用户的时间和恼怒,并且通过降低误解数据的风险来增加分析的可靠性。可以实施基于文本的表格或图表704以在检测案例内的单独交互上将这些数据作为详细信息显示,例如(如图所示)作为检测的一部分发起的聊天交互的名称或类型、交互的数量或其他数值测量以及在显示的交互中的成功和失败的比例。应当理解,根据本发明,如图所示的这些信息是示例性的,并且可以根据联络中心内的具体报告或实施方式呈现附加或替代的信息。Interface 700 may also include (as shown) a number of graphical or text-based tables or charts 703, 704, and 705 for presenting formulated or otherwise organized data to a user. A graphical table 703 is referred to, for example, circles representing relative percentages of passed or failed detections, or possibly other statistics presented graphically, such as duration or number. Such graphics may be clickable or user-interactive, which optionally allows the user to modify the information presented within the graphics and optionally dynamically update the display as selections are made. In this way, a user can concisely view multiple statistics for a given report without cluttering the interface 700 with numerous graphics, and the user is able to view only the data of interest without having to browse through irrelevant or unnecessary information, thereby Reduce user time and frustration, and increase the reliability of your analysis by reducing the risk of misinterpreting data. A text-based table or chart 704 can be implemented to display these data as details on individual interactions within a detection case, such as (as shown) the name or type of chat interaction initiated as part of the detection, the number of interactions, or Other numerical measures and ratios of successes and failures in the displayed interactions. It should be understood that such information as shown is exemplary and that additional or alternative information may be presented according to specific reports or implementations within the contact center in accordance with the present invention.
可以显示基于文本的表格或图表705,该表格或图表呈现从检测案例内的交互记录的详细信息。这些信息可以包括(但是不限于)交互数量和名称、存储交互的记录的信息的位置、交互的时间或持续时间、具有可选地可变的详细等级的交互的执行的结果(例如,简单的通过/失败或详细的错误报告)或可点击或者用户交互的元件,例如,超链接或按钮,因为可以用于(如图所示)在点击时显示交互的视觉记录。应当理解,这些信息是示例性的,并且可以根据联络中心内的具体报告或实施方式宽泛地变化,此外,用户可以通过选择在图表或表格的任何特定的域、行或列中显示什么数据来自定义这些信息以便仅仅查看如上所述感兴趣的数据。因此,可以利用可点击或者用户交互式元件控制在图表或表格中显示的数据,例如,用户可以输入具体的交互名称或数量以更详细地查看的文本输入域706、使用户能够从可选地以排序方式分类或呈现的数据选择中挑选以供高效导航的可点击下拉菜单式域707。应当理解,这些元件是示例性的,并且根据本发明,所有图示的元件的性质和功能可以变化,并且新的方法和用户界面元件的构造在本领域内是可用的并且可以根据本发明来利用。A text-based table or graph 705 may be displayed presenting details recorded from the interactions within the detection case. Such information may include (but is not limited to) the number and name of the interaction, the location where recorded information for the interaction is stored, the time or duration of the interaction, the results of the execution of the interaction with an optionally variable level of detail (e.g., a simple pass/fail or detailed error reports) or clickable or user-interactive elements, such as hyperlinks or buttons, as can be used (as shown) to display a visual record of the interaction when clicked. It should be understood that this information is exemplary and may vary broadly depending on the specific report or implementation within the contact center, furthermore, the user may select what data to display in any particular field, row or column of the chart or table from Define these to view only the data of interest as described above. Thus, the data displayed in a chart or table can be controlled using clickable or user-interactive elements, for example, a text entry field 706 where the user can enter a specific interaction name or quantity to view in more detail, enabling the user to select from an optional A clickable drop-down menu-style field 707 for efficient navigation to select from sorted or presented data selections in a sorted manner. It should be understood that these elements are exemplary and that the nature and function of all illustrated elements may vary in accordance with the invention and that new methods and configurations of user interface elements are available in the art and may be implemented in accordance with the invention. use.
图9是本发明的优选实施例的方法图示,图示了用于处理在根据如上所述的系统(参见图8)的联络中心内可以利用的自动化的音频质量检测的一般流程。如图所示,在起始步骤901中,呼叫模拟开始。这可以通过网络界面(如此前图示,参见图8)或与检测系统交互的其他装置发起,并且可以作为手动或自动过程的一部分执行。在下一个步骤910中,向端点模拟器发送参考音频以用于模拟联络中心代理者对来自客户的入站交互的响应。在平行步骤920中,可以向呼叫引擎发送类似的参考音频以用于模拟客户与联络中心代理者的入站交互。在下一个步骤921中,用于客户模拟的参考音频可以通过入站呼叫处理装置(例如,通过PSTN或类似的电话网络或者通过互联网或用于网络电话呼叫交互的其他数据网络)发送到联络中心,并且可以根据用于入站交互的标准呼叫处理在联络中心内进行处理。在下一个步骤922中,参考音频可以在联络中心内路由到端点模拟器以用于模拟的代理者处理。在下一个步骤911中,端点模拟器可以根据质量对接收的音频进行打分,并且然后可以用在前一个步骤910中接收的参考音频来响应进来的参考音频,从而模拟代理者对客户交互的响应。在下一个步骤930中,可以通过出站处理装置将音频从端点模拟器发回到呼叫引擎,从而模拟被客户接收的代理者的响应。然后呼叫引擎可以根据质量对音频进行打分,并且在最后一个步骤931中,呼叫模拟可以可选地继续在呼叫引擎与端点模拟器之间交换参考音频,从而模拟客户与联络中心代理者之间持久的交互。在可选的步骤932中,来自此前的步骤911和930的打分数据可以存储在数据库或类似的数据存储介质中供将来使用,数据库或类似的存储介质可以在联络中心内部或外部(例如,在互联网或其他数据网络上远程的云端存储服务)。应当理解,图示的步骤是示例性的,并且根据本发明可以实施附加的步骤,并且根据具体的联络中心的布置可能是适合的,例如包括示例性系统中非特有的附加软件或硬件元件的另外的步骤。Figure 9 is a method diagram of a preferred embodiment of the present invention illustrating the general flow for handling automated audio quality detection that may be utilized within a contact center according to the system described above (see Figure 8). As shown, in an initial step 901, call simulation begins. This can be initiated through a web interface (as previously illustrated, see Figure 8) or other means of interacting with the detection system, and can be performed as part of a manual or automated process. In a next step 910, reference audio is sent to an endpoint simulator for use in simulating a contact center agent's response to an inbound interaction from a customer. In parallel step 920, similar reference audio may be sent to the call engine for use in simulating an inbound interaction of a customer with a contact center agent. In a next step 921, the reference audio for the customer simulation may be sent to the contact center via the inbound call processing means (e.g. via the PSTN or similar telephone network or via the Internet or other data network for VoIP call interactions), And can be handled within the contact center according to standard call handling for inbound interactions. In a next step 922, the reference audio may be routed within the contact center to an endpoint simulator for simulated agent processing. In a next step 911, the endpoint emulator can score the received audio according to quality, and can then respond to the incoming reference audio with the reference audio received in the previous step 910, thereby simulating the agent's response to the customer interaction. In a next step 930, audio may be sent from the endpoint emulator back to the call engine through the outbound processing means, simulating the agent's response received by the customer. The call engine can then score the audio based on quality, and in a final step 931, the call simulation can optionally proceed to exchange reference audio between the call engine and the endpoint simulator, thereby simulating a persistent interaction between the customer and the contact center agent. interaction. In optional step 932, the scoring data from previous steps 911 and 930 may be stored for future use in a database or similar data storage medium, which may be internal or external to the contact center (e.g., at Remote cloud storage services on the Internet or other data networks). It should be understood that the illustrated steps are exemplary and that additional steps may be implemented in accordance with the present invention and may be suitable depending on the particular contact center arrangement, such as those including additional software or hardware elements not unique to the exemplary system additional steps.
图10是本发明的实施例的框图,图示了用于联络中心800内的自动化的音频质量检测的系统。如图示和此前所述,网络服务器801可以向呼叫引擎803发送参考音频802,即,模拟客户与联络中心代理者的交互的的音频样本。根据实施例,可以实施多个音频生成设备1001来生成参考音频808以用于模拟对入站音频交互的代理者响应。参考音频可以通过代理者硬件1002(例如,电话手持式受话器或头戴式受话器)传输,或者通过代理者工作站上的音频软件传输以便用于检测VoIP呼叫交互。然后音频可以通过呼叫管理器1003发送,该呼叫管理器可以用于处理模拟代理者和客户之间的呼叫交互以及响应。呼叫引擎803可以通过PSTN804或类似网络(例如,在VoIP呼叫的情况下,为互联网或类似数据网络)发起模拟呼叫,联络中心800内的路由器805可以连接至该网络。路由器805然后可以确定以将呼叫模拟发送到呼叫管理器1003,该呼叫管理器可以使用此前接收的参考音频808以模拟联络中心代理者对呼叫的响应。如图所示,在呼叫引擎803与呼叫管理器1003之间可以建立双向呼叫流,从而酌情便于持久交互的连续呼叫模拟。每次呼叫引擎803或呼叫管理器1003接收音频时,可以基于音频的质量对其进行打分并且此分数可选地存储在数据库809或类似的存储介质中用于随后检索以便检查或分析。这样,方便了对于联络中心的系统的音频质量的自动化的检测,并且这种检测结果被存储以便在各种进一步的应用的任一种中使用,诸如(例如)生成详述检测结果的报告或者分析此前的检测结果以便于对将来的检测或联络中心运行进行优化。应当理解,图示的构造是示例性的,并且根据本发明可以利用各种额外或替代的元件,从而使系统能够具有灵活的性质并且容易适用于各种联络中心架构。FIG. 10 is a block diagram of an embodiment of the present invention illustrating a system for automated audio quality detection within a contact center 800 . As illustrated and previously described, web server 801 may send reference audio 802 , ie, an audio sample simulating a customer's interaction with a contact center agent, to call engine 803 . According to an embodiment, multiple audio generation devices 1001 may be implemented to generate reference audio 808 for simulating agent responses to inbound audio interactions. The reference audio may be transmitted through agent hardware 1002 (eg, a telephone handset or headset), or through audio software on an agent workstation for use in detecting VoIP call interactions. The audio can then be sent through the call manager 1003, which can be used to handle call interactions and responses between simulated agents and customers. Call engine 803 may initiate an analog call over PSTN 804 or similar network (eg, the Internet or similar data network in the case of a VoIP call) to which router 805 within contact center 800 may be connected. Router 805 may then determine to send a call simulation to call manager 1003, which may use previously received reference audio 808 to simulate a contact center agent's response to the call. As shown, a two-way call flow can be established between call engine 803 and call manager 1003, facilitating continuous call simulation of persistent interactions as appropriate. Each time the call engine 803 or call manager 1003 receives audio, it may be scored based on the quality of the audio and this score is optionally stored in a database 809 or similar storage medium for later retrieval for review or analysis. In this way, the automated detection of the audio quality of the contact center's systems is facilitated, and the results of such detections are stored for use in any of a variety of further applications, such as, for example, generating reports detailing the detection results or Analyze previous inspection results to optimize future inspection or contact center operations. It should be understood that the illustrated configuration is exemplary and that various additional or alternative elements may be utilized in accordance with the present invention, thereby enabling the system to be flexible in nature and readily adaptable to various contact center architectures.
图11是用于模拟联络中心代理者的示例性HATS设备1100的图示,该联络中心代理者包含人体躯干的物理和声学特性。如图所示,HATS设备1100可以具有人体躯干的一般物理形状和形式,并且可以以这种方式并且用这些材料构造以便为了声学准确性而复制人体的密度或其他性质。如图所示,HATS设备1100可以包括一体固定或可拆除地附接的音频生成设备1001,其可用于传输参考音频样本,从而将用嘴说话的代理者适当地模拟成一硬件,例如,电话头戴式受话器麦克风1103。HATS设备1100可以进一步包括多个一体式或可拆除地附接的音频接收器1102,其可以以这样一种方式设计和定位以便模拟人类代理者的耳朵,用于接收传输的音频(例如,来自电话头戴式受话器扬声器1104)。如图所示,HATS设备1100可以以这样一种方式使用以便模拟利用它们的工作站设备(例如(如图所示)电话头戴式受话器或其他设备)的代理者,,以便在与客户交互时更精确地模拟与它们的设备交互的人类代理者的音频性质。应当理解,如图所示的这种配置在本质上是示例性的,并且根据本发明可以利用替代的或附加的代理者硬件,包括(但不限于)电话头戴式受话器、手持式受话器、扬声器电话系统或其他设备,并且HATS设备1100可以容易地被适配成用于这种用途。FIG. 11 is a diagram of an exemplary HATS device 1100 for simulating a contact center agent incorporating the physical and acoustic characteristics of a human torso. As shown, the HATS device 1100 may have the general physical shape and form of a human torso, and may be constructed in such a manner and with these materials to replicate the density or other properties of the human body for acoustic accuracy. As shown, the HATS device 1100 may include an integral fixedly or removably attached audio generating device 1001 that may be used to transmit reference audio samples to properly simulate a speaking agent as a hardware, e.g., telephone head A headset microphone 1103. The HATS device 1100 may further include a plurality of integrally or removably attachable audio receivers 1102, which may be designed and positioned in such a manner as to simulate the ears of a human agent for receiving transmitted audio (e.g., from phone headset speaker 1104). As shown, the HATS device 1100 can be used in such a way as to emulate agents utilizing their workstation devices (such as (as shown) telephone headsets or other devices) so that when interacting with customers More accurately emulate the audio nature of human agents interacting with their devices. It should be understood that the configuration shown is exemplary in nature and that alternative or additional agent hardware may be utilized in accordance with the present invention, including but not limited to telephone headsets, handsets, speakerphone system or other device, and the HATS device 1100 can be easily adapted for such use.
图12是图示了根据本发明的实施例的用于可扩展的端对端聊天检测的运行的示例性方法1200的框图。根据实施例,检测可以利用互联网通信标准的现有元件,例如,HTTP文件头,以在不依赖具体聊天前端的情况下运行基本功能,例如路由或配置功能。这样,具体的检测系统可以以有意义的方式与各种前端交互,并且可以在不要求改变检测系统本身的情况下实施新的或替代的前端。FIG. 12 is a block diagram illustrating an exemplary method 1200 of operation for scalable peer-to-peer chat detection according to an embodiment of the invention. According to an embodiment, detection may utilize existing elements of Internet communication standards, such as HTTP headers, to perform basic functions, such as routing or configuration functions, without relying on a specific chat front end. In this way, a specific detection system can interact with various front ends in a meaningful way, and new or replacement front ends can be implemented without requiring changes to the detection system itself.
在初始步骤1201中,聊天前端(例如,例如基于网络的聊天应用或移动电子设备上的专用移动聊天应用)可以请求交互。这种请求可以由尝试进行聊天的用户发起(点击“与代理者聊天”按钮或类似的交互式用户界面交互),或者可以是自动过程(例如在使用模拟的聊天参与者的自动化的检测)中的一部分中的。这样,检测案例不需要基于发起的具体机制,因为这种机制可能根据在任何具体交互期间利用的前端的变化而变化。In an initial step 1201, a chat front end (eg, such as a web-based chat application or a dedicated mobile chat application on a mobile electronic device) may request an interaction. Such a request may be initiated by the user attempting to chat (by clicking a "Chat with Agent" button or similar interactive user interface interaction), or may be an automated process (such as in automated detection using simulated chat participants) part of the . This way, detection cases need not be based on the specific mechanism initiated, as this mechanism may vary according to changes in the front end exploited during any specific interaction.
在下一个步骤1202中,可以对发送到检测系统的数据进行处理(例如,“聊天处理系统”或此前描述的其他系统元件)以对嵌入的信息进行解释,例如,在检测运行期间使用的HTTP文件头。例如,交互可以请求特定的检测服务器,或者请求根据特定的检测活动的检测标准(如上所述)进行处理。这样,可以确保检测运行,而不论正在利用的前端,因为运行信息是正在通信的交互数据所固有的,而非依赖于前端之间的任何形式的标准化。In a next step 1202, data sent to the detection system (e.g., a "chat processing system" or other system element previously described) can be processed to interpret embedded information, such as HTTP files used during the detection run head. For example, an interaction may request a specific detection server, or request processing according to detection criteria (described above) for a specific detection campaign. In this way, detection can be ensured to run regardless of the front end being exploited, as the run information is inherent to the interaction data being communicated rather than relying on any form of normalization between front ends.
在下一个步骤1203中,可以加载检测交互配置(例如,在前一个步骤中确定的请求的配置)以对检测执行进行配置。这样,检测可以自行配置运行以增加效率并且帮助避免可能降低检测结果的可靠性的用户引入的错误(例如,代理者选择无效配置布置或者作出影响功能的印刷错误)。此外,加载的配置可以将这种运行确定为通信技术而加以利用,从而使检测案例能根据需要在各种网络技术之间进行运行以便全面检测,而不需要前端以在这种技术上明确地运行(例如,通过蜂窝或光纤网络对来自基于互联网的聊天应用的检测案例进行路由,而不论与对前端进行运行的计算设备的实际的物理连接。可以理解,通过以这种方式运行,检测案例可以对可能存在于客户与代理者之间的实际运行中的“真实世界”的运行条件,而不是没有考虑外部因素(例如,客户的特定网络连接或计算机硬件)的检测设施或联络中心内的受控的环境进行检测。In a next step 1203, a detection interaction configuration (eg the requested configuration determined in the previous step) may be loaded to configure the detection execution. In this way, the test can configure itself to run to increase efficiency and help avoid user-introduced errors that could reduce the reliability of test results (eg, agents choosing invalid configuration arrangements or making typographical errors that affect functionality). In addition, loaded configurations can leverage this run as a communication technology, enabling detection cases to run across network technologies as needed for comprehensive detection without requiring a front-end to explicitly Operate (e.g., route a detection case from an Internet-based chat application over a cellular or fiber optic network, regardless of the actual physical connection to the computing device operating on the front end. It will be understood that by operating in this manner, the detection case Can test for "real world" operating conditions that may exist in actual operations between a customer and an agent, rather than within a testing facility or contact center without taking into account external factors (for example, a customer's specific network connection or computer hardware) Controlled environment for testing.
在下一个步骤1204中,检测通信可以可选地遍及替代的或附加的网络技术,例如,以通过使用其他至聊天的连接来检测与客户的可靠连接(例如,通过网络浏览器或智能手机或其他蜂窝功能的移动设备上的应用聊天)。这样,可以使用单个检测案例来检测多个连接,从而在每次交互中尽可能多地收集检测数据来加速检测过程。In a next step 1204, the detection communication may optionally be over an alternative or additional web technology, for example, to detect a reliable connection to the customer by using other connections to the chat (e.g., via a web browser or smartphone or other App chat on cellular-enabled mobile devices). In this way, a single detection case can be used to detect multiple connections, thereby collecting as much detection data as possible in each interaction to speed up the detection process.
在最后一个步骤1205中,检测可以得出结论并且酌情记录或提交结果(例如,根据前一个步骤中加载的配置存储或发送结果)。应当理解,尽管所述的检测运行可能涉及代理者和检测系统,但是本发明提供的功能对于替代的布置是同等适用和有用的,例如,多个自动化“聊天机器人”或类似模拟参与者之间或多个代理者之间的检测交互。这样,检测运行可以包括各种物理或虚拟布置,并且对在实际联络中心运行期间可能经历的所有条件或交互进行全面检测。In a final step 1205, the inspection may draw conclusions and record or submit the results as appropriate (eg, store or send the results according to the configuration loaded in the previous step). It should be understood that while the described detection runs may involve agents and detection systems, the functionality provided by the present invention is equally applicable and useful for alternative arrangements, for example, between multiple automated "chatbots" or similar simulated participants or Detection interactions between multiple agents. As such, inspection runs can include a variety of physical or virtual arrangements and provide a comprehensive inspection of all conditions or interactions that may be experienced during actual contact center operations.
图13是图示了用于基于活动的检测运行的示例性方法1300的方法图。根据这种布置,可以根据能够描述待执行的各种具体检测的单个“活动”来配置并发起多个检测案例,并且这样,可以容易地对多个检测进行配置、执行和报告。另外,在给定正确配置的情况下,活动可以被当成自主运行,例如,在具体的排程上配置特定的检测运行或者将特定的检测运行配置成响应于指定的条件(例如,联络中心内的硬件或软件更新)。此外,多个活动可以互相交互,以便执行基于逻辑的自适应检测,例如,利用一个活动的结果来配置另一个活动或确定特定的活动以运行下一个活动。FIG. 13 is a method diagram illustrating an example method 1300 for activity-based detection operations. According to this arrangement, multiple detection cases can be configured and initiated from a single "activity" that can describe the various specific detections to be performed, and as such, multiple detections can be easily configured, executed and reported. In addition, campaigns can be considered to run autonomously given the correct configuration, for example, configuring specific detection runs on specific schedules or configuring specific detection runs to respond to specified conditions (e.g., within a contact center). hardware or software updates). In addition, multiple activities can interact with each other to perform logic-based adaptive detection, for example, using the results of one activity to configure another activity or to determine a specific activity to run the next activity.
可以以各种方式创建或管理活动,例如,从远程或基于网络的管理软件界面或应用(例如,适合管理员管理远离办公室的活动)或者通过如此前所述的检测创建界面(参见图6)来建立或管理活动,使得在需要时活动是可存取的,而不论管理员的位置或可用的硬件。此外,这样,通过将这种功能与现有的检测创建元件(即,例如管理员界面的其他元件可以连接上的集中分布的硬件或软件系统元件)集成,而非漫长地或代价高昂地对具体的管理员设备进行更新,现有的检测系统可以容易地用于允许基于活动的功能。Activities can be created or managed in various ways, for example, from a remote or web-based management software interface or application (e.g., suitable for an administrator to manage activities away from the office) or through a detection interface as previously described (see Figure 6) to create or manage activities so that they are accessible when needed, regardless of the administrator's location or available hardware. Furthermore, by integrating this functionality with existing detection creation elements (i.e., centrally distributed hardware or software system elements to which other elements such as the administrator Specific administrator devices are updated and existing detection systems can be easily used to allow activity-based functionality.
在初始步骤1301中,活动可以例如由联络中心管理员或其他授权用户配置。这种配置可以酌情具有不同的性质和粒度以适于所需的检测运行。这样,活动可以用于强化具体的检测参数或条件,或者仅仅在安排的间隔执行基本检测,或者响应于具体的触发器或可能需要的任何其他这种可配置的运行来执行基本检测。In an initial step 1301, activities may be configured, for example, by a contact center administrator or other authorized user. Such configurations may be of varying nature and granularity as appropriate to suit the desired assay run. As such, campaigns can be used to enforce specific detection parameters or conditions, or to perform basic detection only at scheduled intervals, or in response to specific triggers or any other such configurable operation that may be required.
在下一个步骤1302中,可以根据配置的参数发起活动(例如,由事件触发或根据设置的计划表发起)。另外,可以内在地(来自联络中心内,发起与外部真实或虚拟用户的交互出站)或外在地(外部用户发起与联络中心的交互入站)触发活动,正如可能适合用于特定活动运行并且根据待执行的检测的性质。例如,外部用户可以选择以发起交互并触发活动以便在对他们的计算机工作站作出硬件改变之后对功能进行验证,或者联络中心可以发起出站交互作为日程表的一部分以维持对运行的“健康检查”。In a next step 1302, an activity may be initiated according to configured parameters (eg, triggered by an event or initiated according to a set schedule). Additionally, campaigns can be triggered internally (from within the contact center, initiating an interaction with an external real or virtual user outbound) or externally (an external user initiating an interaction with the contact center inbound), as may be appropriate for a specific campaign run And depending on the nature of the detection to be performed. For example, an external user may choose to initiate an interaction and trigger an activity to verify functionality after making a hardware change to their computer workstation, or a contact center may initiate an outbound interaction as part of a schedule to maintain a "health check" on operations .
在下一个步骤1303中,交互可以根据活动配置进行运行,例如,根据单独的具体参数运行且潜在地运行的一个或多个交互。这样,活动可以用于控制各种检测运行参数并且执行可能在本质上相似或不相似的多个检测,从而提供用于快速配置运行的统一方法。In a next step 1303, the interactions may be run according to the activity configuration, eg one or more interactions run according to individual specific parameters and potentially run. In this way, activities can be used to control various assay run parameters and perform multiple assays that may or may not be similar in nature, thereby providing a unified method for rapidly configuring runs.
在最后一个步骤1304中,由于完成检测,可以酌情接收并存储或报告它们单独的结果,并且在活动全部完成时,可以生成最终的“活动报告”以提供活动运行的综述。以此方式,为了具体结果可以对单独的检测进行检查,而可以对活动的总体运行进行查看以得到快速“综述”,例如,可能适合用于在特定的特征或系统可能未经过严密审查的情况下的周期性的“健康检查”类型的检测。In a final step 1304, as the tests are completed, their individual results may be received and stored or reported as appropriate, and when the campaign is fully completed, a final "campaign report" may be generated to provide an overview of the campaign run. In this way, individual assays can be examined for specific results, while the overall run of the campaign can be viewed for a quick "overview", which may be appropriate, for example, in situations where specific features or systems may not have been closely scrutinized Under the periodic "health check" type detection.
技术人员应当知道如上所述的各种实施例的一系列可能修改。因此,本发明由权利要求书及其等同内容限定。The skilled person will be aware of a range of possible modifications to the various embodiments described above. Accordingly, the invention is defined by the claims and their equivalents.
Claims (10)
Applications Claiming Priority (11)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201313936186A | 2013-07-06 | 2013-07-06 | |
| US201313936183A | 2013-07-06 | 2013-07-06 | |
| US13/936,183 | 2013-07-06 | ||
| US13/936,186 | 2013-07-06 | ||
| US14/140,449 | 2013-12-24 | ||
| US14/140,449 US9137183B2 (en) | 2009-12-22 | 2013-12-24 | System and method for automated chat testing |
| US14/140,470 US9031221B2 (en) | 2009-12-22 | 2013-12-25 | System and method for automated voice quality testing |
| US14/140,470 | 2013-12-25 | ||
| US14/141,424 | 2013-12-27 | ||
| US14/141,424 US9137184B2 (en) | 2009-12-22 | 2013-12-27 | System and method for automated chat testing |
| PCT/US2014/045629 WO2015006246A1 (en) | 2013-07-06 | 2014-07-07 | System and method for automated chat testing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105637812A true CN105637812A (en) | 2016-06-01 |
Family
ID=52280499
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201480048931.7A Pending CN105637812A (en) | 2013-07-06 | 2014-07-07 | Systems and methods for automated chat detection |
Country Status (4)
| Country | Link |
|---|---|
| EP (1) | EP3020166A4 (en) |
| JP (1) | JP2016525745A (en) |
| CN (1) | CN105637812A (en) |
| WO (1) | WO2015006246A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109714491A (en) * | 2019-02-26 | 2019-05-03 | 上海凯岸信息科技有限公司 | Intelligent sound outgoing call detection system based on voice mail |
| CN112242136A (en) * | 2019-07-19 | 2021-01-19 | 国际商业机器公司 | Improving test coverage for session models |
| CN114008600A (en) * | 2019-06-26 | 2022-02-01 | 微软技术许可有限责任公司 | Chat robot diagnostic visualization |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU2016203124A1 (en) * | 2016-03-28 | 2017-10-12 | Cyara Solutions Pty Ltd | System and method for automated end-to-end web interaction testing |
| GB201605360D0 (en) * | 2016-03-30 | 2016-05-11 | Microsoft Technology Licensing Llc | Local chat service simulator for bot development |
| US20180052664A1 (en) * | 2016-08-16 | 2018-02-22 | Rulai, Inc. | Method and system for developing, training, and deploying effective intelligent virtual agent |
| US10817667B2 (en) | 2018-02-07 | 2020-10-27 | Rulai, Inc. | Method and system for a chat box eco-system in a federated architecture |
| US10694037B2 (en) | 2018-03-28 | 2020-06-23 | Nice Ltd. | System and method for automatically validating agent implementation of training material |
| EP3959658B1 (en) * | 2019-04-26 | 2024-05-29 | Oracle International Corporation | Insights into performance of a bot system |
| US10628133B1 (en) | 2019-05-09 | 2020-04-21 | Rulai, Inc. | Console and method for developing a virtual agent |
| CO2019008485A1 (en) * | 2019-08-02 | 2019-08-30 | Bancolombia S A | Methods for monitoring automated assistants |
| CN115562980A (en) * | 2022-09-27 | 2023-01-03 | 重庆长安汽车股份有限公司 | Test method, device, server and storage medium for conversation management system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040008825A1 (en) * | 2002-06-21 | 2004-01-15 | Albert Seeley | One script test script system and method for testing a contact center voice application |
| US20060167970A1 (en) * | 2004-11-12 | 2006-07-27 | Albert Seeley | Testing using asynchronous automated virtual agent behavior |
| US20060265492A1 (en) * | 2005-05-17 | 2006-11-23 | Morris Daniel E | On-demand test environment using automated chat clients |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2286508A (en) * | 1994-02-08 | 1995-08-16 | Ibm | Performance and status monitoring in a computer network |
| US6889160B2 (en) * | 2003-05-30 | 2005-05-03 | Hewlett-Packard Development Company, L.P. | Simulation of network service test environments |
| CN101296243B (en) * | 2008-06-26 | 2013-02-20 | 阿里巴巴集团控股有限公司 | Service integration platform system and method for providing internet service |
-
2014
- 2014-07-07 JP JP2016524390A patent/JP2016525745A/en active Pending
- 2014-07-07 CN CN201480048931.7A patent/CN105637812A/en active Pending
- 2014-07-07 EP EP14823027.9A patent/EP3020166A4/en not_active Withdrawn
- 2014-07-07 WO PCT/US2014/045629 patent/WO2015006246A1/en not_active Ceased
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040008825A1 (en) * | 2002-06-21 | 2004-01-15 | Albert Seeley | One script test script system and method for testing a contact center voice application |
| US20060167970A1 (en) * | 2004-11-12 | 2006-07-27 | Albert Seeley | Testing using asynchronous automated virtual agent behavior |
| US20060265492A1 (en) * | 2005-05-17 | 2006-11-23 | Morris Daniel E | On-demand test environment using automated chat clients |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109714491A (en) * | 2019-02-26 | 2019-05-03 | 上海凯岸信息科技有限公司 | Intelligent sound outgoing call detection system based on voice mail |
| CN109714491B (en) * | 2019-02-26 | 2021-05-14 | 上海凯岸信息科技有限公司 | Intelligent voice outbound detection system based on voice mailbox |
| CN114008600A (en) * | 2019-06-26 | 2022-02-01 | 微软技术许可有限责任公司 | Chat robot diagnostic visualization |
| CN112242136A (en) * | 2019-07-19 | 2021-01-19 | 国际商业机器公司 | Improving test coverage for session models |
| CN112242136B (en) * | 2019-07-19 | 2024-07-23 | 国际商业机器公司 | Improving test coverage of session models |
Also Published As
| Publication number | Publication date |
|---|---|
| EP3020166A1 (en) | 2016-05-18 |
| WO2015006246A1 (en) | 2015-01-15 |
| EP3020166A4 (en) | 2017-04-05 |
| JP2016525745A (en) | 2016-08-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11799808B2 (en) | System and method for automated end-to-end web interaction testing | |
| CN105637812A (en) | Systems and methods for automated chat detection | |
| US9137184B2 (en) | System and method for automated chat testing | |
| US10694027B2 (en) | System and method for automated voice quality testing | |
| US10873546B2 (en) | System and method for automated contact center agent workstation testing | |
| US10268571B2 (en) | System and method for automated thin client contact center agent desktop testing | |
| US11722598B2 (en) | System and methods for an automated chatbot testing platform | |
| JP2017182783A (en) | System and method for automated end-to-end web interaction testing | |
| US10965627B2 (en) | Automated contact center customer mobile device client infrastructure testing | |
| US10447848B2 (en) | System and method for reliable call recording testing and proprietary customer information retrieval | |
| US10084917B2 (en) | Enhanced quality monitoring | |
| US10523604B2 (en) | Mobile dashboard for automated contact center testing | |
| WO2018201149A1 (en) | Automated contact center customer mobile device client infrastructure testing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160601 |
|
| WD01 | Invention patent application deemed withdrawn after publication |