技术领域technical field
本发明涉云计算服务监管领域，尤其涉及一种云服务商能力综合考评系统及考评方法。The invention relates to the field of cloud computing service supervision, in particular to a cloud service provider ability comprehensive evaluation system and evaluation method.
背景技术Background technique
随着云计算技术的快速发展，诞生了IaaS、PaaS、SaaS不同类型的云服务形式，而信息基础设施已经逐渐从传统的硬件设施迁移至云平台上。云盘、云主机、虚拟网络、云操作系统作为最新的IT元素，为政府、教育、IT信息公司等行业提供服务。由于云计算技术可伸缩性强，便于用户按需获取计算能力、存储空间和信息服务，价格实惠等优点，使得云计算得到了很好的推广和实用，同时，也催生了大量的云服务商。这些云服务商中，规模大小不一，技术参差不齐，亟需一种对服务商能力进行考评的装置来对服务安全性、质量等进行评判、辨识和选择。With the rapid development of cloud computing technology, different types of cloud service forms such as IaaS, PaaS, and SaaS have been born, and information infrastructure has gradually migrated from traditional hardware facilities to cloud platforms. As the latest IT elements, cloud disk, cloud host, virtual network, and cloud operating system provide services for government, education, IT information companies and other industries. Due to the strong scalability of cloud computing technology, it is convenient for users to obtain computing power, storage space and information services on demand, and the price is affordable, so that cloud computing has been well promoted and practical. At the same time, it has also spawned a large number of cloud service providers. . Among these cloud service providers, the scale is different, and the technology is uneven. There is an urgent need for a device to evaluate the service provider's ability to judge, identify and select service security and quality.
已公开专利《一种基于SNMP协议的云服务质量评价方法》(专利号：ZL201110380173.7)，将云计算平台中各项系统实时性能指标按照统计学方法，抽象为云服务质量得分，建模得到了对云服务质量的客观评价得分。该专利评价云服务质量时主要考虑了云服务了性能，但是缺少对云服务安全性的考量。且评价服务质量的数据源均为客观采集的性能数值，还缺少了用户在使用服务过程的体验情况。The published patent "A Cloud Service Quality Evaluation Method Based on SNMP Protocol" (patent number: ZL201110380173.7) abstracts the real-time performance indicators of various systems in the cloud computing platform into cloud service quality scores according to statistical methods, and models them Obtained an objective evaluation score for cloud service quality. This patent mainly considers the performance of cloud services when evaluating the quality of cloud services, but lacks the consideration of cloud service security. Moreover, the data sources for evaluating service quality are all objectively collected performance values, and there is also a lack of user experience in the process of using the service.
专利《智能服务评价系统、评价终端及评价方法》(申请号：201610141516.7)和《客观的应用评价》(申请号：201480012378.1)，通过评价终端收集对服务人员的满意度评价数据，计算出服务人员满意度得分，用于提高服务人员服务质量，同时提高服务对象的用户体验，但是主要是以提升用户体验为目的，服务质量评价完全依赖于用户主观评分，可能会因为评分者的品味和经验不一得到的结果相差较大，需要客观评价作为对服务质量的基本评价。The patents "Intelligent Service Evaluation System, Evaluation Terminal and Evaluation Method" (Application No.: 201610141516.7) and "Objective Application Evaluation" (Application No.: 201480012378.1) collect the satisfaction evaluation data of service personnel through the evaluation terminal, and calculate the service personnel Satisfaction score is used to improve the service quality of service personnel and improve the user experience of service objects, but it is mainly for the purpose of improving user experience. Service quality evaluation depends entirely on the subjective rating of users, which may be due to the different tastes and experiences of raters. Once the results obtained are quite different, objective evaluation is required as the basic evaluation of service quality.
综上，已有的方法还存在以下问题：In summary, the existing methods still have the following problems:
1、对服务的评价方法仅仅依靠主观或者客观，缺少两种方法结合的评价；云服务作为一种服务除了客观的量化的评价指标外，引入作为服务对象的用户对云服务质量的主观评价，更利于督促云服务商的用户体验提升。1. The evaluation method of service only relies on subjective or objective, and lacks the evaluation of the combination of the two methods; as a service, cloud service, in addition to objective and quantitative evaluation indicators, introduces the subjective evaluation of cloud service quality by users as service objects, It is more conducive to supervising the improvement of user experience of cloud service providers.
2、传统的服务的评价，主要依赖于性能和运维能力方面的数据和指标，由于用户购买使用云服务后，数据、业务等关键信息都放在云上，因此对云服务的考评除了需要关注性能、运维能力外，安全性更是不容忽视的考评因素。2. The evaluation of traditional services mainly depends on data and indicators in terms of performance and operation and maintenance capabilities. After users purchase and use cloud services, key information such as data and business are placed on the cloud. Therefore, the evaluation of cloud services requires In addition to focusing on performance and operation and maintenance capabilities, security is an evaluation factor that cannot be ignored.
3、当前存在的服务评价机制只对服务质量做了评价，缺少将评价用于对云服务和云服务商选择上，实现评价反馈的方式，达到督促服务商提升自己能力和淘汰掉能力低的服务商，促进云服务商生态健康发展的目的。3. The current service evaluation mechanism only evaluates the service quality, and lacks the way to use the evaluation to select cloud services and cloud service providers to achieve evaluation feedback, so as to urge service providers to improve their capabilities and eliminate those with low capabilities. Service providers, the purpose of promoting the healthy development of the cloud service provider ecosystem.
发明内容Contents of the invention
为了解决上述问题，本发明提供一种结合了用户主观评价和客观数据的云服务商能力综合考评系统及考评方法。In order to solve the above problems, the present invention provides a cloud service provider capability comprehensive evaluation system and evaluation method that combines user subjective evaluation and objective data.
本发明的一种云服务商能力综合考评系统，包括与用户互动的用户评价管理模块、与所述用户评价管理模块相连收集用户评价信息的用户自服务模块、对提供云服务的服务商进行统一管理的服务商管理模块、安全设备管理模块、与所述服务商管理模块和安全设备管理相连用于收集云服务商服务质量数据的数据监测采集模块、与所述用户自服务管理模块和数据监测采集模块相连以对服务商的服务能力数据进行计算的服务商评价计算模块、对所述服务商评价计算模块得到的结果进行实时更新和发布管理的评估结果管理模块。A comprehensive evaluation system for cloud service provider capabilities of the present invention, including a user evaluation management module that interacts with users, a user self-service module that is connected to the user evaluation management module to collect user evaluation information, and unifies service providers that provide cloud services Managed service provider management module, security device management module, data monitoring and acquisition module connected to the service provider management module and security device management for collecting cloud service provider service quality data, and the user self-service management module and data monitoring The collection module is connected to the service provider evaluation calculation module for calculating the service capability data of the service provider, and the evaluation result management module for real-time updating and release management of the results obtained by the service provider evaluation calculation module.
其中，所述用户自服务模块包括供用户完成对云服务购买订单提交的云服务订购模块、屏蔽掉不同云服务商的不同操作页面并提供统一使用页面的云服务使用模块、屏蔽不同云服务商的不同管理操作并提供统一管理功能的云服务管理模块、供用户对云服务商的服务进行评价的云服务评价模块。Wherein, the user self-service module includes a cloud service ordering module for the user to complete the cloud service purchase order submission, a cloud service usage module that blocks different operation pages of different cloud service providers and provides a unified use page, and blocks different cloud service provider The cloud service management module provides unified management functions for different management operations, and the cloud service evaluation module allows users to evaluate the services of cloud service providers.
所述数据监测采集模块包括采集云服务商性能考核指标数据的性能监测模块、采集云服务商运维质量数据的运维质量监测模块、采集云服务商安全事件数据的安全事件监测模块。The data monitoring and collection module includes a performance monitoring module for collecting cloud service provider performance assessment index data, an operation and maintenance quality monitoring module for collecting cloud service provider operation and maintenance quality data, and a security event monitoring module for collecting cloud service provider security event data.
所述服务商评价计算模块包括管理用户评价和监测采集所需的指标数据的指标管理模块、将采集和监测到的不同数据做格式化处理以便于聚类计算的数据预处理模块、分别计算用户对云服务商的评价值以及通过所述数据监测采集模块采集到的数据进行聚类计算以得到服务商质量考评结果的数据分析计算模块。The service provider evaluation calculation module includes an index management module for managing user evaluation and monitoring and collection of index data required, a data preprocessing module for formatting different collected and monitored data to facilitate clustering calculations, and calculating user A data analysis and calculation module that performs clustering calculation on the evaluation value of the cloud service provider and the data collected by the data monitoring and collection module to obtain the service provider quality evaluation result.
所述服务商管理模块是为所有服务商提供统一管理模式的平台。The service provider management module is a platform that provides a unified management mode for all service providers.
本发明的一种云服务商能力综合考评方法，采用云服务商能力综合考评系统来实现，包括如下步骤：A comprehensive evaluation method for cloud service provider capabilities of the present invention is implemented by using a comprehensive evaluation system for cloud service provider capabilities, including the following steps:
s1、用户通过云服务商能力综合考评系统提交云服务购买订单来申请云服务；s1. Users apply for cloud services by submitting cloud service purchase orders through the cloud service provider comprehensive evaluation system;
s2、用户在云服务商能力综合考评系统的监测下使用云服务；s2. Users use cloud services under the monitoring of the cloud service provider's comprehensive evaluation system;
s3、用户对使用过的云服务进行主观评价；s3. Users make subjective evaluations of the cloud services they have used;
s4、通过所述云服务商能力综合考评系统收集用户的主观评价数据以及监测到的客观服务商服务数据，计算云服务提供商的考评结果；s4. Collect subjective evaluation data of users and monitored objective service data of service providers through the cloud service provider comprehensive evaluation system, and calculate the evaluation results of cloud service providers;
s5、监管管理人员对云服务商考评结果进行分析处理；s5. Supervisory management personnel analyze and process the evaluation results of cloud service providers;
s6、判断云服务商的考评结果是否低于标准范围，若是，转到步骤s7；若否，转到步骤s9；s6. Determine whether the evaluation result of the cloud service provider is lower than the standard range, if so, go to step s7; if not, go to step s9;
s7、判断对该服务商提供的服务购买协议是否到期，若是，转到步骤s8；若否，转到步骤s9；s7. Determine whether the service purchase agreement provided by the service provider has expired, if yes, go to step s8; if not, go to step s9;
s8、终止对该服务的购买，选择新的服务商购买相应的云服务；s8. Terminate the purchase of the service, and select a new service provider to purchase the corresponding cloud service;
s9、结束。s9, end.
其中，用户通过所述云服务商能力综合考评系统中的用户自服务模块完成云服务购买订单的提交；所述用户自服务模块屏蔽不同云服务商的不同操作，为所有云服务提供统一的云服务使用界面和管理页面；监管人员在云服务商能力综合考评系统中审批用户提交的服务订购订单；订单审批完成后向云服务商派发云服务生成工单；云服务商根据工单情况生成用户所需云服务并通过云服务商能力综合考评系统提供给用户使用。Among them, the user completes the submission of the cloud service purchase order through the user self-service module in the cloud service provider capability comprehensive evaluation system; the user self-service module shields different operations of different cloud service providers and provides a unified cloud service for all cloud services. Service user interface and management page; supervisors approve service order orders submitted by users in the comprehensive evaluation system of cloud service provider capabilities; after order approval is completed, cloud service providers are dispatched to cloud service providers to generate work orders; cloud service providers generate work orders based on work orders The required cloud services are provided to users through the cloud service provider's comprehensive evaluation system.
在用户使用云服务过程中，通过云服务商能力综合考评系统中的数据监测采集模块实时监测和采集云服务商的性能数据、运维质量数据和安全情况数据，同时，部署数据采集代理到安全设备和云服务商基础设施处，开通数据采集协议进行补充数据收集；以周期轮询采集方式采集云服务商的性能、运维质量和安全情况的客观数据。During the process of users using cloud services, the data monitoring and collection module in the comprehensive evaluation system for cloud service provider capabilities monitors and collects cloud service provider performance data, operation and maintenance quality data, and security data in real time. At the same time, deploy data collection agents to the security The equipment and cloud service provider infrastructure department opens a data collection protocol for supplementary data collection; collects objective data on cloud service provider performance, operation and maintenance quality, and security conditions by means of periodic polling collection.
针对用户给云服务商进行主观评价的数据，采用不可靠评价淘汰机制淘汰用户胡乱提交的不公正评价；将用户提交的各种情况的满意程度评价数据的加权平均值作为用户对使用的云服务的评价分数。Aiming at the data that users make subjective evaluations to cloud service providers, the unreliable evaluation elimination mechanism is used to eliminate the unfair evaluations randomly submitted by users; evaluation score.
本发明结合了主观和客观的评价，在注重性能、运维质量和安全性的理性数据的同时，也结合考虑了云服务商提供的云服务给用户的主观体验情况，增加云服务商能力考评的可靠性，有利于督促云服务商提升用户体验。本发明采用了不可靠主观评价淘汰机制，对完全主观的用户评价值进行甄别，舍弃不可靠的评价值，确保对云服务商的主观评价为合理行为，使得系统对云服务商的评估结果更可靠。The present invention combines subjective and objective evaluations, while paying attention to the rational data of performance, operation and maintenance quality and security, it also considers the subjective experience of cloud services provided by cloud service providers to users, and increases the ability evaluation of cloud service providers The reliability is conducive to urging cloud service providers to improve user experience. The present invention adopts an unreliable subjective evaluation elimination mechanism, screens out completely subjective user evaluation values, discards unreliable evaluation values, ensures that the subjective evaluation of cloud service providers is a reasonable behavior, and makes the evaluation result of the system for cloud service providers more accurate. reliable.
附图说明Description of drawings
图1是本发明的云服务商能力综合考评系统的框架结构示意图；Fig. 1 is a schematic diagram of the frame structure of the cloud service provider's ability comprehensive evaluation system of the present invention;
图2是本发明的云服务商能力综合考评方法主要流程示意图。Fig. 2 is a schematic diagram of the main flow of the cloud service provider's comprehensive evaluation method of the present invention.
具体实施方式detailed description
为了更好的理解本发明，下面结合附图详细说明本发明。In order to better understand the present invention, the present invention will be described in detail below in conjunction with the accompanying drawings.
本发明的一种云服务商能力综合考评系统，采用贯穿云服务商生命周期的考评管理和数据收集评估，如图1所示，本发明的一种云服务商能力综合考评系统，包括与用户互动的用户评价管理模块、与所述用户评价管理模块相连收集用户评价信息的用户自服务模块、对提供云服务的服务商进行统一管理的服务商管理模块、安全设备管理模块、与所述服务商管理模块和安全设备管理相连用于收集云服务商服务质量数据的数据监测采集模块、与所述用户自服务管理模块和数据监测采集模块相连以对服务商的服务能力数据进行计算的服务商评价计算模块、对所述服务商评价计算模块得到的结果进行实时更新和发布管理的评估结果管理模块。A comprehensive evaluation system for cloud service provider capabilities of the present invention adopts evaluation management and data collection and evaluation throughout the life cycle of cloud service providers, as shown in Figure 1, a comprehensive evaluation system for cloud service provider capabilities of the present invention, including An interactive user evaluation management module, a user self-service module connected to the user evaluation management module to collect user evaluation information, a service provider management module for unified management of service providers providing cloud services, a security device management module, and the service provider The provider management module is connected with the security device management to collect the data monitoring and acquisition module of cloud service provider service quality data, and the service provider is connected to the user self-service management module and the data monitoring and acquisition module to calculate the service capability data of the service provider An evaluation calculation module, an evaluation result management module for real-time updating and release management of the results obtained by the service provider evaluation calculation module.
其中，所述用户自服务模块包括供用户完成对云服务购买订单提交的云服务订购模块、屏蔽掉不同云服务商的不同操作页面并提供统一使用页面的云服务使用模块、屏蔽不同云服务商的不同管理操作并提供统一管理功能的云服务管理模块、供用户对云服务商的服务进行评价的云服务评价模块。Wherein, the user self-service module includes a cloud service ordering module for the user to complete the cloud service purchase order submission, a cloud service usage module that blocks different operation pages of different cloud service providers and provides a unified use page, and blocks different cloud service provider The cloud service management module provides unified management functions for different management operations, and the cloud service evaluation module allows users to evaluate the services of cloud service providers.
所述数据监测采集模块包括采集云服务商性能考核指标数据的性能监测模块、采集云服务商运维质量数据的运维质量监测模块、采集云服务商安全事件数据的安全事件监测模块。The data monitoring and collection module includes a performance monitoring module for collecting cloud service provider performance assessment index data, an operation and maintenance quality monitoring module for collecting cloud service provider operation and maintenance quality data, and a security event monitoring module for collecting cloud service provider security event data.
所述服务商评价计算模块包括管理用户评价和监测采集所需的指标数据的指标管理模块、将采集和监测到的不同数据做格式化处理以便于聚类计算的数据预处理模块、分别计算用户对云服务商的评价值以及通过所述数据监测采集模块采集到的数据进行聚类计算以得到服务商质量考评结果的数据分析计算模块。The service provider evaluation calculation module includes an index management module for managing user evaluation and monitoring and collection of index data required, a data preprocessing module for formatting different collected and monitored data to facilitate clustering calculations, and calculating user A data analysis and calculation module that performs clustering calculation on the evaluation value of the cloud service provider and the data collected by the data monitoring and collection module to obtain the service provider quality evaluation result.
所述服务商管理模块是为所有服务商提供统一管理模式的平台。The service provider management module is a platform that provides a unified management mode for all service providers.
本发明的一种云服务商能力综合考评方法，采用云服务商能力综合考评系统来实现，包括如下步骤：A comprehensive evaluation method for cloud service provider capabilities of the present invention is implemented by using a comprehensive evaluation system for cloud service provider capabilities, including the following steps:
s1、用户通过云服务商能力综合考评系统提交云服务购买订单来申请云服务；s1. Users apply for cloud services by submitting cloud service purchase orders through the cloud service provider comprehensive evaluation system;
s2、用户在云服务商能力综合考评系统的监测下使用云服务；s2. Users use cloud services under the monitoring of the cloud service provider's comprehensive evaluation system;
s3、用户对使用过的云服务进行主观评价；s3. Users make subjective evaluations of the cloud services they have used;
s4、通过所述云服务商能力综合考评系统收集用户的主观评价数据以及监测到的客观服务商服务数据，计算云服务提供商的考评结果；s4. Collect subjective evaluation data of users and monitored objective service data of service providers through the cloud service provider comprehensive evaluation system, and calculate the evaluation results of cloud service providers;
s5、监管管理人员对云服务商考评结果进行分析处理；s5. Supervisory management personnel analyze and process the evaluation results of cloud service providers;
s6、判断云服务商的考评结果是否低于标准范围，若是，转到步骤s7；若否，转到步骤s9；s6. Determine whether the evaluation result of the cloud service provider is lower than the standard range, if so, go to step s7; if not, go to step s9;
s7、判断对该服务商提供的服务购买协议是否到期，若是，转到步骤s8；若否，转到步骤s9；s7. Determine whether the service purchase agreement provided by the service provider has expired, if yes, go to step s8; if not, go to step s9;
s8、终止对该服务的购买，选择新的服务商购买相应的云服务；s8. Terminate the purchase of the service, and select a new service provider to purchase the corresponding cloud service;
s9、结束。s9, end.
其中，用户通过所述云服务商能力综合考评系统中的用户自服务模块完成云服务购买订单的提交；所述用户自服务模块屏蔽不同云服务商的不同操作，为所有云服务提供统一的云服务使用界面和管理页面；监管人员在云服务商能力综合考评系统中审批用户提交的服务订购订单；订单审批完成后向云服务商派发云服务生成工单；云服务商根据工单情况生成用户所需云服务并通过云服务商能力综合考评系统提供给用户使用。Among them, the user completes the submission of the cloud service purchase order through the user self-service module in the cloud service provider capability comprehensive evaluation system; the user self-service module shields different operations of different cloud service providers and provides a unified cloud service for all cloud services. Service user interface and management page; supervisors approve service order orders submitted by users in the comprehensive evaluation system of cloud service provider capabilities; after order approval is completed, cloud service providers are dispatched to cloud service providers to generate work orders; cloud service providers generate work orders based on work orders The required cloud services are provided to users through the cloud service provider's comprehensive evaluation system.
在用户使用云服务过程中，通过云服务商能力综合考评系统中的数据监测采集模块实时监测和采集云服务商的性能数据、运维质量数据和安全情况数据，同时，部署数据采集代理到安全设备和云服务商基础设施处，开通数据采集协议进行补充数据收集；以周期轮询采集方式采集云服务商的性能、运维质量和安全情况的客观数据。During the process of users using cloud services, the data monitoring and collection module in the comprehensive evaluation system for cloud service provider capabilities monitors and collects cloud service provider performance data, operation and maintenance quality data, and security data in real time. At the same time, deploy data collection agents to the security The equipment and cloud service provider infrastructure department opens a data collection protocol for supplementary data collection; collects objective data on cloud service provider performance, operation and maintenance quality, and security conditions by means of periodic polling collection.
其中，对云服务商性能数据的采集，完成对云服务性能和质量的考评。云服务性能考核数据由所述云服务综合评估系统中的性能监测模块轮询完成。云服务商所提供的云服务主要包括计算类云服务、存储类云服务、网络类云服务、安全类云服务及其他云服务。采集的性能数据包含但不限于：云服务运行情况(正常运行时间)、资源使用情况(CPU使用率，内存使用情况，网络上/下行速率)、资源故障情况(资源故障率)等。以服务商性能作为核心考核指标，旨在提醒云服务商注重云服务本身的质量，打造出高质量的云服务能力，以满足云上用户对数据和业务的托管需求。Among them, the collection of cloud service provider performance data completes the evaluation of cloud service performance and quality. The cloud service performance assessment data is polled by the performance monitoring module in the cloud service comprehensive evaluation system. Cloud services provided by cloud service providers mainly include computing cloud services, storage cloud services, network cloud services, security cloud services and other cloud services. The collected performance data includes but is not limited to: cloud service running status (uptime), resource usage (CPU usage, memory usage, network up/down rate), resource failure status (resource failure rate), etc. Taking service provider performance as the core assessment indicator, it aims to remind cloud service providers to pay attention to the quality of cloud services themselves, and create high-quality cloud service capabilities to meet cloud users' hosting needs for data and business.
对云服务商运维质量数据的采集，完成对云服务商运维水平的考核。该类数据由所述云服务综合评估系统中的运维质量监测模块轮询完成。云服务商运维质量的评估需要遵循ITIL v3相关标准规范内容。采集数据包含但不限于：云服务故障发生概率、总服务台话务员专业水准和服务态度、故障响应时间、故障处理时间、故障恢复时间、故障处理的质量等，告警持续时长。运维质量数据采集方式包含一下几种：管理协议采集、代理采集、通过接口获取云服务商数据。Collect cloud service provider operation and maintenance quality data, and complete the assessment of cloud service provider operation and maintenance level. This type of data is polled by the operation and maintenance quality monitoring module in the cloud service comprehensive evaluation system. The evaluation of cloud service provider operation and maintenance quality needs to follow the relevant ITIL v3 standard specifications. The collected data includes but is not limited to: the probability of cloud service failures, the professional level and service attitude of the operator at the main service desk, failure response time, failure handling time, failure recovery time, quality of failure handling, etc., and alarm duration. The operation and maintenance quality data collection methods include the following: management protocol collection, agent collection, and cloud service provider data acquisition through interfaces.
对云服务商安全情况数据的采集，完成对云服务商安全事件的监测。云服务商安全监测遵循《信息安全技术云计算服务安全能力要求》(GBT31168-2014)、《信息安全技术云计算服务安全指南》(GBT 31167-2014)相关要求，采集云服务商平台整体安全管理的相关数据，如物理、虚拟安全设备的运行状态、安全策略以及安全事件；对于运行状态、安全策略数据，云服务商平台应提供标准的安全管理接口，供服务商能力考评系统调用、获取安全管理数据；服务商能力考评系统也需提供标准的安全事件上报接口，接受云服务商平台上报的安全事件；通过对云服务商的安全进行监测考评，找出各云服务商平台存在的安全隐患和安全漏洞问题，从而提升云服务商的安全意识和安全能力。Collect cloud service provider security data and complete monitoring of cloud service provider security events. The security monitoring of cloud service providers follows the relevant requirements of "Information Security Technology Cloud Computing Service Security Capability Requirements" (GBT31168-2014) and "Information Security Technology Cloud Computing Service Security Guidelines" (GBT 31167-2014), collecting cloud service provider platform overall security management related data, such as the operating status, security policies, and security events of physical and virtual security devices; for the operating status and security policy data, the cloud service provider platform should provide a standard security management interface for the service provider’s capability evaluation system to call and obtain security Manage data; the service provider capability evaluation system also needs to provide a standard security event reporting interface to accept security events reported by the cloud service provider platform; through monitoring and evaluating the security of cloud service providers, find out the security risks existing in each cloud service provider platform and security vulnerabilities, thereby improving the security awareness and security capabilities of cloud service providers.
针对用户给云服务商进行主观评价的数据，采用不可靠评价淘汰机制淘汰用户胡乱提交的不公正评价；将用户提交的各种情况的满意程度评价数据的加权平均值作为用户对使用的云服务的评价分数。具体地说，用户对使用过的云服务进行主观评价，评价内容包含但不限于：价格、故障处理质量、服务平均响应时间、带宽速率、故障处理时间等多种情况的满意程度；同时用户还将给出对服务商总体满意度评价。由于主观评价取决用户的个人感受，为避免用户胡乱提供不可靠的主观评价，设计了对不可靠评价的淘汰机制。以用户给出的对整个服务商提供的服务满意度作为参考值，与多维度满意度叠加计算值进行比较，差异较大则说明用户评价不稳定，数值参考意义不大，则舍弃该用户的主观评价；差异较小，则说明用户多次评价意向一致，多维度用户评价为可靠的评价值，可以采纳。针对用户给出的评价结果，将用户给出的对价格、故障处理质量、服务平均响应时间、带宽速率、故障处理时间等多种情况的满意程度评价的加权平均值作为用户评价分数。Aiming at the data that users make subjective evaluations to cloud service providers, the unreliable evaluation elimination mechanism is used to eliminate the unfair evaluations randomly submitted by users; evaluation score. Specifically, users make subjective evaluations of used cloud services, including but not limited to: price, fault handling quality, service average response time, bandwidth rate, fault handling time, etc. An overall satisfaction rating for the service provider will be given. Since subjective evaluation depends on the user's personal feelings, in order to prevent users from randomly providing unreliable subjective evaluations, an elimination mechanism for unreliable evaluations is designed. Take the service satisfaction provided by the user for the entire service provider as a reference value, and compare it with the superimposed calculation value of multi-dimensional satisfaction. If the difference is large, it means that the user evaluation is unstable. Subjective evaluation; if the difference is small, it means that users have the same intention for repeated evaluations, and multi-dimensional user evaluations are reliable evaluation values and can be adopted. According to the evaluation results given by users, the weighted average of the satisfaction evaluations given by users on price, fault handling quality, service average response time, bandwidth rate, fault handling time, etc. is used as the user evaluation score.
通过云服务综合评估系统中的评估结果管理模块得到云服务商能力考评结果，并将考评结果反馈应用到对云服务商服务选择、督促改善上。云服务商考评结果反馈应用主要体现在以下两种方式：第一种，计算云服务考评得分后，给出云服务商评分排行，用户在购买云服务选择服务商时可做参考，用户可以选择得分靠前的云服务商来保证自己能够享受到最好的云服务；另一方面，得分低的服务商用户选择购买数量减少，收益降低，促使云服务商优化服务质量来提高自身的评价值，从而争取更多的用户。这种方式体现了购买市场的优胜劣汰。第二种，可以查询具体某一云服务商的考评得分情况，作为管理人员在发布管理、续费或者终止对云服务商购买的一个参考数值。Through the evaluation result management module in the cloud service comprehensive evaluation system, the cloud service provider ability evaluation result is obtained, and the evaluation result feedback is applied to the cloud service provider service selection and supervision and improvement. The cloud service provider evaluation result feedback application is mainly reflected in the following two methods: first, after calculating the cloud service evaluation score, the cloud service provider score ranking is given, and the user can use it as a reference when purchasing cloud services and choosing a service provider. Users can choose Cloud service providers with high scores ensure that they can enjoy the best cloud services; on the other hand, service providers with low scores choose to purchase less quantity and lower revenue, prompting cloud service providers to optimize service quality to improve their own evaluation value , so as to gain more users. This method reflects the survival of the fittest in the buying market. The second is to query the evaluation score of a specific cloud service provider, which can be used as a reference value for management personnel to release management, renew or terminate the purchase of cloud service providers.
本发明通过用户自服务管理模块能够对云服务进行购买使用，并完成对云服务的主观评价；通过数据监测采集模块，能够完成对服务商性能、运维质量、以及安全事件进行监测；通过服务商评价计算模块能够完成对主客观数据的分析计算，以及主客观指标维护管理；通过评估结果管理模块，将评价结果呈现给不同角色的用户，并能依据考评结果反馈解决对云服务商续购或者淘汰等问题。’The present invention can purchase and use the cloud service through the user self-service management module, and complete the subjective evaluation of the cloud service; The supplier evaluation calculation module can complete the analysis and calculation of subjective and objective data, as well as the maintenance and management of subjective and objective indicators; through the evaluation result management module, the evaluation results can be presented to users of different roles, and the repurchase of cloud service providers can be solved based on the feedback of the evaluation results Or elimination and other issues. '
本发明结合了主观和客观的评价，在注重性能、运维质量和安全性的理性数据以保证考评结果可靠性的同时，也结合考虑了云服务商提供的云服务给用户的主观体验情况，有利于督促云服务商提升用户体验。本发明采用了不可靠主观评价淘汰机制，对完全主观的用户评价值进行甄别，舍弃不可靠的评价值，确保对云服务商的主观评价为合理行为，使得系统对云服务商的评估结果更可靠。同时，在评价云服务商能力时，本发明把安全作为一个重要考评因素，督促云服务商提升云服务安全能力和保障。本发明将云服务商能力考评结果反馈应用到对服务商推荐、管理(续费或者终止)上，督促云服务商优化服务质量来提高自身的评价值，从而争取更多的用户。The present invention combines subjective and objective evaluations. While paying attention to rational data of performance, operation and maintenance quality and security to ensure the reliability of evaluation results, it also considers the subjective experience of cloud services provided by cloud service providers to users. It is conducive to urging cloud service providers to improve user experience. The present invention adopts an unreliable subjective evaluation elimination mechanism, screens out completely subjective user evaluation values, discards unreliable evaluation values, ensures that the subjective evaluation of cloud service providers is a reasonable behavior, and makes the evaluation result of the system for cloud service providers more accurate. reliable. At the same time, when evaluating the capabilities of cloud service providers, the present invention regards security as an important evaluation factor, and urges cloud service providers to improve cloud service security capabilities and guarantees. The present invention applies cloud service provider capability evaluation result feedback to service provider recommendation and management (renewal or termination), and urges cloud service providers to optimize service quality to improve their own evaluation value, thereby gaining more users.
以上所述，仅为本发明较佳的具体实施方式，但本发明的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本发明披露的技术范围内，根据本发明的技术方案及其发明构思加以等同替换或改变，都应涵盖在本发明的保护范围之内。The above is only a preferred embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Anyone familiar with the technical field within the technical scope disclosed in the present invention, according to the technical solution of the present invention Any equivalent replacement or change of the inventive concepts thereof shall fall within the protection scope of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611024826.7ACN106559265A (en) | 2016-11-21 | 2016-11-21 | A kind of cloud service provider ability integration appraisal system and examining method |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611024826.7ACN106559265A (en) | 2016-11-21 | 2016-11-21 | A kind of cloud service provider ability integration appraisal system and examining method |
| Publication Number | Publication Date |
|---|---|
| CN106559265Atrue CN106559265A (en) | 2017-04-05 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611024826.7APendingCN106559265A (en) | 2016-11-21 | 2016-11-21 | A kind of cloud service provider ability integration appraisal system and examining method |
| Country | Link |
|---|---|
| CN (1) | CN106559265A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107018024A (en)* | 2017-05-10 | 2017-08-04 | 广东工业大学 | A kind of cloud service recommendation method and device |
| CN107733693A (en)* | 2017-09-22 | 2018-02-23 | 中国人民解放军国防科技大学 | Network security operation and maintenance capability evaluation method and system based on security event statistics |
| CN108038612A (en)* | 2017-12-08 | 2018-05-15 | 温州大学 | A kind of the manufacture cloud service self-organizing evaluation system and method for user behavior driving |
| CN108805362A (en)* | 2018-06-21 | 2018-11-13 | 福州大学 | Manufacture the distinguishing validity and the preferred method of scheme of cloud service scheme |
| CN109905276A (en)* | 2019-01-31 | 2019-06-18 | 山东省电子信息产品检验院 | A kind of cloud service quality monitoring method and system |
| CN113220959A (en)* | 2021-04-20 | 2021-08-06 | 珠海大横琴科技发展有限公司 | Data processing method and device |
| CN114143221A (en)* | 2021-11-29 | 2022-03-04 | 重庆富民银行股份有限公司 | Service asset management method, platform and storage medium based on full link monitoring |
| CN116433336A (en)* | 2023-06-13 | 2023-07-14 | 北京易享信息技术有限公司 | User experience evaluating method and system based on multiple databases |
| CN116823251A (en)* | 2023-05-15 | 2023-09-29 | 浪潮智慧科技有限公司 | Service provider trusted payment method, equipment and medium based on aggregated payment |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105574685A (en)* | 2016-02-02 | 2016-05-11 | 浙江工业大学 | Subjective and objective combination-based cloud service evaluation method |
| CN105718805A (en)* | 2016-01-25 | 2016-06-29 | 福建北卡科技有限公司 | Cloud-computing trust management method based on evaluation confidence degree |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105718805A (en)* | 2016-01-25 | 2016-06-29 | 福建北卡科技有限公司 | Cloud-computing trust management method based on evaluation confidence degree |
| CN105574685A (en)* | 2016-02-02 | 2016-05-11 | 浙江工业大学 | Subjective and objective combination-based cloud service evaluation method |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107018024B (en)* | 2017-05-10 | 2020-10-23 | 广东工业大学 | Method and device for recommending cloud services |
| CN107018024A (en)* | 2017-05-10 | 2017-08-04 | 广东工业大学 | A kind of cloud service recommendation method and device |
| CN107733693A (en)* | 2017-09-22 | 2018-02-23 | 中国人民解放军国防科技大学 | Network security operation and maintenance capability evaluation method and system based on security event statistics |
| CN108038612A (en)* | 2017-12-08 | 2018-05-15 | 温州大学 | A kind of the manufacture cloud service self-organizing evaluation system and method for user behavior driving |
| CN108038612B (en)* | 2017-12-08 | 2021-06-15 | 温州大学 | A user behavior-driven self-organizing evaluation system and method for manufacturing cloud services |
| CN108805362A (en)* | 2018-06-21 | 2018-11-13 | 福州大学 | Manufacture the distinguishing validity and the preferred method of scheme of cloud service scheme |
| CN109905276B (en)* | 2019-01-31 | 2020-01-24 | 山东省电子信息产品检验院 | Cloud service quality monitoring method and system |
| CN109905276A (en)* | 2019-01-31 | 2019-06-18 | 山东省电子信息产品检验院 | A kind of cloud service quality monitoring method and system |
| CN113220959A (en)* | 2021-04-20 | 2021-08-06 | 珠海大横琴科技发展有限公司 | Data processing method and device |
| CN114143221A (en)* | 2021-11-29 | 2022-03-04 | 重庆富民银行股份有限公司 | Service asset management method, platform and storage medium based on full link monitoring |
| CN116823251A (en)* | 2023-05-15 | 2023-09-29 | 浪潮智慧科技有限公司 | Service provider trusted payment method, equipment and medium based on aggregated payment |
| CN116823251B (en)* | 2023-05-15 | 2024-04-05 | 浪潮智慧科技有限公司 | Service provider trusted payment method, equipment and medium based on aggregated payment |
| CN116433336A (en)* | 2023-06-13 | 2023-07-14 | 北京易享信息技术有限公司 | User experience evaluating method and system based on multiple databases |
| CN116433336B (en)* | 2023-06-13 | 2025-07-25 | 北京易享信息技术有限公司 | User experience evaluating method and system based on multiple databases |
| Publication | Publication Date | Title |
|---|---|---|
| CN106559265A (en) | A kind of cloud service provider ability integration appraisal system and examining method | |
| KR101789266B1 (en) | Bug clearing house | |
| CN103295155B (en) | Security core service system method for supervising | |
| US20180143891A1 (en) | Testing and improving performance of mobile application portfolios | |
| US8918345B2 (en) | Network analysis system | |
| CN110223146A (en) | Client's power purchase services entire process monitoring system and method | |
| CN110162445A (en) | The host health assessment method and device of Intrusion Detection based on host log and performance indicator | |
| CN102571406B (en) | Data service node quality analysis method and device and data service short plate analysis system | |
| KR101886943B1 (en) | A method for establishing power supply and demand early warning model based on dynamic clustering | |
| CN104657811B (en) | For account health evaluating, risk identification and the method and system remedied | |
| US7369967B1 (en) | System and method for monitoring and modeling system performance | |
| CN114021971A (en) | A comprehensive evaluation system, method and storage medium for expressway operation and maintenance management | |
| CN106161135A (en) | Business transaction failure analysis methods and device | |
| CN110751549A (en) | Management and control method and device for overdue financial loan collection and acceptance promotion and electronic equipment | |
| CN115794566A (en) | Method, device, electronic equipment and storage medium for data alarm | |
| CN119030860A (en) | Fault node positioning method, device, electronic device and non-volatile storage medium | |
| US10055277B1 (en) | System, method, and computer program for performing health checks on a system including a plurality of heterogeneous system components | |
| CN118642911A (en) | Cloud service resource monitoring system and method | |
| CN109858807A (en) | Enterprise operation monitoring method and system | |
| CN108961076A (en) | Method and device for determining health insurance premium rate | |
| CN111082998A (en) | Architecture system of operation and maintenance monitoring campus convergence layer | |
| CN106571969B (en) | A cloud service availability evaluation method and system | |
| CN104504491A (en) | Meter reading control method and system | |
| CN116016150B (en) | Physical network early warning method, device, electronic device, and storage medium | |
| CN115373933A (en) | Automatic log auditing platform |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | Application publication date:20170405 |