CN111679740A - A method for remote intelligent diagnosis of power station equipment using augmented reality AR technology - Google Patents
A method for remote intelligent diagnosis of power station equipment using augmented reality AR technologyDownload PDFInfo
- Publication number
- CN111679740A CN111679740ACN202010508416.XACN202010508416ACN111679740ACN 111679740 ACN111679740 ACN 111679740ACN 202010508416 ACN202010508416 ACN 202010508416ACN 111679740 ACN111679740 ACN 111679740A
- Authority
- CN
- China
- Prior art keywords
- technology
- remote
- diagnosis
- data
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/36—Creation of semantic tools, e.g. ontology or thesauri
- G06F16/367—Ontology
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/43—Querying
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/0486—Drag-and-drop
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/20—Design optimisation, verification or simulation
- G06F30/27—Design optimisation, verification or simulation using machine learning, e.g. artificial intelligence, neural networks, support vector machines [SVM] or training a model
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/20—Administration of product repair or maintenance
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/06—Energy or water supply
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04806—Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/20—Indexing scheme for editing of 3D models
- G06T2219/2016—Rotation, translation, scaling
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S10/00—Systems supporting electrical power generation, transmission or distribution
- Y04S10/50—Systems or methods supporting the power network operation or management, involving a certain degree of interaction with the load-side end user applications
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- Software Systems (AREA)
- Human Resources & Organizations (AREA)
- Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Computer Graphics (AREA)
- Evolutionary Computation (AREA)
- General Business, Economics & Management (AREA)
- Tourism & Hospitality (AREA)
- Geometry (AREA)
- Public Health (AREA)
- Quality & Reliability (AREA)
- Medical Informatics (AREA)
- Entrepreneurship & Innovation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Operations Research (AREA)
- Architecture (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Water Supply & Treatment (AREA)
- Primary Health Care (AREA)
- Life Sciences & Earth Sciences (AREA)
- Animal Behavior & Ethology (AREA)
- Computational Linguistics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Translated fromChinese
Description
Translated fromChinese技术领域technical field
本发明涉及远程智能诊断的方法，特别涉及利用增强现实AR技术对电站设备进行远程智能诊断的方法，基于增强现实AR技术实现“人－机－数－环－知”循环互动进行远程故障的诊断。The invention relates to a method for remote intelligent diagnosis, and in particular to a method for remote intelligent diagnosis of power station equipment by using augmented reality AR technology. Based on the augmented reality AR technology, the cyclic interaction of "human-machine-data-loop-knowledge" is realized for remote fault diagnosis. .
背景技术Background technique
发电厂(电站)是资金和技术密集型企业，其设备的安全和高效运行是企业不断追求的目标。在电力生产过程中，重要设备运行过程中的任何故障不仅直接影响电能的产量和质量，还可能造成严重的设备和人身事故。要使机组设备安全、可靠、经济地运行，过程状态监测和故障诊断是重要且有效的技术手段。另外由于机组灵活性运行和环保排放等方面需求，电厂在设备运行、检修和可靠性、经济性分析诊断过程中，需要丰富经验和知识的专业人员进行技术服务。随着企业数字化程度提高和设备的大型化，设备故障诊断需要借助的资源和处理的数据量越来越多，需要借助大量的科学计算和知识经验支持，使得单个企业无法解决所有的问题。Power plants (power stations) are capital- and technology-intensive enterprises, and the safe and efficient operation of their equipment is the constant pursuit of enterprises. In the process of electric power production, any failure in the operation of important equipment not only directly affects the output and quality of electric energy, but also may cause serious equipment and personal accidents. To make the unit equipment operate safely, reliably and economically, process state monitoring and fault diagnosis are important and effective technical means. In addition, due to the requirements of flexible operation of units and environmental protection emissions, the power plant requires professionals with rich experience and knowledge to provide technical services in the process of equipment operation, maintenance, reliability, and economic analysis and diagnosis. With the improvement of enterprise digitization and the enlargement of equipment, equipment fault diagnosis requires more and more resources and processing data, and requires a large amount of scientific computing and knowledge and experience support, making it impossible for a single enterprise to solve all problems.
传统的现场技术服务方式存在项目周期长、执行成本高、人力资源占用率高、劳动强度大、应急性差等缺点。现场对设备的诊断分析容易受到人力、技术以及地域的限制，历史知识共享性、重用性低的问题。The traditional on-site technical service method has shortcomings such as long project cycle, high execution cost, high human resource occupancy rate, high labor intensity, and poor emergency response. On-site diagnostic analysis of equipment is easily limited by manpower, technology, and region, and the sharing and reusability of historical knowledge are low.
随着计算机网络技术的迅速发展，设备的远程诊断得到越来越广泛的重视。但传统的远程诊断在数据灵活采集、现场设备连接、环境感知、人员沟通和远程知识传递都存在技术和空间上的障碍，制约了远程诊断的实际应用效果。With the rapid development of computer network technology, the remote diagnosis of equipment has been paid more and more attention. However, the traditional remote diagnosis has technical and spatial obstacles in flexible data collection, field equipment connection, environmental perception, personnel communication and remote knowledge transfer, which restricts the practical application effect of remote diagnosis.
发明内容SUMMARY OF THE INVENTION
为了解决传统远程诊断面临的上述问题，迎合智能电站的发展趋势，本发明的目的在于提供一种利用增强现实AR技术对电站设备进行远程智能诊断的方法,利用AR技术开发的一种对电站设备进行远程智能诊断的方法，主要特征是基于“人－机－数－环－知识”要素地循环有机互动，实现信息、数据和人力资源的有效协同共享，让工业问题诊断更直接，更精准，更高效，可促进区域乃至全球诊断资源共享和快速故障诊断，对提高电站设备安全性、可靠性、可用度以及降低诊断维修成本具有积极意义。In order to solve the above problems faced by traditional remote diagnosis and meet the development trend of smart power stations, the purpose of the present invention is to provide a method for remote intelligent diagnosis of power station equipment by using augmented reality AR technology, and a method developed by using AR technology for power station equipment The main feature of the method for remote intelligent diagnosis is the circular organic interaction based on the elements of "human-machine-data-loop-knowledge", which realizes the effective collaborative sharing of information, data and human resources, and makes the diagnosis of industrial problems more direct and accurate. More efficient, it can promote the sharing of regional and even global diagnostic resources and rapid fault diagnosis, which has positive significance for improving the safety, reliability, availability of power station equipment and reducing the cost of diagnosis and maintenance.
为了达到上述目的，本发明的技术方案为：In order to achieve the above object, the technical scheme of the present invention is:
一种利用增强现实AR技术对电站设备进行远程智能诊断的方法,包括以下步骤：A method for remote intelligent diagnosis of power station equipment using augmented reality AR technology, comprising the following steps:
1.利用AR全息技术和即时通讯技术将现场检修员工与远程专家进行“面对面”连接，实现远程诊断1. Use AR holographic technology and instant communication technology to connect on-site maintenance staff and remote experts "face-to-face" to realize remote diagnosis
具体为：在即时通讯的基础上，通过AR全息成像显示技术把相距千里之外的现场检修员工和远程专家虚拟在一个房间位置，使用景深传感相机和数码投影仪来营造出一个虚拟空间，并将虚拟世界和现实世界融合在一起，场检修员工和远程专家通过这个全息的数码影像从各种不同角度看到彼此，双方“面对面”进行沟通和交流，“手把手”地协助解决问题，双方可在同一工作白板进行图形绘制、展示工作原理流程和解决方案；Specifically: on the basis of instant messaging, the AR holographic imaging display technology is used to virtualize on-site maintenance employees and remote experts thousands of miles away in one room, and a depth-sensing camera and digital projector are used to create a virtual space. Integrating the virtual world and the real world together, the on-site maintenance staff and remote experts see each other from various angles through this holographic digital image. Graphics can be drawn on the same working whiteboard, and working principle processes and solutions can be displayed;
2.利用AR设备识别跟踪和控制感知技术将现场检修机器与远程专家进行人-机连接2. Use AR device identification tracking and control perception technology to connect on-site maintenance machines with remote experts for human-machine connection
首先利用ARAR设备对现场机器进行定位、注册、识别、跟踪，组成完整的AR物体连接，借助计算机将数据通过AR的2D、3D和4D图像技术，对机器进行立体透视；First, use ARAR equipment to locate, register, identify, and track the on-site machine to form a complete AR object connection, and use the computer to pass the data through AR's 2D, 3D and 4D image technology to perform stereoscopic perspective on the machine;
在物体控制感知方面，通过手势和姿态的直接识别和控制，实现与诊断机器设备手势和肢体交互，通过追踪手部很多个关节，实现点击，触摸，滑动和反馈手部姿势，另外还有语音合成控制，意念控制人机交互能功能，远程专家只需上下“看”一眼运行中的设备就能知道哪个零部件出了问题，这样在3D虚拟空间中直接拖拽、旋转、放缩、操作现场设备及其零部件的透视图，帮助用户理解设备结构和运行状态，进一步检查和发现问题；In terms of object control perception, through the direct recognition and control of gestures and gestures, gestures and body interaction with diagnostic equipment can be realized. By tracking many joints of the hand, click, touch, slide and feedback of hand gestures can be realized. In addition, there are voices. Synthetic control, mind-controlled human-computer interaction function, remote experts only need to "look" up and down the running equipment to know which part has a problem, so that they can directly drag, rotate, zoom, and operate in the 3D virtual space The perspective view of the field equipment and its components helps users to understand the equipment structure and operating status, and further check and find problems;
3.利用“端-云”技术将现场运行信息与远程诊断中心进行数据建模可视化连接3. Use the "terminal-cloud" technology to connect the field operation information with the remote diagnosis center for data modeling and visualization
远程诊断需要采集大量的现场运行数据，包括实时数据和历史数据，这些数据具备实时海量的特点，传输并保存到诊断数据中心上，利用人工智能AI从大量运行数据中发现潜在规律、提取设备特征数据和运行规则建模，AR则是将这些特征参数的进行模型的高维显示，给诊断者辅助决策，量值包括：最大值、最小值、峰值、均值、均方值、方差、方根幅值、平均幅值、平均峰值；Remote diagnosis needs to collect a large amount of on-site operation data, including real-time data and historical data. These data have the characteristics of real-time and massive data, which are transmitted and saved to the diagnosis data center. Artificial intelligence (AI) is used to discover potential patterns and extract equipment characteristics from the large-scale operation data. Data and operating rules are modeled, and AR is a high-dimensional display of these characteristic parameters of the model to assist the diagnoser in decision-making. The values include: maximum value, minimum value, peak value, mean value, mean square value, variance, square root Amplitude, average amplitude, average peak value;
4、利用AR增强仿真和投影技术对物理环境和虚拟环境进行融合，将现场环境虚拟到远程诊断中心进行环境仿真连接4. Use AR enhanced simulation and projection technology to integrate the physical environment and virtual environment, and virtualize the on-site environment to the remote diagnosis center for environmental simulation connection
通过AR让协同各方通过第一视角的画面多方共享，为远程专家提供一个虚拟环境与现实世界相叠加的场景，通过将物理空间和虚拟空间进行校准、融合和控制，呈现在大家面前的视野不仅仅是检修员工的眼睛看到的，还有虚拟空间物体、数据及模型，这样远程诊断整个工作沉浸在增强现实的场景中，远程专家直接了解现场检修员所看到的内容，能够更清楚地了解现场工作、维修危险系数，远程专家的指导结果将同步展现在现场用户视野中；Through AR, all parties in the collaboration can share the picture from the first perspective, and provide remote experts with a scene where the virtual environment and the real world are superimposed. Not only the eyes of maintenance employees see, but also objects, data and models in virtual space. In this way, the entire work of remote diagnosis is immersed in the augmented reality scene. Remote experts can directly understand what the on-site maintenance personnel see, and can be more clear. Understand the risk factors of on-site work and maintenance, and the guidance results of remote experts will be simultaneously displayed in the field of users' field of vision;
5、应用AR远程诊断实现设备运行特征参数提取与知识图谱的建立5. Application of AR remote diagnosis to realize the extraction of equipment operation characteristic parameters and the establishment of knowledge graph
电站设备诊断是基于实时/历史数据挖掘部件特征的设备状态评价技术，通过人工智能计算方法，包括人工神经网络，遗传算法、模式识别和数理统计，从大量历史数据中获取机组特征参数，用模式匹配方式对主要设备运行状态进行性能及故障诊断；故障诊断中直接记录、保存现场一手数据，并对任务状态进行实时跟踪，同时能够查询多种类型的知识图谱数据，多种类型包括文档、图片、视频及数据模型；知识图谱数据是通过AR技术实现现场设备运行大数据的收集、分析，从而进行经验方法的沉淀及流程的优化，实现设备诊断知识图谱的建立。Power station equipment diagnosis is an equipment condition evaluation technology based on real-time/historical data mining component characteristics. Through artificial intelligence calculation methods, including artificial neural network, genetic algorithm, pattern recognition and mathematical statistics, the unit characteristic parameters are obtained from a large amount of historical data, and the model The matching method performs performance and fault diagnosis on the operating status of the main equipment; directly records and saves on-site first-hand data during fault diagnosis, and tracks the task status in real time. At the same time, it can query various types of knowledge graph data, including documents, pictures , video and data model; knowledge graph data is to collect and analyze the big data of field equipment operation through AR technology, so as to accumulate experience methods and optimize the process, and realize the establishment of equipment diagnosis knowledge graph.
本发明的优点：Advantages of the present invention:
本发明是根据“人－机－数－环－知”5个特征要素的循环互动来进行远程故障诊断，利用AR全息技术将虚拟世界和现实世界融合在一起，通过即时通讯(文字、语音、图片、视频表达的信息)技术实现远程诊断多方进行“面对面”进行沟通和交流，“手把手”地协助解决问题；利用ARAR视觉定位，注册，识别，跟踪组成的完整的AR物体连接，再通过手势和姿态的直接识别和控制实现远程诊断的“人-机”连接；利用“端-云”、AI数据建模及可视化技术实现数据的连接应用；利用AR增强仿真和投影技术将对物理环境和虚拟环境进行融合，通过AR让协同各方通过第一视角的画面多方共享，提供一个虚拟环境与现实世界相叠加的场景，让协作更精准、更高效。并将远程诊断由桌面级延伸到环境级；应用AR+AI远程诊断实现了设备运行特征参数提取与知识图谱的建立。基于AR技术的远程诊断，真正意义上远程诊断能够实现前面讲的多专家、多手段、多工具的协同，以及能够实现区域乃至全球诊断资源共享和快速故障诊断；为智能电站的迅速发展提供多元化的启发，对提高电站设备安全性、可靠性、可用度以及降低诊断维修成本具有积极意义。The present invention performs remote fault diagnosis based on the cyclic interaction of the five characteristic elements of "human-machine-data-loop-knowledge", uses AR holographic technology to integrate the virtual world and the real world, and uses instant communication (text, voice, Information expressed by pictures and videos) technology realizes remote diagnosis and multi-party "face-to-face" communication and communication, and "hands-on" to assist in solving problems; using ARAR visual positioning, registration, recognition, and tracking to form a complete AR object connection, and then through gestures Realize the “human-machine” connection of remote diagnosis through the direct recognition and control of posture and posture; realize the connection application of data by using “terminal-cloud”, AI data modeling and visualization technology; use AR enhanced simulation and projection technology to analyze the physical environment and physical environment. The virtual environment is integrated, and through AR, all parties in the collaboration can share the picture from the first perspective, providing a scene where the virtual environment and the real world are superimposed, making the collaboration more accurate and efficient. And the remote diagnosis is extended from the desktop level to the environment level; the application of AR+AI remote diagnosis realizes the extraction of equipment operation characteristic parameters and the establishment of knowledge graph. The remote diagnosis based on AR technology, in the true sense, can realize the collaboration of multiple experts, multi-methods, and multi-tools mentioned above, and can realize the sharing of regional and even global diagnostic resources and rapid fault diagnosis; it provides diversified solutions for the rapid development of smart power stations. The enlightenment of this technology has positive significance for improving the safety, reliability, availability of power station equipment and reducing the cost of diagnosis and maintenance.
附图说明Description of drawings
图1是本发明利用增强现实(AR)技术对电站设备进行远程诊断－特征要素关系图。FIG. 1 is a diagram showing the relationship between remote diagnosis of power station equipment and feature elements using augmented reality (AR) technology according to the present invention.
图2是本发明利用增强现实(AR)技术对电站设备进行远程智能诊断各系统连接框图。FIG. 2 is a block diagram of the connection of various systems for remote intelligent diagnosis of power station equipment by using augmented reality (AR) technology in the present invention.
具体实施方式Detailed ways
下面结合说明书的附图1和图2，对本发明作进一步的说明。The present invention will be further described below with reference to Fig. 1 and Fig. 2 of the specification.
如图1所示，本发明利用增强现实(AR)技术对电站设备进行远程智能诊断的方法，是一种实现“人－机－数－环－知”循环互动进行远程故障诊断的方法，其特点要素包括5个方面如图1所示，具体为：As shown in FIG. 1 , the present invention uses the augmented reality (AR) technology to perform remote intelligent diagnosis on power station equipment, which is a method for realizing remote fault diagnosis through “human-machine-data-loop-knowledge” cyclic interaction. The characteristic elements include five aspects as shown in Figure 1, specifically:
1.利用AR全息技术和即时通讯技术将现场检修员工与远程专家进行“面对面”连接，实现远程诊断1. Use AR holographic technology and instant communication technology to connect on-site maintenance staff and remote experts "face-to-face" to realize remote diagnosis
远程诊断常用的方法就是远程协助，目前电话、视频、聊天工具能够提供远程协助功能，但体验却不尽如人意，比如电话无法具象地表现出对话双方的场景画面，视频远程协助虽然能够提供现场画面，不过却很难实现“手把手”地协助，而聊天工具的远程协助一般为单向(如QQ)。The commonly used method of remote diagnosis is remote assistance. At present, telephone, video, and chat tools can provide remote assistance functions, but the experience is not satisfactory. For example, the telephone cannot vividly show the scene of the two parties in the conversation. Although video remote assistance can provide on-site assistance However, it is difficult to achieve "hands-on" assistance, and the remote assistance of chat tools is generally one-way (such as QQ).
该步骤具体为：在即时通讯(文字、语音、图片、视频表达的信息)的基础上，通过AR全息成像显示技术把相距千里之外的现场检修员工和远程专家虚拟在一个房间位置。以往只能通过屏幕的文字、语音、图片还有视频来表达自己的信息，运用了强大的AR虚拟全息成像技术，使用景深传感相机和数码投影仪来营造出一个虚拟空间，并将虚拟世界和现实世界融合在一起，利用AR强大的实时3D运算能力、精准的即时定位、手势识别技术与立体抬头现实技术等技术，提供了一种前所未有的互动形式。场检修员工和远程专家能够通过这个全息的数码影像从各种不同角度看到彼此，双方近乎“面对面”进行沟通和交流，包括音视频聊天互动、“手把手”地协助解决问题，双方可在同一工作白板进行图形绘制、展示工作原理流程和解决方案。This step is as follows: on the basis of instant messaging (information expressed by text, voice, pictures, and video), the on-site maintenance staff and remote experts thousands of miles away are virtualized in one room through AR holographic imaging display technology. In the past, we could only express our own information through text, voice, pictures and videos on the screen. We used the powerful AR virtual holographic imaging technology, used depth-sensing cameras and digital projectors to create a virtual space and put the virtual world together. It integrates with the real world, and provides an unprecedented form of interaction by using AR's powerful real-time 3D computing capabilities, precise real-time positioning, gesture recognition technology and three-dimensional head-up reality technology. On-site maintenance staff and remote experts can see each other from various angles through this holographic digital image, and the two sides communicate and communicate almost "face-to-face", including audio and video chat interaction, and "hands-on" assistance to solve problems. Working whiteboard for graphic drawing, presentation of working principle processes and solutions.
远程专家可以用手指或笔在屏幕中圈出问题所在，对方同时也可以看到画圈的画面，以此来解决实际中所遇到的问题。这样远程专家就可以“现场”方式指导用户操作，以解决实际工作中所遇到的问题。The remote expert can use a finger or a pen to circle the problem on the screen, and the other party can see the circled picture at the same time, so as to solve the problem encountered in practice. In this way, the remote expert can guide the user operation "on the spot" to solve the problems encountered in the actual work.
AR多人通讯支持一对多、多对一、多对多等各种场景，参与诊断各方可自由选择接入通讯的终端设备类型。AR multi-person communication supports various scenarios such as one-to-many, many-to-one, and many-to-many, and all parties involved in the diagnosis can freely choose the type of terminal equipment to access the communication.
2、利用AR设备识别跟踪和控制感知技术将现场检修机器与远程专家进行人-机连接2. Use AR device identification tracking and control perception technology to connect on-site maintenance machines with remote experts for human-machine connection
通过利用AR视觉定位，注册，识别，跟踪组成的完整的AR物体连接技术。借助计算机将复杂数据通过AR的2D、3D和4D图像技术，对机器进行立体透视，是人机互动连接的前提。A complete AR object connection technology composed of AR vision positioning, registration, recognition, and tracking. Using a computer to pass complex data through AR's 2D, 3D and 4D image technology to perform a stereoscopic perspective on the machine is the premise of human-computer interaction.
在物体控制感知方面，通过手势和姿态的直接识别和控制，实现与诊断机器设备手势和肢体交互，系统可通过常用手势实现点击，触摸，滑动和反馈手部姿势，还可用语音和图形标记物控制，可实现在3D虚拟空间中直接拖拽、旋转、放缩、操作现场设备及其零部件的透视图。这样，远程专家只需上下“看”一眼运行中的设备就能知道你的哪个零部件出了问题，甚至可以判断设备是否需要停机维修。In the aspect of object control perception, through the direct recognition and control of gestures and gestures, the gestures and body interaction with diagnostic machines and equipment can be realized. The system can realize click, touch, slide and feedback hand gestures through common gestures, and can also use voice and graphic markers. Control, which can directly drag, rotate, zoom, and operate the perspective view of field devices and their components in the 3D virtual space. In this way, a remote expert can know which part of yours is faulty by simply "looking" up and down at the running equipment, and can even determine whether the equipment needs to be shut down for maintenance.
通过追踪手部很多个关节，实现点击，触摸，滑动和反馈手部姿势，另外还有更强的人机交互能功能：语音合成控制，意念控制等。这样在3D虚拟空间中直接拖拽、旋转、放缩、操作现场设备及其零部件的透视图，帮助用户理解设备结构和运行状态，进一步检查和发现问题。By tracking many joints of the hand, it can realize click, touch, slide and feedback of hand posture, and there are also stronger human-computer interaction functions: speech synthesis control, thought control, etc. In this way, the perspective view of the field equipment and its components can be directly dragged, rotated, zoomed, and operated in the 3D virtual space, helping users to understand the equipment structure and operating status, and further check and find problems.
3、利用“端-云”技术将现场运行信息与远程诊断中心进行数据建模可视化连接3. Use the "terminal-cloud" technology to connect the field operation information with the remote diagnosis center for data modeling and visualization
如图2所示，远程诊断中心提供数据云服务(IaaS/PaaS/SaaS)，AR终端现场部署，两者进行“端-云”连接。As shown in Figure 2, the remote diagnosis center provides data cloud services (IaaS/PaaS/SaaS), AR terminals are deployed on-site, and the two are connected to the cloud.
远程诊断需要大量的现场运行数据，这些数据具备实时海量的特点。根据数据及建模连接需要，基于XML语言可扩展性、高度结构化、便于网络传输特点，自定义标记、属性和描述法，实现数据跨平台传送及多样化显示，这样对工作地点移动性较大的远程诊断人员来说，可以及时地进行数据连接。Remote diagnosis requires a large amount of on-site operation data, which has the characteristics of real-time mass. According to the needs of data and modeling connection, based on the characteristics of XML language scalability, high structure, and easy network transmission, custom tags, attributes and description methods can realize data cross-platform transmission and diversified display, which is more convenient for workplace mobility. For large remote diagnostic personnel, data connection can be made in time.
对于接收到的大数据集，采用AR+AI工作处理方式。电站设备诊断是基于实时/历史数据挖掘部件特征的设备状态评价技术，利用人工智能AI从大量运行数据中发现潜在规律、提取设备特征数据和运行规则建模，AR则是将这些特征参数的量值(包括：最大值、最小值、峰值、均值、均方值、方差、方根幅值、平均幅值、平均峰值)进行模型的高维显示，给诊断者辅助决策。For the received large data set, the AR+AI work processing method is adopted. Power station equipment diagnosis is an equipment status evaluation technology based on real-time/historical data mining component characteristics. Artificial intelligence (AI) is used to discover potential laws from a large amount of operating data, extract equipment characteristic data and model operation rules. AR is the quantitative analysis of these characteristic parameters. Values (including: maximum value, minimum value, peak value, mean value, mean square value, variance, root square amplitude, average amplitude, and average peak value) are displayed in a high-dimensional model to assist the diagnostician in decision-making.
AR终端现场部署，数据及模型存储在云端，通过“AR+AI”技术进行端云连接互动，实现算力和算法的融合，技术和应用场景的结合。AR terminals are deployed on-site, data and models are stored in the cloud, and the "AR+AI" technology is used to connect and interact with the cloud, realizing the integration of computing power and algorithms, and the combination of technology and application scenarios.
4、利用AR增强仿真和投影技术将对物理环境和虚拟环境进行融合。将现场环境虚拟到远程诊断中心进行环境仿真连接4. Using AR enhanced simulation and projection technology, the physical environment and the virtual environment will be integrated. Virtual on-site environment to remote diagnostic center for environment simulation connection
通过AR让协同各方通过第一视角的画面多方共享，为远程专家提供一个虚拟环境与现实世界相叠加的场景，如图2所示，通过将物理空间和虚拟空间进行校准、融合和控制，使远程诊断整个工作沉浸在增强现实的场景中，不仅仅是检修员工的眼睛看到的，远程专家也直接了解现场检修员所看到的内容，可以更清楚地了解现场工作、维修危险系数，远程专家的指导结果将同步展现在现场用户视野中。可通过一键冻屏和实时标注技术，提供身临其境的维修指导，让协作更精准、更高效。Through AR, the cooperating parties can share the picture from the first perspective, and provide remote experts with a scene where the virtual environment and the real world are superimposed. Immerse the entire remote diagnosis work in the augmented reality scene, not only the eyes of the maintenance staff see, but the remote experts also directly understand the content seen by the on-site maintenance personnel, and can more clearly understand the risk factors of on-site work and maintenance, The guidance results of the remote experts will be simultaneously displayed in the field user's field of vision. It can provide immersive maintenance guidance through one-click freezing and real-time labeling technology, making collaboration more accurate and efficient.
通过AR环境投影映射方式取代我们在日常生活中所熟知的屏幕，实现360°投影沉浸式环境体验，将远程诊断由桌面级延伸到环境级，即由传统桌面远程连接方式向现场物理世界大场景交互发展，实现“无处不在的用户交互界面”。The AR environment projection mapping method replaces the screens we are familiar with in daily life, realizes 360° projection immersive environment experience, and extends remote diagnosis from the desktop level to the environment level, that is, from the traditional desktop remote connection method to the scene of the physical world scene Interactive development to achieve "ubiquitous user interface".
5.应用AR远程诊断实现了设备运行特征值参数提取与知识图谱的建立5. The application of AR remote diagnosis realizes the extraction of equipment operation characteristic value parameters and the establishment of knowledge graph
在工业领域，大型设备因机构复杂，大修操作繁琐，流程长、对操作规范、效率、安全性要求高。现场巡检和检修人员压力大。In the industrial field, large-scale equipment has complex mechanisms, cumbersome overhaul operations, long processes, and high requirements for operational specifications, efficiency, and safety. On-site inspection and maintenance personnel are under great pressure.
电站设备诊断是基于实时/历史数据挖掘部件特征的设备状态评价技术，通过人工智能计算方法(人工神经网络，遗传算法)、模式识别和数理统计，从大量历史数据中获取机组特征参数，用模式匹配方式对主要设备运行状态进行性能及故障诊断。Power station equipment diagnosis is an equipment status evaluation technology based on real-time/historical data mining component characteristics. Through artificial intelligence calculation methods (artificial neural network, genetic algorithm), pattern recognition and mathematical statistics, the unit characteristic parameters are obtained from a large amount of historical data, and the model The matching method is used to perform performance and fault diagnosis on the operating status of the main equipment.
AR诊断过程中可直接记录、保存现场一手数据，并对任务状态进行实时跟踪，便于信息的管理与追溯。同时可查询多种类型(包括文档、图片、视频及数据模型等)的知识图谱数据。During the AR diagnosis process, the on-site primary data can be directly recorded and saved, and the task status can be tracked in real time, which is convenient for information management and traceability. At the same time, various types of knowledge graph data (including documents, pictures, videos and data models, etc.) can be queried.
通过AR技术实现现场设备运行大数据的收集、分析，从而进行经验方法的沉淀及流程的优化。同时构建“专家数据模型”和相关智能算法，实现真正意义的远程智能诊断。Through AR technology, the collection and analysis of big data of field equipment operation can be realized, so as to accumulate experience and methods and optimize the process. At the same time, an "expert data model" and related intelligent algorithms are constructed to realize real remote intelligent diagnosis.
本发明的利用增强现实(AR)技术对电站设备进行远程智能诊断的方法，利用AR技术，相关人员通过AR智能终端，如AR智能眼镜，利用内置的软件算法和工作辅助系统进行以往案例分析、判断，迭代出最优工作方案，将需要实操的标准步骤则通过三维图像叠加的现实世界中，并浮现于眼前。所有步骤都将一清二楚，出错率极大降低。In the method for remote intelligent diagnosis of power station equipment using augmented reality (AR) technology of the present invention, using AR technology, relevant personnel use AR intelligent terminals, such as AR smart glasses, to use built-in software algorithms and work assistance systems to analyze past cases, Judgment, iterate the optimal work plan, and the standard steps that need to be operated will appear in the real world where 3D images are superimposed. All steps will be clear, and the error rate will be greatly reduced.
随着工业物联网技术的发展，远程故障诊断和维护技术可以实现对复杂系统快速、及时、正确诊断和维护。远程诊断不但能及时给机组做出分析诊断，减少故障的处理时间，并可为发电企业提供设备状态评估、故障预警、性能劣化分析、节能分析以及运行指导，因而可提高设备运行安全性、可靠性、可用度。With the development of industrial Internet of Things technology, remote fault diagnosis and maintenance technology can realize fast, timely, and correct diagnosis and maintenance of complex systems. Remote diagnosis can not only analyze and diagnose the unit in time and reduce the processing time of faults, but also provide power generation enterprises with equipment status assessment, fault warning, performance deterioration analysis, energy saving analysis and operation guidance, thus improving the safety and reliability of equipment operation. availability, availability.
基于AR技术的远程诊断是计算机、现代信息技术和传统工程技术服务的结合，通过“人－机－数－环－知”循环互动，真正意义上远程诊断能够实现前面讲的多专家、多手段、多工具的协同，以及能够实现区域乃至全球诊断资源共享和快速故障诊断。诊断过程中“移动的是信息流而不是人本身”，符合目前“互联网+技术”的发展潮流，成为工业智能化发展的方向之一，也为智能电站的迅速发展提供多元化的启发，本发明具有良好的应用前景。Remote diagnosis based on AR technology is a combination of computer, modern information technology and traditional engineering technology services. Through the cyclic interaction of "human-machine-data-loop-knowledge", remote diagnosis in a true sense can realize the multi-expert and multi-method mentioned above. , the collaboration of multiple tools, and the sharing of regional and even global diagnostic resources and rapid fault diagnosis. In the process of diagnosis, "what moves is the flow of information rather than the person itself", which is in line with the current development trend of "Internet + technology", and has become one of the directions of industrial intelligent development, and also provides diversified inspiration for the rapid development of smart power stations. The invention has good application prospects.
以上显示和说明了本发明的系统架构、主要内容和主要特征。本行业的技术人员应该了解，本发明不受上述应用例子的限制，上述应用例子和说明书中描述的只是说明本发明的原理及组成，在不脱离本发明精神和范围的前提下，本发明还会有各种变化和改进，这些变化和改进都落入要求保护的本发明范围内。本发明要求保护范围由所附的权利要求书及其等效物界定。The system architecture, main contents and main features of the present invention are shown and described above. Those skilled in the art should understand that the present invention is not limited by the above application examples. The above application examples and descriptions are only to illustrate the principle and composition of the present invention. Without departing from the spirit and scope of the present invention, the present invention also There are various changes and modifications which fall within the scope of the claimed invention. The claimed scope of the present invention is defined by the appended claims and their equivalents.
Claims (6)
Translated fromChinesePriority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010508416.XACN111679740A (en) | 2020-06-06 | 2020-06-06 | A method for remote intelligent diagnosis of power station equipment using augmented reality AR technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010508416.XACN111679740A (en) | 2020-06-06 | 2020-06-06 | A method for remote intelligent diagnosis of power station equipment using augmented reality AR technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111679740Atrue CN111679740A (en) | 2020-09-18 |
Family
ID=72435233
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010508416.XAPendingCN111679740A (en) | 2020-06-06 | 2020-06-06 | A method for remote intelligent diagnosis of power station equipment using augmented reality AR technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111679740A (en) |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112181848A (en)* | 2020-10-21 | 2021-01-05 | 滁州市精美家电设备股份有限公司 | Industrial Internet 5G remote guarantee and diagnosis full-automatic complete equipment operation system |
| CN112330818A (en)* | 2020-11-03 | 2021-02-05 | 北京卫星环境工程研究所 | Unmanned aerial vehicle part manual layering auxiliary system and method based on augmented reality |
| CN112434575A (en)* | 2020-11-12 | 2021-03-02 | 广东电网有限责任公司 | Electric power Internet of things equipment remote control method and system based on attitude recognition |
| CN112562092A (en)* | 2020-12-22 | 2021-03-26 | 国网上海市电力公司 | Electrical test intelligent interaction system based on AR technology |
| CN112616047A (en)* | 2020-11-13 | 2021-04-06 | 贵州电网有限责任公司 | Machine room operation field guidance and remote assistance scheduling system based on AR |
| CN112710426A (en)* | 2020-12-17 | 2021-04-27 | 大唐东北电力试验研究院有限公司 | AR power station steam turbine dynamic balance method and device based on virtual reality |
| CN112865317A (en)* | 2021-01-28 | 2021-05-28 | 深圳供电局有限公司 | Remote virtual control method, device and system for intelligent power station |
| CN112947881A (en)* | 2021-04-02 | 2021-06-11 | 浙江德维迪亚数字科技有限公司 | Remote screen freezing guidance method based on instant messaging |
| CN113011723A (en)* | 2021-03-04 | 2021-06-22 | 北京计算机技术及应用研究所 | Remote equipment maintenance system based on augmented reality |
| CN113114971A (en)* | 2021-06-16 | 2021-07-13 | 国能信控互联技术有限公司 | Head display equipment assisting remote cooperation, remote cooperation system and control method thereof |
| CN113222337A (en)* | 2021-04-06 | 2021-08-06 | 盈机技术服务(北京)有限公司 | Remote vulnerability assessment method and device and storage medium |
| CN113783305A (en)* | 2021-09-27 | 2021-12-10 | 国能陕西水电有限公司 | AR-based power station integrated management method, system and server |
| CN115171447A (en)* | 2022-07-11 | 2022-10-11 | 广东电网有限责任公司东莞供电局 | Operation tutoring system based on augmented reality technology |
| CN115313618A (en)* | 2021-12-10 | 2022-11-08 | 中国电力科学研究院有限公司 | Transformer substation remote expert diagnosis platform and diagnosis method based on AR and 5G |
| CN115357873A (en)* | 2022-10-20 | 2022-11-18 | 苏州元硕自动化科技有限公司 | AR equipment point inspection auxiliary system based on Vuforia technology |
| CN115562105A (en)* | 2022-09-25 | 2023-01-03 | 帖凯莹 | Remote interaction technology based on fusion AR |
| CN118695965A (en)* | 2022-02-11 | 2024-09-24 | Lg电子株式会社 | Charging station control system based on digital twin |
| CN118860159A (en)* | 2024-09-24 | 2024-10-29 | 北京至臻云智能科技有限公司 | Auxiliary maintenance method and system of gesture recognition in GIS equipment based on mixed reality |
| US12399571B2 (en) | 2022-12-19 | 2025-08-26 | T-Mobile Usa, Inc. | Hand-movement based interaction with augmented reality objects |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108879440A (en)* | 2018-06-20 | 2018-11-23 | 国网山东省电力公司济宁供电公司 | Intelligent examination and repair system and method based on wearable augmented reality display terminal and cloud platform |
| CN110233841A (en)* | 2019-06-11 | 2019-09-13 | 上海文景信息科技有限公司 | A kind of long-distance education data interaction system and method based on AR holographic glasses |
| CN110442486A (en)* | 2019-08-05 | 2019-11-12 | 北京远舢智能科技有限公司 | A kind of remote device diagnostics system and method based on mixed reality technology |
- 2020
- 2020-06-06CNCN202010508416.XApatent/CN111679740A/enactivePending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108879440A (en)* | 2018-06-20 | 2018-11-23 | 国网山东省电力公司济宁供电公司 | Intelligent examination and repair system and method based on wearable augmented reality display terminal and cloud platform |
| CN110233841A (en)* | 2019-06-11 | 2019-09-13 | 上海文景信息科技有限公司 | A kind of long-distance education data interaction system and method based on AR holographic glasses |
| CN110442486A (en)* | 2019-08-05 | 2019-11-12 | 北京远舢智能科技有限公司 | A kind of remote device diagnostics system and method based on mixed reality technology |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112181848A (en)* | 2020-10-21 | 2021-01-05 | 滁州市精美家电设备股份有限公司 | Industrial Internet 5G remote guarantee and diagnosis full-automatic complete equipment operation system |
| CN112330818B (en)* | 2020-11-03 | 2021-06-22 | 北京卫星环境工程研究所 | Auxiliary system and method for manual layup of UAV parts based on augmented reality |
| CN112330818A (en)* | 2020-11-03 | 2021-02-05 | 北京卫星环境工程研究所 | Unmanned aerial vehicle part manual layering auxiliary system and method based on augmented reality |
| CN112434575A (en)* | 2020-11-12 | 2021-03-02 | 广东电网有限责任公司 | Electric power Internet of things equipment remote control method and system based on attitude recognition |
| CN112434575B (en)* | 2020-11-12 | 2023-09-01 | 广东电网有限责任公司 | Gesture recognition-based remote control method and system for electric power Internet of things equipment |
| CN112616047A (en)* | 2020-11-13 | 2021-04-06 | 贵州电网有限责任公司 | Machine room operation field guidance and remote assistance scheduling system based on AR |
| CN112710426A (en)* | 2020-12-17 | 2021-04-27 | 大唐东北电力试验研究院有限公司 | AR power station steam turbine dynamic balance method and device based on virtual reality |
| CN112562092A (en)* | 2020-12-22 | 2021-03-26 | 国网上海市电力公司 | Electrical test intelligent interaction system based on AR technology |
| CN112865317A (en)* | 2021-01-28 | 2021-05-28 | 深圳供电局有限公司 | Remote virtual control method, device and system for intelligent power station |
| CN113011723A (en)* | 2021-03-04 | 2021-06-22 | 北京计算机技术及应用研究所 | Remote equipment maintenance system based on augmented reality |
| CN113011723B (en)* | 2021-03-04 | 2024-03-01 | 北京计算机技术及应用研究所 | Remote equipment maintenance system based on augmented reality |
| CN112947881A (en)* | 2021-04-02 | 2021-06-11 | 浙江德维迪亚数字科技有限公司 | Remote screen freezing guidance method based on instant messaging |
| CN113222337A (en)* | 2021-04-06 | 2021-08-06 | 盈机技术服务(北京)有限公司 | Remote vulnerability assessment method and device and storage medium |
| CN113222337B (en)* | 2021-04-06 | 2022-07-29 | 盈机技术服务(北京)有限公司 | Remote vulnerability assessment method and device and storage medium |
| CN113114971A (en)* | 2021-06-16 | 2021-07-13 | 国能信控互联技术有限公司 | Head display equipment assisting remote cooperation, remote cooperation system and control method thereof |
| CN113783305A (en)* | 2021-09-27 | 2021-12-10 | 国能陕西水电有限公司 | AR-based power station integrated management method, system and server |
| CN113783305B (en)* | 2021-09-27 | 2023-10-20 | 国能陕西水电有限公司 | AR-based power station integrated management method, system and server |
| CN115313618A (en)* | 2021-12-10 | 2022-11-08 | 中国电力科学研究院有限公司 | Transformer substation remote expert diagnosis platform and diagnosis method based on AR and 5G |
| CN118695965A (en)* | 2022-02-11 | 2024-09-24 | Lg电子株式会社 | Charging station control system based on digital twin |
| CN115171447A (en)* | 2022-07-11 | 2022-10-11 | 广东电网有限责任公司东莞供电局 | Operation tutoring system based on augmented reality technology |
| CN115562105A (en)* | 2022-09-25 | 2023-01-03 | 帖凯莹 | Remote interaction technology based on fusion AR |
| CN115357873A (en)* | 2022-10-20 | 2022-11-18 | 苏州元硕自动化科技有限公司 | AR equipment point inspection auxiliary system based on Vuforia technology |
| US12399571B2 (en) | 2022-12-19 | 2025-08-26 | T-Mobile Usa, Inc. | Hand-movement based interaction with augmented reality objects |
| CN118860159A (en)* | 2024-09-24 | 2024-10-29 | 北京至臻云智能科技有限公司 | Auxiliary maintenance method and system of gesture recognition in GIS equipment based on mixed reality |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111679740A (en) | A method for remote intelligent diagnosis of power station equipment using augmented reality AR technology | |
| JP7105326B2 (en) | PRODUCT DEFECT DETECTION METHOD, APPARATUS, ELECTRONIC DEVICE, STORAGE MEDIUM, AND PROGRAM | |
| CN110109535A (en) | Augmented reality generation method and device | |
| CN104679248B (en) | A kind of more scene interactivity data visualisation systems and working method | |
| CN111526118A (en) | Remote operation guiding system and method based on mixed reality | |
| CN107491174A (en) | Method, apparatus, system and electronic equipment for remote assistance | |
| CN108388711A (en) | A kind of engineering design based on BIM and management system | |
| Zhang et al. | A novel MR remote collaboration system using 3D spatial area cue and visual notification | |
| CN116489149B (en) | A method for building a cloud-edge-device collaborative mixed reality environment for industrial applications | |
| CN108010413A (en) | A kind of wind power plant's O＆M analogue system and its operation appraisal procedure | |
| CN210006245U (en) | augmented reality multi-person collaborative simulation system for power equipment training | |
| CN107610238A (en) | A kind of power equipment AR dynamic modeling systems and its method of work | |
| CN111600297A (en) | Online analysis method and device for power grid equipment operation data under cloud-edge cooperation | |
| CN113965550B (en) | Intelligent Interactive Remote Assisted Video System | |
| CN118071537A (en) | A control system for long-distance water diversion pump station groups based on digital twin technology | |
| CN115294308A (en) | Augmented reality-assisted assembly job guidance system based on deep learning | |
| CN111737789A (en) | Building data visualization management system based on 3D digital scene | |
| Seitz et al. | Augmenting the industrial internet of things with emojis | |
| Feng et al. | ARCoA: Using the AR-assisted cooperative assembly system to visualize key information about the occluded partner | |
| CN107103793A (en) | Substation simulation system based on VR technologies | |
| CN103428472B (en) | A kind of full interactive exchange communication method in kind based on collaborative perception and device thereof | |
| CN207074418U (en) | A kind of power plant's three-dimension visible sysem | |
| CN111660294B (en) | Augmented reality control system of hydraulic heavy-duty mechanical arm | |
| Li et al. | Research on equipment maintenance guidance technology based on mr and digital twin | |
| CN117523128A (en) | Three-dimensional modeling method and system for realizing city information based on big data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20200918 | |
| RJ01 | Rejection of invention patent application after publication |