CN112734588A - Augmented reality processing auxiliary system and use method thereof - Google Patents

Abstract

The invention discloses an augmented reality processing auxiliary system which comprises a workpiece processing database, an operation module and augmented reality equipment, wherein the workpiece processing database is used for storing a plurality of workpiece processing original data, the operation module is electrically connected with the workpiece processing database and used for calculating auxiliary processing data of a workpiece, the augmented reality equipment is electrically connected with the workpiece processing database and the operation module, an inductor is arranged on the augmented reality equipment and used for sensing an identification pattern on the workpiece, the identification pattern is analyzed and calculated to obtain an identification code and is transmitted to the workpiece processing database, the workpiece processing database transmits the corresponding workpiece processing original data to the operation module after receiving the identification code so as to calculate the auxiliary processing data, and the operation module transmits the auxiliary processing data to the augmented reality equipment for display.

Description

Augmented reality processing auxiliary system and use method thereof

Technical Field

The invention relates to the field of processing auxiliary systems, in particular to a processing auxiliary system for assisting an operator to operate a processing machine by utilizing an augmented reality technology and a use method thereof.

Background

In order to deal with the manufacture of various workpieces of different shapes or materials, such as wood, metal materials, semiconductors, ceramics, composite materials, or other various workpieces capable of being processed, the types of tools used on existing processing machines and machines are various, and the operation of the processing machines is relatively complicated. In order to meet the size and shape requirements of various workpieces, an operator of a machining machine often needs to compare the workpiece being machined with a design drawing at any time, and manually measure the size of a part to be machined on the workpiece before and after each machining process is performed to confirm that the machining process is correct.

For example, in the prior art, when drilling a plate-shaped workpiece, an operator needs to measure the size of the mother plate first, and if the size is not the same, the mother plate needs to be cut into a correct size, and then the size of the plate-shaped workpiece is measured again. And then an operator needs to compare the design drawing or the CAD drawing file to confirm that the dimension of the plate-shaped workpiece is correct, and then the plate-shaped workpiece is arranged on the drilling processing machine to prepare for drilling processing operation, wherein in order to match the drilling position of the plate-shaped workpiece, the operator needs to manually install a special tool on the drilling processing machine according to CAM software or a tool installation mode which is planned in advance, then the machine table is mechanically positioned on the installed tools, and the drilling processing operation can be formally carried out after the positioning is finished.

Therefore, the operator in the whole process flow needs to compare the design drawing, the workpiece and the machine configuration back and forth, and the more complicated the process flow is, the more easily the error is caused for the machine operator. If the cutting dimension error, the processing procedure omission or the cutter installation error happens carelessly in the process, not only the whole process needs to be corrected from the beginning, but also the workpiece with the previous processing error needs to be scrapped to cause waste, and the whole processing production progress is also easy to delay. In addition, in a production line of a processing plant, it is often necessary to deal with the change of the type of the workpiece to be produced, and when the same machine is changed to process different types of workpieces, all the above processes may need to be modified greatly, which may also cause the reduction of the production efficiency.

Disclosure of Invention

According to the shortcomings and problems encountered in the prior art, the present invention provides a method for processing a production line by using augmented reality real-time imaging technology, wherein the imaging source is original workpiece processing data, the augmented reality real-time imaging technology is combined with CAD/CAM software, that is, the original workpiece processing data is obtained after scanning the processed workpiece, and the model drawn by the CAD software and the result of the planned path of the CAM software are calculated in real time, and then projected imaging is performed, so that the conventional design drawing can be replaced, and the processing efficiency and convenience on the production line can be increased.

Taking the quality detection of the production line of the carpentry panel furniture as an example, in the prior art, when verifying whether the processing result or the precision of the workpiece meets the standard, an operator needs to measure the relative coordinates and the dimensions of the process implemented on the workpiece by himself, and the process is interactively compared with a design drawing or a CAD drawing file, which is time-consuming and labor-consuming. In addition, taking the mass production machine model of carpentry panel furniture as "numerical control multi-gang drill", each different workpiece needs to plan the machining path and machine configuration by the CAM software, and the operator can start machining after installing the tool on the machine according to the prompt provided by the program. If the number of processes to be performed is large, the operator must print out the drawings for configuring the tool or check whether the tool configuration on the tool is consistent with the configuration planned by the CAM software, which is also time-consuming and laborious.

In addition, before the workpieces are scanned by using or augmented reality equipment, each workpiece must be given a unique identification barcode, which may be a one-dimensional Code, a two-dimensional Code, a QR Code, an RFID Code or other equivalent object identification codes, for recording the geometric information and the processing information of the workpiece. And then, by utilizing a Mark-Based technology in the augmented reality technology, taking the exclusive identification bar code of the workpiece as an identification object, and after the identification bar code is scanned by a lens, obtaining the workpiece information recorded by the identification bar code to generate a virtual model or a description of CAD or CAM. And calculating the proportion of the virtual model according to the deformation of the identification bar code in the actual space, projecting a virtual workpiece or machine configuration with the same size, and marking related positions, sizes and prompt information for operators to refer to.

If the augmented reality real-time imaging technology can be combined with CAD/CAM software, when the workpiece is machined, the exclusive identification bar code of the workpiece is scanned, the model drawn by the CAD software is imaged according to the original workpiece machining data, and the model is applied to quality detection, an operator can compare the difference between the actual machining result and the virtual image at a glance, and the detection flow becomes more intuitive and rapid. Moreover, before processing, the exclusive identification bar code of the workpiece is scanned, the processing path is calculated immediately through the CAM software, and the result after the CAM software is planned is projected, so that an operator can install and verify the machine according to the imaging result, and the pre-processing operation becomes more efficient.

Accordingly, in order to achieve the above object, the present invention provides an augmented reality processing support system for supporting a processing machine to process a workpiece, the augmented reality processing support system comprising: a workpiece processing database for storing a plurality of workpiece processing raw data; the calculation module is electrically connected with the workpiece processing database and is used for calculating auxiliary processing data of the workpiece; the augmented reality equipment is electrically connected with the workpiece processing database and the calculation module and is provided with a sensor for sensing the identification pattern on the workpiece; the identification pattern is analyzed and calculated to obtain an identification code and is transmitted to a workpiece processing database, the workpiece processing database receives the identification code and transmits workpiece processing original data corresponding to the workpiece, the calculation module calculates auxiliary processing data of the workpiece, the calculation module transmits the auxiliary processing data to augmented reality equipment, and the augmented reality equipment displays the auxiliary processing data on a display of the augmented reality equipment.

In a preferred embodiment, the workpiece processing raw data is a text file.

In a preferred embodiment, the auxiliary processing data includes a virtual graphic file of the workpiece, and the calculation module further includes a drawing module for drawing the virtual graphic file through the workpiece processing raw data.

In a preferred embodiment, the auxiliary processing data includes an operation flow of the processing machine, and the calculation module further includes a computer-aided manufacturing calculation module for calculating the operation flow through the workpiece processing raw data.

In a preferred embodiment, the calculation module is disposed in the augmented reality device.

In a preferred embodiment, the analysis algorithm is executed by the processor of the augmented reality device to obtain the identification code, and the augmented reality device transmits the identification code to the workpiece processing database.

In a preferred embodiment, the identification pattern is transmitted from the augmented reality device to the operation module, the analysis operation is executed by the operation module to obtain the identification code, and the operation module transmits the identification code to the workpiece processing database.

To achieve the above object, the present invention provides a method for using an augmented reality processing support system for supporting a processing machine to process a workpiece, the augmented reality processing support system comprising a workpiece processing database, an operation module and augmented reality equipment, wherein the workpiece processing database is used for storing a plurality of workpiece processing raw data, the augmented reality equipment has a sensor, and the method comprises the following steps: sensing the identification pattern on the workpiece through a sensor; analyzing the identification pattern to obtain an identification code; transmitting the identification code to a workpiece processing database; according to the identification code, the workpiece processing database transmits the workpiece processing original data of the corresponding workpiece to the calculation module; according to the original data of the workpiece processing, the calculation module calculates the auxiliary processing data of the workpiece and transmits the auxiliary processing data to the augmented reality equipment; and displaying the auxiliary processing data on a display of the augmented reality device.

In a preferred embodiment, the method of using the augmented reality processing assistance system further comprises the steps of: analyzing the identification pattern through a processor of the augmented reality device to obtain an identification code; and

the identification code is transmitted to the workpiece processing database through the augmented reality device.

In a preferred embodiment, the method of using the augmented reality processing assistance system further comprises the steps of: sensing the identification pattern on the workpiece through a sensor to obtain an identification pattern image and transmitting the identification pattern image to an arithmetic module; analyzing the image of the identification pattern through an arithmetic module to obtain an identification code; and transmitting the identification code to a workpiece processing database through the operation module.

According to the above, the embodiment of the invention senses the identification pattern on the workpiece through the sensor of the augmented reality device, receives the workpiece processing raw data from the workpiece processing database after analyzing the identification pattern to obtain the identification code, calculates the auxiliary processing data of the workpiece according to the workpiece processing raw data and displays the auxiliary processing data on the display of the augmented reality device, so that the method can display the appropriate operation flow corresponding to different types of workpieces in real time and can also greatly reduce the operation errors of the processing machine operator.

Drawings

FIG. 1 is a system architecture diagram illustrating an augmented reality processing assistance system, according to an embodiment of the present invention;

FIG. 2 is a schematic diagram illustrating a workpiece and an identification pattern on the workpiece according to the embodiment of FIG. 1;

FIG. 3 is a schematic diagram showing a display state of the augmented reality processing assistance system for an operator to view according to the embodiment of FIGS. 1 and 2;

FIG. 4 is a system architecture diagram illustrating an augmented reality processing assistance system, according to another embodiment of the present invention;

FIG. 5 is a system architecture diagram illustrating an augmented reality processing assistance system, according to yet another embodiment of the present invention;

FIG. 6 is a diagram illustrating a method of using an augmented reality processing assistance system, according to yet another embodiment of the present invention;

FIG. 7A is a diagram illustrating a method of using the augmented reality processing assistance system according to the embodiment of FIG. 6; and

FIG. 7B is a diagram illustrating a method of using the augmented reality processing assistance system according to the embodiment of FIG. 6.

Description of the symbols:

10. 20, 30 augmented reality processing auxiliary system

11 workpiece machining database

111 original data of workpiece processing

112. 113 auxiliary processing data

12. 22, 32 calculation module

121 drawing module

122 computer aided manufacturing calculation module

13 augmented reality device

131 sensor

132 processor

133 display

15 workpiece

15' virtual workpiece

151 identification pattern

152 feature

Post-processing pattern of 152' features

321 processor of calculation module

A. B, C data transmission path

S101 to S106, S202 to S203, and S301 to S303

Detailed Description

The foregoing and other features and advantages of the invention will be apparent from the following, more particular description of a preferred embodiment, as illustrated in the accompanying drawings. Directional terms as referred to in the following examples, for example: up, down, left, right, front or rear, etc., are referred to only in the direction of the attached drawings. Accordingly, the directional terminology is used for purposes of illustration and is in no way limiting.

FIG. 1 is a schematic diagram of an augmented reality processing assistance system according to an embodiment of the present invention. Referring to fig. 1, the augmented reality processingauxiliary system 10 includes aworkpiece processing database 11, anoperation module 12 andaugmented reality equipment 13. Theworkpiece processing database 11 is used to store a plurality of workpiece processingraw data 111, and theworkpiece processing database 11 is located in a storage device (not shown), such as a hard disk in a computer or other readable recording medium, wherein the workpiece processingraw data 111 may be the size, shape, thickness, processing manner, etc. of various processed workpiece products or features on the workpieces, and the features may be protrusions or depressions, etc. on various workpieces, without limitation.

Fig. 2 is a schematic diagram illustrating a workpiece and an identification pattern on the workpiece according to the embodiment of fig. 1, and is also described with reference to fig. 1. Theoperation module 12 is electrically connected to theworkpiece processing database 11, theoperation module 12 is used for calculating auxiliary processing data of theworkpiece 15, and theaugmented reality device 13 is electrically connected to theworkpiece processing database 11 and theoperation module 12, wherein theaugmented reality device 13 has asensor 131 for sensing the identification pattern 151 on theworkpiece 15. In this embodiment, theworkpiece 15 is a flat plate, but not limited thereto, thesensor 131 may be a laser barcode scanner, a Charge Coupled Device (CCD) scanner, a 2D camera, a 3D camera, or other suitable sensing device, the identification pattern 151 is formed on theworkpiece 15 by, for example, sticker attachment, laser processing, or other suitable methods, the identification pattern 151 can record an identification code (not shown) of theworkpiece 15, theworkpieces 15 in different processing flows or different types respectively have different identification codes, wherein the identification pattern 151 may be a one-dimensional barcode, a two-dimensional barcode, an RFID, or other suitable types, which is not limited by the present invention.

Referring to fig. 1 and fig. 2, when thesensor 131 senses the identification pattern 151 on theworkpiece 15, the identification pattern 151 is analyzed and calculated to obtain an identification code, and the identification code is transmitted to theworkpiece processing database 11. Specifically, theaugmented reality device 13 of the embodiment further includes aprocessor 132, theprocessor 132 can perform the analysis operation on the identification pattern 151 to obtain the identification code, and theaugmented reality device 13 transmits the identification code to theworkpiece processing database 11 through the data transmission path a. In this embodiment, theprocessor 132 may be a single-core or multi-core Central Processing Unit (CPU), other programmable general-purpose or special-purpose Microprocessor (Microprocessor), other similar devices, or a combination thereof, which can be installed in theaugmented reality device 13 and can perform analysis and calculation in the prior art. The analysis and calculation may be performed by converting the identification pattern 151 sensed by thesensor 131 into an electrical signal, and then performing the processes of calculating a deformation ratio, decoding, image processing, etc. to obtain an identification code, wherein the identification code is, for example, a string of characters, symbols, numbers or a combination thereof specific to theworkpiece 15. The data transmission path a may be a wired or wireless data transmission method, such as a physical cable, Wi-Fi, bluetooth, Zigbee or other suitable data transmission methods. In addition, since the analysis and calculation of pattern recognition belongs to the prior art in the field of augmented reality technology, the present invention does not need to describe the calculation principle and details thereof.

With continued reference to fig. 1 and 2, when theworkpiece processing database 11 receives the identification code, the workpiece processingraw data 111 corresponding to theworkpiece 15 is transmitted. For example, each piece of workpiece processingoriginal data 111 stored in theworkpiece processing database 11 corresponds to a specific identification code, and when theworkpiece processing database 11 receives the identification code specific to the workpiece 15 from the data transmission path a, the workpiece processingoriginal data 111 corresponding to theworkpiece 15 is transmitted to theoperation module 12 through another data transmission path B, where the data transmission path B is similar to the data transmission path a in shape, and an existing wired or wireless data transmission manner may be adopted, which is not repeated herein.

After receiving the workpiece processingraw data 111 corresponding to theworkpiece 15, theoperation module 12 calculates theauxiliary processing data 112 of theworkpiece 15, and transmits theauxiliary processing data 112 to theaugmented reality device 13 through the data transmission path C, and theaugmented reality device 13 displays theauxiliary processing data 112 on thedisplay 133. Specifically, theoperation module 12 is, for example, a single-core or multi-core CPU and gpu (graphics Processing unit) PC, tablet computer or other suitable electronic device, theoperation module 12 includes adrawing module 121 and a computer-aidedcalculation module 122, the workpiece Processingoriginal data 111 is a text file, and the data transmission path C is similar to the data transmission path A, B and can be a conventional wired or wireless data transmission manner. Because the originalworkpiece processing data 111 only records the text information of the finished product or feature such as size, shape, thickness, or processing mode after theworkpiece 15 is processed, compared with the image file or the picture file, the data transmission rate between theworkpiece processing database 11 and theoperation module 12 can be greatly increased, and thedrawing module 121 can also make theauxiliary processing data 112 of theworkpiece 15 in real time according to various data in the originalworkpiece processing data 111, thereby increasing the processing efficiency of theoperation module 12. In this embodiment, thedrawing module 121 may be implemented by Computer Aided Design (CAD) software or other suitable drawing software, theauxiliary processing data 112 may be a virtual model after theworkpiece 15 is processed, and theaugmented reality device 13 may be a head-mounted display device, a mobile phone, a tablet Computer, a notebook Computer or other electronic display device with augmented reality function, so that an operator only needs to wear or hold theaugmented reality device 13, and can view the virtual model after theworkpiece 15 is processed on thedisplay 133 of theaugmented reality device 13, and can determine whether the operation of the processing machine is correct in real time, thereby greatly reducing the operation errors of the operator of the processing machine.

In this embodiment, the Computer-Aidedcalculation module 122 of thecalculation module 12 may be implemented by Computer-Aided Manufacturing (CAM) software or other suitable processing and Manufacturing planning software, and the Computer-Aidedcalculation module 122 may calculate, in real time, theauxiliary processing data 113 and display the auxiliary processing data on thedisplay 133 of theaugmented reality device 13 according to the content of the workpiece processingraw data 111, where theauxiliary processing data 113 may be an operation flow of a processing machine corresponding to theworkpiece 15, and the operation flow includes, for example, the type, installation position and number of tools on the processing machine, or an operation sequence of the processing machine when performing the processing operation of theworkpiece 15. In this way, the operator of the machining tool can compare the operation modes of the machining tool, such as tool mounting, in real time to greatly reduce the operation errors, and the augmented realitymachining support system 10 can also modify thesupport machining data 112 and 113 in real time by scanning the identification bar codes 151 ofdifferent workpieces 15 when the type of theworkpiece 15 is changed, so that the appropriate operation flow or virtual model of the finished workpiece can be displayed corresponding to different types ofworkpieces 15.

FIG. 3 is a schematic diagram showing a display state of the augmented reality processing assistance system for an operator to view according to the embodiment of FIGS. 1 and 2. Referring to fig. 1, fig. 2 and fig. 3, it should be noted that the present invention does not limit the file format of theauxiliary processing data 112 or 113, nor limit thedisplay 133 to display only one of theauxiliary processing data 112 or 113, and thedisplay 133 can also display the modifiedauxiliary processing data 112 and 113 at the same time when the hardware capabilities of theoperation module 12 and theaugmented reality device 13 are sufficient. Specifically, theaugmented reality device 13 can simultaneously display theactual workpiece 15 and theauxiliary processing data 112 and 113 in thedisplay 133 through the existing augmented reality display technology, wherein theauxiliary processing data 112 includes the virtual model 15 'of theworkpiece 15 and the processed pattern 152' of thefeature 152 on theworkpiece 15, and theauxiliary processing data 113 includes the operation flow, for example, the information required to be known by the operator, such as the installation position and the operation steps of the tool in the processing machine, is displayed in a pure text manner. In addition, theauxiliary processing data 112 may further include graphic characters or symbols such as dimension marks, process types, etc. besides the virtual model 15 'and the processed pattern 152' of the feature, and the information included in theauxiliary processing data 113 may be in a schematic form or a graphic and text form, such as a schematic diagram of the tool types and installation positions of the processing tools, etc., so that the operator of the processing tools can understand the operation flow of the tools more easily and the work efficiency can be increased.

In the present embodiment, theauxiliary processing data 112 includes a virtual model of theworkpiece 15 after processing, and theauxiliary processing data 113 includes an operation flow of the processing machine corresponding to theworkpiece 15, however, in other embodiments, the auxiliary processing data may include a drawing capability of the computer aidedcalculation module 122 itself, or a simulation process film for drawing theworkpiece 15 according to the processingraw data 111 by thedrawing module 121. In addition, when the auxiliary processing data is calculated and an error is found by the computer-aidedcalculation module 122, for example, the tool specification of the processing machine fails to meet the processing requirement of theworkpiece 15 or another error occurs, the computer-aidedcalculation module 122 may also add a prompt of the failure of the processing path planning and/or the reason of the error to the auxiliary processing data and display the prompt on thedisplay 133 of theaugmented reality device 13.

FIG. 4 is a system architecture diagram illustrating an augmented reality processing assistance system, according to another embodiment of the present invention. Referring to fig. 4, the augmented reality processingauxiliary system 20 is similar to the augmented reality processingauxiliary system 10 of fig. 1, and the same elements are denoted by the same element numbers and are not repeated herein. The augmented realityprocessing support system 20 is different from the augmented realityprocessing support system 10 of fig. 1 in that theoperation module 22 is disposed in theaugmented reality device 13. That is, when the hardware computing capability of theaugmented reality device 13 is sufficient, theoperation module 22 can be directly installed in theaugmented reality device 13 and perform computing by using the hardware resources of theaugmented reality device 13, so as to reduce the hardware configuration related to theoperation module 22 and reduce the volume of the whole augmented reality processingauxiliary system 20. In addition, since theoperation module 22 is directly installed in theaugmented reality device 13, after the identification code is transmitted from theaugmented reality device 13 to theworkpiece processing database 11 through the data transmission path a, the workpiece processingraw data 111 is also transmitted back to theaugmented reality device 13 through the data transmission path a for theoperation module 22 to calculate, thereby simplifying the data transmission path and flow.

FIG. 5 is a system architecture diagram illustrating an augmented reality processing assistance system, according to yet another embodiment of the present invention. Referring to fig. 2 and 5, the augmented reality processingauxiliary system 30 is similar to the augmented reality processingauxiliary system 10 of fig. 1 and the augmented reality processingauxiliary system 20 of fig. 4, and the same elements are denoted by the same element numbers and are not described again. The difference between the augmented realityprocessing support system 30 and the augmented realityprocessing support systems 10 and 20 is that when thesensor 131 of theaugmented reality device 13 senses the identification pattern 151, an identification pattern image (not shown) is obtained, theaugmented reality device 13 transmits the identification pattern image to theoperation module 32, theoperation module 32 performs analysis and operation on the identification pattern image to obtain an identification code, and theoperation module 32 transmits the identification code to theworkpiece processing database 11. In detail, theaugmented reality device 13 can transmit the sensed identification pattern 151 in the form of an image file, that is, an identification pattern image, to theoperation module 32 through the data transmission path C, and then theprocessor 321 of theoperation module 32 performs analysis and operation on the identification pattern image to obtain the identification code, wherein theprocessor 321 may include a single core or a multi-core Central Processing Unit (CPU) capable of performing analysis and operation in the prior art, other programmable general purpose or special purpose microprocessors (microprocessors) or other similar elements or a combination of the above elements, which is not repeated herein. Then, theoperation module 32 transmits the identification code to theworkpiece processing database 11 through the data transmission path B, theworkpiece processing database 11 transmits the corresponding workpiece processingraw data 111 to theoperation module 32 through the data transmission path B according to the identification code to calculate theauxiliary processing data 112, 113, finally theoperation module 32 transmits the calculatedauxiliary processing data 112, 113 to theaugmented reality device 13 through the data transmission path C, and thedisplay 133 displays theauxiliary processing data 112, 113. In this way, since theaugmented reality device 13 only needs to transmit the identification pattern image to theoperation module 32, a part of the hardware load can be reduced, and an excessive hardware capability is relatively unnecessary, thereby achieving a light weight of theaugmented reality device 13. In addition, since theaugmented reality device 13 of the embodiment does not need to directly perform data transmission connection with theworkpiece processing database 11, that is, theworkpiece processing database 11 only needs to verify the security of the data transmission path B between the verification module and theoperation module 32 and does not need the data transmission path a, the information security of theworkpiece processing database 11 can be improved. In addition, in the embodiment, theoperation module 32 performs analysis and operation on the image of the identification pattern through theprocessor 321, and performs calculation of theauxiliary processing data 112 and 113 through thedrawing module 121 and the computer aidedmanufacturing calculation module 122, respectively, however, theprocessor 321 can also perform or support calculation work of thedrawing module 121 and the computer aidedmanufacturing calculation module 122, and details of the invention are not repeated herein.

In the augmented reality processingauxiliary system 10 disclosed in the embodiment of fig. 1, theworkpiece processing database 11, theoperation module 12 and theaugmented reality device 13 are respectively independent electronic devices or are disposed in different devices; in the augmented realityprocessing support system 20 disclosed in the embodiment of fig. 4, theoperation module 22 is disposed in theaugmented reality device 13; in the augmented realityprocessing support system 30 disclosed in fig. 5, theaugmented reality device 13 transmits the recognition pattern image to theprocessor 321 of theoperation module 32 to perform analysis and operation on the recognition pattern image. However, in other embodiments, the workpiece processing database may be disposed in the augmented reality device, for example, the augmented reality device may be an electronic device such as a notebook computer or a tablet computer that can be provided with a large-capacity storage device, and the workpiece processing database may be disposed in the storage device of the electronic device, so that the augmented reality processing auxiliary system only needs to be disposed with a connection line between the augmented reality device and the operation module, thereby improving the operation efficiency of the entire augmented reality processing auxiliary system. In addition, if the hardware capability of the augmented reality device is sufficient, the workpiece processing database and the operation module can be arranged in the augmented reality device at the same time, so that the occupied space or volume of the augmented reality processing auxiliary system can be greatly reduced. In this embodiment, the operation of the augmented reality processing auxiliary system is substantially the same as that of the previous embodiment, and is not described herein again.

FIG. 6 is a diagram illustrating a method of using an augmented reality processing assistance system according to still another embodiment of the present invention. The embodiment of fig. 6 can be applied to the augmented reality processingauxiliary systems 10, 20, and 30, please refer to fig. 6 in combination with fig. 1, fig. 2, fig. 4, and fig. 5. The augmented realityprocessing support system 10, 20, 30 is used for assisting a processing machine to process aworkpiece 15, the augmented realityprocessing support system 10, 20, 30 includes aworkpiece processing database 11, an operation module 12 (or 22, 32) and anaugmented reality device 13, theworkpiece processing database 11 is used for storing a plurality of workpiece processingraw data 111, theaugmented reality device 13 has asensor 131, and the using method of the augmented reality processing support system further includes the following steps.

Step S101: the identification pattern on the workpiece is sensed by a sensor. In this step, thesensor 131 of theaugmented reality device 13 is used to sense the identification pattern 151 on theworkpiece 15, wherein the identification pattern 151 is capable of recording the identification code of theworkpiece 15.

Step S102: the identification pattern is analyzed to obtain an identification code. In this step, the identification pattern 151 is analyzed and calculated to obtain the identification code, wherein the analysis and calculation is performed by converting the identification pattern 151 sensed by thesensor 131 into an electrical signal, and then calculating a deformation ratio, decoding and the like to obtain the identification code.

Step S103: and transmitting the identification code to a workpiece processing database. In this step, the identification code is transmitted from theaugmented reality device 13 to theworkpiece processing database 11 through the data transmission path a in the augmented realityprocessing support system 10, 20. In addition, in the augmented realityprocessing support system 30, theprocessor 321 of theoperation module 32 performs analysis and calculation to obtain the identification code, so theoperation module 32 transmits the identification code to theworkpiece processing database 11 through the data transmission path B.

Step S104: according to the identification code, the workpiece processing database transmits the workpiece processing original data of the corresponding workpiece to the calculation module. In this step, theworkpiece processing database 11 of the augmented reality processingauxiliary systems 10 and 30 transmits the workpiece processingraw data 111 to theoperation modules 12 and 32 through the data transmission path B, and in the augmented reality processingauxiliary system 20, theworkpiece processing database 11 transmits the workpiece processingraw data 111 to theoperation module 22 in theaugmented reality device 13 through the data transmission path a.

Step S105: according to the original data of the workpiece processing, the calculation module calculates the auxiliary processing data of the workpiece and transmits the auxiliary processing data to the augmented reality device. In this step, theoperation modules 12, 22, 32 calculate theauxiliary processing data 112, 113 of theworkpiece 15 according to the workpiece processingraw data 111, theoperation modules 12, 32 transmit theauxiliary processing data 112, 113 to theaugmented reality device 13 through the data transmission path C, and theoperation module 12 is disposed in theaugmented reality device 13, so that theauxiliary processing data 112, 113 can be transmitted only through the internal circuit of theaugmented reality device 13. Theauxiliary processing data 112 may be a virtual model of theworkpiece 15 after processing is completed, and theauxiliary processing data 113 may be an operation flow of the processing machine corresponding to theworkpiece 15.

Step S106: displaying the auxiliary processing data on a display of the augmented reality device. In this step, theaugmented reality device 13 displays the receivedauxiliary processing data 112, 113 on thedisplay 133, wherein theaugmented reality device 13 can selectively display only theauxiliary processing data 112 or 113 on thedisplay 133, or can simultaneously display theauxiliary processing data 112 and 113 on thedisplay 133.

FIG. 7A is a diagram illustrating a method of using the augmented reality processing support system according to the embodiment of FIG. 6. The embodiment of fig. 7A can be applied to the augmented reality processingauxiliary systems 10 and 20, please refer to fig. 7A in combination with fig. 1, fig. 2 and fig. 4, wherein the same steps are denoted by the same reference numerals and are not repeated herein. The embodiment of fig. 7 is similar to that of fig. 6, except that the following steps are also included. Step S202: the identification pattern is analyzed by the processor of the augmented reality device to obtain the identification code. In this step, the analysis algorithm is executed by theprocessor 132 of theaugmented reality device 13 to obtain the identification code.

Step S203: the identification code is transmitted to the workpiece processing database through the augmented reality device. In this step, the identification code is transmitted from theaugmented reality device 13 to theworkpiece processing database 11 through the data transmission path A.

FIG. 7B is a diagram illustrating a method of using the augmented reality processing assistance system according to the embodiment of FIG. 6. The embodiment of fig. 7A can be applied to the augmented reality processingauxiliary system 30, please refer to fig. 7B in combination with fig. 2 and fig. 5, wherein the same steps are denoted by the same reference numerals and are not repeated herein. The embodiment of fig. 7B is similar to that of fig. 6 and 7A, except that the following steps are also included. Step S301: the recognition pattern on the workpiece is sensed through the sensor to obtain a recognition pattern image, and the recognition pattern image is transmitted to the operation module. In this step, after theaugmented reality device 13 senses the identification pattern 151 through thesensor 133, an image of the identification pattern is formed and transmitted to theoperation module 32 through the data transmission path C.

Step S302: the image of the identification pattern is analyzed by an arithmetic module to obtain an identification code. In this step, theoperation module 32 performs analysis and operation on the identification pattern image transmitted by theaugmented reality device 13 through theprocessor 321 to obtain the identification code.

Step S303: the identification code is transmitted to the workpiece processing database through the operation module. In this step, after theoperation module 32 performs analysis and calculation to obtain the identification code of theworkpiece 15, theoperation module 32 transmits the identification code to theworkpiece processing database 11 through the data transmission path B.

In summary, the embodiment of the invention senses the identification pattern on the workpiece through the sensor of the augmented reality device, obtains the original workpiece processing data from the workpiece processing database after analyzing the identification pattern to obtain the identification code, and calculates the auxiliary processing data of the workpiece according to the original workpiece processing data by the operation module and displays the auxiliary processing data on the display of the augmented reality device.

However, the above description is only a preferred embodiment of the present invention, and the scope of the present invention should not be limited thereby, and all the simple equivalent changes and modifications made according to the claims and the description of the present invention are still within the scope of the present invention.

Claims (10)

1. An augmented reality processing assistance system for assisting a processing machine to process a workpiece, the augmented reality processing assistance system comprising:

a workpiece processing database for storing a plurality of workpiece processing raw data;

the calculation module is electrically connected with the workpiece processing database and is used for calculating auxiliary processing data of the workpiece; and

the augmented reality equipment is electrically connected with the workpiece processing database and the calculation module and is provided with a sensor for sensing an identification pattern on the workpiece;

the identification pattern is analyzed and calculated to obtain an identification code and is transmitted to the workpiece processing database, the workpiece processing database receives the identification code and transmits the workpiece processing original data corresponding to the workpiece to the calculation module to calculate auxiliary processing data of the workpiece, the calculation module transmits the auxiliary processing data to the augmented reality device, and the augmented reality device displays the auxiliary processing data on a display of the augmented reality device.

2. The augmented reality processing-aided system of claim 1, wherein the raw data of the workpiece processing is a text file.

3. The augmented reality processing-aided system of claim 1, wherein the auxiliary processing data comprises a virtual graphics file of the workpiece, and the algorithm module further comprises a drawing module for drawing the virtual graphics file through the workpiece processing raw data.

4. The augmented reality processing support system of claim 1, wherein the auxiliary processing data comprises an operation flow of the processing tool, the algorithm module further comprising a computer aided manufacturing calculation module, the computer aided manufacturing calculation module calculating the operation flow from the workpiece processing raw data.

5. The augmented reality processing auxiliary system of claim 1, wherein the algorithm module is disposed in the augmented reality device.

6. The system of claim 1, wherein the analysis algorithm is executed by a processor of the augmented reality device to obtain the identification code, and the augmented reality device transmits the identification code to the workpiece processing database.

7. The augmented reality processing support system of claim 1, wherein the identification pattern is transmitted from the augmented reality device to the algorithm module, the analysis algorithm is executed by the algorithm module to obtain the identification code, and the algorithm module transmits the identification code to the workpiece processing database.

8. The method for using the augmented reality processing auxiliary system is used for assisting a processing machine to process a workpiece, and is characterized in that the augmented reality processing auxiliary system comprises a workpiece processing database, an arithmetic module and augmented reality equipment, wherein the workpiece processing database is used for storing a plurality of workpiece processing original data, the augmented reality equipment is provided with a sensor, and the using method comprises the following steps:

sensing an identification pattern on the workpiece through the sensor;

analyzing the identification pattern to obtain an identification code;

transmitting the identification code to the workpiece processing database;

according to the identification code, the workpiece processing database transmits the workpiece processing original data corresponding to the workpiece to the calculation module;

according to the original workpiece processing data, the calculation module calculates an auxiliary processing data of the workpiece and transmits the auxiliary processing data to the augmented reality device; and

displaying the auxiliary processing data on a display of the augmented reality device.

9. The method of using the augmented reality processing-assistance system of claim 8, further comprising the steps of:

analyzing the identification pattern through a processor of the augmented reality device to obtain the identification code; and

the identification code is transmitted to the workpiece processing database through the augmented reality device.

10. The method of using the augmented reality processing-assistance system of claim 8, further comprising the steps of:

sensing the identification pattern on the workpiece through the sensor to obtain an identification pattern image and transmitting the identification pattern image to the calculation module;

analyzing the identification pattern image through the calculation module to obtain the identification code; and

the identification code is transmitted to the workpiece processing database through the operation module.

Images