Disclosure of Invention
In view of this, embodiments of the present invention provide a method, an apparatus, and a device for displaying a specification based on an AR technology, so as to improve readability and interestingness of the specification.
In a first aspect, an embodiment of the present invention provides an specification display method based on an AR technology, including:
extracting characteristic information of the target specification;
reporting the extracted characteristic information to a server side, and enabling the server side to determine a virtual use description animation corresponding to the target specification according to the characteristic information;
and downloading the virtual use instruction animation from the server side, and displaying the virtual use instruction animation on the target instruction book through an AR technology.
In a second aspect, an embodiment of the present invention provides a description display method based on an AR technology, including:
acquiring characteristic information of a target specification reported by a client;
determining a virtual use instruction animation corresponding to the target instruction book according to the characteristic information;
and sending the virtual use instruction animation to the client side, so that the client side receives and displays the virtual use instruction animation on the target specification through an AR technology.
In a third aspect, an embodiment of the present invention provides an instruction display apparatus based on an AR technology, including:
the characteristic extraction module is used for extracting characteristic information of the target specification;
the characteristic reporting module is used for reporting the extracted characteristic information to a server side, so that the server side determines a virtual use instruction animation corresponding to the target specification according to the characteristic information;
and the AR display module is used for downloading the virtual use instruction animation from the server and displaying the virtual use instruction animation on the target specification through an AR technology.
In a fourth aspect, an embodiment of the present invention provides an specification display apparatus based on an AR technology, including:
the characteristic acquisition module is used for acquiring the characteristic information of the target specification reported by the client;
the virtual animation determining module is used for determining a virtual use instruction animation corresponding to the target instruction book according to the characteristic information;
and the virtual animation issuing module is used for issuing the virtual use instruction animation to the client side, so that the client side receives and displays the virtual use instruction animation on the target specification through an AR technology.
In a fifth aspect, an embodiment of the present invention further provides an apparatus, including:
One or more processors;
a storage device for storing one or more programs,
when the one or more programs are executed by the one or more processors such that the one or more processors implement the operations of:
extracting characteristic information of the target specification;
reporting the extracted characteristic information to a server side, and enabling the server side to determine a virtual use description animation corresponding to the target specification according to the characteristic information;
and downloading the virtual use instruction animation from the server side, and displaying the virtual use instruction animation on the target instruction book through an AR technology.
In a sixth aspect, an embodiment of the present invention further provides an apparatus, including:
one or more processors;
a storage device for storing one or more programs,
when the one or more programs are executed by the one or more processors such that the one or more processors implement the operations of:
acquiring characteristic information of a target specification reported by a client;
determining a virtual use instruction animation corresponding to the target instruction book according to the characteristic information;
and sending the virtual use instruction animation to the client side, so that the client side receives and displays the virtual use instruction animation on the target specification through an AR technology.
According to the technical scheme provided by the embodiment of the invention, the client extracts the feature information of the target specification, the extracted feature information is reported to the server, the server determines the virtual use description animation corresponding to the target specification according to the feature information, the client downloads the virtual use description animation from the server, and the virtual use description animation is displayed on the target specification through the AR technology. Therefore, the display mode of the specification in the embodiment of the invention not only comprises characters and pictures, but also comprises the virtual use specification animation on the specification, so that the readability and the interestingness of the specification are improved, and a user can conveniently and intuitively understand the specification.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a flowchart of an specification displaying method based on AR technology according to an embodiment of the present invention. The method of this embodiment may be executed by an apparatus for presenting instructions based on AR technology, where the apparatus may be implemented by hardware and/or software, and may be configured in a client, that is, the method provided in this embodiment may be executed by the client. The method of the present embodiment is generally applicable to the case of displaying product specifications. Referring to fig. 1, the specification display method based on the AR technology provided in this embodiment may specifically include the following steps:
and S11, extracting the characteristic information of the target specification.
In this embodiment, the target specification is a specification of any product to be displayed, such as a specification currently read by a user, and for example, the target specification may be a medicine taking specification or an article use specification. The characteristic information refers to a label of the target specification for distinguishing the target specification from other specifications, and may include, for example, at least one of a two-dimensional code, a brand name, and a product model.
Specifically, when the client monitors a specification display event, the client acquires the target specification and extracts feature information of the target specification. The instruction book display event can be generated when the fact that a user clicks an instruction book display button preset in a client side is detected.
And S12, reporting the extracted characteristic information to a server, and enabling the server to determine the virtual use instruction animation corresponding to the target instruction according to the characteristic information.
In this embodiment, the virtual instruction animation refers to a virtual animation for displaying the instruction of using the product, and taking the product as a medicine as an example, the virtual instruction animation may be a virtual animation for displaying the medicine taking dosage and the medicine taking time; taking the product as a building block toy as an example, the virtual use instruction animation may be a virtual animation showing the assembly process of the building block.
Specifically, the client reports the extracted feature information to the server, and after receiving the feature information reported by the client, the server matches the feature information with a virtual use instruction animation preset in the server, and determines the successfully matched virtual use instruction animation as the virtual use animation corresponding to the target instruction.
S13, downloading the virtual use instruction animation from the server side, and displaying the virtual use instruction animation on the target specification through AR technology.
Among them, Augmented Reality (AR) is a technology that integrates real world information and virtual world information "seamlessly" by calculating the position and angle of a camera image in real time and adding a corresponding virtual image.
Specifically, after the server determines the virtual use instruction animation corresponding to the target specification, a download path of the virtual use instruction animation is issued to the client, the client downloads the virtual use instruction animation from the server according to the received download path, the position and the angle of the target specification are determined through an AR technology, and the downloaded virtual use instruction animation is displayed on the target specification.
According to the technical scheme provided by the embodiment, the client extracts the feature information of the target specification, the extracted feature information is reported to the server, the server determines the virtual use instruction animation corresponding to the target specification according to the feature information, the client downloads the virtual use instruction animation from the server, and the virtual use instruction animation is displayed on the target specification through the AR technology. Therefore, the display mode of the specification in the embodiment of the invention not only comprises characters and pictures, but also comprises the virtual use specification animation on the specification, so that the readability and the interestingness of the specification are improved, and a user can conveniently and intuitively understand the specification.
Illustratively, the extracting the feature information of the target specification may include: scanning the target specification through a camera; and extracting the characteristic information of the target specification according to the scanning result.
Specifically, when the client monitors a specification display event, a camera in a user terminal to which the client belongs is controlled to be started, the target specification is scanned through the camera, the scanning result is subjected to graying processing, and feature information of the target specification is extracted. In the scanning process, the content of the target specification can be completely scanned, or only the two-dimensional code or the identification pattern in the target specification can be scanned. Wherein the instruction book presentation event may be generated when it is detected that the user clicks an instruction book presentation button in the client.
Illustratively, after the virtual instruction animation is presented on the target instruction book by the AR technology, the method further includes: and adjusting the display content and/or the display progress of the virtual use description animation according to the user operation.
The target specification may correspond to more than one virtual instruction animation, and for example, the target specification is an instruction for an electric rice cooker, and the corresponding virtual instruction animation may include a virtual instruction animation for use in preparation before use, cooking, heating cold rice, reservation, cooking soup, or the like. Specifically, the displayed virtual use instruction animation can be selected according to the user operation, so that the display content of the virtual use instruction animation is adjusted, and the display progress of the virtual use instruction animation can be adjusted according to the user operation. Still taking the example that the target specification is the instruction for using the electric cooker, after the user finishes the preparation work by using the virtual instruction animation of the previous preparation process, the user can view the virtual instruction animation of the cooking process by clicking the next step. That is, the present embodiment can also adjust the display content and/or the display progress of the animation using the virtual use instruction according to the user requirement.
Example two
Fig. 2 is a flowchart of an specification displaying method based on AR technology according to a second embodiment of the present invention. The method of this embodiment may be executed by an instruction display apparatus based on AR technology, where the apparatus may be implemented by hardware and/or software, and may be configured in a server, that is, the method provided in this embodiment may be executed by the server. The method of the present embodiment is generally applicable to the case of displaying product specifications. Referring to fig. 2, the specification display method based on the AR technology provided in this embodiment may specifically include the following steps:
and S21, acquiring the characteristic information of the target specification reported by the client.
In this embodiment, the target specification is a specification of any product to be displayed, and for example, the target specification may be a specification of taking a medicine or a specification of using an article. The characteristic information refers to a label of the target specification for distinguishing the target specification from other specifications, and may include, for example, at least one of a two-dimensional code, a trademark, a brand name, and a product model number.
Specifically, the client extracts the feature information of the target specification, and reports the feature information to the server, and the server acquires the feature information reported by the client.
And S22, determining the virtual use instruction animation corresponding to the target instruction book according to the characteristic information.
Illustratively, a plurality of virtual use instruction animations are preset in the server, after the server receives the feature information reported by the client, the feature information is matched with the virtual use instruction animation preset in the server, and the successfully matched virtual use instruction animation is determined as the virtual use animation corresponding to the target instruction.
Illustratively, S22 may include: matching the characteristic information with candidate characteristic information preset in a characteristic library; determining a target product according to the matching result; and determining a virtual use instruction animation corresponding to the target instruction according to the target product.
The candidate feature information may be at least one of a two-dimensional code, a trademark, a brand name, and a product model. Specifically, the feature information is matched with the candidate feature information to obtain candidate feature information which is successfully matched, then, the target product can be determined according to the mapping relationship between the candidate feature information and the product which are created in advance, and the virtual use instruction animation corresponding to the target product, that is, the virtual use instruction animation corresponding to the target specification, can be determined according to the mapping relationship between the product which is created in advance and the virtual use instruction animation.
And S23, sending the virtual use instruction animation to the client side, and enabling the client side to receive and display the virtual use instruction animation on the target specification through an AR technology.
Specifically, the server side issues a download path of the virtual use instruction animation to the client side, the client side downloads the virtual use instruction animation from the server side according to the received download path, the position and the angle of the target instruction book are determined through the AR technology, and the downloaded virtual use instruction animation is displayed on the target instruction book.
Referring to fig. 3, the specification display method based on the AR technology includes: the client scans the target specification through a camera in the user terminal, extracts feature information of the target specification, reports the feature information to a feature library of the server, the server matches the feature information with candidate feature information preset in the feature library, identifies a target product, searches for virtual use description animations of the target product, and the user terminal downloads and displays the virtual use description animations. The user terminal may be an electronic product with a scanning function, such as a smart phone or a tablet computer.
According to the technical scheme provided by the embodiment, the server determines the virtual use instruction animation corresponding to the target specification according to the characteristic information reported by the client, the client downloads the virtual use instruction animation from the server and displays the virtual use instruction animation on the target specification through the AR technology, namely the virtual use instruction animation is displayed on the specification through the AR technology, so that the function of the specification can be played to the maximum extent, the target audience is very large, and the use scenes are very many. For users, the fresh articles are not difficult to understand for the users, and the users do not need to ask others to use the articles, and can directly and intuitively know the products through the virtual animation.
EXAMPLE III
Fig. 4 is a structural diagram of an instruction display apparatus based on AR technology according to a third embodiment of the present invention. The device is generally applicable to the situation of displaying product specifications and is configured in a client. Referring to fig. 4, the specification showing device based on the AR technology provided in this embodiment has the following specific structure:
afeature extraction module 31, configured to extract feature information of the target specification;
afeature reporting module 32, configured to report the extracted feature information to a server, so that the server determines, according to the feature information, a virtual usage instruction animation corresponding to the target specification;
the AR display module 33 is configured to download the virtual instruction animation from the server, and display the virtual instruction animation on the target specification by using AR technology.
For example, thefeature extraction module 31 may include:
the specification scanning unit is used for scanning the target specification through a camera;
and the characteristic extraction unit is used for extracting the characteristic information of the target specification according to the scanning result.
Illustratively, the characteristic information includes at least one of two-dimensional code, trademark, brand name and product model number.
Illustratively, the above specification display device based on AR technology may further include:
and the virtual animation adjusting module is used for adjusting the display content and/or the display progress of the virtual use instruction animation according to the user operation after the virtual use instruction animation is displayed on the target specification through the AR technology.
Illustratively, the target specification is a package or article of manufacture.
The specification display device based on the AR technology provided by this embodiment is the same as the specification display method based on the AR technology performed by the client according to any embodiment of the present invention, and may perform the specification display method based on the AR technology performed by the client according to any embodiment of the present invention. For technical details that are not described in detail in this embodiment, reference may be made to a method for displaying an AR technology-based specification executed by a client according to any embodiment of the present invention.
Example four
Fig. 5 is a structural diagram of an instruction display apparatus based on AR technology according to a fourth embodiment of the present invention. The device is generally applicable to the situation of displaying product specifications and is arranged in a server side. Referring to fig. 5, the specification display device based on the AR technology provided in this embodiment has the following specific structure:
Afeature obtaining module 41, configured to obtain feature information of a target specification reported by a client;
a virtualanimation determining module 42, configured to determine a virtual instruction animation corresponding to the target instruction book according to the feature information;
a virtualanimation issuing module 43, configured to issue the virtual usage instruction animation to the client, so that the client receives and displays the virtual usage instruction animation on the target specification through an AR technology.
For example, the virtualanimation determination module 42 may include:
the characteristic matching unit is used for matching the characteristic information with candidate characteristic information preset in a characteristic library;
the product determining unit is used for determining a target product according to the matching result;
and the virtual animation determining unit is used for determining the virtual use instruction animation corresponding to the target instruction book according to the target product.
The specification display device based on the AR technology provided by the embodiment of the present invention is the same inventive concept as the specification display method based on the AR technology performed by the server according to any embodiment of the present invention, and can perform the specification display method based on the AR technology performed by the server according to any embodiment of the present invention. For technical details that are not described in detail in this embodiment, reference may be made to a method for displaying an AR technology-based specification executed by a server according to any embodiment of the present invention.
EXAMPLE five
As shown in fig. 6, which is a schematic diagram of a hardware structure of an apparatus provided in the fifth embodiment of the present application, as shown in fig. 6, the electronic apparatus includes:
one ormore processors 510, oneprocessor 510 being illustrated in FIG. 6;
amemory 520;
the electronic device may further include: aninput device 530 and anoutput device 540.
Theprocessor 510, thememory 520, theinput device 530 and theoutput device 540 in the electronic apparatus may be connected by a bus or other means, and fig. 6 illustrates the connection by the bus as an example.
Thememory 520 is a non-transitory computer-readable storage medium, and can be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the data storage method in the embodiment of the present application (for example, thefeature extraction module 31, thefeature reporting module 32, and the AR display module 33 shown in fig. 4). Theprocessor 510 executes various functional applications and data processing of the server by running software programs, instructions and modules stored in thememory 520, that is, the specification showing method based on AR technology executed by the client, which implements the above method embodiments.
Thememory 520 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the electronic device, and the like. Further, thememory 520 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments,memory 520 may optionally include memory located remotely fromprocessor 510, which may be connected to a terminal device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
Theinput device 530 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic apparatus. Theoutput device 540 may include a display device such as a display screen.
Namely: the electronic device includes:
one or more processors;
a storage device for storing one or more programs,
when the one or more programs are executed by the one or more processors such that the one or more processors implement the operations of:
extracting characteristic information of the target specification;
reporting the extracted characteristic information to a server side, and enabling the server side to determine a virtual use description animation corresponding to the target specification according to the characteristic information;
and downloading the virtual use instruction animation from the server side, and displaying the virtual use instruction animation on the target instruction book through an AR technology.
Further, the extracting the feature information of the target specification includes:
scanning the target specification through a camera;
and extracting the characteristic information of the target specification according to the scanning result.
Further, the characteristic information includes at least one of a two-dimensional code, a trademark, a brand name, and a product model.
Further, after the displaying the virtual instruction animation on the target instruction book by the AR technology, the method further includes:
and adjusting the display content and/or the display progress of the virtual use description animation according to the user operation.
Further, the target instruction is an instruction for taking the medicine or an instruction for using the article.
EXAMPLE six
As shown in fig. 7, which is a schematic diagram of a hardware structure of an apparatus provided in a sixth embodiment of the present application, as shown in fig. 7, the electronic apparatus includes:
one ormore processors 610, oneprocessor 610 being exemplified in fig. 7;
amemory 620;
the electronic device may further include: aninput device 630 and anoutput device 640.
Theprocessor 610, thememory 620, theinput device 630 and theoutput device 640 in the electronic device may be connected by a bus or other means, and fig. 7 illustrates an example of connection by a bus.
Thememory 620, as a non-transitory computer-readable storage medium, may be used for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the data storage method in the embodiment of the present application (for example, thefeature obtaining module 41, the virtualanimation determination module 42, and the virtualanimation issuing module 43 shown in fig. 5). Theprocessor 610 executes various functional applications and data processing of the server by running software programs, instructions and modules stored in thememory 620, that is, the specification showing method based on AR technology executed by the server, which implements the above method embodiments.
Thememory 620 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the electronic device, and the like. Further, thememory 620 may include high speed random access memory, and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments,memory 620 optionally includes memory located remotely fromprocessor 610, which may be connected to the terminal device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input means 630 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Theoutput device 640 may include a display device such as a display screen.
Namely: the electronic device includes:
one or more processors;
a storage device to store one or more programs,
when the one or more programs are executed by the one or more processors such that the one or more processors implement:
Acquiring characteristic information of a target specification reported by a client;
determining a virtual use instruction animation corresponding to the target instruction book according to the characteristic information;
and sending the virtual use instruction animation to the client side, so that the client side receives and displays the virtual use instruction animation on the target specification through an AR technology.
Further, the determining the virtual instruction animation corresponding to the target instruction according to the feature information includes:
matching the characteristic information with candidate characteristic information preset in a characteristic library;
determining a target product according to the matching result;
and determining a virtual use instruction animation corresponding to the target instruction according to the target product.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.