A kind of commodity identification and cash register system based on image recognitionTechnical field
The present invention relates to commodity cash register technical fields, more particularly, to a kind of commodity identification and cash register based on image recognitionSystem.
Background technique
Image recognition technology is a key areas of artificial intelligence.It, which refers to, carries out Object identifying to image, with identificationThe technology of various types of target.In order to work out the simulation movable computer program of mankind's image recognition, there has been proposedImage recognition model.With the continuous development of modern computer information technology, this technology of image recognition is extensive using moreWith it is universal, progressed into daily life.
Image recognition technology is applied in commodity cash register and is a research hotspot at present, can by image recognition commodityIt realizes when cash register without manually checking, the classification and price of commodity can be obtained.But it is for now, existing according to image recognitionThe product identification system of technology is not high to the accuracy of the more serious commodity identification of some superpositions, bigger for differentiationCommodity identification do not come out, and recognition speed is slower, brings inconvenience for cash register work.In addition, existing goods identification systemThe commodity that can be identified of uniting are limited, and type is few, limits its extensive use.
Summary of the invention
It is an object of the present invention to overcome the above-mentioned drawbacks of the prior art and provide one kind to be based on image recognitionCommodity identification and cash register system.
The purpose of the present invention can be achieved through the following technical solutions:
A kind of commodity identification and cash register system based on image recognition, the system is using semi-self-service cash register mode or automaticallyCash register mode, the system include:
Image capture module: for carrying out Image Acquisition to cash register commodity；
Picture recognition module: for carrying out commodity identification to the image of acquisition；
POS terminal: for sending identification instruction, receiving identification information and commodity payment；
Weighing module: for acquiring the weight data of cash register commodity；
Identification control module: for controlling picture recognition module and Weighing module, the identification letter for receiving picture recognition moduleIt ceases and weight data is analyzed and processed；The identification control module and image capture module, Weighing module wired connectionOr it is wirelessly connected；
Cloud training platform: it is connected to the network with picture recognition module, for providing identification model library for picture recognition module；
Network module: for providing wireless data transmission for whole system；
Customer handheld terminal: for carrying out commodity bill payment under full-automatic cash register mode, the customer handheld is wholeEnd is equipped with payment module.
Preferably, the cloud training platform to commodity image data gathered in advance, commodity image number data intoRow training obtains identification model and stores to identification model library.
Preferably, the identification control module is equipped with processor and memory, and the memory stores commercial standardsWeight data and commodity price data, the commercial standards weight data are all kinds of commercial standards weight numbers gathered in advanceAccording to.
Preferably, the image capture module includes first microprocessor, camera, camera regulating device and imagePretreatment unit, the first microprocessor are connect with identification control module, and the camera and first microprocessor connectIt connects, the image pre-processing unit is connect with camera, and the camera regulating device is connect with camera, and described takes the photographAs head is equipped with the nanometer anti-fog coating for preventing camera mirror surface from hazing.
Preferably, the Weighing module includes electronic-weighing platform, the second microprocessor and incudes trigger module, describedElectronic-weighing platform is connect with the second microprocessor, and second microprocessor is connect with identification control module, the camera shootingThe center of head and electronic-weighing platform is correspondingly arranged up and down, and the induction trigger module is set on electronic-weighing platform, describedInduction trigger module with identification control module connect.
Preferably, when using semi-self-service cash register mode, the POS terminal include cash register unit and respectively with cash register unitTouch screen, client display screen and the printing device of connection, the touch screen and identification control module connect；It is received when using full-automaticWhen silver-colored mode, the POS terminal includes that cash register unit and the touching display screen connecting respectively with cash register unit, clearing code generate listMember and printing device, the touching display screen are equipped with clearing key, which connect with clearing code generation unit, instituteThe clearing code generation unit stated is connect with printing device.
Preferably, the picture recognition module be set to POS terminal in, and with the wired or wireless connection of image capture module.
Preferably, the picture recognition module and POS terminal cloud are arranged, and with the wired or wireless company of image capture moduleIt connects.
When using semi-self-service cash register mode, the cash register process of the system specifically includes the following steps:
1) sampling mark carried out to all kinds of commodity in advance, obtain include commodity image, commercial standards weight, commodity price andThe sample data of goods number, cloud training platform are trained commodity image data, commodity image number data, obtain and knowOther model is simultaneously stored to identification model library, and commercial standards weight data and commodity price data are stored to identification control module；
If 2) there is commodity to be placed on electronic-weighing platform, induction trigger module sends trigger signal to identifying control module,Identify control module control image capture module carry out Image Acquisition, camera shooting commodity image and by commodity image pass throughIt is sent to picture recognition module after image pre-processing unit processing, is performed the next step；
3) picture recognition module transfers the identification model in the identification model library of cloud training platform and carries out image recognition, andThe commodity image that will acquire is sent to cloud training platform, and the goods number of identification and picture are sent to knowledge by picture recognition moduleOther control module, meanwhile, cloud training platform will identify that successful commodity image is added in corresponding commodity training pattern,Identification model library constantly carries out mold cycle repetitive exercise, completes the update in identification model library；
4) identification control module determines whether to weigh automatically according to image recognition result, if so, then follow the steps 5),Otherwise, recognition result is shown on touch screen, executes step 6)；
5) weighing data is sent to identification control module, identification control according to the instruction of identification control module by Weighing moduleMolding block is compared practical weighing data with standard weights data, and comparison result is shown on touch screen, executes stepIt is rapid 6)；
6) cashier carries out information checking to the data that touch screen is shown, if verification passes through, cashier clicks touchingControl screen generates commodity bill using the cash register unit of POS terminal, and client display screen shows bill information, customer payment bill, printingEquipment prints payment bill, completes cash register；If verification failure, cashier according to wrong data judge incorrectly reason, and according toAfter being adjusted according to error reason, it re-execute the steps 2).
When using full-automatic cash register mode, the cash register process of the system specifically includes the following steps:
1) sampling mark carried out to all kinds of commodity in advance, obtain include commodity image, commercial standards weight, commodity price andThe sample data of goods number, cloud training platform are trained commodity image data, commodity image number data, obtain and knowOther model is simultaneously stored to identification model library, and commercial standards weight data and commodity price data are stored to identification control module；
2) commodity are placed on electronic-weighing platform by customer, and induction trigger module sends trigger signal to identification control mouldBlock, identification control module control image capture module carry out Image Acquisition, camera shoot commodity image and by commodity imageIt is sent to picture recognition module after handling by image pre-processing unit, performs the next step；
3) picture recognition module transfers the identification model in the identification model library of cloud training platform and carries out image recognition, andThe commodity image that will acquire is sent to cloud training platform, and the goods number of identification and picture are sent to knowledge by picture recognition moduleOther control module, meanwhile, cloud training platform will identify that successful commodity image is added in corresponding commodity training pattern,Identification model library constantly carries out mold cycle repetitive exercise, completes the update in identification model library；
4) identification control module determines whether to weigh automatically according to image recognition result, if so, then follow the steps 5),Otherwise, recognition result is shown on touch screen, executes step 6) or step 7)；
5) weighing data is sent to identification control module, identification control according to the instruction of identification control module by Weighing moduleMolding block is compared practical weighing data with standard weights data, and comparison result is shown on touch screen, under executionOne step；
6) customer carries out information checking according to the data that touching display screen is shown, if verification passes through, clicks touch-control and showsThe clearing key of screen, clearing code generation unit generate payment and settlement code, and customer is completed by customer handheld terminal scanning clearing codeBill payment, printing device print payment bill, complete cash register；If verification failure, customer judges incorrectly former according to wrong dataCause, and after being adjusted according to error reason, it re-execute the steps 2).
Compared with prior art, the invention has the following advantages that
(1) present system can be by commodity image information collection, commodity weight information collection, merchandise news training with realityThe identification and cash register of existing extensive stock, are widely used；
(2) present system is equipped with exclusive Weighing module, and commodity image identification and commodity weight verification are combined andJudge that commodity stack situation or wrong identification situation, can further improve the accuracy rate of image recognition；
(3) present invention marks process standardization and sample training by the sample collection of early period, sample, is greatly improved knowledgeOther efficiency；
(4) picture recognition module of the invention and identification control module can realize wired or wireless connection, can be for notIt is arranged on corresponding position with demand, using flexible, conveniently；
(5) recognition speed of present system is fast, and single picture identification only needs 0.1s, when using semi-self-service cash register modeWhen, greatly reduce the time of cashier's typing commodity；
(6) present system is divided into complete self-service cash register and semi-self-service cash register both of which, and identifies control module in triggeringWhen, can be used manually triggering or two kinds of automatic trigger, can be selected according to the demand in different shops or market installation system andThe classification of equipment, application field is extensive, distinct characteristics；
(7) the camera glass of present system uses unique nanometer anti-fog coating, can solve identification warm-served food class commodityCaused by camera shooting haze problem, further increase the recognition accuracy of warm-served food and the commodity application range of identification；
(8) image capture module of the invention is equipped with camera regulating device, and camera regulating device can be according to being distributed inThe quantity and size of commodity on electronic-weighing platform carry out height and shooting angle is adjusted, to further increase the standard of image recognitionTrue property.
Detailed description of the invention
Fig. 1 is a kind of commodity identification and receipts based on image recognition in the embodiment of the present invention 1 under semi-self-service cash register modeThe structural schematic diagram of silver-colored system；
Fig. 2 is the workflow schematic diagram of system in the embodiment of the present invention 1；
Fig. 3 is a kind of commodity identification and receipts based on image recognition in the embodiment of the present invention 2 under full-automatic cash register modeThe structural schematic diagram of silver-colored system；
In Fig. 1 shown in label:
1, camera erecting bed, 2, camera, 3, lifting regulating rod, 4, pedestal, 5, fixed plate, 6, USB connecting line, 7, electricitySub- weighing unit, 8, host, 9, touch screen, 10, client display screen, 11, printing device；
In Fig. 3 shown in label:
1, camera erecting bed, 2, camera, 3, lifting regulating rod, 4, pedestal, 5, fixed plate, 6, USB connecting line, 7, electricitySub- weighing unit, 8, host, 11, printing device, 12, touching display screen, 13, clearing key.
Specific embodiment
The present invention is described in detail with specific embodiment below in conjunction with the accompanying drawings.
The present invention relates to a kind of commodity identification and cash register system based on image recognition, the system is by combining image recognitionAnd accurate commodity identification and cash register are completed in weight verification, carry out semi-self-service cash register or full-automatic cash register to commodity.
Embodiment 1
A kind of commodity identification and cash register system based on image recognition, for realizing semi-self-service cash register, including Image AcquisitionModule, picture recognition module, Weighing module, identification control module, POS terminal, cloud training platform and network module.
Cloud training platform carries out sample training according to the mark commodity original acquired early period, and generates identification model, cloudTraining platform is held to be equipped with identification model library, identification model library stores identification model.Cloud training platform passes through with POS terminalNetwork module connection.
POS terminal includes host, touch screen 9, printing device 11, client display screen 10, is equipped with cash register unit in host.Cash registerUnit is separately connected with touch screen 9, printing device 11, client display screen 10.Touch screen 9 is connect with identification control module.
Weighing module is set to cash register region, for obtaining the weight data of cash register commodity and sending data to identification controlModule.Weighing module includes electronic-weighing platform, the second microprocessor and induction trigger module, electronic-weighing platform and the second micro processDevice connection, the second microprocessor are connect with identification control module, and induction trigger module is set on electronic-weighing platform, incude trigger modeBlock is connect with identification control module.
Image capture module is set to cash register region, for carrying out image taking to cash register commodity, and image is sent to figureAs identification module.Image capture module includes first microprocessor, camera 2, camera regulating device and image preprocessing listMember, first microprocessor with identification control module connect, camera 2 is connect with first microprocessor, image pre-processing unit andCamera connection, camera 2 are set in camera regulating device.Camera 2 is corresponding up and down with the center of electronic-weighing platformSetting.
It identifies that control module and Weighing module, image capture module use wired or wireless connection, knows for controlling imageOther module and Weighing module receive the identification information of picture recognition module and are analyzed and processed to weight data, identification controlModule is equipped with processor and memory, and memory stores commercial standards weight data and commodity price data, and processor is to imageIdentification module, Weighing module control and be compared to practical weighing data with standard weights data.
Picture recognition module can be set to POS terminal in, and with the wired or wireless connection of image capture module, picture recognition moduleCan also be arranged with POS terminal cloud, and with the wired or wireless connection of image capture module.The picture recognition module of the present embodiment is set toIn POS terminal, picture recognition module is connect with image capture module wire/wireless, and is connected to the network with cloud training platform, is passed throughThe identification model library for transferring cloud training platform identifies the commodity image of image capture module acquisition.
The identification control module of the present embodiment is set in POS terminal, and image capture module, Weighing module are connected by USB respectivelyWiring 6 is connect with identification control module.
As shown in Fig. 2, the position of camera 2 is set to 7 top of electronic-weighing platform, and the position of camera 2 and electronic-weighingThe center on 7 surface of platform is corresponding.Camera regulating device includes fixed plate 5, pedestal 4, lifting regulating rod 3 and camera peaceFill platform 1.Fixed plate 5 is fixed on cash register region, and pedestal 4 is fixed in fixed plate 5, and lifting regulating rod 3 is fixed on pedestal 4, takes the photographAs head erecting bed 1 is set to the top of lifting regulating rod 3, the junction of camera erecting bed 1 and lifting regulating rod 3 is equipped with being used forThe rotary shaft of 360 degree of adjusting camera erecting beds 1, camera 2 are fixed on the bottom of camera erecting bed 1, and lifting regulating rod 3 is usedIn the height for adjusting camera 2, camera erecting bed 1 is used to adjust the shooting angle of camera 2, can be neatly to electronic-weighingThe commodity of different modes of emplacement are completely shot in platform.Light compensating lamp is additionally provided on camera erecting bed 1, light compensating lamp is fixed onThe lens edge of the two sides of camera 2, camera 2 is equipped with focus adjustment circle.
As shown in Fig. 2, the workflow of present system are as follows:
Step 1: carrying out sampling mark to all kinds of commodity in advance, obtaining includes commodity image, commercial standards weight, commodityThe sample data of price and goods number, cloud training platform are trained commodity image data, commodity image number data,It obtains identification model and stores to identification model library, commercial standards weight data and commodity price data store to identification and control mouldBlock；
Step 2: if there is commodity to be placed on electronic-weighing platform, induction trigger module sends trigger signal to identifying controlModule, identification control module control image capture module carry out Image Acquisition, camera shoot commodity image and by commodity figureAs being sent to picture recognition module after handling by image pre-processing unit, perform the next step；
Step 3: picture recognition module, which transfers the identification model in the identification model library of cloud training platform, carries out image knowledgeNot, and the commodity image that will acquire is sent to cloud training platform, and picture recognition module sends out the goods number of identification and pictureIt send to identification control module, meanwhile, cloud training platform will identify that successful commodity image is added to corresponding commodity trainingIn model, identification model library constantly carries out mold cycle repetitive exercise, completes the update in identification model library；
Step 4: identification control module determines whether to weigh automatically according to image recognition result, if so, executing stepRapid five, otherwise, recognition result is shown on touch screen, executes step 6；
Step 5: weighing data is sent to identification control module according to the instruction of identification control module by Weighing module, knowOther control module is compared practical weighing data with standard weights data, and comparison result is shown on touch screen, holdsRow step 6；
Step 6: cashier carries out information checking to the data that touch screen is shown, and if verification passes through, cashier's pointHit touch screen, using POS terminal cash register unit generate commodity bill, client display screen show bill information, customer payment bill,Printing device prints payment bill, completes cash register；If verification failure, cashier according to wrong data judge incorrectly reason,And after being adjusted according to error reason, it re-execute the steps two.
If error reason be commodity image in product locations deviate frame out, adjust photographic device head regulating device withAdjust the shooting angle or height of camera；If error reason is that the commodity image in commodity image is unintelligible, focusAdjusting ring and light compensating lamp, to adjust the focal length and light filling degree of camera；If error reason is that the gross weight that Weighing module obtains isZero, then check whether the connection of electronic-weighing platform and POS terminal is abnormal.
Embodiment 2
A kind of commodity identification and cash register system based on image recognition, the system is without cashier, it can be achieved that customer is completeAutomatic cash register, including image capture module, picture recognition module, Weighing module, identification control module, POS terminal, cloud training are flatPlatform, network module and customer handheld terminal.As shown in figure 3, the POS terminal of the present embodiment system include cash register unit and respectively with receiptsTouching display screen 12, clearing code generation unit and the printing device 11 of silver-colored unit connection, touching display screen 12 are equipped with clearing and pressKey 13, clearing key 13 are connect with clearing code generation unit, and clearing code generation unit is connect with printing device 11.This system itsHis structure is same as Example 1.
The workflow of this system are as follows:
Step 1: carrying out sampling mark to all kinds of commodity in advance, obtaining includes commodity image, commercial standards weight, commodityThe sample data of price and goods number, cloud training platform are trained commodity image data, commodity image number data,It obtains identification model and stores to identification model library, commercial standards weight data and commodity price data store to identification and control mouldBlock；
Step 2: commodity are placed on electronic-weighing platform by customer, induction trigger module sends trigger signal to identifying controlMolding block, identification control module control image capture module carry out Image Acquisition, camera shoot commodity image and by commodityImage is sent to picture recognition module after handling by image pre-processing unit, performs the next step；
Step 3: picture recognition module, which transfers the identification model in the identification model library of cloud training platform, carries out image knowledgeNot, and the commodity image that will acquire is sent to cloud training platform, and picture recognition module sends out the goods number of identification and pictureIt send to identification control module, meanwhile, cloud training platform will identify that successful commodity image is added to corresponding commodity trainingIn model, identification model library constantly carries out mold cycle repetitive exercise, completes the update in identification model library；
Step 4: identification control module determines whether to weigh automatically according to image recognition result, if so, executing stepRapid five, otherwise, recognition result is shown on touch screen, executes step 6；
Step 5: weighing data is sent to identification control module according to the instruction of identification control module by Weighing module, knowOther control module is compared practical weighing data with standard weights data, and comparison result is shown on touch screen, holdsRow is in next step；
Step 6: customer carries out information checking according to the data that touching display screen is shown, if verification passes through, touch-control is clickedThe clearing key of display screen, clearing code generation unit generate payment and settlement code, and customer passes through customer handheld terminal scanning clearing codeBill payment is completed, printing device prints payment bill, completes cash register；If verification failure, customer misdeem according to wrong dataAccidentally reason, and after being adjusted according to error reason, it re-execute the steps two.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, anyThe cashier for being familiar with the art in the technical scope disclosed by the present invention, can readily occur in various equivalent modifications or replaceIt changes, these modifications or substitutions should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with rightIt is required that protection scope subject to.