Background technique
Known, the examination that early stage carries out generallys use the mode for teacher's group signature of going over examination papers, and the teacher that gos over examination papers is straight by scoreIt connects and is labeled on paper, after the completion of waiting all papers to correct, united again by manually copying score in summaryMeter analysis.This craft mode of going over examination papers be it is very original, working efficiency is low, and achievement transcribing errors are also inevitable, is only suitable forMinimum scale and the insignificant examinations such as class, grade's examination.
With the development of science and technology gradually proposing the concept that automation is goed over examination papers.Mode known to a kind of is by using markRemember the automatic scoring that paper carries out, or passes through image procossing as disclosed in Japanese documentation JP-A-7-199794Device scores to answer sheet, is configured to described image processor to come distinguished symbol and mark by using Digital Image ProcessingRemember and these symbols and label are compared to score to answer sheet with correct option.And such as in Japanese documentationDisclosed in JP-A-11-224245 like that, where it is proposed such a points-scoring systems, and the system is configured to by makingWith special-purpose cushion and pen and detects the state of pen automatic scoring is carried out to answer sheet.
However, the above-mentioned prior art has the disadvantages that.That is, institute is public using mark sheet and in JP-A-7-199794In the case that the image processor opened carries out automatic scoring, if answer and is-not symbol, character or label by text (as answeredThe problem of), then answer cannot be identified by answer recognition unit, therefore cannot score answer.Further, since willPoints-scoring system disclosed in JP-A-11-224245 is configured to by using special-purpose cushion and pen and detects the state of pen and come to answerPaper carries out automatic scoring, it is therefore desirable to the specialized hardware of such as special-purpose cushion and pen, therefore its structure becomes complicated and expensive.
With the further development of computer networking technology and image processing techniques, automation, which is goed over examination papers, to be further evolved intoUsing computer marking.Computer marking is carried out by the way of paper and test paper separation, and objective item is appraised automatically by computer,Subjective item on computers scores respectively to the electronic image of examinee's test paper by network by the different teachers that gos over examination papers, finallyCarry out core point and achievement verification automatically by computer system again.The teacher that marks examination papers can be effectively prevented using computer network gradingBetween influence each other, moreover it is possible to the error rate that will go over examination papers minimizes.Current is all utilized in for computer marking systemAnchor point is set on answering card, and the answer sheet recognition device of computer marking system is identified by induction on special answering cardAnchor point identifies different topic answer locations.As an example, a kind of calculating is disclosed in CN101866415AThe answer sheet recognition device of machine marking system, including data read module and character recognition module, wherein the reading data mouldBlock is sent to the character recognition module for obtaining answer sheet picture information, and by the answer sheet picture information；The wordIdentification module is accorded with, for using optical character recognition technology, the character shape of the answer sheet picture information is translated into calculatingThe readable text information of machine and storage.As another example, a kind of examination based on OCR identification is disclosed in CN102890775AScore automatic identification processing method is rolled up, including the marking region on automatic program identification paper, is identified and is tried using OCR techniqueRoll up score.Directly the hand-written score on papery paper is handled in above-mentioned document, does not need to make dedicated answering card.SoAnd in practice, it has been found that can only enough meet that there are the objective items of model answer (such as to select using optical character recognition technologySelect topic, True-False etc.), but for needing then still obviously not accurately identifying and sentence come the topic of answer using character expressIt is disconnected.
It is also used as another example, a kind of terminal examination evaluation system, the system packet are disclosed in CN104900101AInclude server, student terminal system and the teacher's terminal system that interaction is realized by internet, wherein contain in server memoryExam pool and exam pool answer, the server send operation topic and examination paper according to the examination order that teacher's terminal system is issuedTo aobvious outside student terminal system, and input student's answer in student terminal system by user, then on pass server back, serviceDevice receives student's answer and is read and made comments according to exam pool answer, then will read and make comments result and be sent to examination terminal system and student terminal systemSystem.The system can be realized Automatic Read Overmarginalia, and provide go over examination papers speed and quality of instruction.Then, the system is not first stillThe topic that answer is literal expression can be read and made comments.Further, it is difficult to ensure due to automating the quality read and made comments, in the essence read and made commentsReal needs are not able to satisfy in terms of exactness and accuracy.
As an improvement example, a kind of teaching machine based on electromagnetic handwritten plate is disclosed in CN106887168ANetwork on-line teaching system, including teacher's terminal and student terminal include to read and make comments module in teacher's terminal, described to read and make comments mouldBlock includes reading and making comments module and Automatic Read Overmarginalia module manually.It is described manually read and make comments module for teacher manually to student reply content intoRow verification, Automatic Read Overmarginalia module are that system automatically replies student and answer compares verification.Specifically, using including originalHandwriting recognition module and speech recognition module acquire the voice of person's handwriting and microphone or microphone of the handwriting pad with time writer, logicalIt crosses data processing module the reply message of identification is compared with correct option and go over examination papers.Manually read and make comments module be then used as it is auxiliaryIt helps and student's answer content is checked manually for teacher.Although introduced in the document manually read and make comments module for intoCapable verification, but the hardware that the actually described system itself is inputted is prohibitively expensive, and for oneself of person's handwriting and voiceIt is dynamic to read and make comments the topic for being inherently unable to satisfy and reading and making comments that answer is literal expression, therefore the system is still unable to satisfy real needs.
As a kind of trial of the automatic marking processing to character property examination question, by Iflytek limited liability company as ShenA kind of answer recognition methods and system for character property examination question, the method packet are disclosed in the CN104463101A to ask someoneIt includes: obtaining character property script image；One or more answer character strings to be identified are obtained from the answer image；It is based onGeneral acoustic model carries out handwriting recognition to the answer character string to be identified, obtains the first recognition result；Obtain character propertyThe answer information of examination question；According to the answer information of first recognition result and the character property examination question, adaptive acoustic is constructedModel；Handwriting recognition is carried out to the answer character string to be identified using the adaptive acoustic model, obtains finally identifying knotFruit.By above technical scheme, the recognition accuracy of character property objective item can effectively improve, and then improve go over examination papers efficiency and standardTrue property.
However, above paper automatic marking processing system do not meet the teacher that gos over examination papers in practice read and make comments habit, existHuman-computer interaction is poor, read and make comments process design with actually go over examination papers habit be separated the case where, the effect of actual use can not make us fullMeaning.Further, in actually examination test, paper is different according to the subject test or field and generally comprises different topicsType, such as examine in and must examine subject with college entrance examination: for Chinese language and foreign language, it is indispensable can there are problems that for example, fill,Or the topics type such as discussion topic.The feature of reading and making comments of these topic types is: 1. and be not present no model answer, and be usually by multiple keysKey for Reference composed by word (so-called to branch or adopt branch)；2. fixed format is often not present in the result of answering of studentAnd template, there are very big othernesses, there is a situation where following such: although the result of answering of student is stating upper and standardAnswer is different, but has actually grasped key answering principles substantially, at this time often according to stringent comparison in the prior artIt is judged as mistake, makes the accuracy of test by serious influence；3. read and make comments paper, in addition to needing to provide examinationOutside score, it is also desirable to retain the trace of reading and making comments for the teacher that gos over examination papers, such as teacher is for the note of student's answer and comment etc.,So that student is it will be appreciated that the shortcoming of itself, while it also can satisfy the needs that teacher comments on paper.
Applicant it is hereby stated that, what is stated in above section is only the technology contents that are known of applicant.Above content is onlyProvide only the prior art for being related to the relevant background information of the disclosure but not necessarily constituting the application.
It is that present multimedia tutoring system is opened in consideration of it, how to provide a kind of exam paper marking system to meet current demandOriginator problem anxious to be resolved.
Summary of the invention
At least one of deficiency exists in the prior art in order to overcome, the present invention provides a kind of exam paper marking system,For reading and making comments student to the electronic test paper answer comprising at least one test question from paper database as a result, the paperThe system of reading and making comments includes: first terminal equipment, comprising: the first display module, for showing the test of the electronic test paper to studentTopic；First input module, for the answer result for student's input to the test question；Second terminal equipment, comprising: second is aobviousShow module, the electronic test paper with the answer result for being denoted as different colours is shown to outside the teacher that gos over examination papers；Second input module,The electronic test paper is read and made comments for the teacher that gos over examination papers；Server is communicatively connected to the first terminal equipment, second terminal respectivelyEquipment and paper database, the server include first and read and make comments module, by the answer of the test question of paper database purchaseAutomatic comparison, which is carried out, with the answer result tentatively reads and makes comments result to generate；Fractional statistics module, it is described for receiving and countingTentatively read and make comments result；Second reads and makes comments module, generates for the input according to the teacher that gos over examination papers and finally reads and makes comments result.
Exam paper marking system according to the present invention can assist going over examination papers teacher fast contrast testing student answer result withDifference between Key for Reference so that improve electronic test paper reads and makes comments speed and efficiency, and reduces the work for the teacher that gos over examination papersIt measures and has also taken into account the accuracy for reading and making comments electronic test paper.Also, it is long that exam paper marking system of the invention is more in line with the teacher that gos over examination papersHabit that the phase formed go over examination papers.
Preferably, at least one described test question preferably includes subjective item and objective item, and described first reads and makes comments mouldBlock includes the complete comparing unit for reading and making comments the objective item and the character string comparison unit for reading and making comments the subjective item.
The present invention to subjective item can compare automatically and be read and made comments in the case where keeping centainly reading and making comments accuracy as a result,Speed and efficiency are read and made comments to improve electronic test paper.
Preferably, the character string comparison unit preferably includes: the first transform subblock, is used for the answer resultMultiple character strings and the character string of Key for Reference of subjective item be converted into word sequence respectively；Second transform subblock, being used for willThe word sequence is converted into corresponding set of words respectively；First operation submodule, for calculating the min-hash of each set of wordsMin-hash distance between value and set of words；Classification submodule, for being classified according to min-hash distance to word sequence；And the second operation submodule, for carrying out shared string operations in same class.
Quickly judge whether difference is excessive between answer result and Key for Reference by min-hash algorithm first as a result,It identifies with the obvious dissimilar or not approximate answer of Key for Reference as a result, carrying out shared character string to effectively reduce the later periodThe character string quantity of operation can be effectively saved character compared with the character string comparison unit of unused min-hash algorithmThe calculation amount of string comparison operation and the calculation resources of occupancy.Secondly, by the judgement of answer result and the degree of approximation of Key for ReferenceIt is converted into the operation of the shared length of the min-hash distance and shared string operations between set of words, rather than is usedThe optical mask identification technology being widely used in the prior art, so as to avoid need in the prior art high hardware cost andThe deficiency of poor discrimination.
Preferably, the set of words of each answer result and the ginseng of subjective item are further calculated by the first operation submoduleMin-hash distance between examining the set of words of answer two-by-two, by classification submodule by the min-hash of the set of words with Key for ReferenceDistance is less than word sequence corresponding to the set of words of first threshold and is divided into same class, and min-hash distance is greater than first thresholdSet of words corresponding to the character string of answer result be denoted as the first color；Subsequent second operation submodule min-hash away fromFrom shared string operations below being carried out in the same class for being less than first threshold: making the word sequence of Key for Reference in the classFor the first word sequence, the shared character string of first word sequence and other word sequences in such is calculated separately, wherein gainedThe ratio of the string length of the length and Key for Reference of the shared character string arrived is greater than corresponding to the word sequence of second thresholdThe character string of answer result is denoted as the second color, and the length of obtained shared character string and the character string of Key for Reference are longThe character string that the ratio of degree is less than answer result corresponding to the word sequence of second threshold is denoted as third color.
As a result, on the basis of being calculated with min-hash algorithm and shared character string, by will be approximate with Key for ReferenceThe different answer result of degree is labeled as different colors, quickly understands and identify the feelings of answer result convenient for the teacher that gos over examination papersCondition reads and makes comments the efficiency finally read and made comments and annotated in module second to effectively improve.
Preferably, the first threshold be set of words minimum hash digit 50%, the second threshold, preferablyIt is 80%.
It is read and made comments thus, it is possible to carry out automatic comparison to subjective item in the case where keeping centainly reading and making comments accuracy.
Preferably, it second reads and makes comments module and is configured to receive the input from the second terminal equipment in this way: corresponding toThe answer of the character string of the first color and the second color is denoted as a result, described second, which reads and makes comments module, allows to go over examination papers teacher via describedSecond terminal equipment adds their confirmation and/or is annotated that read and make comments module via second outside to be formed to the result of tentatively reading and making commentsResult is finally read and made comments in output；Corresponding to the character string for being denoted as third color answer as a result, described second read and make comments module permitXu Yuejuan teacher tentatively reads and makes comments result and is modified and/or annotated to form warp via the second terminal equipment to describedBy second read and make comments that module exports outward finally read and make comments result.
Thus, it is possible to according to the difference of answer result and Key for Reference degree of approximation come targeted to tentatively result is read and made commentsAdd their confirmation or modify, sufficiently accurate finally read and make comments result to export outward.
Preferably, the exam paper marking system is that per pass subjective item is equipped with affiliated score upper bound, when teacher's warp of going over examination papersBy the second terminal equipment to it is described tentatively read and make comments fractional value that result modify and exceed the score upper bound when, the examinationVolume reads and makes comments system and forbids the operation from the second terminal equipment and alarmed.
Thus, it is possible to which the teacher that go over examination papers will not be goed over examination papers work and mistakenly assert the class subjective item due to heavyUpper limit score value, thus maximum likelihood avoid the teacher that gos over examination papers subjective a possibility that making a mistake.
Preferably, the first terminal equipment receives to read and make comments finally reading and making comments as a result, and via described for module from secondIt shows outside first display module to student.
Thereby, it is possible to the traces of reading and making comments of the outer aobvious teacher that gos over examination papers, such as teacher is for the note of student's answer and comment etc.Deng so that student is it will be appreciated that the shortcoming of itself, while also can satisfy the needs that teacher comments on paper.
Preferably, wherein second input module is the handwriting recognition list for recording the handwriting input trace for the teacher that gos over examination papersMember, second display module are the touch screen with hand-write input function.
The present invention can be inputted as a result, in hand-written mode, and be more in line with the teacher that gos over examination papers in this way reads and makes comments habit.
Preferably, the hand-writing recognition unit is configured to execute the hand-written input method of reduplicated word, and the reduplicated word is hand-writtenInput method includes the following steps:
Firstly, the hand-writing recognition unit detects that finger contacts this event of touch screen, the start recording teacher that gos over examination papers is defeatedThe stroke person's handwriting of the character entered, and the handwriting area transferred on the touchscreen shows corresponding stroke track；Until its finger fromOpen touch screen, the end of input of current stroke；
Then, the hand-writing recognition unit judged according to following judgment basis the stroke of current handwriting input with beforeWhether the stroke through inputting belongs to the same character: first determining whether current stroke is newly to write pen on the right side of preceding unicursalIt draws, is write if it is not, then further judging whether current stroke is folded on trace with the stroke of handwriting input before, if so,Then further judge that current stroke and the folded of stroke of handwriting input write whether degree is greater than predetermined threshold, if so, recognizingThe same character is not belonging to the stroke inputted before for the stroke of current handwriting input；
If the hand-writing recognition unit judge stroke currently entered and the stroke inputted before be belong to it is sameCharacter, then the hand-writing recognition unit persistently records the handwriting input trace for the teacher that gos over examination papers, until judging to obtain currently enteredStroke no longer belongs to the same character with the stroke inputted before, at this time by the handwritten traces of current record write intoRow Text region, and recognition result is exported on the touchscreen, recognition result is then subjected to dimmed processing；
If it is same that the hand-writing recognition unit judges that stroke currently entered is not belonging to the stroke inputted beforeCharacter, then judging, which whether there is on touch screen, has write and had carried out identifying processing and carried out the handwritten word of dimmed processingSymbol then eliminates the character for having carried out identifying processing if there is there is such hand-written character；Continuing will be except when preceding penAll strokes except picture constitute a handwriting characters, carry out Text region and export recognition result on the touchscreen, soRecognition result is subjected to dimmed processing afterwards.
The present invention can allow the teacher that gos over examination papers that need not pause when writing kinds of characters as a result, can be with the multiple hands of continuous writingWrite characters and identified accordingly and display processing, to improve the efficiency of handwriting input.
Specific embodiment
Below in conjunction with attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that instituteThe embodiment of description is only a part of the embodiment of the present invention, instead of all the embodiments.Usually described in attached drawing hereIt can arrange and design with a variety of different configurations with the component of the embodiment of the present invention shown.Therefore, below in attached drawingThe detailed description of the embodiment of the present invention of middle offer is not intended to limit the range of claimed invention, but only tableShow selected embodiment of the invention.Based on the embodiment of the present invention, those skilled in the art are not making creative workUnder the premise of every other embodiment obtained, shall fall within the protection scope of the present invention.
With reference to Fig. 1, the general frame schematic diagram of exam paper marking system according to the present invention is shown.The paper batchSystem is read for reading and making comments student to the result of the electronic test paper answer comprising at least one test question.Specifically, the paperThe system of reading and making comments includes consisting of: first terminal equipment 10, is communicatively connected to the first terminal at second terminal equipment 20 respectivelyThe server 30 of equipment 10 and second terminal equipment 20, and the paper database 31 with the server 30 communication connection,In, the first terminal equipment 10 includes at least: for the first input module for student's input to the answer result of test question101 with the first display module 102 for showing the test question of the electronic test paper to student, second terminal equipment 20 is then at leastInclude: the second input module 201 for reading and making comments the electronic test paper for the teacher that gos over examination papers is shown with to outside the teacher that gos over examination papers with answer knotSecond display module 202 of the electronic test paper of fruit, and server 30 includes at least and carries out the answer of test question and answer resultAutomatic comparison tentatively reads and makes comments the first of result and reads and makes comments module 301, receives and count the score for tentatively reading and making comments result to generateIt statistical module 302 and is generated according to the input for the teacher that gos over examination papers and finally reads and makes comments the second of result and read and make comments module 303.
In the present invention, first terminal equipment 10 and second terminal equipment 20 may, for example, be and is connected to via cable networkThe desktop computer of server 30, naturally it is also possible to be the various portable terminals communicated to connect via wireless network and server 30End device, such as, but not limited to: first terminal equipment 10 and second terminal equipment 20 can be tablet computer, smart phone etc.,And it can directly be communicated to connect with server 30 via radio network techniques such as 4G, bluetooth or WiFi.Take one's testLife can log in the exam paper marking system via network and in the form of account number cipher, take one's test and understand answering for oneselfInscribe situation.
According to a particular embodiment of the invention, the student to take one's test can be via the first terminal equipment 10 simultaneouslyTo input in a manner of account or student number, and by the code entry exam paper marking system, so that the test of electronic test paper is carried out, and theOne terminal device 10 is to be communicatively connected to paper database 31 by server 30, to receive electricity from the paper database 31The sub- paper and student for Gong taking one's test answers.Certainly, alternatively, the electronic test paper is it is also contemplated that beIt is provided by server 30 itself, i.e., server 30 connects paper database 31 to obtain electronic test paper, then by the electronic test paperThe student that first terminal equipment 10 Gong takes one's test is sent to answer.
In a specific embodiment of the present invention, the electronic test paper includes at least one quiz, and the above quiz is selectedFrom in quiz stored in paper database 31, naturally it is also possible to it is envisioned that can also be by server 30 from paper databaseDifferent quizs is selected in 31 to form the electronic test paper.Here, at least one test question in the electronic test paper is excellentSelection of land includes objective item and subjective item two types.Wherein, in the present invention, term " objective item " refers to the testThe topic type of the model answer of topic, the result of the topic type read and made comments only include two kinds of answer right and wrong as a result, as non-limitQualitative example, the topic type be for example non-topic, multiple-choice question, choose topic etc..Meanwhile " subjective item " refers to reference at least one exampleThe Key for Reference of for example character property gives the topic type read and made comments with certain subjectivity, wherein the Key for Reference for example can be by moreA keyword (i.e. so-called to branch or adopt branch) composition, wherein the result read and made comments may comprising answer correct, mistake withAt least three kinds of unknown (can not judge whether correctly or incorrectly) etc. as a result, as non-limiting example, the topic type is for exampleIt is simple answer, Essay Writing topic and gap-filling questions etc..
Referring next to Fig. 1, via the aobvious electronic test paper from server 30 outside the first display module 102 and take one's testStudent can be via the first input module 101 existing comprising subjective item and objective item to electronic test paper of the first terminal equipment 10Interior quiz is answered and answer result is uploaded to server 30, and then, the first of server 30 reads and makes comments module 301 canAccording to the Key for Reference for corresponding to each quiz, the comparison of Lai Jinhang answer result, and then obtains and tentatively read and make comments result.
In the present invention, the answer of quiz can be also stored in paper database 31 with each quiz, in the present inventionSpecific embodiment in read and make comments module 301 by tentatively read and made comments automatically first and read out, according to each quiz by participating inQuiz answer given by the student of test as a result, first read and make comments module 301 automatically read and make comments the student that takes one's test toWhether the answer result of each quiz out is correct.The process of Automatic Read Overmarginalia according to the present invention described in detail below: it is takingFirst in business device 30 reads and makes comments complete comparison unit 3011 of the module 301 with complete comparing function and there is character string to compareThe character string comparison unit 3012 of function.
Fig. 2 is referred to, wherein Fig. 2 is to schematically depict the according to the present invention first composition for reading and making comments module 301.Such asShown in Fig. 2, described first, which reads and makes comments module 301, further includes complete comparison unit 3011, character string comparison unit 3012.BelowBy English test electronic test paper for, quiz can be roughly divided into have appraise according to model answer go over examination papers it is objectiveTopic, and with subjective item both topic types goed over examination papers of taking the circumstances into consideration appraise according to Key for Reference, wherein have according to reference to answeringCase is taken the circumstances into consideration appraise the subjective item goed over examination papers, and the whether correct judgment mode of answer has certain fuzzy space.Citing andSpeech, for the topics type such as simply inscribing, Key for Reference is often made of multiple keywords (i.e. so-called to branch or adopt branch),Even if the answer result of the student to take one's test is above not quite similar with Key for Reference in answer statement, if but having contained describedIt is multiple to branch or to adopt branch, and state upper logical, can be considered that answer is correct, even if answer statement may with answerIt is very big to inscribe result gap.
According to a particular embodiment of the invention, complete comparison unit 3011 is used to compare answering for the objective item in each quizTopic as a result, and generate correspond to objective item accurately read and make comments result, wherein the objective entitled topic type with model answer,Such as the objective entitled single choice, as long as having read the option information that the student that takes one's test is chosen, by the option informationWhether answer correct with the scheduled model answer test question that compares that you can get it and gives corresponding score, subsequent instituteThe score for stating objective item will be sent to fractional statistics module 302.
Further, for the answer of character property objective item, due to the student that takes one's test knowledge point grasp ability andWithout fixed format, the answer result for being input to character string comparison unit 3012 exists for the difference of answer level and answer itselfThe different situation of answering mode.It really may be implemented accurately to automate using character string comparison progress operation and go over examination papers, but countCalculation amount is still excessive, therefore has and advanced optimize to promote the room for improvement of operation efficiency.
As more preferred mode, in electronic test paper, the character string comparison unit 3012 will take one's test studentAnswer result compared with Key for Reference obtain the subjective item about the test tentatively read and make comments as a result, and describedIndicate the error degree with Key for Reference in answer result respectively in different colors.Specifically, test student is first checked forAnswer as a result, differentiating sentence paragraph using comma or fullstop to form multiple character strings, then by the multiple character stringTranscription comparison is carried out with the character string of Key for Reference to read and make comments, when answer result is clearly present error with Key for Reference, depending onIt for answer apparent error, will be shown with red-label, conversely, when not having obvious errors, it is correct to be considered as answer, will be shown with Green MarkerShow, to can not judge whether correctly or incorrectly to indicate with yellow.It is described in detail below with reference to preferable example.
Still by taking English letter answer as an example, as shown in figure 3, the character string comparison unit 3012 includes: the first conversion submoduleBlock 321, for the character string of multiple character strings of the answer result for the student that takes one's test and the Key for Reference of subjective item will to be used asIt is converted into word sequence respectively；Second transform subblock 322, for word sequence to be converted into corresponding set of words respectively；First fortuneOperator module 323, the min-hash distance between minimum hash and set of words for calculating each set of words；Classification submoduleBlock 324, for being classified according to min-hash distance to word sequence；And the second operation submodule 325, in same classIn carry out shared string operations.It should be pointed out that in the complete comparison unit 3011 and character string comparison unit 3012Each functional module being implemented in combination with by hardware, software or hardware and software, thereby executing following according to this hairBright method and steps.
In the present invention, " word sequence " refers to the sequence of word；Correspondingly, " set of words " refers to the set of word.In other words, sequenceColumn and the constitution element of set are all words.The difference of the two is that the element in sequence can repeat and must have sequentially, andOrder of elements is not considered in set and element is without repetition.As an example, for example, test student submit answer result wordSymbol string are as follows: " the Chinese nation gets the great rejuvenation "；At the same time, the word of Key for ReferenceSymbol string is " the great rejuvenation of the Chinese nation ".So, as shown in figure 4, first in stepThe word sequence A for obtaining the character string of answer result after the participle operation of the first transform subblock 321 in rapid S100 are as follows:{ the, Chinese, nation, gets, the, great, rejuvenation }.The character string of Key for Reference is by the first conversionKeyword word sequence B:{ the, great, rejuvenation, of, the obtained after the participle operation of device 321,Chinese, nation }.Certainly as known to those skilled in the art, character string of the invention is right not only just for English wordIt also can be all applicable in the mixed word etc. of the word or Chinese and English of Chinese.
It in the present invention, then in step s 200 can be by the more of the second transform subblock self-test in 322 future studentThe word sequence of the Key for Reference of a answer result and the subjective item is converted into corresponding set of words, in conversion process, weightExisting word of appearing again only retains one, such as " the ".To make above example convert after obtain set of words A the,Chinese, nation, gets, great, rejuvenation }；Set of words B be then the, great, rejuvenation,Of, Chinese, nation }.
Then, each of the above set of words is calculated using hash algorithm by the first operation submodule 323 in step S300Minimum hash, the minimum hash can be used for calculating the Jaccard similarity between two set of words.Those skilled in the artMember knows that so-called Jaccard similarity refers to for two set A, B, then Jaccard (A, B)=| A ∩ B |/| A ∪ B |.?On the basis of this, the first operation submodule 323 calculates the set of words for each answer result that test student submits and subjective item refers toThe set of words of answer two-by-two between min-hash distance.In the present invention, minimum hash is the numerical value (such as 32 of regular lengthPosition).In this 32, position is identical and the number for the position that numerical value is different is the min-hash distance between two set of words,For middle min-hash apart from smaller, the Jaccard similarity of the two set of words is higher.By the min-hash distance being calculated withPreset first threshold is compared, and min-hash distance is less than word order corresponding to the set of words of the first thresholdColumn are classified as same class, and in the present invention, as non-limiting example, the first threshold can be the digit of minimum hash50%.Certainly, those skilled in the art, which can according to need, sets the threshold value, this is understood that obtain.
Then, in step S400, in multiple answer results for submitted the student to take one's test by classification submodule 324, the word sequence for meeting min-hash distance in the word sequence being converted into and being less than this condition of first threshold remain, it is rightIn being unsatisfactory for answer of the min-hash distance less than this condition of first threshold, the answer result of student's input can be considered asCompletely and the keyword (i.e. point scoring or adopting branch) of Key for Reference is dissimilar or not approximate, therefore character string comparison unitThe answer result of the student is directly automatically judged to answer apparent error and is indicated with red-label and be sent to the by 3012Two display modules 202, and the test question is not given point or the information of score is not sent to fractional statistics module 302.It is rightIn the word sequence for meeting min-hash distance condition, its word sequence corresponding with Key for Reference is divided into a class.
Finally, in step S500, by the second operation submodule 325 arbitrarily selected from above same class one asThe word sequence of student's answer result and the word sequence of Key for Reference carry out the operation of shared character string.Below to belong in same classA student the word sequence of answer result and the word sequence of Key for Reference for carry out shared character stringCalculating process.For simplicity by above English word respectively with the schematical mark of letter.
In the first situation, it is assumed that the word order of student's answer result is classified as { A, B, A, D, E, F, G }, the word of Key for ReferenceSequence is { A, B, B, D, E, F, G }.By sharing string operations, the word sequence of student's answer result and the word order of Key for ReferenceThe shared character string of column is { A, B, D, E, F, G }, length 6.Since the length of the word sequence of Key for Reference is 7, it is known that sharedThe lenth ratio of the word sequence of string length and Key for Reference is greater than preset threshold value (such as 80%).In this case,Can be considered as student input answer result it is identical with keyword (i.e. point scoring or the adopting branch) of Key for Reference orPerson is completely approximate, and it is obvious correct simultaneously that the answer result of the student is directly automatically judged to answer by character string comparison unit 3012And the word order of student's answer result is classified as outside { A, B, A, D, E, F, G } progress and shows and is included by shared character string thereinCharacter shown with Green Marker and be sent to the second display module 202, further also the corresponding score of the test question is believedBreath is sent to fractional statistics module 302.
In another case, assume that the word order of student's answer result is classified as { A, B, A, D, E, F, G }, the word order of Key for ReferenceIt is classified as { A, B, B, C, E, F, G }.By sharing string operations, the word sequence of student's answer result and the word sequence of Key for ReferenceShared character string be { A, B, E, F, G }, length 5.Since the length of the word sequence of Key for Reference is 7, it is known that shared characterThe lenth ratio of the word sequence of string length and Key for Reference is less than preset threshold value.In this case, character string comparison unit3012 it is considered that the answer result of student input and keyword (i.e. point scoring or adopting branch) part phase of Key for ReferenceSame or part is approximate, i.e., the answer result of the described student belongs to the scope that can not judge whether correctly or incorrectly.In this feelingsUnder condition, by the word order of student's answer result be classified as { A, B, A, D, E, F, G } carry out it is outer aobvious and by shared character string institute thereinThe character for including shows with yellow flag and is sent to the second display module 202, and the score of the test question half is believedBreath can be sent to fractional statistics module 302.
From the foregoing, it will be observed that complete comparison unit 3011 and character string comparison unit 3012 in module 301 are read and made comments by first,Can be realized to automatically, rapidly answer to the student that takes one's test to electronic test paper the case where read and make comments, wherein for visitorSight topic can accurately provide score, and for subjective item, preliminary screening can be provided according to answer situation and is criticized for the first timeRead as a result, and the answer result for the student that takes one's test is marked with different colors, thus go over examination papers religion convenient for the later periodTeacher's finally reads and makes comments work.Further, according to the preferred embodiment of min-hash algorithm utilized above, with unused min-hashThe character string comparison unit of algorithm is compared, and can rapidly be judged between answer result and Key for Reference with the presence or absence of apparent poorIt is different, so as to be effectively saved the calculation amount of character string comparison operation and the calculation resources of occupancy.
From the above, in the present invention, finally reading and making comments work includes finally reading and making comments work and to student to subjective itemThe note of answer and annotation, and retain reading and making comments to show outside trace and checking to the student to take one's test for the teacher that gos over examination papers.SpecificallyFor, as shown in Figure 1, the teacher that gos over examination papers can log on server 30 via second terminal equipment 20, utilize the second input module201 and second read and make comments module 112 to read and make comments for the first time result and first read and make comments the score that module 301 provides read and made comments again andIt obtains and finally reads and makes comments result.In the present invention, finally reading and making comments result may be that first read and make comments in result of modification is judged for exampleThe answer of subjective item whether review again correctly or incorrectly, can also be to be criticized to the answer result and thinking of each subjective itemNote, naturally it is also possible to be that amendment first reads and makes comments the score that module 301 provides to generate and finally read and make comments as a result, can also further incite somebody to actionIt is stored in server 30 with the electronic test paper for finally reading and making comments result and/or answer annotation for the reading of first terminal equipment 10It takes.Specifically, go over examination papers teacher by the answer result of each subjective item again row check correct or annotate after finally read and made commentsAs a result, therefore, the recycling first terminal equipment 10 of the student to take one's test logs on server 30, and via the first display mouldBlock 102 shows annotation given by result (containing the electronic test paper for finally reading and making comments score) and the person of going over examination papers after reading and making comments.
In the present invention, second input module 201 is preferably the handwriting input trace that can recorde the teacher that gos over examination papersHand-writing recognition unit 201.In the present invention, the hand-writing recognition unit 201 of adaptation is selected according to the type of server 30.ToolFor body, when server 30 is desktop computer, the hand-writing recognition unit 201 can utilize wired mode (such as USB connectionLine) or wireless mode (such as infrared ray, bluetooth, WiFi, NFC wireless communication technique) with as desktop computer server intoRow communication connection, and in the case, the hand-writing recognition unit 201 can be selected from handwriting pad, photography assembly or electronic pen etc.Has the handwriting recognition component of handwriting record and discriminating function.Further, the hand-writing recognition unit 201 preferably has memoryFunction is for storage handwriting recognition data.At the same time, when second terminal equipment 20 is movable termination, for example, smart phoneOr when tablet computer, the hand-writing recognition unit 201 can use the capacitive touch sensors of the movable termination withAnd matched handwriting recognition engine, i.e., religion of going over examination papers directly is recorded in the sliding of the mobile terminal by the finger of the teacher that gos over examination papersThe handwriting input trace of teacher.Then, divide the handwriting input trace and by handwriting recognition engine identification character to be transmitted to screenCurtain carries out outer aobvious.
In a preferred embodiment, by way of the shared string operations in character string comparison unit 3012Through the Key for Reference of the answer result for the student that takes one's test and each subjective item has been carried out preliminary comparison.For via characterCorrect answer of the comparison unit 3012 labeled as the complete wrong of red and labeled as green go here and there as a result, going over examination papers teacher at this time onlyIt needs to operate hand-writing recognition unit 201 to add their confirmation to the result of going over examination papers of character string comparison unit 3012.At this time due to religion of going over examination papersTeacher only needs substantially to browse can be confirmed by the requirement whether answer of the part of Green Marker has met Key for Reference,To greatly reduce the labor intensity for the teacher that gos over examination papers.Further, it is answered for what label in the second display module 202 wasTopic as a result, the teacher that gos over examination papers can annotate answer result according to answer situation, such as in simple topic in label with it is describedRelated source of the relevant knowledge point of problem to the knowledge point in textbook, above information can be led to by the teacher that gos over examination papersIt crosses hand-writing recognition unit 201 to be input in server 30, and is further used as additional information storage into electronic test paper.
The answer for being for the label that can not judge whether correctly or incorrectly is as a result, the teacher that gos over examination papers needs emphasis to be subject toIt reads and makes comments.When reading and making comments, exam paper marking system of the invention can assign the teacher that the gos over examination papers permission for reading and making comments the subjective item again.ToolFor body, exam paper marking system of the invention is that per pass subjective item is equipped with score upper bound belonging to it, for example, per pass letter answerScore upper bound be 10 points.Label correctly or incorrectly, which is, to be judged whether for those character string comparison units 3012Answer as a result, being taken the circumstances into consideration in the score section of 0-10 point by going over examination papers teacher according to Key for Reference to be given a mark and/or write batchNote.When exam paper marking system discovery is greater than 10 via the fractional value that the teacher that gos over examination papers that hand-writing recognition unit 201 inputs provides, instituteIt states exam paper marking system and forbids the operation from second input equipment 20 and sending " can not operate " or " beyond scoreThe warning of the upper limit ", to prompt to go over examination papers, teacher does not meet pre-defined rule to score value for the simple answer.Via to per pass subjectivityTopic is equipped with score upper bound, so that the teacher that gos over examination papers will not be goed over examination papers work and mistakenly assert the class due to heavyThe upper limit score value of subjective item, thus maximum likelihood avoid the teacher that gos over examination papers subjective a possibility that making a mistake.
It is further preferred that in order to improve the speed and that retains the teacher that gos over examination papers go over examination papers trace for example of going over examination papers for the teacher that gos over examination papersPoint comment or annotation need to effectively improve in the writing input efficiency and stringent identification for example, of hand-writing recognition unit 201The input method of the character of text, therefore input method hand-written it is preferable to use reduplicated word in the present invention, this input method are to allowFor user after writing a character, the character late of handwriting input can fold the handwriting input for writing on the top of first characterMethod.The hand-written input method of reduplicated word according to the present invention, go over examination papers teacher can in the useful space of handwriting input any positionIt sets and carries out continuous handwriting input, to more be bonded the habit of going over examination papers for the teacher that gos over examination papers.
Specifically, hand-writing recognition unit 201 of the invention is configured to allow go over examination papers teacher uninterruptedly carry out it is any number ofCharacter continuous hand-written simultaneously carries out corresponding identifying processing, to effectively promote the efficiency for writing input.It below will be by readdingIt is that example describes this hair come the handwriting input trace for recording the teacher that gos over examination papers that the finger of teacher, which is rolled up, in the sliding of the mobile terminalThe hand-written input method of bright reduplicated word.Certainly, as known to those skilled in the art, the hand-written input method of above-mentioned reduplicated word is similarlySuitable for carrying out handwriting input in a manner of writing pencil and this mode should also be as being considered as claimed content.
The hand-written input method of the reduplicated word of multiword symbol continuous writing according to the present invention, is detected by hand-writing recognition unit 201The different strokes of first character and second character out, when the teacher that gos over examination papers starts to fold and writes second character, preferably automaticallyThe display color for having write the first character finished is dimmed, to facilitate the teacher that gos over examination papers from 202 supernatant of the second display moduleThe trace of the current character of oneself institute's handwriting input is seen clearly.It can not stop in this way and continuously arbitrarily write multiple wordsSymbol.It is when handwriting input third character, the viewing area of the first character inputted before from the second display module 202 is automaticIt disappears, and second character inputted before being allowed to is automatically dimmed, thus realizes final continuous formality input, it below will be specificIntroduce each step of the method:
Go over examination papers first teacher finger contact in the present invention be, for example, touch screen the second display module 202, start it is defeatedEnter stroke, at this moment hand-writing recognition unit 201 can be detected finger contact this event of touch screen, start recording go over examination papers teacher inputCharacter stroke person's handwriting.Next, the hand-writing recognition unit 201 records religion of going over examination papers when finger moves on the touchscreenThe handwriting input trace of teacher, and transfer handwriting area on the touchscreen and show corresponding stroke track, this embodiment itIn, the stroke color of current hand-written character is indicated with red；(as known to those skilled in the art, it is also possible to which other color expression is worked asThe color of preceding handwritten stroke, red are intended merely to be more in line with the habit of going over examination papers for the teacher that gos over examination papers, and replace the color of handwritten stroke simultaneouslyThe substantive content of the content of present invention is not influenced)；The teacher that gos over examination papers keeps handwriting input until its finger leaves touch screen, current strokeEnd of input.
Then, hand-writing recognition unit 201 judges whether the stroke of current handwriting input belongs to the stroke inputted beforeIn the same character.Specific decision logic and method are as follows: either Chinese Hanzi character or English word character, strokeInput is all sequence from left to right, such as is usually the combinde rqdical character of tiled configuration in chinese character, wherein left side is needsThe radical first inputted.Based on this discovery, the stroke for judging current handwriting input of the application and the stroke inputted beforeWhether first criterion of same character is belonged to are as follows: judges whether current stroke is newly to write pen on the right side of preceding unicursalIt draws, if it is determined that being that stroke is write in the new of right side, it may be considered that stroke currently entered and the stroke inputted before are to belong toIn the same character.If it is determined that being not located at the right side of preceding unicursal, then in view of certain Chinese characters are, for example, up-down structureCombinde rqdical character, such as " basin " word are made of " being divided to " and " ware word bottom " two radicals, then carry out the judgement of Second Criterion condition: judgement is worked asWhether preceding stroke, which is folded on trace with the stroke of handwriting input before, is write, if not folded on trace write, can be recognizedIt with the stroke before inputted is to belong to the same character for stroke currently entered.If it is determined that current stroke is therewithThe stroke of preceding handwriting input on trace fold writes, then carry out the judgement of third criterion: judge current stroke with it is hand-writtenThe folded of the stroke of input writes degree, writes degree less than 60% if folded, it may be considered that stroke currently entered with beforeThe stroke of input is to belong to the same character., whereas if folded degree of writing is greater than 60%, it may be considered that stroke currently enteredIt is to be not belonging to the same character with the stroke inputted before.
Then, judge that the stroke that stroke currently entered has been inputted with before is to belong to together in hand-writing recognition unit 201In the case where one character, further determine whether that there are also new strokes to input, if there is also have new stroke input, instituteThe handwriting input trace that hand-writing recognition unit 201 persistently records the teacher that gos over examination papers is stated, and handwriting area always on the touchscreen is aobviousShow corresponding stroke track, until to show that stroke currently entered no longer belongs to the stroke inputted before same for judgementThe handwritten traces of current record write are carried out Text region at this time, and export recognition result on the touchscreen by character, soRecognition result is subjected to dimmed processing afterwards.
Meanwhile if judging that the stroke that stroke currently entered has been inputted with before does not belong in hand-writing recognition unit 201In the case where the same character, then judging, which whether there is on touch screen, has write and had carried out identifying processing and becomeThe hand-written character of dark treatment, if having had existed such hand-written character, by the word for having carried out identifying processingSymbol is eliminated.Continue by other than current stroke all strokes constitute a handwriting characters, carry out Text region andRecognition result is exported on touch screen, and recognition result is then subjected to dimmed processing.
It can be seen that the input method hand-written via reduplicated word of the invention, so that the teacher that gos over examination papers carries out book on the touchscreenWhen writing, continuous reduplicated word handwriting input is carried out according to the habit that the teacher that gos over examination papers writes naturally, it can be continuous hand-written defeated incessantlyEnter multiple texts, the handwritten traces that hand-writing recognition unit 201 automatically inputs the teacher that gos over examination papers carry out identification output, thus effectivelyThe efficiency for improving handwriting input.
On this basis, read and make comments the operation at module 303 second via teacher is goed over examination papers, can to tentatively go over examination papers result andThe score being stored in fractional statistics module 302 is read and made comments again and is obtained and finally read and made comments result and go over examination papers given by teacherAnnotation.The recycling first terminal equipment 10 of the student to take one's test as a result, logs on server 30 and is read and made comments with reading secondInformation above in module 303, and finally reading and making comments after reading and making comments is shown to the student to take one's test via the first display module 102As a result (contain the electronic test paper for finally reading and making comments score) and the teacher that gos over examination papers given by annotation.
To sum up, exam paper marking system according to the present invention can first be answered with standard by complete comparison unit 3011The answer result of the objective item of case is strictly compared, and via character string comparison unit 3012 to by multiple crucial phrasesAt the answer result that provides of student of subjective item of Key for Reference compare, thus tentatively goed over examination papers result and its pointNumber, at the same the answer result of subjective item is indicated according to different situations with different colors and show answer result withShared character string between Key for Reference.Then, going over examination papers teacher can be to tentatively going over examination papers result and its score is read and made comments again, exampleSuch as is checked, is confirmed, modified or marked in detail to Key for Reference or the subjective item compare, thusIt obtains finally to read and make comments result and be back to outside first terminal equipment and show to the student to take one's test.Via automatically to objective item progressIt compares completely, and the mode that shared character string is compared and indicated is carried out to subjective item, the labour that can reduce the teacher that gos over examination papers is strongDegree also takes into account the accuracy goed over examination papers simultaneously.
The technical scheme of the present invention has been explained in detail above with reference to the attached drawings, although preferred implementation of the invention has been describedExample, once a person skilled in the art knows basic creative concepts, then other change can be made to these embodimentsMore and modify.So it includes preferred embodiment and all changes for falling into the scope of the invention that the following claims are intended to be interpreted asMore and modify.
Better embodiment of the invention is described above, it is intended to so that spirit of the invention is more clear and convenient for managingSolution, is not meant to limit the present invention, all within the spirits and principles of the present invention, modification, replacement, the improvement made should allWithin the protection scope that appended claims of the invention is summarized.