Disclosure of Invention
The invention aims to provide a multi-interface display method and a multi-interface display system of motion trail information, aiming at overcoming the defects in the prior art, and solving the problem that the motion of writing needs to be captured by means of a camera device in the prior art.
In order to achieve the above object, in a first aspect, the present invention provides a method for displaying motion trail information in multiple interfaces, where the method includes:
each data acquisition device in the plurality of data acquisition devices acquires the lattice data of the lattice area passing through;
the data acquisition device sends the dot matrix data to a server;
the server receives the dot matrix data sent by each data acquisition device;
the server analyzes the dot matrix data to obtain a data acquisition device list corresponding to each data acquisition device; the data acquisition device list comprises MAC addresses of the data acquisition devices;
the server carries out structured storage on each data acquisition device list; the structured storage specifically includes a stroke list under each data acquisition device list; the stroke list comprises a stroke point list; the stroke point list comprises a page number ID of paper where each stroke is located, position coordinates of each stroke point, experienced by the stroke from a starting point to an end point, a time stamp of each stroke point and pressure-sensitive data of each stroke point;
the server sends the data acquisition device list, the stroke list and the stroke point list to a terminal;
the terminal receives a data acquisition device list, a stroke list and a stroke point list which are sent by the server;
the terminal sets sub-writing interfaces with the number not less than the number of the data acquisition device lists according to the number of the data acquisition device lists, and displays the sub-writing interfaces on the same screen according to the IDs of the sub-writing interfaces on the writing interface of the terminal; each sub-writing interface comprises a sub-writing interface ID corresponding to the MAC address;
and the terminal displays the motion track information of each data acquisition device on a corresponding sub-writing interface according to the stroke point list and the time stamp, the pressure data and the position coordinates of each stroke point.
In a possible implementation manner, the displaying, by the terminal, the motion trajectory information of each data acquisition device on the corresponding sub-writing interface according to the stroke point list and according to the timestamp, the pressure data, and the position coordinate of each stroke point specifically includes:
the terminal presents the dynamic process of the motion trail information on the sub-writing interface according to the time stamp and the position coordinate of each stroke point and the time sequence;
and in the dynamic process of presenting the motion trail information, the terminal presents the thickness of the motion trail information according to the pressure-sensitive data of each stroke point.
In a possible implementation manner, when displaying the trajectory information of each data acquisition device, the method further includes:
the terminal acquires a background picture corresponding to the page ID according to the page ID where the stroke is located;
and when the terminal displays the track information, displaying the background picture in each sub-writing interface according to the page number ID.
In one possible implementation, the sub-writing interface comprises a region position of the sub-writing interface and a sub-writing interface ID; and the ID of the sub-writing interface corresponds to the MAC address of the data acquisition device.
In one possible implementation, the method further includes:
and associating the MAC address of the data acquisition device, the ID of the sub-writing interface and the area position of the sub-writing interface to generate an association table.
In one possible implementation, the method further includes:
the terminal sets different background colors for the sub-writing interfaces according to the time stamp of each stroke; or,
and the terminal sets different background colors for the sub-writing interface according to the pressure bar pressure data of each stroke.
In one possible implementation, the method further includes:
and the exchanger receives the dot matrix data sent by the data acquisition device and forwards the dot matrix data to the server.
In a possible implementation manner, the writing interface of the terminal further includes a reserved writing interface;
and when the number of the data acquisition devices connected with the server is increased, displaying the increased motion trail information of the data acquisition devices on the reserved writing interface.
In one possible implementation, the method further includes:
the terminal is connected with projection equipment, and the projection equipment displays the motion trail information.
In a second aspect, the present invention provides a multi-interface display system for motion trail information, where the multi-interface display system for motion trail information includes the data acquisition device, the server, and the terminal described in the first aspect and any possible implementation manner of the first aspect.
Therefore, by the multi-interface display method and the multi-interface display system for the motion trail information, written motion trail information can be captured without additional camera equipment, and a plurality of pieces of motion trail information are displayed on the same screen in a multi-interface mode, so that a new mode is provided for classroom and classroom feedback.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terminal in the technical scheme of the invention comprises but is not limited to a desktop computer, a notebook computer, a tablet computer, a smart phone and the like.
Fig. 1 is a schematic flow chart of a multi-interface display method of motion trajectory information according to an embodiment of the present invention. As shown in fig. 1, the method comprises the steps of:
step 101, each data acquisition device of the plurality of data acquisition devices acquires dot matrix data of the passed dot matrix area.
And 102, the data acquisition device sends the dot matrix data to a server.
Specifically, the data acquisition device is a dot matrix digital pen with a dot matrix identification function, which is called a digital pen for short, and a pressure sensor, a processor, a camera, a memory, a communication module and the like are arranged in the digital pen.
After the pressure sensor receives the pressure signal, the camera is started, the camera is a high-speed camera, the dot matrix where the pen point passes can be photographed at the speed of 100 sheets per second, the X and Y coordinate values of the pen point in the writing process are recorded, and the position coordinate of each pen point is obtained, so that the accurate collection of the handwriting is realized. The processor will record a time stamp of the pen tip movement, the writing sequence and writing speed of each stroke point. Meanwhile, a pressure sensor arranged in the dot matrix digital pen can record the pressing force of a pen point to obtain pressure-sensitive data, and the pressure-sensitive data can be converted into the weight and thickness of the written strokes to be displayed in the subsequent process. Namely: acquiring and recording the writing structure and the stroke accurate position of the Chinese character based on micron-sized X and Y coordinates; acquiring and recording stroke sequence and speed of Chinese character writing based on coordinate points of the timestamp; and acquiring and recording the weight and thickness of the Chinese character stroke writing based on the pen point pressure sensor to obtain pressure sensing data. These position coordinates, pressure-sensitive data, velocity information, and the like are collectively referred to as dot matrix data.
Take writing a Chinese character "mountain" as an example.
First stroke of Chinese character "mountain": the pen-down and pen-up Penup of the middle vertical, and coordinate point coordinate information: including the serial number of the pen (i.e., the MAC address of the pen), the type, the timestamp of each stroke point, the serial number of each stroke point, the coordinate information of each stroke point, i.e., coordinate X, coordinate Y, the page ID of the paper, pressure data, etc.
The data is sent to the terminal equipment through the data interface in two modes, one mode is real-time sending, a processor arranged in the data acquisition device encodes the dot matrix data into a standard transmission data packet in real time, the MAC address of the data acquisition device is added to the packet head of the data packet, and then the data interface transmits the transmission data packet to the terminal equipment in real time in a wired or wireless mode.
The other is non-real time transmission, the processor encodes the dot matrix data into a standard transmission data packet in real time, adds the MAC address of the data acquisition device to the packet header of the data packet, then stores the data packet in the memory, and transmits the transmission data packet stored in the memory to the terminal equipment by the data interface at set time or in other non-real time modes. The data interface is a wired data interface or a wireless data interface; the wired data interface is a USB interface, a MiniUSB interface, a MicroUSB interface, a parallel port and a serial port; the wireless data interface is a Bluetooth interface, an infrared interface, a Wifi interface, a 2.4-5.0GHz band interface or a wireless communication interface.
The dot matrix region specifically includes: the electronic display board comprises writing paper with a dot matrix pattern, a white board with the dot matrix pattern and an electronic display screen for displaying the dot matrix pattern.
The dot matrix area is composed of a plurality of dots which are regularly arranged according to a special algorithm, as shown in fig. 2. For example, every 36 points, the arrangement is combined into a lattice. The average distance between the two points was 0.3 mm. The size of each lattice was 1.8mm by 1.8 mm. The lattice represents the special coordinate position information by a special coding mode.
Wherein, a common pdf electronic file (possibly printed with content information such as characters, pictures, tables and the like) is additionally laid with a layer of dot matrix background pattern on a ZBform form data acquisition platform through a special dot matrix laying interface, and then printed or printed. Therefore, when the digital pen is written on the paper, the related information of the dot matrix can be captured, so that accurate position information can be obtained, the dot matrix information laid on each page of paper is different, the serial numbers of the paper are different, and the switching and positioning between page numbers and even different readings can be realized.
When the dot matrix data are sent, a time stamp of sending time can be added to the dot matrix data, so that the synchronous processing of each data acquisition device can be conveniently carried out through the sending time stamp of each dot matrix data.
And 103, the server receives the dot matrix data sent by each data acquisition device.
104, analyzing the dot matrix data by the server to obtain a data acquisition device list corresponding to each data acquisition device; the data acquisition device list includes MAC addresses of the data acquisition devices.
The data acquisition device acquires the dot matrix data on more than one page of the dot matrix paper, so that the data acquisition device can send each page number ID during writing to the server.
105, the server carries out structured storage on each data acquisition device list; the structured storage specifically comprises a stroke list under each data acquisition device list; the stroke list comprises a stroke point list; the stroke point list includes a page number ID of a sheet on which each stroke is located, position coordinates of each stroke point that the stroke passes from a start point to an end point, a time stamp of each stroke point, and pressure-sensitive data of each stroke point.
Fig. 3 is a schematic diagram of a structured storage according to an embodiment of the present invention. Referring to fig. 3, the data acquisition device is illustrated as a digital pen. The server stores a digital pen list corresponding to each digital pen, the digital pen list comprises MAC addresses of the digital pens, the digital pen list corresponds to a plurality of stroke lists, namely each stroke corresponds to one stroke list, and the digital pen list corresponds to one stroke point list, namely all stroke points forming the stroke. The stroke point list includes information such as position coordinates, time stamps, and pressure data of each stroke point. Therefore, the information under the digital pen can be classified through structured storage. The stroke list and the stroke point list under the digital pen list can be conveniently and quickly inquired through the digital pen list.
The MAC represents an MAC address, stroke is a stroke, Page ID is a Page ID, Dot is an origin, X is a position coordinate, an X-axis coordinate of a stroke point, Y is a Y-axis coordinate of the stroke point in the position coordinate, Timestamp is a Timestamp, and Press is pressure data.
Step 106, the server sends the data acquisition device list, the stroke list and the stroke point list to the terminal;
step 107, the terminal receives a data acquisition device list, a stroke list and a stroke point list which are sent by the server;
108, the terminal sets sub-writing interfaces with the number not less than the number of the data acquisition device lists according to the number of the data acquisition device lists, and displays a plurality of sub-writing interfaces on the same screen according to the IDs of the sub-writing interfaces on the writing interfaces of the terminal; each sub-writing interface comprises a sub-writing interface ID corresponding to the MAC address;
the sub-writing interface comprises a region position of the sub-writing interface and a sub-writing interface ID; the sub-writing interface ID corresponds to the MAC address of the data acquisition device.
The terminal has a writing interface. The writing interface can be divided into a plurality of sub-areas according to the number of the digital pen lists, and each sub-area is a sub-writing interface. Each sub-writing interface has an ID different from the IDs of other sub-writing interfaces, and the IDs correspond to the MAC addresses in the digital pen list one by one. The range of each sub-writing interface can be represented by coordinates in the image coordinate system. By way of example and not limitation, when the sub-writing interface is a rectangle, the extent of the sub-writing interface may be represented by coordinates of four corner points of the rectangle.
For example, if the number of the data acquisition device list is 10, the number of the MAC addresses is 10, and at this time, the writing interface of the terminal may be divided into 10 sub-writing interfaces.
Further, the writing interface of the terminal also comprises a reserved writing interface;
and when the number of the data acquisition devices connected with the server is increased, displaying the motion trail information of the increased data acquisition devices on the reserved writing interface.
It can be understood that the number of the sub-writing interfaces may also be greater than 10, so that the sub-writing interfaces are reserved in the terminal for the subsequently accessed data acquisition devices, so that subsequent redistribution is not required, and the motion trajectory information of the subsequently accessed data acquisition devices in the server can be directly displayed in the reserved sub-writing interfaces.
After step 108, further comprising:
and associating the MAC address of the data acquisition device, the ID of the sub-writing interface and the area position of the sub-writing interface to generate an association table.
Specifically, an association table is generated on the terminal, and the association table includes the ID of the sub-writing interface, the shape of the sub-writing interface, the coordinates of each corner point corresponding to the shape of the sub-writing interface, and the MAC address of the data acquisition device. Therefore, when the plurality of sub-writing interfaces are displayed on the same screen on the writing interface on the terminal next time, the sub-writing interfaces do not need to be re-distributed, and the association table is called.
For example, when the method is applied to classroom teaching, the number of people on a class is determined, after writing track information of all students is displayed for the first time, the association table can be called in subsequent display, and the previous association table can be called quickly without redistributing sub-writing interfaces, so that the writing track information of the students is displayed.
In one example, the teacher prints a plurality of prepared electronic courseware after rasterization by the ZBform form data acquisition platform, for example, 50 paper documents, gives the documents to each student in the class, and simultaneously allocates a dot matrix digital pen to each student. When all students write on respective paper courseware, the teacher can display the content of writing on the paper courseware of each student through projection at the teaching end program, and the writing progress of each person is different, and the writing display interface shows the writing progress of different pages.
And step 109, the terminal displays the motion track information of each data acquisition device on the corresponding sub-writing interface according to the stroke point list and the time stamp, the pressure data and the position coordinates of each stroke point.
Specifically, step 109 includes: the terminal presents the dynamic process of the motion trail information on the sub-writing interface according to the time stamp and the position coordinate of each stroke point and the time sequence;
and in the dynamic process of presenting the motion trail information, the terminal presents the thickness of the motion trail information according to the pressure-sensitive data of each stroke point.
In another example, when applying the system to classroom feedback, students have previously obtained a standardized uniform style paper feedback or answer sheet with a dot matrix background, with different location areas of the feedback or answer sheet representing different business meanings, such as to check a specific location representation A, B, C, D or to select or cancel. (this process is accomplished through the "form design" function of the ZDeform form data collection platform).
When each student checks or answers at a specific position on the paper, the writing display interface of each student captures respective writing handwriting, the handwriting recognition is carried out through the ZDeform form data acquisition platform, and after data model conversion, a feedback result or a test result is presented at the application display end in time.
Further, when step 109 is executed, the method further includes:
the terminal acquires a background picture corresponding to the page ID according to the page ID where the stroke is located;
and when the terminal displays the track information, displaying a background picture in each sub-writing interface according to the page number ID.
Specifically, referring to fig. 4 and 5, fig. 4 is a schematic diagram of a pdf file and a lattice according to an embodiment of the present invention. Fig. 5 is a schematic diagram of page IDs according to an embodiment of the present invention.
On a ZDef platform, a pdf file is uploaded, and the platform can intelligently process the file, namely, a layer of background pattern with a dot matrix is laid on the file. The pdf file is, by way of example and not limitation, a background picture, which may be a picture with various colors, or a picture with a logo, such as a watermark logo of "xx test questions", and the shape, color, and format of the background picture are not limited in the present application, and can be set by a person skilled in the art as needed.
Since the dot matrix background pattern of each page is unique, namely, there is a page number ID, namely, PageID, for example: 1536.667.65.81.
on the ZDef platform, the pdf files and the PageIDs are in one-to-one correspondence.
Therefore, by calling the PageID, the terminal can obtain a background picture of a certain page corresponding to the pdf file, and the background picture can be displayed as a background of the motion trail information when displaying the motion trail information. Therefore, each sub-writing interface on the terminal has different background pictures according to different page number IDs.
Further, the server stores the motion track information and the page number of each data acquisition device according to the MAC address of the data acquisition device.
Therefore, the motion track information and the page number of the data acquisition devices are stored, and the data acquisition devices are convenient to use in offline display.
Further, when step 109 is executed, the method further includes:
the terminal sets different background colors for the sub-writing interface according to the time stamp of each stroke; or,
and the terminal sets different background colors for the sub-writing interface according to the pressure data of each stroke.
According to the received sequence of the track information sent by the server, different backgrounds can be set for the sub-writing interfaces, so that which data acquisition device writes first can be known through the backgrounds.
Or different backgrounds are set according to the size of the pressure-sensitive data, so that the writing strength of the data acquisition device is high. Subsequently, the personnel corresponding to the data acquisition device with too large or too small writing force can be reminded to correct the bad writing habit.
Further, after step 109, the method further includes:
the terminal is connected with the projection equipment, and the projection equipment displays the motion trail information.
The terminal can also be connected with other terminals, such as a computer of an education supervisor, so that the classroom interaction can be evaluated conveniently.
Specifically, other terminals evaluate the classroom according to the fluency and speed of writing track information.
Therefore, by the multi-interface display method of the motion trail information, provided by the embodiment of the invention, the written motion trail information can be captured without an additional camera device, and a plurality of pieces of motion trail information are displayed on the same screen and the multiple interfaces, so that a new form is provided for classroom and classroom feedback.
It will be appreciated that the method may also be applied in other fields, such as hospitals, civil authorities, delivery authorities, etc., for example, a form of an outpatient list for outpatient registration information in a hospital includes a plurality of entries, for example, the entry contents include: patient name, gender, age, occupation, contact details, etc. When the form is printed into the dot matrix paper, the content of the table entries filled in the dot matrix paper is finally displayed on the terminal of the medical staff, and subsequently, the content of the form can be directly stored without being input on the terminal again, so that the input efficiency is improved.
Fig. 6 is a schematic structural diagram of a multi-interface display system of motion trajectory information according to a second embodiment of the present invention. The system is applied to a multi-interface display method of motion trail information, as shown in fig. 6, the multi-interface display system 600 of motion trail information includes: a plurality of data acquisition devices 1, a server 2 and a terminal 3.
The data acquisition devices 1, the server 2 and the terminal 3 perform the same operations as in the first embodiment, and are not described herein again.
Therefore, the multi-interface display system of the motion trail information provided by the embodiment of the invention can capture the written motion trail information without additional camera equipment, and display a plurality of motion trail information on the same screen and multiple interfaces, thereby providing a new form for classroom and classroom feedback.
Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied in hardware, a software module executed by a processor, or a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The above embodiments are provided to further explain the objects, technical solutions and advantages of the present invention in detail, it should be understood that the above embodiments are merely exemplary embodiments of the present invention and are not intended to limit the scope of the present invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.