Movatterモバイル変換


[0]ホーム

URL:


CN116089660A - Data storage method of monitoring system - Google Patents

Data storage method of monitoring system
Download PDF

Info

Publication number
CN116089660A
CN116089660ACN202310251779.3ACN202310251779ACN116089660ACN 116089660 ACN116089660 ACN 116089660ACN 202310251779 ACN202310251779 ACN 202310251779ACN 116089660 ACN116089660 ACN 116089660A
Authority
CN
China
Prior art keywords
category
reserved
similarity
band
height
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202310251779.3A
Other languages
Chinese (zh)
Other versions
CN116089660B (en
Inventor
刘敏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Ruidao Network Technology Co ltd
Original Assignee
Xi'an Zhongchuang Boyuan Network Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xi'an Zhongchuang Boyuan Network Technology Co ltdfiledCriticalXi'an Zhongchuang Boyuan Network Technology Co ltd
Priority to CN202310251779.3ApriorityCriticalpatent/CN116089660B/en
Publication of CN116089660ApublicationCriticalpatent/CN116089660A/en
Application grantedgrantedCritical
Publication of CN116089660BpublicationCriticalpatent/CN116089660B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Images

Classifications

Landscapes

Abstract

The invention relates to the field of data processing for data storage, and provides a data storage method of a monitoring system, which comprises the following steps: acquiring height information and various wave band data of different positions of a crop growing area; clustering the height information of different positions to obtain a plurality of first categories; acquiring reserved bands according to the entropy values of each band data in different first categories and the first similarity between the category heights; performing factor analysis on the reserved wave band to obtain the high correlation degree of the reserved wave band; obtaining second similarity among different positions according to band data of each position in different reserved bands to obtain a plurality of second categories, and re-clustering the first categories and the second categories to obtain a third category; and respectively compressing and storing the monitoring data in each third category. The present invention aims to improve the efficiency of compressed storage by mining correlations in monitoring data.

Description

Data storage method of monitoring system
Technical Field
The invention relates to the field of data processing for data storage, in particular to a data storage method of a monitoring system.
Background
The monitoring system is widely used in the fields of agricultural production, industrial processing and the like, the monitoring system acquires data of things to be monitored in various aspects under different time through various sensors, and meanwhile, the monitoring system generally monitors a large number of things to be monitored, so that the data size of monitoring data obtained by the monitoring system is extremely large, and the monitoring data needs to be compressed in the storage process of a server.
The existing monitoring system generally adopts a traditional compression method to compress the monitoring data without considering the correlation existing between the monitoring data; because the monitoring data are obtained by monitoring a large number of things to be monitored in various aspects for a long time, a large number of monitoring data with similar states exist, namely, the monitoring data have relevance; therefore, the monitoring data with similar states are required to be determined according to the similarity between the data in the monitoring data in various aspects, the correlation between the monitoring data is obtained by deep mining of the data, and then the monitoring data with similar states is compressed, so that the compression efficiency of the monitoring data is improved.
Disclosure of Invention
The invention provides a data storage method of a monitoring system, which aims to solve the problem of low compression and storage efficiency of existing crop growth monitoring data, and adopts the following technical scheme:
one embodiment of the present invention provides a data storage method of a monitoring system, the method comprising the steps of:
acquiring height information of each position in a crop growing area, and acquiring various wave band data;
clustering is carried out according to the height information of different positions, and a plurality of first categories and category heights are obtained;
the method comprises the steps of carrying out ascending arrangement on class heights of a plurality of first classes to obtain class height sequences, obtaining entropy value sequences of each wave band according to various wave band data and the first classes and the class heights, obtaining first similarity of each wave band according to the entropy value sequences and the class height sequences, and obtaining reserved wave bands according to the first similarity;
factor analysis is carried out on each reserved wave band in each first category to obtain the height characteristic duty ratio of each reserved wave band, and the height correlation degree of each reserved wave band is obtained according to the height characteristic duty ratio of each reserved wave band and the corresponding first similarity;
obtaining second similarity of position pairs formed by any two positions according to the band data of each position in different reserved bands, classifying the positions according to the second similarity to obtain a plurality of second categories, superposing the first category corresponding areas and the second category corresponding areas, obtaining a clustering center according to the ratio of the superposed intersection to the union, taking the ratio of the number of the intersection to the number of the first category elements as a first weight value of a height difference value between the positions, taking the ratio of the number of the intersection to the number of the second category elements as a second weight value of the second similarity between the positions, taking the weighted sum result of the height difference value between the positions and the second similarity as a clustering distance, and clustering to obtain a plurality of third categories according to the clustering center and the clustering distance;
and respectively compressing and storing the acquired monitoring data in each third category.
Optionally, the obtaining the plurality of first categories and the category heights includes the following specific methods:
clustering the different positions according to the height information, wherein the clustering distance is the difference value of the height information among the different positions, the clustering result comprises a plurality of categories, each category is a height category, the height category is marked as a first category, the average value of all the height information in each first category is calculated as the average height, and the average height is marked as the category height.
Optionally, the method for obtaining the entropy value sequence of each band includes the following specific steps:
each first class corresponds to one region in each wave band data, and the information entropy of the wave band data at all positions in each region is used as the entropy value of the corresponding wave band data in the corresponding first class;
obtaining entropy values of each band data in different first categories, and arranging the entropy values according to ascending order of heights of the first categories corresponding to the categories to obtain entropy value sequences of each band.
Optionally, the method for obtaining the first similarity of each band according to the entropy sequence and the class height sequence includes the following specific steps:
Figure SMS_1
wherein ,
Figure SMS_2
represent the first
Figure SMS_3
A first degree of similarity of the seed bands,
Figure SMS_4
represent the first
Figure SMS_5
The sequence of entropy values of the seed band,
Figure SMS_6
the sequence of class heights is represented by a sequence of class heights,
Figure SMS_7
a cosine similarity calculation function representing the two sequences.
Optionally, the method for acquiring the height characteristic duty ratio of each reserved band includes the following specific steps:
Figure SMS_8
wherein ,
Figure SMS_9
represent the first
Figure SMS_10
The height characteristic duty cycle of the individual reserved bands,
Figure SMS_11
the number of the first category is indicated,
Figure SMS_12
represent the first
Figure SMS_13
The reserved wave band is at the first
Figure SMS_14
The method for calculating the high correlation characteristic duty ratio in the first category comprises the following steps:
Figure SMS_15
wherein ,
Figure SMS_16
the entropy value of the common factor vector obtained for the factor analysis,
Figure SMS_17
obtained for factor analysis
Figure SMS_18
The reserved wave band is at the first
Figure SMS_19
Entropy values of the special factor vectors corresponding to the reserved vectors formed in the first category.
Optionally, the method for obtaining the high correlation degree of each reserved band includes the following specific steps:
Figure SMS_20
wherein ,
Figure SMS_22
represent the first
Figure SMS_28
The degree of high correlation of the individual reserved bands,
Figure SMS_29
represent the first
Figure SMS_23
The height characteristic duty cycle of the individual reserved bands,
Figure SMS_25
represent the first
Figure SMS_26
A first degree of similarity of the reserved bands,
Figure SMS_27
indicating the high of all reserved bandsThe maximum value of the product of the degree characteristic and the first similarity,
Figure SMS_21
representing the height characteristic duty cycle of each reserved band,
Figure SMS_24
representing a first similarity for each reserved band.
Optionally, the obtaining the second similarity of the position pair formed by any two positions includes the following specific methods:
Figure SMS_30
wherein ,
Figure SMS_32
represent the first
Figure SMS_35
A second degree of similarity for the pairs of positions,
Figure SMS_36
representing sharing of
Figure SMS_33
The number of reserved bands of wavelengths,
Figure SMS_37
represent the first
Figure SMS_38
The position pairs are at the first
Figure SMS_39
The band similarity in the band is preserved,
Figure SMS_31
represent the first
Figure SMS_34
The height correlation degree of each reserved wave band;
the band similarity is at the first position through two positions
Figure SMS_40
And obtaining the ratio between the band data in the reserved bands.
Optionally, the classifying the different positions according to the second similarity to obtain a plurality of second categories includes the following specific methods:
according to the obtained second similarity of all the position pairs, a second similarity sequence is obtained according to descending order, the number of the position pairs corresponding to different second similarities is counted, the second similarity with the number closest to the number of the first similarities is selected, and each corresponding position pair is used as an initial second category respectively;
and respectively calculating the positions which are not divided into any second category, and the average value of the second similarity between the positions in each second category, and taking the second category corresponding to the maximum value obtained by each position as the second category to which each position belongs.
Compared with the prior art, the invention has at least the following beneficial effects: the heights of crops are the same and are only sufficient conditions in the same growth stage, but not necessary conditions, the precision of the correlation degree of each calculated wave band data and the height information is higher by calculating the wave band data which are highly similar to the types and combining the height characteristic duty ratio in each wave band data, the first types obtained by the height clustering are reclustered according to the precision, the crop types divided according to the growth stages are obtained with higher precision, and the type data corresponding to each growth stage are respectively compressed and stored; meanwhile, if new data are generated, the new data are only required to be classified and stored according to the similarity relation between the new data and the existing category; by taking monitoring data of crops as an example, the monitoring data of the crops in different aspects are clustered according to the correlation among the characteristics, and then the corresponding category data are compressed and stored.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the description below are only some embodiments of the invention, and that other drawings can be obtained according to these drawings without inventive faculty for a person skilled in the art.
Fig. 1 is a flow chart of a data storage method of a monitoring system according to an embodiment of the invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1, a flowchart of a data storage method of a monitoring system according to an embodiment of the invention is shown, the method includes the following steps:
and S001, acquiring the height information of each position in the crop growing area and various wave band data.
The purpose of the embodiment is to extract the correlation of crop monitoring data through data mining, so as to realize analysis of the growth stage of crops, and further compress and store the monitoring data of the growth stage with stronger correlation; therefore, laser radar point cloud data of a crop growing area are acquired through the high-precision laser radar to obtain the height information of each position in the crop growing area.
It should be further noted that, the growth of crops is often affected by different hormones, such as nitrogen, chlorophyll, etc., the band data corresponding to the different hormones are often different, and the difference of the hormones also causes the difference of the heights of the crops; therefore, the wave band data corresponding to different hormones are required to be acquired, and various wave band data are obtained.
Step S002, clustering the height information of different positions to obtain a plurality of first categories.
K-means clustering is carried out on different positions according to the height information,in the present embodiment
Figure SMS_41
The value of (2) is set to 9, the clustering distance is the difference value of the height information between different positions according to the implementation scene, the clustering result comprises a plurality of categories, the clustering result is expressed as a plurality of first category areas in the growing area of crops, the height information of different positions in the same category is similar, the difference of the height information of different positions among different categories is larger, each category is a height category, the height category is marked as a first category, the average value of all the height information in each first category is calculated as the average height, and the average height is marked as the category height.
Step S003, a reserved band is obtained according to the first similarity between the entropy value of each band data in different first categories and the category height.
For the same crop, the same high probability of the height information belongs to the same growth stage, but the height information does not necessarily belong to the same growth stage, namely the same height information is only a sufficient condition of the same growth stage but not a necessary condition, so that the crops with the same height information also need to be further analyzed to obtain the commonalities of the crops, further corresponding band data are obtained, the similarity of the band data and the height information is large, and the band data are obtained by calculating the similarity of the band data and the class heights in different first classes.
The obtained class heights are arranged in ascending order from small to large to obtain a class height sequence, and the corresponding first classes are also ordered in the same order, wherein each first class contains all band data; each first class corresponds to a region in each wave band data, and the information entropy of the wave band data at all positions in each region is used as the entropy value of the corresponding wave band data in the corresponding first class; calculating entropy values of each band data in different first categories, arranging according to the arrangement sequence of the first categories to obtain an entropy value sequence, and calculating cosine similarity between the entropy value sequence and the category height sequence to obtain first similarity corresponding to each band data.
Specifically, by the first
Figure SMS_42
For example, the first similarity of the band data is calculated
Figure SMS_43
The method of (1) is as follows:
Figure SMS_44
wherein ,
Figure SMS_45
represent the first
Figure SMS_46
The sequence of entropy values of the seed band data,
Figure SMS_47
the sequence of class heights is represented by a sequence of class heights,
Figure SMS_48
a cosine similarity calculation function representing two sequences; at this time, the first
Figure SMS_49
The greater the first similarity of the seed wave band data, the greater the correlation between the information of the seed wave band data and the height information of crops, and the more the seed wave band data needs to be reserved as the wave band data mutually verified with the height information; and the smaller the first similarity, the smaller the correlation between the information of the band data and the crop height information, and the smaller the necessity of the band data as mutually authenticated with the height information.
Further, according to the above method, a first similarity of each band data is obtained, and a first preset threshold is given
Figure SMS_50
For judging the correlation between the band data and the height information, the first preset threshold value in this embodiment is adopted
Figure SMS_51
Calculating, and taking the band data with the first similarity larger than a first preset threshold value as a reserved band; it should be noted that the reserved bands are independent of the first class, that is, all the first classes include a reserved band, and the reserved bands in all the first classes are the same.
And S004, performing factor analysis on each reserved wave band to obtain the high correlation degree of each reserved wave band.
It should be noted that the reserved bands are obtained through calculation of all first categories, and then the correlation degree of each reserved band and the height information is obtained through extraction of the commonality characteristics of the reserved bands in the first categories; each first category not only contains information related to the height, but also contains other information, so that the commonality characteristic of reserved wave bands is required to be calculated, the commonality of the reserved wave bands, namely the correlation between reserved wave bands and the height is large, and the extracted commonality reflects the height related characteristic in the wave band data; and calculating the duty ratio of the highly relevant features in each reserved wave band, and combining the first similarity of the reserved wave bands to further obtain the degree of correlation between each reserved wave band and the height information.
Specifically, the height characteristic duty ratio of each reserved wave band is obtained through a factor analysis method, wherein the factor analysis is a method capable of extracting common characteristics and special characteristics of a plurality of vectors; converting the band data of each reserved band in all positions in each first class corresponding region into a vector form in a line-by-line end-to-end connection mode, namely a reserved vector, and taking the reserved vector as input of factor analysis, wherein factor analysis output obtains a common factor vector and a special factor vector which corresponds to the reserved vector one by one, and the common factor vector represents common characteristics of input vectors, namely highly relevant characteristics; and calculating the duty ratio of the common factor vector for each input reserved vector, namely, calculating the duty ratio of the highly relevant feature, and then calculating the average value of the highly relevant feature duty ratio of the reserved vector of each first class for a certain reserved wave band, namely, the height feature duty ratio of the corresponding reserved wave band.
Specifically, by the first
Figure SMS_52
For example, the reserved band is calculated to be at the first
Figure SMS_53
Highly correlated feature duty cycle in a first category
Figure SMS_54
The method of (1) is as follows:
Figure SMS_55
wherein ,
Figure SMS_56
the entropy value of the common factor vector obtained for the factor analysis,
Figure SMS_57
obtained for factor analysis
Figure SMS_58
The reserved wave band is at the first
Figure SMS_59
Entropy values of special factor vectors corresponding to the reserved vectors formed in the first categories; the calculation process of the entropy value of the common factor vector comprises the following steps: rounding each element in the vector to form an integer sequence, and then calculating the entropy value of the integer sequence, wherein the calculation method of the entropy value of the special factor vector is the same.
Further, according to the first
Figure SMS_60
The duty cycle of the highly correlated features of each reserved band in all the first categories yields the duty cycle of the highly correlated features of the reserved band
Figure SMS_61
The calculation method of (1) is as follows:
Figure SMS_62
wherein ,
Figure SMS_63
the number of the first category is indicated,
Figure SMS_64
represent the first
Figure SMS_65
The reserved wave band is at the first
Figure SMS_66
Highly correlated feature duty cycles in the first category.
Further, the height correlation degree of each reserved wave band is obtained according to the obtained height characteristic duty ratio of the reserved wave band and the first similarity, so as to
Figure SMS_67
For example, a reserved band, the degree of correlation is high
Figure SMS_68
The calculation method of (1) is as follows:
Figure SMS_69
wherein ,
Figure SMS_70
represent the first
Figure SMS_73
The height characteristic duty cycle of the individual reserved bands,
Figure SMS_75
represent the first
Figure SMS_71
First similarity of each reserved band, and first similarity of each acquired band
Figure SMS_77
The product can be obtained by the method,
Figure SMS_78
representing the height characteristic duty cycle of each reserved band,
Figure SMS_79
representing a first similarity for each reserved band,
Figure SMS_72
representing the maximum value of the product of the height characteristic duty ratio of all the reserved wave bands and the first similarity, and using the maximum value for normalization processing; at this time, the first
Figure SMS_74
Height characteristic duty cycle of each reserved band
Figure SMS_76
The larger the first similarity is, the larger the common characteristic between the band data of the reserved band and the crop height information is, the characteristic duty ratio of the height information in each band is obtained through factor analysis, only the height characteristics in the reserved band are saved, other characteristics are ignored, and the correlation between the band data and the crop height information is better verified by combining the first similarity; and obtaining the height correlation degree of all the reserved wave bands according to the calculation method, wherein the height correlation degree is used for reflecting the common characteristic duty ratio of the reserved wave bands and the height information in the first class.
Step S005, obtaining second similarity between different positions according to the band data of each position in different reserved bands, obtaining a plurality of second categories according to the second similarity, and re-clustering through the first category and the second category to obtain a third category.
It should be noted that, the first category is clustering according to the height of the crops, at this time, the common characteristic duty ratio between the reserved waveband and the height information is obtained, the second category classified according to the waveband data information is obtained according to the common characteristic, and then clustering is performed again according to the superposition intersection expression of the first category region and the second category region, so as to improve the classification accuracy between the growth monitoring data corresponding to each category.
In particular, when it is reservedAfter the high correlation degree of the wave bands, acquiring a plurality of wave band data of each same position in different reserved wave bands, and analyzing the similarity of the wave band data of different positions in each reserved wave band to further obtain a second similarity; it should be noted that the same position may form different position pairs with any other different positions; in the first place
Figure SMS_80
For example, a second similarity of position pairs
Figure SMS_81
The calculation method of (1) is as follows:
Figure SMS_82
wherein ,
Figure SMS_85
representing sharing of
Figure SMS_87
The number of reserved bands of wavelengths,
Figure SMS_88
represent the first
Figure SMS_83
The position pairs are at the first
Figure SMS_86
Band similarity in the reserved bands, at the first two positions
Figure SMS_89
The ratio of the band data in the reserved bands is obtained, the ratio numerator is smaller band data, the denominator is larger band data,
Figure SMS_90
is the first
Figure SMS_84
The degree of high correlation of the bands is preserved.
Further, the method comprises the steps of,according to the obtained second similarity of all the position pairs, keeping a decimal place of the obtained second similarity, obtaining a second similarity sequence according to descending order, counting the number of the position pairs corresponding to different second similarities, and selecting the number and the first category number
Figure SMS_91
The nearest second similarity, each corresponding position pair is respectively taken as the initial second category and is shared by
Figure SMS_92
And the second categories are respectively used for calculating the average value of the second similarity between each position which is not divided into any second category and all the positions in each second category, and the second category corresponding to the maximum value obtained by each position is used as the second category to which the position belongs.
It should be noted that the closest is selected
Figure SMS_93
Number of (3)
Figure SMS_94
The corresponding position pairs serve as initial second categories, namely, the first category obtained by clustering the crop heights and the second category obtained by calculating the reserved wave bands can represent the growth categories, but errors exist, so that the most accurate positions belonging to the same growth category are obtained through mutual verification of two types of data, then the positions are used as initial clustering centers for re-clustering, a third category with higher accuracy and smaller errors is obtained, and therefore, in order to reduce the calculated amount, the nearest type is selected
Figure SMS_95
Number of (3)
Figure SMS_96
The corresponding pair of locations serves as the initial second category.
Further, at this time, all positions in the data of different wave bands have been clustered to obtain a first category and classified to obtain a second category,overlapping the corresponding region of the first category in each reserved wave band with the corresponding region of the second category in each reserved wave band to obtain an intersection of the first category and the second category, wherein the first category is
Figure SMS_97
The method for judging the area center of the intersection set as the reclustering center point by taking the intersection set as an example comprises the following steps:
Figure SMS_98
wherein ,
Figure SMS_99
for the duty cycle between the intersection and the corresponding union,
Figure SMS_102
the intersection portion is represented by a representation of the intersection,
Figure SMS_105
for the first category of the parts,
Figure SMS_101
for the second category of parts,
Figure SMS_103
i.e. the part of the union that is sought for
Figure SMS_104
Greater than a second preset threshold
Figure SMS_106
Is retained, the second preset threshold value of the embodiment adopts
Figure SMS_100
And (4) calculating, wherein the central point of the intersection area is used as a clustering central point of the reclustering.
It should be further noted that, in the process of calculating the clustering center, the height difference information and the second similarity information of two positions are referred to at the same time, so that different weights are respectively given. Specifically, still by the first
Figure SMS_107
By way of example, the first
Figure SMS_108
Clustering distance of individual position pairs
Figure SMS_109
The calculation method of (1) is as follows:
Figure SMS_110
wherein ,
Figure SMS_111
i.e., the duty ratio of the intersection in the corresponding first category, i.e., the element number duty ratio, as a first weight value of the altitude difference information,
Figure SMS_112
is the first
Figure SMS_113
The height difference between the pairs of positions is obtained from the areas of the first category corresponding to the different reserved bands,
Figure SMS_114
for the duty ratio of the intersection in the corresponding second category, the duty ratio is the element number duty ratio, and is taken as a second weight value of the second similarity,
Figure SMS_115
is the first
Figure SMS_116
A second similarity between pairs of positions. At this time, when the first category and the second category are superimposed to generate an intersection, the larger the ratio of the intersection in the first category and the second category is, the higher the initial precision of the third category expressed by the corresponding category is, and the higher the reliability is; and obtaining the clustering distance between the two positions according to the method.
Further, the obtained gathers according to the intersection regionClass center point, and cluster distance between locations
Figure SMS_117
Reclustering the positions by adopting a K-means clustering method, wherein
Figure SMS_118
The value is still the same as the number of the first category, i.e. using
Figure SMS_119
And calculating, wherein the obtained clustering results are recorded as a plurality of third categories.
And step S006, respectively compressing and storing the acquired monitoring data in each third category.
Respectively compressing and storing the acquired data in each third category, wherein the data in the third category comprises growth monitoring data of the same crop in the same growth stage, and on one hand, the similarity between the data in the same third category is larger; on the other hand, the data are compressed and stored according to the third category, and if new data are generated, the data are classified and stored only according to the similarity relation between the new data and the existing category; the compressed storage method of each third category can be compressed by using a huffman coding compression method or a run-length coding compression method.
Therefore, compression storage of the monitoring data is completed, correlation between height information and band data among crops at different positions is analyzed through data mining, then crops with similar growth states are obtained through clustering, the monitoring data of the crops with similar growth states are compressed and stored, and compression efficiency of the monitoring data in compression storage is improved.
It should be noted that, in this embodiment, the band data is obtained by performing hyperspectral detection on a growing area of a crop, each channel in the obtained hyperspectral image is one band data, the data of each pixel point in each channel in the hyperspectral image is the band data of each position in each band data, and each pixel point in the hyperspectral image corresponds to each position in the growing area, so each position corresponds to one height information and multiple band data.
The foregoing description of the preferred embodiments of the invention is not intended to be limiting, but rather is intended to cover all modifications, equivalents, alternatives, and improvements that fall within the spirit and scope of the invention.

Claims (8)

1. A method of data storage for a monitoring system, the method comprising the steps of:
acquiring height information of each position in a crop growing area, and acquiring various wave band data;
clustering is carried out according to the height information of different positions, and a plurality of first categories and category heights are obtained;
the method comprises the steps of carrying out ascending arrangement on class heights of a plurality of first classes to obtain class height sequences, obtaining entropy value sequences of each wave band according to various wave band data and the first classes and the class heights, obtaining first similarity of each wave band according to the entropy value sequences and the class height sequences, and obtaining reserved wave bands according to the first similarity;
factor analysis is carried out on each reserved wave band in each first category to obtain the height characteristic duty ratio of each reserved wave band, and the height correlation degree of each reserved wave band is obtained according to the height characteristic duty ratio of each reserved wave band and the corresponding first similarity;
obtaining second similarity of position pairs formed by any two positions according to the band data of each position in different reserved bands, classifying the positions according to the second similarity to obtain a plurality of second categories, superposing the first category corresponding areas and the second category corresponding areas, obtaining a clustering center according to the ratio of the superposed intersection to the union, taking the ratio of the number of the intersection to the number of the first category elements as a first weight value of a height difference value between the positions, taking the ratio of the number of the intersection to the number of the second category elements as a second weight value of the second similarity between the positions, taking the weighted sum result of the height difference value between the positions and the second similarity as a clustering distance, and clustering to obtain a plurality of third categories according to the clustering center and the clustering distance;
and respectively compressing and storing the acquired monitoring data in each third category.
2. The method for storing data in a monitoring system according to claim 1, wherein the obtaining a plurality of first categories and category heights comprises the following specific steps:
clustering the different positions according to the height information, wherein the clustering distance is the difference value of the height information among the different positions, the clustering result comprises a plurality of categories, each category is a height category, the height category is marked as a first category, the average value of all the height information in each first category is calculated as the average height, and the average height is marked as the category height.
3. The method for storing data in a monitoring system according to claim 1, wherein the step of obtaining the entropy sequence of each band comprises the following specific steps:
each first class corresponds to one region in each wave band data, and the information entropy of the wave band data at all positions in each region is used as the entropy value of the corresponding wave band data in the corresponding first class;
obtaining entropy values of each band data in different first categories, and arranging the entropy values according to ascending order of heights of the first categories corresponding to the categories to obtain entropy value sequences of each band.
4. The method for storing data in a monitoring system according to claim 1, wherein the obtaining the first similarity of each band according to the entropy sequence and the class height sequence comprises the following specific steps:
Figure QLYQS_1
wherein ,
Figure QLYQS_2
represent the first
Figure QLYQS_3
First similarity of seed band,/I>
Figure QLYQS_4
Indicate->
Figure QLYQS_5
Entropy sequence of seed band,/->
Figure QLYQS_6
Representing class height sequence,/->
Figure QLYQS_7
A cosine similarity calculation function representing the two sequences.
5. The method for storing data in a monitoring system according to claim 1, wherein the step of obtaining the height characteristic duty ratio of each reserved band comprises the following specific steps:
Figure QLYQS_8
wherein ,
Figure QLYQS_9
indicate->
Figure QLYQS_10
Height characteristic ratio of each reserved band, < ->
Figure QLYQS_11
Representing the number of first categories, +.>
Figure QLYQS_12
Indicate->
Figure QLYQS_13
The reserved band is at->
Figure QLYQS_14
The method for calculating the high correlation characteristic duty ratio in the first category comprises the following steps: />
Figure QLYQS_15
wherein ,
Figure QLYQS_16
entropy value of common factor vector obtained for factor analysis,/->
Figure QLYQS_17
The +.>
Figure QLYQS_18
The reserved band is at->
Figure QLYQS_19
Entropy values of the special factor vectors corresponding to the reserved vectors formed in the first category.
6. The method for storing data in a monitoring system according to claim 1, wherein the step of obtaining the degree of high correlation of each reserved band comprises the following specific steps:
Figure QLYQS_20
wherein ,
Figure QLYQS_23
indicate->
Figure QLYQS_25
A high degree of correlation of the reserved bands, +.>
Figure QLYQS_28
Indicate->
Figure QLYQS_21
The height characteristic duty cycle of the individual reserved bands,
Figure QLYQS_26
indicate->
Figure QLYQS_27
First similarity of reserved bands, < >>
Figure QLYQS_29
Maximum value representing the product of the height characteristic ratio of all reserved bands and the first similarity, +.>
Figure QLYQS_22
Height characteristic ratio representing each reserved band, +.>
Figure QLYQS_24
Representing a first similarity for each reserved band.
7. The method for storing data in a monitoring system according to claim 1, wherein the step of obtaining the second similarity of the pair of positions formed by any two positions comprises the following specific steps:
Figure QLYQS_30
wherein ,
Figure QLYQS_32
indicate->
Figure QLYQS_35
Second similarity of the pairs of positions, +.>
Figure QLYQS_38
Representing common->
Figure QLYQS_33
Reserved band->
Figure QLYQS_36
Indicate->
Figure QLYQS_37
The position pair is at->
Figure QLYQS_39
Band similarity in the reserved bands, +.>
Figure QLYQS_31
Indicate->
Figure QLYQS_34
The height correlation degree of each reserved wave band;
the band similarity is at the first position through two positions
Figure QLYQS_40
And obtaining the ratio between the band data in the reserved bands.
8. The method for storing data in a monitoring system according to claim 1, wherein the classifying the different locations according to the second similarity to obtain a plurality of second categories comprises the following specific steps:
according to the obtained second similarity of all the position pairs, a second similarity sequence is obtained according to descending order, the number of the position pairs corresponding to different second similarities is counted, the second similarity with the number closest to the number of the first similarities is selected, and each corresponding position pair is used as an initial second category respectively;
and respectively calculating the positions which are not divided into any second category, and the average value of the second similarity between the positions in each second category, and taking the second category corresponding to the maximum value obtained by each position as the second category to which each position belongs.
CN202310251779.3A2023-03-162023-03-16Data storage method of monitoring systemActiveCN116089660B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN202310251779.3ACN116089660B (en)2023-03-162023-03-16Data storage method of monitoring system

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN202310251779.3ACN116089660B (en)2023-03-162023-03-16Data storage method of monitoring system

Publications (2)

Publication NumberPublication Date
CN116089660Atrue CN116089660A (en)2023-05-09
CN116089660B CN116089660B (en)2024-08-02

Family

ID=86187164

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN202310251779.3AActiveCN116089660B (en)2023-03-162023-03-16Data storage method of monitoring system

Country Status (1)

CountryLink
CN (1)CN116089660B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN116582133A (en)*2023-07-122023-08-11东莞市联睿光电科技有限公司Intelligent management system for data in transformer production process
CN118523779A (en)*2024-07-222024-08-20山东省科学院海洋仪器仪表研究所Intelligent monitoring method for running state of equipment based on sensing technology

Citations (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20130031063A1 (en)*2011-07-262013-01-31International Business Machines CorporationCompression of data partitioned into clusters
CN113537108A (en)*2021-07-232021-10-22安徽省农业科学院土壤肥料研究所Crop chlorophyll content inversion method based on unmanned aerial vehicle hyperspectral remote sensing
CN115329910A (en)*2022-10-172022-11-11南通坤鹏科技有限公司Intelligent processing method for enterprise production emission data

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20130031063A1 (en)*2011-07-262013-01-31International Business Machines CorporationCompression of data partitioned into clusters
CN113537108A (en)*2021-07-232021-10-22安徽省农业科学院土壤肥料研究所Crop chlorophyll content inversion method based on unmanned aerial vehicle hyperspectral remote sensing
CN115329910A (en)*2022-10-172022-11-11南通坤鹏科技有限公司Intelligent processing method for enterprise production emission data

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
葛亮;王斌;张立明;: "基于波段聚类的高光谱图像波段选择", 计算机辅助设计与图形学学报, no. 11, pages 65 - 72*

Cited By (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN116582133A (en)*2023-07-122023-08-11东莞市联睿光电科技有限公司Intelligent management system for data in transformer production process
CN116582133B (en)*2023-07-122024-02-23东莞市联睿光电科技有限公司Intelligent management system for data in transformer production process
CN118523779A (en)*2024-07-222024-08-20山东省科学院海洋仪器仪表研究所Intelligent monitoring method for running state of equipment based on sensing technology

Also Published As

Publication numberPublication date
CN116089660B (en)2024-08-02

Similar Documents

PublicationPublication DateTitle
CN116089660B (en)Data storage method of monitoring system
CN113095370B (en)Image recognition method, device, electronic equipment and storage medium
MartÍnez-UsÓMartinez-Uso et al.Clustering-based hyperspectral band selection using information measures
Jia et al.Gabor cube selection based multitask joint sparse representation for hyperspectral image classification
CN115834895B (en)Efficient data compression and storage method for unmanned aerial vehicle
CN112067129B (en)Hyperspectral processing method and waveband selection method
CN113536019B (en) Image retrieval method, device and computer readable storage medium
CN113420640B (en) Mangrove hyperspectral image classification method, device, electronic equipment and storage medium
KR101917369B1 (en)Method and apparatus for retrieving image using convolution neural network
CN102819582A (en)Quick searching method for mass images
CN113918598A (en)Product quantization searching method, device, terminal and storage medium
CN111177436B (en)Face feature retrieval method, device and equipment
CA2773925A1 (en)Method and systems for computer-based selection of identifying input for class differentiation
AriyapadathPlant Leaf Classification and Comparative Analysis of Combined Feature Set Using Machine Learning Techniques.
CN105205487B (en)A kind of image processing method and device
Wu et al.A dense Litchi Target Recognition Algorithm for large scenes
CN110070035B (en)Multispectral remote sensing image classification method and system
CN106101732B (en) A Vector Quantization Scheme for Fast Compression of Hyperspectral Signals
CN114842357A (en)Sky integration big data flood prevention early warning system based on unmanned aerial vehicle
Liu et al.Hyperspectral band selection based on consistency-measure of neighborhood rough set theory
CN118014468A (en)Intelligent chemical warehouse area unloading full-flow data management method
CN117932103A (en)Target retrieval method, terminal and computer readable storage medium
CN103442236B (en) A Compression Coding Method for Remote Sensing Signals Based on Multilevel and Fractal Vector Quantization
CN110889438A (en)Image processing method and device, electronic equipment and storage medium
CN106815349B (en)Time filtering method and event filtering method based on Hash algorithm and regular matching

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
TA01Transfer of patent application right
TA01Transfer of patent application right

Effective date of registration:20240628

Address after:Room 301, 3rd Floor, Building 28, No.1 Courtyard, Wuliqiao 1st Street, Chaoyang District, Beijing, 100020

Applicant after:Beijing Ruidao Network Technology Co.,Ltd.

Country or region after:China

Address before:710000, Unit 702, Building 18, Wanke High tech Huafu, Xifengsan Road, Electronic City Street, Yanta District, Xi'an City, Shaanxi Province

Applicant before:Xi'an Zhongchuang Boyuan Network Technology Co.,Ltd.

Country or region before:China

GR01Patent grant
GR01Patent grant

[8]ページ先頭

©2009-2025 Movatter.jp