Movatterモバイル変換


[0]ホーム

URL:


CN102780681A - URL (Uniform Resource Locator) filtering system and URL filtering method - Google Patents

URL (Uniform Resource Locator) filtering system and URL filtering method
Download PDF

Info

Publication number
CN102780681A
CN102780681ACN2011101213726ACN201110121372ACN102780681ACN 102780681 ACN102780681 ACN 102780681ACN 2011101213726 ACN2011101213726 ACN 2011101213726ACN 201110121372 ACN201110121372 ACN 201110121372ACN 102780681 ACN102780681 ACN 102780681A
Authority
CN
China
Prior art keywords
url
rule file
message
internal memory
http message
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2011101213726A
Other languages
Chinese (zh)
Inventor
王永光
沈蓓洁
卢勤元
李冰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE CorpfiledCriticalZTE Corp
Priority to CN2011101213726ApriorityCriticalpatent/CN102780681A/en
Priority to PCT/CN2011/080608prioritypatent/WO2012151843A1/en
Publication of CN102780681ApublicationCriticalpatent/CN102780681A/en
Pendinglegal-statusCriticalCurrent

Links

Images

Classifications

Landscapes

Abstract

The invention relates to a URL (Uniform Resource Locator) filtering system and a URL filtering method. The system comprises an identifying unit, an internal memory unit, a rule unit, a scanning unit and a matching unit. The method comprises the following steps of: generating a URL rule file capable of being identified by the system and loading the URL rule file in the internal memory according to a URL list defined by a user; when the system receives a message, scanning and judging whether the message is an HTTP (Hyper Text Transport Protocol) message or not; if so, scanning the URL information in the HTTP message, and matching the URL information with the URL information in the URL rule file in an internal memory; and discharging or filtering the HTTP message according to the matching result. By utilizing the URL filtering system provided by the invention, the URL processing speed is accelerated without distinguishing types of the URL.

Description

Url filtering system and the method for filtering URL
Technical field
The communications field of the present invention, the method that relates in particular to a kind of URL (Uniform/Universal Resource Locator, URL) filtration system and filter URL.
Background technology
URL also is called as web page address, is the resource addresses that Internet goes up standard, is used for intactly describing a kind of identification method that Internet goes up webpage and other resource addresses.Each last webpage of Internet all has a unique URL address name identification, is referred to as the URL address usually, and this address can be a local disk, also can be a certain computer on the local area network (LAN), more is the website on the Internet.Briefly, URL is exactly the Web address, is commonly called as " network address ".
Along with popularizing of network; Information on the Internet provides increasing facility for people's life and work; The teen-age quantity that touches network is also more and more, but online information is very different, particularly also has the website of bad things such as advocation pornographic quite a lot, violence, supertition; In order to present a healthy and upgoing website to the teenager; Need the URL of its visit be filtered, thereby mask some unsound and illegal websites, thereby guarantee teen-age growing up healthy and sound.
At present existing url filtering method mainly contains three kinds:
The first, use the hash table to deposit URL information; This method is applicable to that the different URL of domain name searches, and when domain name is identical, searches consuming time longer;
The second, use string matching algorithm; This method is applicable to keyword search, but seek rate is slow;
The 3rd uses the canonical matching algorithm; This method is applicable to that uncertain URL searches, and its seek rate is also slow.
Existing method seek rate can increase and significantly descends along with the record of the URL in the URL list, can not satisfy the URL management in the network of handling up of present height.
Summary of the invention
The method that the object of the present invention is to provide a kind of url filtering system and filter URL is improved prior art with solution and is searched the slow-footed problem of URL.
The invention provides the method for a kind of URL of filtration, may further comprise the steps:
According to user-defined URL list, generate the discernible URL rule file of url filtering system, and above-mentioned URL rule file is loaded in the internal memory;
When said system is received message, scan and judge whether above-mentioned message is HTTP (Hyper Text Transfer Protocol, HTTP) message, if, then
Wherein URL information of scanning is mated with the URL information in the URL rule file in the internal memory;
Perhaps filter the above-mentioned HTTP message according to the matching result clearance.
Further, the above-mentioned URL rule file is loaded in the internal memory also comprises after the step:
Judge whether above-mentioned user-defined URL list changes, if, then according to the user-defined URL list after changing, the discernible URL rule file of the system that regenerates, and newly-generated URL rule file is loaded in the internal memory;
After loading completion, new URL rule file is carried out the URL information matches in the said system use internal memory, deletes URL rule file old in the internal memory simultaneously.
Further, when said system is judged the message of receiving and is not the HTTP message, the above-mentioned message of directly letting pass.
Further, above-mentioned user-defined URL list is blacklist or white list.
Further, above-mentioned let pass or filter above-mentioned HTTP message step according to matching result specifically comprise:
When above-mentioned user-defined URL list is blacklist, if the above-mentioned HTTP message is then filtered in the URL information of the HTTP message of receiving and the success of the URL information matches in the URL rule file in the internal memory; If the URL information of the HTTP message of receiving and the failure of the URL information matches in the URL rule file in the internal memory, the above-mentioned HTTP of then letting pass message;
When above-mentioned user-defined URL list is white list, if the URL information of the HTTP message of receiving and the success of the URL information matches in the URL rule file in the internal memory, the above-mentioned HTTP of then letting pass message; If the above-mentioned HTTP message is then filtered in the URL information of the HTTP message of receiving and the failure of the URL information matches in the URL rule file in the internal memory.
The present invention also provides a kind of url filtering system, comprises recognition unit and internal storage location, also comprises regular unit, scanning element and matching unit,
Said recognition unit is used to discern whether the message of receiving is the HTTP message, and recognition result is sent to above-mentioned scanning element;
Above-mentioned regular unit is used for according to user-defined URL list, the discernible URL rule file of generation system, and above-mentioned URL rule file is loaded into above-mentioned internal storage location;
Above-mentioned scanning element is used to scan the message of receiving, and sends to above-mentioned message recognition unit, perhaps scans the URL information in the HTTP message, and above-mentioned URL information is sent to above-mentioned matching unit; And the matching result that returns of the recognition result that returns according to above-mentioned recognition unit and above-mentioned matching unit, the message that clearance/filtration is received;
Above-mentioned matching unit, the URL information in the URL information that is used for receiving and the URL rule file of above-mentioned internal storage location is mated, and matching result is sent to above-mentioned scanning element.
Further; Whether above-mentioned regular unit also is used for the self-defining URL list of judges and changes, and when above-mentioned user-defined URL changes; According to the user-defined URL list after changing; The discernible URL rule file of the system that regenerates is loaded into newly-generated URL rule file in the above-mentioned internal storage location, and after loading successfully, notifies above-mentioned matching unit to use new URL rule file to carry out the URL information matches.
Further, above-mentioned matching unit also is used for after receiving the notice of above-mentioned regular unit, uses new URL rule file to carry out the URL information matches, and deletes URL rule file old in the above-mentioned internal storage location.
The present invention further provides a kind of gateway, and above-mentioned gateway comprises above-mentioned url filtering system.
The present invention converts user-defined URL list to URL system hardware discernible URL rule file and is loaded in the internal memory; When receiving message, system can mate the URL rule file in HTTP message and the internal memory rapidly, and provides matching result; The scanning matching speed can reach 2Gbps at least; And need not distinguish the type of URL, save in the existing method complicated and loaded down with trivial details URL classification and search, accelerate the URL processing speed; The present invention supports the url filtering of big data quantity, is applicable in the network equipments such as ISG (Integrated Service Gateway, integrated service gateway), WAP gateway, WEB gateway.
Description of drawings
Accompanying drawing described herein is used to provide further understanding of the present invention, constitutes a part of the present invention, and illustrative examples of the present invention and explanation thereof are used to explain the present invention, does not constitute improper qualification of the present invention.In the accompanying drawings:
Fig. 1 is the method flow diagram that the present invention filters URL;
Fig. 2 is the theory diagram of url filtering of the present invention system;
Fig. 3 is the theory diagram of gateway of the present invention.
Embodiment
In order to make technical problem to be solved by this invention, technical scheme and beneficial effect clearer, clear,, the present invention is further elaborated below in conjunction with accompanying drawing and embodiment.Should be appreciated that specific embodiment described herein only in order to explanation the present invention, and be not used in qualification the present invention.
As shown in Figure 1, be the method flow diagram that the present invention filters URL, present embodiment supposes that user-defined URL list is a blacklist, specifically may further comprise the steps:
Step S001:, generate the discernible URL rule file of url filtering system according to user-defined blacklist;
Step S002: above-mentioned URL rule file is loaded in the internal memory;
Step S003: message is received by system;
Step S004: scan above-mentioned message;
Step S005: judge whether above-mentioned message is the HTTP message, if, execution in step S006 then, otherwise, execution in step S010;
Step S006: scanning URL information wherein;
Step S007: mate with the URL information in the URL rule file in the internal memory;
Step S008: judge whether to mate successfully, if, execution in step S009 then; Otherwise, execution in step S010;
Step S009: filter above-mentioned message;
Step S010: the above-mentioned message of letting pass.
The message of this step comprises HTTP message and non-HTTP message.
In other embodiments, when user-defined URL list is white list, if the URL information of the HTTP message of receiving and the success of the URL information matches in the URL rule file in the internal memory, the above-mentioned HTTP of then letting pass message; If the above-mentioned HTTP message is then filtered in the URL information of the HTTP message of receiving and the failure of the URL information matches in the URL rule file in the internal memory.
Among the present invention, in the time of the system handles message, judge also whether above-mentioned user-defined URL list changes; If, then according to the user-defined URL list after changing, the discernible URL rule file of the system that regenerates; And newly-generated URL rule file is loaded in the internal memory; After loading completion, use new URL rule file to carry out the URL information matches, delete old URL rule file simultaneously; This makes the present invention under the professional situation of the coupling of interrupt scanning not, realizes the real-time update of URL rule file.In concrete embodiment, can reserve two internal memory A and B, if old URL rule file leaves among the internal memory A; After the so user-defined URL name altered, newly-generated URL rule file just is loaded among the internal memory B, after loading is accomplished; System uses the URL rule file among the internal memory B to carry out the URL information matches; Meanwhile, the URL rule file among the deletion internal memory A is after user-defined URL list changes once more; Newly-generated URL rule file then is loaded among the internal memory A, and the like.That is to say that system carries out two tasks simultaneously, one is to handle the message of receiving, whether one be to detect user-defined URL list to change.
The present invention is based on the filter method of hardware, compare, improved the speed of handling the HTTP message with existing method based on software.
As shown in Figure 2, be the theory diagram of url filtering of the present invention system, comprisescanning element 01,recognition unit 02,regular unit 03, matchingunit 04,internal storage location 05;
Scanningelement 01 is used to scan the message of receiving, and sends tomessage recognition unit 02, perhaps scans the URL information in the HTTP message, and above-mentioned URL information is sent to matchingunit 04; And the matching result that returns of the recognition result that returns according torecognition unit 02 and matchingunit 04, the message that clearance/filtration is received;
Recognition unit 02 is used to discern whether the message of receiving is the HTTP message, and recognition result is sent to scanningelement 01;
Rule unit 03 is used for according to user-defined URL list, the discernible URL rule file of generation system, and above-mentioned URL rule file is loaded intointernal storage location 05; And be used for the self-defining URL list of judges and whether change; And when above-mentioned user-defined URL changes; According to the user-defined URL list after changing, the discernible URL rule file of the system that regenerates is loaded into newly-generated URL rule file in theinternal storage location 05; And after loading completion, the notice matching unit uses new URL rule file to carry out the URL information matches;
Matchingunit 04; URL information in the URL information that is used for receiving and the URL rule file ofinternal storage location 05 is mated; And matching result sent to scanningelement 01; Perhaps when receiving the notice ofregular unit 03, use the URL rule file of new loading in theinternal storage location 05 to carry out the URL information matches, and old URL rule file in the deletioninternal storage location 05.
As shown in Figure 3; Be gateway theory diagram of the present invention, comprise url filtering system shown in Figure 2, the url filtering system comprisesscanning element 01,recognition unit 02,regular unit 03, matchingunit 04,internal storage location 05; Each Elementary Function is no longer repeated referring to above-mentioned description to Fig. 2 here.
Above-mentioned explanation illustrates and has described the preferred embodiments of the present invention; But as previously mentioned; Be to be understood that the present invention is not limited to the form that this paper discloses, should do not regard eliminating as, and can be used for various other combinations, modification and environment other embodiment; And can in invention contemplated scope described herein, change through the technology or the knowledge of above-mentioned instruction or association area.And change that those skilled in the art carried out and variation do not break away from the spirit and scope of the present invention, then all should be in the protection range of accompanying claims of the present invention.

Claims (9)

CN2011101213726A2011-05-112011-05-11URL (Uniform Resource Locator) filtering system and URL filtering methodPendingCN102780681A (en)

Priority Applications (2)

Application NumberPriority DateFiling DateTitle
CN2011101213726ACN102780681A (en)2011-05-112011-05-11URL (Uniform Resource Locator) filtering system and URL filtering method
PCT/CN2011/080608WO2012151843A1 (en)2011-05-112011-10-10Ulr filtering system, method and gateway

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN2011101213726ACN102780681A (en)2011-05-112011-05-11URL (Uniform Resource Locator) filtering system and URL filtering method

Publications (1)

Publication NumberPublication Date
CN102780681Atrue CN102780681A (en)2012-11-14

Family

ID=47125437

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN2011101213726APendingCN102780681A (en)2011-05-112011-05-11URL (Uniform Resource Locator) filtering system and URL filtering method

Country Status (2)

CountryLink
CN (1)CN102780681A (en)
WO (1)WO2012151843A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN103354546A (en)*2013-06-252013-10-16亿赞普(北京)科技有限公司Message filtering method and message filtering apparatus
CN103401850A (en)*2013-07-192013-11-20北京星网锐捷网络技术有限公司Message filtering method and device
CN103560995A (en)*2013-09-252014-02-05深圳市共进电子股份有限公司URL filtering method for realizing IPv4 and IPv6 at the same time
CN105302815A (en)*2014-06-232016-02-03腾讯科技(深圳)有限公司Web page uniform resource locator URL filtering method and apparatus
CN105938472A (en)*2015-08-262016-09-14杭州迪普科技有限公司Web access control method and device
CN106657201A (en)*2015-11-032017-05-10中兴通讯股份有限公司Data processing method and device for GSLB scheduling system
CN106970917A (en)*2016-01-132017-07-21中国科学院声学研究所A kind of foundation of blacklist URL Hash table and the lookup method of request URL
WO2017198145A1 (en)*2016-05-202017-11-23中兴通讯股份有限公司Processing method and device for scheduling rule of uniform resource locator
CN109547421A (en)*2018-11-082019-03-29锐捷网络股份有限公司A kind of method and device for the URL that audits

Citations (5)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20080209057A1 (en)*2006-09-282008-08-28Paul MartiniSystem and Method for Improved Internet Content Filtering
US20090083240A1 (en)*2007-09-242009-03-26Microsoft CorporationAuthorization agnostic based mechanism
CN101795272A (en)*2010-01-222010-08-04联想网御科技(北京)有限公司Illegal website filtering method and device
CN102004770A (en)*2010-11-162011-04-06杭州迪普科技有限公司Webpage auditing method and device
CN102004789A (en)*2010-12-072011-04-06苏州迈科网络安全技术股份有限公司Application method of uniform/universal resource locator (URL) filter system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20080209057A1 (en)*2006-09-282008-08-28Paul MartiniSystem and Method for Improved Internet Content Filtering
US20090083240A1 (en)*2007-09-242009-03-26Microsoft CorporationAuthorization agnostic based mechanism
CN101795272A (en)*2010-01-222010-08-04联想网御科技(北京)有限公司Illegal website filtering method and device
CN102004770A (en)*2010-11-162011-04-06杭州迪普科技有限公司Webpage auditing method and device
CN102004789A (en)*2010-12-072011-04-06苏州迈科网络安全技术股份有限公司Application method of uniform/universal resource locator (URL) filter system

Cited By (13)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN103354546A (en)*2013-06-252013-10-16亿赞普(北京)科技有限公司Message filtering method and message filtering apparatus
CN103401850A (en)*2013-07-192013-11-20北京星网锐捷网络技术有限公司Message filtering method and device
CN103560995A (en)*2013-09-252014-02-05深圳市共进电子股份有限公司URL filtering method for realizing IPv4 and IPv6 at the same time
CN105302815B (en)*2014-06-232019-06-07腾讯科技(深圳)有限公司The filter method and device of the uniform resource position mark URL of webpage
CN105302815A (en)*2014-06-232016-02-03腾讯科技(深圳)有限公司Web page uniform resource locator URL filtering method and apparatus
CN105938472A (en)*2015-08-262016-09-14杭州迪普科技有限公司Web access control method and device
CN106657201A (en)*2015-11-032017-05-10中兴通讯股份有限公司Data processing method and device for GSLB scheduling system
CN106657201B (en)*2015-11-032021-08-24中兴通讯股份有限公司Data processing method and device of GSLB (generalized Global System for Mobile communications) scheduling system
CN106970917A (en)*2016-01-132017-07-21中国科学院声学研究所A kind of foundation of blacklist URL Hash table and the lookup method of request URL
CN106970917B (en)*2016-01-132019-11-19中国科学院声学研究所 A method for establishing a hash table of blacklisted URLs and searching for requested URLs
CN107404392A (en)*2016-05-202017-11-28中兴通讯股份有限公司The processing method and processing device of the scheduling rule of uniform resource position mark URL
WO2017198145A1 (en)*2016-05-202017-11-23中兴通讯股份有限公司Processing method and device for scheduling rule of uniform resource locator
CN109547421A (en)*2018-11-082019-03-29锐捷网络股份有限公司A kind of method and device for the URL that audits

Also Published As

Publication numberPublication date
WO2012151843A1 (en)2012-11-15

Similar Documents

PublicationPublication DateTitle
CN102780681A (en)URL (Uniform Resource Locator) filtering system and URL filtering method
CN102857493B (en)Content filtering method and device
CN101183988B (en)Method of identifying packet corresponding service types and device thereof
CN105187394B (en)Proxy server and method with mobile terminal from malicious software action detectability
JP4554675B2 (en) Communication control device and communication control system
CN103688489B (en)Method for strategy processing and network equipment
US20220368713A1 (en)System and method for monitoring security of a computer network
JP2013510368A (en) Text filtering method and system
CN103366117B (en)A kind of viral restorative procedure of infection type and system
CN107979581B (en) Zombie feature detection method and device
CN102193948A (en)Feature matching method and device
CN113810408B (en)Network attack organization detection method, device, equipment and readable storage medium
CN114024759B (en)Security policy management and control method, device, computer equipment and medium
CN104239353B (en)WEB classification control and log audit method
CN111585989A (en)Vulnerability detection method and device of networked industrial control equipment and computer equipment
CN112118249A (en)Security protection method and device based on log and firewall
CN115242434A (en)Application program interface API identification method and device
CN109922083B (en)Network protocol flow control system
CN111625807A (en)Equipment type identification method and device
CN113630301B (en)Data transmission method, device and equipment based on intelligent decision and storage medium
KR101846778B1 (en)Method for ID Resolution Service and M2M System applying the same
CN105653625A (en)Analysis method and device of abnormal data
CN105635159B (en)Method for blocking and system based on keyword
JP4146505B1 (en) Determination apparatus and determination method
CN104063405B (en)Microblog terminal and its method for managing subscriber data data

Legal Events

DateCodeTitleDescription
C06Publication
PB01Publication
C10Entry into substantive examination
SE01Entry into force of request for substantive examination
RJ01Rejection of invention patent application after publication

Application publication date:20121114

RJ01Rejection of invention patent application after publication

[8]ページ先頭

©2009-2025 Movatter.jp