Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up

Malicious traffic detection system

License

NotificationsYou must be signed in to change notification settings

stamparm/maltrail

Repository files navigation

Maltrail

Python 2.6|2.7|3.xLicenseMalware familiesMalware sinkholesTwitter

Content

Introduction

Maltrail is a malicious traffic detection system, utilizing publicly available (black)lists containing malicious and/or generally suspicious trails, along with static trails compiled from various AV reports and custom user defined lists, where trail can be anything from domain name (e.g.zvpprsensinaix.com forBanjori malware), URL (e.g.hXXp://109.162.38.120/harsh02.exe for known maliciousexecutable), IP address (e.g.185.130.5.231 for known attacker) or HTTP User-Agent header value (e.g.sqlmap for automatic SQL injection and database takeover tool). Also, it uses (optional) advanced heuristic mechanisms that can help in discovery of unknown threats (e.g. new malware).

Reporting tool

The following (black)lists (i.e. feeds) are being utilized:

360bigviktor, 360chinad, 360conficker, 360cryptolocker, 360gameover, 360locky, 360necurs, 360suppobox, 360tofsee, 360virut, abuseipdb, alienvault, atmos, badips, bitcoinnodes, blackbook, blocklist, botscout, bruteforceblocker, ciarmy, cobaltstrike, cruzit, cybercrimetracker, dataplane, dshieldip, emergingthreatsbot, emergingthreatscip, emergingthreatsdns, feodotrackerip, gpfcomics, greensnow, ipnoise,kriskinteldns, kriskintelip, malc0de, malwaredomainlistdns, malwaredomains,maxmind, minerchk, myip, openphish, palevotracker, policeman, pony,proxylists, proxyrss, proxyspy, ransomwaretrackerdns, ransomwaretrackerip, ransomwaretrackerurl, riproxies, rutgers, sblam, socksproxy, sslbl, sslproxies, talosintelligence, torproject, trickbot, turris, urlhaus, viriback, vxvault, zeustrackermonitor, zeustrackerurl, etc.

As of static entries, the trails for the following malicious entities (e.g. malware C&Cs or sinkholes) have been manually included (from various AV reports and personal research):

1ms0rry, 404, 9002, aboc, absent, ab, acbackdoor, acridrain, activeagent, adrozek, advisorbot, adwind, adylkuzz, adzok, afrodita, agaadex, agenttesla, aldibot, alina, allakore, almalocker, almashreq, alpha, alureon, amadey, amavaldo, amend_miner, ammyyrat, android_acecard, android_actionspy, android_adrd, android_ahmythrat, android_alienspy, android_andichap, android_androrat, android_anubis, android_arspam, android_asacub, android_backflash, android_bankbot, android_bankun, android_basbanke, android_basebridge, android_besyria, android_blackrock, android_boxer, android_buhsam, android_busygasper, android_calibar, android_callerspy, android_camscanner, android_cerberus, android_chuli, android_circle, android_claco, android_clickfraud, android_cometbot, android_cookiethief, android_coolreaper, android_copycat, android_counterclank, android_cyberwurx, android_darkshades, android_dendoroid, android_dougalek, android_droidjack, android_droidkungfu, android_enesoluty, android_eventbot, android_ewalls, android_ewind, android_exodus, android_exprespam, android_fakeapp, android_fakebanco, android_fakedown, android_fakeinst, android_fakelog, android_fakemart, android_fakemrat, android_fakeneflic, android_fakesecsuit, android_fanta, android_feabme, android_flexispy, android_fobus, android_fraudbot, android_friend, android_frogonal, android_funkybot, android_gabas, android_geinimi, android_generic, android_geost, android_ghostpush, android_ginmaster, android_ginp, android_gmaster, android_gnews, android_godwon, android_golddream, android_goldencup, android_golfspy, android_gonesixty, android_goontact, android_gplayed, android_gustuff, android_gypte, android_henbox, android_hiddad, android_hydra, android_ibanking, android_joker, android_jsmshider, android_kbuster, android_kemoge, android_ligarat, android_lockdroid, android_lotoor, android_lovetrap, android_malbus, android_mandrake, android_maxit, android_mobok, android_mobstspy, android_monokle, android_notcompatible, android_oneclickfraud, android_opfake, android_ozotshielder, android_parcel, android_phonespy, android_pikspam, android_pjapps, android_qdplugin, android_raddex, android_ransomware, android_redalert, android_regon, android_remotecode, android_repane, android_riltok, android_roamingmantis, android_roidsec, android_rotexy, android_samsapo, android_sandrorat, android_selfmite, android_shadowvoice, android_shopper, android_simbad, android_simplocker, android_skullkey, android_sndapps, android_spynote, android_spytekcell, android_stels, android_svpeng, android_swanalitics, android_teelog, android_telerat, android_tetus, android_thiefbot, android_tonclank, android_torec, android_triada, android_uracto, android_usbcleaver, android_viceleaker, android_vmvol, android_walkinwat, android_windseeker, android_wirex, android_wolfrat, android_xavirad, android_xbot007, android_xerxes, android_xhelper, android_xploitspy, android_z3core, android_zertsecurity, android_ztorg, andromeda, antefrigus, antibot, anubis, anuna, apocalypse, apt_12, apt_17, apt_18, apt_23, apt_27, apt_30, apt_33, apt_37, apt_38, apt_aridviper, apt_babar, apt_bahamut, etc.

Architecture

Maltrail is based on theTraffic ->Sensor <->Server <->Client architecture.Sensor(s) is a standalone component running on the monitoring node (e.g. Linux platform connected passively to the SPAN/mirroring port or transparently inline on a Linux bridge) or at the standalone machine (e.g. Honeypot) where it "monitors" the passingTraffic for blacklisted items/trails (i.e. domain names, URLs and/or IPs). In case of a positive match, it sends the event details to the (central)Server where they are being stored inside the appropriate logging directory (i.e.LOG_DIR described in theConfiguration section). IfSensor is being run on the same machine asServer (default configuration), logs are stored directly into the local logging directory. Otherwise, they are being sent via UDP messages to the remote server (i.e.LOG_SERVER described in theConfiguration section).

Architecture diagram

Server's primary role is to store the event details and provide back-end support for the reporting web application. In default configuration, server and sensor will run on the same machine. So, to prevent potential disruptions in sensor activities, the front-end reporting part is based on the"Fat client" architecture (i.e. all data post-processing is being done inside the client's web browser instance). Events (i.e. log entries) for the chosen (24h) period are transferred to theClient, where the reporting web application is solely responsible for the presentation part. Data is sent toward the client in compressed chunks, where they are processed sequentially. The final report is created in a highly condensed form, practically allowing presentation of virtually unlimited number of events.

Note:Server component can be skipped altogether, and just use the standaloneSensor. In such case, all events would be stored in the local logging directory, while the log entries could be examined either manually or by some CSV reading application.

Demo pages

Fully functional demo pages with collected real-life threats can be foundhere.

Requirements

To run Maltrail properly,Python2.6,2.7 or3.x is required on *nix/BSD system, together with installedpcapy-ng package.

NOTE: Using ofpcapy lib instead ofpcapy-ng can lead to incorrect work of Maltrail, especially onPython 3.x environments.Examples.

  • Sensor component requires at least 1GB of RAM to run in single-process mode or more if run in multiprocessing mode, depending on the value used for optionCAPTURE_BUFFER. Additionally,Sensor component (in general case) requires administrative/root privileges.

  • Server component does not have any special requirements.

Quick start

The following set of commands should get your MaltrailSensor up and running (out of the box with default settings and monitoring interface "any"):

  • ForUbuntu/Debian
sudo apt-get install git python3 python3-dev python3-pip python-is-python3 libpcap-dev build-essential procps schedtoolsudo pip3 install pcapy-nggit clone --depth 1 https://github.com/stamparm/maltrail.gitcd maltrailsudo python3 sensor.py
  • ForSUSE/openSUSE
sudo zypper install gcc gcc-c++ git libpcap-devel python3-devel python3-pip procps schedtoolsudo pip3 install pcapy-nggit clone --depth 1 https://github.com/stamparm/maltrail.gitcd maltrailsudo python3 sensor.py
  • ForDocker environment instructions can be foundhere.

Sensor

To start the (optional)Server on same machine, open a new terminal and execute the following:

[[-d maltrail ]]|| git clone --depth 1 https://github.com/stamparm/maltrail.gitcd maltrailpython server.py

Server

To test that everything is up and running execute the following:

ping -c 1 136.161.101.53cat /var/log/maltrail/$(date +"%Y-%m-%d").log

Test

Also, to test the capturing of DNS traffic you can try the following:

nslookup morphed.rucat /var/log/maltrail/$(date +"%Y-%m-%d").log

Test2

To stopSensor andServer instances (if running in background) execute the following:

sudo pkill -f sensor.pypkill -f server.py

Access the reporting interface (i.e.Client) by visiting thehttp://127.0.0.1:8338 (default credentials:admin:changeme!) from your web browser:

Reporting interface

Administrator's guide

Sensor

Sensor's configuration can be found inside themaltrail.conf file's section[Sensor]:

Sensor's configuration

If optionUSE_MULTIPROCESSING is set totrue then all CPU cores will be used. One core will be used only for packet capture (with appropriate affinity, IO priority and nice level settings), while other cores will be used for packet processing. Otherwise, everything will be run on a single core. OptionUSE_FEED_UPDATES can be used to turn off the trail updates from feeds altogether (and just use the provided static ones). OptionUPDATE_PERIOD contains the number of seconds between each automatic trails update (Note: default value is set to86400 (i.e. one day)) by using definitions inside thetrails directory (Note: bothSensor andServer take care of the trails update). OptionCUSTOM_TRAILS_DIR can be used by user to provide location of directory containing the custom trails (*.txt) files.

OptionUSE_HEURISTICS turns on heuristic mechanisms (e.g.long domain name (suspicious),excessive no such domain name (suspicious),direct .exe download (suspicious), etc.), potentially introducing false positives. OptionCAPTURE_BUFFER presents a total memory (in bytes of percentage of total physical memory) to be used in case of multiprocessing mode for storing packet capture in a ring buffer for further processing by non-capturing processes. OptionMONITOR_INTERFACE should contain the name of the capturing interface. Use valueany to capture from all interfaces (if OS supports this). OptionCAPTURE_FILTER should contain the network capture (tcpdump) filter to skip the uninteresting packets and ease the capturing process. OptionSENSOR_NAME contains the name that should be appearing inside the eventssensor_name value, so the event from one sensor could be distinguished from the other. If optionLOG_SERVER is set, then all events are being sent remotely to theServer, otherwise they are stored directly into the logging directory set with optionLOG_DIR, which can be found inside themaltrail.conf file's section[All]. In case that the optionUPDATE_SERVER is set, then all the trails are being pulled from the given location, otherwise they are being updated from trails definitions located inside the installation itself.

OptionsSYSLOG_SERVER and/orLOGSTASH_SERVER can be used to send sensor events (i.e. log data) to non-Maltrail servers. In case ofSYSLOG_SERVER, event data will be sent in CEF (Common Event Format) format to UDP (e.g. Syslog) service listening at the given address (e.g.192.168.2.107:514), while in case ofLOGSTASH_SERVER event data will be sent in JSON format to UDP (e.g. Logstash) service listening at the given address (e.g.192.168.2.107:5000).

Example of event data being sent over UDP is as follows:

  • For optionSYSLOG_SERVER (Note:LogSeverity values are 0 (for low), 1 (for medium) and 2 (for high)):

Dec 24 15:05:55 beast CEF:0|Maltrail|sensor|0.27.68|2020-12-24|andromeda (malware)|2|src=192.168.5.137 spt=60453 dst=8.8.8.8 dpt=53 trail=morphed.ru ref=(static)

  • For optionLOGSTASH_SERVER:

{"timestamp": 1608818692, "sensor": "beast", "severity": "high", "src_ip": "192.168.5.137", "src_port": 48949, "dst_ip": "8.8.8.8", "dst_port": 53, "proto": "UDP", "type": "DNS", "trail": "morphed.ru", "info": "andromeda (malware)", "reference": "(static)"}

When running the sensor (e.g.sudo python sensor.py) for the first time and/or after a longer period of non-running, it will automatically update the trails from trail definitions (Note: stored inside thetrails directory). After the initialization, it will start monitoring the configured interface (optionMONITOR_INTERFACE inside themaltrail.conf) and write the events to either the configured log directory (optionLOG_DIR inside themaltrail.conf file's section[All]) or send them remotely to the logging/reportingServer (optionLOG_SERVER).

Sensor run

Detected events are stored inside theServer's logging directory (i.e. optionLOG_DIR inside themaltrail.conf file's section[All]) in easy-to-read CSV format (Note: whitespace ' ' is used as a delimiter) as single line entries consisting of:timesensorsrc_ipsrc_portdst_ipdst_portprototrail_typetrailtrail_inforeference (e.g."2015-10-19 15:48:41.152513" beast 192.168.5.33 32985 8.8.8.8 53 UDP DNS 0000mps.webpreview.dsl.net malicious siteinspector.comodo.com):

Sample log

Server

Server's configuration can be found inside themaltrail.conf section[Server]:

Server's configuration

OptionHTTP_ADDRESS contains the web server's listening address (Note: use0.0.0.0 to listen on all interfaces). OptionHTTP_PORT contains the web server's listening port. Default listening port is set to8338. If optionUSE_SSL is set totrue thenSSL/TLS will be used for accessing the web server (e.g.https://192.168.6.10:8338/). In that case, optionSSL_PEM should be pointing to the server's private/cert PEM file.

SubsectionUSERS contains user's configuration settings. Each user entry consists of theusername:sha256(password):UID:filter_netmask(s). ValueUID represents the unique user identifier, where it is recommended to use values lower than 1000 for administrative accounts, while higher value for non-administrative accounts. The partfilter_netmask(s) represents the comma-delimited hard filter(s) that can be used to filter the shown events depending on the user account(s). Default entry is as follows:

Configuration users

OptionUDP_ADDRESS contains the server's log collecting listening address (Note: use0.0.0.0 to listen on all interfaces), while optionUDP_PORT contains listening port value. If turned on, when used in combination with optionLOG_SERVER, it can be used for distinct (multiple)Sensor <->Server architecture.

OptionFAIL2BAN_REGEX contains the regular expression (e.g.attacker|reputation|potential[^"]*(web scan|directory traversal|injection|remote code|iot-malware download|spammer|mass scanner) to be used in/fail2ban web calls for extraction of today's attacker source IPs. This allows the usage of IP blocking mechanisms (e.g.fail2ban,iptables oripset) by periodic pulling of blacklisted IP addresses from remote location. Example usage would be the following script (e.g. run as aroot cronjob on a minute basis):

#!/bin/bashipset -q flush maltrailipset -q create maltrail hash:netforipin$(curl http://127.0.0.1:8338/fail2ban2>/dev/null| grep -P'^[0-9.]+$');do ipset add maltrail$ip;doneiptables -I INPUT -mset --match-set maltrail src -j DROP

OptionBLACKLIST allows to build regular expressions to apply on one field. For each rule, the syntax is :<field> <control> <regexp> where :

  • field indicates the field to compage, it can be:src_ip,src_port,dst_ip,dst_port,protocol,type,trail orfilter.
  • control can be either~ formatches or!~ fordoesn't match
  • regexp is the regular expression to apply to the field.Chain another rule with theand keyword (theor keyword is not supported, just add a line for this).

You can use the keywordBLACKLIST alone or add a name :BLACKLIST_NAME. In the latter case, the url will be :/blacklist/name

For example, the following will build an out blacklist for all traffic from another source than192.168.0.0/16 to destination portSSH or matching the filtersscan orknown attacker

BLACKLIST_OUT    src_ip !~ ^192.168. and dst_port ~ ^22$    src_ip !~ ^192.168. and filter ~ scan    src_ip !~ ^192.168. and filter ~ known attackerBLACKLIST_IN    src_ip ~ ^192.168. and filter ~ malware

The way to build ipset blacklist is the same (see above) excepted that URLs will be/blacklist/in and/blacklist/out in our example.

Same as forSensor, when running theServer (e.g.python server.py) for the first time and/or after a longer period of non-running, if optionUSE_SERVER_UPDATE_TRAILS is set totrue, it will automatically update the trails from trail definitions (Note: stored inside thetrails directory). Its basic function is to store the log entries inside the logging directory (i.e. optionLOG_DIR inside themaltrail.conf file's section[All]) and provide the web reporting interface for presenting those same entries to the end-user (Note: there is no need install the 3rd party web server packages like Apache):

Server run

User's guide

Reporting interface

When entering theServer's reporting interface (i.e. via the address defined by optionsHTTP_ADDRESS andHTTP_PORT), user will be presented with the following authentication dialog. User has to enter the proper credentials that have been set by the server's administrator inside the configuration filemaltrail.conf (Note: default credentials areadmin:changeme!):

User login

Once inside, user will be presented with the following reporting interface:

Reporting interface

The top part holds a sliding timeline (Note: activated after clicking the current date label and/or the calendar iconCalendar icon) where user can select logs for past events (Note: mouse over event will trigger display of tooltip with approximate number of events for current date). Dates are grouped by months, where 4 month period of data are displayed inside the widget itself. However, by using the provided slider (i.e.Timeline slider) user can easily access events from previous months.

Timeline

Once clicking the date, all events for that particular date should be loaded and represented by the client's web browser. Depending on number of events and the network connection speed, loading and display of logged events could take from couple of seconds, up to several minutes (e.g. 100,000 events takes around 5 seconds in total). For the whole processing time, animated loader will be displayed across the disabled user interface:

Loader

Middle part holds a summary of displayed events.Events box represents total number of events in a selected 24-hour period, where red line represents IP-based events, blue line represents DNS-based events and yellow line represents URL-based events.Sources box represents number of events per top sources in form of a stacked column chart, with total number of sources on top.Threats box represents percentage of top threats in form of a pie chart (Note: gray area holds all threats having each <1% in total events), with total number of threats on top.Trails box represents percentage of top trails in form of a pie chart (Note: gray area holds all trails having each <1% in total events), with total number of trails on top. Each of those boxes are active, hence the click on one of those will result with a more detailed graph.

Summary

Bottom part holds a condensed representation of logged events in form of a paginated table. Each entry holds details for a single threat (Note: uniquely identified by a pair(src_ip, trail) or(dst_ip, trail) if thesrc_ip is the same as thetrail as in case of attacks coming from the outside):

Single threat

Columnthreat holds threat's unique ID (e.g.85fdb08d) and color (Note: extruded from the threat's ID),sensor holds sensor name(s) where the event has been triggered (e.g.blitvenica),events holds total number of events for a current threat,severity holds evaluated severity of threat (Note: calculated based on values ininfo andreference columns, prioritizing malware generated traffic),first_seen holds time of first event in a selected (24h) period (e.g.06th 08:21:54),last_seen holds time of last event in a selected (24h) period (e.g.06th 15:21:23),sparkline holds a small sparkline graph representing threat's activity in selected period,src_ip holds source IP(s) of a threat (e.g.99.102.41.102),src_port holds source port(s) (e.g.44556, 44589, 44601),dst_ip holds destination IP(s) (e.g.213.202.100.28),dst_port holds destination port(s) (e.g.80 (HTTP)),proto holds protocol(s), (e.g.TCP),trail holds a blacklisted (or heuristic) entry that triggered the event(s),info holds more information about the threat/trail (e.g.known attacker for known attacker's IP addresses oripinfo for known IP information service commonly used by malware during a startup),reference holds a source of the blacklisted entry (e.g.(static) for static trails ormyip.ms for a dynamic feed retrieved from that same source) andtags holds user defined tags for a given trail (e.g.APT28).

When moving mouse oversrc_ip anddst_ip table entries, information tooltip is being displayed with detailed reverse DNS and WHOIS information (Note:RIPE is the information provider):

On mouse over IP

Event details (e.g.src_port,dst_port,proto, etc.) that differ inside same threat entry are condensed in form of a bubble icon (i.e.Ellipsis). This is performed to get an usable reporting interface with as less rows as possible. Moving mouse over such icon will result in a display of an information tooltip with all items held (e.g. all port numbers being scanned byattacker):

On mouse over bubble

Clicking on one such icon will open a new dialog containing all stored items (Note: in their uncondensed form) ready to be Copy-Paste(d) for further analysis:

Ctrl-C dialog

When hovering mouse pointer over the threat's trail for couple of seconds it will result in a frame consisted of results using the trail as a search term performed againstSearch EncryptsearX search engine. In lots of cases, this provides basic information about the threat itself, eliminating the need for user to do the manual search for it. In upper right corner of the opened frame window there are two extra buttons. By clicking the first one (i.e.New tab icon), the resulting frame will be opened inside the new browser's tab (or window), while by clicking the second one (i.e.Close icon) will immediately close the frame (Note: the same action is achieved by moving the mouse pointer outside the frame borders):

On mouse over trail

For each threat there is a columntag that can be filled with arbitrary "tags" to closely describe all threats sharing the same trail. Also, it is a great way to describe threats individually, so all threats sharing the same tag (e.g.yahoo) could be grouped out later:

Tags

Real-life cases

In the following section some of the "usual suspects" scenarios will be described through the real-life cases.

Mass scans

Mass scans is a fairly common phenomenon where individuals and/or organizations give themselves a right to scan the whole 0.0.0.0/0 IP range (i.e. whole Internet) on a daily basis, with disclaimer where they say that if you don't like it then you should contact them privately to be skipped from future scans.

Shodan FileZilla results

To make stuff worse, organizations asShodan andZoomEye give all results freely available (to other potential attackers) through their search engine. In the following screenshots you'll see details of Shodan scans in one single day.

Here is a reverse DNS and WHOIS lookup of the "attacker"'s address:

Shodan 1

When hovering mouse pointer over thetrail column's content (IP address), you'll be presented with the search results fromsearX where you'll be able to find more information about the "attacker":

Shodan 2

In thedst_ip column, if you have a large organization, you'll be presented with large list of scanned IP addresses:Shodan 3

In thedst_port column you'll be able to see all ports that have been scanned by such mass scans:

Shodan 4

In other similar situations you'll see the same behaviour, coming from blacklisted individual attacker(s) (in this case bycinsscore.com):

Known attacker

One more common behaviour is scanning of the whole 0.0.0.0/0 IP range (i.e. Internet) in search for one particular port (e.g. TCP port 443 whenHeartbleed has been found). In the following screenshot you'll find one such case for previously blacklisted attacker(s) (in this case byalienvault.com and two other blacklists) targeting the UDP port 5060 (i.e. SIP) in search formisconfigured VoIP devices:

SIP scan

Anonymous attackers

To spot the potential attackers hidden behind theTor anonymity network, Maltrail utilizes publicly available lists of Tor exit nodes. In the following screenshot you'll see a case where potential attacker has been utilizing the Tor network to access the web target (over HTTP) in our organization's range in suspicious way (total 171 connection requests in 10 minutes):

Tor attacker

Service attackers

Fairly similar case to the previous one is when previously blacklisted attacker tries to access particular (e.g. non-HTTP(s)) service in our organization's range in rather suspicious way (i.e. total 1513 connection attempts in less than 15 minutes):

RDP brute force

If we enter thessh attacker to theFilter field, we'll be able to see all similar occurrences for that day, but in this case for port 22 (i.e. SSH):

SSH attackers filter

Malware

In case of connection attempts coming from infected computers inside our organization toward already known C&C servers, you'll be able to find threats similar to the following (in this caseBeebone):

beebone malware

In case of DNS requests containing knownDGA domain names, threat will be shown like (in this caseNecurs):

necurs malware

In the following case file downloads from blacklisted (in this case bymalwarepatrol.net) URL(s) have occurred:

malware download

If we enter the particular malware name (in this caseRamnit) into theFilter field, only threats that are known to be linked to this malware will be filtered in (showing you all affected internal computers):

ramnit malware

More generally, if we enter themalware into theFilter field, all threats that have been found by malware(-related) trails (e.g.IP addresses) will be filtered in:

malware filter

Suspicious domain lookups

Maltrail uses the static list of TLDdomains that are known to be commonly involved in suspicious activities. Most suchTLD domains are coming from free domain registrars (e.g.Freenom), hence they should be under greater scrutiny. In the following screenshot we can find a case where one such TLD domain.cm has been used by unknown malware using theDGA algorithm to contact itsC&C server(s):

cm DGA

There are also cases when perfectly valid TLD domains (e.g..ru) are used for suspicious activities, such in this case (e.g.long domain name (suspicious)) where the domains are obviously DGA generated by unknown malware:

Suspicious long domains

Maltrail uses staticlist of so-called "dynamic domains" that are often used in suspicious activities (e.g. for malware C&C servers that often change the destination's IP addresses):

Suspicious dynamic domains

Also, Maltrail uses staticlist of "onion"-related domains that are also often used in suspicious activities (e.g. malware contacting C&C servers by using Tor2Web service(s)):

Suspicious onion

In case of old and/or obsolete malware that sits undetected on organization's infected internal computers, there is often a "phenomenon" where malware continuously tries to contact the long dead C&C server's domain without any DNS resolution. Hence, those kind of (potential) threats will be marked asexcessive no such domain (suspicious):

Excessive no such domain name

In case that one trail is responsible for too many threats (e.g. in case of fake source IPs like in DNS amplification attacks), all similar threats will be grouped under a singleflood threat (Note: threat's ID will be marked with suffixF0), like in the following example:

Flood

Suspicious ipinfo requests

Lots of malware uses some kind ofipinfo service (e.g.ipinfo.io) to find out the victim's Internet IP address. In case of regular and especially in out-of-office hours, those kind of requests should be closely monitored, like in the following example:

suspicious ipinfo

By using filteripinfo all potentially infected computers in our organization's range can be listed that share this kind of suspicious behaviour:

ipinfo filter

Suspicious direct file downloads

Maltrail tracks all suspicious direct file download attempts (e.g..apk,.bin,.class,.chm,.dll,.egg,.exe,.hta,.hwp,.lnk,.ps1,.scr,.sct,.wbk and.xpi file extensions). This can trigger lots of false positives, but eventually could help in reconstruction of the chain of infection (Note: legitimate service providers, like Google, usually use encrypted HTTPS to perform this kind of downloads):

Direct .exe download

Suspicious HTTP requests

In case of suspicious requests coming from outer web application security scanners (e.g. searching for SQLi, XSS, LFI, etc. vulnerabilities) and/or the internal user malicious attempts toward unknown web sites, threats like the following could be found (real case of attackers trying to exploit Joomla! CMS CVE-2015-7297, CVE-2015-7857, and CVE-2015-7858vulnerabilities):

SQLi com_contenthistory

In following example, web application vulnerability scan has been marked as "suspicious":

Vulnerability scan

If we click on the bubble icon (i.e.Ellipsis) for details and copy paste the whole content to a textual file, we'll be able to see all suspicious HTTP requests:

Vulnerability scan requests

In the following screenshot, a run of popular SQLi vulnerability toolsqlmap can be found inside our logs:

sqlmap scan requests

Port scanning

In case of too many connection attempts toward considerable amount of different TCP ports, Maltrail will warn about the potential port scanning, as a result of its heuristic mechanism detection. It the following screenshot such warning(s) can be found for a run of popular port scanning toolnmap:

nmap scan

DNS resource exhaustion

One popular DDoS attack against the web server(s) infrastructure is the resource exhaustion of its (main) DNS server by making valid DNS recursion queries for (pseudo)random subdomain names (e.g.abpdrsguvjkyz.www.dedeni.com):

DNS resource exhaustion

Data leakage

Miscellaneous programs (especially mobile-based) present malware(-like) behaviour where they send potentially sensitive data to the remote beacon posts. Maltrail will try to capture such behaviour like in the following example:

Data leakage

False positives

Like in all other security solutions, Maltrail is prone to "false positives". In those kind of cases, Maltrail will (especially in case ofsuspicious threats) record a regular user's behaviour and mark it as malicious and/or suspicious. In the following example it can be seen that a blacklist feed providerblocklist.de marked regular Google server asattacker(s), resulting with the following threat:

Google false positive 1

By hovering mouse over the trail, frame with results fromsearX search show that this is (most probably) a regular Google's server:

Google false positive 2

As another example, access to regular.work domains (popular TLD for malicious purposes) resulted with the following threat:

Suspicious domain false positive

Nevertheless, administrator(s) should invest some extra time and check (with other means) whether the "suspicious" means malicious or not, as in the following example:

Suspicious .ws

Best practice(s)

  1. Install Maltrail:
  • OnUbuntu/Debian

    sudo apt-get install git python3 python3-dev python3-pip python-is-python3 libpcap-dev build-essential procps schedtoolsudo pip3 install pcapy-ngcd /tmpgit clone --depth 1 https://github.com/stamparm/maltrail.gitsudo mv /tmp/maltrail /optsudo chown -R$USER:$USER /opt/maltrail
  • OnSUSE/openSUSE

    sudo zypper install gcc gcc-c++ git libpcap-devel python3-devel python3-pip procps schedtoolsudo pip3 install pcapy-ngcd /tmpgit clone --depth 1 https://github.com/stamparm/maltrail.gitsudo mv /tmp/maltrail /optsudo chown -R$USER:$USER /opt/maltrail
  1. Set working environment:

    sudo mkdir -p /var/log/maltrailsudo mkdir -p /etc/maltrailsudo cp /opt/maltrail/maltrail.conf /etc/maltrailsudo nano /etc/maltrail/maltrail.conf
  2. Set running environment:

    • crontab -e # autostart server & periodic update
    */5 * * * * if [ -n "$(ps -ef | grep -v grep | grep 'server.py')" ]; then : ; else python3 /opt/maltrail/server.py -c /etc/maltrail/maltrail.conf; fi0 1 * * * cd /opt/maltrail && git pull
    • sudo crontab -e # autostart sensor & periodic restart
    */1 * * * * if [ -n "$(ps -ef | grep -v grep | grep 'sensor.py')" ]; then : ; else python3 /opt/maltrail/sensor.py -c /etc/maltrail/maltrail.conf; fi2 1 * * * /usr/bin/pkill -f maltrail
  3. Enable as systemd services (Linux only):

    sudo cp /opt/maltrail/maltrail-sensor.service /etc/systemd/system/maltrail-sensor.servicesudo cp /opt/maltrail/maltrail-server.service /etc/systemd/system/maltrail-server.servicesudo systemctl daemon-reloadsudo systemctl start maltrail-server.servicesudo systemctl start maltrail-sensor.servicesudo systemctlenable maltrail-server.servicesudo systemctlenable maltrail-sensor.servicesystemctl status maltrail-server.service&& systemctl status maltrail-sensor.service

Note:/maltrail-sensor.service can be started as dedicated service without pre-started/maltrail-server.service. This is useful for case, when/maltrail-server.service is installed and works on another machine in you network environment.

License

This software is provided under a MIT License. See the accompanyingLICENSE file for more information.

Sponsors

Developers

Presentations

  • 47th TF-CSIRT Meeting, Prague (Czech Republic), 2016 (slides)

Publications

Blacklist

  • Maltrail's daily updated blacklist of malware-related domains can be foundhere. It is based on trails found attrails/static/malware and can be safely used for DNS traffic blocking purposes.

Thank you

  • Thomas Kristner
  • Eduardo Arcusa Les
  • James Lay
  • Ladislav Baco (@laciKE)
  • John Kristoff (@jtkdpu)
  • Michael Münz (@mimugmail)
  • David Brush
  • @Godwottery
  • Chris Wild (@briskets)

Third-party integrations

1 Using (only) trails

2 Connector to trails (only)


[8]ページ先頭

©2009-2025 Movatter.jp