- Notifications
You must be signed in to change notification settings - Fork15
Concurrent Rapid7 FDNS dataset parser
License
jimen0/fdns
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
Packagefdns parsesRapid7Forward DNS dataset in a concurrent way. The parser reports found entries (subdomains, IP addresses, records, etc) for the given record and domain.
Behaviour has changed since the project was created. NowA record reports DNS names instead of IP addresses.
This project is deprecated and will be used to experiment with non-reflection APIs. Please, do not rely on it being backwards compatible. Docker images might be deleted at any time.
go install github.com/mailru/easyjson/...@v0.7.7git clone --depth 1 https://github.com/jimen0/fdns.gitcd fdnsgo generatego install cmd/fdns/fdns.go
docker container run --rm -it ghcr.io/jimen0/fdns/fdns:v2.0.2➜fdnsUsage of fdns: --domains strings domains of which subdomains are discovered --file string path of the dataset (can't be used with url) --goroutines int number of goroutines (default 4) --records strings records that will be parsed a|aaaa|cname|ns|ptr --substrings strings substrings to match (ignores record types) --url string URL of the dataset (can't be used with file) --verbose enable verbose error messages
docker container run \ --rm \ -it \ fdns \ --domains .yahoo.com,.github.com \ --records a,aaaa,cname \ --goroutines 4 \ --url https://opendata.rapid7.com/sonar.fdns_v2/2020-07-24-1595549209-fdns_any.json.gz \ --verbose
Please, remember that for old datasets, Rapid7 requires you to login before downloading them. This tool only aims to be used with the most recent release of them, therefore it doesn't support that logic. Feel free to submit a PR or fork the project if you need it.
Just rungo test -race -v ./... inside of the project's root folder.
Submit a PR or open an issue. Just make sure that your PR passesgofmt,golint andgo vet.
About
Concurrent Rapid7 FDNS dataset parser