geoffrey/eulaurarien
1
0
Fork 0
Code Issues 7 Pull requests Releases 1 Wiki Activity

Improved DNS resolving performances

Browse source 
Also various fixes.
Also some debug stuff, make sure to remove that later.
This commit is contained in:
Geoffrey Frogeye 2019-12-03 15:35:21 +01:00
parent c609b90390
commit 0159c6037c
Signed by: geoffrey
GPG key ID: D8A7ECA00A8CD3DD
5 changed files with 34 additions and 10 deletions
Download patch file Download diff file Expand all files Collapse all files

5
resolve_subdomains.sh
View file

@ -1,7 +1,10 @@
#!/usr/bin/env bash
# Resolve the CNAME chain of all the known subdomains for later analysis
echo "Compiling subdomain lists..." > /dev/stderr
cat subdomains/*.list | sort -u > temp/all_subdomains.list
./resolve_subdomains.py --input temp/all_subdomains.list --output temp/all_resolved.csv
# Sort by last character to utilize the DNS server caching mechanism
rev temp/all_subdomains.list | sort | rev > temp/all_subdomains_reversort.list
./resolve_subdomains.py --input temp/all_subdomains_reversort.list --output temp/all_resolved.csv
sort -u temp/all_resolved.csv > temp/all_resolved_sorted.csv