eulaurarien/resolve_subdomains.sh

#!/usr/bin/env bash

# Resolve the CNAME chain of all the known subdomains for later analysis
cat subdomains/*.list | sort -u > temp/all_subdomains.list
./resolve_subdomains.py --input temp/all_subdomains.list --output temp/all_resolved.csv
sort -u temp/all_resolved.csv > temp/all_resolved_sorted.csv
Improved rules handling Rules can now come in 3 different formats: - AdBlock rules - Host lists - Domains lists All will be converted into domain lists and aggregated (only AdBlock rules matching a whole domain will be kept). Subdomains will now be matched if it is a subdomain of any domain of the rule. It is way faster (seconds rather than hours!) but less flexible (although it shouldn't be a problem). 2019-12-03 07:48:12 +00:00			`#!/usr/bin/env bash`

			`# Resolve the CNAME chain of all the known subdomains for later analysis`
			`cat subdomains/*.list \| sort -u > temp/all_subdomains.list`
			`./resolve_subdomains.py --input temp/all_subdomains.list --output temp/all_resolved.csv`
			`sort -u temp/all_resolved.csv > temp/all_resolved_sorted.csv`