Generates a host list of first-party trackers for ad-blocking.
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

10 lines
515 B

  1. #!/usr/bin/env bash
  2. # Resolve the CNAME chain of all the known subdomains for later analysis
  3. echo "Compiling subdomain lists..." > /dev/stderr
  4. pv subdomains/*.list | sort -u > temp/all_subdomains.list
  5. # Sort by last character to utilize the DNS server caching mechanism
  6. pv temp/all_subdomains.list | rev | sort | rev > temp/all_subdomains_reversort.list
  7. ./resolve_subdomains.py --input temp/all_subdomains_reversort.list --output temp/all_resolved.csv
  8. sort -u temp/all_resolved.csv > temp/all_resolved_sorted.csv