Geoffrey Frogeye
3b6f7a58b3
Remove support for Rapid7
They changed their privacy / pricing model and as such I don't have
access to their massive DNS dataset anymore,
even after asking.
Since 2022-01-02, I put the list on freeze while looking for an alternative,
but couldn't find any.
To make the list update again with the remaining DNS sources I have,
I put the last version of the list generated with the Rapid7 dataset
as an input for subdomains, that will now get resolved with MassDNS.
5 months ago
Geoffrey Frogeye
49a36f32f2
Add requirements.txt file
1 year ago
Geoffrey Frogeye
29cf72ae92
Fix most of the README being bold
Why did I go with this Markdown generator again?
2 years ago
Geoffrey Frogeye
998c3faf8f
Add SAS.com
2 years ago
Geoffrey Frogeye
c8a14a4e21
Add DataUnlocker
2 years ago
Geoffrey Frogeye
1ec26e7f96
Add Plausible.io
2 years ago
Geoffrey Frogeye
5b49441bc0
Add Branch.io tracker
2 years ago
Geoffrey Frogeye
afd122f2ab
Update usage recommendations
2 years ago
Geoffrey Frogeye
6ae3d5fb55
Add Lead Forensics tracker
2 years ago
Geoffrey Frogeye
10a505d84f
Add Fathom
2 years ago
Geoffrey Frogeye
c06648da53
Added Pardot tracker
2 years ago
Geoffrey Frogeye
f165e5a094
Fix (most) mypy / flake8 errors
2 years ago
Geoffrey Frogeye
3dcccad39a
Black pass
2 years ago
Geoffrey Frogeye
a023dc8322
Fix deprecated np.bool
2 years ago
Geoffrey Frogeye
389e83d492
Fix database maximum cache size cap
2 years ago
Geoffrey Frogeye
edf444cc28
Add ad-cloud.jp and improve names of Japanese trackers
Closes #19
Names from https://github.com/AdguardTeam/cname-trackers/issues/1
2 years ago
Geoffrey Frogeye
fa23d466d2
Actually remove ThreatMetrix
Forgot -i when grepping
2 years ago
Geoffrey Frogeye
f5f9f88c42
Remove ThreatMetrix
I received a lot of false positives for this one,
and while I wasn't able to reproduce the issue in most of the cases,
I trust the community.
It's also not in any other CNAME tracker list, probably for the same reason.
Plus, it's apparently not very nasty.
So I'll let it go.
Closes #17
2 years ago
Geoffrey Frogeye
2997e41f98
Investigated >0.5% trackers from Fukuda paper
2 years ago
Geoffrey Frogeye
6cf1028174
Added other tracking source for Adobe
Found on the Adobe documentation and in the wild
https://experienceleague.adobe.com/docs/analytics/implementation/vars/config-vars/trackingserversecure.html?lang=en#s.trackingserversecure-in-appmeasurement-and-launch-custom-code-editor
2 years ago
Geoffrey Frogeye
b98a37f9da
Add 1st chain Act-On
To unclobber -only lists
2 years ago
Geoffrey Frogeye
8828d4cf24
Investigated >1% trackers from Fukuda paper
2 years ago
Geoffrey Frogeye
04205dd9fc
Add AdGuard in the distribution README
2 years ago
Geoffrey Frogeye
cec96b7e50
Add Fukuda & co research paper to test suite
2 years ago
Geoffrey Frogeye
eb1fcefd49
Use more correct terms
2 years ago
Geoffrey Frogeye
0ecb431728
Add AdGuard for multiparty
2 years ago
Geoffrey Frogeye
c1619b3cff
Add more sources and acknowledgement
2 years ago
Geoffrey Frogeye
2c0286e36b
Add genieesspv.jp CNAME tracker
Closes #18
3 years ago
Geoffrey Frogeye
954bc86eaa
More Tracedock domains
From https://gist.github.com/pietvanzoen/ed7b8322a552542bc00a83ced7332d33
3 years ago
Geoffrey Frogeye
b09f861c27
README: Added more reasons the browsers trust first party
3 years ago
Geoffrey Frogeye
9326dc6aca
Added similar projects
3 years ago
Geoffrey Frogeye
c803a714fa
I don't know how to write the word “explanation“...
3 years ago
Geoffrey Frogeye
b3a3219f93
Improved usage scenarios for different lists
3 years ago
Geoffrey Frogeye
fbc06f71bb
Added symlink to latest explaination
3 years ago
Geoffrey Frogeye
63ab7651fc
Disabled RDNS import due to #15
3 years ago
Geoffrey Frogeye
0724feed26
README: Removed help message and fixed category for finder
3 years ago
Geoffrey Frogeye
adb07417f5
Fixed import_rapid7 script typo
3 years ago
Geoffrey Frogeye
0cc18303fd
Re-import Rapid7 datasets when rules have been updated
3 years ago
Geoffrey Frogeye
708c53041e
Added two japanese trackers
3 years ago
Geoffrey Frogeye
808e36dde3
Improvements to subdomain collection
I use this for tracker identification so it's not perfect but still it's
a bit better.
3 years ago
Geoffrey Frogeye
2b97ee4cb9
Better list output
3 years ago
Geoffrey Frogeye
fd8bfee088
Improved -only variants descriptions
3 years ago
Geoffrey Frogeye
e93807142c
Explanations folder
3 years ago
Geoffrey Frogeye
a4a908955a
Added index webpage
3 years ago
Geoffrey Frogeye
7e06e98808
Added TraceDock FP tracker
Thought they did change the URL of their load balancers,
guess I was wrong.
3 years ago
Geoffrey Frogeye
4fca68c6f0
Fixed handling of unknown field error
3 years ago
Geoffrey Frogeye
54a9c78534
Handled another error
3 years ago
Geoffrey Frogeye
171fa93873
Force pv output
Even if redirected to a file
Allow to see progress when ran in a cron or something
3 years ago
Geoffrey Frogeye
095e51fad9
Ensure massdns output is lower case
For some reason some server output part of their response as upper case.
This fails the reading process as it's designed to only work on lower
case for performance reasons.
3 years ago
Geoffrey Frogeye
883942ba55
Allow custom massdns path
3 years ago