Geoffrey Frogeye
3dcccad39a
Black pass
1 year ago
Geoffrey Frogeye
a023dc8322
Fix deprecated np.bool
1 year ago
Geoffrey Frogeye
389e83d492
Fix database maximum cache size cap
1 year ago
Geoffrey Frogeye
edf444cc28
Add ad-cloud.jp and improve names of Japanese trackers
Closes #19
Names from https://github.com/AdguardTeam/cname-trackers/issues/1
1 year ago
Geoffrey Frogeye
fa23d466d2
Actually remove ThreatMetrix
Forgot -i when grepping
1 year ago
Geoffrey Frogeye
f5f9f88c42
Remove ThreatMetrix
I received a lot of false positives for this one,
and while I wasn't able to reproduce the issue in most of the cases,
I trust the community.
It's also not in any other CNAME tracker list, probably for the same reason.
Plus, it's apparently not very nasty.
So I'll let it go.
Closes #17
1 year ago
Geoffrey Frogeye
2997e41f98
Investigated >0.5% trackers from Fukuda paper
2 years ago
Geoffrey Frogeye
6cf1028174
Added other tracking source for Adobe
Found on the Adobe documentation and in the wild
https://experienceleague.adobe.com/docs/analytics/implementation/vars/config-vars/trackingserversecure.html?lang=en#s.trackingserversecure-in-appmeasurement-and-launch-custom-code-editor
2 years ago
Geoffrey Frogeye
b98a37f9da
Add 1st chain Act-On
To unclobber -only lists
2 years ago
Geoffrey Frogeye
8828d4cf24
Investigated >1% trackers from Fukuda paper
2 years ago
Geoffrey Frogeye
04205dd9fc
Add AdGuard in the distribution README
2 years ago
Geoffrey Frogeye
cec96b7e50
Add Fukuda & co research paper to test suite
2 years ago
Geoffrey Frogeye
eb1fcefd49
Use more correct terms
2 years ago
Geoffrey Frogeye
0ecb431728
Add AdGuard for multiparty
2 years ago
Geoffrey Frogeye
c1619b3cff
Add more sources and acknowledgement
2 years ago
Geoffrey Frogeye
2c0286e36b
Add genieesspv.jp CNAME tracker
Closes #18
2 years ago
Geoffrey Frogeye
954bc86eaa
More Tracedock domains
From https://gist.github.com/pietvanzoen/ed7b8322a552542bc00a83ced7332d33
2 years ago
Geoffrey Frogeye
b09f861c27
README: Added more reasons the browsers trust first party
3 years ago
Geoffrey Frogeye
9326dc6aca
Added similar projects
3 years ago
Geoffrey Frogeye
c803a714fa
I don't know how to write the word “explanation“...
3 years ago
Geoffrey Frogeye
b3a3219f93
Improved usage scenarios for different lists
3 years ago
Geoffrey Frogeye
fbc06f71bb
Added symlink to latest explaination
3 years ago
Geoffrey Frogeye
63ab7651fc
Disabled RDNS import due to #15
3 years ago
Geoffrey Frogeye
0724feed26
README: Removed help message and fixed category for finder
3 years ago
Geoffrey Frogeye
adb07417f5
Fixed import_rapid7 script typo
3 years ago
Geoffrey Frogeye
0cc18303fd
Re-import Rapid7 datasets when rules have been updated
3 years ago
Geoffrey Frogeye
708c53041e
Added two japanese trackers
3 years ago
Geoffrey Frogeye
808e36dde3
Improvements to subdomain collection
I use this for tracker identification so it's not perfect but still it's
a bit better.
3 years ago
Geoffrey Frogeye
2b97ee4cb9
Better list output
3 years ago
Geoffrey Frogeye
fd8bfee088
Improved -only variants descriptions
3 years ago
Geoffrey Frogeye
e93807142c
Explanations folder
3 years ago
Geoffrey Frogeye
a4a908955a
Added index webpage
3 years ago
Geoffrey Frogeye
7e06e98808
Added TraceDock FP tracker
Thought they did change the URL of their load balancers,
guess I was wrong.
3 years ago
Geoffrey Frogeye
4fca68c6f0
Fixed handling of unknown field error
3 years ago
Geoffrey Frogeye
54a9c78534
Handled another error
3 years ago
Geoffrey Frogeye
171fa93873
Force pv output
Even if redirected to a file
Allow to see progress when ran in a cron or something
3 years ago
Geoffrey Frogeye
095e51fad9
Ensure massdns output is lower case
For some reason some server output part of their response as upper case.
This fails the reading process as it's designed to only work on lower
case for performance reasons.
3 years ago
Geoffrey Frogeye
883942ba55
Allow custom massdns path
3 years ago
Geoffrey Frogeye
d3b244f317
Forgot one dependency
3 years ago
Geoffrey Frogeye
018f6548ea
Fixed feed_dns not saving in single-threaded mode
Would you believe it, seven hours of processing for nothing
3 years ago
Geoffrey Frogeye
0b9e2d0975
Validate also lower the case of domains
3 years ago
Geoffrey Frogeye
2bcf6cbbf7
Added SINGLE_PROCESS environment variable
3 years ago
Geoffrey Frogeye
b310ca2fc2
Clever pruning mechanism
3 years ago
Geoffrey Frogeye
bb9e6de62f
Profiling is now optional
3 years ago
Geoffrey Frogeye
c543e0eab6
Make multi-processing optional for feed_dns
3 years ago
Geoffrey Frogeye
195f41bd9f
Use smaller cache if it cannot allocate
3 years ago
Geoffrey Frogeye
0e7479e23e
Added handling for IPs too big
3 years ago
Geoffrey Frogeye
9f343ed296
Removed debug print
3 years ago
Geoffrey Frogeye
c65ae94892
Added ability to use Rapid7 API
Closes #11
3 years ago
Geoffrey Frogeye
7d1c1a1d54
Implement pruning
3 years ago
