7 commits

Author	SHA1	Message	Date
Geoffrey Frogeye	d6df0fd4f9	Tracker: Webtrekk	2019-12-07 21:21:33 +01:00
Geoffrey Frogeye	ae71d6b204	Tracker: 2o7	2019-12-07 19:17:18 +01:00
Geoffrey Frogeye	0b2eb000c3	FP: ThreatMetrix	2019-12-07 18:23:11 +01:00
Geoffrey Frogeye	025370bbbe	Splitted list with curated and not curated ... Closes #2	2019-12-05 19:15:24 +01:00
Geoffrey Frogeye	0159c6037c	Improved DNS resolving performances ... Also various fixes. Also some debug stuff, make sure to remove that later.	2019-12-03 15:35:21 +01:00
Geoffrey Frogeye	69b82d29fd	Improved rules handling ... Rules can now come in 3 different formats: - AdBlock rules - Host lists - Domains lists All will be converted into domain lists and aggregated (only AdBlock rules matching a whole domain will be kept). Subdomains will now be matched if it is a subdomain of any domain of the rule. It is way faster (seconds rather than hours!) but less flexible (although it shouldn't be a problem).	2019-12-03 08:48:12 +01:00
Geoffrey Frogeye	7d01d016a5	Can now use AdBlock lists for tracking matching ... It's not very performant by itself, especially since pyre2 isn't maintained nor really compilableinstallable anymore. The performance seems to have decreased from 200 req/s to 0.2 req/s when using 512 threads, and to 80 req/s using 64 req/s. This might or might not be related,as the CPU doesn't seem to be the bottleneck. I will probably add support for host-based rules, matching the subdomains of such hosts (as for now there doesn't seem to be any other pattern for first-party trackers than subdomains, and this would be a very broad performace / compatibility with existing lists improvement), and convert the AdBlock lists to this format, only keeping domains-only rules.	2019-11-15 08:57:31 +01:00