Geoffrey Frogeye
018f6548ea
Fixed feed_dns not saving in single-threaded mode
Would you believe it, seven hours of processing for nothing
1 year ago
Geoffrey Frogeye
bb9e6de62f
Profiling is now optional
1 year ago
Geoffrey Frogeye
195f41bd9f
Use smaller cache if it cannot allocate
1 year ago
Geoffrey Frogeye
0e7479e23e
Added handling for IPs too big
1 year ago
Geoffrey Frogeye
7d1c1a1d54
Implement pruning
1 year ago
Geoffrey Frogeye
4a22054796
Added optional cache for faster IP matching
1 year ago
Geoffrey Frogeye
aca5023c3f
Fixed scripting around
1 year ago
Geoffrey Frogeye
dce35cb299
Harder verficiation before adding entries to DB
1 year ago
Geoffrey Frogeye
d65107f849
Save dupplicates too
Maybe I won't publish them but this will help me for tracking trackers.
1 year ago
Geoffrey Frogeye
7851b038f5
Reworked rule export
1 year ago
Geoffrey Frogeye
8f6e01c857
Added first_party tracking
Well, tracking if a rule is from a first or a multi rule...
Hope I did not do any mistake
1 year ago
Geoffrey Frogeye
c3bf102289
Made references work
1 year ago
Geoffrey Frogeye
03a4042238
Added level
Also fixed IP logic because this was real messed up
1 year ago
Geoffrey Frogeye
3197fa1663
Remove list usage for IpTreeNode
1 year ago
Geoffrey Frogeye
a0e68f0848
Reworked match and node system
For level, and first_party later
Next: add get_match to retrieve level of source and have correct levels
... am I going somewhere with all this?
1 year ago
Geoffrey Frogeye
aec8d3f8de
Reworked how paths work
Get those tuples out of my eyes
1 year ago
Geoffrey Frogeye
ce52897d30
Smol fixes
1 year ago
Geoffrey Frogeye
d976752797
Store Ip4Path as int instead of List[int]
1 year ago
Geoffrey Frogeye
4d966371b2
Workflow: SQL -> Tree
Welp. All that for this.
1 year ago
Geoffrey Frogeye
ddceed3d25
Workflow: Can now import DnsMass output
Well, in a specific format but DnsMass nonetheless
1 year ago
Geoffrey Frogeye
d7c239a6f6
Workflow: Some modifications
1 year ago
Geoffrey Frogeye
269b8278b5
Worflow: Fixed rules counts
1 year ago
Geoffrey Frogeye
ab7ef609dd
Workflow: Various optimisations and fixes
I forgot to close this one earlier, so:
Closes #7
1 year ago
Geoffrey Frogeye
f3eedcba22
Updated now based on timestamp
Did I forget to add feed_asn.py a few commits ago?
Oh well...
1 year ago
Geoffrey Frogeye
9050a84670
Read-only mode
1 year ago
Geoffrey Frogeye
e19f666331
Workflow: Automatically import IP ranges from ASN
Closes #9
1 year ago
Geoffrey Frogeye
57416b6e2c
Workflow: POO and individual tables per types
Mostly for performances reasons.
First one to implement threading later.
Second one to speed up the dichotomy,
but it doesn't seem that much better so far.
1 year ago
Geoffrey Frogeye
1484733a90
Workflow: Small tweaks
1 year ago
Geoffrey Frogeye
55877be891
IP parsing C accelerated, use bytes everywhere
1 year ago
Geoffrey Frogeye
7937496882
Workflow: Base for new one
While I'm automating this you'll need to download the A set from
https://opendata.rapid7.com/sonar.fdns_v2/ to the file a.json.gz.
1 year ago