Geoffrey Frogeye
3dcccad39a
Black pass
9 months ago
Geoffrey Frogeye
a023dc8322
Fix deprecated np.bool
9 months ago
Geoffrey Frogeye
389e83d492
Fix database maximum cache size cap
9 months ago
Geoffrey Frogeye
018f6548ea
Fixed feed_dns not saving in single-threaded mode
Would you believe it, seven hours of processing for nothing
2 years ago
Geoffrey Frogeye
bb9e6de62f
Profiling is now optional
2 years ago
Geoffrey Frogeye
195f41bd9f
Use smaller cache if it cannot allocate
2 years ago
Geoffrey Frogeye
0e7479e23e
Added handling for IPs too big
2 years ago
Geoffrey Frogeye
7d1c1a1d54
Implement pruning
2 years ago
Geoffrey Frogeye
4a22054796
Added optional cache for faster IP matching
2 years ago
Geoffrey Frogeye
aca5023c3f
Fixed scripting around
2 years ago
Geoffrey Frogeye
dce35cb299
Harder verficiation before adding entries to DB
2 years ago
Geoffrey Frogeye
d65107f849
Save dupplicates too
Maybe I won't publish them but this will help me for tracking trackers.
2 years ago
Geoffrey Frogeye
7851b038f5
Reworked rule export
2 years ago
Geoffrey Frogeye
8f6e01c857
Added first_party tracking
Well, tracking if a rule is from a first or a multi rule...
Hope I did not do any mistake
2 years ago
Geoffrey Frogeye
c3bf102289
Made references work
2 years ago
Geoffrey Frogeye
03a4042238
Added level
Also fixed IP logic because this was real messed up
2 years ago
Geoffrey Frogeye
3197fa1663
Remove list usage for IpTreeNode
2 years ago
Geoffrey Frogeye
a0e68f0848
Reworked match and node system
For level, and first_party later
Next: add get_match to retrieve level of source and have correct levels
... am I going somewhere with all this?
2 years ago
Geoffrey Frogeye
aec8d3f8de
Reworked how paths work
Get those tuples out of my eyes
2 years ago
Geoffrey Frogeye
ce52897d30
Smol fixes
2 years ago
Geoffrey Frogeye
d976752797
Store Ip4Path as int instead of List[int]
2 years ago
Geoffrey Frogeye
4d966371b2
Workflow: SQL -> Tree
Welp. All that for this.
2 years ago
Geoffrey Frogeye
ddceed3d25
Workflow: Can now import DnsMass output
Well, in a specific format but DnsMass nonetheless
2 years ago
Geoffrey Frogeye
d7c239a6f6
Workflow: Some modifications
2 years ago
Geoffrey Frogeye
269b8278b5
Worflow: Fixed rules counts
2 years ago
Geoffrey Frogeye
ab7ef609dd
Workflow: Various optimisations and fixes
I forgot to close this one earlier, so:
Closes #7
2 years ago
Geoffrey Frogeye
f3eedcba22
Updated now based on timestamp
Did I forget to add feed_asn.py a few commits ago?
Oh well...
2 years ago
Geoffrey Frogeye
9050a84670
Read-only mode
2 years ago
Geoffrey Frogeye
e19f666331
Workflow: Automatically import IP ranges from ASN
Closes #9
2 years ago
Geoffrey Frogeye
57416b6e2c
Workflow: POO and individual tables per types
Mostly for performances reasons.
First one to implement threading later.
Second one to speed up the dichotomy,
but it doesn't seem that much better so far.
2 years ago
Geoffrey Frogeye
1484733a90
Workflow: Small tweaks
2 years ago
Geoffrey Frogeye
55877be891
IP parsing C accelerated, use bytes everywhere
2 years ago
Geoffrey Frogeye
7937496882
Workflow: Base for new one
While I'm automating this you'll need to download the A set from
https://opendata.rapid7.com/sonar.fdns_v2/ to the file a.json.gz.
2 years ago