Geoffrey Frogeye
c803a714fa
I don't know how to write the word “explanation“...
2020-01-11 11:31:16 +01:00
Geoffrey Frogeye
b3a3219f93
Improved usage scenarios for different lists
2020-01-11 11:26:54 +01:00
Geoffrey Frogeye
fbc06f71bb
Added symlink to latest explaination
2020-01-07 14:37:01 +01:00
Geoffrey Frogeye
63ab7651fc
Disabled RDNS import due to #15
2020-01-07 14:17:38 +01:00
Geoffrey Frogeye
0724feed26
README: Removed help message and fixed category for finder
2020-01-06 16:44:45 +01:00
Geoffrey Frogeye
adb07417f5
Fixed import_rapid7 script typo
2020-01-05 22:35:12 +01:00
Geoffrey Frogeye
0cc18303fd
Re-import Rapid7 datasets when rules have been updated
2020-01-04 10:54:46 +01:00
Geoffrey Frogeye
708c53041e
Added two japanese trackers
2020-01-03 22:09:16 +01:00
Geoffrey Frogeye
808e36dde3
Improvements to subdomain collection
...
I use this for tracker identification so it's not perfect but still it's
a bit better.
2020-01-03 22:08:06 +01:00
Geoffrey Frogeye
2b97ee4cb9
Better list output
2019-12-27 21:46:57 +01:00
Geoffrey Frogeye
fd8bfee088
Improved -only variants descriptions
2019-12-27 15:58:20 +01:00
Geoffrey Frogeye
e93807142c
Explanations folder
2019-12-27 15:35:30 +01:00
Geoffrey Frogeye
a4a908955a
Added index webpage
2019-12-27 15:21:33 +01:00
Geoffrey Frogeye
7e06e98808
Added TraceDock FP tracker
...
Thought they did change the URL of their load balancers,
guess I was wrong.
2019-12-27 13:43:38 +01:00
Geoffrey Frogeye
4fca68c6f0
Fixed handling of unknown field error
2019-12-27 01:10:21 +01:00
Geoffrey Frogeye
54a9c78534
Handled another error
2019-12-26 20:38:35 +01:00
Geoffrey Frogeye
171fa93873
Force pv output
...
Even if redirected to a file
Allow to see progress when ran in a cron or something
2019-12-26 15:38:56 +01:00
Geoffrey Frogeye
095e51fad9
Ensure massdns output is lower case
...
For some reason some server output part of their response as upper case.
This fails the reading process as it's designed to only work on lower
case for performance reasons.
2019-12-26 15:32:24 +01:00
Geoffrey Frogeye
883942ba55
Allow custom massdns path
2019-12-26 00:33:23 +01:00
Geoffrey Frogeye
d3b244f317
Forgot one dependency
2019-12-26 00:16:18 +01:00
Geoffrey Frogeye
018f6548ea
Fixed feed_dns not saving in single-threaded mode
...
Would you believe it, seven hours of processing for nothing
2019-12-26 00:02:01 +01:00
Geoffrey Frogeye
0b9e2d0975
Validate also lower the case of domains
2019-12-25 15:31:20 +01:00
Geoffrey Frogeye
2bcf6cbbf7
Added SINGLE_PROCESS environment variable
2019-12-25 15:15:49 +01:00
Geoffrey Frogeye
b310ca2fc2
Clever pruning mechanism
2019-12-25 14:54:57 +01:00
Geoffrey Frogeye
bb9e6de62f
Profiling is now optional
2019-12-25 13:52:19 +01:00
Geoffrey Frogeye
c543e0eab6
Make multi-processing optional for feed_dns
2019-12-25 13:04:15 +01:00
Geoffrey Frogeye
195f41bd9f
Use smaller cache if it cannot allocate
2019-12-25 13:03:55 +01:00
Geoffrey Frogeye
0e7479e23e
Added handling for IPs too big
2019-12-25 12:35:06 +01:00
Geoffrey Frogeye
9f343ed296
Removed debug print
2019-12-24 15:12:38 +01:00
Geoffrey Frogeye
c65ae94892
Added ability to use Rapid7 API
...
Closes #11
2019-12-24 15:08:18 +01:00
Geoffrey Frogeye
7d1c1a1d54
Implement pruning
2019-12-21 19:38:20 +01:00
Geoffrey Frogeye
1a6e64da3d
Forgot numpy dependency
2019-12-20 21:08:21 +01:00
Geoffrey Frogeye
d66040a7b6
Added some litterature
...
Well not really litterature in the scientific term but still something
to read
2019-12-20 18:22:15 +01:00
Geoffrey Frogeye
57e2919f25
Added information about CORS security issue
2019-12-20 17:58:53 +01:00
Geoffrey Frogeye
94acd106da
Acknwoledgments
...
Gesundheit
2019-12-20 17:46:24 +01:00
Geoffrey Frogeye
885d92dd77
Added LICENSE
2019-12-20 17:38:26 +01:00
Geoffrey Frogeye
8b7e538677
Updated links
...
(could not bother guessing them)
2019-12-20 17:24:05 +01:00
Geoffrey Frogeye
cd46b39756
Merge branch 'newworkflow'
2019-12-20 17:18:42 +01:00
Geoffrey Frogeye
38cf532854
Updated README
...
Split in two actually (program and list).
Closes #3
Also,
Closes #1
Because I forgot to do it earlier.
2019-12-20 17:15:39 +01:00
Geoffrey Frogeye
53b14c6ffa
Removed TODO placeholders in commands description
...
It's better than nothing but not by that much
2019-12-19 08:07:01 +01:00
Geoffrey Frogeye
c81be4825c
Automated tests
...
Very rudimentary but should do the trick
Closes #4
2019-12-18 22:46:00 +01:00
Geoffrey Frogeye
4a22054796
Added optional cache for faster IP matching
2019-12-18 21:40:24 +01:00
Geoffrey Frogeye
06b745890c
Added other first-party trackers
2019-12-18 17:03:05 +01:00
Geoffrey Frogeye
aca5023c3f
Fixed scripting around
2019-12-18 13:01:32 +01:00
Geoffrey Frogeye
dce35cb299
Harder verficiation before adding entries to DB
2019-12-17 19:53:05 +01:00
Geoffrey Frogeye
747fe46ad0
Script to automatically download from Rapid7 datasets
2019-12-17 15:04:19 +01:00
Geoffrey Frogeye
b43cb1725c
Autosave
...
Not needed but since the import may take multiple hour I get frustrated
if this gets interrupted for some reason.
2019-12-17 15:02:42 +01:00
Geoffrey Frogeye
f5c60c482a
Merge branch 'master' of git.frogeye.fr:geoffrey/eulaurarien
2019-12-17 14:28:38 +01:00
Geoffrey Frogeye
12ecfa1a5d
Added outdated documentation warning in README
2019-12-17 14:28:23 +01:00
Geoffrey Frogeye
e882e09b37
Added outdated documentation warning in README
2019-12-17 14:27:43 +01:00