-
Notifications
You must be signed in to change notification settings - Fork 12
[OpenKAT v1.6] Feature/multipart download #61
Conversation
… from one boefje, while also using external supplied mime-types
…roduces"-field being overwritten for normalizer plugins.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me!
Awesome steps into getting the whole train up and running.
Tests are failing because of an Octopoes import. Am I correct in assuming that this will fix itself once minvws/nl-kat-octopoes#38 has been merged? (I will do a functional test later today) |
Yup, this would make sense. I think the mentioned PR looks good, so if you could check them I think we can merge. |
Works as advertised in conjunction with minvws/nl-kat-octopoes#38. Below finding was discovered automatically from a hostname plus nmap Boefje enabled on port 80 and 443. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Octopoes v1.5.0rc1 is currently hardcoded in the Boefjes requirements (monorepo will fix this) and thus the tests do not take into account the new model. However, the tests pass on my machine with octopoes pinned on 3d4a6ad
.
…-boefjes into feature/multipart-download
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Cool stuff. Just a few remarks.
Test and stubs look good 👍 I had only one remark and a question for this
boefjes/plugins/kat_webpage_analysis/find_images_in_html/normalize.py
Outdated
Show resolved
Hide resolved
…but log them and make sure to add an ended_at and save the normalizer_meta to bytes. Signed-off-by: Donny Peeters <[email protected]>
Signed-off-by: Donny Peeters <[email protected]>
Signed-off-by: Donny Peeters <[email protected]>
Signed-off-by: Donny Peeters <[email protected]>
Signed-off-by: Donny Peeters <[email protected]>
… feature/multipart-download
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
No remarks!
Signed-off-by: Donny Peeters <[email protected]>
The feature in screenshots
The new objects found by the find_images_in_html normalizer: site images
Image is downloaded by website_analysis boefje with image/png mime type:
New normalizer running on image mime types:
New ImageMeta objects created by that normalizer: