Skip to content
This repository has been archived by the owner on Mar 24, 2023. It is now read-only.

[OpenKAT v1.6] Feature/multipart download #61

Merged
merged 20 commits into from
Jan 24, 2023

Conversation

Donnype
Copy link
Contributor

@Donnype Donnype commented Jan 11, 2023

The feature in screenshots

The new objects found by the find_images_in_html normalizer: site images

img_scanme

Image is downloaded by website_analysis boefje with image/png mime type:

raw_img_scanme

New normalizer running on image mime types:

scanme_norm_img

New ImageMeta objects created by that normalizer:

img_meta

@Donnype Donnype requested a review from a team as a code owner January 11, 2023 14:35
Copy link
Contributor

@underdarknl underdarknl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me!
Awesome steps into getting the whole train up and running.

@Darwinkel
Copy link
Contributor

Tests are failing because of an Octopoes import. Am I correct in assuming that this will fix itself once minvws/nl-kat-octopoes#38 has been merged? (I will do a functional test later today)

@underdarknl
Copy link
Contributor

Tests are failing because of an Octopoes import. Am I correct in assuming that this will fix itself once minvws/nl-kat-octopoes#38 has been merged? (I will do a functional test later today)

Yup, this would make sense. I think the mentioned PR looks good, so if you could check them I think we can merge.

@Darwinkel
Copy link
Contributor

Works as advertised in conjunction with minvws/nl-kat-octopoes#38. Below finding was discovered automatically from a hostname plus nmap Boefje enabled on port 80 and 443.

image

Darwinkel
Darwinkel previously approved these changes Jan 16, 2023
Copy link
Contributor

@Darwinkel Darwinkel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Octopoes v1.5.0rc1 is currently hardcoded in the Boefjes requirements (monorepo will fix this) and thus the tests do not take into account the new model. However, the tests pass on my machine with octopoes pinned on 3d4a6ad.

underdarknl
underdarknl previously approved these changes Jan 16, 2023
@underdarknl underdarknl changed the title Feature/multipart download [OpenKAT v1.6] Feature/multipart download Jan 17, 2023
@Donnype Donnype dismissed stale reviews from underdarknl and Darwinkel via 94c4260 January 17, 2023 16:15
Copy link
Contributor

@ammar92 ammar92 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cool stuff. Just a few remarks.

Test and stubs look good 👍 I had only one remark and a question for this

boefjes/plugins/kat_webpage_analysis/main.py Outdated Show resolved Hide resolved
boefjes/plugins/kat_webpage_analysis/main.py Outdated Show resolved Hide resolved
tests/__init__.py Outdated Show resolved Hide resolved
tests/test_bodyimage.py Show resolved Hide resolved
Donnype and others added 6 commits January 24, 2023 13:07
…but log them and make sure to add an ended_at and save the normalizer_meta to bytes.

Signed-off-by: Donny Peeters <[email protected]>
Signed-off-by: Donny Peeters <[email protected]>
Signed-off-by: Donny Peeters <[email protected]>
Signed-off-by: Donny Peeters <[email protected]>
Signed-off-by: Donny Peeters <[email protected]>
ammar92
ammar92 previously approved these changes Jan 24, 2023
Copy link
Contributor

@ammar92 ammar92 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No remarks!

@underdarknl underdarknl merged commit f50b359 into main Jan 24, 2023
@underdarknl underdarknl deleted the feature/multipart-download branch January 24, 2023 16:29
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants