Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release/2.1.0 #1147

Merged
merged 146 commits into from
Jun 22, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
146 commits
Select commit Hold shift + click to select a range
567cbce
Update models.py
iuime Dec 13, 2023
738dc06
Update forms.py
iuime Dec 13, 2023
7850694
Update common_func.py
iuime Dec 13, 2023
daf11b2
Update notification.html
iuime Dec 13, 2023
ef69478
Update 0001_initial.py
iuime Dec 13, 2023
a910f20
Update views.py
iuime Dec 13, 2023
bf57294
Update tasks.py
iuime Dec 13, 2023
35390e1
Update notification.html
iuime Dec 13, 2023
7f127f5
Update notification.html
iuime Dec 13, 2023
e93b51b
Update common_func.py
iuime Dec 13, 2023
ecebf3b
Fix importing of CIDR blocks as targets: https://github.com/yogeshojh…
phil-behnke Feb 22, 2024
3b50bff
Fix resolving CIDR blocks on "Resolve and add IP Address" tab: https:…
phil-behnke Feb 22, 2024
d15417e
Create entries in database for domains added via resolving an IP
pbehnke-ep Feb 26, 2024
a10b5b1
Disable strict checking of host bits in cidr notation. See https://do…
pbehnke-ep Feb 27, 2024
6e1ba74
arm64 build
vncloudsco Mar 8, 2024
ad99457
combine install layers
sa7mon Mar 14, 2024
9374051
delete go modules
sa7mon Mar 14, 2024
3c6bb23
update optimize dockerfile
vncloudsco Mar 15, 2024
a9bc2a2
squeeze image
sa7mon Mar 15, 2024
756d94a
use django-env in settings.py
fopina Apr 16, 2024
ccbaeff
remove obsolete compose version
May 6, 2024
97d474c
update Dockerfile for multi-platform support
May 6, 2024
d2d0938
Update Infoga github link
psyray Dec 4, 2023
872828f
Drop infoga in favor of h8mail
psyray Dec 5, 2023
5b820fb
Update common_func.py
TH3xACE Mar 21, 2024
206ee93
Bug Correction : custom scan engine dump and load
TH3xACE Mar 21, 2024
674b8d5
Fix Txt File Var Declaration
specters312 Apr 30, 2024
c5e158f
Fix "subdomain" s3 bucket
Talanor May 7, 2024
f62aade
remove duplicate gospider references
Talanor May 7, 2024
1d63631
Revert "remove duplicate gospider references"
metehan-arslan May 9, 2024
fc7ae26
Revert "Fix "subdomain" s3 bucket"
metehan-arslan May 9, 2024
e4d532a
Revert "Fix Txt File Var Declaration"
metehan-arslan May 9, 2024
e59a270
Revert "Bug Correction : custom scan engine dump and load"
metehan-arslan May 9, 2024
76dbea8
Revert "Update common_func.py"
metehan-arslan May 9, 2024
a7f9cfd
Revert "Drop infoga in favor of h8mail"
metehan-arslan May 9, 2024
0a2d4d0
Revert "Update Infoga github link"
metehan-arslan May 9, 2024
c7f2492
ops(docker): use Docker Compose V2 commands
AnonymousWP Jan 9, 2024
2c9f694
ops(docker-compose): upgrade to 2.23.3
AnonymousWP Dec 8, 2023
5970e67
ops(make): add option to change password via `make`
AnonymousWP Jan 14, 2024
925cf4f
docs(readme): add ideal values for `MAX_CONCURRENCY`
AnonymousWP Nov 25, 2023
d7590da
Convert answer to lowercase
jxdv Dec 12, 2023
0262d54
update input + typo in install.sh
jxdv Dec 13, 2023
fd1f31f
not exposing postgres publicly
noraj Oct 3, 2021
2ccaafb
do not expose the internal container either
noraj Oct 3, 2021
39bc170
ops(migrations): automate migration process
AnonymousWP Apr 18, 2023
65b7dcd
fix(migrations): revert sudo and use `echo`
AnonymousWP Apr 18, 2023
8bff3bc
Add stack trace into male logs if DEBUG True
psyray Oct 18, 2023
14d36f0
Update README with debug procedure
psyray Oct 19, 2023
c1f8ef1
Update README.md
yogeshojha Oct 24, 2023
f52d000
README modifications
psyray Oct 24, 2023
b8a74c3
Add celery log for DEBUG
psyray Nov 20, 2023
9dba1cb
Add debug log to celery tasks part
psyray Nov 21, 2023
e423a5a
Fix typo
yogeshojha May 12, 2024
5198f05
Refactor CSS and add missing div
psyray Nov 18, 2023
e451660
Add external ip at bottom of the page
psyray Nov 18, 2023
ba0d0c4
Change bad var call for ip
psyray Nov 18, 2023
b91d6a8
Upgrade Django to 3.2.23
psyray Nov 19, 2023
ede6717
Update Django dependencies
psyray Nov 19, 2023
32a4542
feat: add non-interactive installation parameter
AnonymousWP Nov 21, 2023
c4abf57
feat(admin_settings): show role description users
AnonymousWP Nov 26, 2023
7c785b1
fix: typo
AnonymousWP Nov 26, 2023
e134412
Added initiated_by, aborted_by in model
yogeshojha Dec 1, 2023
2d62331
Added initiated by on start scan create_scan_object
yogeshojha Dec 4, 2023
29f5dbe
Added aborted user details
yogeshojha Dec 4, 2023
eb99775
show user details on scan history
yogeshojha Dec 4, 2023
5ba8a54
feat(issue-604): handle organisation in csv bulk upload of targets
SeanOverton Dec 6, 2023
dc70ad1
feat(issue-604): update ui text to explain adding organisation in tar…
SeanOverton Dec 6, 2023
8e354eb
Update web/targetApp/templates/target/add.html
SeanOverton Dec 6, 2023
2fc942e
Update web/targetApp/templates/target/add.html
SeanOverton Dec 6, 2023
eb345c5
feat(issue-492): added optional input for organization in add target …
SeanOverton Dec 6, 2023
d32e77b
feat(issue-462): added organization_name att. to addTargetForm class
SeanOverton Dec 6, 2023
c0de383
feat(issue-462): added organization_name handling to view
SeanOverton Dec 6, 2023
9ec2aca
feat(issue-462): added optional org input to target quick add modal
SeanOverton Dec 6, 2023
2e681f8
feat(issue-462): added handling of org_name in AddTarget APIView
SeanOverton Dec 6, 2023
e40e7b9
it's -> its
jxdv Dec 17, 2023
9925e4a
fix some typos / mistakes in README
jxdv Dec 12, 2023
ecbf370
add parenthesis
jxdv Dec 13, 2023
a0715f0
Update README.md
jxdv Dec 16, 2023
8a553fb
update key generation function
jxdv Dec 26, 2023
8b7c468
rename var
jxdv Dec 26, 2023
0f37678
update key length
jxdv Dec 29, 2023
460f560
Filter by important subdomains in API call
psyray Oct 19, 2023
0338d94
Add important subdomains button
psyray Oct 19, 2023
4fbe8d2
Add listener on is_important button
psyray Oct 19, 2023
72e4ef1
Fix indentation
psyray Jan 12, 2024
260303c
update codeql to v3
jxdv Feb 17, 2024
8debafa
replace .format() with f-strings
jxdv Feb 13, 2024
70aa537
remove non-existet params from docstrings
jxdv Feb 13, 2024
b250fe3
optimize get_nmap_cmd based on TODO
jxdv Feb 13, 2024
cd0312b
simplify xml2json func
jxdv Feb 13, 2024
559d11c
use f-strings
jxdv Feb 13, 2024
15fae92
small python cleanup
jxdv Dec 12, 2023
5fcc55a
ops(migrations): automate migration process
AnonymousWP Apr 18, 2023
d0da481
fix(migrations): add `sudo`
AnonymousWP Apr 18, 2023
96db99f
fix(migrations): revert sudo and use `echo`
AnonymousWP Apr 18, 2023
ff035ce
feat: add non-interactive installation parameter
AnonymousWP Nov 21, 2023
5a98ad4
fix some typos / mistakes in README
jxdv Dec 12, 2023
7bb9d42
remove duplicates
yogeshojha May 12, 2024
a023d40
Add ollama localgpt to report generator and AttackSuggestionGenerator…
ErdemOzgen Nov 30, 2023
9238735
Add Erdem Ozgen to CONTRIBUTORS.md
ErdemOzgen Nov 30, 2023
6cbbe0b
Add langchain library
ErdemOzgen Nov 30, 2023
266f898
Add ollama dockerservice
ErdemOzgen Nov 30, 2023
75ebc3d
Add ollama service to docker-compose
ErdemOzgen Nov 30, 2023
bc4f407
Add Docker command to run llama2-uncensored
ErdemOzgen Nov 30, 2023
d800081
remove exposed port and command
yogeshojha Apr 20, 2024
36967f8
added custom client for ollama
yogeshojha Apr 20, 2024
034c425
add ui for llm toolkit
yogeshojha Apr 20, 2024
2e48082
add new llm button
yogeshojha Apr 20, 2024
78bb203
added ollama manager to pull and delete models
yogeshojha Apr 21, 2024
474bb25
display available models in ui and create delete model js function
yogeshojha Apr 21, 2024
b8e9920
added add model and delete model ui and endpoints
yogeshojha Apr 21, 2024
1f35de3
added put method to select model
yogeshojha Apr 21, 2024
5ab92fc
Added ollama settings to store selected models
yogeshojha Apr 21, 2024
75cadb9
fix using ollama vs openai
yogeshojha Apr 21, 2024
bbf3ef8
fix requirements
yogeshojha May 12, 2024
95f5384
show error message when openai key is not set
yogeshojha May 12, 2024
56da132
Merge pull request #1259 from yogeshojha/feature/llm
yogeshojha May 12, 2024
0365285
Merge pull request #1230 from fopina/use/djangoenv
yogeshojha May 12, 2024
d7641f5
Merge pull request #1137 from iuime/master
yogeshojha May 12, 2024
69292d2
update versions
yogeshojha May 12, 2024
60a7cba
run migrations
yogeshojha May 12, 2024
ef5d00d
added restart: always to redis container
null-ref-0000 Jun 2, 2024
990e2ea
fix lark migrations
yogeshojha Jun 19, 2024
ab674e9
Merge pull request #1275 from null-ref-0000/issue-1274
yogeshojha Jun 19, 2024
1748aa9
Merge branch 'docker-cleanup' into release/2.1.0
yogeshojha Jun 19, 2024
0077ee4
remove duplicate gospider
yogeshojha Jun 19, 2024
ad1b8eb
remove docker compose version
yogeshojha Jun 19, 2024
8142c80
Merge branch 'metehan-arslan/master' into release/2.1.0
yogeshojha Jun 19, 2024
dde5056
fix go installer in accordance with PR #1212
yogeshojha Jun 19, 2024
b511d9b
Merge branch 'pbehnke/master' into release/2.1.0
yogeshojha Jun 19, 2024
f57350d
Merge branch 'TinyActive/master' into release/2.1.0
yogeshojha Jun 19, 2024
bb9b97c
cleanup dockerfile
yogeshojha Jun 19, 2024
dd3c7a5
Added SAN extension to the generated certs
michschl Jun 20, 2024
08fab87
fix docker compose command
yogeshojha Jun 21, 2024
bfdde5c
Merge branch 'patch-1' into release/2.1.0
yogeshojha Jun 22, 2024
35f5380
fix save subdomain when it returns None
yogeshojha Jun 22, 2024
9416c35
fix typo comment
yogeshojha Jun 22, 2024
6547d85
fix eye witness
yogeshojha Jun 22, 2024
5311b9d
fix llm attack surface generator
yogeshojha Jun 22, 2024
136d669
uodate readme
yogeshojha Jun 22, 2024
745d2c4
update art
yogeshojha Jun 22, 2024
92c6263
update art
yogeshojha Jun 22, 2024
49341ce
update github actions
yogeshojha Jun 22, 2024
ff33bd4
auto release
yogeshojha Jun 22, 2024
1b42508
remove release
yogeshojha Jun 22, 2024
39b9bd9
update readme
yogeshojha Jun 22, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions .env
Original file line number Diff line number Diff line change
Expand Up @@ -28,3 +28,10 @@ POSTGRES_HOST=db
#
MAX_CONCURRENCY=80
MIN_CONCURRENCY=10

#
# Rengine web interface super user (for non-interactive install)
#
DJANGO_SUPERUSER_USERNAME=rengine
[email protected]
DJANGO_SUPERUSER_PASSWORD=Sm7IJG.IfHAFw9snSKv
9 changes: 8 additions & 1 deletion .github/workflows/build-pr.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,19 @@ name: 🌄 Build Docker image for pull request

on:
pull_request:
branches: [ master, stable, dev ]
branches:
- master
- release/*

jobs:
build:
name: Build Docker image
runs-on: ubuntu-latest
strategy:
matrix:
platform:
- linux/amd64
- linux/arm64
steps:
- name: Checkout the git repo
uses: actions/checkout@v4
Expand Down
5 changes: 5 additions & 0 deletions .github/workflows/build.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,11 @@ jobs:
build:
name: Build Docker image
runs-on: ubuntu-latest
strategy:
matrix:
platform:
- linux/amd64
- linux/arm64
steps:
- name: Checkout the git repo
uses: actions/checkout@v4
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/codeql-analysis.yml
Original file line number Diff line number Diff line change
Expand Up @@ -24,12 +24,12 @@ jobs:

# Initializes the CodeQL tools for scanning.
- name: Initialize CodeQL
uses: github/codeql-action/init@v2
uses: github/codeql-action/init@v3
with:
languages: ${{ matrix.language }}

- name: Autobuild
uses: github/codeql-action/autobuild@v2
uses: github/codeql-action/autobuild@v3

- name: Perform CodeQL Analysis
uses: github/codeql-action/analyze@v2
uses: github/codeql-action/analyze@v3
1 change: 1 addition & 0 deletions CONTRIBUTORS.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,7 @@ Thanks to these individuals for making reNgine awesome by fixing bugs, resolving
* [Suprita-25](https://github.com/Suprita-25)
* [TheBinitGhimire](https://github.com/TheBinitGhimire)
* [Vinay Leo](https://github.com/vinaynm)
* [Erdem Ozgen](https://github.com/ErdemOzgen)

*If you have created a Pull request, feel free to add your name here, because we know you are awesome and deserve thanks from the community!*

Expand Down
39 changes: 25 additions & 14 deletions Makefile
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
include .env
.DEFAULT_GOAL:=help

# Credits: https://github.com/sherifabdlnaby/elastdocker/
Expand All @@ -6,55 +7,65 @@
COMPOSE_PREFIX_CMD := COMPOSE_DOCKER_CLI_BUILD=1

COMPOSE_ALL_FILES := -f docker-compose.yml
SERVICES := db web proxy redis celery celery-beat
SERVICES := db web proxy redis celery celery-beat ollama

# --------------------------

.PHONY: setup certs up build username pull down stop restart rm logs

certs: ## Generate certificates.
@${COMPOSE_PREFIX_CMD} docker-compose -f docker-compose.setup.yml run --rm certs
@${COMPOSE_PREFIX_CMD} docker compose -f docker-compose.setup.yml run --rm certs

setup: ## Generate certificates.
@make certs

up: ## Build and start all services.
${COMPOSE_PREFIX_CMD} docker-compose ${COMPOSE_ALL_FILES} up -d --build ${SERVICES}
${COMPOSE_PREFIX_CMD} docker compose ${COMPOSE_ALL_FILES} up -d --build ${SERVICES}

build: ## Build all services.
${COMPOSE_PREFIX_CMD} docker-compose ${COMPOSE_ALL_FILES} build ${SERVICES}
${COMPOSE_PREFIX_CMD} docker compose ${COMPOSE_ALL_FILES} build ${SERVICES}

username: ## Generate Username (Use only after make up).
${COMPOSE_PREFIX_CMD} docker-compose ${COMPOSE_ALL_FILES} exec web python3 manage.py createsuperuser
ifeq ($(isNonInteractive), true)
${COMPOSE_PREFIX_CMD} docker compose ${COMPOSE_ALL_FILES} exec web python3 manage.py createsuperuser --username ${DJANGO_SUPERUSER_USERNAME} --email ${DJANGO_SUPERUSER_EMAIL} --noinput
else
${COMPOSE_PREFIX_CMD} docker compose ${COMPOSE_ALL_FILES} exec web python3 manage.py createsuperuser
endif

changepassword: ## Change password for user
${COMPOSE_PREFIX_CMD} docker compose ${COMPOSE_ALL_FILES} exec web python3 manage.py changepassword

migrate: ## Apply migrations
${COMPOSE_PREFIX_CMD} docker compose ${COMPOSE_ALL_FILES} exec web python3 manage.py migrate

pull: ## Pull Docker images.
docker login docker.pkg.github.com
${COMPOSE_PREFIX_CMD} docker-compose ${COMPOSE_ALL_FILES} pull
${COMPOSE_PREFIX_CMD} docker compose ${COMPOSE_ALL_FILES} pull

down: ## Down all services.
${COMPOSE_PREFIX_CMD} docker-compose ${COMPOSE_ALL_FILES} down
${COMPOSE_PREFIX_CMD} docker compose ${COMPOSE_ALL_FILES} down

stop: ## Stop all services.
${COMPOSE_PREFIX_CMD} docker-compose ${COMPOSE_ALL_FILES} stop ${SERVICES}
${COMPOSE_PREFIX_CMD} docker compose ${COMPOSE_ALL_FILES} stop ${SERVICES}

restart: ## Restart all services.
${COMPOSE_PREFIX_CMD} docker-compose ${COMPOSE_ALL_FILES} restart ${SERVICES}
${COMPOSE_PREFIX_CMD} docker compose ${COMPOSE_ALL_FILES} restart ${SERVICES}

rm: ## Remove all services containers.
${COMPOSE_PREFIX_CMD} docker-compose $(COMPOSE_ALL_FILES) rm -f ${SERVICES}
${COMPOSE_PREFIX_CMD} docker compose $(COMPOSE_ALL_FILES) rm -f ${SERVICES}

test:
${COMPOSE_PREFIX_CMD} docker-compose $(COMPOSE_ALL_FILES) exec celery python3 -m unittest tests/test_scan.py
${COMPOSE_PREFIX_CMD} docker compose $(COMPOSE_ALL_FILES) exec celery python3 -m unittest tests/test_scan.py

logs: ## Tail all logs with -n 1000.
${COMPOSE_PREFIX_CMD} docker-compose $(COMPOSE_ALL_FILES) logs --follow --tail=1000 ${SERVICES}
${COMPOSE_PREFIX_CMD} docker compose $(COMPOSE_ALL_FILES) logs --follow --tail=1000 ${SERVICES}

images: ## Show all Docker images.
${COMPOSE_PREFIX_CMD} docker-compose $(COMPOSE_ALL_FILES) images ${SERVICES}
${COMPOSE_PREFIX_CMD} docker compose $(COMPOSE_ALL_FILES) images ${SERVICES}

prune: ## Remove containers and delete volume data.
@make stop && make rm && docker volume prune -f

help: ## Show this help.
@echo "Make application docker images and manage containers using docker-compose files."
@echo "Make application Docker images and manage containers using Docker Compose files."
@awk 'BEGIN {FS = ":.*##"; printf "\nUsage:\n make \033[36m<target>\033[0m (default: help)\n\nTargets:\n"} /^[a-zA-Z_-]+:.*?##/ { printf " \033[36m%-12s\033[0m %s\n", $$1, $$2 }' $(MAKEFILE_LIST)
Loading
Loading