-
Notifications
You must be signed in to change notification settings - Fork 242
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ci: cilium scale pipeline #2085
Merged
Merged
Changes from all commits
Commits
Show all changes
75 commits
Select commit
Hold shift + click to select a range
f1fa9d9
ci: adding scale pipeline for cilium
camrynl 6d79671
change timeout
camrynl f689cdf
change timeout
camrynl b523941
update net policies
camrynl 41a1b87
use acn build pool to avoid azp delays
camrynl b68f169
address comments -- update build pool var and remove timeouts from scale
camrynl b6c38d7
address comments -- set node/pod counts and test input as variables
camrynl a62049d
remove all test resources
camrynl 44d56cb
check apachebench rollout status
camrynl 6dd4214
collect more cpu/mem results
camrynl eab0e41
add cns restart and fix artifact upload
camrynl 5583310
add cns restart and fix artifact upload
camrynl ab33ad2
update name for artifact publishing
camrynl d320547
update apachebench artifact collection
camrynl 5c918f0
update apachebench artifact collection
camrynl 74c6a1d
test cns version check
camrynl 0d10ded
change cns update
camrynl 57e3356
update artifact directory name
camrynl 08960d7
add netperf testing stage
camrynl 4dc5ce8
give permissions to netperf script
camrynl b563f81
change netperf steps
camrynl f2d6660
update path to netperf yaml
camrynl 9b619d3
change netperf deployment to 2
camrynl 93042c6
get correct pods in netperf script
camrynl 50c66be
publish netperf results
camrynl fe1e503
publish netperf results
camrynl cfe4dc6
add same vm test for netperf
camrynl d3dcad8
netperf script to print pod values
camrynl 4417a4b
netperf find nodes logic
camrynl b783de2
netperf find nodes logic
camrynl 6528aea
ci: adding scale pipeline for cilium
camrynl 093abeb
change timeout
camrynl d3d6e1d
change timeout
camrynl e0b1219
update net policies
camrynl 9243ebb
use acn build pool to avoid azp delays
camrynl aa81448
address comments -- update build pool var and remove timeouts from scale
camrynl e0cc798
address comments -- set node/pod counts and test input as variables
camrynl dee90f7
remove all test resources
camrynl 6a8c524
check apachebench rollout status
camrynl ce9825b
collect more cpu/mem results
camrynl 688d35d
add cns restart and fix artifact upload
camrynl 4505797
add cns restart and fix artifact upload
camrynl b51c478
update name for artifact publishing
camrynl c4df0ad
update apachebench artifact collection
camrynl c6df1c6
update apachebench artifact collection
camrynl c34720a
test cns version check
camrynl 9589c45
change cns update
camrynl a91dd8b
update artifact directory name
camrynl 6c91845
add netperf testing stage
camrynl 1e7007b
give permissions to netperf script
camrynl 4dbde07
change netperf steps
camrynl e4dfd3d
update path to netperf yaml
camrynl 5570052
change netperf deployment to 2
camrynl fbda33a
get correct pods in netperf script
camrynl 366ddb5
publish netperf results
camrynl 2de4cd8
publish netperf results
camrynl ebe6f54
add same vm test for netperf
camrynl 4da84e2
netperf script to print pod values
camrynl 52ddeb9
netperf find nodes logic
camrynl e611c08
netperf find nodes logic
camrynl 047a4ad
Merge branch 'camryn/ciliumscaletest' of https://github.com/Azure/azu…
camrynl a35ce9a
address comments, add more cpu and mem collection, and rename artifac…
camrynl cbfeab7
address comments for labeling nodes
camrynl ddfe7e9
fix artifact directory name
camrynl bea0975
fix artifact directory name apache
camrynl 4a81387
fix artifact directory name apache
camrynl 45cbda9
fix artifact directory name netperf
camrynl b2a08b1
fix artifact directory name netperf in script
camrynl 12c547b
Merge branch 'master' of https://github.com/camrynl/azure-container-n…
camrynl e55497c
Merge branch 'master' into camryn/ciliumscaletest
camrynl d8aa8e6
Merge branch 'master' of https://github.com/camrynl/azure-container-n…
camrynl 9341075
Merge branch 'camryn/ciliumscaletest' of https://github.com/Azure/azu…
camrynl d64ed40
Merge branch 'master' into camryn/ciliumscaletest
camrynl 5dd541a
Merge branch 'master' into camryn/ciliumscaletest
camrynl 0225f3c
Merge branch 'master' into camryn/ciliumscaletest
camrynl File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
Large diffs are not rendered by default.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,18 @@ | ||
apiVersion: apps/v1 | ||
kind: Deployment | ||
metadata: | ||
name: apachebench | ||
spec: | ||
selector: | ||
matchLabels: | ||
app: apachebench | ||
template: | ||
metadata: | ||
labels: | ||
app: apachebench | ||
spec: | ||
containers: | ||
- name: ubuntu-tools | ||
image: tamilmani1989/ubuntu18-tools | ||
command: ["/bin/sleep", "3650d"] | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,28 @@ | ||
apiVersion: apps/v1 | ||
kind: Deployment | ||
metadata: | ||
name: container6 | ||
namespace: default | ||
spec: | ||
selector: | ||
matchLabels: | ||
app: container6 | ||
replicas: 3 | ||
template: # create pods using pod definition in this template | ||
metadata: | ||
# unlike pod-nginx.yaml, the name is not included in the meta data as a unique name is | ||
# generated from the deployment name | ||
labels: | ||
app: container6 | ||
netperf: "true" | ||
spec: | ||
nodeSelector: | ||
netperf: "true" | ||
containers: | ||
- name: ubuntu | ||
image: tamilmani1989/ubuntu18-tools | ||
imagePullPolicy: Always | ||
command: ["/bin/sh","-c"] | ||
args: ["echo helloworld>hello.txt; php -S 0.0.0.0:9568"] | ||
securityContext: | ||
privileged: true |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,55 @@ | ||
#!/bin/bash | ||
# find the nodes with netperf pods and assign test vars | ||
node_found=0 | ||
for node in $(kubectl get nodes -o name); | ||
do | ||
if [ $node_found -lt 2 ]; then | ||
echo "Current : $node" | ||
node_name="${node##*/}" | ||
echo "checking whether the node has any netperf pods deployed to it" | ||
pod_count=$(kubectl get pods -l app=container6 -o wide | grep "$node_name" -c) | ||
netperf_pod=$(kubectl get pods -l app=container6 -o wide | grep "$node_name" | awk '{print $1}') | ||
echo "netperf pod : $netperf_pod" | ||
echo "pod_count: $pod_count" | ||
|
||
if [ $pod_count -gt 1 ]; then | ||
target_pod=$(echo $netperf_pod | cut -d" " -f 1) | ||
target_pod_ip=$(kubectl get pod "$target_pod" -o jsonpath='{.status.podIP}') | ||
same_vm_pod=$(echo $netperf_pod | cut -d" " -f 2) | ||
kubectl exec -it $target_pod -- netserver | ||
node_found=$((node_found + 1)) | ||
echo "Number of nodes found with netperf pod: $node_found" | ||
else | ||
diff_vm_pod=$netperf_pod | ||
node_found=$((node_found + 1)) | ||
echo "Number of nodes found with netperf pod: $node_found" | ||
fi | ||
fi | ||
done | ||
|
||
echo "target netperf pod: $target_pod" | ||
echo "target netperf pod IP: $target_pod_ip" | ||
echo "same vm pod: $same_vm_pod" | ||
echo "different vm pod: $diff_vm_pod" | ||
|
||
#netperf on same vm pod | ||
iteration=10 | ||
while [ $iteration -ge 0 ] | ||
do | ||
echo "============ Iteration $iteration ===============" | ||
kubectl exec -it $same_vm_pod -- netperf -H $target_pod_ip -l 30 -t TCP_STREAM >> "test3_netperf/same_vm_iteration_$iteration.log" | ||
echo "===============================" | ||
sleep 5s | ||
iteration=$((iteration-1)) | ||
done | ||
|
||
#netperf on different vm pod | ||
iteration=10 | ||
while [ $iteration -ge 0 ] | ||
do | ||
echo "============ Iteration $iteration ===============" | ||
kubectl exec -it $diff_vm_pod -- netperf -H $target_pod_ip -l 30 -t TCP_STREAM >> "test3_netperf/diff_vm_iteration_$iteration.log" | ||
echo "===============================" | ||
sleep 5s | ||
iteration=$((iteration-1)) | ||
done |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We can limit this result to three if we use the label selector
netperf=true
?There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes, in label-nodes.sh I cut off the
netperf=true
labeling once 3 nodes have it