forked from ethereum/go-ethereum
-
Notifications
You must be signed in to change notification settings - Fork 5
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request ethereum#312 from XinFinOrg/dev-upgrade
CI Upgrade
- Loading branch information
Showing
28 changed files
with
775 additions
and
196 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| Dockerfile |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,41 @@ | ||
| FROM golang:1.14-alpine as builder | ||
|
|
||
| RUN apk add make build-base linux-headers | ||
|
|
||
| COPY . /builder | ||
| RUN cd /builder && make && mv /builder/build/bin/XDC /builder/build/bin/XDC-mainnet | ||
|
|
||
| RUN mv /builder/common/constants/constants.go.devnet /builder/common/constants.go | ||
| RUN cd /builder && make && mv /builder/build/bin/XDC /builder/build/bin/XDC-devnet | ||
|
|
||
| RUN mv /builder/common/constants/constants.go.testnet /builder/common/constants.go | ||
| RUN cd /builder && make && mv /builder/build/bin/XDC /builder/build/bin/XDC-testnet | ||
|
|
||
| # The runtime image | ||
| FROM alpine:3 | ||
|
|
||
| WORKDIR /work | ||
|
|
||
| RUN apk add --no-cache bash curl | ||
|
|
||
| COPY --from=builder /builder/build/bin/XDC-devnet /usr/bin | ||
| COPY --from=builder /builder/build/bin/XDC-testnet /usr/bin | ||
| COPY --from=builder /builder/build/bin/XDC-mainnet /usr/bin | ||
|
|
||
| # # Copy over files | ||
| ADD cicd/devnet /work/devnet | ||
| ADD cicd/testnet /work/testnet | ||
| ADD cicd/mainnet /work/mainnet | ||
| ADD cicd/entry.sh /work/ | ||
|
|
||
| # Create an empty pwd file | ||
| RUN touch /work/.pwd | ||
|
|
||
| # rpc | ||
| EXPOSE 8545 | ||
| # ws | ||
| EXPOSE 8555 | ||
| # port | ||
| EXPOSE 30303 | ||
|
|
||
| ENTRYPOINT ["bash","/work/entry.sh"] |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,52 +1,10 @@ | ||
| # CI/CD pipeline for XDC | ||
| This directory contains CI/CD scripts used for each of the XDC environments. | ||
| # Docker Command | ||
|
|
||
| ## How to deploy more nodes | ||
| Adjust the number of variable `num_of_nodes` under file `.env`. (**Maximum supported is 58**) | ||
|
|
||
| ## Devnet | ||
| Each PR merged into `dev-upgrade` will trigger below actions: | ||
| - Tests | ||
| - Terraform to apply infrascture changes(if any) | ||
| - Docker build of XDC with devnet configurations with tag of `:latest` | ||
| - Docker push to docker hub. https://hub.docker.com/repository/docker/xinfinorg/devnet | ||
| - Deployment of the latest XDC image(from above) to devnet run by AWS ECS | ||
|
|
||
| ### First time set up an new environment | ||
| 1. Pre-generate a list of node private keys in below format | ||
| ## Docker Build | ||
| ``` | ||
| { | ||
| "xdc0": { | ||
| "pk": {{PRIVATE KEY}}, | ||
| "address": {{XDC wallet address}}, | ||
| "imageTag": {{Optional field to run different version of XDC}}, | ||
| "logLevel": {{Optional field to adjust the log level for the container}} | ||
| }, | ||
| "xdc1": {...}, | ||
| "xdc{{NUMBER}}: {...} | ||
| } | ||
| docker build -f cicd/Dockerfile . | ||
| ``` | ||
| 2. Access to aws console, create a bucket with name `tf-devnet-bucket`: | ||
| - You can choose any name, just make sure update the name in the s3 bucket name variable in `variables.tf` | ||
| - And update the name of the terraform.backend.s3.bucket from `s3.tf` | ||
| 3. Upload the file from step 1 into the above bucket with name `node-config.json` | ||
| 4. In order to allow pipeline able to push and deploy via ECR and ECS, we require below environment variables to be injected into the CI pipeline: | ||
| 1. DOCKER_USERNAME | ||
| 2. DOCKER_PASSWORD | ||
| 3. AWS_ACCESS_KEY_ID | ||
| 4. AWS_SECRET_ACCESS_KEY | ||
|
|
||
| You are all set! | ||
|
|
||
| ## How to run different version of XDC on selected nodes | ||
| 1. Create a new image tag: | ||
| - Check out the repo | ||
| - Run docker build `docker build -t xdc-devnet -f cicd/devnet/Dockerfile .` | ||
| - Run docker tag `docker tag xdc-devnet:latest xinfinorg/devnet:test-{{put your version number here}}` | ||
| - Run docker push `docker push xinfinorg/devnet:test-{{Version number from step above}}` | ||
| 2. Adjust node-config.json | ||
| - Download the node-config.json from s3 | ||
| - Add/update the `imageTag` field with value of `test-{{version number you defined in step 1}}` for the selected number of nodes you want to test with | ||
| - Optional: Adjust the log level by add/updating the field of `logLevel` | ||
| - Save and upload to s3 | ||
| 3. Make a dummy PR and get merged. Wait it to be updated. | ||
| ## Docker Run | ||
| ``` | ||
| docker run -it -e NETWORK=devnet -e PRIVATE_KEYS=$KEY $IMAGE | ||
| `` |
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,52 @@ | ||
| # CI/CD pipeline for XDC | ||
| This directory contains CI/CD scripts used for each of the XDC environments. | ||
|
|
||
| ## How to deploy more nodes | ||
| Adjust the number of variable `num_of_nodes` under file `.env`. (**Maximum supported is 58**) | ||
|
|
||
| ## Devnet | ||
| Each PR merged into `dev-upgrade` will trigger below actions: | ||
| - Tests | ||
| - Terraform to apply infrascture changes(if any) | ||
| - Docker build of XDC with devnet configurations with tag of `:latest` | ||
| - Docker push to docker hub. https://hub.docker.com/repository/docker/xinfinorg/devnet | ||
| - Deployment of the latest XDC image(from above) to devnet run by AWS ECS | ||
|
|
||
| ### First time set up an new environment | ||
| 1. Pre-generate a list of node private keys in below format | ||
| ``` | ||
| { | ||
| "xdc0": { | ||
| "pk": {{PRIVATE KEY}}, | ||
| "address": {{XDC wallet address}}, | ||
| "imageTag": {{Optional field to run different version of XDC}}, | ||
| "logLevel": {{Optional field to adjust the log level for the container}} | ||
| }, | ||
| "xdc1": {...}, | ||
| "xdc{{NUMBER}}: {...} | ||
| } | ||
| ``` | ||
| 2. Access to aws console, create a bucket with name `tf-devnet-bucket`: | ||
| - You can choose any name, just make sure update the name in the s3 bucket name variable in `variables.tf` | ||
| - And update the name of the terraform.backend.s3.bucket from `s3.tf` | ||
| 3. Upload the file from step 1 into the above bucket with name `node-config.json` | ||
| 4. In order to allow pipeline able to push and deploy via ECR and ECS, we require below environment variables to be injected into the CI pipeline: | ||
| 1. DOCKER_USERNAME | ||
| 2. DOCKER_PASSWORD | ||
| 3. AWS_ACCESS_KEY_ID | ||
| 4. AWS_SECRET_ACCESS_KEY | ||
|
|
||
| You are all set! | ||
|
|
||
| ## How to run different version of XDC on selected nodes | ||
| 1. Create a new image tag: | ||
| - Check out the repo | ||
| - Run docker build `docker build -t xdc-devnet -f cicd/devnet/Dockerfile .` | ||
| - Run docker tag `docker tag xdc-devnet:latest xinfinorg/devnet:test-{{put your version number here}}` | ||
| - Run docker push `docker push xinfinorg/devnet:test-{{Version number from step above}}` | ||
| 2. Adjust node-config.json | ||
| - Download the node-config.json from s3 | ||
| - Add/update the `imageTag` field with value of `test-{{version number you defined in step 1}}` for the selected number of nodes you want to test with | ||
| - Optional: Adjust the log level by add/updating the field of `logLevel` | ||
| - Save and upload to s3 | ||
| 3. Make a dummy PR and get merged. Wait it to be updated. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.