Pipeline build failed with Error during kubernetes apply: java.lang.NullPointerException #4517

ljelinkova · 2018-11-02T10:19:20Z

Issue Overview

One e2e test failed on cluster 2a when building pipeline with Spring Boot booster with the following error

Error during kubernetes apply: java.lang.NullPointerException
	at io.fabric8.kubernetes.pipeline.devops.ApplyStepExecution.findPluginClass(ApplyStepExecution.java:596)
	at io.fabric8.kubernetes.pipeline.devops.ApplyStepExecution.findOpenShiftBuildConfigName(ApplyStepExecution.java:527)
	at io.fabric8.kubernetes.pipeline.devops.ApplyStepExecution.run(ApplyStepExecution.java:182)
	at io.fabric8.kubernetes.pipeline.devops.ApplyStepExecution.run(ApplyStepExecution.java:90)
	at org.jenkinsci.plugins.workflow.steps.AbstractSynchronousStepExecution.start(AbstractSynchronousStepExecution.java:42)
	at org.jenkinsci.plugins.workflow.cps.DSL.invokeStep(DSL.java:270)
	at org.jenkinsci.plugins.workflow.cps.DSL.invokeMethod(DSL.java:178)
	at org.jenkinsci.plugins.workflow.cps.CpsScript.invokeMethod(CpsScript.java:122)

You can see the whole Jenkins log here:
http://artifacts.ci.centos.org/devtools/e2e/devtools-test-e2e-openshift.io-smoketest-us-east-2a-released/973/05-05-jenkins-log.html

And more artifacts and logs here
http://artifacts.ci.centos.org/devtools/e2e/devtools-test-e2e-openshift.io-smoketest-us-east-2a-released/973/

The text was updated successfully, but these errors were encountered:

ppitonak · 2018-11-05T11:17:42Z

Happened multiple times over the weekend:

https://ci.centos.org/job/devtools-test-e2e-openshift.io-smoketest-us-east-2a-released/985/ (Nov 3, 2018 11:05:00 PM)
https://ci.centos.org/job/devtools-test-e2e-openshift.io-smoketest-us-east-1b-released/979/ (Nov 2, 2018 9:05:00 PM)
https://ci.centos.org/job/devtools-test-e2e-openshift.io-smoketest-us-east-1b-released/976/ (Nov 2, 2018 9:05:00 AM)
https://ci.centos.org/job/devtools-test-e2e-openshift.io-smoketest-us-east-1a-released/989/ (Nov 4, 2018 4:05:00 PM)
https://ci.centos.org/job/devtools-test-e2e-prod-preview.openshift.io-smoketest-pr-us-east-2a-beta/3519/ (Nov 5, 2018 4:40:00 AM)
https://ci.centos.org/job/devtools-test-e2e-prod-preview.openshift.io-smoketest-pr-us-east-2a-released/3513/ (Nov 4, 2018 11:10:00 PM)
https://ci.centos.org/job/devtools-test-e2e-prod-preview.openshift.io-smoketest-pr-us-east-2a-released/3511/ (Nov 4, 2018 9:10:00 PM)

ppitonak · 2018-11-07T12:16:03Z

@pradeepto please assign to somebody

https://ci.centos.org/job/devtools-test-e2e-prod-preview.openshift.io-smoketest-pr-us-east-2a-beta/3558/console
https://ci.centos.org/job/devtools-test-e2e-prod-preview.openshift.io-smoketest-pr-us-east-2a-beta/3559/console
https://ci.centos.org/job/devtools-test-e2e-prod-preview.openshift.io-smoketest-pr-us-east-2a-beta/3567/console
https://ci.centos.org/job/devtools-test-e2e-openshift.io-smoketest-us-east-2a-released/1001/console
https://ci.centos.org/job/devtools-test-e2e-openshift.io-smoketest-us-east-1a-released/1005/console
https://ci.centos.org/job/devtools-test-e2e-openshift.io-smoketest-us-east-2-released/1006/console
https://ci.centos.org/job/devtools-test-e2e-openshift.io-smoketest-us-east-1a-beta/1372/console

ppitonak · 2018-11-08T10:37:17Z

Appeared 5 times today (100% of test failures), most recent one is https://ci.centos.org/job/devtools-test-e2e-openshift.io-smoketest-us-east-2a-released/1010/

sbose78 · 2018-11-08T10:38:19Z

Does it work outside the tests, when tried out manually?

hrishin · 2018-11-08T10:59:44Z

Does it work outside the tests, when tried out manually?

yes. Somehow its intermittent ATM.

hrishin · 2018-11-08T11:24:51Z

@ppitonak I suspect(rare chance though) new Jenkins image could be breaking it.
All builds are failing for jenkins-openshift:v03b76a3 and kubernetesApply get execute on Jenkins node.

Could you try fabric8/jenkins-openshift:va519389 or fabric8/jenkins-openshift:v87522af Jenkins images for e2e test.

ppitonak · 2018-11-08T11:41:02Z

How can I do that?

hrishin · 2018-11-08T13:02:53Z

@ppitonak

By editing DeploymentConfig

Eaither by OpenShift web console or oc edit dc/jenkins -n <jenkins-namespace>

sthaha · 2018-11-08T13:16:47Z

@hrishin that isn't an option when running e2e tests.

hrishin · 2018-11-08T20:13:32Z

@ppitonak we can see some failures for va519389. Shall we try v87522af?

hrishin · 2018-11-09T07:40:26Z

@ppitonak @ljelinkova Note : a Jenkins update is available with new tenant deployments.

ppitonak · 2018-11-09T10:39:22Z

Last failure had these versions:

oc get -o custom-columns=NAME:.metadata.name,LABELS_VERSION:.metadata.labels.version deploymentconfigs
NAME      LABELS_VERSION
jenkins   61661dc

image: fabric8/jenkins-openshift:v541889d

What is the new version?

ppitonak · 2018-11-12T12:02:22Z

@hrishin ^

hrishin · 2018-11-13T11:41:43Z

@ppitonak v541889d is the new version.

ppitonak · 2018-11-13T12:27:32Z

OK, we are using the latest version of Jenkins, what's next?

hrishin · 2018-11-13T13:38:53Z

@ppitonak we working on this issue. Appears like the new image might have broken some plugins dependencies which in turn causing this issue.

ljelinkova · 2018-11-19T10:52:32Z

Still failing in production e2e tests
https://ci.centos.org/job/devtools-test-e2e-openshift.io-smoketest-us-east-1a-beta/1522/console

piyush-garg · 2018-11-19T11:01:37Z

@ppitonak @ljelinkova Update on this issue, this is coming from upstream plugin and waiting for this PR jenkinsci/kubernetes-pipeline-plugin#70 to get merged cc @hrishin @sthaha

`apply` step is failing intermediately with NullPointerException (NPE) in devops-steps plugin This patch fixes NPE issue in devops-step plugin Build: - jenkinsci/kubernetes-pipeline-plugin@bb6d52b Fixes - openshiftio/openshift.io#4517

`apply` step is failing intermediately with NullPointerException (NPE) in devops-steps plugin This patch fixes NPE issue in devops-step plugin Devops Step plugin build: - jenkinsci/kubernetes-pipeline-plugin@bb6d52b Fixes - openshiftio/openshift.io#4517 new build test test pr-build for plugin fixes ansicolor dependency fixes ansicolor dependency

`apply` step is failing intermediately with NullPointerException (NPE) in devops-steps plugin This patch fixes NPE issue in devops-step plugin Devops Step plugin build: - jenkinsci/kubernetes-pipeline-plugin@bb6d52b Fixes - openshiftio/openshift.io#4517

piyush-garg · 2018-11-23T10:09:32Z

This has been fixed with openshiftio/saas-openshiftio#1145

hrishin · 2018-11-23T10:18:39Z

Update

This issue has been fixed in devops-steps plugin. We have updated the Jenkins image with plugin and we will rollout tenants updates soon.

Meanwhile to test this patch could you do update tenant then reset environment through osio profile and run 2e2 tests? @ljelinkova @ppitonak

Thanks @chmouel @piyush-garg

ljelinkova · 2018-11-26T12:04:15Z

Is the fix already in production? I didn't do any tenant update but we do reset the environment every run. Jenkins version is 9a1fbb4.

E2E tests are unusually green in the last few days and I haven't seen this issue anymore. So if you confirm that the fix is in production we can close this issue.

piyush-garg · 2018-11-26T12:15:51Z

@ljelinkova This PR has been moved to prod, but it's still not available for every user. Any user who does reset environment or update tenant, the user will get these changes. Jenkins image tag should be vd38332c and Jenkins version should be 9a1fbb4 to have these changes. These changes have been moved to prod on Friday 23 November. Tenant update is still pending to reflect it for all user. Hope this helps. Thanks

ppitonak · 2018-11-28T15:58:11Z

Is mass tenant update done?

piyush-garg · 2018-11-28T16:03:15Z

@ppitonak Cluster-wide tenant update is still pending.

hrishin · 2018-12-03T12:09:35Z

Update

Tenant update is scheduled for Monday 3 Dec.

ljelinkova · 2018-12-04T13:52:21Z

The E2E tests do not encounter this issue any more so I am closing this issue now and not waiting for tenant update.

piyush-garg · 2018-12-04T14:19:13Z

@ljelinkova Whenever you do reset environment, then Jenkins comes up with latest tenant properties. This is not the case for all users, we need do that for all user. In e2e test, we reset the environment that's why no error is shown there. Ideally, we should wait for tenant update to reflect the changes for all users. Thanks

ppitonak · 2018-12-04T15:02:07Z

@piyush-garg makes sense. However, @hrishin wrote earlier that tenant update was scheduled on Dec 3, was it postponed?

piyush-garg · 2018-12-04T15:11:00Z

@ppitonak It was scheduled on 3 dec but postponed because of a blocking issue #4568

chmouel · 2018-12-13T13:27:16Z

We are planning to schedule now a tenant update since #4568 is ready to roll, @hrishin is on it,

ppitonak · 2018-12-18T11:14:47Z

Any updates?

hrishin · 2018-12-18T12:41:40Z

Not yet Pavol. Give us day or two will give an update.

…

On Tue, Dec 18, 2018 at 4:44 PM Pavol Pitonak ***@***.***> wrote: Any updates? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#4517 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AbSj-nDiA-M2zBEmDYZ8Q2hwTFy8GwdAks5u6M4qgaJpZM4YLY3A> .

-- Hrishikesh | +91 7276 342274 | IRC: hshinde

ljelinkova added area/pipelines team/build-cd area/e2e-tests labels Nov 2, 2018

ppitonak added SEV2-high priority/P1 Critical type/bug labels Nov 5, 2018

rupalibehera added the sprint/current label Nov 5, 2018

ppitonak mentioned this issue Nov 5, 2018

Update che plugin registry openshiftio/saas-openshiftio#1124

Merged

hrishin self-assigned this Nov 8, 2018

hrishin mentioned this issue Nov 14, 2018

NPE in openshift build config loading fixed jenkinsci/kubernetes-pipeline-plugin#70

Merged

piyush-garg added the status/blocked label Nov 19, 2018

hrishin mentioned this issue Nov 20, 2018

fixes apply step NPE issue fabric8io/openshift-jenkins-s2i-config#218

Merged

hrishin mentioned this issue Nov 23, 2018

updates jenkins tenant openshiftio/saas-openshiftio#1145

Merged

piyush-garg removed the status/blocked label Nov 23, 2018

chmouel closed this as completed in openshiftio/saas-openshiftio#1145 Nov 23, 2018

hrishin reopened this Nov 26, 2018

ljelinkova closed this as completed Dec 4, 2018

piyush-garg reopened this Dec 4, 2018

nurali-techie closed this as completed in nurali-techie/saas-openshiftio@b60e9a6 Dec 20, 2018

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Pipeline build failed with Error during kubernetes apply: java.lang.NullPointerException #4517

Pipeline build failed with Error during kubernetes apply: java.lang.NullPointerException #4517

ljelinkova commented Nov 2, 2018 •

edited

Loading

ppitonak commented Nov 5, 2018

ppitonak commented Nov 7, 2018

ppitonak commented Nov 8, 2018

sbose78 commented Nov 8, 2018

hrishin commented Nov 8, 2018

hrishin commented Nov 8, 2018

ppitonak commented Nov 8, 2018

hrishin commented Nov 8, 2018

sthaha commented Nov 8, 2018

hrishin commented Nov 8, 2018 •

edited

Loading

hrishin commented Nov 9, 2018 •

edited

Loading

ppitonak commented Nov 9, 2018

ppitonak commented Nov 12, 2018

hrishin commented Nov 13, 2018

ppitonak commented Nov 13, 2018

hrishin commented Nov 13, 2018

ljelinkova commented Nov 19, 2018

piyush-garg commented Nov 19, 2018 •

edited

Loading

piyush-garg commented Nov 23, 2018 •

edited

Loading

hrishin commented Nov 23, 2018

ljelinkova commented Nov 26, 2018

piyush-garg commented Nov 26, 2018

ppitonak commented Nov 28, 2018

piyush-garg commented Nov 28, 2018

hrishin commented Dec 3, 2018 •

edited

Loading

ljelinkova commented Dec 4, 2018

piyush-garg commented Dec 4, 2018

ppitonak commented Dec 4, 2018

piyush-garg commented Dec 4, 2018

chmouel commented Dec 13, 2018

ppitonak commented Dec 18, 2018

hrishin commented Dec 18, 2018 via email

Pipeline build failed with Error during kubernetes apply: java.lang.NullPointerException #4517

Pipeline build failed with Error during kubernetes apply: java.lang.NullPointerException #4517

Comments

ljelinkova commented Nov 2, 2018 • edited Loading

Issue Overview

ppitonak commented Nov 5, 2018

ppitonak commented Nov 7, 2018

ppitonak commented Nov 8, 2018

sbose78 commented Nov 8, 2018

hrishin commented Nov 8, 2018

hrishin commented Nov 8, 2018

ppitonak commented Nov 8, 2018

hrishin commented Nov 8, 2018

sthaha commented Nov 8, 2018

hrishin commented Nov 8, 2018 • edited Loading

hrishin commented Nov 9, 2018 • edited Loading

ppitonak commented Nov 9, 2018

ppitonak commented Nov 12, 2018

hrishin commented Nov 13, 2018

ppitonak commented Nov 13, 2018

hrishin commented Nov 13, 2018

ljelinkova commented Nov 19, 2018

piyush-garg commented Nov 19, 2018 • edited Loading

piyush-garg commented Nov 23, 2018 • edited Loading

hrishin commented Nov 23, 2018

Update

ljelinkova commented Nov 26, 2018

piyush-garg commented Nov 26, 2018

ppitonak commented Nov 28, 2018

piyush-garg commented Nov 28, 2018

hrishin commented Dec 3, 2018 • edited Loading

Update

ljelinkova commented Dec 4, 2018

piyush-garg commented Dec 4, 2018

ppitonak commented Dec 4, 2018

piyush-garg commented Dec 4, 2018

chmouel commented Dec 13, 2018

ppitonak commented Dec 18, 2018

hrishin commented Dec 18, 2018 via email

ljelinkova commented Nov 2, 2018 •

edited

Loading

hrishin commented Nov 8, 2018 •

edited

Loading

hrishin commented Nov 9, 2018 •

edited

Loading

piyush-garg commented Nov 19, 2018 •

edited

Loading

piyush-garg commented Nov 23, 2018 •

edited

Loading

hrishin commented Dec 3, 2018 •

edited

Loading