roachtest: schemachange/index/tpcc/w=1000 failed

[cockroach-teamcity]

roachtest.schemachange/index/tpcc/w=1000 failed with artifacts on master @ 63679e7bf4a0244c6e46381751543cfe3f32388c:

		  | 6c5cc8 sp=0xc0016c5c60 pc=0x467bd1
		  | github.com/cockroachdb/cockroach/pkg/workload.(*SQLRunner).Init(0xc004924890, 0x8a99a38, 0xc000360060, 0x5211e5b, 0x7, 0xc000630000, 0xc000eeaf60, 0x8, 0x0)
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/workload/sql_runner.go:122 +0x20b fp=0xc0016c5d80 sp=0xc0016c5cc8 pc=0x3aa030b
		  | github.com/cockroachdb/cockroach/pkg/workload/tpcc.createPayment(0x8a99a38, 0xc000360060, 0xc00000d0e0, 0xc000630000, 0x8a016c0, 0xc00492c000, 0x0, 0x0)
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/workload/tpcc/payment.go:145 +0x38a fp=0xc0016c5e18 sp=0xc0016c5d80 pc=0x420a26a
		  | github.com/cockroachdb/cockroach/pkg/workload/tpcc.newWorker(0x8a99a38, 0xc000360060, 0xc00000d0e0, 0xc000630000, 0xc004928720, 0xc0003582a0, 0x84, 0xc00064d140, 0xc001cf7408, 0xc003253f94)
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/workload/tpcc/worker.go:193 +0x21b fp=0xc0016c5ea8 sp=0xc0016c5e18 pc=0x421159b
		  | github.com/cockroachdb/cockroach/pkg/workload/tpcc.(*tpcc).Ops.func3(0x495801, 0x0)
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/workload/tpcc/tpcc.go:862 +0x145 fp=0xc0016c5f78 sp=0xc0016c5ea8 pc=0x421cfc5
		  | golang.org/x/sync/errgroup.(*Group).Go.func1(0xc0045bcab0, 0xc000c33c80)
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x59 fp=0xc0016c5fd0 sp=0xc0016c5f78 pc=0x12dd439
		  | runtime.goexit()
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1371 +0x1 fp=0xc0016c5fd8 sp=0xc0016c5fd0 pc=0x4c5cc1
		  | created by golang.org/x/sync/errgroup.(*Group).Go
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x66
		  |
		  | goroutine 3258 [running]:
		  | runtime.throw(0x5249fe4, 0x15)
		  | 	/usr/local/go/src/runtime/panic.go:1117 +0x72 fp=0xc001645c60 sp=0xc001645c30 pc=0x48b672
		  | runtime.mapassign_faststr(0x4a822a0, 0xc0013b8030, 0xc003f2f540, 0x9, 0x2)
		  | 	/usr/local/go/src/runtime/map_faststr.go:211 +0x3f1 fp=0xc001645cc8 sp=0xc001645c60 pc=0x467bd1
		  | github.com/cockroachdb/cockroach/pkg/workload.(*SQLRunner).Init(0xc003f4c690, 0x8a99a38, 0xc000360060, 0x5211e5b, 0x7, 0xc0013b8000, 0xc000eeaf60, 0x8, 0x0)
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/workload/sql_runner.go:122 +0x20b fp=0xc001645d80 sp=0xc001645cc8 pc=0x3aa030b
		  | github.com/cockroachdb/cockroach/pkg/workload/tpcc.createPayment(0x8a99a38, 0xc000360060, 0xc00000d0e0, 0xc0013b8000, 0x8a016c0, 0xc000bd9110, 0x0, 0x0)
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/workload/tpcc/payment.go:145 +0x38a fp=0xc001645e18 sp=0xc001645d80 pc=0x420a26a
		  | github.com/cockroachdb/cockroach/pkg/workload/tpcc.newWorker(0x8a99a38, 0xc000360060, 0xc00000d0e0, 0xc0013b8000, 0xc002193d70, 0xc0003582a0, 0x49, 0xc000532240, 0xc0012c4688, 0xc0018a4794)
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/workload/tpcc/worker.go:193 +0x21b fp=0xc001645ea8 sp=0xc001645e18 pc=0x421159b
		  | github.com/cockroachdb/cockroach/pkg/workload/tpcc.(*tpcc).Ops.func3(0x495801, 0x0)
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/workload/tpcc/tpcc.go:862 +0x145 fp=0xc001645f78 sp=0xc001645ea8 pc=0x421cfc5
		  | golang.org/x/sync/errgroup.(*Group).Go.func1(0xc0045bcab0, 0xc0014e5ec0)
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x59 fp=0xc001645fd0 sp=0xc001645f78 pc=0x12dd439
		  | runtime.goexit()
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1371 +0x1 fp=0xc001645fd8 sp=0xc001645fd0 pc=0x4c5cc1
		  | created by golang.org/x/sync/errgroup.(*Group).Go
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x66
		  | Error: SSH_PROBLEM: exit status 255
		  | (1) SSH_PROBLEM
		  | Wraps: (2) Node 5. Command with error:
		  |   | ``````
		  |   | ./cockroach workload run tpcc --warehouses=1000 --histograms=perf/stats.json --wait=false --tolerate-errors --workers=1000 --ramp=5m0s --duration=2h0m0s --prometheus-port=2112 --pprofport=33333  {pgurl:1-4}
		  |   | ``````
		  | Wraps: (3) exit status 255
		  | Error types: (1) errors.SSH (2) *hintdetail.withDetail (3) *exec.ExitError
		  |
		  | stdout:
		  | Initializing 1000 connections...
		  | Initializing 0 idle connections...
		  | Initializing 1000 workers and preparing statements...
		Wraps: (8) exit status 10
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *withstack.withStack (6) *errutil.withPrefix (7) *cluster.WithCommandDetails (8) *exec.ExitError

Reproduce

See: roachtest README

Same failure on other branches

• roachtest: schemachange/index/tpcc/w=1000 failed #54304 roachtest: schemachange/index/tpcc/w=1000 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!