Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rpc: TestHeartbeatHealthTransport failed under stress #13734

Closed
cockroach-teamcity opened this issue Feb 23, 2017 · 82 comments
Closed

rpc: TestHeartbeatHealthTransport failed under stress #13734

cockroach-teamcity opened this issue Feb 23, 2017 · 82 comments
Assignees
Labels
C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot.
Milestone

Comments

@cockroach-teamcity
Copy link
Member

SHA: https://github.com/cockroachdb/cockroach/commits/f6bbf792517ce7f203d2aeead64931c8b3a1c8d3

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=
GOFLAGS=-race

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=159303&tab=buildLog

I170223 07:10:21.184639 87 vendor/google.golang.org/grpc/transport/http2_server.go:323  transport: http2Server.HandleStreams failed to read frame: read tcp 127.0.0.1:42237->127.0.0.1:56376: use of closed network connection
I170223 07:10:21.186029 75 vendor/google.golang.org/grpc/transport/http2_client.go:1126  transport: http2Client.notifyError got notified that the client transport was broken EOF.
I170223 07:10:21.186590 146 vendor/google.golang.org/grpc/server.go:419  grpc: Server.Serve failed to complete security handshake from "127.0.0.1:56377": read tcp 127.0.0.1:42237->127.0.0.1:56377: use of closed network connection
I170223 07:10:21.186954 64 vendor/google.golang.org/grpc/clientconn.go:786  grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: EOF"; Reconnecting to {127.0.0.1:42237 <nil>}
I170223 07:10:22.264647 44 vendor/google.golang.org/grpc/transport/http2_server.go:323  transport: http2Server.HandleStreams failed to read frame: read tcp 127.0.0.1:42237->127.0.0.1:56426: use of closed network connection
I170223 07:10:22.264803 102 vendor/google.golang.org/grpc/transport/http2_client.go:1126  transport: http2Client.notifyError got notified that the client transport was broken EOF.
I170223 07:11:07.368772 139 vendor/google.golang.org/grpc/transport/http2_server.go:323  transport: http2Server.HandleStreams failed to read frame: read tcp 127.0.0.1:42237->127.0.0.1:56438: use of closed network connection
	<autogenerated>:14: rpc/context_test.go:294, condition failed to evaluate within 45s: unexpected error: <nil>
@cockroach-teamcity cockroach-teamcity added O-robot Originated from a bot. C-test-failure Broken test (automatically or manually discovered). labels Feb 23, 2017
@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/f6bbf792517ce7f203d2aeead64931c8b3a1c8d3

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=159000&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/f6bbf792517ce7f203d2aeead64931c8b3a1c8d3

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=159101&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/f6bbf792517ce7f203d2aeead64931c8b3a1c8d3

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=-race

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=159202&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/f6bbf792517ce7f203d2aeead64931c8b3a1c8d3

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=deadlock
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=159404&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/f6bbf792517ce7f203d2aeead64931c8b3a1c8d3

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=deadlock
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=159505&tab=buildLog

@petermattis petermattis changed the title github.com/cockroachdb/cockroach/pkg/rpc: TestHeartbeatHealthTransport failed under stress rpc: TestHeartbeatHealthTransport failed under stress Feb 23, 2017
@petermattis petermattis added this to the 1.0 milestone Feb 23, 2017
@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/6067175467360837c69b66fafae9910952cf6709

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=160812&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/6067175467360837c69b66fafae9910952cf6709

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=160913&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/6067175467360837c69b66fafae9910952cf6709

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=-race

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=161014&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/6067175467360837c69b66fafae9910952cf6709

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=
GOFLAGS=-race

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=161115&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/6067175467360837c69b66fafae9910952cf6709

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=deadlock
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=161216&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/6067175467360837c69b66fafae9910952cf6709

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=deadlock
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=161317&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/e6cce4f67c58479657ccee3833c36742eec4e3fa

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=161792&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/e6cce4f67c58479657ccee3833c36742eec4e3fa

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=161893&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/e6cce4f67c58479657ccee3833c36742eec4e3fa

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=-race

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=161994&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/e6cce4f67c58479657ccee3833c36742eec4e3fa

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=
GOFLAGS=-race

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=162095&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/e6cce4f67c58479657ccee3833c36742eec4e3fa

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=deadlock
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=162196&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/e6cce4f67c58479657ccee3833c36742eec4e3fa

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=deadlock
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=162297&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/e6cce4f67c58479657ccee3833c36742eec4e3fa

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=162458&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/e6cce4f67c58479657ccee3833c36742eec4e3fa

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=162559&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/e6cce4f67c58479657ccee3833c36742eec4e3fa

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=-race

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=162660&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/e6cce4f67c58479657ccee3833c36742eec4e3fa

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=
GOFLAGS=-race

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=162761&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/e6cce4f67c58479657ccee3833c36742eec4e3fa

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=deadlock
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=162862&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/e6cce4f67c58479657ccee3833c36742eec4e3fa

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=deadlock
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=162963&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/382709bd132741c65ef9759c02b08d52b7510d86

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=-race

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=163370&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/382709bd132741c65ef9759c02b08d52b7510d86

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=163168&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/066b9480d6efa34dd2ad440b5a2b6d3cc9686441

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=deadlock
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=168767&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/dca163044206905f9adfad123870b93d3e7526b7

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=168991&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/dca163044206905f9adfad123870b93d3e7526b7

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=169094&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/dca163044206905f9adfad123870b93d3e7526b7

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=-race

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=169198&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/dca163044206905f9adfad123870b93d3e7526b7

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=
GOFLAGS=-race

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=169304&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/dca163044206905f9adfad123870b93d3e7526b7

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=deadlock
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=169413&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/dca163044206905f9adfad123870b93d3e7526b7

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=deadlock
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=169520&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/9ad551bf373f72dbd39b9d471798c1e3e1582d1f

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=169748&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/9ad551bf373f72dbd39b9d471798c1e3e1582d1f

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=169850&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/9ad551bf373f72dbd39b9d471798c1e3e1582d1f

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=-race

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=169953&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/9ad551bf373f72dbd39b9d471798c1e3e1582d1f

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=
GOFLAGS=-race

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=170060&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/9ad551bf373f72dbd39b9d471798c1e3e1582d1f

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=deadlock
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=170166&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/9ad551bf373f72dbd39b9d471798c1e3e1582d1f

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=deadlock
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=170275&tab=buildLog

@a-robinson
Copy link
Contributor

This has been failing on master and now in at least one PR build (https://teamcity.cockroachdb.com/viewLog.html?buildId=170923&buildTypeId=Cockroach_UnitTests).

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/f24fa2ce359ee9a46d143c3bb40280fed6742f2a

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=171214&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/f24fa2ce359ee9a46d143c3bb40280fed6742f2a

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=171317&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/f24fa2ce359ee9a46d143c3bb40280fed6742f2a

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=-race

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=171422&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/f24fa2ce359ee9a46d143c3bb40280fed6742f2a

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=
GOFLAGS=-race

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=171529&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/f24fa2ce359ee9a46d143c3bb40280fed6742f2a

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=deadlock
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=171637&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/afebd19fc3031ffe3b2f09cc3c55bb36725e5d6b

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=172620&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/afebd19fc3031ffe3b2f09cc3c55bb36725e5d6b

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=172724&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/6880337159ac1b1984fa0136032db9b5572d80ed

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=
GOFLAGS=-race

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=172829&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/6880337159ac1b1984fa0136032db9b5572d80ed

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=
GOFLAGS=-race

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=172936&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/6880337159ac1b1984fa0136032db9b5572d80ed

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=true
TAGS=deadlock
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=173048&tab=buildLog

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/6880337159ac1b1984fa0136032db9b5572d80ed

Parameters:

COCKROACH_PROPOSER_EVALUATED_KV=false
TAGS=deadlock
GOFLAGS=

Stress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=173155&tab=buildLog

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot.
Projects
None yet
Development

No branches or pull requests

4 participants