Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

go/runtime: Remove tag indexer #4216

Merged
merged 1 commit into from
Aug 30, 2021
Merged

Conversation

kostko
Copy link
Member

@kostko kostko commented Aug 25, 2021

See #3888
Closes #3388
Closes #1674

The tag indexer is slow, buggy and unused by the SDK. Runtime transaction
indexing and querying capabilities should be provided as part of the new
event streaming API.

@kostko kostko added c:breaking/cfg Category: breaks configuration c:breaking Category: breaking code change labels Aug 25, 2021
@kostko kostko force-pushed the kostko/feature/rt-remove-tagindexer branch from 63001bd to b8e9546 Compare August 27, 2021 10:30
@kostko kostko marked this pull request as ready for review August 27, 2021 10:30
Copy link
Contributor

@pro-wh pro-wh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

confirming that the runtime sdk didn't use this
(edit) to elaborate: watching blocks had been the way to go. may reconsider if we later reinstate this functionality with a more reliable implementation

pretty clean, that the removal is almost all deletions

I see that the end to end test is slightly enhanced to wait for a round

approving, but anyone else feel free to discuss too

github.com/btcsuite/btcutil v1.0.2
github.com/cenkalti/backoff/v4 v4.1.1
github.com/dgraph-io/badger/v2 v2.2007.2
github.com/dgraph-io/badger/v3 v3.2103.1
github.com/eapache/channels v1.1.0
github.com/facebookgo/ensure v0.0.0-20200202191622-63f1cf65ac4c // indirect
github.com/facebookgo/subset v0.0.0-20200203212716-c811ad88dec4 // indirect
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

are these unrelated?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the result of running go mod tidy, let me look into it a bit.

@kostko kostko force-pushed the kostko/feature/rt-remove-tagindexer branch from b8e9546 to 9093c12 Compare August 29, 2021 15:29
@codecov
Copy link

codecov bot commented Aug 29, 2021

Codecov Report

Merging #4216 (f69222c) into master (f95ac4d) will decrease coverage by 0.07%.
The diff coverage is 100.00%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #4216      +/-   ##
==========================================
- Coverage   68.67%   68.59%   -0.08%     
==========================================
  Files         411      408       -3     
  Lines       47549    46936     -613     
==========================================
- Hits        32652    32197     -455     
+ Misses      10848    10750      -98     
+ Partials     4049     3989      -60     
Impacted Files Coverage Δ
go/runtime/client/api/grpc.go 67.78% <ø> (-0.15%) ⬇️
go/runtime/client/client.go 66.14% <ø> (-0.98%) ⬇️
go/runtime/registry/config.go 67.28% <ø> (-0.82%) ⬇️
go/runtime/registry/registry.go 78.44% <ø> (+0.47%) ⬆️
go/runtime/client/tests/tester.go 100.00% <100.00%> (ø)
go/common/keyformat/key_format.go 71.59% <0.00%> (-4.74%) ⬇️
go/consensus/tendermint/full/services.go 81.53% <0.00%> (-3.85%) ⬇️
go/consensus/tendermint/full/light.go 51.85% <0.00%> (-3.71%) ⬇️
go/worker/common/committee/node.go 73.94% <0.00%> (-2.95%) ⬇️
go/consensus/tendermint/apps/beacon/state/state.go 70.27% <0.00%> (-2.71%) ⬇️
... and 20 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a23b778...f69222c. Read the comment docs.

@kostko kostko force-pushed the kostko/feature/rt-remove-tagindexer branch from 9093c12 to f69222c Compare August 30, 2021 06:42
@kostko kostko merged commit 809520c into master Aug 30, 2021
@kostko kostko deleted the kostko/feature/rt-remove-tagindexer branch August 30, 2021 08:45
tjanez added a commit that referenced this pull request Oct 18, 2021
tjanez added a commit that referenced this pull request Oct 18, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
c:breaking/cfg Category: breaks configuration c:breaking Category: breaking code change
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Tag indexer should retry failed ops Bleve tag indexer will break after block 2^53
3 participants