Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

full-elastic-stack-example vector use datastream #175

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

fjellvannet
Copy link
Contributor

Updating the vector config to generate a datastream rather than an index - this works better for production. Also sets the data_stream fields accordingly

Just double-checked that this works twice (both with the namespace and elasticsearch rename from the last PR just to be double sure that it works)

For now this is my last PR :)

Updating the vector config to generate a datastream rather than
an index - this works better for production. Also sets the
data_stream fields accordingly
@RichardoC
Copy link
Owner

For this one, I think it's better not to include this in the example as often the ES datastreams are set up via the elastic cluster rather than the api clients https://www.elastic.co/guide/en/elasticsearch/reference/current/data-streams.html and I'm trying to keep this example simple for folks to see what's going on rather than have something production ready. At that point we should probably be adding lifecycle management etc as well 😅

Thank you though

@fjellvannet
Copy link
Contributor Author

That's alright :) This is why I made three separate PR's :)

Maybe it could be included in another example or in a comment or something?

@RichardoC
Copy link
Owner

Makes sense, I'm happy to link to an "Elastic best practises" document from this example's README which says use datastreams/retentions/don't have excessive fields/etc if you have a recommendation?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants