Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stream features to offline storage #530

Open
hangfei opened this issue Jul 29, 2022 · 4 comments
Open

Stream features to offline storage #530

hangfei opened this issue Jul 29, 2022 · 4 comments
Assignees
Labels
good first issue Good for newcomers scala code is mostly scala

Comments

@hangfei
Copy link
Collaborator

hangfei commented Jul 29, 2022

We now support stream features to online table(Redis).

It's a popular ask by users.

The main code is added by this #137.
Existing user guide: https://github.com/linkedin/feathr/blob/f3d6ba57425d550f19730403115c0523f6c3ffe6/docs/how-to-guides/streaming-source-ingestion.md.

Difficulty: medium

@hangfei hangfei added scala code is mostly scala good first issue Good for newcomers labels Jul 29, 2022
@hangfei
Copy link
Collaborator Author

hangfei commented Jul 29, 2022

@ahlag If you are interested, feel free to assign this to yourself.

@ahlag
Copy link
Contributor

ahlag commented Jul 30, 2022

@hangfei
Yeah sure! By the way, I can't assign myself. I think it's because I don't have the permission. By the way, how does this differ from this issue #289?

@hangfei
Copy link
Collaborator Author

hangfei commented Jul 31, 2022

#289 provide an API to "query" offline data.. This provides an API to write streaming data to offline.

@gkorland
Copy link

gkorland commented Sep 1, 2022

Did you consider having Redis Streams as a lightweight alternative Stream to Kafka.
Notice Redis already has a nice integration with Spark Streaming

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers scala code is mostly scala
Projects
None yet
Development

No branches or pull requests

3 participants