Skip to content
This repository has been archived by the owner on Nov 4, 2021. It is now read-only.

Port Python get_event endpoint over to plugin server #25

Closed
wants to merge 33 commits into from

Conversation

Twixes
Copy link
Member

@Twixes Twixes commented Nov 26, 2020

This is a (WIP) port of the get_event view function from Python to TypeScript, more precisely only its ee branch. The original runs our capture endpoint in the Django app but isn't compatible with plugin processing, this should allow for compatibility.

@Twixes Twixes requested a review from mariusandra November 26, 2020 07:35
@Twixes Twixes removed the request for review from mariusandra November 26, 2020 07:51
@mariusandra
Copy link
Collaborator

With regard to naming things, there are two parts of the stack that can both be called "ingestion":

  • /e/ --> some queue (and then before plugins) .... aka "capture"
  • some queue after plugins --> database ... aka "process_event"

The JS server should be able to do both ends, yet I think the process_event step is more important for now, since the first step is handled by Django. Even in EE we write the events to a Kafka topic in capture, which the plugin server could just read from. There's however no way to get events after plugin processing back into Django for the final process_event_ee step...

(That said the capture step as started in this PR is also very important to get done. If for nothing else, we can at least do better benchmarks when that's in place)

@Twixes Twixes changed the title Port over Python get_event endpoint to TS Port Python get_event endpoint over to plugin server Dec 2, 2020
@mariusandra mariusandra mentioned this pull request Dec 9, 2020
@Twixes Twixes mentioned this pull request Mar 24, 2021
2 tasks
@Twixes Twixes mentioned this pull request May 27, 2021
2 tasks
@Twixes
Copy link
Member Author

Twixes commented May 27, 2021

This is super stale now.

@Twixes Twixes closed this May 27, 2021
@Twixes Twixes deleted the ingestion-capture branch June 18, 2021 12:44
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants