TES import

[buchanae]

Rough draft of pulling Funnel events from Kafka and writing them into Arachne.

[adamstruck]

Looks good! 👍

Generally, my concern is the proliferation of duplication of code that is starting to occur in these repos:

• github.com/ohsu-comp-bio/funnel
• github.com/ohsu-comp-bio/tes
• github.com/ohsu-comp-bio/mortar

I think we need to start thinking carefully how to split up things conceptually and make sure import things whenever possible.

[buchanae]

I removed the tes package, which was accidentally committed.

As soon as we resolve ohsu-comp-bio/funnel#481 I'll remove some of the events package too.

[adamstruck]

this command should be updated now that you removed the tes.proto file

[buchanae]

I've added new functionality to this PR, so please review again.

This creates additional vertex types for each task. Still need edges.

[buchanae]

Ok, the latest commit is in decent shape:

• Added edges from task to tag, file, etc.
• Cleaned up client, vertex, edge code
• Cleaned up Kafka event reader
• Added dev docs to readme and helpers to Makefile

I didn't put a ton of thought into vertex/edge label names, GID formats, etc. I'm pretty sure I'm diverging from BMEG on that so far. Probably cleanup to be done there. Also, we should have a style guide for those things.

[buchanae]

Added a cobra CLI. I'm done adding to this branch now.

[buchanae]

@adamstruck requested tests and the basics of a Go project, so I guess I'm not done yet.

Added tidy/lint in the last commit.