README.md

es_demo - Elasticsearch and Kibana Demo Project

Get an Elasticsearch and Kibana instance deployed to EKS and play around with it.

Goals

1. Learn and demonstrate K8s cluster creation suitable for production Elasticsearch instance for GBH Archives.
2. Learn and deploy Elasticsearch with Kibana to EKS cluster.
3. Ingest PBCore JSON documents
   1. Using _bulk API
      1. Gather performance results
      2. Test upper limits
   2. With schema autodetect
   3. With defined schema
   4. Compare strategies for indexing and querying hierarchical metadata (PBCore)
4. Ingest Transcripts
   1. Using _bulk API
      1. Gather performance results
      2. Test upper limits
   2. Semantic search