structured-kafka-streaming

Data Streaming with Spark and Java

The purpose of this application is to stream data from Apache Kafka, combine the realtime data with static data from a CSV and either print it on the console or send it to Apache Kafka.

Run the application

Validate and change the runtime arguments in the pom.xml

<argument>kafka_broker:ip</argument>
<argument>subscribe</argument>
<argument>kafka_topic</argument>
<argument>csv_directory</argument>
<argument>spark_master</argument

Execute the App

Run the application with the following command on the command line: mvn exec:java