Fast Stream Analytics with Kafka & Flink

Steps:

1.Setup Kafka Connect & Kafka

http://dhanuka84.blogspot.com/2017/03/kafka-connect-architecture.html

2. Download Flink & Install

https://ci.apache.org/projects/flink/flink-docs-release-1.2/quickstart/setup_quickstart.html

3. Go to flink folder : cd flink-1.2.0/

4. Start flink in standalone mode

./bin/start-local.sh

5. Start Kafka Read Job

./bin/flink run ~/flink/flink-examples/flink-examples-streaming/target/Kafka.jar --topic metric_topic --bootstrap.servers localhost:9092

6. Watch logs

tail -f log/flink-*-jobmanager-*.out

7. Send JSON to Kafka Connect TCP port.

cat analytics.json | netcat localhost 12345

Source Code: 

https://github.com/dhanuka84/flink/blob/master/flink-examples/flink-examples-streaming/src/main/java/org/apache/flink/streaming/examples/kafka/ReadFromKafka.java