You are tasked to create a data pipeline using pub/sub. A microservice will publish data to a Kafka topic and another microservice will subscript to read the contents from the Kafka topic and put results in stdout.
- Get Kafka running locally using docker -- you can find any docker file from the internet
- Write a microservice in GoLang (or another language you prefer) that publishes randomly generated temperature readings in Celcius to a kafka topic called (
celcius-readings
) every 1 second. The data in the topic should be: adouble
celcius reading and along
epoch timestamp - Write a microservice in GoLang that subscribes to the
celcius-readings
kafka topic and simply outputs each celcius and epoch timestamp to std out
- The repo should have a good README explanation for us to get the project running locally and review the Tasks
- We will run the project using
docker-compose up
. - If we need to run things in addition to
docker-compose up
, please list out what we should be running from the command line.