Detailed Job Description:
- Create data ingestion pipelines using spark streaming to consume data from Apache Kafka
- Write transformational logic and aggregation logic in spark
- Experience in setting up Airflow jobs for orchestration
- Communicate and co-ordinate with Busi...
