Must Have Skills (Top 3 technical skills only)*:
- Databricks
- Pyspark
- ETL
Detailed Job Description:
- Must have Azure Cloud experience and understand Azure components like ADF, Azure SQL and Azure DataBricks.
- Very Strong DataBricks, Spark, Pyspark, DataBricks SQL with Azure
- Must have Strong ETL and ELT experience
- Must have strong Python, DataBricks SQL skills beyond just calling Spark Api, must be fluent in Python programming language
- Must have Relational Database knowledge for optimum loading of Data from on premise system and data lake
- Must have experience with Data Lake and Data Bases
- Must have knowledge of OOP and functional programming to create reusable framework for ETL
- Must understand encryption and sec...
