Data Engineer
Core Skills Mandatory with minimum 3-4 years of experience with self rating:
- Databricks
- PySpark
- Spark SQL
- Python
- Concepts of Azure Cloud
- Familiarity with Azure DevOps, Azure LogicApp, ADLS, Delta lake/tables
- Spark
- Hadoop
- BigData
JD
· The candidate must have Architecture knowledge of Big data & related concepts.
· The candidate must be hands on experienced in Azure Databricks, Pyspark, SparkSQL & Python. · Candidate must be very strong in SQL & PL/SQL. · Nice to have some familiarity on MDM Concepts. · Must be familiar with Azure. · Familiarity with Azure DevOps, Azure LogicApp, ADLS, Delta lake/tables · Must have strong communication skills. · Must have good working knowledge of Spark & Hadoop. |
Activities involved:
- Enhance existing data pipelines as per business requirements
- Perform Data analysis as needed
- Review code with client leads
- Create jobs to schedule data pipelines as per requirements
- Work with Azure DevOps team for production implementation and release activities
- Post production monitoring of jobs and handle any defects.
You can share this story by using your social accounts:
Comments are closed.