Data Engineer

Dinagaran Veerappan

3SUSA

Contract
Remote
Posted 3 years ago

Core Skills Mandatory with minimum 3-4 years of experience with self rating:

  1. Databricks
  2. PySpark
  3. Spark SQL
  4. Python
  5. Concepts of Azure Cloud
  6. Familiarity with Azure DevOps, Azure LogicApp, ADLS, Delta lake/tables
  7. Spark
  8. Hadoop
  9. BigData

 

JD

 

·       The candidate must have Architecture knowledge of Big data & related concepts.

·       The candidate must be hands on experienced in Azure Databricks, Pyspark, SparkSQL & Python.

·       Candidate must be very strong in SQL & PL/SQL.

·       Nice to have some familiarity on MDM Concepts.

·       Must be familiar with Azure.

·       Familiarity with Azure DevOps, Azure LogicApp, ADLS, Delta lake/tables

·       Must have strong communication skills.

·       Must have good working knowledge of Spark & Hadoop.

 

Activities involved:

  1. Enhance existing data pipelines as per business requirements
  1. Perform Data analysis as needed
  2. Review code with client leads
  3. Create jobs to schedule data pipelines as per requirements
  4. Work with Azure DevOps team for production implementation and release activities
  5. Post production monitoring of jobs and handle any defects.

Apply Online

A valid email address is required.
You can share this story by using your social accounts: