Senior Data Engineer
Years of Experience:
Skills Stack:
Shift Timings:
Role and Responsibility Details:
Role: Data Engineer (a Data developer with experience in Python)
Years of Experience: 3-10 years
Work within Program:
Develop high-performance ETL pipelines on large datasets in the Azure cloud leveraging Databricks+Python as the BigData platform.
Required Skills
50% of work: Solid Python development skills is important. Knowledge and experience in Python for data manipulation or back-end API or framework development (NOT applications development unless a person with app development skills is OK and would like to work as a data engineer)
25% of work: Database Developer with strong knowledge of relational DB concepts and SQL on any relational DB
25% of work: Experience with any ETL framework/tool although SSIS preferred
Required but we can provide training and they can learn if lacking the experience in these areas
API Development in Python
Azure Data Factory (ADF)
SPARK, Databricks
Nice-to-have
Collaborative Agile experience
CI/CD skills
General Traits
Excellent Analytical & Communication Skills
Job Description:
Work within Program:
Develop high-performance ETL pipelines on large datasets in the Azure cloud leveraging Databricks+Python as the BigData platform.
Required Skills
50% of work: Solid Python development skills is important. Knowledge and experience in Python for data manipulation or back-end API or framework development (NOT applications development unless a person with app development skills is OK and would like to work as a data engineer)
25% of work: Database Developer with strong knowledge of relational DB concepts and SQL on any relational DB
25% of work: Experience with any ETL framework/tool although SSIS preferred
Required but we can provide training and they can learn if lacking the experience in these areas
API Development in Python
Azure Data Factory (ADF)
SPARK, Databricks
Nice-to-have
Collaborative Agile experience
CI/CD skills
General Traits
Excellent Analytical & Communication Skills
Qualifications:
Locations:
Contact:
Email: tdg-recruitment@thedigitalgroup.com
Please wait...