Careers

Senior Data Engineer

Years of Experience: 
3-10 Years
Skills Stack: 
Python, SQL Server and ETL Tool
Shift Timings: 
12:30 pm - 09:30 pm
Role and Responsibility Details: 

Role: Data Engineer (a Data developer with experience in Python)

Years of Experience: 3-10 years

Work within Program:

        Develop high-performance ETL pipelines on large datasets in the Azure cloud leveraging Databricks+Python as the BigData platform.


        Required Skills

50% of work: Solid Python development skills is important. Knowledge and experience in Python for data manipulation or back-end API or framework development (NOT applications development  unless a person with app development skills is OK and would like to work as a data engineer)

        25% of work: Database Developer with strong knowledge of relational DB concepts and SQL on any relational DB

        25% of work: Experience with any ETL framework/tool although SSIS preferred


        Required but we can provide training and they can learn if lacking the experience in these areas

        API Development in Python

Azure Data Factory (ADF)

        SPARK, Databricks


        Nice-to-have

        Collaborative Agile experience

CI/CD skills 


        General Traits

        Excellent Analytical & Communication Skills

Job Description: 

Work within Program:

        Develop high-performance ETL pipelines on large datasets in the Azure cloud leveraging Databricks+Python as the BigData platform.


        Required Skills

50% of work: Solid Python development skills is important. Knowledge and experience in Python for data manipulation or back-end API or framework development (NOT applications development  unless a person with app development skills is OK and would like to work as a data engineer)

        25% of work: Database Developer with strong knowledge of relational DB concepts and SQL on any relational DB

        25% of work: Experience with any ETL framework/tool although SSIS preferred


        Required but we can provide training and they can learn if lacking the experience in these areas

        API Development in Python

Azure Data Factory (ADF)

        SPARK, Databricks


        Nice-to-have

        Collaborative Agile experience

CI/CD skills 


        General Traits

        Excellent Analytical & Communication Skills


       

Qualifications: 
* Bachelor of Technology in Computer Science,BE ,* Bachelor of Engineering in Computer Science
Locations: 
Pune- Pyramid
Contact: 
Recruitment Team
Email: tdg-recruitment@thedigitalgroup.com