Careers

Role: Data Engineer (a Data developer with experience in Python)

Years of Experience: 3-10 years

Work within Program:

        Develop high-performance ETL pipelines on large datasets in the Azure cloud leveraging Databricks+Python as the BigData platform.

        Required Skills

50% of work: Solid Python development skills is important. Knowledge and experience in Python for data manipulation or back-end API or framework development (NOT applications development  unless a person with app development skills is OK and would like to work as a data engineer)

        25% of work: Database Developer with strong knowledge of relational DB concepts and SQL on any relational DB

        25% of work: Experience with any ETL framework/tool although SSIS preferred

        Required but we can provide training and they can learn if lacking the experience in these areas

        API Development in Python

Azure Data Factory (ADF)

        SPARK, Databricks

        Nice-to-have

        Collaborative Agile experience

CI/CD skills 

        General Traits

        Excellent Analytical & Communication Skills

Work within Program:

        Develop high-performance ETL pipelines on large datasets in the Azure cloud leveraging Databricks+Python as the BigData platform.

        Required Skills

50% of work: Solid Python development skills is important. Knowledge and experience in Python for data manipulation or back-end API or framework development (NOT applications development  unless a person with app development skills is OK and would like to work as a data engineer)

        25% of work: Database Developer with strong knowledge of relational DB concepts and SQL on any relational DB

        25% of work: Experience with any ETL framework/tool although SSIS preferred

        Required but we can provide training and they can learn if lacking the experience in these areas

        API Development in Python

Azure Data Factory (ADF)

        SPARK, Databricks

        Nice-to-have

        Collaborative Agile experience

CI/CD skills 

        General Traits

        Excellent Analytical & Communication Skills