About the position

Quality Data Engineer

Job Description:

We are seeking a Quality Data Engineer with a strong background in data quality engineering and data migration. The ideal candidate will have expertise in SQL, AWS/Redshift, and hands-on experience with data pipelines and migration efforts. This role will focus on ensuring the quality of data as it transitions from on-premise systems (SQL Server) to AWS/Redshift and integrates with platforms like Salesforce. The successful candidate will be involved in implementing and documenting processes, ensuring the adaptation of best practices, and integrating quality measures into data systems.

Key Responsibilities:

• Lead and maintain data migration efforts from on-premise SQL Server to AWS/Redshift, ensuring data quality throughout the process.
• Design, implement, and monitor data pipelines with a strong focus on quality and best practices.
• Work collaboratively with software engineers and data teams to implement QE (Quality Engineering) practices for development processes.
• Develop, document, and maintain best practices for data quality in the context of AWS and Salesforce integrations.
• Utilize and manage tools like SSIS, Python, CData (nice to have), dbt, and Astronomer to maintain data quality across environments.
• Build, maintain, and optimize SQL queries and scripts for data extraction, transformation, and loading.
• Collaborate with teams to define and enforce data governance and quality assurance measures.
• Work on integrating and automating data validation processes and quality checks within the pipeline.

Required Qualifications:

• 3+ years of experience in Data Engineering with a focus on data quality.
• Proficiency in SQL and experience working with AWS/Redshift environments.
• Experience with data migration projects from SQL Server to cloud platforms such as AWS/Redshift.
• Hands-on experience with SSIS, Python, and working knowledge of dbt and Astronomer (nice to have).
• Strong understanding of Quality Engineering (QE) practices and their application in data engineering processes.
• Experience with data integration platforms like Salesforce.
• Strong documentation skills with the ability to adapt and adopt best practices for data quality and governance.

Preferred Qualifications (Nice to Have):

• Experience with CData for data integration.
• Hands-on experience with dbt and Astronomer for managing data pipelines.

Requirements