Azure ADB/ADF Migration Project

Duration : 6 Months
Shift : US shift

Job Summary:
We are seeking a skilled Data Engineer with 5+ years of experience in designing, developing, and
implementing data migration and archival solutions. The ideal candidate will have expertise in Azure cloud
technologies, ETL/ELT development, data validation, and enterprise data migration projects involving ERP and
HCM systems. This role will focus on building scalable data pipelines, ensuring data quality, and supporting
large-scale migration and archival initiatives.

Technologies:
Azure Data Lake, Azure Data Bricks, Azure Data Factory, Azure DevOps, Gitlab, Github, & Snow

Key Responsibilities:
• Design and implement ETL processes to move data from various legacy systems to Azure data
platforms.
• Design and develop data orchestration workflows using Azure Data Factory (ADF).
• Build data transformation and consolidation pipelines using Azure Databricks.
• Use Azure Data Factory or Data Bricks orchestration tools to automate and schedule data
pipelines/Job workflows
• Design efficient data models (e.g., star or snowflake schema) for use in analytical applications and
reporting systems.
• Contribute to solution design discussions, code reviews, and implementation of migration best
practices.
• Continuously monitor the health of pipelines, jobs and infrastructure, ensuring they are running
efficiently and securely
• Address and resolve data issues, including failures in ETL pipelines, system performance problems,
and data inconsistencies
• Keep logs of pipeline performance, failures, and system updates to provide visibility for monitoring
and troubleshooting
• Work independently to deliver assigned migration workstreams while coordinating effectively with
cross-functional teams.
• Monitor migration execution, analyze results, and recommend improvements to increase reliability,
scalability, and operational efficiency.
• Ensure that all data engineering processes comply with industry security standards and best
practices, including encryption, access controls, and data masking
• Collaborate with legacy system owners, business stakeholders, application teams, and architects to
understand migration requirements and define technical solutions.

Qualifications:
• Bachelor's degree in B.E in Computer Science, Data Management, or a related field.
• Proficiency in coding skills such as Python, Pyspark & Azure SQL
• Strong understanding of data management and automation.
• Excellent analytical, troubleshooting and problem-solving skills.
• Years of Experience – 5-8 years in a similar role.