Must haves:
- 5 - 10 years of proven working experience in an ETL role; strong understanding of ETL principles, including data extraction, transformation, and loading processes.
- · Strong SQL skills and experience working with Azure SQL Databases and Dataverse.
- · Knowledge of Microsoft Dynamics 365 Customer Engagement (CE).
Nice to have:
- Azure cloud certifications (e.g. Azure fundamentals, Azure Data Engineer associate, Azure Database Administrator associate)
Experience and Skillset Requirements
Mandatory Requirements
- 5+ years of proven working experience in an ETL role; strong understanding of ETL principles, including data extraction, transformation, and loading processes.
- Strong SQL skills and experience working with Azure SQL Databases and Dataverse.
- Knowledge of Microsoft Dynamics 365 Customer Engagement (CE).
Nice to Have Requirements
- Azure cloud certifications (e.g. Azure fundamentals, Azure Data Engineer associate, Azure Database Administrator associate)
Desired Skills and Experience
- 5+ years of proven working experience in an ETL role; strong understanding of ETL principles, including data extraction, transformation, and loading processes; knowledge of common ETL design patterns.
- Experience in integrating various data sources and systems, using Azure ETL technologies such as Synapse.
- Knowledge of technologies commonly used with Dynamics 365, such as DataVerse / Common Data Service (CDS), Data Entities, and APIs.
- Expertise in data transformation techniques, such as data cleansing, aggregation, enrichment, and normalization using Azure cloud technologies.
- Understanding of data quality management practices, including data profiling, data validation, and error handling within ETL processes.
- Understanding of data governance principles, data privacy regulations and experience working with high-sensitivity data, and knowledge of best practices for data security and compliance in Azure.
- Strong SQL skills and experience working with Azure SQL Databases and Dataverse; good understanding of Azure storage concepts and technologies; Expert in data manipulation languages (T-SQL), data definition languages, physical database design, data modelling, query performance analysis & tuning.
- Familiarity with version control systems (e.g., Azure Repos) and collaboration tools (e.g., Azure DevOps) for managing code, tracking changes, and collaborating with team members.
- Experience with continuous integration/continuous deployment (CI/CD) processes around DevOps, data workflows, Synapse workspaces.
- Experience with SQL Server Management Studio, Azure data management tools, XRM toolbox.
A Note on Assignment Type:
Scope
- The Office of the Public Guardian and Trustee (OPGT) requires a Senior Software Developer – ETL to validate the data migration from the existing OPGT legacy applications to the new Dynamics 365 OPGT solution.
Assignment Deliverables
As a member of the data migration team, you will be responsible for validating the quality of the data migration from the legacy application to Dynamics, in preparation for go-live. A high-level list of deliverables follows:
- Data Analysis: analyze the existing data in the legacy applications, understand its structure, quality, and relationships.
- Data Mapping and Transformation: read the existing data migration code to understand the mapping of the data elements from the legacy application to the corresponding entities and fields in Dynamics 365 CE
- Data Testing and Quality Assurance: conduct thorough testing to verify the accuracy and integrity of the migrated data; define test cases, perform data reconciliation, and address any issues or discrepancies that arise during the testing phase; develop KPIs to report on the progress, completeness, and quality of the data migration effort.
- Data Migration Test Plans: Develop comprehensive test plans outlining the testing approach, scope, objectives, and the resources required for data migration quality assurance.
- Data Migration Test Cases: Create detailed test cases and test scripts covering all aspects of data migration, including data extraction, transformation, loading, and validation.
- Data Fix Development: Modify data migration code to address data migration issues.
- Documentation: Maintain detailed documentation of test cases, test results, and any modifications made to the test plan during the project.
- Ongoing Support: provide post-migration support, analyze, and address data-related issues or questions; help optimize data management processes in the new environment.
- Other duties as assigned.
The Vendor’s Personnel will also be required to:
- Complete work and achieve milestones within the assigned deadlines.
- Notify the Cluster/Ministry project Manager in writing of any issues or other material concerns related to the Assignment Deliverables as soon as he/she becomes aware of them.
- Submit Deliverables for the Cluster/Ministry approval as they are completed.
- Comply with the Ontario Government and the Cluster/Ministry security procedures and practices.
- Comply with the Ontario Government and the Cluster/Ministry architecture/technology standards and best practices.
- Comply with the Ontario Government and the Cluster/Ministry Conflict of Interest and Confidentiality Guidelines.
- Provide knowledge and skill transfer to a designated Cluster/Ministry staff; and comply with the Ontario Government I&IT Directive, Operational Policy on the I&IT Project Gateway Process, and other applicable Guidelines, Standards and Procedures.