Senior Metadata Implementation Specialist
Markitech
Role Type: Contract [6+ months initially then more]
Important - We are looking for someone with hands-on experience implementing fabric Pipelines using frameworks and notebooks.
About the Role
We are seeking a Senior Metadata Implementation Specialist to spearhead the design, build, and operationalisation of our enterprise Metadata Management (MM) System. Using Microsoft Azure, this initiative leverages Microsoft Fabric and Microsoft Purview to create a unified, automated, and secure data governance landscape.
As the primary technical subject matter expert, you will bridge the gap between cloud infrastructure, data engineering, and data governance. You will be hands-on in configuring Microsoft Purview scanners, engineering automated metadata ingestion pipelines using Microsoft Fabric (OneLake, Data Factory, and PySpark), and integrating complex enterprise systems like Salesforce and Workday. You will ensure compliance while enabling data stewards and business owners to trust and utilise our data assets.
The hourly rate for this 6+month engagement is a minimum $70CAD$/hr (negotiable) and is fully remote, but should be in Canada.
Key Responsibilities
Microsoft Purview Setup & Metadata Governance
- Implement and operationalize the Microsoft Purview Data Map and Data Catalog, including the configuration of automated scanners, classifications, and custom lineage ingestion.
- Utilize Apache Atlas REST APIs to build complex Purview metadata graph relationships, utilizing GUID-based linkage for custom data assets.
- Design and implement governance workflows, business glossary lifecycles, and tooling for data stewards to maintain data quality and ownership.
- Support Master Data Management (MDM) alignment, canonical modeling, and enterprise data governance best practices.
Microsoft Fabric & Data Engineering
- Architect and develop Microsoft Fabric pipelines and Synapse Data Engineering notebooks (PySpark/Python) to automate metadata ingestion and data movement.
- Establish scalable integration patterns and Fabric architecture designs leveraging OneLake (Lakehouse Gen2).
- Extract, transform, and load metadata from external platforms, including Salesforce (via REST/Bulk APIs), Workday (via RaaS), SQL Server, and custom applications.
Azure Infrastructure, Security & CI/CD
- Ensure a strict Zero-Trust architecture, adhering to PHI and PIPEDA compliance standards.
- Configure and integrate secure Azure services, including Azure Key Vault, Managed Identities, Azure Storage, Azure Functions, and Azure Monitor/Log Analytics for SIEM flows.
- Develop robust CI/CD pipelines (YAML, Git) for deploying Purview artifacts, Fabric notebooks, and metadata automation scripts across development, test, and production environments.
- Collaborate cross-functionally with enterprise architects, data stewards, integration developers, and business stakeholders.
Required Skills & Experience
- Experience: 5–10 years in highly technical Data Engineering, Cloud Data Architecture, or Platform Engineering roles.
- Data Governance Tech: 2+ years of hands-on experience implementing Microsoft Purview or Apache Atlas, including deep knowledge of metadata lifecycles, lineage tracking, and stewardship roles.
- Microsoft Fabric & Data Lake: Hands-on expertise with Microsoft Fabric (OneLake/Lakehouse architecture), building pipelines, and writing advanced PySpark and Python code.
- API & Integrations: Proven experience integrating complex enterprise APIs, specifically extracting data/metadata from Salesforce and Workday (RaaS).
- Azure Ecosystem: Strong practical knowledge of Azure networking (Private Endpoints, VNet integration), security (RBAC, Managed Identities), and infrastructure deployment.
Preferred Qualifications
- Background in the Healthcare industry with an understanding of handling sensitive healthcare data and PHI regulatory requirements.
- Familiarity with integration platforms (iPaaS), specifically Boomi integration patterns.
- Understanding of architectural governance frameworks, such as TOGAF 10.