Back Senior Data Engineer

Build batch and/or streaming pipelines for Azure and GCP billing data, with an architecture that can extend to additional cloud providers

Normalize provider-specific billing and usage data into a consistent, FOCUS-aligned model

Ingest and join resource inventory, tagging, ownership, product, service, and environment metadata

Implement reconciliation checks between source billing systems, the normalized warehouse, and downstream reporting datasets

Establish data contracts, schemas, lineage, freshness checks, completeness checks, and failure-handling patterns

Create reusable transformations that support executive dashboards, product-level cost views, burn-rate reporting, and anomaly detection

Build operational visibility for pipeline health, including freshness, latency, volume, schema drift, and failed-record monitoring

Partner with platform, FinOps, Finance, and service-owning teams to resolve data-quality gaps and improve attribution coverage

Document pipeline behavior, ownership, runbooks, recovery procedures, and known data limitations

Improve automation, test coverage, deployment safety, and cost efficiency of the data platform

Build or integrate event-driven ingestion patterns so new Cost Management exports trigger processing without manual refreshes

Support Microsoft Fabric, Data Lake, Data Factory, and KQL-based consumption patterns where they fit the target architecture

Treat private endpoints, private DNS, managed identities, Entra ID/RBAC, and disabled public access as part of the data-platform design—not afterthoughts

• Participate in on-call rotations and contribute to improving system reliability and incident response