Principal Data Platform Engineer

About this role

Role: Principal Data Platform Engineer Location: US Remote (Preference given to Dallas, TX or Scottsdale, AZ candidates) Synonymous Business Title (s): Business Analytics Director

Overview:

Blue Yonder is seeking a Principal Data Platform Engineer to own the platforms our data and AI capabilities run on, Power BI, AtScale, and Databricks. As Blue Yonder deploys an AI-first operating model, these platforms are the critical foundation for how the enterprise sees, decides, and acts. Their performance, reliability, and accessibility are functions this role owns outright.

This is a deeply technical senior individual contributor role . The successful candidate pairs hands-on platform administration and engineering depth with the judgment to make architecture, cost, and governance decisions that hold up at enterprise scale, and the credibility to set standards across a large data organization without formal authority. Outcomes in this role are visible to executive leadership and felt by every user of the platform.

Technical Stack: • Databricks: Expert-level administration; Unity Catalog, cluster policies, SQL warehouses, identity and workspace configuration, and cost controls • Power BI: Deep tenant and capacity administration experience, including capacity management, gateways, workspace architecture, and deployment pipelines • Semantic Layers: Hands-on experience administering a semantic layer platform; AtScale strongly preferred • Cloud Infrastructure: Strong working knowledge of Azure; Identity (Entra ID), networking, storage, private endpoints, and cost management • SQL: Expert-level SQL for troubleshooting, performance tuning, and usage analysis • Automation: Python and/or PowerShell for platform automation, API-driven administration, and reporting; comfort with version control, CI/CD, and infrastructure-as-code • Identity & Security: SSO, SAML/OAuth, service principles, role-based access control, and data-level security models • AI Platform Tooling: Practical experience configuring and governing enterprise AI tooling, connectors, MCP server connections, agent and assistant configuration, and the access boundaries around them

What You’ll Be Doing:

Platform Management & Administration • Own the day-to-day administration, configuration, and health of the enterprise data and AI platform estate: Power BI, AtScale, Databricks, Microsoft Copilot, and Claude • Administer Databricks workspaces, cluster policies, SQL warehouses, Unity Catalog, service principals, and workspace-level security • Manage the Power BI tenant end to end—tenant settings, capacity, workspace architecture, data gateways, and deployment pipelines • Administer AtScale, including semantic model deployment, catalog and environment management, aggregate strategy, and query engine tuning • Manage the enterprise AI platform layer—entitlement and seat administration, workspace and project structure, and enablement of new capabilities as they ship • Define and run upgrade, patch, and release management processes; test and roll out platform changes without disrupting users

Reliability, Performance & Support • Own platform availability and performance; serve as the senior escalation point for platform-level incidents • Establish monitoring, alerting, and observability across the estate, including performance baselines and capacity headroom tracking • Diagnose complex problems that span identity, network, compute, and semantic layers, driving them to root cause rather than symptom relief • Act as the key point of contact for the data team and business end users across all platforms—triage, resolution, and follow-through • Build runbooks, self-service documentation, and enablement material that reduce recurring support demand

Cost Optimization • Own the cost model for the platform estate: capacity sizing, compute policies, autoscaling behavior, SKU selection, licensing, and consumption-based AI spend • Identify and eliminate waste—idle compute, oversized capacity, unused licenses, inefficient queries, and redundant refresh schedules • Build showback and chargeback reporting so business units can see and be accountable for their own consumption • Forecast platform spend, partner with Finance on budget planning, and quantify the return on platform investment

Governance & Security • Implement and enforce governance across platforms: access models, role-based and row-level security, workspace and catalog standards, and content certification processes • Own governance of the AI layer—which data AI tools may reach, which connectors and integrations are approved, and how usage is logged, retained, and audited • Partner with Security, IT, and Legal on data residency, data loss prevention, audit, and regulatory requirements • Maintain the authoritative documentation set for the platform: standards, architecture decisions, and configuration baselines

Configuration & Integration • Configure and maintain integrations across the estate, including MCP server connections, cross-platform connectivity, single sign-on, service principals, and API and gateway configuration • Evaluate, pilot, and productionize new platform capabilities, connectors, and integration patterns, including the AI tooling that increasingly depends on them • Manage environment promotion across development, test, and production, applying infrastructure-as-code and version control where practical

Usage Analytics & Reporting • Instrument and report on platform usage—active users, workload patterns, adoption by team, AI tool utilization, and license efficiency • Convert usage data into recommendations: where to invest, where to consolidate, and where enablement is needed • Deliver recurring reporting on platform health, cost, adoption, and risk to data leadership and executive stakeholders

Vendor Relationships • Serve as the primary technical relationship owner for platform vendors, including Microsoft, Databricks, AtScale, and Anthropic • Manage support escalations, road

Similar jobs

• Principal Data Engineer — CNA · Chicago, IL
• Principal Data Engineer — Empower · Remote
• Principal Data Engineer — Recordedfuture · Boston, MA
• Principal Data Engineer — Rdccareers · Austin, Texas, United States
• Principal Data Engineer — Dragos · Remote
• Principal Data Engineer — Trueanomalyinc · Denver, CO or Long Beach, CA
• Principal Data Engineer — Octus · Remote
• Principal Data Engineer — Beaconbiosignals · Remote