Fabric's Data Engineering Agent: Set Guardrails Before Autonomy
Fabric's preview data engineering agent runs with the launching engineer's permissions. What to delegate first, which settings to pick, and what stays human.
91 articles
Fabric's preview data engineering agent runs with the launching engineer's permissions. What to delegate first, which settings to pick, and what stays human.
Fabric IQ is GA in Copilot Chat, Cowork and MCP. Treat each semantic model as an agent endpoint: RLS, OLS, metadata contracts and default-on access.
Foundry's preview egress controls attach ordered destination rules to a hosted agent. Why that limits prompt-injection damage, and how to roll it out safely.
GPT-6 arrived in Foundry ten weeks after GPT-5.6. Pin versions, gate on real queries, shadow traffic and plan retirements before you switch tiers on day one.
Power Platform and Dynamics 365 release plans moved to the AI at Work roadmap. Why a CoE now needs continuous change intake, not two planning events a year.
Power BI now converts single Direct Lake tables to Import in web modelling, making storage mode a per-table choice with real refresh and governance costs.
Foundry Model Router picks from OpenAI, Anthropic, DeepSeek, xAI and Meta models. Treat subsets, policy and model logging as governance, not tuning knobs.
Git integration and fabric-cicd ship Fabric items well. Workspaces, capacity, domains, roles and tenant settings still need their own source of truth.
Use a read-only service principal, the scanner APIs and the Fabric admin APIs to detect governance drift in a Fabric tenant, without handing it write access.
How identity flows through OneLake shortcuts: passthrough vs delegated, SQL endpoint access modes, the Direct Lake over SQL exception, and lost policy.
How workspace splits, item names, descriptions, endorsement and domains decide what people find in the OneLake catalog, plus a findability test you can script.
Fabric sensitivity labels apply per item, not per table, so item boundaries, defaults, inheritance and protection policies need designing before OneLake grows.
How to run blameless reviews for data quality incidents: record who detected it, which control was missing, and turn each review into a tracked change.
A passthrough OneLake shortcut adds speed but no boundary: how to give data science teams curated Fabric features without opening the whole lakehouse.
Treat every OneLake shortcut as a cross-team dependency: placement, identity, write paths, environment variables and a REST inventory of what points where.
How to cut an inherited data quality rule set down to the checks that change decisions, using failure history, ownership and an explicit retirement path.
How to stop Fabric workspace and item sprawl before it starts: lifecycle states, domains, tags, endorsement, retention settings and a weekly hygiene audit.
Foundry Agent Service went GA in mid-March 2026, but monitoring and tracing are still preview. What's governed now, and the controls I'd add first.
Why adding people as Fabric workspace Contributors is the access shortcut that erodes OneLake boundaries, and a faster pattern that keeps them intact.
A table contract is half the job: assigning owners per layer, collapsing load outcomes to three, and mapping Fabric pipeline failures to runbooks.
How I split Microsoft Foundry resources and projects by environment and use case so RBAC, quota and agent data line up with ownership and delivery speeds up.
Why OneLake governance has to be designed before scale: table contracts, schema-enabled lakehouses, explicit owners and deliberate failure modes in Fabric.
What the Microsoft Foundry rename means in early 2026: Foundry projects vs hubs, the preview portal, prompt flow's place, and how I'd decide.
The AI security failures that actually cost money are leaked keys, unbounded token spend and sensitive data in logs. Fix those before prompt defences.
Computational governance scales where manual review cannot. Embed policies in CI/CD pipelines to catch issues before they reach production.
An AI CoE serves as the central hub for AI expertise, governance, and best practices. It prevents siloed implementations and ensures consistent quality…
Comprehensive AI governance ensures responsible and compliant AI deployment.
A practical look at the agent tooling that really exists on 1 January 2025, what is still preview, and where to draw the line on autonomy.
AI governance is not bureaucracy - it's enablement with guardrails. Build governance that enables innovation while managing risk appropriately.
The EU AI Act is complex but manageable with systematic approach. Start your inventory now, prioritize high-risk systems, and build compliance into your…
Regulation is here to stay. Treat compliance as a feature, not a burden, and build it into your AI development process.
AI safety is no longer optional. Build safety into your AI systems from the start, not as an afterthought.
Effective Microsoft Fabric governance requires attention to access control, data quality, cost management, and lifecycle management. This month's…
1. Collect comprehensively : Gather data from all sources 2. Aggregate appropriately : Different audiences need different views 3. Automate distribution :…
1. Tag everything : Consistent tagging enables accurate allocation 2. Use multiple methods : Combine direct, shared, and overhead allocation 3. Document…
1. Start with showback : Build understanding before chargeback 2. Keep it simple : Complex models create disputes 3. Automate collection : Manual processes…
1. Start with visibility : You can't optimize what you can't see 2. Allocate costs : Enable accountability through showback/chargeback 3. Automate policies…
Security is foundational to any data platform. Today I'm exploring the security architecture and best practices in Microsoft Fabric.
A data marketplace enables data discovery, sharing, and consumption across your organization. Today I'm exploring how to build one using Microsoft Fabric.
Data contracts formalize the agreement between data producers and consumers. Today I'm exploring how to implement effective data contracts in your data…
Federated governance balances domain autonomy with organizational standards. Today I'm exploring how to implement effective federated governance in…
1. Clear domain boundaries Define ownership clearly 2. Product thinking Treat data as a product 3. Self serve enablement Empower domain teams 4.…
Workspaces are the containers for collaboration in Fabric. Effective governance ensures organization, security, and efficiency. Today I'm covering workspace…
Tenant settings control what users can do in your Fabric environment. Today I'm covering the essential settings every admin should configure.
Fabric administration has matured significantly. Today I'm covering the latest admin capabilities for managing your Fabric environment effectively.
Unity Catalog extends governance to machine learning assets. Manage models, features, and experiments with the same rigor as your data.
1. Define clear policies What's allowed, what's not 2. Implement review Human approval for external use 3. Track everything Full audit trail 4. Disclose…
A readiness checklist for the Data Activator preview in Fabric: tenant switches, throughput and alert limits, failure modes, and when to wait for GA.
How to run internal-only GPTs in ChatGPT Enterprise: sharing controls, what knowledge files really expose, Actions auth, and when to build instead.
AI introduces risks that cut across data, models, operations and people. Over the past year I've helped teams map those risks to concrete controls — from…
Governance isn't a checkbox — it's what lets organisations scale AI safely. The frameworks I use combine risk tiers, model lifecycle controls, and pragmatic…
Fabric endorsement — the Promoted and Certified badge system for Fabric items — is a lightweight but important trust signal in a self-service analytics…
Fabric governance is where the platform's SaaS architecture creates both an advantage and a complication for enterprise security teams. The advantage…
Item permissions provide the flexibility to share specific artifacts securely. Tomorrow, I will cover Row-Level Security in Fabric.
Proper role management is essential for secure and efficient collaboration. Tomorrow, I will cover Item Permissions in more detail.
Security is an ongoing responsibility. Tomorrow, I will cover Workspace Roles in more detail.
A Fabric workspace is the collaboration boundary in Microsoft Fabric—the container where Fabric items (Lakehouses, Warehouses, Notebooks, Pipelines, KQL…
1. Start early : Include ethics from project inception 2. Involve stakeholders : Get diverse perspectives 3. Document everything : Decisions, trade offs,…
Azure OpenAI's preview ships with use-case review, content filtering and abuse monitoring. Here is where those controls stop and your application's begin.
A security baseline for an Azure OpenAI preview resource in January 2023: private endpoints, Azure AD auth, customer-managed keys, logging and policy.
Azure OpenAI is still a limited-access preview as 2023 starts. Here is what to settle now on access, identity, data handling and code so you're ready for GA.
AI governance must balance: Innovation : Enabling teams to use AI effectively Risk : Managing security, privacy, and compliance risks Consistency : Ensuring…
Microsoft's framework provides a solid foundation: 1. Fairness : AI should treat all people fairly 2. Reliability & Safety : AI should perform reliably and…
Approvals and checks ensure deployments meet organizational requirements.
A well-planned environment strategy enables teams to move fast while maintaining governance and security.
Understanding solution layering prevents deployment issues and ensures predictable behavior across environments.
Proper ALM ensures Power Platform solutions are reliable, maintainable, and can be safely deployed across environments.
How DirectQuery for Power BI datasets lets teams extend a certified model with their own data, what the preview limits are, and when not to chain.
How the preview Azure Advisor Score is weighted, why dismissals inflate it, and how to pair it with Resource Graph queries before you report it upward.
How to run Azure Well-Architected Reviews on a cadence: what the assessment covers, what Azure Advisor adds between reviews, and what neither can tell you.
How to use the Microsoft Cloud Adoption Framework for strategy, planning, governance and operations, not just as a landing zone template library.
What an Azure landing zone is in early 2022, and how to choose between the portal accelerator, the Terraform module and your own Bicep.
Azure Blueprints has sat in preview since 2018; here's how to keep landing zone governance portable with Bicep, Template Specs, Policy and locks.
How to run Azure Policy from a Git repo with Bicep: what to version, how to stage controls safely, and how to test without a local evaluator.
Set Azure Hybrid Benefit in Bicep, audit it with Resource Graph and Azure Policy, and size core licences so the discount never becomes a compliance finding.
Managed Environments represent a significant maturation of Power Platform governance. For enterprises that want to enable citizen development while…
Databricks cluster policies are the governance layer that prevents the classic enterprise data platform problem: data scientists spinning up 64-node GPU…
Activity Logs include several categories: Administrative : Resource management operations (create, update, delete) Security : Security Center alerts and…
Set up the data sharing infrastructure: Configure datasets to be shared: Invite consumers to access shared data: Set up automated data synchronization: On…
Create and configure an Azure Purview account: Register various data sources for lineage tracking: Set up scans to discover and catalog data: Azure Data…
Effective cost management requires proactive monitoring and automated responses. Azure Cost Management budgets provide the foundation for cost governance,…
Multi-tenant Azure management is the architecture problem I've spent more time on this year than any other. The patterns matter because the wrong choice…
Azure Management Groups are the first thing I help clients set up when their Azure estate starts involving more than two or three subscriptions. Without…
Azure Resource Graph is the query service that answers "what do we actually have in Azure?" at enterprise scale in milliseconds. The ARM APIs query each…
Power Platform governance is the problem that doesn't announce itself until it's already serious. I've walked into tenants where three hundred flows were…
Cloud bills have a way of arriving late and being everyone's problem at once. Cost Management is the tool that moves that conversation from quarterly shock…
The first time I helped a platform team stand up a new environment from scratch, we got it right on the third try. The first two tries had a RBAC assignment…
The tagging policy conversation is the one I have in every landing zone engagement. Someone inevitably says "we'll just ask people to tag resources…
Every cloud bill story I've heard starts the same way: "we didn't realise it was running." A test VM left on over a long weekend, a Premium SSD attached to…
Blueprints ensure every environment starts from a known, compliant state.
Every Azure environment I've inherited from someone else has the same three problems: storage accounts created without encryption-at-rest configuration…