1 min read
Offline Data Transfer with Azure Data Box
Azure offers several Data Box options: Data Box Disk : Up to 40 TB per order (8 TB per disk) Data Box : 100 TB storage capacity Data Box Heavy : Up to 1 PB…
Blog
Thoughts on data engineering, cloud architecture, and technology. 2205 articles and counting.
Showing 24 of 2205 posts — page 78 of 92
1 min read
Secure Data Sharing with Azure Data Share
Set up the data sharing infrastructure: Configure datasets to be shared: Invite consumers to access shared data: Set up automated data synchronization: On…
1 min read
Understanding Data Lineage with Azure Purview
Create and configure an Azure Purview account: Register various data sources for lineage tracking: Set up scans to discover and catalog data: Azure Data…
2 min read
Introducing Power BI Goals for OKR and KPI Tracking
Power BI Goals arrived in 2021 as Microsoft's answer to OKR tracking inside the BI platform, and I think it was better conceived than it might sound. The…
1 min read
Power BI Premium Gen2 - Enhanced Performance and New Capabilities
Premium Gen2 introduces several architectural improvements: Autoscale compute resources based on demand No need for capacity management or monitoring v…
1 min read
Databricks SQL Analytics is Now Generally Available
Databricks SQL Analytics provides: Native SQL interface to query Delta Lake tables SQL Endpoints with auto scaling compute Built in visualization and…
1 min read
Mastering Delta Lake MERGE Operations for Upserts and SCD
The MERGE statement combines INSERT, UPDATE, and DELETE operations in a single atomic transaction: Handle complex business logic with conditional updates:…
1 min read
Getting Started with Apache Spark 3.0 in Azure Synapse Analytics
First, let us create a new Spark pool with version 3.0 in Azure Synapse: One of the most significant improvements in Spark 3.0 is Adaptive Query Execution.…
1 min read
Helm Charts for Azure Kubernetes Service
Helm charts provide a powerful way to package and deploy applications to AKS with Azure specific integrations. By leveraging values files for environment…
1 min read
Azure Container Apps Concepts and Architecture
Azure Container Apps combines the simplicity of serverless with the power of containers. With built in Dapr integration, KEDA scaling, and revision…
1 min read
Dapr on Azure for Cloud-Native Applications
Dapr simplifies building cloud native applications by providing consistent APIs for common microservices patterns. With native Azure integration, you can…
1 min read
Azure Service Fabric for Microservices
Azure Service Fabric provides a mature platform for building microservices with built in state management, service discovery, and health monitoring. While…
1 min read
Circuit Breaker Pattern with Polly and Azure
The Circuit Breaker pattern is essential for building resilient microservices. Polly provides a mature implementation with advanced features like sampling…
1 min read
Implementing the Saga Pattern with Azure Services
The Saga pattern is how you handle distributed transactions—operations that span multiple microservices and need consistency guarantees—without two-phase…
2 min read
SSH Connect to Linux Server from a Mac using SOCKS5 Proxy
I've been spending a lot of time lately in setting up on-premises Linux Servers. There are a lot of reasons why you would like to SSH to a Linux server such…
1 min read
Event Sourcing Patterns with Azure Cosmos DB
Event Sourcing with Azure Cosmos DB provides a robust foundation for building systems that require complete audit trails, temporal queries, and event driven…
1 min read
CQRS Pattern Implementation with Azure Services
CQRS with Azure services enables building highly scalable applications with optimized read and write paths. Azure SQL provides transactional guarantees for…
1 min read
Leveraging Azure Architecture Center Reference Architectures
The Azure Architecture Center is the reference resource I bookmark more than any other when I need to move from "I know what I want to build" to "I know the…
1 min read
Implementing the Azure Well-Architected Framework
The Azure Well-Architected Framework is the document I send to clients at the start of every architecture engagement and the checklist I review before every…
1 min read
Implementing Azure Advisor Recommendations at Scale
Azure Advisor is the free recommendation service that surfaces findings your team should have already found—and usually hasn't. The five categories (Cost…
1 min read
Azure Cost Management Budgets and Alerts
Effective cost management requires proactive monitoring and automated responses. Azure Cost Management budgets provide the foundation for cost governance,…
1 min read
Multi-Tenant Management Patterns in Azure
Multi-tenant Azure management is the architecture problem I've spent more time on this year than any other. The patterns matter because the wrong choice…