1 min read
Transformers Library: The Swiss Army Knife of NLP
Tomorrow we'll explore the Accelerate library for distributed training. Transformers Documentation Pipeline API Model Hub
Blog
Thoughts on data engineering, cloud architecture, and technology. 2205 articles and counting.
Showing 24 of 2205 posts — page 45 of 92
1 min read
Hugging Face Model Hub: Finding and Using Pre-trained Models
Tomorrow we'll explore the Transformers library in depth. Hugging Face Hub Hub Documentation Model Cards
1 min read
Hugging Face + Azure: Running Open Source Models in the Cloud
Hugging Face and Microsoft's partnership has made the model hub directly accessible from Azure ML, and in August 2023 this is meaningfully useful for Llama…
1 min read
PEFT Libraries: Practical Tools for Efficient Fine-Tuning
Tomorrow we'll explore Hugging Face integration with Azure. PEFT Documentation PEFT GitHub TRL Library
1 min read
Parameter-Efficient Fine-Tuning: A Comprehensive Guide
Tomorrow we'll explore PEFT libraries and their practical usage. PEFT Library Documentation Adapter Transformers PEFT Methods Survey
1 min read
LoRA and QLoRA: Efficient Fine-Tuning for Large Language Models
Tomorrow we'll explore parameter efficient fine tuning methods in more depth. LoRA Paper QLoRA Paper PEFT Library Hugging Face LoRA Guide
1 min read
LLM Fine-Tuning Strategies: When and How to Customize Models
Fine-tuning is the right answer to fewer questions than the hype suggests, and I want to be precise about when it actually makes sense before diving into…
1 min read
File Processing with AI: Automating Data Workflows
File processing — extracting structured data from PDFs, converting between formats, parsing inconsistent CSVs, pulling content from Excel sheets with…
1 min read
AI-Powered Visualization: Creating Charts with Natural Language
Visualization has always required a combination of skills that rarely all sit in the same person: data access, statistical understanding, and design…
1 min read
Data Analysis with AI: Practical Patterns and Techniques
The Code Interpreter release this month changed how I approach quick data analysis tasks. Not the deep, production-grade EDA that belongs in a Fabric…
1 min read
ChatGPT Code Interpreter: Data Analysis for Everyone
OpenAI released Code Interpreter for ChatGPT Plus subscribers on July 6, 2023 — and within a week it had become my default tool for quick data exploration…
1 min read
Azure OpenAI Code Interpreter: AI-Powered Data Analysis
Tomorrow we'll explore ChatGPT Code Interpreter capabilities. Azure OpenAI Assistants Code Interpreter Guide Azure OpenAI Pricing
1 min read
Experiment Tracking in Fabric: Best Practices and Patterns
Tomorrow we'll explore Azure OpenAI Code Interpreter. MLflow Tracking Experiment Best Practices MLOps Patterns
1 min read
MLflow in Fabric: Experiment Tracking and Model Management
MLflow in Fabric is the managed tracking layer that turns a Spark notebook into a reproducible experiment record. The integration is transparent — you…
1 min read
ML Models in Fabric: Training, Registry, and Deployment
Tomorrow we'll explore MLflow integration in Fabric. Model Management in Fabric MLflow Model Registry Model Deployment Guide
1 min read
Fabric Data Science: ML Workflows in the Modern Data Platform
Data Science in Fabric brings ML experiment tracking, model registration, and batch prediction into the same platform where the training data lives — which…
1 min read
Real-Time Dashboards in Fabric: Live Data Visualization
Tomorrow we'll explore Fabric Data Science capabilities. Real Time Dashboard Documentation KQL Visualizations Dashboard Best Practices
1 min read
Eventstreams in Fabric: Streaming Data Ingestion
Tomorrow we'll explore Real Time Dashboards for visualizing streaming data. Eventstream Documentation Event Hub Integration Streaming Best Practices
1 min read
KQL Databases: Advanced Patterns and Techniques
'{ "SoftDeletePeriod": "90.00:00:00", "Recoverability": "Enabled" }' '{ "DataHotSpan": "7.00:00:00", "IndexHotSpan": "14.00:00:00" }'
1 min read
Fabric Real-Time Analytics: Stream Processing at Scale
'{' ' "SoftDeletePeriod": "30.00:00:00",' ' "Recoverability": "Enabled"' '}'
1 min read
Query Insights in Fabric: Monitoring and Optimization
Tomorrow we'll explore Fabric Real Time Analytics. Query Insights Documentation Performance Tuning Monitoring DMVs
1 min read
Cross-Database Queries in Fabric: Unified Data Access
Tomorrow we'll explore Query Insights for monitoring and optimization. Cross Database Queries OneLake Shortcuts Security Model
1 min read
T-SQL in Fabric: Patterns and Best Practices
If you're coming to Fabric Warehouse from a SQL Server or Azure SQL Database background, the T-SQL compatibility is reassuring — CTEs, window functions…
1 min read
Fabric Warehouse: Cloud-Native SQL Analytics
The Fabric Warehouse is the part of Microsoft Fabric that surprised me most in hands-on testing. I expected it to be the Lakehouse's SQL analytics endpoint…