↓ Skip to main content

Posts

SCD Type 2 Done Right: Declarative Pipelines and Change Data Feed
·1821 words·9 mins
Databricks Data Engineering Databricks Scd-Type-2 Declarative-Pipelines Dlt Change-Data-Feed Delta-Lake Cdc
Real-Time Anomaly Detection with Structured Streaming and Delta Lake
·2554 words·12 mins
Databricks Data Engineering Streaming Databricks Structured-Streaming Delta-Lake Anomaly-Detection Iot Pyspark
Multi-Tenant Data Platform: Row Filters, Column Masks, and ABAC on Unity Catalog
·2413 words·12 mins
Databricks Security Architecture Databricks Unity-Catalog Multi-Tenancy Abac Row-Filters Column-Masks Data-Governance
Delta Sharing: Zero-Copy Data Exchange Across Workspaces and Beyond
·1857 words·9 mins
Databricks Data Engineering Architecture Databricks Delta-Sharing Unity-Catalog Data-Governance Open-Protocol
Data Quality Gates: Lakehouse Monitoring and DLT Expectations
·1847 words·9 mins
Databricks Data Engineering Data Quality Databricks Lakehouse-Monitoring Dlt Expectations Data-Quality Delta-Lake
Unity Catalog Deep Dive: Fine-Grained Access Control
·1783 words·9 mins
Databricks Security Data Engineering Databricks Unity-Catalog Security Governance Access-Control Rbac
Serverless GPU & AI Runtime: Running GPU Workloads Without Cluster Management on Databricks
·2166 words·11 mins
Databricks AI Machine Learning Databricks Serverless-Gpu Ai-Runtime Fine-Tuning Distributed-Training Pytorch Deep-Learning
Mosaic AI Gateway: Unified AI Governance at Scale
·3144 words·15 mins
Databricks AI Security Databricks Ai-Gateway Mosaic-Ai Llm Governance Model-Serving Guardrails
MLflow 3: Rebuilt for the GenAI Era
·1945 words·10 mins
Databricks MLOps Generative AI Databricks Mlflow Genai Llm Agents Observability Prompt-Engineering
Lakeflow GA: The Unified Data Engineering Platform You've Been Waiting For
·1849 words·9 mins
Databricks Data Engineering Databricks Lakeflow Declarative-Pipelines Lakeflow-Connect Lakeflow-Designer Etl Data-Engineering
Lakebase: Postgres Meets the Lakehouse — Hands-On with Databricks' OLTP Play
·3865 words·19 mins
Databricks Data Engineering AI Databricks Lakebase Postgres Oltp Ai-Agents Pgvector Lakehouse
Agent Bricks: Building Enterprise AI Agents on Databricks
·2223 words·11 mins
Databricks AI Data Engineering Databricks Agent-Bricks Ai-Agents Mosaic-Ai Mlflow Unity-Catalog Rag
Replacing a Toro Irrigation Controller with ESP32 and Home Assistant
·1263 words·6 mins
Homelab IoT Esp32 Esphome Home-Assistant Irrigation Waveshare Automation
Why Your Bose SoundTouch Ignores Traffic From Other VLANs (and How to Fix It)
·2206 words·11 mins
Networking Homelab Ubiquiti Unifi Bose Airplay Vlan Iot Iptables
Lakewatch Sees Threats. Who Sees the Blind Spots?
·3110 words·15 mins
Security Data Engineering Databricks Lakewatch Silentpulse Security Pyspark Metric-Views Ai-Functions Nifi Zerobus
SIEM is legacy - building a threat hunting app on a Security Data Lake
·2003 words·10 mins
Security Data Engineering Databricks Threat-Hunting Siem Lakehouse Ai Databricks-Apps
From SIEM to Lakehouse: Detection-as-Code on Databricks
·2827 words·14 mins
Security Data Engineering Databricks Detection-as-Code Siem Lakehouse Mitre Security
Zerobus Ingest: Building a NiFi Processor for Databricks' New Streaming Primitive
·2425 words·12 mins
Data Engineering Security Databricks Zerobus Nifi Streaming Delta Grpc
Serverless Databricks - convenience vs control
·1646 words·8 mins
Architecture Data Security Databricks Serverless Security Egress
Trino + UC + Iceberg: Escape from Vendor Lock-in
·1257 words·6 mins
Data Engineering Tutorial Trino Iceberg Kubernetes Podman Databricks