↓ Skip to main content

Data Engineering

SCD Type 2 Done Right: Declarative Pipelines and Change Data Feed
·1821 words·9 mins
Databricks Data Engineering Databricks Scd-Type-2 Declarative-Pipelines Dlt Change-Data-Feed Delta-Lake Cdc
Real-Time Anomaly Detection with Structured Streaming and Delta Lake
·2554 words·12 mins
Databricks Data Engineering Streaming Databricks Structured-Streaming Delta-Lake Anomaly-Detection Iot Pyspark
Delta Sharing: Zero-Copy Data Exchange Across Workspaces and Beyond
·1857 words·9 mins
Databricks Data Engineering Architecture Databricks Delta-Sharing Unity-Catalog Data-Governance Open-Protocol
Data Quality Gates: Lakehouse Monitoring and DLT Expectations
·1847 words·9 mins
Databricks Data Engineering Data Quality Databricks Lakehouse-Monitoring Dlt Expectations Data-Quality Delta-Lake
Unity Catalog Deep Dive: Fine-Grained Access Control
·1783 words·9 mins
Databricks Security Data Engineering Databricks Unity-Catalog Security Governance Access-Control Rbac
Lakeflow GA: The Unified Data Engineering Platform You've Been Waiting For
·1849 words·9 mins
Databricks Data Engineering Databricks Lakeflow Declarative-Pipelines Lakeflow-Connect Lakeflow-Designer Etl Data-Engineering
Lakebase: Postgres Meets the Lakehouse — Hands-On with Databricks' OLTP Play
·3865 words·19 mins
Databricks Data Engineering AI Databricks Lakebase Postgres Oltp Ai-Agents Pgvector Lakehouse
Agent Bricks: Building Enterprise AI Agents on Databricks
·2223 words·11 mins
Databricks AI Data Engineering Databricks Agent-Bricks Ai-Agents Mosaic-Ai Mlflow Unity-Catalog Rag
Lakewatch Sees Threats. Who Sees the Blind Spots?
·3110 words·15 mins
Security Data Engineering Databricks Lakewatch Silentpulse Security Pyspark Metric-Views Ai-Functions Nifi Zerobus
SIEM is legacy - building a threat hunting app on a Security Data Lake
·2003 words·10 mins
Security Data Engineering Databricks Threat-Hunting Siem Lakehouse Ai Databricks-Apps
From SIEM to Lakehouse: Detection-as-Code on Databricks
·2827 words·14 mins
Security Data Engineering Databricks Detection-as-Code Siem Lakehouse Mitre Security
Zerobus Ingest: Building a NiFi Processor for Databricks' New Streaming Primitive
·2425 words·12 mins
Data Engineering Security Databricks Zerobus Nifi Streaming Delta Grpc
Trino + UC + Iceberg: Escape from Vendor Lock-in
·1257 words·6 mins
Data Engineering Tutorial Trino Iceberg Kubernetes Podman Databricks