pg_durable: Microsoft open-sources durable execution that runs inside the database

pg_durable is an open source tool that enables implementing long-running, fault-tolerant SQL workflows inside PostgreSQL. It allows you to manage workflows by combining data and compute without any separate external infrastructure.

The core mechanism is checkpointing. State is saved at each SQL step, so even if the database crashes or restarts, execution resumes from the last successful point. This prevents complex state reconstruction work.

Key use cases:

• Vector embedding pipelines: Automating data chunking, embedding API calls, and data insertion via pgvector.
• Data ingestion and transformation: Deduplication and transformation work on large batches.
• External API integration: Performing data enrichment or webhook calls within SQL.

Work that previously required using external orchestrators like Airflow, Temporal, and Step Functions, or complex implementations combining pg_cron with separate state tables, can now be consolidated inside PostgreSQL, simplifying the architecture.