Enterprise Workflow Engine with Cryptographic Trust
The core engine for building trust-verified workflows with 140+ production-ready nodes, sync and async runtimes, cyclic workflow support, and the CARE/EATP cryptographic trust framework. Three application frameworks -- Kaizen (AI agents), Nexus (multi-channel platform), and DataFlow (database operations) -- are built on this foundation.
- Only workflow engine with cryptographic trust chains -- CARE/EATP provides human-origin tracking, constraint propagation, trust verification, and RFC 3161 timestamped audit trails. No other framework has anything comparable.
- 140+ production-ready workflow nodes -- AI, API, code execution, data, database, file, logic, monitoring, and transform nodes out of the box.
- Production-grade durability -- Real distributed transactions (saga + 2PC with pluggable transport), checkpoint-based workflow resume without duplicate side effects, persistent event store (SQLite WAL), dead letter queue with exponential backoff retry. 72 security findings resolved across 4 red team rounds.
- Comprehensive observability -- Prometheus
/metricsendpoint, OpenTelemetry tracing with per-node spans, comprehensive execution audit trail (NODE_EXECUTED/FAILED events with inputs/outputs), WebSocket live dashboard, search attributes for cross-execution queries. - Workflow interaction -- Send signals to running workflows (
SignalChannel), query workflow state (QueryRegistry), pause/resume execution, cooperative cancellation, built-in scheduling (cron + interval), workflow versioning with semver registry, continue-as-new for infinite-duration workflows. - Scale-out ready -- Distributed circuit breaker (Redis-backed with Lua atomic transitions), multi-worker task queue architecture, resource quotas with semaphore-based concurrency control, coordinated graceful shutdown, Kubernetes deployment manifests.
- Progressive infrastructure -- Start with zero config (SQLite), scale to multi-worker PostgreSQL/MySQL by changing environment variables. Dialect-portable SQL via QueryDialect strategy pattern. SQL task queue with
SKIP LOCKED, worker heartbeat registry, exactly-once idempotent execution. No code changes between Level 0 (dev) and Level 2 (production). - Infrastructure-agnostic --
LocalRuntimeruns entirely in-process. No server cluster, no external database, no message broker. Deploy anywhere: any cloud, any region, on-prem, edge, air-gapped. Zero vendor lock-in. - Unified engine APIs --
DataFlowEngine.builder("sqlite:///app.db").build()andNexusEngine.builder().preset(Preset.SAAS).build()provide fluent builder patterns with validation layers, data classification, query monitoring, and enterprise middleware. Cross-SDK parity with kailash-rs. - Field-level validation and data classification -- Declarative
@field_validatorand@classifydecorators on DataFlow models. Built-in validators for email, URL, UUID, phone, length, range, pattern. Classification levels (PII, internal, public) with retention policies and masking strategies. - Organizational governance (PACT) -- D/T/R accountability grammar, operating envelopes with monotonic tightening, knowledge clearance levels, verification gradient, and MCP tool governance. Governs AI agent organizations with fail-closed decisions and anti-self-modification defense.
- Foundation for four application frameworks -- Kaizen (AI agents with trust), Nexus (multi-channel deploy), DataFlow (zero-config database), and PACT (organizational governance) are all built on this Core SDK.
+------------------------------------------------------------------+
| Application Frameworks |
| |
| Kaizen v2.3.0 Nexus v1.5.0 DataFlow v1.2.0 |
| AI Agents Multi-Channel Zero-Config DB |
| CARE/EATP Trust API + CLI + MCP @db.model |
| Multi-Agent Coord. Auth + RBAC 11 Nodes/Model |
+------------------------------------------------------------------+
| Core SDK v2.1.0 |
| |
| 140+ Nodes | WorkflowBuilder | Runtime (Sync + Async) |
| MCP Server | Cyclic Workflows | CARE Trust Layer |
| | Conditional Exec | Trust Verification |
+------------------------------------------------------------------+
| Progressive Infrastructure |
| |
| QueryDialect | ConnectionManager | StoreFactory (L0/L1/L2) |
| SQL TaskQueue | WorkerRegistry | IdempotentExecutor |
+------------------------------------------------------------------+
| Enterprise Capabilities |
| |
| RBAC + Auth | Audit Trails | Multi-Tenancy |
| Secret Mgmt | Resource Limits | Access Control |
+------------------------------------------------------------------+
# Core SDK
pip install kailash
# Application frameworks (each includes Core SDK)
pip install kailash-kaizen # AI agents with trust
pip install kailash-nexus # Multi-channel platform (API + CLI + MCP)
pip install kailash-dataflow # Zero-config database operations
pip install kailash-pact # Organizational governance (D/T/R)The Core SDK provides WorkflowBuilder and LocalRuntime for building and executing DAG-based workflows with 140+ built-in nodes.
from kailash.workflow.builder import WorkflowBuilder
from kailash.runtime import LocalRuntime
workflow = WorkflowBuilder()
workflow.add_node("PythonCodeNode", "process", {
"code": "result = {'message': 'Hello from Kailash!'}"
})
runtime = LocalRuntime()
results, run_id = runtime.execute(workflow.build())
print(results["process"]["result"]) # {'message': 'Hello from Kailash!'}Async runtime for Docker/FastAPI deployments:
import asyncio
from kailash.runtime import AsyncLocalRuntime
async def main():
runtime = AsyncLocalRuntime()
results, run_id = await runtime.execute_workflow_async(workflow.build(), inputs={})
print(results)
asyncio.run(main())
# Or use `await` directly inside FastAPI route handlersKailash is the only workflow engine with built-in cryptographic trust verification. Trust context propagates through all workflow execution automatically.
from kailash.runtime.trust import (
RuntimeTrustContext,
TrustVerificationMode,
runtime_trust_context,
)
from kailash.runtime import LocalRuntime
# Create a trust context with enforcing verification
ctx = RuntimeTrustContext(
trace_id="audit-trace-2024-001",
verification_mode=TrustVerificationMode.ENFORCING,
delegation_chain=["human-operator-jane", "supervisor-agent", "worker-agent"],
constraints={"max_tokens": 1000, "allowed_tools": ["read", "analyze"]},
)
# Trust context propagates through all workflow execution
with runtime_trust_context(ctx):
runtime = LocalRuntime()
results, run_id = runtime.execute(workflow.build())
# Constraints can only be tightened (immutable pattern)
tighter_ctx = ctx.with_constraints({"allowed_tools": ["read"]}) # Removes "analyze"
node_ctx = ctx.with_node("data_processor") # Tracks execution pathThree application frameworks are built on Core SDK, each in its own package within this monorepo:
Production-ready AI agents with signature-based programming, multi-agent coordination, and the CARE/EATP trust framework.
import asyncio, os
from dotenv import load_dotenv
load_dotenv()
from kaizen.api import Agent
async def main():
model = os.environ.get("DEFAULT_LLM_MODEL", "gpt-4o")
agent = Agent(model=model)
result = await agent.run("Analyze this quarterly report for compliance risks")
asyncio.run(main())pip install kailash-kaizen | Repository | Documentation
Write a function once. Deploy it as a REST API, CLI command, and MCP tool simultaneously.
from nexus import Nexus
app = Nexus()
@app.handler("analyze", description="Analyze a document")
async def analyze(document: str, format: str = "summary") -> dict:
return {"analysis": f"Analyzed '{document}' as {format}"}
app.start()
# REST API: POST /workflows/analyze {"document": "report.pdf"}
# CLI: nexus run analyze --document report.pdf
# MCP: AI agents can call the 'analyze' tool directlypip install kailash-nexus | Repository | Documentation
One decorator generates 11 database operation nodes per model. Supports PostgreSQL, MySQL, and SQLite.
from dataflow import DataFlow
db = DataFlow("sqlite:///app.db")
@db.model
class User:
id: str
name: str
email: str
# Automatically generated:
# UserCreateNode, UserReadNode, UserUpdateNode, UserDeleteNode,
# UserListNode, UserCountNode, UserUpsertNode,
# UserBulkCreateNode, UserBulkUpdateNode, UserBulkDeleteNode, UserBulkUpsertNodepip install kailash-dataflow | Repository | Documentation
The CARE (Context, Action, Reasoning, Evidence) framework and EATP (Enterprise Agent Trust Protocol) are Core SDK features that provide:
- Human origin tracking -- trace every AI action back to the human who authorized it, across delegation chains
- Constraint propagation -- constraints can only be tightened as they flow through agent delegations, never loosened
- Trust verification -- three modes (disabled, permissive, enforcing) with cached verification and high-risk node awareness
- EATP-compliant audit trails -- every workflow start, node execution, trust verification, and resource access is recorded with RFC 3161 timestamps
Trust verification for workflows, nodes, and resources:
from kailash.runtime.trust import TrustVerifier, TrustVerifierConfig
verifier = TrustVerifier(
config=TrustVerifierConfig(
mode="enforcing",
high_risk_nodes=["BashCommand", "HttpRequest", "DatabaseQuery"],
),
)
# Verify before execution -- blocks unauthorized access in enforcing mode
result = await verifier.verify_workflow_access(
workflow_id="financial-report-gen",
agent_id="analyst-agent-42",
trust_context=ctx,
)
if result.allowed:
# Execute with full audit trail
pass- 140+ production nodes: AI, API, code execution, data, database, file, logic, monitoring, transform
- Runtime parity:
LocalRuntime(sync) andAsyncLocalRuntime(async) with identical return structures - CARE trust layer: RuntimeTrustContext, TrustVerifier, RuntimeAuditGenerator
- Cyclic workflows: CycleBuilder API with convergence detection
- MCP integration: Built-in Model Context Protocol server support
- Conditional execution: SwitchNode branching and skip patterns
- Embeddable: Runs in-process with no external dependencies
- Performance optimized: Cached topological sort, networkx removed from hot path, opt-in resource limits
| Framework | Version | Key Capabilities |
|---|---|---|
| Kaizen | v1.2.5 | Signature-based AI agents, multi-agent coordination, CARE/EATP trust, FallbackRouter, MCP sessions |
| Nexus | v1.4.2 | Multi-channel deploy (API+CLI+MCP), handler pattern, NexusAuthPlugin, presets, middleware API |
| DataFlow | v0.12.4 | 11 nodes per model, PostgreSQL/MySQL/SQLite parity, auto-wired multi-tenancy, async transactions |
Start with zero config, scale to multi-worker by changing environment variables. No application code changes required.
| Level | What You Set | What You Get |
|---|---|---|
| 0 | Nothing | SQLite stores, in-memory execution, single process |
| 1 | KAILASH_DATABASE_URL=postgresql://... |
All stores persist to PostgreSQL/MySQL, queryable history |
| 2 | + KAILASH_QUEUE_URL=redis://... |
Multi-worker parallel execution with task queue |
| 3 | (v1.1+) | Leader election, distributed locks, global ordering |
Full guide: Progressive Infrastructure | Quick setup: Multi-Worker Quickstart
# Core SDK unit tests (7,800+ tests)
pytest tests/unit/ -m 'not (slow or integration or e2e)' --timeout=1
# Runtime parity tests
pytest tests/parity/ -v
# Integration tests (requires Docker for PostgreSQL/Redis)
pytest tests/integration/ --timeout=5
# End-to-end tests
pytest tests/e2e/ --timeout=10Testing policy: Tier 1 (unit) allows mocking. Tier 2 (integration) and Tier 3 (E2E) require real infrastructure -- no mocking permitted.
| Resource | Description |
|---|---|
| Kaizen Guide | AI agents, signatures, multi-modal, CARE/EATP trust |
| Nexus Guide | Multi-channel platform, auth, middleware, handlers |
| DataFlow Guide | Database operations, models, queries, multi-tenancy |
| Sphinx Docs | Full API reference and guides |
# Clone and setup
git clone https://github.com/terrene-foundation/kailash-py.git
cd kailash-py
uv sync
# Run tests
pytest tests/unit/ -m 'not (slow or integration or e2e)' --timeout=1
# Code quality
black .
isort .
ruff check .See Contributing Guide for details.
This project is licensed under the Apache License, Version 2.0. You may use, modify, distribute, and commercialize the software freely, subject to the terms of the license.
See the LICENSE file for the full license text.
The Kailash SDK is the subject of patent applications owned by Terrene Foundation See the PATENTS file for details. Under Apache License 2.0, Section 3, each Contributor grants a patent license covering claims necessarily infringed by their Contribution(s) alone or by combination of their Contribution(s) with the Work, subject to the defensive termination clause in Section 3.