Lab: Add drift detection to reconcile stored state against live cloud resources

Problem

After performing operations (create, delete, update), there is no way to verify whether the stored data in swamp matches the actual state of resources in the cloud provider. This creates several problems:

After deletion

When a resource is deleted via swamp model method run web-droplet delete, the stored data persists. There's no indication that the resource no longer exists. The user has to either check the cloud console or run get on each resource and look for 404 errors to confirm cleanup.

After external changes

If someone modifies infrastructure outside of swamp (via the cloud console, another tool, or API), swamp's stored state becomes silently stale. There's no way to discover this drift.

After provisioning

Resources like load balancers transition through states (new → active) after creation. The stored data reflects the creation-time snapshot, not the current state. There's no "refresh all" to update everything at once.

Real-world scenario

After tearing down dev infrastructure (5 resources), confirming everything was actually deleted required:

swamp model method run web-firewall get --input '...' --json   # hope for 404
swamp model method run web-lb get --input '...' --json         # hope for 404
swamp model method run web-droplet get --input '...' --json    # hope for 404
swamp model method run web-droplet get --input '...' --json    # second droplet
swamp model method run web-vpc get --input '...' --json        # hope for 404

And each of these requires providing all model inputs (see related issue about model inputs validation on all methods), making it even more tedious.

Proposed solution

`swamp status` or `swamp drift` command

A command that compares stored data against live API state:

swamp status --json

Output:

web-vpc          stored: 379edfed   live: active    ✓ in sync
web-droplet/web-1  stored: 556223958  live: active    ✓ in sync
web-droplet/web-2  stored: 556223959  live: not found  ✗ deleted externally
web-lb           stored: d8624a18   live: active    ⚠ ip changed (pending → 143.198.1.1)
web-firewall     stored: 883d89d4   live: active    ✓ in sync

This would:

Iterate over all models with stored data
Call get on each using the stored resource ID
Compare stored attributes against live response
Report differences (deleted, modified, in-sync)

`swamp sync` command

Optionally, a command to refresh all stored data to match live state:

swamp sync --json              # refresh all
swamp sync web-lb --json       # refresh specific model

Summary

Changes would be needed in:

New CLI command(s) (status/drift/sync)
Data service — ability to enumerate all stored data across models
Method execution — batch get calls using stored resource IDs
Output rendering — diff view comparing stored vs live attributes
Models would need a convention for which method refreshes state (typically get) and which stored field is the resource ID (typically id)

yep yep yep

Support named argument syntax for model method run (e.g. --arg key=value)

env var overrides for globalArguments silently change which environment a model targets

deno lint no-import-prefix conflicts with swamp's required npm:/jsr: inline specifiers

AI agents should search community extensions before offering to create custom models

feat: add --content-type filter to extension search

Add a 'reports' feature

Port remaining CLI commands to libswamp + renderer pattern

Persistent runner / server mode to eliminate per-invocation CLI startup overhead

AI agent should prefer fan-out model methods over shell loops for fleet operations

Support unbundled helper scripts in extension packages

Add progress indicator for long-running model methods

Built-in structured output parser for CLI commands

Automatic trace context propagation across workflow steps

Native OpenTelemetry tracing for swamp CLI internals

Claude Code should prefer extending swamp extensions over using external CLI tools

Framework log lines written to stdout pollute model method output

Swamp skill should guide AI agents to create extension models instead of inline shell scripts

Shared team collectives for collaborative extension publishing

Delete methods should return last known state data

Add smoke-test skill for extension models

Workflow run output is unreadable — resource data and errors are buried in log noise

Recommend or manage lockfile strategy for extension model npm dependencies

Output of running a method is not the actual output

Add macOS Keychain vault type

bug: Vault secret shell escaping incomplete — $(), semicolons, and pipes are interpreted

Swamp should support "Scheduled"-type status for execution

feat: add support for Nix via a flake

ModelType.normalize replaces all dots with slashes, corrupting dotted type names

fix: collective validator error message omits drivers and datastores

Skill docs: document configSchema inline requirement and .describe() constraints for vault extensions

It takes 42 seconds to run swamp --help

After today upgrade

Auto-resolver fails when extensions/models/ directory does not exist for vault-only extensions

Azure Key Vault extension vault bundle fails to load in compiled binary

RangeError: Maximum call stack size exceeded when loading extension models with npm dependencies after upgrade to 20260317

Extension Zod schema incompatibility after upgrade to 20260312

Data garbage collection never fully removes expired data from disk

extension push --dry-run requires authentication unnecessarily

Typed context APIs to eliminate no-explicit-any in extension models

AWS extensions fail to load: missing _lib/aws.ts shared dependency

getContent() should resolve vault expressions for sensitive fields

getContent() should return parsed objects, not raw Uint8Array

Add context.readResource() to MethodContext for user extension models

Datastore lock: allow concurrent reads across different models

extension install should be an alias of extension pull

feat: Execution Driver Abstraction — Pluggable Isolation for Model Execution

Support --global-arg on model create

consider a libswamp

Running workflow should not block read-only operations

Update from 20260227 to 20260311 breaks existing model definitions (symlink + path-based type)

loadUserModels ignores --repo-dir, uses cwd instead

datastore lock release --force deadlocks on the stale lock it's trying to release

Datastore lock not released when interactive command fails in non-TTY context

vault put to 1Password stores empty password field

Leaderboard shows 0-event users whose profiles 404

Move AWS, Azure, and 1Password vault providers to extensions

Data instance name uniqueness is global across specs instead of per-spec

Audit timeline misses today's entries in UTC+ timezones

AI agent discoverability: reduce trial-and-error for CLI syntax

GlobalArguments CEL expressions fail when factory inputs are omitted — selective evaluation not working

Document factory pattern for model reuse in skills

Delete method uses identifier as data name instead of instance name

CLI method run ignores required arguments without .default()

Workflow run output mixes data, errors, and logs without clear separation — hard to find what actually executed

data.latest() in workflow step inputs resolved at workflow start, not at step execution time

Update method fails when globalArguments contain cross-model CEL expressions

Track resource deletion in local data model

fix: extension npm packages fail to resolve in compiled binary

swamp repo upgrade replaces entire CLAUDE.md with generic template instead of merging

Add drift detection to reconcile stored state against live cloud resources

Model inputs schema validated on all methods — delete fails requiring create-time inputs

Support wait-until-ready semantics for async resource provisioning

support pushing to organizations

Add data rename/move command for non-destructive refactoring

Schema mismatch warnings lack model context and misrepresent API response shapes

Support pre-flight validate method on models before method execution

Extension models need built-in support for idempotent create operations

Workflow reports succeeded when step outputs indicate failure

Swamp skills don't prevent AI agents from manually generating UUIDs for workflows

`swamp status` or `swamp drift` command

`swamp sync` command