mirror of
https://github.com/moltbot/moltbot.git
synced 2026-03-09 15:35:17 +00:00
* feat(context-engine): add ContextEngine interface and registry
Introduce the pluggable ContextEngine abstraction that allows external
plugins to register custom context management strategies.
- ContextEngine interface with lifecycle methods: bootstrap, ingest,
ingestBatch, afterTurn, assemble, compact, prepareSubagentSpawn,
onSubagentEnded, dispose
- Module-level singleton registry with registerContextEngine() and
resolveContextEngine() (config-driven slot selection)
- LegacyContextEngine: pass-through implementation wrapping existing
compaction behavior for 100% backward compatibility
- ensureContextEnginesInitialized() guard for safe one-time registration
- 19 tests covering contract, registry, resolution, and legacy parity
* feat(plugins): add context-engine slot and registerContextEngine API
Wire the ContextEngine abstraction into the plugin system so external
plugins can register context engines via the standard plugin API.
- Add 'context-engine' to PluginKind union type
- Add 'contextEngine' slot to PluginSlotsConfig (default: 'legacy')
- Wire registerContextEngine() through OpenClawPluginApi
- Export ContextEngine types from plugin-sdk for external consumers
- Restore proper slot-based resolution in registry
* feat(context-engine): wire ContextEngine into agent run lifecycle
Integrate the ContextEngine abstraction into the core agent run path:
- Resolve context engine once per run (reused across retries)
- Bootstrap: hydrate canonical store from session file on first run
- Assemble: route context assembly through pluggable engine
- Auto-compaction guard: disable built-in auto-compaction when
the engine declares ownsCompaction (prevents double-compaction)
- AfterTurn: post-turn lifecycle hook for ingest + background
compaction decisions
- Overflow compaction: route through contextEngine.compact()
- Dispose: clean up engine resources in finally block
- Notify context engine on subagent lifecycle events
Legacy engine: all lifecycle methods are pass-through/no-op, preserving
100% backward compatibility for users without a context engine plugin.
* feat(plugins): add scoped subagent methods and gateway request scope
Expose runtime.subagent.{run, waitForRun, getSession, deleteSession}
so external plugins can spawn sub-agent sessions without raw gateway
dispatch access.
Uses AsyncLocalStorage request-scope bridge to dispatch internally via
handleGatewayRequest with a synthetic operator client. Methods are only
available during gateway request handling.
- Symbol.for-backed global singleton for cross-module-reload safety
- Fallback gateway context for non-WS dispatch paths (Telegram/WhatsApp)
- Set gateway request scope for all handlers, not just plugin handlers
- 3 staleness tests for fallback context hardening
* feat(context-engine): route /compact and sessions.get through context engine
Wire the /compact command and sessions.get handler through the pluggable
ContextEngine interface.
- Thread tokenBudget and force parameters to context engine compact
- Route /compact through contextEngine.compact() when registered
- Wire sessions.get as runtime alias for plugin subagent dispatch
- Add .pebbles/ to .gitignore
* style: format with oxfmt 0.33.0
Fix duplicate import (ControlUiRootState in server.impl.ts) and
import ordering across all changed files.
* fix: update extension test mocks for context-engine types
Add missing subagent property to bluebubbles PluginRuntime mock.
Add missing registerContextEngine to lobster OpenClawPluginApi mock.
* fix(subagents): keep deferred delete cleanup retryable
* style: format run attempt for CI
* fix(rebase): remove duplicate embedded-run imports
* test: add missing gateway context mock export
* fix: pass resolved auth profile into afterTurn compaction
Ensure the embedded runner forwards resolved auth profile context into
legacy context-engine compaction params on the normal afterTurn path,
matching overflow compaction behavior. This allows downstream LCM
summarization to use the intended provider auth/profile consistently.
Also fix strict TS typing in external-link token dedupe and align an
attempt unit test reasoningLevel value with the current ReasoningLevel
enum.
Regeneration-Prompt: |
We were debugging context-engine compaction where downstream summary
calls were missing the right auth/profile context in normal afterTurn
flow, while overflow compaction already propagated it. Preserve current
behavior and keep changes additive: thread the resolved authProfileId
through run -> attempt -> legacy compaction param builder without
broad refactors.
Add tests that prove the auth profile is included in afterTurn legacy
params and that overflow compaction still passes it through run
attempts. Keep existing APIs stable, and only adjust small type issues
needed for strict compilation.
* fix: remove duplicate imports from rebase
* feat: add context-engine system prompt additions
* fix(rebase): dedupe attempt import declarations
* test: fix fetch mock typing in ollama autodiscovery
* fix(test): add registerContextEngine to diffs extension mock APIs
* test(windows): use path.delimiter in ios-team-id fixture PATH
* test(cron): add model formatting and precedence edge case tests
Covers:
- Provider/model string splitting (whitespace, nested paths, empty segments)
- Provider normalization (casing, aliases like bedrock→amazon-bedrock)
- Anthropic model alias normalization (opus-4.5→claude-opus-4-5)
- Precedence: job payload > session override > config default
- Sequential runs with different providers (CI flake regression pattern)
- forceNew session preserving stored model overrides
- Whitespace/empty model string edge cases
- Config model as string vs object format
* test(cron): fix model formatting test config types
* test(phone-control): add registerContextEngine to mock API
* fix: re-export ChannelKind from config-reload-plan
* fix: add subagent mock to plugin-runtime-mock test util
* docs: add changelog fragment for context engine PR #22201
338 lines
13 KiB
TypeScript
338 lines
13 KiB
TypeScript
import type { AgentMessage } from "@mariozechner/pi-agent-core";
|
|
import { describe, expect, it, beforeEach } from "vitest";
|
|
// ---------------------------------------------------------------------------
|
|
// We dynamically import the registry so we can get a fresh module per test
|
|
// group when needed. For most groups we use the shared singleton directly.
|
|
// ---------------------------------------------------------------------------
|
|
import { LegacyContextEngine, registerLegacyContextEngine } from "./legacy.js";
|
|
import {
|
|
registerContextEngine,
|
|
getContextEngineFactory,
|
|
listContextEngineIds,
|
|
resolveContextEngine,
|
|
} from "./registry.js";
|
|
import type {
|
|
ContextEngine,
|
|
ContextEngineInfo,
|
|
AssembleResult,
|
|
CompactResult,
|
|
IngestResult,
|
|
} from "./types.js";
|
|
|
|
// ---------------------------------------------------------------------------
|
|
// Helpers
|
|
// ---------------------------------------------------------------------------
|
|
|
|
/** Build a config object with a contextEngine slot for testing. */
|
|
// eslint-disable-next-line @typescript-eslint/no-explicit-any
|
|
function configWithSlot(engineId: string): any {
|
|
return { plugins: { slots: { contextEngine: engineId } } };
|
|
}
|
|
|
|
function makeMockMessage(role: "user" | "assistant" = "user", text = "hello"): AgentMessage {
|
|
return { role, content: text, timestamp: Date.now() } as AgentMessage;
|
|
}
|
|
|
|
/** A minimal mock engine that satisfies the ContextEngine interface. */
|
|
class MockContextEngine implements ContextEngine {
|
|
readonly info: ContextEngineInfo = {
|
|
id: "mock",
|
|
name: "Mock Engine",
|
|
version: "0.0.1",
|
|
};
|
|
|
|
async ingest(_params: {
|
|
sessionId: string;
|
|
message: AgentMessage;
|
|
isHeartbeat?: boolean;
|
|
}): Promise<IngestResult> {
|
|
return { ingested: true };
|
|
}
|
|
|
|
async assemble(params: {
|
|
sessionId: string;
|
|
messages: AgentMessage[];
|
|
tokenBudget?: number;
|
|
}): Promise<AssembleResult> {
|
|
return {
|
|
messages: params.messages,
|
|
estimatedTokens: 42,
|
|
systemPromptAddition: "mock system addition",
|
|
};
|
|
}
|
|
|
|
async compact(_params: {
|
|
sessionId: string;
|
|
sessionFile: string;
|
|
tokenBudget?: number;
|
|
compactionTarget?: "budget" | "threshold";
|
|
customInstructions?: string;
|
|
legacyParams?: Record<string, unknown>;
|
|
}): Promise<CompactResult> {
|
|
return {
|
|
ok: true,
|
|
compacted: true,
|
|
reason: "mock compaction",
|
|
result: {
|
|
summary: "mock summary",
|
|
tokensBefore: 100,
|
|
tokensAfter: 50,
|
|
},
|
|
};
|
|
}
|
|
|
|
async dispose(): Promise<void> {
|
|
// no-op
|
|
}
|
|
}
|
|
|
|
// ═══════════════════════════════════════════════════════════════════════════
|
|
// 1. Engine contract tests
|
|
// ═══════════════════════════════════════════════════════════════════════════
|
|
|
|
describe("Engine contract tests", () => {
|
|
it("a mock engine implementing ContextEngine can be registered and resolved", async () => {
|
|
const factory = () => new MockContextEngine();
|
|
registerContextEngine("mock", factory);
|
|
|
|
const resolved = getContextEngineFactory("mock");
|
|
expect(resolved).toBe(factory);
|
|
|
|
const engine = await resolved!();
|
|
expect(engine).toBeInstanceOf(MockContextEngine);
|
|
expect(engine.info.id).toBe("mock");
|
|
});
|
|
|
|
it("ingest() returns IngestResult with ingested boolean", async () => {
|
|
const engine = new MockContextEngine();
|
|
const result = await engine.ingest({
|
|
sessionId: "s1",
|
|
message: makeMockMessage(),
|
|
});
|
|
|
|
expect(result).toHaveProperty("ingested");
|
|
expect(typeof result.ingested).toBe("boolean");
|
|
expect(result.ingested).toBe(true);
|
|
});
|
|
|
|
it("assemble() returns AssembleResult with messages array and estimatedTokens", async () => {
|
|
const engine = new MockContextEngine();
|
|
const msgs = [makeMockMessage(), makeMockMessage("assistant", "world")];
|
|
const result = await engine.assemble({
|
|
sessionId: "s1",
|
|
messages: msgs,
|
|
});
|
|
|
|
expect(Array.isArray(result.messages)).toBe(true);
|
|
expect(result.messages).toHaveLength(2);
|
|
expect(typeof result.estimatedTokens).toBe("number");
|
|
expect(result.estimatedTokens).toBe(42);
|
|
expect(result.systemPromptAddition).toBe("mock system addition");
|
|
});
|
|
|
|
it("compact() returns CompactResult with ok, compacted, reason, result fields", async () => {
|
|
const engine = new MockContextEngine();
|
|
const result = await engine.compact({
|
|
sessionId: "s1",
|
|
sessionFile: "/tmp/session.json",
|
|
});
|
|
|
|
expect(typeof result.ok).toBe("boolean");
|
|
expect(typeof result.compacted).toBe("boolean");
|
|
expect(result.ok).toBe(true);
|
|
expect(result.compacted).toBe(true);
|
|
expect(result.reason).toBe("mock compaction");
|
|
expect(result.result).toBeDefined();
|
|
expect(result.result!.summary).toBe("mock summary");
|
|
expect(result.result!.tokensBefore).toBe(100);
|
|
expect(result.result!.tokensAfter).toBe(50);
|
|
});
|
|
|
|
it("dispose() is callable (optional method)", async () => {
|
|
const engine = new MockContextEngine();
|
|
// Should complete without error
|
|
await expect(engine.dispose()).resolves.toBeUndefined();
|
|
});
|
|
});
|
|
|
|
// ═══════════════════════════════════════════════════════════════════════════
|
|
// 2. Registry tests
|
|
// ═══════════════════════════════════════════════════════════════════════════
|
|
|
|
describe("Registry tests", () => {
|
|
it("registerContextEngine() stores a factory", () => {
|
|
const factory = () => new MockContextEngine();
|
|
registerContextEngine("reg-test-1", factory);
|
|
|
|
expect(getContextEngineFactory("reg-test-1")).toBe(factory);
|
|
});
|
|
|
|
it("getContextEngineFactory() returns the factory", () => {
|
|
const factory = () => new MockContextEngine();
|
|
registerContextEngine("reg-test-2", factory);
|
|
|
|
const retrieved = getContextEngineFactory("reg-test-2");
|
|
expect(retrieved).toBe(factory);
|
|
expect(typeof retrieved).toBe("function");
|
|
});
|
|
|
|
it("listContextEngineIds() returns all registered ids", () => {
|
|
// Ensure at least our test entries exist
|
|
registerContextEngine("reg-test-a", () => new MockContextEngine());
|
|
registerContextEngine("reg-test-b", () => new MockContextEngine());
|
|
|
|
const ids = listContextEngineIds();
|
|
expect(ids).toContain("reg-test-a");
|
|
expect(ids).toContain("reg-test-b");
|
|
expect(Array.isArray(ids)).toBe(true);
|
|
});
|
|
|
|
it("registering the same id overwrites the previous factory", () => {
|
|
const factory1 = () => new MockContextEngine();
|
|
const factory2 = () => new MockContextEngine();
|
|
|
|
registerContextEngine("reg-overwrite", factory1);
|
|
expect(getContextEngineFactory("reg-overwrite")).toBe(factory1);
|
|
|
|
registerContextEngine("reg-overwrite", factory2);
|
|
expect(getContextEngineFactory("reg-overwrite")).toBe(factory2);
|
|
expect(getContextEngineFactory("reg-overwrite")).not.toBe(factory1);
|
|
});
|
|
});
|
|
|
|
// ═══════════════════════════════════════════════════════════════════════════
|
|
// 3. Default engine selection
|
|
// ═══════════════════════════════════════════════════════════════════════════
|
|
|
|
describe("Default engine selection", () => {
|
|
// Ensure both legacy and a custom test engine are registered before these tests.
|
|
beforeEach(() => {
|
|
// Registration is idempotent (Map.set), so calling again is safe.
|
|
registerLegacyContextEngine();
|
|
// Register a lightweight custom stub so we don't need external resources.
|
|
registerContextEngine("test-engine", () => {
|
|
const engine: ContextEngine = {
|
|
info: { id: "test-engine", name: "Custom Test Engine", version: "0.0.0" },
|
|
async ingest() {
|
|
return { ingested: true };
|
|
},
|
|
async assemble({ messages }) {
|
|
return { messages, estimatedTokens: 0 };
|
|
},
|
|
async compact() {
|
|
return { ok: true, compacted: false };
|
|
},
|
|
};
|
|
return engine;
|
|
});
|
|
});
|
|
|
|
it("resolveContextEngine() with no config returns the default ('legacy') engine", async () => {
|
|
const engine = await resolveContextEngine();
|
|
expect(engine.info.id).toBe("legacy");
|
|
});
|
|
|
|
it("resolveContextEngine() with config contextEngine='legacy' returns legacy engine", async () => {
|
|
const engine = await resolveContextEngine(configWithSlot("legacy"));
|
|
expect(engine.info.id).toBe("legacy");
|
|
});
|
|
|
|
it("resolveContextEngine() with config contextEngine='test-engine' returns the custom engine", async () => {
|
|
const engine = await resolveContextEngine(configWithSlot("test-engine"));
|
|
expect(engine.info.id).toBe("test-engine");
|
|
});
|
|
});
|
|
|
|
// ═══════════════════════════════════════════════════════════════════════════
|
|
// 4. Invalid engine fallback
|
|
// ═══════════════════════════════════════════════════════════════════════════
|
|
|
|
describe("Invalid engine fallback", () => {
|
|
it("resolveContextEngine() with config pointing to unregistered engine throws with helpful error", async () => {
|
|
await expect(resolveContextEngine(configWithSlot("nonexistent-engine"))).rejects.toThrow(
|
|
/nonexistent-engine/,
|
|
);
|
|
});
|
|
|
|
it("error message includes the requested id and available ids", async () => {
|
|
// Ensure at least legacy is registered so we see it in the available list
|
|
registerLegacyContextEngine();
|
|
|
|
try {
|
|
await resolveContextEngine(configWithSlot("does-not-exist"));
|
|
// Should not reach here
|
|
expect.unreachable("Expected resolveContextEngine to throw");
|
|
} catch (err: unknown) {
|
|
const message = err instanceof Error ? err.message : String(err);
|
|
expect(message).toContain("does-not-exist");
|
|
expect(message).toContain("not registered");
|
|
// Should mention available engines
|
|
expect(message).toMatch(/Available engines:/);
|
|
// At least "legacy" should be listed as available
|
|
expect(message).toContain("legacy");
|
|
}
|
|
});
|
|
});
|
|
|
|
// ═══════════════════════════════════════════════════════════════════════════
|
|
// 5. LegacyContextEngine parity
|
|
// ═══════════════════════════════════════════════════════════════════════════
|
|
|
|
describe("LegacyContextEngine parity", () => {
|
|
it("ingest() returns { ingested: false } (no-op)", async () => {
|
|
const engine = new LegacyContextEngine();
|
|
const result = await engine.ingest({
|
|
sessionId: "s1",
|
|
message: makeMockMessage(),
|
|
});
|
|
|
|
expect(result).toEqual({ ingested: false });
|
|
});
|
|
|
|
it("assemble() returns messages as-is (pass-through)", async () => {
|
|
const engine = new LegacyContextEngine();
|
|
const messages = [
|
|
makeMockMessage("user", "first"),
|
|
makeMockMessage("assistant", "second"),
|
|
makeMockMessage("user", "third"),
|
|
];
|
|
|
|
const result = await engine.assemble({
|
|
sessionId: "s1",
|
|
messages,
|
|
});
|
|
|
|
// Messages should be the exact same array reference (pass-through)
|
|
expect(result.messages).toBe(messages);
|
|
expect(result.messages).toHaveLength(3);
|
|
expect(result.estimatedTokens).toBe(0);
|
|
expect(result.systemPromptAddition).toBeUndefined();
|
|
});
|
|
|
|
it("dispose() completes without error", async () => {
|
|
const engine = new LegacyContextEngine();
|
|
await expect(engine.dispose()).resolves.toBeUndefined();
|
|
});
|
|
});
|
|
|
|
// ═══════════════════════════════════════════════════════════════════════════
|
|
// 6. Initialization guard
|
|
// ═══════════════════════════════════════════════════════════════════════════
|
|
|
|
describe("Initialization guard", () => {
|
|
it("ensureContextEnginesInitialized() is idempotent (calling twice does not throw)", async () => {
|
|
const { ensureContextEnginesInitialized } = await import("./init.js");
|
|
|
|
expect(() => ensureContextEnginesInitialized()).not.toThrow();
|
|
expect(() => ensureContextEnginesInitialized()).not.toThrow();
|
|
});
|
|
|
|
it("after init, 'legacy' engine is registered", async () => {
|
|
const { ensureContextEnginesInitialized } = await import("./init.js");
|
|
ensureContextEnginesInitialized();
|
|
|
|
const ids = listContextEngineIds();
|
|
expect(ids).toContain("legacy");
|
|
});
|
|
});
|