Custom connections are gone: the CLI talks to the LLeMbas server it is logged in to
LLeMbas CLI 2.0 is LLeMbas-server-specific (CLI rule 2). Removed: the anthropic, gemini, ollama and responses clients, context discovery and llama-swap unloading (discover.ts), the Connection schema with its dialect, auth, key_cmd, discover, unload_url and one_model_at_a_time, the model `fallback` (it only ever moved to another server), effort_map and cache, and the multi-connection refs. Kept: openai-chat, http, sse, think, effort, tokens and all of src/lembas. - connections.yaml holds the login (`type: webui`, as lembas login writes it). A custom entry from 1.x is read past with a warning that says how to log in, so an old file still starts; with several logins left, the latest is used and the others named. - A model's ref is the id the server serves it under; the older forms (`<login>/<id>`, `<login>/<model>`) still resolve and config.yaml is rewritten once. Without a login there is no model, and the error (and the first-run screen, now the sign-in alone) says `lembas login <address>`. - A login to another server signs this machine out of the previous one. - The window is the server's word (no discovery); a capacity group comes from the server's `capacity.group` alone; embeddings use the server's /v1/embeddings. - `lembas models` lists the server's models; install.sh's starter files, the README and the JSON schemas say the same. Tests: every fixture is a login now (the fake server lists models, answers other GETs with 404, and can hand one model to another script, as a server with several backends); the dialect suites and the cross-connection tests are gone with their code. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
80 files changed
+587
-2575
No files matched your search
+11
-5
@@ -11,8 +11,12 @@ export interface Fake {
|
||||
stop(): void
|
||||
}
|
||||
|
||||
/** `show`: what Ollama's /api/show answers (404 when not given); it takes no scripted response. */
|
||||
export function fakeProvider(script: Scripted[], opts: { show?: unknown } = {}): Fake {
|
||||
/** `route`: another fake that answers for a model (by the id in the request), as one LLeMbas server
|
||||
* serves models from several backends — the request is passed to it whole, and recorded there. */
|
||||
/** `served`: what GET /v1/models lists, as a LLeMbas server lists its models (default two
|
||||
* placeholders). Any other GET — the instance's own description, its personalization — is a 404,
|
||||
* which a client reads as "this server does not have it". */
|
||||
export function fakeProvider(script: Scripted[], opts: { route?: (model: string) => Fake | undefined; served?: Record<string, unknown>[] } = {}): Fake {
|
||||
const requests: any[] = []
|
||||
const calls: { path: string; headers: Record<string, string> }[] = []
|
||||
let i = 0
|
||||
@@ -21,11 +25,13 @@ export function fakeProvider(script: Scripted[], opts: { show?: unknown } = {}):
|
||||
async fetch(req) {
|
||||
const url = new URL(req.url)
|
||||
if (req.method !== "POST" || url.pathname.endsWith("/unload")) calls.push({ path: url.pathname + url.search, headers: Object.fromEntries(req.headers.entries()) })
|
||||
if (url.pathname.endsWith("/models")) return Response.json({ data: [{ id: "m1", meta: { n_ctx: 32768 } }, { id: "m2", max_model_len: 8192 }] })
|
||||
if (url.pathname.endsWith("/models")) return Response.json({ data: opts.served ?? [{ id: "m1", meta: { n_ctx: 32768 } }, { id: "m2", max_model_len: 8192 }] })
|
||||
if (url.pathname.endsWith("/props")) return url.pathname.includes("/upstream/swapped/") ? Response.json({ default_generation_settings: { n_ctx: 16384 } }) : new Response("no", { status: 404 })
|
||||
if (url.pathname.endsWith("/unload")) return new Response("ok")
|
||||
if (url.pathname.endsWith("/api/show")) return opts.show ? Response.json(opts.show) : new Response("not found", { status: 404 })
|
||||
const body = await req.json()
|
||||
if (req.method === "GET") return new Response("not found", { status: 404 })
|
||||
const body = (await req.json()) as any
|
||||
const to = typeof body?.model === "string" ? opts.route?.(body.model) : undefined
|
||||
if (to) return fetch(to.url.replace(/\/v1$/, "") + url.pathname + url.search, { method: "POST", headers: req.headers, body: JSON.stringify(body) })
|
||||
requests.push(body)
|
||||
calls.push({ path: url.pathname + url.search, headers: Object.fromEntries(req.headers.entries()) })
|
||||
const r = script[i++]
|
||||
|
||||
Reference in new issue
Block a user