Neutrome SDK reference
    Preparing search index...

    Type Alias Executor

    The unit of composition: something that answers a program.

    Both methods must be implemented, so an executor can be used in a streaming and a non-streaming request alike.

    const executor: Executor = {
      async execute(request, ctx) {
        return ctx.invoke(upstream, prependSystemPrompt(request, system()));
      },
      async *stream(request, ctx) {
        yield* ctx.invokeStream(upstream, prependSystemPrompt(request, system()));
      },
    };
    type Executor = {
        execute(request: Program, ctx: ExecutorContext): Promise<Program>;
        stream(request: Program, ctx: ExecutorContext): AsyncIterable<Program>;
    }
    Index
    execute stream

    Settings
    Member Visibility

    On This Page
    Methods