Task API
Call
Endpoint for issuing a task to an LLM
The call endpoint is a declarative endpoint for completing tasks with AI. It supports declaring tasks in a highly model agnostic way focusing on input and output schemas.
Common operations
- Specify your task with small instruction, input schema and output schema.
- Optionally specify one or more models to utilize to complete the task
- Optionally specify examples for the model to understand successful completions.
- Optionally specify few shot configuration to enable automatic retrieval of examples from a dataset. See functions.
- Optionally specify caching configuration to avoid repeating generations for repeating tasks.
- Optionally add tags to be able to do comprehensive analytics