Skip to content
ActionAI21 LabsUpdated May 2026

How do I call AI21 Jamba for chat completion?

Short answer: Drop the "AI21 LabsChat Completion" action anywhere in your workflow, map the inputs from upstream nodes, and publish.

Inputs

The fields this action accepts.

Every field can be mapped from an upstream trigger, AI step, table row, or hard-coded literal.

FieldTypeRequiredDescription
Model
model
optionsRequiredWhich model to use
User Message
message
stringRequiredMessage sent to the model as user role
System Prompt
system_prompt
stringOptionalOptional system instructions
Temperature
temperature
stringOptional0-2, higher = more random
Max Tokens
max_tokens
stringOptionalMaximum tokens to generate
Sample request
{
"model": "{{trigger.model}}",
"message": "Your prompt",
"system_prompt": "e.g. You are a helpful assistant",
"temperature": "0.7",
"max_tokens": "1024"
}
Returns
{
"id": "chatcmpl_abc",
"model": "jamba-1.5-large",
"usage": {
"total_tokens": 60,
"prompt_tokens": 10,
"completion_tokens": 50
},
"choices": [
{
"message": {
"role": "assistant",
"content": "Sample"
},
"finish_reason": "stop"
}
]
}

Use these fields in downstream nodes for routing, logging, or error handling.

Triggered by

Apps that pair well as the trigger for Chat Completion.

Any of these apps can fire this action as part of a workflow.

FAQ

Questions about Chat Completion.

What does the Chat Completion action do in AI21 Labs?
Runs a chat completion against AI21's Jamba models using the OpenAI-compatible message-array shape. Jamba's hybrid Mamba-Transformer architecture handles 256k-token context efficiently, which is where it wins over GPT-4-class on long-document workflows.
What inputs does Chat Completion require?
Required: Model, User Message. Every input accepts a static value or a variable from any upstream node in your workflow.
Can I use dynamic inputs from earlier workflow nodes?
Yes. Any field on this action can pull values from upstream nodes, whether that's a form response, a trigger payload, an AI output, or a lookup result.
What happens if AI21 Labs returns an error?
The workflow pauses on the failed node, the error message is captured in the run log, and you can retry the run with one click. Auto-retry policies are configurable per workflow with exponential backoff up to 5 attempts.
Does Chat Completion support batch operations?
Yes. Run Chat Completion inside a Loop node to process arrays. Tiny Command handles AI21 Labs's rate limits automatically so you don't have to throttle manually.
More actions

Other AI21 Labs actions.

Send chat completion from your workflows.

Triggered by anything in the catalog. Free tier available. No credit card.