Skip to content
ActionNovita AIUpdated May 2026

How do I call Novita AI for inference?

Short answer: Drop the "Novita AINovita Chat Completion" action anywhere in your workflow, map the inputs from upstream nodes, and publish.

Inputs

The fields this action accepts.

Every field can be mapped from an upstream trigger, AI step, table row, or hard-coded literal.

FieldTypeRequiredDescription
Model
model
optionsRequiredWhich model to use
User Message
message
stringRequiredUser message to send to the model
System Prompt
system_prompt
stringOptionalOptional system instructions that shape the model's behavior
Temperature
temperature
stringOptionalSampling temperature (0–2). Higher = more random.
Max Tokens
max_tokens
stringOptionalMaximum tokens to generate in the response
Top P
top_p
stringOptionalNucleus sampling threshold (0–1)
Response Format
response_format
optionsOptionalForce JSON output (model must support JSON mode)
Sample request
{
"model": "{{trigger.model}}",
"message": "e.g. Summarize this article in 3 bullets",
"system_prompt": "e.g. You are a helpful assistant.",
"temperature": "0.7",
"max_tokens": "1024"
}
Returns
{
"id": "chatcmpl-abc123",
"model": "meta-llama/llama-3.3-70b-instruct",
"usage": {
"total_tokens": 60,
"prompt_tokens": 10,
"completion_tokens": 50
},
"choices": [
{
"message": {
"role": "assistant",
"content": "Sample response"
},
"finish_reason": "stop"
}
]
}

Use these fields in downstream nodes for routing, logging, or error handling.

Triggered by

Apps that pair well as the trigger for Novita Chat Completion.

Any of these apps can fire this action as part of a workflow.

FAQ

Questions about Novita Chat Completion.

What does the Novita Chat Completion action do in Novita AI?
Runs chat completion against Novita-hosted open-source models using OpenAI-compatible shape. Competitive pricing for OSS inference.
What inputs does Novita Chat Completion require?
Required: Model, User Message. Every input accepts a static value or a variable from any upstream node in your workflow.
Can I use dynamic inputs from earlier workflow nodes?
Yes. Any field on this action can pull values from upstream nodes, whether that's a form response, a trigger payload, an AI output, or a lookup result.
What happens if Novita AI returns an error?
The workflow pauses on the failed node, the error message is captured in the run log, and you can retry the run with one click. Auto-retry policies are configurable per workflow with exponential backoff up to 5 attempts.
Does Novita Chat Completion support batch operations?
Yes. Run Novita Chat Completion inside a Loop node to process arrays. Tiny Command handles Novita AI's rate limits automatically so you don't have to throttle manually.
More actions

Other Novita AI actions.

Send novita chat completion from your workflows.

Triggered by anything in the catalog. Free tier available. No credit card.