ActionFireworks AIUpdated May 2026

How do I call Fireworks for LLM inference?

Short answer: Drop the "Fireworks AI → Fireworks Chat Completion" action anywhere in your workflow, map the inputs from upstream nodes, and publish.

Use this action All 3 Fireworks AI actions

Inputs

The fields this action accepts.

Every field can be mapped from an upstream trigger, AI step, table row, or hard-coded literal.

Field	Type	Required	Description
Model model	options	Required	Which model to use
User Message message	string	Required	User message to send to the model
System Prompt system_prompt	string	Optional	Optional system instructions that shape the model's behavior
Temperature temperature	string	Optional	Sampling temperature (0–2). Higher = more random.
Max Tokens max_tokens	string	Optional	Maximum tokens to generate in the response
Top P top_p	string	Optional	Nucleus sampling threshold (0–1)
Response Format response_format	options	Optional	Force JSON output (model must support JSON mode)

Sample request

{
  "model": "{{trigger.model}}",
  "message": "e.g. Summarize this article in 3 bullets",
  "system_prompt": "e.g. You are a helpful assistant.",
  "temperature": "0.7",
  "max_tokens": "1024"
}

Returns

{
  "id": "chatcmpl-abc123",
  "model": "accounts/fireworks/models/llama-v3p3-70b-instruct",
  "usage": {
    "total_tokens": 60,
    "prompt_tokens": 10,
    "completion_tokens": 50
  },
  "choices": [
    {
      "message": {
        "role": "assistant",
        "content": "Sample response"
      },
      "finish_reason": "stop"
    }
  ]
}

Use these fields in downstream nodes for routing, logging, or error handling.

Triggered by

Apps that pair well as the trigger for Fireworks Chat Completion.

Any of these apps can fire this action as part of a workflow.

Google Sheets → Fireworks AI

2 Google Sheets triggers

HubSpot → Fireworks AI

18 HubSpot triggers

FAQ

Questions about Fireworks Chat Completion.

What does the Fireworks Chat Completion action do in Fireworks AI?

Runs chat completion against Fireworks-hosted open-source models. Notable for Firefunction V2 — Fireworks's fine-tuned Llama for reliable function calling. OpenAI-compatible shape.

What inputs does Fireworks Chat Completion require?

Required: Model, User Message. Every input accepts a static value or a variable from any upstream node in your workflow.

Can I use dynamic inputs from earlier workflow nodes?

Yes. Any field on this action can pull values from upstream nodes, whether that's a form response, a trigger payload, an AI output, or a lookup result.

What happens if Fireworks AI returns an error?

The workflow pauses on the failed node, the error message is captured in the run log, and you can retry the run with one click. Auto-retry policies are configurable per workflow with exponential backoff up to 5 attempts.

Does Fireworks Chat Completion support batch operations?

Yes. Run Fireworks Chat Completion inside a Loop node to process arrays. Tiny Command handles Fireworks AI's rate limits automatically so you don't have to throttle manually.

More actions