ActionGroqUpdated September 2026

How do I call Groq for LLM inference?

Short answer: You can groq chat completion in Groq by hand from its own interface, but it won’t repeat itself. On TinyCommand, add the Groq Groq Chat Completion action to a workflow, map its 5 inputs from any upstream app, and it runs automatically every time the trigger fires. No code, and a free tier to start.

Groq Chat Completion in Groq — start free
Inputs

The fields this action accepts.

Every field can be mapped from an upstream trigger, AI step, table row, or hard-coded literal.

FieldTypeRequiredDescription
Model
model
optionsRequiredModel. Options: Llama 3.3 70B, Llama 3.1 8B (fastest), Llama 3 70B, Mixtral 8x7B, Gemma 2 9B
Message
message
stringRequiredMessage. Example: Explain quantum computing in simple terms
System Prompt
system_prompt
stringOptionalSystem Prompt. Example: You are a helpful assistant.
Temperature
temperature
stringOptional0 = deterministic, 2 = very creative
Max Tokens
max_tokens
stringOptionalMax Tokens. Example: 1024
Sample request
{
"model": "{{trigger.model}}",
"message": "e.g. Explain quantum computing in simple terms",
"system_prompt": "e.g. You are a helpful assistant.",
"temperature": "e.g. 0.7",
"max_tokens": "e.g. 1024"
}
Returns
{
"id": "chatcmpl-abc",
"model": "llama-3.3-70b-versatile",
"usage": {
"total_tokens": 170,
"prompt_tokens": 20,
"completion_tokens": 150
},
"choices": [
{
"message": {
"role": "assistant",
"content": "Quantum computing uses..."
},
"finish_reason": "stop"
}
]
}

Use these fields in downstream nodes for routing, logging, or error handling.

Triggered by

Apps that pair well as the trigger for Groq Chat Completion.

Any of these apps can fire this action as part of a workflow.

FAQ

Questions about Groq Chat Completion.

What does the Groq Chat Completion action do in Groq?
Runs chat completion at Groq's custom-LPU-hardware speed (1000+ tokens/sec on Llama 3.3 70B). For latency-sensitive workflows where the speed advantage stacks across multi-step agent chains.
What inputs does Groq Chat Completion require?
Required: Model, Message. Every input accepts a static value or a variable from any upstream node in your workflow.
Can I use dynamic inputs from earlier workflow nodes?
Yes. Any field on this action can pull values from upstream nodes, whether that's a form response, a trigger payload, an AI output, or a lookup result.
What happens if Groq returns an error?
The run history shows the failed step with its input and the error message Groq returned, so you can fix the input and run the workflow again. Automatic retries are built into HTTP steps only, where you can also set your own retry count and delay.
Does Groq Chat Completion support batch operations?
Run Groq Chat Completion inside a loop to process each item in an array. TinyCommand does not throttle calls for you, so for large arrays add a Delay step if you need to stay within Groq's rate limits.
More actions

Other Groq actions.

Groq Chat Completion in Groq — start free