---
title: "Text Generation"
description: "Local-first visual environment for building and running AI workflows. Build agents visually, deploy anywhere, privacy by design."
canonical: https://docs.nodetool.ai/nodes/transformers/textgeneration
markdown: https://docs.nodetool.ai/nodes/transformers/textgeneration.md
product: NodeTool
source: https://github.com/nodetool-ai/nodetool/blob/main/docs/nodes/transformers/textgeneration.md
---

# Text Generation

**Type:** `transformers.TextGeneration`

**Namespace:** `transformers`

## Properties

| Property | Type | Description | Default |
|----------|------|-------------|---------|
| prompt | `str` | Prompt for the language model. | `Once upon a time` |
| model | `any` | Transformers.js model (ONNX-compatible). | - |
| max_new_tokens | `int` | Maximum number of tokens to generate after the prompt. | `128` |
| temperature | `float` | Sampling temperature (1.0 = neutral). | `1` |
| top_p | `float` | Nucleus sampling probability mass (1.0 = disabled). | `1` |
| top_k | `int` | Limit sampling to the K most likely tokens. | `50` |
| do_sample | `bool` | Sample tokens instead of greedy decoding. | `true` |
| repetition_penalty | `float` | Penalty applied to repeated tokens (>1 discourages repetition). | `1` |
| dtype | `enum` | Model dtype / quantization level. | `auto` |
| device | `enum` | Inference device. | `auto` |

## Outputs

| Output | Type | Description |
|--------|------|-------------|
| text | `str` |  |

## Related Nodes

Browse other nodes in the [transformers](./) namespace.