In the GPT API, there is an optional max_tokens parameter. This represents the maximum tokens you want to spend between the prompt and the resulting completion. Setting this too low could result in incomplete responses.

Source#

OpenAI Forums