System Prompt

A system prompt is the standing set of instructions an AI model receives before any user message, text that defines the assistant’s role, rules, tone, and boundaries for the entire conversation. Where a user prompt says what you want right now, the system prompt says how the assistant should behave always: “You are a support agent for Acme. Answer only from the provided documentation. If unsure, escalate to a human. Never discuss pricing exceptions.”

Users of a chat product usually never see the system prompt; it’s set by whoever built or configured the assistant. On AI APIs it’s an explicit field, and it’s the main lever of prompt engineering for any assistant your team ships: persona, output format, what to refuse, which knowledge to trust, and how to handle edge cases all belong there. Many workplace AI tools expose a friendlier version of the same idea, “custom instructions,” “agent instructions,” or a configurable “role.”

System prompts are strong guidance, not enforcement. Models follow them well most of the time, but a determined user can sometimes talk a model out of its instructions, the attack known as prompt injection, so security rules can’t live only in the system prompt.

Why it matters at work

The system prompt is where an AI assistant’s consistency comes from. Two teams using the same underlying model get wildly different reliability depending on this one document: a precise system prompt with rules, examples, and refusal criteria produces an assistant that behaves the same way for every employee; a vague one produces improvisation. It’s also a governance artifact worth versioning and reviewing like code, a single careless line (“be maximally helpful”) can undo careful policy work.

A work example

A customer-success team writes a system prompt instructing its draft-reply assistant to always use the customer’s name, never promise delivery dates, and flag any refund request for human review, and reply quality stops depending on which agent wrote the prompt that day.

Get one practical AI-at-work idea in your inbox each week, subscribe to the AI Work+ newsletter.

FAQ

What is the difference between a system prompt and a normal prompt? The system prompt is standing instructions set by the developer or admin that apply across a whole conversation or product, defining role, tone, rules, and tools. User prompts are the individual requests made within those rules.

Can users see or override a system prompt? Usually they cannot see it directly, but models can sometimes be coaxed into revealing or ignoring parts of it. Treat system prompts as guidance, not security, and never put secrets in them.