A system prompt is the standing instruction the model sees before the user's message. It sets the role, the rules, and the way to answer. The user can still type anything. The standing instruction is what tells the model to refuse a refund promise, cite a policy, or answer in five lines.
Write it the way you would brief a new hire on day one. Who they are, what they may not do, and what a good reply looks like. Keep it shorter than the temptation. A ten-page standing note gets ignored in the middle. Put the rules that would cause harm at the top, and test them by trying to talk the bot out of them.
Think of it this way: The system prompt is the employee handbook handed to a new hire on day one. It sets the role, the rules, what to do, and critically, what never to do, before any customer interaction begins.
A fintech company's AI assistant initially gives generic financial advice. After tightening the system prompt to forbid specific investment recommendations and define the assistant's scope, compliance concerns drop significantly.
A retailer bot was told to be helpful. A customer asked it to promise a refund the policy does not allow, and it agreed. The standing instruction now says it may describe the refund rule and must not promise an exception. Staff handle exceptions. The bot stops creating them.
In every AI feature that has a defined role, audience, or set of constraints. The system prompt is the primary mechanism for enforcing brand voice, safety limits, and behavioral guardrails. System prompts are not a substitute for proper access control or data security. They reduce the likelihood of bad outputs but cannot block determined adversarial use on their own.
RaftLabs points the model at your documents and your rules, then checks the answers against cases you already trust. That surrounding work is where these projects succeed or stall. The related work on our side is Prompt engineering.
This sits with the other building & tuning terms on the glossary. How a general model gets pointed at your documents, your tone, and your workflow. Worth reading next: Fine-tuning, Retrieval-Augmented Generation (RAG), and Prompt Engineering.