AI glossary · Basics

System prompt

Also called: System instruction · Base instruction

What is a system prompt?

Someone writing to the chatbot on your website sees only their question and the answer. Behind it sits the invisible system prompt: an instruction the operator sets once that runs with every answer.

It is like the briefing for a new temp at reception: who we are, how we talk to customers, what they may answer and when to hand over to the boss. The normal prompt is a customer's single question.

How does it work?

The language model reads it first with every request and shapes its answer to it. Typical parts:

  • Role: “You are the reception of Example Joinery.” According to Anthropic, even one sentence on the role makes a difference.
  • Tone: form of address, length of answers, how formal.
  • Knowledge: opening hours, services, frequent questions. The AI should not claim anything beyond this.
  • Limits: “Do not quote prices. Hand invoice questions to a person.”

Why does it matter for your business?

The system prompt decides whether your bot behaves like your business. Without a clear limit, it may answer questions it knows nothing about, and you are responsible for them.

A system prompt is no safe, though. The security organisation OWASP advises against treating it as a secret, because clever inputs can draw it out (prompt injection). So passwords, access keys and internal prices stay out. Who may do what belongs in the software around it, not in the text.

How does OsAI use it?

Every bot and phone assistant OsAI builds gets a written system prompt with role, tone, knowledge and limits. The AI reception you can try in your browser on the AI phone assistant page works this way: its model answers only from stored knowledge.

If you have a bot built, ask what is in the system prompt and whether credentials are kept separate. For your own instructions to ChatGPT or Claude, see the German guide on prompts for everyday business (in German).

Frequently asked questions

Can I change ChatGPT's system prompt?

Not the provider's, but you can store your own base instructions. Many chat apps have settings for personal or project instructions, which work much like a system prompt for your chats.

Is the system prompt secret?

Do not rely on it. OWASP advises against treating it as a secret because it can be drawn out. Write it so you would not mind a customer reading it.

What belongs in a website chatbot's system prompt?

Role, tone, the knowledge it may answer from and clear limits: no prices without approval, no legal advice, hand complaints to a person. Customers must also be able to tell they are talking to an AI, as Art. 50 of the EU AI Act has required since 2 August 2026 (AI labelling). This is an overview, not legal advice.

Sources

Last updated: