What you share with an AI service
Anything you type is data you hand to a company. Know what happens to it, and keep sensitive details out.
Words on this page (2)
- training
- : Adjusting a model's parameters on data so its predictions improve.
- tool
- : A function the model can ask your program to run, described by a name, description and argument schema.
What it is
When you use a chat app, your messages go to the provider's servers. What happens next depends on the service, your plan and your settings. Many consumer apps keep your conversations for some time and may use them to improve their models unless you switch that off. Business and developer plans usually have stricter terms, such as not on your data. Policies change, so check the current settings and privacy page of the service you use. Some apps have a temporary or incognito chat, and most let you delete history.
What to keep out
Passwords and security codes. Government ID, bank or card numbers. Medical records. Private details about other people, such as a friend's problem or a customer's address. Your employer's secrets, unreleased plans, source code or customer data, unless your workplace has approved the for it.
A worked example: redacting
Before: "Dear Maria Lopez, your account 4421-8830 is overdue by $240. Please call 555-0142." You want help making it politer. After redacting: "Dear [customer], your account [number] is overdue by [amount]. Please call [phone]." The model improves the wording just as well. You paste the real details back in yourself.
What happens to your message
Your text travels over the internet to the provider's computers, where the model reads it and writes a reply. The provider may store the conversation, let staff review some of it for safety, or use it to improve future models. Which of these applies depends on the service and plan. That is why the settings page matters more than the logo on the app.
A second example: when redacting is not enough
Redacting works when the details are separate from the question. Imagine you paste a story about a classmate's family problem with the name removed. People who know your school could still guess who it is from the events. Details such as a rare job, a small town or a date can identify someone without a name. The safer move is to describe the situation in general terms or not share it at all.
Trade-offs
Strict privacy has a cost. The more context you give a model, the better its help, so withholding everything makes answers vague. Pick the level by risk. A recipe or a poem needs no care. Health, money and other people's secrets need a lot. Some tools can run on your own computer, so the text never leaves it. Those models are usually smaller and less capable, which is the trade.
What goes wrong
Data leaks mostly through habit, not hacking. You paste a whole document when two paragraphs would do. You upload a screenshot with notifications visible. You use a work account on a personal device. You will not see any symptom, which is the problem. Prevention is the only fix, because you cannot take text back once it is sent.
Try it yourself
Open the privacy or data settings of one AI tool you use.
- Find whether your chats can be used to train models.
- Find how to delete history or start a temporary chat.
- Write down what you found in one line.
Expect the answers to be in different places than you guessed. Repeat the check every few months, because policies change.
Common mistakes
Using a personal account for work documents. Assuming deleted chats vanish everywhere at once. Pasting a screenshot that contains tabs, names or messages you did not mean to share. When in doubt, ask yourself whether you would be comfortable if this text appeared in a stranger's inbox.
A new employee pastes a customer complaint, with the customer's full name and order history, into a free chatbot to help write a reply. A week later the privacy team asks about it. The fix would have taken ten seconds: replace the name and numbers with placeholders. The same reply, and no data left the company.
Check yourself
Which of these should you keep out of a chat with an AI service?
Not quite. Credentials, identity numbers and private information about others are risky to share, whatever the provider promises.
You want help rewording a customer email. What is a safe way to do it?
Not quite. Redacting the details loses nothing the model needs and keeps the sensitive parts with you.
Where do you find out whether a service uses your chats to train its models?
Not quite. Policies differ by service and plan and they change, so the current policy and your settings are the source of truth.
You got 0 of 3 right.
Go deeper
- Docs
Anthropic · How conversations are handled and how to control your data.
- Docs
OpenAI · Chat history, training opt-outs and temporary chats.
- ArticleAI Risk Management FrameworkArticle
NIST · A reference for how organizations think about data and AI risk.
Spotted a mistake or something unclear? Report it on GitHub.