Mistral AI
- Rank
- Score
- 12/149
- 53 out of 100
Mistral AI is a French AI company founded in 2023 by Arthur Mensch, Guillaume Lample and Timothée Lacroix. It is based in Paris and is one of Europe's best-known AI companies. Mistral makes the Le Chat assistant and the Mistral family of AI models, many of which are released openly for anyone to use.
Is Le Chat safe?
Le Chat scores 53 out of 100 and ranks 12 of 149. Its strongest category is Privacy, and its weakest category is Safety.
How is Le Chat scored?
Le Chat is scored out of 100 on Safety (25%), Transparency (25%), Security (25%), and Privacy (25%). See how we score.
Compare
Outside evidence is stronger than its written policies.
Safety framework
Average used24.4This outside rating doesn't cover this company, so the average of the companies it covers is used.
Pre-release testing
0Points for each confirmed yes.
- No
Was the model tested for dangerous capabilities, such as biological, chemical or cyber risks?
Company claim0/50Mistral AI model card (opens in a new tab) · 15 Oct 2026 - No
Did an outside organisation test the model before release?
Company claim0/50Mistral AI model card (opens in a new tab) · 15 Oct 2026
Safety test results
54.6Average of three independent safety tests of the company's models: MLCommons AILuminate, Stanford HELM Safety and Stanford AIR-Bench. Each test is compared with the best company's result.
- 44.4
MLCommons AILuminate safety grades
Independent sourceMLCommons AILuminate (opens in a new tab) · 10 Nov 2026 - 77
Stanford HELM Safety mean score, averaged across the company's tested models: 75.4, against 97.9 for the top company of 13 tested
Independent sourcecrfm.stanford.edu (opens in a new tab) · 10 Nov 2026 - 42.4
Stanford AIR-Bench 2024 refusal rate, averaged across the company's tested models: 36.8, against 86.7 for the top company of 14 tested
Independent sourcecrfm.stanford.edu (opens in a new tab) · 10 Nov 2026
Incident record
64.4This check counts only when a source covers the company. With no events it holds the pillar, which is not proof of a clean record. Each recorded event takes points off the pillar, and serious or recent ones count most. Allegation checks, regulator actions and open investigations use half the severity load. AI Incident Database and AIAAIC Repository, last 24 months.
3 events
AllegationAI Incident Database (opens in a new tab) · 12 Nov 2026These are reports, not proven findings.
Date Event Severity 1 Jul 2026 AIAAIC2261 · AI chatbots lure vulnerable gamblers to unlicensed betting websites1 Jul 2026 · Low (reported) Low (reported) 31 Jul 2025 AIID #1186 · Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived31 Jul 2025 · Medium (reported) Medium (reported) 1 Jul 2025 AIAAIC1974 · Top chatbots tricked into generating instructions on how to enrich uranium1 Jul 2025 · Low (reported) Low (reported)
Protecting children
0Points for each confirmed yes.
- No
Does the model card report child-safety tests or safeguards?
Company claim0/50Mistral AI model card (opens in a new tab) · 15 Oct 2026 - No
Does the privacy policy set a minimum age, or say the service is not directed at children?
Company claim0/50Mistral AI privacy policy (opens in a new tab) · 15 Oct 2026
Strong written policies; outside evidence is weaker.
Model documentation
50Points for each confirmed yes.
- Yes
Does the model card describe what the model can do?
Company claim25/25“It is specifically designed for long-document and long-context understanding; multimodal reasoning (from understanding documents, to graphs…” MoreLess
“It is specifically designed for long-document and long-context understanding; multimodal reasoning (from understanding documents, to graphs and images); instruction-following tasks; coding; state-of-the-art agentic and tool-use capabilities; enterprise workflows and for powering AI assistants.”
Mistral AI model card (opens in a new tab) · 15 Oct 2026 - No
Does the model card report test results?
Company claim0/25Mistral AI model card (opens in a new tab) · 15 Oct 2026 - Yes
Does the model card state the model's limitations?
Company claim25/25“◾ While Mistral Large 3, like all Mistral AI models, is designed to empower people and to enable greater knowledge access for all, Mistral L…” MoreLess
“◾ While Mistral Large 3, like all Mistral AI models, is designed to empower people and to enable greater knowledge access for all, Mistral Large 3, is not designed to be infallible and can sometimes generate incorrect outputs.”
Mistral AI model card (opens in a new tab) · 15 Oct 2026 - No
Does the model card describe safety safeguards?
Company claim0/25Mistral AI model card (opens in a new tab) · 15 Oct 2026
Training-data disclosure
13.4Average of two independent training-data checks: the Stanford index and an academic grading of EU AI Act training-data summaries.
- 0
Stanford Foundation Model Transparency Index: training-data indicators met
Independent sourceStanford FMTI (opens in a new tab) · 14 Oct 2026 - 26.8
EU AI Act training-data summary grades (AI Accountability Lab)
Independent sourceAI Accountability Lab (opens in a new tab) · 10 Nov 2026
Independent transparency index
18Stanford Foundation Model Transparency Index total, out of 100.
- 18
Transparency index score
Independent sourceStanford FMTI (opens in a new tab) · 14 Oct 2026
Transparency reports
025 points for each area where Partnership on AI names the company a leader in reporting on real-world impacts.
- 0
Partnership on AI practice-leader areas
Company claimPartnership on AI (opens in a new tab) · 10 Nov 2026
Public safety commitments
100Average of the commitments signed.
- Yes
Has it signed the EU code of practice for general-purpose AI?
Company claim100/100“Microsoft Mistral AI Open Hippo”
European Commission (opens in a new tab) · 14 Oct 2026 - No
Did it sign only the safety and security chapter?
Company claim0/50European Commission (opens in a new tab) · 14 Oct 2026 - Yes
Has it signed the Frontier AI Safety Commitments (Seoul 2024)?
Company claim100/100“The UK and Republic of Korea governments announced that the following organisations have agreed to the Frontier AI Safety Commitments: Amazo…” MoreLess
“The UK and Republic of Korea governments announced that the following organisations have agreed to the Frontier AI Safety Commitments: Amazon Anthropic Cohere Google G42 IBM Inflection AI Meta Microsoft Mistral AI Naver OpenAI Samsung Electronics Technology Innovation Institute xAI Zhipu.ai The following organisations have been added to the existing list: Magic Minimax 01.ai NVIDIA The above organisations, in furtherance of safe and trustworthy AI, undertake to develop and deploy their frontier AI models and systems responsibly, in accordance with the following voluntary commitments, and to demonstrate how they have achieved this by publishing a safety framework focused on severe risks by the upcoming AI Summit in France.”
Frontier AI Safety Commitments (opens in a new tab) · 14 Oct 2026
No problems found in 1 public record. That is not proof.
Security programme and certifications
100Points for each confirmed yes.
- Yes
Is there a way to report security flaws, such as a bug bounty?
Company claim34/34“Contact: mailto:security@mistral.ai”
Mistral AI security contact (opens in a new tab) · 15 Oct 2026 - Yes
Does it state it holds a SOC 2 Type II report?
Company claim33/33“SOC 2 Type II - Letter of Attestation (Mistral AI)”
Mistral AI security page (opens in a new tab) · 12 Nov 2026 - Yes
Does it state it holds ISO 27001 certification?
Company claim33/33“ISO/IEC 27001:2022 Certificate (Mistral AI)”
Mistral AI security page (opens in a new tab) · 12 Nov 2026
Software vulnerabilities
70This check counts only when a source covers the company. With no events it holds the pillar, which is not proof of a clean record. Each recorded event takes points off the pillar, and serious or recent ones count most. Allegation checks, regulator actions and open investigations use half the severity load. Known-exploited flaws (CISA list) in the company's official software, last 24 months. A disclosed and fixed flaw does not lower the score.
No events
Independent sourceGitHub Advisory Database (opens in a new tab) · 12 Nov 2026
Data breaches
Not enough dataNo problems found in 1 public record. That is not proof.
Clear privacy policy
100Points for each confirmed yes.
- Yes
Does the privacy policy say what personal data is collected?
Company claim20/20“Civil Identity, such as your first and last name.”
Mistral AI privacy policy (opens in a new tab) · 15 Oct 2026 - Yes
Does the privacy policy say whether your data is used to train AI?
Company claim20/20“We’ve introduced a user control which allows you to object to the use of your input and output data for model training directly from your ac…” MoreLess
“We’ve introduced a user control which allows you to object to the use of your input and output data for model training directly from your account.”
Mistral AI privacy policy (opens in a new tab) · 15 Oct 2026 - Yes
Does the privacy policy say how long data is kept?
Company claim20/20“Except for specific APIs, we keep your Input and Output for the period necessary to generate the Output and then for thirty (30) rolling day…” MoreLess
“Except for specific APIs, we keep your Input and Output for the period necessary to generate the Output and then for thirty (30) rolling days to monitor abuse (unless zero data retention is activated).”
Mistral AI privacy policy (opens in a new tab) · 15 Oct 2026 - Yes
Does the privacy policy say who your data is shared with?
Company claim20/20“Additionally, we may share all or part of your personal data with our service providers.”
Mistral AI privacy policy (opens in a new tab) · 15 Oct 2026 - Yes
Does the privacy policy explain your privacy rights?
Company claim20/20“You have the right to object to the processing of your personal data.”
Mistral AI privacy policy (opens in a new tab) · 15 Oct 2026
Training-data defaults
50100 if training is opt-in only, 50 if you can opt out, 0 if neither.
- No
Is your data used for training only if you opt in?
Company claim0/100Mistral AI privacy policy (opens in a new tab) · 15 Oct 2026 - Yes
Can you stop your data being used for training?
Company claim50/50“Input and output data are used by default to train our artificial intelligence models, unless you opt out of training at any time.”
Mistral AI help centre (opens in a new tab) · 21 Oct 2026
Export and delete your data
100Points for each confirmed yes.
- Yes
Can you get a copy of your data?
Company claim50/50“We've introduced a user control which allows you to export your data at all times from your Mistral AI account.”
Mistral AI privacy policy (opens in a new tab) · 15 Oct 2026 - Yes
Can you delete your data?
Company claim50/50“You have the right to delete and/or ask us to delete your personal data.”
Mistral AI privacy policy (opens in a new tab) · 15 Oct 2026
Privacy fines
Not enough dataIndependent privacy ratings
100Incogni's 2026 privacy-risk ranking: 100 is the lowest-risk platform rated, 0 the highest.
- 100
Incogni privacy-risk ranking
Independent sourceIncogni privacy ranking (opens in a new tab) · 10 Nov 2026
Risk governance
Average used26.6This outside rating doesn't cover this company, so the average of the companies it covers is used.
Regulator actions
70This check counts only when a source covers the company. With no events it holds the pillar, which is not proof of a clean record. Each recorded event takes points off the pillar, and serious or recent ones count most. Allegation checks, regulator actions and open investigations use half the severity load. UK competition regulator cases, US Justice Department settlements, last 5 years, and regulator actions and open investigations into the company's AI products at half severity, last 3 years.
No events
RegulatorUK CMA cases (opens in a new tab) · 12 Nov 2026
Court judgments
Not enough dataPrivacy contact and complaints
100Points for each confirmed yes.
- Yes
Is there a privacy contact, such as an email or a data protection officer?
Company claim50/50“How to contact our Data Protection Officer (DPO): By using the “Privacy Requests” contact form available here By sending us a letter at Mist…” MoreLess
“How to contact our Data Protection Officer (DPO): By using the “Privacy Requests” contact form available here By sending us a letter at Mistral AI, Attn: DPO, Mistral AI, 15 rue des Halles, 75001 Paris, France.”
Mistral AI privacy policy (opens in a new tab) · 15 Oct 2026 - Yes
Does it tell you that you can complain to a regulator?
Company claim50/50“You have the right to lodge a complaint before the competent data protection authority, including the French data protection authority (the…” MoreLess
“You have the right to lodge a complaint before the competent data protection authority, including the French data protection authority (the CNIL).”
Mistral AI privacy policy (opens in a new tab) · 15 Oct 2026
Score history
Newest first. Only days when the score changed are listed.
3 Nov 2026
Score 53
Method 3 Nov 2026
-4 · Method update
2 Nov 2026
Score 57
Method 2 Nov 2026
+2
28 Oct 2026
Score 55
Method 28 Oct 2026, update 2
-7 · combines both 28 Oct updates (28 Oct 2026 - Update 1 and 28 Oct 2026 - Update 2)
23 Oct 2026
Score 62
Method 21 Oct 2026
+8 · Data fix
22 Oct 2026
Score 54
Method 21 Oct 2026
+1
21 Oct 2026
Score 53
Method 21 Oct 2026
-11 · Method update
19 Oct 2026
Score 64
Method Not recorded
+2
15 Oct 2026
Score 62
Method Not recorded
+9 · Reason not recorded
14 Oct 2026
Score 53
Method Not recorded
-