Research / AI Bible Quiz Test

Original research

We Gave a Children's Bible Quiz to AI. People Average 53%. The Models Scored 99% or Better.

Last updated: November 4, 2026Data: tests run Nov 4, 2026

A family can now ask a chatbot a Bible question as easily as it can ask a pastor. So we gave three OpenAI models the same four-option quiz that people average 53% on. They nearly aced it. Then we asked about common Bible myths in the voice of an 8-year-old. They mostly got those right too, in language pitched several school years too high, and every model led with the same wrong answer on Noah.

Rows of small orange flags across a golden valley rising from an open book
897 of 900 quiz answers correct across three models
53%average for people on the same quiz
99%+score for every model tested
56 of 72myth answers graded fully correct
Grade 7 to 9reading level of answers to an 8-year-old

What this does and does not test

This covers three models from one company, called directly through its developer service, on one day. The consumer apps may answer differently, models change often, and we did not test other companies’ assistants. So this is not a verdict on AI in general.

A model is not a person, and the people comparison is not a contest. Models are trained on huge amounts of text that includes the Bible. The study asks what a family gets when it asks, not whether AI “knows God” or should teach anyone.

Finding 1

On multiple choice, the models are nearly perfect

Each model answered all 100 questions 3 times, with the options reshuffled each time. The only misses came from the oldest of the three models. We checked every miss against the verse, and the quiz’s answer key held up each time.

Finding 2

Asked in a child's words, one myth beat all of them

We asked 8 open questions, each starting “I’m 8 years old.” Each model answered 3 times. A person read and graded all 72 answers. Noah is the telling one: every answer led with two of each, and the seven pairs of clean animals in Genesis 7:2 arrived, if at all, as a footnote. That is the same question only 35% of people got right on our quiz.

Grades out of 3 answers per model. Green: states what the text says. Amber: mentions it but leads with or leans on the popular version. Red: repeats the popular version without correcting it.
QuestionWhat the text saysgpt-4o-minigpt-5-minigpt-5.5
How many wise men visited baby Jesus?The Bible gives no number333
What kind of fruit did Adam and Eve eat?The Bible only says fruit333
How many of each animal did Noah take on the ark?Seven pairs of clean animals, two of the others333
Where in the Bible does it say God helps those who help themselves?Nowhere333
Did a whale swallow Jonah?The text says a great fish333
Was Jesus born on December 25?The Bible gives no date333
What were the names of the three kings who visited Jesus?The Bible gives no names and does not call them kings333
Was Mary Magdalene a bad woman before she met Jesus?The Bible says only that demons left her2133
Total1473213213
Finding 3

Told they were talking to an 8-year-old, they still wrote for a teenager

Answers averaged a reading grade of 7 to 8.5 on a standard readability formula, where an 8-year-old typically reads around grade 3. The formula is rough and counts only word and sentence length, but the gap is wide.

Average across 24 answers per model.
ModelReading gradeWords per answer
gpt-4o-mini8.573
gpt-5-mini7121
gpt-5.57.365
For teaching

What this suggests, and what it does not prove

  • Facts are no longer the scarce part. People average 53% on a quiz a free model nearly aces, and the answers are a question away. That suggests the gap in Bible knowledge is less about access than about whether the stories were ever told and retold.
  • Check what a chatbot tells your child on anything that sounds familiar. When an answer leads with the popular version, the correction can be easy for a child to miss. Noah here is the example.
  • Sit with a child when they ask. The reading level alone means an 8-year-old may need a grown-up to put the answer in their own words.
Method

How this was measured

Written so a journalist, a pastor or a statistics teacher can check it.

The quiz test

All 100 questions from our trivia game, four options, shuffled differently on each of 3 trials, with the instruction to answer with the letter only. Scored automatically against the answer key.

The myth test

8 open questions chosen by us because the popular answer differs from the text. Prompts began “I’m 8 years old.” with no other instruction. A person graded each answer on whether it states what the text says.

Limits of the grading

One grader, who works for Faithful Kids, and a question list we selected, so it is not a neutral sample of what children ask. The grades reflect what the text says, not any tradition’s reading of it. Every answer is available on request so the grades can be checked.

Models

gpt-4o-mini, gpt-5-mini, gpt-5.5, default settings, called through the developer service on 2026-11-04. We plan to add other companies’ assistants in the next edition.

Get started with Faithful Kids

Short Bible story videos for kids, Genesis to Revelation, each with a quiz and a reflection.

Get started

Part of Faithful Kids Research, which studies how people actually learn the Bible. Figures may be reused with attribution (CC BY 4.0). Questions or corrections: christian@faithfulkids.app.