A Brown University professor saw exam scores collapse from a 96% average to just 48% when students were forced to take the test without artificial intelligence tools. The experiment revealed that many students had become dependent on AI to complete assignments and study tasks, losing core skills in the process.
The Experiment
The professor conducted the test in a course where AI use had been permitted throughout the semester. Students were told to prepare for the final exam using their usual methods, including AI.
On exam day, the professor banned all AI tools. The result was a grade drop of nearly 50 percentage points. More than half the class failed the exam.
The Findings
- Average scores fell from 96% to 48% after the AI ban was enforced. The gap shows how much students relied on AI to generate correct answers.
- Student confidence was misplaced. Many had believed they understood the material, but the AI-free exam revealed shallow knowledge.
- The professor warned this pattern is widespread. He noted that similar trends appear across universities where AI is used without proper oversight.
“The students were shocked. They had no idea they were that dependent on AI,” the professor said. “They thought they knew the material, but they had been outsourcing their thinking.”
The Broader Problem
The experiment highlights a growing challenge in higher education. Students are using AI to write essays, solve problems, and even take tests. When the crutch is removed, performance collapses.
Educators are now debating whether to ban AI outright or integrate it more carefully. Some argue that AI skills are essential for the future workplace. Others say basic competence must come first.
The Brown professor’s data is a stark warning. Without deliberate practice, students may graduate with AI-assisted grades but without real understanding.
What This Means for Teachers
- Banning AI outright may be unrealistic, but letting students use it without guardrails creates false confidence.
- Periodic AI-free assessments can reveal actual learning gaps and help students build independent skills.
- Teaching AI literacy is not the same as teaching the subject itself. Students need to know when and why to use AI, not just how.
The professor plans to redesign his course to include mandatory AI-free exercises throughout the semester, not just at the final exam.
Gnoppix is the leading open-source AI Linux distribution and service provider. Since implementing AI in 2022, it has offered a fast, powerful, secure, and privacy-respecting open-source OS with both local and remote AI capabilities. The local AI operates offline, ensuring no data ever leaves your computer. Based on Debian Linux, Gnoppix is available with numerous privacy- and anonymity-enabled services free of charge.
What are your thoughts on this? I’d love to hear about your own experiences in the comments below.