What Do the Potential Concerns About AI Mean for Schools?

Michael Keany

November 2026

Artificial intelligence has moved so quickly into schools that educators barely had time to decide whether they wanted it before students and teachers began using it. Now a new development should command the attention of school leaders: some of the people building the world’s most powerful AI systems are themselves calling for stronger safeguards and a slower, more deliberate pace of development.

In September 2026, Anthropic CEO Dario Amodei called for slowing the advancement of frontier AI so that safety measures could catch up with technical capabilities. Leaders including Sam Altman of OpenAI, Elon Musk of xAI, and Demis Hassabis of Google DeepMind expressed support for stronger safety measures and greater coordination. The concerns include misuse, cyberattacks, loss of human control, and systems becoming more capable faster than governments and institutions can adequately evaluate them. (The Guardian)

For schools, this does not mean we should panic or abandon AI. It means we should stop treating AI as simply another educational technology.

Schools Need to Become Deliberate Adopters

Schools have often followed a familiar technology cycle: a new tool appears, teachers experiment with it, districts purchase products, and policies eventually catch up. AI requires almost the reverse approach.

School leaders should ask first: What problem are we trying to solve, what could go wrong, and what human oversight is necessary?

The U.S. Department of Education has warned that AI systems may produce inaccurate information, introduce privacy and security risks, amplify bias, and automate decisions in ways that could disadvantage students. Its guidance emphasizes keeping humans involved when consequential educational decisions are made. (U.S. Department of Education)

That principle should become fundamental school policy:

AI may advise. Humans decide.

A teacher can use AI to suggest lesson ideas. A principal might use it to summarize survey data. A counselor might use it to identify resources. But schools should be extremely cautious about allowing algorithms to determine grades, discipline, special education placement, teacher evaluation, course placement, or other high-stakes decisions.

Students Need AI Literacy, Not Simply AI Access

The second implication is curricular.

If AI-generated information can be wrong, biased, manipulative, or fabricated, students need a new kind of literacy. They must learn to ask:

Where did this information come from? Can I verify it? What evidence supports it? What might the system be missing?

Those questions may soon be as fundamental as traditional reading comprehension.

UNESCO’s guidance on generative AI similarly emphasizes a human-centered approach, privacy protection, age-appropriate use, equity, and careful evaluation of AI tools before their widespread adoption in education. (UNESCO)

Ironically, the more powerful AI becomes, the more important traditional intellectual skills may become: reading deeply, writing clearly, questioning evidence, recognizing bias, conducting research, and constructing an argument.

Protect Student Data Aggressively

Schools should also assume that information entered into AI systems may carry privacy implications.

Teachers and students should never casually upload personally identifiable student information, confidential records, individualized education programs, behavioral histories, medical information, or sensitive personnel material into public AI systems unless the district has specifically approved the platform and its data protections.

AI convenience should never outrun student privacy.

Preserve What Makes School Human

Perhaps the deepest concern is not technological at all.

If AI can tutor, write, analyze, summarize, generate lessons, and answer questions instantly, schools must become increasingly intentional about what only people can provide.

Children still need adults who know them.

They need teachers who notice confusion before students raise their hands, coaches who encourage them after failure, counselors who recognize when something is wrong, classmates who challenge their thinking, and principals who create communities in which people feel that they belong.

Schools should therefore embrace AI where it increases human capacity, while resisting uses that simply replace human relationships.

The emerging warnings from AI leaders should not cause schools to retreat from innovation. They should encourage something schools understand very well:

Powerful tools require thoughtful supervision.

The question facing school leaders is no longer simply, “How can we use AI?”

The better question is:

“How can we ensure that AI remains a tool serving students and teachers rather than a system to which we gradually surrender decisions, judgment, and responsibility?”

References

1. U.S. Department of Education, Office of Educational Technology. Artificial Intelligence and the Future of Teaching and Learning: Insights and Recommendations. 2023. (ERIC)
2. UNESCO. Fengchun Miao & Wayne Holmes. Guidance for Generative AI in Education and Research. 2023, updated 2026. (UNESCO)
3. Reuters. “Anthropic CEO Urges AI Companies to Slow Model Development Amid Fears Over Misuse.” September 12, 2026. (Reuters)

 Prepared with the assistance of AI software OpenAI. (2026). ChatGPT (5.2) [Large language model]. https://chat.openai.com