Microsoft's Classroom AI Privacy Pledge

Millions of students turn to AI chatbots every day for homework help, emotional support, and personal advice, often without knowing where their conversations and personal data end up. As AI becomes a standard part of the school day, the question of how that data is used — and who is responsible for protecting it — has become a growing concern for educators, parents, and students.

Microsoft's Binding Agreement With AFT

Microsoft announced it had agreed to adopt guardrails and privacy standards for its AI in schools, as negotiated with the American Federation of Teachers (AFT), the country's second-largest teachers union.

The agreement is legally binding and requires third-party audits for compliance, according to the AFT, which said it could set an industry standard. Microsoft says it will not use student or educator data to train AI systems, apart from a narrow exception for data that could help protect students. It also says the data it collects cannot be sold, used for advertising, or used for product development.

What the Standards Prohibit

The agreement prohibits any use of AI companions or features “designed to foster emotional attachment or dependency” and to keep students engaged for longer than a learning task requires. It also includes audit and transparency measures that require the company to disclose to families, in plain language, how its tools work.

“This standard sets a high bar for child privacy and AI safety, and we’ll extend this agreement to every school district across the country,” Brad Smith, Microsoft’s vice chair and president, said in a statement.

— Brad Smith, Microsoft’s vice chair and president

The standards will apply to all schools that Microsoft has contracts with starting Nov. 1, Smith said.

Union Leaders Frame the Deal

AFT President Randi Weingarten called the agreement the “first of its kind” and an important step to setting an industry standard in the absence of federal and state legislation on AI in schools.

“We want parents to have control of their kids’ education. We want educators to have control of kids’ education, not ed tech. And that’s what this agreement is,” Weingarten said.

— Randi Weingarten, AFT President

She spoke at a joint news conference with Smith at the headquarters of the United Federation of Teachers, the AFT’s New York City affiliate. The headquarters is home to AFT’s National Academy for AI Instruction for teachers, which launched a year ago backed by $23 million from Microsoft, OpenAI, and Anthropic.

Google's Silence and Classroom Expansion

Two other leading AI companies, OpenAI and Anthropic, said they also were discussing safety and privacy pacts with the AFT. But Google, the dominant provider of education technology for America’s schools, has not said whether it plans to offer similar protections.

Weingarten said she contacted Google directly to tell them about the agreement before making it public, in hopes the company would become a signatory. Google has not responded to a request for comment from The Associated Press on whether it plans to offer similar protections.

Google found itself at the center of controversy over AI in schools when it announced in August it had turned on its Gemini chatbot for many K-12 students using Google Classroom, its learning management system. The company says Google Classroom is used by 150 million teachers and students worldwide.

Critics decried Google’s move as an escalation of the race between tech giants to make inroads in schools and win over the next generation of AI users. The AI addition to Classroom only affects schools that allow student access to its Gemini app or Gemini Notebook, but it marks a major shift. Until August, Google had only allowed Gemini to be turned on for students 18 or older.

Competitors Signal Support

OpenAI, the maker of ChatGPT, called it an “important milestone for AI safety and privacy in schools.” The company has been working with AFT, it said in a statement, “and we look forward to finalizing our own agreement.”

Anthropic, the maker of Claude, said in a statement, “We applaud all efforts to drive responsible AI use in education.” The company said it was working with AFT to shape “a gold standard for safety and privacy.”

Privacy Experts Weigh In

Experts in data privacy say the new standards could help shape the conversation that schools have with AI providers, whether a school is a Microsoft customer or not.

“What I’m hopeful about is that this takes some of the pressure off individual school districts to negotiate with large tech companies,” said Elizabeth Laird, director at the Center for Democracy and Technology.

— Elizabeth Laird, director at the Center for Democracy and Technology

Until now, the negotiating power of schools to secure privacy protections from tech firms often depended on financial clout. “I think this standard makes progress toward not having that type of inequity across school districts,” Laird said.

Laird commended the agreement for going “above and beyond” what is legally required for vendors working with schools. For instance, Microsoft has committed not to use sensitive data that many companies leverage, such as information about gender, race, age, ZIP code that can be used to identify a person even if their name is removed.

But until others sign on, Laird said, the agreement highlights how difficult it is to set AI standards in the absence of legislation. It also emphasizes that the burden of protecting student privacy should fall on tech companies — not on parents, students, or schools.

Criticism and Remaining Questions

The safety provisions in the agreement are meaningful, but the standards will only be effective if all AI companies, especially the tech giants, sign on, said Josh Golin, executive director of online safety nonprofit Fairplay. He said the agreement sidesteps the question of whether AI products even belong in classrooms, or at what age they should be introduced.

“I worry that a high-profile framework like this will be misunderstood and schools will think, ‘If they’re doing a good job on data privacy and safety, then that means we should be using the tool,’” Golin said.

— Josh Golin, executive director of online safety nonprofit Fairplay

Golin also noted schools use thousands of AI-driven educational technology products produced by smaller companies, and questioned whether Google would embrace the framework. “Is Google going to embrace this framework? That is a huge question,” he said.

School Districts Hit Pause

As the school year started, the country’s two largest school districts, New York City and Los Angeles, announced they were putting the brakes on student use of AI for one year, as they study how to best incorporate the technology into education.

Along with their yearlong AI moratorium, the school systems for New York City and Los Angeles plan extensive audits of their education technology contracts and AI tools, with a focus on data privacy, transparency, and accountability. The ban in New York City applies to all elementary and middle school students, while in Los Angeles it extends through high school.

What This Means for Schools and Families

The agreement's most immediate impact may be on how school districts approach AI procurement. With Microsoft bound by third-party audits and plain-language transparency requirements, schools that use its tools will have a clearer baseline for what they can expect. But the deal also leaves open the question of whether similar protections will extend to the other AI products schools increasingly rely on.

For parents and educators, the standards shift some of the burden of protecting student privacy onto the companies themselves, rather than leaving it to individual districts to negotiate protections on their own. That could help level the playing field for smaller or less wealthy school systems that lack the legal resources to push back against large vendors.

Still, as Golin's comments suggest, the agreement may create a perception problem: schools could interpret Microsoft's compliance as a seal of approval for using AI in classrooms, even though the agreement does not address whether the tools should be used at all. And without commitments from Google and other major providers, the framework remains a patchwork rather than an industry-wide standard. What happens next may depend on whether Google responds to Weingarten's outreach — and whether other AI companies follow Microsoft's lead in the absence of federal or state legislation.