What Happened When Meta Used A.I. to Ban Accounts on Facebook and Instagram

Users said the technology mistakenly deleted their accounts. To resolve the issue, they still had to rely on A.I.

What Happened When Meta Used A.I. to Ban Accounts on Facebook and Instagram

The notification startled Camille Hanson awake one night this March. Her Facebook and Instagram accounts, where she had nearly one million followers running a business with her husband teaching English to nonnative speakers, had been flagged for deletion. Meta said she had violated the community guidelines for fraud and deception.

“I’m just an English teacher,” Ms. Hanson, 40, remembered thinking. She was flummoxed by the fraud and deception claims. “What am I doing wrong?” she wondered.

The notice said she could appeal, so she clicked the button to begin the process. A week later, she got another notification: Her appeal was denied.

“All your information will be permanently deleted,” Meta’s response read. “You cannot request another review of this decision.”

It was like having “an actual physical business, and somebody just shuts down your office or your storefront,” Ms. Hanson’s husband, Calvin, 42, said in an interview from their home in Portugal.

Camille and Calvin Hanson at home in Viana Do Castelo, Portugal. They run a business on Instagram teaching English to nonnative speakers.Daniel Rodrigues for The New York Times