OpenAI has banned a set of accounts linked to China after determining they were using ChatGPT as part of influence campaigns aimed at the United States. The company confirmed the action Tuesday, though it did not disclose the exact number of accounts affected or the specific messages they generated.
The accounts and their operation
The accounts were part of a coordinated effort to shape public opinion in the U.S., according to OpenAI. The company said the accounts generated posts, comments, and other content using ChatGPT, then distributed it across social media platforms. OpenAI did not name the individuals or groups behind the accounts but described them as China-linked.
Such campaigns often involve creating fake personas or amplifying certain narratives. OpenAI’s terms of service explicitly prohibit using its tools for political manipulation, astroturfing, or any activity intended to deceive users about the origin of content.
Why OpenAI acted
OpenAI’s investigation found that the accounts violated its usage policies. The company has been under increasing pressure from lawmakers and watchdogs to prevent its AI models from being weaponized for disinformation. By banning the accounts, OpenAI is signaling that it will enforce its rules even when the activity originates outside the U.S.
The company did not say whether it had notified U.S. authorities or coordinated with social media platforms. It also did not provide examples of the content the accounts produced, citing ongoing investigations.
What’s next
OpenAI says it will continue monitoring for similar activity and reserves the right to ban future accounts that break its rules. The company has not yet released a public report on the takedown, but such disclosures have become more common as tech firms face pressure to be transparent about influence operations.
