OpenAI pulls ChatGPT search feature over privacy concerns

OpenAI has removed an opt-in feature from its ChatGPT platform after it was discovered that private user conversations were appearing in Google search results. The decision follows a report by Fast Company which highlighted the public accessibility of sensitive discussions.

Earlier this week, it was revealed that private ChatGPT conversations, some containing highly personal information such as details about drug use or sexual health, were unexpectedly indexed by Google. The issue reportedly stemmed from the “Share” feature within the ChatGPT application. When users opted to share a chat, they were presented with a checkbox labeled “Make this chat discoverable.” Below this option, in smaller, lighter text, a disclaimer stated that the conversation could then appear in search engine results. Critics suggested this design may have inadvertently led users to make their private chats publicly searchable without full awareness of the consequences.

In response to widespread backlash on social media, OpenAI swiftly pulled the feature and initiated efforts to remove any exposed conversations from search engine indexes.

Dane Stuckey, OpenAI’s chief information security officer, addressed the issue, stating, “Ultimately we think this feature introduced too many opportunities for folks to accidentally share things they didn’t intend to, so we’re removing the option.” He added, “We’re also working to remove indexed content from the relevant search engines.” Stuckey characterized the feature as a “short-lived experiment.” This statement marked a reversal from the company’s earlier position, which had maintained that the feature’s labeling was sufficiently clear.

Cybersecurity analyst and CEO of SocialProof Security, Rachel Tobac, commended OpenAI for its prompt action. “We know that companies will make mistakes sometimes, they may implement a feature on a website that users don’t understand and impact their privacy or security,” she noted. “It’s great to see swift and decisive action from the ChatGPT team here to shut that feature down and keep user’s privacy a top priority.”

However, the incident has raised broader concerns among AI ethicists. Carissa Véliz, an AI ethicist at the University of Oxford, expressed unease about such “experiments” involving the general public. “Tech companies use the general population as guinea pigs,” Véliz commented. “They do something, they try it out on the population, and see if somebody complains.”