Connect with us

Technologies

Gen AI Chatbots Are Starting to Remember You. Should You Let Them?

An AI model’s long memory can offer a better experience — or a worse one. Good thing you can turn it off.

Until recently, generative AI chatbots didn’t have the best memories: You tell it something and, when you come back later, you start again with a blank slate. Not anymore. 

OpenAI started testing a stronger memory in ChatGPT last year and rolled out improvements this month. Grok, the flagship tool of Elon Musk’s xAI, also just got a better memory.

It took significant improvements in math and technology to get here but the real-world benefits seem pretty simple: You can get more consistent and personalized results without having to repeat yourself.

“If it’s able to incorporate every chat I’ve had before, it does not need me to provide all that information the next time,” said Shashank Srivastava, assistant professor of computer science at the University of North Carolina at Chapel Hill.

Those longer memories can help with solving some frustrations with chatbots but they also pose some new challenges. As with when you talk to a person, what you said yesterday might influence your interactions today.

Here’s a look at how the bots came to have better memories and what it means for you.

Improving an AI model’s memory

For starters, it isn’t quite a “memory.” Mostly, these tools work by incorporating past conversations alongside your latest query. “In effect, it’s as simple as if you just took all your past conversations and combined them into one large prompt,” said Aditya Grover, assistant professor of computer science at UCLA.

Those large prompts are now possible because the latest AI models have significantly larger “context windows” than their predecessors. The context window is, essentially, how much text a model can consider at once, measured in tokens. A token might be a word or part of a word (OpenAI offers one token as three-quarters of a word as a rule of thumb). 

Early large language models had context windows of 4,000 or 8,000 tokens — a few thousand words. A few years ago, if you asked ChatGPT something, it could consider roughly as much text as is in this recent CNET cover story on smart thermostats. Google’s Gemini 2.0 Flash now has a context window of a million tokens. That’s a bit longer than Leo Tolstoy’s epic novel War and Peace. Those improvements are driven by some technical advances in how LLMs work, creating faster ways to generate connections between words, Srivastava said. 

Other techniques can also boost a model’s memory and ability to answer a question. One is retrieval-augmented generation, in which the model can run a search or otherwise pull up documents as needed to answer a question, without always keeping all of that information in the context window. Instead of having a massive amount of information available at all times, it just needs to know how to find the right resource, like a researcher perusing a library’s card catalog.

Read more: AI Essentials: 27 Ways to Make Gen AI Work for You, According to Our Experts

Why context matters for a chatbot

The more an LLM knows about you from its past interactions with you, the better suited to your needs its answers will be. That’s the goal of having a chatbot that can remember your old conversations. 

For example, if you ask an LLM with no memory of you what the weather is, it’ll probably follow up first by asking where you are. One that can remember past conversations, however, might know that you often ask it for advice about restaurants or other things in San Francisco, for example, and assume that’s your location. “It’s more user-friendly if the system knows more about you,” Grover said.

A chatbot with a longer memory can provide you with more specific answers. If you ask it to suggest a gift for a family member’s birthday and tell it some details about that family member, it won’t need as much context when you ask again next year. “That would mean smoother conversations because you don’t need to repeat yourself,” Srivatsava said.

A long memory, however, can have its downsides.

You can (and maybe should) tell AI to forget

Having a chatbot recommend a gift poses a conundrum that’s all too common in human memories: You told your aunt you liked airplanes when you were 12 years old, and decades later you still get airplane-themed gifts from her. An LLM that remembers things about you could bias itself too much toward something you told it before.

“There’s definitely that possibility that you can lose your control and that this personalization could haunt you,” Srivastava said. “Instead of getting an unbiased, fresh perspective, its judgment might always be colored by previous interactions.”

LLMs typically allow you to tell them to forget certain things or to exclude some conversations from their memory. 

You may also deal with things you don’t want an AI model to remember. If you have private or sensitive information you’re communicating with an LLM (and you should think twice about doing so at all), you probably want to turn off the memory function for those interactions. 

Read the guidance on the tool you’re using to be sure you know what it’s remembering, how to turn it on and off and how to delete items from its memory. 

Grover said this is an area where gen AI developers should be transparent and offer clear commands in the user interface. “I think they need to be providing more controls that are visible to the user, when to turn it on, when to turn it off,” he said. “Give a sense of urgency for the user base so they don’t get locked into defaults that are hard to find.”

How to turn off gen AI memory features

Here’s how to manage memory features in some common gen AI tools.

ChatGPT

OpenAI has a couple types of memory in its models. One is called “reference saved memories” and it stores details that you specifically ask ChatGPT to save, like your name or dietary preferences. Another, “reference chat history,” remembers information from past conversations (but not everything). 

To turn off either of these features, you can go to Settings and Personalization and toggle the items off. 

You can ask ChatGPT what it remembers about you and ask it to forget something it has remembered. To completely delete this information, you can delete the saved memories in Settings and the chat where you saved that information.

Gemini

Google’s Gemini model can remember things you’ve discussed or summarize past conversations. 

To modify or delete these memories, or to turn off the feature entirely, you can go into your Gemini Apps Activity menu.

Grok

Elon Musk’s xAI announced memory features in Grok this month and they’re turned on by default. 

You can turn them off under Settings and Data Controls. The specific setting is different between Grok.com, where it’s “Personalize Grok with your conversation history,” and on the Android and iOS apps, where it’s “Personalize with memories.” 

Technologies

Trump Maintains US‑Iran Negotiations Continue Amid Tehran’s Denials of Duplicity

President Trump insists that US‑Iran talks are ongoing despite Tehran’s denial of any negotiation plans, while warning that only a deal or total surrender will allow passage through the Strait of Hormuz. Conflicting statements from both sides have heightened uncertainty as the conflict enters its sixth month.

On Monday, President Donald Trump asserted that negotiations between the United States and Iran are still taking place, even after Tehran stated it has no intention of engaging in direct talks with Washington.

In a fiery Truth Social post, Trump labeled Iran’s leaders “unbelievably duplicitous,” claiming they are lying about ongoing peace talks “whether Iran wants to admit it or not.” He repeated his assertion that the United States completely controls the Strait of Hormuz, despite maritime traffic through the crucial route lingering at only a small fraction of pre‑conflict levels.

He wrote, “Nothing reaches Iran unless we allow it, and nothing will pass unless a deal—or total surrender—is achieved.”

Earlier that day, Iranian Foreign Ministry spokesperson Esmail Baghaei told reporters there is no imminent plan for U.S.–Iran negotiations, contradicting Trump’s earlier comment that talks would resume Monday afternoon. Baghaei added that Iran’s only current discussions are with Oman concerning the Strait of Hormuz.

The conflicting statements have heightened uncertainty over the peace‑talk process and the broader conflict, now in its sixth month.

Trump’s assertion about new negotiations came a day after he said on Truth Social that he had agreed to cancel a massive strike against Iran “subject to being able to rapidly make a DEAL.” He said in the same post that Iran and other Middle Eastern countries had asked him to hold off on that attack because “the perimeters of a deal has been agreed to.”

Trump has claimed dozens of times throughout the more‑than‑five‑month‑long war that a deal is at hand. No permanent deal has been signed, and a temporary ceasefire reached in June has fallen apart.

Trump has also repeatedly threatened to launch devastating strikes against Iran before backing off. After the latest example, oil prices on Monday fell and stocks surged.

BMI, a research unit of Fitch Solutions, said in a note Monday that a broader diplomatic understanding on reopening the Strait of Hormuz is still achievable this quarter, while raising the probability of its escalation scenario to 35% from 25%, citing mounting military, diplomatic and economic signs of rising U.S.-Iran tensions.

“Diplomatic progress is likely to be punctuated by periodic military flare-ups, while miscalculation by either side could trigger a renewed escalation,” BMI analysts wrote in a note. The firm said the key issue to watch is the future governance of the strait, as the Iran-Oman talks — potentially backed by Gulf states, China and the U.S. — point to efforts to build a post-conflict shipping framework.

Shipping risks persist even as diplomacy appears to be advancing. The United Kingdom Maritime Trade Operations Centre said it received a report of an incident 20 nautical miles (23 miles) northeast of Khasab, Oman — at the mouth of the strait — with a tanker’s master reporting an explosion in close proximity to the vessel at about 20:37 UTC Sunday (4:37 pm ET). The vessel and crew were safe and authorities are investigating, UKMTO said, advising ships to transit with caution.

The proposal Trump announced over the weekend calls for the U.S. and Iran to return to negotiations and continue ironing out some of the thorny issues that had derailed diplomatic efforts, according to The Associated Press, citing a regional official involved in the mediation efforts.

The official said the proposal also includes a reopening of the Hormuz Strait and halting attacks across the region, including by Iranian-backed militias in Iraq on the Arab Gulf countries and Jordan.

The U.S., for its part, will end its naval blockade on Iran and allow Tehran to export its oil, the official said, adding that no deal has been reached, although the mediation efforts remained underway.

Trump’s weekend reversal has lowered the temperature after days of escalating attacks across the Gulf. Kuwait said Saturday that Iranian forces launched a wave of drones within its airspace, with its military destroying multiple aircraft after Iran targeted critical infrastructure in the country’s north.

A parallel track with Muscat is also advancing. Iranian diplomats said Tehran was close to reaching a new arrangement with Oman to manage shipping through the Strait of Hormuz, a deal critical to preventing the war from escalating further, according to the Financial Times.

Iranian officials said negotiations over future management of the Hormuz Strait with Oman, which sits on the opposite shore of the waterway, are in their final stages. The agreed shipping route would be different from those used before, according to Iran’s Foreign Ministry spokesperson, Baghaei, adding that the new route was separate from the issue of the strait’s reopening or continued closure.

Continue Reading

Technologies

Oil Prices Slide as Trump Halts Planned Iran Strike

Oil prices dropped after Trump cancelled a planned strike on Iran, with WTI down about 5% and Brent near 5% lower. He said the move followed requests from Tehran and regional allies for a pause while a deal shaping the Strait of Hormuz and Iran’s nuclear program is negotiated.

Oil prices fell on Monday after President Donald Trump announced he had cancelled a planned strike on Iran. WTI futures dropped roughly 5% to $80.34 a barrel, while Brent slipped about 4.7% to $83.77 a barrel.

Trump said early Sunday he called off the strike after Iran and several Middle Eastern nations asked him to hold off, noting that the outlines of a deal had been agreed upon. He added that the prospective accord would entail the immediate, full opening of the Strait of Hormuz and an end to Iran’s nuclear ambitions, according to his Truth Social post.

The president had been considering another round of strikes as diplomatic hopes waned since the conflict began on February 28. He said the U.S. and Iran would meet for talks on Monday, but Iran denied any scheduled negotiations with Washington, citing PressTV. Iran’s foreign‑ministry spokesperson Esmaeil Baghaei clarified that Tehran was only discussing shipping routes through the Strait of Hormuz with Oman. In a follow‑up Truth Social message, Trump insisted that, regardless of Iran’s acknowledgment, the United States is indeed discussing a solution to a long‑standing problem created by Iran.

Continue Reading

Technologies

Oil Prices Drop as Trump Cancels Planned Attack on Iran

Oil prices fell sharply after President Trump announced the cancellation of a planned strike on Iran, citing a new deal that would open the Hormuz Strait and end Iran’s nuclear threat.

Oil prices fell sharply on Monday after President Donald Trump announced that he had called off a planned strike on Iran.

West Texas Intermediate futures, the U.S. benchmark, slipped roughly 5% to close at $80.34 per barrel, while Brent crude, the international benchmark, declined 4.7% to settle at $83.77 a barrel.

Trump made the announcement early Sunday, saying he had canceled the strike following requests from Tehran and other Middle Eastern countries.

In a Truth Social post, he wrote: “We have just been asked by Iran, and other Middle Eastern Countries, to hold off any attack in that the perimeters of a deal has been agreed to.”

The president indicated that the proposed agreement would include the immediate, complete, and total opening of the Hormuz Strait, as well as an end to Iran’s nuclear threat.

Trump had been weighing additional strikes amid diminishing prospects for a diplomatic resolution to the conflict that began on Feb. 28. He stated that the U.S. and Iran would hold negotiations on Monday.

Tehran denied that talks were planned with Washington, according to state news outlet PressTV.

Iran’s Foreign Ministry spokesman Esmaeil Baghaei said Tehran was only holding talks with Oman regarding the routes ships can use through the Strait of Hormuz.

In a subsequent Truth Social post, Trump added that whether “Iran wants to admit it or not, we are, in fact, talking of a solution to a problem that they have caused for decades.”

Continue Reading

Trending

Copyright © Verum World Media