Anthropic's Message Threads cut time to first token by 35 percent for long conversations Matthias Bastian View the LinkedIn Profile of Matthias Bastian Nov 3, 2026 Anthropic released Message Threads as a public beta on its Claude platform. Until now, every API request had to resend the entire conversation history. Message Threads only transmits what's changed since the last message, cutting time to first token by about 35 percent for requests between 500,0
Archive: March 2024
Anthropic's Message Threads cut time to first token by 35 percent for long conversations
The Verge
Posted Nov 5, 2026 at 10:38 PM UTCEExternal LinkElizabeth LopattoAnd I say, hey-ey-ey, hey-ey-ey, I said, hey, what’s going on?Today I was on the phone with someone who suggested maybe the AI bubble was bursting and that was what was going on with AI stocks. Well, maybe! I don’t know! I’ve seen a lot of attempts to explain why the market was up yesterday and is down today and this is the best one of the bunch.So, about that Anthropic IPO . . .[FT Alphavill