Tag: open source llm
Open source llm explained — what it is, how it works and what it costs. Below are 20 articles about open source llm on CheapToken News. This is one of the main topics we track on CheapToken News.

Xinzhiyuan reports Only a few days after OpenAI launched Images 2.6 on November 4, people were already shouting: GPT is cooked. GPT-6 is completely done for. What has everyone excited is MiniMax's new H3 Image model. Beta tester Emily reported several impressive specs: Up to 16 reference images, prompts of up to 7,500 characters, and output at up to 4K. She also casually placed a bet: based on her understanding of MiniMax, she believed the model would even

Step 5 Preview Returns to the Global Top Tier Author | Wu Haiming Editor | Li Na TAG62@@Cen Feng Two years ago, when StepFun first made its public debut in the foundation-model community, it took the stage by storm with Step 1. Later that same year, it released Step 1V and the trillion-parameter foundation model Step 2 in succession. At the time, the industry still believed that the bigger the model, the more capable it was. Whoever pushed the Scaling Law

Loading the player… The very qualities that make open AI platforms valuable, like open doors and rich data, might also make them vulnerable to more hacks, Irene Solaiman, chief policy officer and SVP of strategy at Hugging Face said on a recent episode of the Equity podcast. The October attack on OpenCode, which targeted users’ third-party API keys and caused financial damage, is the latest example. It follows an incident this summer in which an OpenAI age

Zhidx (WeChat public account: zhidxcom) Author | Sun Xiaowen Editor | Cheng Qian Zhidx reported on November 10 that Meituan's LongCat team open-sourced the native multimodal model LongCat-2.5 last night. According to OpenCode's public data, as of noon today, LongCat-2.5'scumulative token usage on the platform had reached approximately 109 billion, with around 4,700 unique users and about 50,000 sessions completed. ▲LongCat-2.5's public data on OpenCode (Im

Nvidia strengthens open-source strategy with SchedMD acquisition Maximilian Schreiner View the LinkedIn Profile of Maximilian Schreiner Dec 16, 2025 AI News Without the Hype – Curated by Humans Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section. Subscribe now { "@context": "https://schema.org", "@type": "NewsArticle", "headli

PyTorch is the popular open source toolkit that AI app developers and startups use to build, train, and run AI models. It is, by some accounts, used by 85% of the AI apps. PyTorch was originally developed by Meta (then Facebook) in 2016, long before the world had an inkling that LLMs would change the world. At the time, Nvidia’s GPUs were already the standard hardware for AI research, so many of PyTorch’s features were built to work specifically with them.

PHP is a server-side programming language so widely used for web applications that it powers roughly 70% of the websites on the internet; by some accounts, that’s more than 33 million sites. It is also used by popular content management systems like WordPress. The NSA warned that these holes are so severe that if a website can’t be patched immediately, it should be pulled off the web until it can be. The holes allow attackers to infiltrate the server’s fil

New open-source benchmark reveals reasoning as the biggest bottleneck for AI in cloud operations Maximilian Schreiner View the LinkedIn Profile of Maximilian Schreiner Nov 4, 2026 CloudOpsBench is a new open-source benchmark that measures how well AI agents handle typical DevOps tasks in the cloud, from fixing services and removing resources to restricting access rights, rolling out updates, and decommissioning projects. Version 1.0 includes 45 tasks on AW

A startling announcement went out earlier this week: Due to recently discovered vulnerabilities in the open source programming language PHP, website owners had to immediately patch their sites — or if they couldn’t update right away, they should take the sites down to be safe. On this week’s episode of TechCrunch’s Equity podcast, Kirsten Korosec, Sean O’Kane, and I discussed the significance of the PHP-ocalypse and whether we’ll see more incidents like th

The companies didn’t disclose the deal amount but said that they will keep Pipecat open source. For the uninitiated, Pipecat is a framework that manages voice and video streams along with other pieces in the pipeline, like speech-to-text (STT), large language models (LLMs), and text-to-speech (TTS) models while reducing latency. Its maker, Daily, provides hosted infrastructure for voice and video calls of any kind. With Pipecat, Deepgram will likely gain a

A single cluster processes about 155 trillion tokens per day, and inference optimization is a battle fought over milliseconds. Author丨Zheng Jiamei Editor丨Cen Feng Yesterday, DeepSeek once again open-sourced a major project on GitHub called DeepInfer.This time, no new model was released. What it made available was the inference engine behind DeepSeek-V4.1-Flash, including core technologies such as MoE expert parallelism, asynchronous batch scheduling, custo

Called Box Content Retrieval, the new feature allows agents to answer queries far more effectively by relying on the embedded metadata created by Nemotron. Box says the upshot for users is faster, more accurate, and less expensive queries. Nvidia’s VP of generative AI software, Kari Briski, told TechCrunch that she expects queries to be answered four times faster, with 20% fewer errors and 90% fewer tokens used. The system will be available to all of Box’s

The inventor of the bitter lesson has a bitter lesson for LLM scaling enthusiasts Matthias Bastian View the LinkedIn Profile of Matthias Bastian Nov 8, 2026 Nano Banana Pro prompted by THE DECODER Key Points Turing Award winner Richard Sutton, author of the influential 2019 essay "The Bitter Lesson," writes in a new post that raw compute alone isn't enough for intelligence. AI science needs clever new methods and is "far from finished." Sutton had already

Google ships four TPU variants in one year as it ramps up competition with Nvidia Maximilian Schreiner View the LinkedIn Profile of Maximilian Schreiner Nov 9, 2026 Nano Banana Pro prompted by THE DECODER Key Points Google is introducing two new systems in its eighth-generation AI chip lineup, the TPU 8tx and TPU 8i Max, both built on existing processors. The TPU 8tx keeps confidential data encrypted during processing, while the TPU 8i Max doubles memory a

@gitmeshi(Git Meshi)The Features of Open Dungeon, a Local AI Role-Playing App, and Key Considerations for AdoptionOSSAILocalLLMprivacy0Posted at 2026-11-09TAG40@@When prototyping story generation or conversational content within a company, there is sometimes a need to avoid sending the settings and character information entered into a cloud API. In validation environments where account registration and API key management should be avoided, or in situations

Zhidx (WeChat official account: zhidxcom) Author | Sanbei Editor | Moying Zhidx reported on November 5 that Baidu officially released and open-sourced ERNIE-5.5-Flash-Base today. The model uses a sparse MoE architecture and has a total of 280B parameters, with only 14B parameters activated per token. It completed pretraining from scratch on 33.5T tokens, with a maximum training context length of 128K, while fine-tuning and inference support a context lengt

AI Takes Over an 80,000-Star Open-Source Company, Handling Everything from Coding and Task Assignment to Debugging 2026-11-09 13:47:58 Source: QbitAI Not Enough Workers? The Supervisor Agent Can Hire on Its Own! Wenting, reporting from Aofeisi QbitAI | WeChat Official Account QbitAI An AI editor-in-chief leads three AI staff writers, each keeping a close eye on cutting-edge large models, open-source projects, and personnel moves at major tech companies. I

Even Professors Are Cutting Corners with Claude… Jay reporting from Aofeisi QbitAI | WeChat Official Account QbitAI AI is ruining my computer science degree. The one who wrote this complaint was a sophomore girl who had dreamed of studying computer science since childhood, Katie. With no prestigious university to her name, she had only managed a B in high school math; she had received no formal professional training before, and the only “project experience

Tenfold Capacity Expansion After Surge in Tencent Hy4 Invocations; No. 1 Among Open-Source Models in Agent Capabilities 2026-11-06 10:00:11 Source: QbitAI On November 5, Tencent announced that WorkBuddy had expanded tenfold in response to a surge in Hy4 invocations On November 5, Tencent announced that WorkBuddy had expanded tenfold in response to a surge in Hy4 invocations, in order to meet the experience and usage needs of more users. Meanwhile, driven b

A Brand-New Computer Virus ay, posted from Aofeisi QbitAI | WeChat Official Account QbitAI Uh-oh. AGENTS.MD is becoming a computer virus of the AI era. You were just casually opening a webpage. You didn’t click any pop-ups, didn’t click any “Download” prompts, and barely moved your hands. The moment you switched away from the webpage, a plain-text file called AGENTS.md had already silently landed in your computer’s “Downloads” (~/Downloads) folder. But at