Tag: open source llm

Open source llm explained — what it is, how it works and what it costs. Below are 20 articles about open source llm on CheapToken News. This is one of the main topics we track on CheapToken News.

Breaking! “Yuan Shen” MiniMax open-sources 3 Image—the strongest open-source model, made in China.

January 12, 2020 | 新智元 aiera
Breaking! “Yuan Shen” MiniMax open-sources 3 Image—the strongest open-source model, made in China.
Xinzhiyuan reports Only a few days after OpenAI launched Images 2.6 on November 4, people were already shouting: GPT is cooked. GPT-6 is completely done for. What has everyone excited is MiniMax's new H3 Image model. Beta tester Emily reported several impressive specs: Up to 16 reference images, prompts of up to 7,500 characters, and output at up to 4K. She also casually placed a bet: based on her understanding of MiniMax, she believed the model would even

Top Two Globally in Open Source, StepFun Is Finally Back

June 5, 2026 | 雷锋网 AI
Top Two Globally in Open Source, StepFun Is Finally Back
Step 5 Preview Returns to the Global Top Tier Author | Wu Haiming Editor | Li Na TAG62@@Cen Feng Two years ago, when StepFun first made its public debut in the foundation-model community, it took the stage by storm with Step 1. Later that same year, it released Step 1V and the trillion-parameter foundation model Step 2 in succession. At the time, the industry still believed that the bigger the model, the more capable it was. Whoever pushed the Scaling Law

Cyberattacks threaten to make open-source AI a little less open, Hugging Face exec warns 

May 10, 2026 | TechCrunch AI
Cyberattacks threaten to make open-source AI a little less open, Hugging Face exec warns 
Loading the player… The very qualities that make open AI platforms valuable, like open doors and rich data, might also make them vulnerable to more hacks, Irene Solaiman, chief policy officer and SVP of strategy at Hugging Face said on a recent episode of the Equity podcast. The October attack on OpenCode, which targeted users’ third-party API keys and caused financial damage, is the latest example. It follows an incident this summer in which an OpenAI age

Meituan Open-Sources Its 1.6-Trillion-Parameter Large Model! Cumulative Token Usage Surpasses 100 Billion, Ranking First in Four Tests

April 24, 2019 | 智东西
Meituan Open-Sources Its 1.6-Trillion-Parameter Large Model! Cumulative Token Usage Surpasses 100 Billion, Ranking First in Four Tests
Zhidx (WeChat public account: zhidxcom) Author | Sun Xiaowen Editor | Cheng Qian Zhidx reported on November 10 that Meituan's LongCat team open-sourced the native multimodal model LongCat-2.5 last night. According to OpenCode's public data, as of noon today, LongCat-2.5'scumulative token usage on the platform had reached approximately 109 billion, with around 4,700 unique users and about 50,000 sessions completed. ▲LongCat-2.5's public data on OpenCode (Im

Nvidia strengthens open-source strategy with SchedMD acquisition

November 2, 2021 | The Decoder
Nvidia strengthens open-source strategy with SchedMD acquisition
Nvidia strengthens open-source strategy with SchedMD acquisition Maximilian Schreiner View the LinkedIn Profile of Maximilian Schreiner Dec 16, 2025 AI News Without the Hype – Curated by Humans Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section. Subscribe now { "@context": "https://schema.org", "@type": "NewsArticle", "headli

Google has joined Amazon in attacking Nvidia’s stronghold with AI app developers

May 2, 2023 | TechCrunch AI
Google has joined Amazon in attacking Nvidia’s stronghold with AI app developers
PyTorch is the popular open source toolkit that AI app developers and startups use to build, train, and run AI models. It is, by some accounts, used by 85% of the AI apps. PyTorch was originally developed by Meta (then Facebook) in 2016, long before the world had an inkling that LLMs would change the world. At the time, Nvidia’s GPUs were already the standard hardware for AI research, so many of PyTorch’s features were built to work specifically with them.

PHP Armageddon: OpenAI, Google’s Wiz find ancient holes, panicking the internet

June 15, 2016 | TechCrunch AI
PHP Armageddon: OpenAI, Google’s Wiz find ancient holes, panicking the internet
PHP is a server-side programming language so widely used for web applications that it powers roughly 70% of the websites on the internet; by some accounts, that’s more than 33 million sites. It is also used by popular content management systems like WordPress. The NSA warned that these holes are so severe that if a website can’t be patched immediately, it should be pulled off the web until it can be. The holes allow attackers to infiltrate the server’s fil

New open-source benchmark reveals reasoning as the biggest bottleneck for AI in cloud operations

February 7, 2023 | The Decoder
New open-source benchmark reveals reasoning as the biggest bottleneck for AI in cloud operations
New open-source benchmark reveals reasoning as the biggest bottleneck for AI in cloud operations Maximilian Schreiner View the LinkedIn Profile of Maximilian Schreiner Nov 4, 2026 CloudOpsBench is a new open-source benchmark that measures how well AI agents handle typical DevOps tasks in the cloud, from fixing services and removing resources to restricting access rights, rolling out updates, and decommissioning projects. Version 1.0 includes 45 tasks on AW

Will AI expose the rickety infrastructure of the internet?

September 6, 2024 | TechCrunch AI
Will AI expose the rickety infrastructure of the internet?
A startling announcement went out earlier this week: Due to recently discovered vulnerabilities in the open source programming language PHP, website owners had to immediately patch their sites — or if they couldn’t update right away, they should take the sites down to be safe. On this week’s episode of TechCrunch’s Equity podcast, Kirsten Korosec, Sean O’Kane, and I discussed the significance of the PHP-ocalypse and whether we’ll see more incidents like th

Deepgram acquires Pipecat-maker Daily to bolster its voice AI infrastructure

April 15, 2025 | TechCrunch AI
Deepgram acquires Pipecat-maker Daily to bolster its voice AI infrastructure
The companies didn’t disclose the deal amount but said that they will keep Pipecat open source. For the uninitiated, Pipecat is a framework that manages voice and video streams along with other pieces in the pipeline, like speech-to-text (STT), large language models (LLMs), and text-to-speech (TTS) models while reducing latency. Its maker, Daily, provides hosted infrastructure for voice and video calls of any kind. With Pipecat, Deepgram will likely gain a

DeepSeek Unveils Another Open-Source Powerhouse! How Much Technical Wizardry Is Hidden in DeepInfer?

July 1, 2020 | 雷锋网 AI
DeepSeek Unveils Another Open-Source Powerhouse! How Much Technical Wizardry Is Hidden in DeepInfer?
A single cluster processes about 155 trillion tokens per day, and inference optimization is a battle fought over milliseconds. Author丨Zheng Jiamei Editor丨Cen Feng Yesterday, DeepSeek once again open-sourced a major project on GitHub called DeepInfer.This time, no new model was released. What it made available was the inference engine behind DeepSeek-V4.1-Flash, including core technologies such as MoE expert parallelism, asynchronous batch scheduling, custo

Box taps Nvidia’s Nemotron for new agent-first content retrieval system

June 17, 2023 | TechCrunch AI
Box taps Nvidia’s Nemotron for new agent-first content retrieval system
Called Box Content Retrieval, the new feature allows agents to answer queries far more effectively by relying on the embedded metadata created by Nemotron. Box says the upshot for users is faster, more accurate, and less expensive queries. Nvidia’s VP of generative AI software, Kari Briski, told TechCrunch that she expects queries to be answered four times faster, with 20% fewer errors and 90% fewer tokens used. The system will be available to all of Box’s

The inventor of the bitter lesson has a bitter lesson for LLM scaling enthusiasts

September 13, 2022 | The Decoder
The inventor of the bitter lesson has a bitter lesson for LLM scaling enthusiasts
The inventor of the bitter lesson has a bitter lesson for LLM scaling enthusiasts Matthias Bastian View the LinkedIn Profile of Matthias Bastian Nov 8, 2026 Nano Banana Pro prompted by THE DECODER Key Points Turing Award winner Richard Sutton, author of the influential 2019 essay "The Bitter Lesson," writes in a new post that raw compute alone isn't enough for intelligence. AI science needs clever new methods and is "far from finished." Sutton had already

Google ships four TPU variants in one year as it ramps up competition with Nvidia

December 4, 2021 | The Decoder
Google ships four TPU variants in one year as it ramps up competition with Nvidia
Google ships four TPU variants in one year as it ramps up competition with Nvidia Maximilian Schreiner View the LinkedIn Profile of Maximilian Schreiner Nov 9, 2026 Nano Banana Pro prompted by THE DECODER Key Points Google is introducing two new systems in its eighth-generation AI chip lineup, the TPU 8tx and TPU 8i Max, both built on existing processors. The TPU 8tx keeps confidential data encrypted during processing, while the TPU 8i Max doubles memory a

Features and Adoption Decision Points for the Local AI Role-Playing App Open Dungeon #OSS - Qiita

January 30, 2016 | Qiita AI
Features and Adoption Decision Points for the Local AI Role-Playing App Open Dungeon #OSS - Qiita
@gitmeshi(Git Meshi)The Features of Open Dungeon, a Local AI Role-Playing App, and Key Considerations for AdoptionOSSAILocalLLMprivacy0Posted at 2026-11-09TAG40@@When prototyping story generation or conversational content within a company, there is sometimes a need to avoid sending the settings and character information entered into a cloud API. In validation environments where account registration and API key management should be avoided, or in situations

280B total parameters, 14B activated! Baidu open-sources ERNIE 5.5 Flash Base, achieving SOTA at the same scale

July 12, 2021 | 智东西
280B total parameters, 14B activated! Baidu open-sources ERNIE 5.5 Flash Base, achieving SOTA at the same scale
Zhidx (WeChat official account: zhidxcom) Author | Sanbei Editor | Moying Zhidx reported on November 5 that Baidu officially released and open-sourced ERNIE-5.5-Flash-Base today. The model uses a sparse MoE architecture and has a total of 280B parameters, with only 14B parameters activated per token. It completed pretraining from scratch on 33.5T tokens, with a maximum training context length of 128K, while fine-tuning and inference support a context lengt

AI takes over an 80,000-star open-source company, handling everything from writing code and assigning tasks to finding bugs.

June 24, 2020 | QbitAI 资讯
AI takes over an 80,000-star open-source company, handling everything from writing code and assigning tasks to finding bugs.
AI Takes Over an 80,000-Star Open-Source Company, Handling Everything from Coding and Task Assignment to Debugging 2026-11-09 13:47:58 Source: QbitAI Not Enough Workers? The Supervisor Agent Can Hire on Its Own! Wenting, reporting from Aofeisi QbitAI | WeChat Official Account QbitAI An AI editor-in-chief leads three AI staff writers, each keeping a close eye on cutting-edge large models, open-source projects, and personnel moves at major tech companies. I

“AI ruined my computer science degree”

November 15, 2015 | QbitAI 资讯
“AI ruined my computer science degree”
Even Professors Are Cutting Corners with Claude… Jay reporting from Aofeisi QbitAI | WeChat Official Account QbitAI AI is ruining my computer science degree. The one who wrote this complaint was a sophomore girl who had dreamed of studying computer science since childhood, Katie. With no prestigious university to her name, she had only managed a B in high school math; she had received no formal professional training before, and the only “project experience

Tencent Hy4 Sees Surging Usage, Expands Capacity Tenfold, and Tops Open-Source Models in Agent Capabilities

September 25, 2024 | QbitAI 资讯
Tencent Hy4 Sees Surging Usage, Expands Capacity Tenfold, and Tops Open-Source Models in Agent Capabilities
Tenfold Capacity Expansion After Surge in Tencent Hy4 Invocations; No. 1 Among Open-Source Models in Agent Capabilities 2026-11-06 10:00:11 Source: QbitAI On November 5, Tencent announced that WorkBuddy had expanded tenfold in response to a surge in Hy4 invocations On November 5, Tencent announced that WorkBuddy had expanded tenfold in response to a surge in Hy4 invocations, in order to meet the experience and usage needs of more users. Meanwhile, driven b

AGENTS.MD, DANGER DANGER DANGER!!!

April 6, 2020 | QbitAI 资讯
AGENTS.MD, DANGER DANGER DANGER!!!
A Brand-New Computer Virus ay, posted from Aofeisi QbitAI | WeChat Official Account QbitAI Uh-oh. AGENTS.MD is becoming a computer virus of the AI era. You were just casually opening a webpage. You didn’t click any pop-ups, didn’t click any “Download” prompts, and barely moved your hands. The moment you switched away from the webpage, a plain-text file called AGENTS.md had already silently landed in your computer’s “Downloads” (~/Downloads) folder. But at