
Large Language Models (LLMs) have become indispensable tools for diverse natural language processing (NLP) tasks. Traditional LLMs operate at the token level, generating output one word or subword at a time. However, human cognition works on multiple levels of abstraction, enabling deeper analysis and creative reasoning. Addressing this gap, in a new paper Large Concept Models: Language Modeling in a Sentence Representation Space, a research team at Meta i