Language Models

When Bigger Models Perform Worse: Brevity Constraints Reverse Performance Hierarchies in Language Models

Research reveals that larger language models underperform smaller ones on 7.7% of benchmark problems due to overthinking, but brevity constraints can reverse these performance gaps and unlock superior capabilities in …

AI · Development Editorial Team

Apr 12 arxiv.org 3 min read

Scaling Latent Reasoning via Looped Language Models

This paper introduces Ouro, a family of Looped Language Models (LoopLM) that achieve 2-3× parameter efficiency by implementing iterative computation through shared parameters and adaptive depth allocation, demonstrating …

AI · Architecture Editorial Team

Feb 2 arxiv.org 3 min read

GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning

GEPA introduces a novel prompt optimization approach that uses natural language reflection and Pareto-based evolutionary search to optimize compound AI systems, achieving superior performance compared to reinforcement …

AI · Development Editorial Team

Sep 25 news.ycombinator.com 3 min read

Markov Chains: The Original Language Models

Markov Chains: The Original Language Models Markov chains represent the foundational approach to language modeling that predates modern LLMs by decades. Understanding their mechanics reveals both the evolution of text …

Artificial Intelligence › Machine Learning · Development › Programming Editorial Team

Sep 18 youtu.be 6 min read

Building Character-Level Language Models: From Bigrams to GPT-2

Building Character-Level Language Models: From Bigrams to GPT-2 Character-level language models predict the next character in a sequence by learning patterns from training data. This tutorial builds these models …

Artificial Intelligence › Deep Learning · Artificial Intelligence › Natural Language Processing Editorial Team