Infrastructure/Cloud Computing

Replacing a $3000/mo Heroku bill with a $55/mo server

A technical discussion on migrating from expensive cloud platforms to cost-effective self-hosted solutions, including memory management and OOM prevention strategies.
Signal Editorial Team
4 min read
Artificial Intelligence › Large Language Models

Getting AI to work in complex codebases

Discussion on the challenges and limitations of using LLMs for code generation in production environments, exploring determinism concerns.
Signal Editorial Team
3 min read
Artificial Intelligence › Machine Learning

Markov Chains: The Original Language Models

Exploring how Markov chains serve as foundational language models and their relationship to modern LLMs through temperature control and state transitions.
Signal Editorial Team
3 min read
Artificial Intelligence › Large Language Models

Sampling and Structured Outputs in LLMs

Discussion of advanced techniques for constraining LLM outputs using structured generation libraries like Guidance and LLGuidance.
Signal Editorial Team
3 min read
Artificial Intelligence › Large Language Models

Engineering AI Systems That Endure: Beyond the Bitter Lesson

How to build reliable AI systems while navigating the rapid pace of LLM evolution and the tension between domain knowledge and scalable methods.
Signal Editorial Team
4 min read