Back to feed
News
Now (0-6 months)
January 7, 2026

LLMs contain a LOT of parameters. But what’s a parameter?

6 days agoMIT Technology Review AI

Summary

MIT Technology Review Explains: Let our writers untangle the complex, messy world of technology to help you understand what’s coming next. You can read more from the series here. I am writing this because one of my editors woke up in the middle of the night and scribbled on a bedside notepad: “What is a…

Impact Areas

cost
strategic

Sector Impact

In the frontier model sector, this foundational knowledge allows researchers and developers to critically evaluate architectural improvements, parameter-efficient training techniques, and scaling strategies. A deeper comprehension of parameters facilitates the creation of more powerful, yet resource-conscious, AI models pushing the boundaries of what's possible.

Analysis Perspective

Analysis for this perspective will be generated once content ingestion is set up.

Companies Mentioned
Technologies
LLM
Transformers