Should you grab your umbrella before you walk out the door? Checking the weather forecast beforehand will only be helpful if that forecast is accurate. Spatial prediction problems, like weather forecasting or air pollution estimation, involve predicting the value of…
A lot has changed in the 15 years since Kaiming He was a PhD student. “When you are in your PhD stage, there is a high wall between different disciplines and subjects, and there was even a high wall within…
The ancient Greek philosopher and polymath Aristotle once concluded that the human heart is tri-chambered and that it was the single most important organ in the entire body, governing motion, sensation, and thought. Today, we know that the human heart…
Shreyaa Raghavan’s journey into solving some of the world’s toughest challenges started with a simple love for puzzles. By high school, her knack for problem-solving naturally drew her to computer science. Through her participation in an entrepreneurship and leadership program,…
During a meeting of class 6.C40 (Ethics of Computing), Professor Armando Solar-Lezama poses the same impossible question to his students that he often asks himself in the research he leads with the Computer Assisted Programming Group at MIT: “How do we…
The MIT Stephen A. Schwarzman College of Computing has received substantial support for its striking new headquarters on Vassar Street in Cambridge, Massachusetts. A major gift from Sebastian Man ’79, SM ’80 will be recognized with the naming of a…
Language models have shown great capabilities across various tasks. However, complex reasoning remains challenging as it often requires additional computational resources and specialized techniques. This challenge has motivated the development of inference-time compute (ITC) scaling methods, which allocate additional computational…
The pretraining efficiency and generalization of large language models (LLMs) are significantly influenced by the quality and diversity of the underlying training corpus. Traditional data curation pipelines often treat quality and diversity as separate objectives, applying quality filtering followed by…
Proteins are the workhorses that keep our cells running, and there are many thousands of types of proteins in our cells, each performing a specialized function. Researchers have long known that the structure of a protein determines what it can…
While early language models could only process text, contemporary large language models now perform highly diverse tasks on different types of data. For instance, LLMs can understand many languages, generate computer code, solve math problems, or answer questions about images and…
