Papers

If you have ever spent time in the comment section of a social media platform, you have likely encountered an argument that just felt wrong. It wasn’t necessarily that the facts were incorrect, but rather that the way the dots were connected didn’t make sense. Perhaps someone argued, “If we don’t ban all cars immediately, the planet is doomed.” You know this is an extreme stance that ignores middle-ground solutions, a classic False Dilemma. Or maybe you read, “My uncle ate bacon every day and lived to be 90, so bacon is healthy.” This is a Faulty Generalization—taking a single data point and applying it to the whole population. ...

Introduction The artificial intelligence landscape has been irrevocably changed by Large Language Models (LLMs) like ChatGPT and LLaMA. These models possess incredible capabilities, but they have a massive hunger for data. Traditionally, training or fine-tuning these giants requires aggregating massive datasets into a centralized server. However, in the real world, data doesn’t live in a single data center. It lives on our phones, our laptops, and in decentralized local servers—often protected by stringent privacy regulations like GDPR. ...

When you are faced with a complex problem that requires multiple steps to solve, how do you approach it? Psychological research suggests that humans often start with “heuristics”—mental shortcuts or shallow associations. If you are looking for your keys, you might first look on the kitchen counter simply because “keys often go there,” not because you remember putting them there. However, as you eliminate options and get closer to the solution, your thinking shifts. You become more rational, deducing exactly where you must have been last. ...

If you have played with recent Large Vision-Language Models (LVLMs) like GPT-4V, LLaVA, or InstructBLIP, you’ve likely been impressed. You can upload a photo of a messy room and ask, “What’s on the table?” or upload a meme and ask, “Why is this funny?” and the model usually responds with eerie accuracy. These models have bridged the gap between pixels and text, allowing for high-level reasoning and captioning. However, there is a catch. While these models are excellent generalists, they are surprisingly poor specialists. If you upload a photo of a bird and ask, “Is this a bird?”, the model says yes. But if you ask, “Is this a Cerulean Warbler or a Black-throated Blue Warbler?”, the model often falls apart. ...

Introduction In the rapidly evolving world of Artificial Intelligence, Multimodal Large Language Models (MLLMs) like GPT-4V have dazzled us with their ability to chat about images. You can upload a photo of your fridge, and the model can suggest recipes. However, beneath this conversational fluency lies a persistent issue: visual grounding. When you ask a model to pinpoint the exact location of “the red mug to the left of the blue book,” it often struggles. Instead of truly “seeing” the spatial relationships, many models rely on linguistic probabilities—essentially guessing based on word associations rather than visual evidence. This leads to hallucinations, where the model confidently identifies an object that isn’t there or misinterprets complex instructions. ...

Large Language Models (LLMs) are voracious readers. During their pre-training phase, they consume massive datasets scraped from the open web. While this allows them to learn grammar, reasoning, and world knowledge, it also means they inadvertently memorize sensitive information—ranging from Personally Identifiable Information (PII) to toxic hate speech. This poses a significant security and ethical dilemma. If a model memorizes a user’s address or internalizes harmful biases, how do we remove that specific knowledge? The traditional approach would be to scrub the dataset and retrain the model from scratch. However, for models with billions of parameters, retraining is prohibitively expensive and time-consuming. ...

Introduction Imagine you are a college student about to take a difficult exam on a subject you have never studied before—perhaps Advanced Astrophysics or the history of a fictional country. You have two ways to prepare. Option A: You lock yourself in a room for a week before the exam and memorize every fact in the textbook until your brain hurts. Option B: You don’t study at all, but during the exam, you are allowed to keep the open textbook on your desk and look up answers as you go. ...

Introduction In the rapidly evolving world of Large Language Models (LLMs), engineers and researchers often face a dilemma when trying to improve performance: should they spend their time engineering better prompts, or should they collect data to fine-tune the model weights? Conventionally, this is viewed as an “either/or” decision. Prompt engineering is lightweight and iterative, while fine-tuning is resource-intensive but generally more powerful. However, recent research suggests that we might be looking at this the wrong way. What if these two distinct optimization strategies aren’t competitors, but rather complementary steps in a unified pipeline? ...

If you have ever taken a course on Neural Machine Translation (NMT), you likely learned the “Golden Rule” of the field: data is king. To build a system capable of translating between English and German, you traditionally need millions of high-quality, aligned sentence pairs. If you want a multilingual model, you need massive datasets covering every direction you intend to support. But the era of Large Language Models (LLMs) like Llama-2 has shaken the foundations of this dogma. These models have read terabytes of text during pre-training. They have likely seen German, Chinese, and Russian before they ever encounter a specific translation dataset. ...

Introduction Reading is one of the most fundamental skills required to navigate modern society, yet assessing how well someone understands what they read remains a complex challenge. Traditionally, the only practical way to measure reading comprehension is through standardized testing—giving someone a passage and asking them questions afterwards. While effective, this approach has significant limitations. It is “offline,” meaning we only get the results after the reading process is finished. It doesn’t tell us where the reader got confused, when their attention drifted, or how they processed the information in real-time. It is essentially a “black box” approach: text goes in, an answer comes out, and we miss everything that happened in between. ...

How does a society hold itself together? In sociology, the answer is often solidarity—the cohesive bond that unites individuals. But solidarity is not a static concept; it shifts with wars, economic crises, and cultural revolutions. Understanding these shifts requires analyzing millions of words spoken over decades, a task that has historically been impossible for human researchers to perform at scale. In a recent paper, researchers from Bielefeld University and partnering institutions undertook an ambitious project: analyzing 155 years of German parliamentary debates (from 1867 to 2022) to track solidarity towards women and migrants. By combining deep sociological theory with state-of-the-art Large Language Models (LLMs) like GPT-4, they didn’t just automate a reading task—they uncovered profound changes in how political leaders frame empathy, exclusion, and belonging. ...

The Rise of the AI Judge In the rapidly evolving landscape of Artificial Intelligence, we face a bottleneck: evaluation. As Large Language Models (LLMs) become more capable, evaluating their outputs has become prohibitively expensive and time-consuming for humans. If you are developing a new model, you cannot wait weeks for human annotators to grade thousands of responses. The industry solution has been “LLM-as-a-Judge.” We now rely on powerful models, like GPT-4, to grade the homework of smaller or newer models. These “Evaluator LLMs” decide rankings on leaderboards and influence which models get deployed. But this reliance rests on a massive assumption: that the Evaluator LLM actually knows what a good (or bad) answer looks like. ...

Introduction We live in an era of information explosion. Every day, news outlets, social media, and forums are flooded with claims about company performance. “Company X increased its revenue by 20%,” or “Company Y’s debt load has doubled.” For investors and analysts, the stakes of acting on false information are incredibly high. The antidote to misinformation is verification—checking these claims against the original source documents, such as 10-K (annual) and 10-Q (quarterly) reports filed with the SEC. ...

In the fast-moving world of Artificial Intelligence, we often obsess over a single metric: accuracy. We want to know if the model got the answer right. But in high-stakes environments—like healthcare diagnosis, legal analysis, or autonomous driving—being “right” isn’t enough. We also need to know how confident the model is in its decision. Imagine a doctor who is wrong 10% of the time but insists they are 100% sure of every diagnosis. That doctor is dangerous. Similarly, a machine learning model that predicts incorrect outcomes with high confidence is “miscalibrated.” ...

Large Language Models (LLMs) like GPT-4 and LLaMA-2 are linguistic wizards, capable of writing poetry, code, and essays with ease. Yet, ask them a multi-step grade school math problem, and they often stumble. The standard solution to this problem is Chain-of-Thought (CoT) prompting—giving the model a few examples of how to solve similar problems step-by-step before asking it to solve a new one. This is known as few-shot learning. Intuitively, the more examples you show the model, the better it should perform. But there is a hard ceiling: the context window. ...

Training Large Language Models (LLMs) is computationally expensive. Even as we’ve moved from training from scratch to fine-tuning pre-trained models, the cost in terms of time and GPU compute (FLOPs) remains a massive barrier for students and researchers. To mitigate this, the community adopted Parameter Efficient Fine-Tuning (PEFT) methods, with LoRA (Low-Rank Adaptation) being the undisputed champion. LoRA reduces the memory footprint significantly by freezing the main model weights and training only a small subset of parameters. But here is the catch: while LoRA saves memory, it doesn’t necessarily speed up the training process itself by a huge margin. You still have to run thousands of iterations of Stochastic Gradient Descent (SGD). ...

Why Fairer LLMs Make Better Judges: Inside the ZEPO Framework If you have experimented with Large Language Models (LLMs) recently, you likely know that they are not just useful for writing code or generating poems—they are increasingly being used as evaluators. In a world where generating text is cheap but evaluating it is expensive, using an LLM to judge the quality of another LLM’s output (a technique often called “LLM-as-a-Judge”) has become a standard practice. ...

Introduction: The Lazy Student Problem in AI Imagine you are a teacher grading a multiple-choice history exam. You notice a student who gets nearly every answer correct. Impressive, right? But then you look closer. You realize that for every question where the answer is “C,” the question is slightly longer than the others. The student isn’t actually reading the history questions; they have just learned a shortcut: “Long question = Answer C.” ...

We have all been there. You ask ChatGPT or Claude a specific question about a historical event or a niche scientific concept. The answer flows out elegantly, formatted perfectly, and sounds completely authoritative. But then you double-check a date or a name, and you realize: the model made it up. Large Language Models (LLMs) have revolutionized how we search, extract, and integrate information. They free us from having to open twenty tabs to find a simple answer. However, their utility is severely capped by one major flaw: factuality. ...

Introduction Imagine you are planning a road trip. You ask your co-pilot, “How much gas do we have left?” If your co-pilot is a computer, it might say: “We have 14.2 liters remaining in a 50-liter tank.” If your co-pilot is a human, they might say: “We have a small amount left.” Both answers are “correct,” but they operate on different planes of logic. The computer uses precise reasoning, dealing with exact numbers and deterministic rules. The human uses fuzzy reasoning, handling imprecise categories and linguistic ambiguities. While Large Language Models (LLMs) like GPT-4 and Llama-3 have become exceptional at the former—solving complex calculus and coding problems—how good are they at the latter? ...