AI Researcher and Engineer

Motivation “Knowledge graph” gets used everywhere. This post pins down a minimal formal meaning, relates it to a widely cited definition from Hogan et al. (2020), and compares RDF...

Motivation: Why On Policy RL Matters for Modern AI If you've been following the latest developments in large language models (LLMs), you've probably heard of GRPO (Group Relative P...

Motivation: Why Do We Need Generative Models? In order to generate data, we need to sample from a distribution. But here, we are not talking about simply sampling from the training...

Modern Natural Language Processing (NLP) revolves around language modeling —the art of predicting the next token given the previous ones. Formally, if we have a sequence of tokens...