Taewoon Kim Taewoon Kim
Blog Contact CV
Archive

Blog

Posts tagged neural-networks.

March 9, 2025 Taewoon Kim

Discrete vs. Continuous: A Tale of Two Approaches to Language Modeling

Balancing n-gram models and neural networks for next-token prediction

Modern Natural Language Processing (NLP) revolves around language modeling —the art of predicting the next token given the previous ones. Formally, if we have a sequence of tokens...

Discrete vs. Continuous: A Tale of Two Approaches to Language Modeling
language-modeling discrete-search neural-networks chain-of-thought
Learn more
Taewoon Kim
Privacy
Email GitHub LinkedIn X YouTube Scholar

This site uses analytics only if you say yes. See the privacy policy for details.