Pranjal Rawat

Pranjal Rawat

Applied Scientist, Uber · PhD, Georgetown Economics

Hi, I'm Pranjal

I'm an incoming Applied Scientist at Uber working on algorithmic pricing in the Delivery Marketplace. I have a PhD in Econometrics and Quantitative Economics from Georgetown University and three years of full-time work experience in applied and data science (Amex, RecSys).

My research interests lie in ML-powered scalable methodologies for causal inference & experimentation, choice & preference modelling, reinforcement learning & dynamic programming, and optimization problems.

During my PhD, my advisors were John Rust and Nathan Miller and I also interned/worked with the following tech firms: Roblox, Uber and Topsort. Before my PhD, I worked as an Assistant Manager (Data Science) at American Express for 3 years on productionalizing marketing rec-sys and graph embedding systems. Before that, I worked on time series econometrics during my first Masters and at the Reserve Bank of India.

I serve as a reviewer for Control and Cybernetics.

A Deep Learning Approach to Heterogeneous Consumer Aesthetics in Fast Fashion

FashionCLIP embeddings and a demand model on millions of H&M purchases. Recovers price and taste sensitivity.

Who is more Bayesian: Humans or ChatGPT?

Humans vs. ChatGPT on binary classification. Documents bias and version drift. With John Rust, Chengjun Zhang, Tianshi Mu, Aaron Zhong.

Algorithmic Collusion in Auctions

Controlled lab experiments measuring bid suppression across Q-learning, bandits, and pacing. WEAI 2025.

Approximating Auction Equilibria with Reinforcement Learning

PPO learns bidding strategies in multi-item and dynamic auctions.

A Survey of Reinforcement Learning for Economics

RL methods for economic problems with high-dimensional states and continuous actions.

Dynamic Discrete Choice and Inverse Reinforcement Learning

Inferring preferences and beliefs from human behavior. Forthcoming, Oxford Research Encyclopedia of Economics and Finance, with John Rust.

The monograph, its code and slides, and a package for dynamic choice estimation.

Monograph

A Survey of Reinforcement Learning for Economics

291 pages of RL methods for economic problems, with a worked simulation in every chapter.
Chapters

1. Introduction

Why sequential decision problems in economics are hard.

2. Two Cultures of Sequential Decision-Making

Translating between the inference tradition and the control tradition.

3. A Brief History of Reinforcement Learning

From animal conditioning and optimal control to deep RL.

4. Reinforcement Learning Algorithms

Dynamic programming, temporal differences, policy gradients, and their convergence theory.

5. The Empirics of Deep Reinforcement Learning

What happens when you actually train deep RL.

6. Structural Estimation with Reinforcement Learning

RL as a numerical method inside the estimation loop.

7. Reinforcement Learning for Macroeconomic Models

Deep RL as a solver for representative and heterogeneous agent models.

8. Reinforcement Learning in Games

Coase conjecture, counterfactual regret minimisation, multi-agent Cournot and Bertrand.

9. Bandits and Dynamic Pricing

Regret, exploration, and demand learning under price experimentation.

10. Offline Reinforcement Learning

Learning a policy from logged data alone.

11. RLHF and AI Alignment

Preference learning as discrete choice.

12. Causal Inference for Reinforcement Learning

Confounded off-policy evaluation, sensitivity, instruments and proxies.

13. Reinforcement Learning for Causal Inference

Dynamic treatment regimes and double machine learning.

14. Quantile, Robust and Constrained Reinforcement Learning

Risk-sensitive, robust, and constrained control.

15. World Models and Model-Based Reinforcement Learning

Planning through a learned model.

16. Reinforcement Learning in the Field

Primary-source accounts of deployed systems.

17. Discussion

Where the two cultures meet.

Appendix A. Mathematical Preliminaries

The theory a graduate reader needs, each result illustrated by a simulation.
Code

survey-of-reinforcement-learning-in-economics

Every figure in the monograph comes from a script here. 62 simulations, MIT licensed.
Software

EconIRL

Dynamic discrete choice and inverse reinforcement learning, with standard errors.
Related work

Dynamic Discrete Choice and Inverse Reinforcement Learning

Inferring preferences and beliefs from behavior. Oxford Research Encyclopedia, with John Rust.

Algorithmic Collusion in Auctions

Lab experiments measuring bid suppression across Q-learning, bandits, and pacing.

Approximating Auction Equilibria with Reinforcement Learning

PPO learns bidding strategies in multi-item and dynamic auctions.

Notes on economics, machine learning, and whatever I'm reading. Subscribe →

'26
Jun
'26
May
'26
Apr
'26
Mar
'25
Nov
'25
Nov
'25
May
'25
Feb
'25
Jan
'25
Jan
'24
Oct
'24
Sep

TechEcon live site →

A Netflix-like website and digital library of resources for Econ PhD students, early-career economists and data scientists working in US tech industry. This aggregator site contains: a) Econometrics, Statistics, & ML packages (Python, R), b) Large industrial datasets from real firms, c) Learning resources, "getting started" roadmaps, d) YT series & podcasts, bloggers, events & conferences near you.

DeepInference

A Python package that implements the deep-learning-based estimators from Farrell, Liang, and Misra (2021, 2025), which combines the interpretability of classic statistical models (Logit, Poisson, etc.) with the representational power of deep nets, allowing parametric inference and capturing rich HTEs over high-dim covariates, images, text, sequences, and more.

PrefGraph

A Python package that implements revealed preference graph algorithms from leading papers in Microeconomics and Optimization to compute consistency and exploitability scores, and recover reward/utility functions from user choices from budgets, menus, lotteries, comparisons, etc.

EconIRL PyPI · docs

A Python package that implements SOTA dynamic discrete choice and inverse reinforcement learning algorithms to help us understand and predict users' sequential choices.

Interactive Pricing Theory live site →

18 interactive tracks teaching pricing and revenue optimization through visualizations, full mathematical formulations, and hands-on simulators, drawing on Phillips' Pricing and Revenue Optimization.

econometrics-in-python ★ 61

A guide to the econometrics package ecosystem in Python, mapping the tools for each method to working code.

industry-datasets ★ 54

A curated catalogue of large datasets released by real firms, for empirical research and teaching.

computational-economics ★ 40

Computational methods and notebooks for solving richer economic models than closed-form theory allows.