Dhruv Madeka is a Research Engineer at Google DeepMind working on Gemini pre-training. His current research focuses on Large Language Modeling. Before that, Dhruv was a Principal Machine Learning Scientist at Amazon working on applying Deep Reinforcement Learning to inventory management problems. Dhruv has also worked on developing generative and supervised deep learning models for probabilistic time series forecasting. In the past - Dhruv worked in the Quantitative Research team at Bloomberg LP, developing open source tools for the Jupyter Notebook and conducting advanced mathematical research in derivatives pricing, quantitative finance and forecasting.