Every prompt sent to an AI chatbot results in a chain of physical processes: electrons are moved across silicon, heat is dispersed into water or air and energy was produced somewhere in the power grid to power it. This project focuses on determining the computation cost and therefore power consumption and environmental impact of Large Language Model (LLM) usage.

Students will conduct research, Fermi estimation, and uncertainty propagation to create a first-principles model of the end-to-end cost of LLM inference.

Students should have a strong foundation in a range of physics topics including thermodynamics. Experience in solving Fermi programs, order-of-magnitude estimation and uncertainty analysis are also essential. 

Computer science knowledge is desirable. Experience with Python is also desirable.