Trends in the Dollar Training Cost of Machine Learning Systems – Epoch

I combine training compute and GPU price-performance data to estimate the cost of compute in US dollars for the final training run of 124 machine learning systems published between 2009 and 2022, and find that the cost has grown by approximately 0.5 orders of magnitude per year.

Introduction to Deep Learning with TensorFlow – Deep Learning 1

Estimating 🌴PaLM's training cost

The Economic Case for Generative AI and Foundation Models

AI Trends – Epoch

Moore No More – (Part IV – Computing Epochs) – —– Thinking Path ——

Levelized cost-based learning analysis of utility-scale wind and

The bigger-is-better approach to AI is running out of road

Navigating the High Cost of AI Compute

Epoch : An essential notion in real-time programming