Skip to content

Conversation

@hongping-zh
Copy link

Summary

This PR adds the latest NVIDIA GPUs to the calculator:

  • RTX 5090 (Blackwell) - Consumer flagship, 575W TDP, 32GB GDDR7
  • H100 PCIe - Data center GPU, 350W TDP, 80GB HBM3
  • H100 SXM5 - High-performance variant, 700W TDP, 80GB HBM3

Why This Matters

The RTX 5090 is the first consumer Blackwell GPU. We conducted real-world energy benchmarks on it and discovered an important finding for the Green AI community:

Model Config Energy (J/1k Tokens) Change
TinyLlama-1.1B FP16 1659 baseline
TinyLlama-1.1B 4-bit 2098 +26.5% ⚠️
Qwen2-7B FP16 5509 baseline
Qwen2-7B 4-bit 4878 -11.4%

Key Finding: 4-bit quantization increases energy consumption by 26-29% for small models (<3B parameters) on high-performance GPUs, challenging the common assumption that quantization always saves energy.

Data Sources

Related Work

Full benchmark report and calculator available at: https://github.com/hongping-zh/ecocompute-ai

Thank you for maintaining this valuable tool for the Green AI community! 🌱

hongping-zh added a commit to hongping-zh/awesome-green-ai that referenced this pull request Jan 30, 2026
### Summary

This PR adds [EcoCompute AI Calculator](https://hongping-zh.github.io/ecocompute-ai/calculator/) to the Calculation Tools section.

### What is EcoCompute AI?

A free, open-source LLM carbon footprint calculator featuring:
- Real-time training/inference cost and carbon estimation
- Support for multiple GPU types (A100, H100, RTX 5090, etc.)
- **Smart quantization warnings** based on real benchmark data

### Why Add This?

We conducted the **first public energy efficiency benchmark on RTX 5090 (Blackwell)** and discovered:

| Model | FP16 Energy | 4-bit Energy | Change |
|-------|-------------|--------------|--------|
| TinyLlama-1.1B | 1659 J/1k | 2098 J/1k | **+26.5%** ⚠️ |
| Qwen2-7B | 5509 J/1k | 4878 J/1k | **-11.4%** ✅ |

**Key Finding**: 4-bit quantization increases energy consumption for small models (<3B), challenging the assumption that quantization always saves energy.

### Links

- **Calculator**: https://hongping-zh.github.io/ecocompute-ai/calculator/
- **GitHub**: https://github.com/hongping-zh/ecocompute-ai
- **Related PR**: mlco2/impact#60 (adding RTX 5090 data)

Thank you for maintaining this awesome list! 🌱
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant