3 year commit pricing with Jetstream + Maxtext on TPU v5e is $0.25 per million t...

		kiratp on June 14, 2024 \| parent \| context \| favorite \| on: Cost of self hosting Llama-3 8B-Instruct 3 year commit pricing with Jetstream + Maxtext on TPU v5e is $0.25 per million tokens. On demand pricing put it at about $0.45 per million tokens. Source: We use TPUs at scale at https://osmos.io Google Next 2024 session going into detail: https://www.youtube.com/watch?v=5QsM1K9ahtw https://github.com/google/JetStream https://github.com/google/maxtext