The leading AI Infra & Developer Tools tools, models and organizations, ranked by an explainable score across popularity, momentum, credibility and ecosystem impact.
| # | Tool | Overall | Pop. | Mom. | Cred. | Eco. |
|---|---|---|---|---|---|---|
| 1 | Patronus AI · Eval An evaluation and testing platform that automatically scores, monitors and stress-tests AI systems and agents. | 78 | 74 | 90 | 74 | 70 |
| 2 | Etched · Inference A startup building Sohu, a transformer-only ASIC aimed at far faster, cheaper LLM inference than GPUs. | 77 | 74 | 87 | 74 | 70 |
| 3 | Predibase · MLOps A platform for fine-tuning and serving small, specialized open-source language models efficiently. | 76 | 74 | 84 | 75 | 70 |
| 4 | d-Matrix · Inference An AI chip startup building in-memory compute accelerators for ultra-low-latency generative inference. | 75 | 74 | 78 | 76 | 70 |
| 5 | OpenRouter · Inference A unified API gateway that routes requests across hundreds of LLMs from many providers. | 75 | 61 | 76 | 84 | 84 |
| 6 | LangSmith · Eval LangSmith — Eval · AI Infra & Developer Tools. | 74 | 58 | 76 | 84 | 84 |
| 7 | NVIDIA · Inference NVIDIA — Inference · AI Infra & Developer Tools. | 72 | 74 | 38 | 98 | 94 |
| 8 | Fireworks AI · Inference A fast, low-cost inference platform for serving open-source and fine-tuned generative models via API. | 72 | 54 | 73 | 84 | 84 |
| 9 | RunPod · Inference A GPU cloud offering on-demand and serverless compute for training and deploying AI models. | 72 | 56 | 87 | 74 | 70 |
| 10 | Together AI · Inference Together AI — Inference · AI Infra & Developer Tools. | 71 | 53 | 73 | 84 | 84 |
| 11 | Langfuse · Observability An open-source LLM engineering platform for tracing, evaluating and monitoring AI applications. | 71 | 52 | 73 | 84 | 84 |
| 12 | LiteLLM · Inference An open-source proxy and SDK that gives a unified, OpenAI-compatible interface to 100+ LLM providers. | 71 | 49 | 90 | 74 | 70 |
| 13 | Unsloth · MLOps An open-source library that makes LLM fine-tuning dramatically faster and more memory-efficient. | 71 | 49 | 90 | 74 | 70 |
| 14 | Replicate · Inference Replicate — Inference · AI Infra & Developer Tools. | 70 | 55 | 64 | 86 | 84 |
| 15 | Modal · Inference Modal — Inference · AI Infra & Developer Tools. | 70 | 52 | 84 | 75 | 70 |
| 16 | Fal.ai · Inference A generative-media inference platform optimized for running image, video and audio models at low latency. | 70 | 54 | 84 | 75 | 70 |
| 17 | Braintrust · Eval An end-to-end platform for evaluating, testing and iterating on LLM applications in development and production. | 70 | 48 | 90 | 74 | 70 |
| 18 | Portkey · Observability An AI gateway and observability layer that routes, caches and monitors calls across LLM providers. | 70 | 46 | 90 | 74 | 70 |
| 19 | Baseten · Inference A platform for deploying and serving machine learning models in production with autoscaling infrastructure. | 69 | 56 | 78 | 76 | 70 |
| 20 | Helicone · Observability An open-source observability platform for logging, monitoring and analyzing LLM API requests. | 69 | 44 | 90 | 74 | 70 |
| 21 | Groq · Inference Groq — Inference · AI Infra & Developer Tools. | 68 | 57 | 55 | 87 | 84 |
| 22 | Weights & Biases · Observability Weights & Biases — Observability · AI Infra & Developer Tools. | 68 | 55 | 58 | 87 | 84 |
| 23 | CoreWeave · Inference A specialized GPU cloud provider delivering large-scale NVIDIA compute for AI training and inference. | 68 | 56 | 58 | 87 | 84 |
| 24 | Arize AI · Observability An ML and LLM observability platform for monitoring, troubleshooting and evaluating models in production. | 68 | 48 | 67 | 85 | 84 |
| 25 | Galileo · Eval An evaluation and observability platform for measuring and improving the reliability of generative AI apps. | 68 | 45 | 84 | 75 | 70 |
| 26 | Lakera · Eval An AI security company protecting LLM applications from prompt injection and other GenAI threats. | 68 | 47 | 84 | 75 | 70 |
| 27 | Unstructured · MLOps A data platform that ingests and transforms unstructured documents into structured data for LLMs and RAG. | 68 | 44 | 87 | 74 | 70 |
| 28 | Anyscale · MLOps The company behind Ray, offering a managed platform for scaling AI training and inference workloads. | 67 | 47 | 64 | 86 | 84 |
| 29 | MLflow · MLOps An open-source platform for managing the ML lifecycle, including experiment tracking and model registry. | 67 | 50 | 61 | 86 | 84 |
| 30 | Scale AI · MLOps A data platform providing labeling, evaluation and RLHF data to train and refine AI models. | 67 | 53 | 55 | 87 | 84 |