Home › Best AI tools › LLM APIs & Model Providers
Best AI Tools for Building with llm apis (90 options)
90 tools for building with LLM APIs in the directory. Model APIs, inference platforms and gateways for building with large language models.
How to read this page. We do not rank tools or publish scores. This page lists every LLM APIs & Model Providers tool in the directory with its official link and pricing model so you can shortlist, then try the ones that fit. Pricing labels come from each vendor's pricing page when we could confirm them; "See site" means we could not.
At a glance
- 90 tools listed; 5 free to use, 10 with a free tier, 5 paid, 70 where pricing is not confirmed here.
- With a free plan or tier: Beam, Eden AI, ExLlamaV2, Infermatic, Llamafile, LocalAI, MLC LLM, Modal, Modular MAX, Not Diamond, Portkey, Requesty, Sarvam AI, TensorRT-LLM, Vercel AI Gateway.
What to look for
Compare model choice, context length, rate limits, data-retention terms and how usage is billed, such as per token or per request.
All 90 tools
| Tool | What it does | Pricing | Link |
|---|---|---|---|
| AI/ML API | Single API giving access to hundreds of AI models. | See site | Official site |
| AI21 Labs | AI lab offering the Jamba models and enterprise AI tools. | See site | Official site |
| Alibaba Cloud Model Studio | Alibaba Cloud's platform for accessing and building on Qwen and other models. | See site | Official site |
| Amazon Bedrock | AWS service offering foundation models from multiple providers through one API. | See site | Official site |
| Anthropic API | Anthropic's developer API for the Claude family of models. | See site | Official site |
| Anyscale | Managed platform for running Ray-based AI workloads. | See site | Official site |
| Arcee AI | U.S. lab building open-weight language models, available to download or through an API. | See site | Official site |
| Azure AI Foundry | Microsoft's platform for building and managing AI apps and agents with a catalog of models. | See site | Official site |
| Baseten | Inference platform for deploying and serving AI models. | See site | Official site |
| Beam | Serverless GPU platform for running AI inference, sandboxes and background jobs in Python. | Freemium | Official site |
| Caveman | Cuts AI coding-agent token costs with recoverable context compression and usage tracking. | See site | Official site |
| Cerebras | AI hardware company offering high-speed inference for open models. | See site | Official site |
| Chutes | Decentralized serverless inference platform for running open-source AI models. | See site | Official site |
| Cloudflare AI Gateway | Gateway for caching, rate limiting and observing AI API traffic. | See site | Official site |
| Cloudflare Workers AI | Run AI models on Cloudflare's network via serverless APIs. | See site | Official site |
| Cohere | Enterprise AI company offering language models, embeddings and rerank APIs. | See site | Official site |
| Conifer | LLM gateway and router that picks a model for each request, built for government and enterprise. | See site | Official site |
| CoreWeave | GPU cloud provider for training and running large AI models. | Paid | Official site |
| Crusoe | AI cloud provider offering GPU compute and managed inference. | See site | Official site |
| Databricks Mosaic AI | Databricks' tools for building, serving and governing AI models and agents. | See site | Official site |
| DeepInfra | Hosted inference for open-source models via API. | See site | Official site |
| DeepSeek API | Developer documentation for the DeepSeek model API. | See site | Official site |
| Eden AI | Unified API for many AI providers covering LLMs, speech, vision, translation and document parsing. | Freemium | Official site |
| ExLlamaV2 | Open-source inference library for running LLMs on consumer GPUs. | Free | Official site |
| fal | Generative media platform with API access to image, video and audio models plus serverless GPUs. | See site | Official site |
| Featherless | Serverless inference for a large catalog of open models on Hugging Face. | See site | Official site |
| Fireworks AI | Inference platform for open and fine-tuned generative models. | See site | Official site |
| Fluidstack | AI cloud provider of large GPU clusters for training and inference. | See site | Official site |
| FriendliAI | Inference platform for serving open and custom generative models. | See site | Official site |
| Google AI Studio | Google's web tool and API gateway for prototyping with Gemini models. | See site | Official site |
| Groq | Fast inference platform that runs open models on custom LPU hardware. | See site | Official site |
| Hugging Face | Hub for open models, datasets and apps, with hosted inference. | See site | Official site |
| Hyperbolic | GPU cloud and inference API for open models, with on-demand GPU rentals. | See site | Official site |
| Hyperstack | GPU cloud for AI training and inference with NVIDIA GPUs. | See site | Official site |
| IBM watsonx.ai | IBM's studio for building, tuning and deploying foundation models and AI applications. | Free trial | Official site |
| Inception | Builds Mercury, a family of diffusion-based language models, offered through an API. | See site | Official site |
| Inference.net | Inference platform for running and fine-tuning open models, with batch and real-time APIs. | See site | Official site |
| Infermatic | Hosted inference API for open-source language models. | Freemium | Official site |
| Jarvislabs | GPU cloud for AI training and fine-tuning with on-demand instances. | See site | Official site |
| Kimi API Platform | Developer API platform for Moonshot AI's Kimi large language models. | See site | Official site |
| Kong AI Gateway | AI gateway for governing and securing LLM and MCP traffic. | See site | Official site |
| Lambda | GPU cloud offering on-demand instances and reserved clusters for training and running AI models. | See site | Official site |
| Lepton AI | Serverless GPU inference and model deployment platform. | See site | Official site |
| Lightning AI | Cloud platform for building, training and serving AI models, from the PyTorch Lightning team. | See site | Official site |
| Liquid AI | AI company building efficient foundation models (LFMs) designed to run on devices and in the cloud. | See site | Official site |
| LiteLLM | Open-source gateway for calling many LLM providers through one OpenAI-style interface. | See site | Official site |
| Llama | Meta's family of open-weight models with downloads and developer resources. | See site | Official site |
| Llamafile | Mozilla project that packages LLMs into single-file executables. | Free | Official site |
| LocalAI | Open-source, OpenAI-compatible API for running models locally. | Free | Official site |
| Martian | Model routing that picks among LLMs for each request. | See site | Official site |
| MiniMax | AI company offering text, speech, video and music models through its own apps and a developer API platform. | See site | Official site |
| MLC LLM | Universal LLM deployment engine for running models on many devices. | Free | Official site |
| Modal | Serverless cloud for running AI workloads and model inference. | Freemium | Official site |
| Modular MAX | Inference and serving stack from Modular for running AI models. | Freemium | Official site |
| Munito AI | European LLM inference API for open models, private by default. | See site | Official site |
| Nebius | AI cloud with GPU infrastructure and managed inference. | See site | Official site |
| Not Diamond | Model router that picks the best-suited LLM for each request, plus prompt optimization. | Freemium | Official site |
| Nous Research | Open AI research lab behind the open-weight Hermes models and Hermes Agent. | See site | Official site |
| Novita AI | Cloud platform offering model APIs and GPU instances. | See site | Official site |
| Nscale | AI hyperscaler offering GPU compute and serverless inference for model training and deployment. | See site | Official site |
| NVIDIA NIM | NVIDIA's catalog of model endpoints and microservices for inference. | See site | Official site |
| OpenAI API | OpenAI's developer platform for its language, image, audio and agent APIs. | See site | Official site |
| OpenRelay | AI inference at a flat monthly rate for reserved throughput, plus hourly GPU VMs. | See site | Official site |
| OpenRouter | Unified API that routes requests to many model providers. | See site | Official site |
| OVHcloud AI Endpoints | Serverless API access to open-source AI models from OVHcloud. | See site | Official site |
| Parasail | GPU inference network for running open models through serverless or dedicated endpoints. | Paid | Official site |
| Perplexity API | Perplexity's API for search-grounded answers. | See site | Official site |
| Portkey | AI gateway for routing, observing and governing LLM requests. | Freemium | Official site |
| Reka | AI lab offering multimodal models and APIs. | See site | Official site |
| Replicate | Run and deploy machine learning models through a simple API. | See site | Official site |
| Requesty | LLM gateway and router that gives one API for many model providers with fallbacks and cost controls. | Freemium | Official site |
| RouterPlus | LLM inference and routing that picks models based on your own evals and production traffic, behind one API key. | See site | Official site |
| Runware | Image and video generation inference API for many models. | See site | Official site |
| Sakana AI | Tokyo AI lab building efficient foundation models and multi-model orchestration systems. | See site | Official site |
| SaladCloud | Distributed GPU cloud that runs AI inference on a network of consumer GPUs. | See site | Official site |
| SambaNova | AI infrastructure and inference cloud for open and custom models. | See site | Official site |
| Sarvam AI | Indian AI company offering language, speech and translation models for Indian languages through an API. | Freemium | Official site |
| Scaleway Generative APIs | European serverless API for open-weight LLMs hosted by Scaleway. | See site | Official site |
| Segmind | Serverless API platform for image, video and other generative models, with a workflow builder. | See site | Official site |
| SiliconFlow | Inference cloud offering APIs for many open-source language, image and video models. | Paid | Official site |
| TensorDock | Marketplace for renting cloud GPUs for AI and rendering. | See site | Official site |
| TensorRT-LLM | NVIDIA open library for high-performance large language model inference. | Free | Official site |
| Together AI | Cloud for running, fine-tuning and deploying open-source models. | See site | Official site |
| Upstage | AI company offering Solar language models and document AI APIs. | See site | Official site |
| Vast.ai | Marketplace for renting GPUs from many providers by the hour. | See site | Official site |
| Vercel AI Gateway | Vercel's gateway giving one endpoint for many AI model providers, with usage tracking and fallbacks. | Freemium | Official site |
| Vertex AI | Google Cloud's platform for building and deploying generative AI and ML models. | See site | Official site |
| Vultr | Cloud provider with cloud GPUs and serverless inference for AI workloads. | See site | Official site |
| WaveSpeedAI | Inference API for fast image and video generation models. | See site | Official site |
| xAI API | xAI's developer API for its Grok language, image and voice models, billed by usage. | Paid | Official site |
Related guides
- Alternatives to Requesty
- Requesty vs OpenRouter
- OpenRouter vs LiteLLM
- Groq vs Cerebras
- Together AI vs Fireworks AI
- Replicate vs fal
- Paperspace vs Lambda
Browse the LLM APIs & Model Providers category · All best-of guides