SDKs, inference APIs, local runners, vector databases, observability and fine-tuning libraries. Many are free or open source, so compare the usage unit you pay for.
Showing 50 of 106 · open a row for its score breakdown
About AI coding tools
AI development tools are the plumbing behind AI features: SDKs for calling models (Vercel AI SDK), gateways and inference APIs (Openrouter, Groqcloud, Fireworks), local model runners (Ollama), vector databases (Pinecone, Milvus Cloud), observability (Langfuse, Helicone) and fine-tuning libraries (Axolotl, Peft). It is among the most free-friendly corners of the AI section: 89 of the 106 have a free plan or open-source license, and many of the leaders score above 8 in our reviews. The bill usually comes from usage instead, whether tokens, requests, traces or GPU time, so compare the pricing unit rather than the plan name.
What to compare before you choose
The unit you pay for
Few tools here charge a simple subscription: most bill per token, request, trace or seat. GitHub, for example, charges per user ($4 Team, $21 Enterprise), while gateways and observability tools meter usage. Model spend on your expected volume, not the entry price.
Open source or managed
Open-source libraries cost nothing to license, but you supply the compute and the operations work, while managed services charge for hosting, scaling and support. Our reviews flag several open-source tools for teams without GPU access or the in-house skills to run their dependencies.
Language and stack fit
The Vercel AI SDK is TypeScript-first, and our reviews flag it and Vercel AI for Python-first ML workflows. Check your language, framework and deployment target before comparing features, because switching stacks later costs more than any subscription.
Questions about AI development software
Is Openrouter cheaper than paying model providers directly?
Per token it costs the same, because Openrouter passes model prices through with no markup; the difference is a 5.5% fee when you buy credits. In return you get a single API for many models, which is why our review rates it best for developers who route between providers and scores it 8.5, with 9 for ease. If you use a single provider and do not need routing, going direct avoids the fee.
Can Ollama replace a paid LLM API in production?
Usually not for production traffic. Ollama is free under the MIT license and scores 8.5, and our review rates it best for developers running open LLMs locally for development and prototyping. It flags high-concurrency production serving, where a dedicated inference engine is the better choice, and machines without enough RAM or GPU for larger models. An optional cloud Pro plan starts at $20/mo.
What does Langfuse cost if you self-host it?
The open-source version costs nothing to license, but you run the infrastructure, and our review flags Langfuse for teams unwilling to operate ClickHouse, which self-hosting requires. The managed cloud has a free plan with 50K units a month, and Core costs $29/mo. Langfuse scores 8.4 in our review and is rated best for AI teams that want open-source LLM observability with a cloud option.
Do you need a GPU to fine-tune an open LLM with Axolotl or Peft?
Yes. Both are free, Apache 2.0-licensed libraries, but training needs GPU compute, either your own or rented from a cloud provider, and our review flags Axolotl for teams without it. Peft's parameter-efficient methods are designed to make fine-tuning possible on consumer GPUs, but it assumes an existing PyTorch or Transformers workflow. Axolotl targets ML engineers fine-tuning open-weight models such as Llama, Mistral and Gemma.