Key takeaways (as of 12 October 2026)
- Serving: vLLM (Apache-2.0, 93,564 stars, v0.31.0 on 5 Oct 2026) is the default open GPU engine and SGLang the main alternative. Hugging Face's TGI was archived read-only on 21 Mar 2026; do not use it for new work.
- Routing: LiteLLM's MIT proxy is free and already has budgets, rate limits and fallbacks. Hosted routers charge on top of model spend: OpenRouter 5.5% (Standard) or 8% (Business). No vendor's own API processes requests in India; AWS Bedrock's
in.profiles keep calls to the previous Claude generation, Kimi K3 and GPT-5.6 Terra/Luna in India, while the newest models have no documented India processing. - Retrieval: pgvector, Docling (MIT) and open-weight embeddings (Qwen3-Embedding, BGE-M3) carry no licence fees. Hosted parsing costs about $1.25 (LlamaParse basic), $15 (Unstructured) or $10–$40 (Reducto) per 1,000 pages.
- Memory: Mem0 leads on stars (66,978) and disclosed funding ($24M). Audit logs, SSO, SOC 2 and HIPAA BAAs are enterprise-tier features at almost every vendor read, and no vendor page read details retention or PII handling. Claude org owners cannot read members' memories; Microsoft 365 Copilot memories are discoverable in Purview but are not covered by retention policies.
- Ownership churn: Weights & Biases (CoreWeave, $1.0B, May 2025), Invariant Labs (Snyk), Protect AI (Palo Alto Networks, $634.5M, July 2025), Prompt Security (SentinelOne, about $180M, September 2025), Lakera (Check Point), Langfuse (ClickHouse), Helicone (Mintlify; now in maintenance mode), promptfoo (OpenAI) and Traceloop (ServiceNow) have all been acquired or agreed to be acquired since May 2025.
- Licence traps: n8n's Sustainable Use License limits use to "your own internal business purposes or for non-commercial or personal use". Dify may not be run as a multi-tenant service without Dify's written authorisation. Phoenix's ELv2 bans providing it to third parties as a hosted or managed service. Flowise was archived on 13 Aug 2026 and reached end of life on 31 Aug 2026. LM Studio's app terms allow only personal or internal business use and bar SaaS, ASP or service-bureau use. All five were re-read on 12 Oct 2026.
- Voice: Retell's own page puts all-in voice-agent cost at $0.07–$0.31 a minute. Vapi's own page lists a $0.05 a minute platform fee plus component costs, and secondary comparisons put the all-in cost at 2.6–6.2 times that fee. Three vendors publish INR prices (vendor-reported): Sarvam (STT ₹30 an hour, TTS ₹3 per 1,000 characters), Plivo India (calls ₹0.38 and ₹0.25 a minute, transcription ₹0.81 a minute) and Bolna (voice agents ₹5.52 a minute on its pilot plan).
- WhatsApp India: businesses whose Meta Sold-To country is India must move all their WhatsApp Business Accounts (WABAs) to INR billing by 31 Dec 2026, or Meta stops delivering those accounts' messages on 1 Jan 2027. Two vendor pages describe a charge from 1 Oct 2026 for service messages beyond 1,000 free per business phone number a month, at the utility rate (₹0.1150 excluding GST). Meta's own page did not confirm it (vendor-reported).
This document covers the layers around the model, not the agent framework
A model API on its own does not make a production automation. A working deployment also needs something to serve or route model calls, a place to store and search company documents, a parser that turns PDFs and scans into clean text, a memory that persists across sessions, traces and tests that show what the system did, guardrails that screen what goes in and out, and the workflow, voice, messaging and builder tools that connect it all to a business process. This document maps those supporting layers as of 12 October 2026 (licences, prices, deals and India-specific rates were re-checked against primary sources that day), for Indian SMEs, US and global companies, and the IT and operations leaders who run their automation. It leaves out agent SDKs, protocols such as MCP and A2A, coding agents and browser agents, which are covered in Agent frameworks and protocols. GPU choices are in Hardware, unit economics and pricing models in Costs, regulation including India's DPDP Act in Governance, and terms in the Glossary.
Method. GitHub stars, licences, archived flags and latest releases come from the GitHub REST API, queried on 11 Oct 2026. "Latest release" means the release GitHub flags as latest. Sometimes that is a sub-package or SDK tag rather than the product's headline version, and the tables say so where it happens. Prices are list prices read from vendor pricing pages on the same day. They are in USD unless stated otherwise, and INR billing, GST treatment and India-region availability were not confirmed for any USD-priced tool vendor (AWS Bedrock's India routing for model calls is noted under gateways). Labels used throughout: "vendor claim" marks a vendor's own statement about performance or traction; "secondary" marks third-party blogs, trackers or aggregators; "single source" marks a figure that only one source supports. Where research passes disagree, the later reading of a primary page is preferred, and the conflict is shown.
| Layer | Job in production | Open-source default | Hosted default | Main watch-out |
|---|---|---|---|---|
| Inference serving | Runs open-weight models on owned or rented GPUs | vLLM; SGLang | Model provider APIs | TGI archived; no independent 2026 benchmark |
| Gateway / router | One API across providers, with keys, budgets and fallbacks | LiteLLM (MIT core) | OpenRouter, Portkey, Cloudflare AI Gateway | Percentage fees; SSO and audit logs only on enterprise tiers |
| Vector store | Similarity search over embeddings | pgvector; Qdrant | Pinecone; Zilliz; Qdrant Cloud | Monthly minimums; India regions not confirmed |
| Embeddings and rerankers | Turn text into vectors; reorder search results | Qwen3-Embedding; BGE-M3 | Voyage; Cohere; Jina | Indian-language quality untested |
| Document parsing / OCR | PDF, Office files and scans to clean text | Docling; Unstructured; DeepSeek-OCR | Reducto; LlamaParse; Mistral OCR | Per-page cost at volume; Indic scripts untested |
| GraphRAG | Entity graph for multi-hop questions | Microsoft GraphRAG; LightRAG | — | Indexing must be paid again on every corpus change |
| Memory layer | Keeps user and organisation facts across sessions | Mem0; Graphiti; Cognee; Supermemory | Mem0, Zep and Supermemory clouds | Governance only on enterprise tiers |
| Observability and evaluation | Traces, cost, quality tests | Langfuse; promptfoo; DeepEval | LangSmith; Braintrust; Datadog | Ownership changes; Phoenix is ELv2 |
| Guardrails and security | Screen prompts and outputs; scan tools | Llama Guard 4; Prompt Guard 2; Guardrails AI; MCP Scan | Lakera; Prompt Security; HiddenLayer | Acquisitions; Llama licence conditions |
| Workflow and orchestration | Triggers, integrations, durable steps | Activepieces; Windmill; Temporal; Prefect; Airflow; n8n (source-available) | Zapier; Make; Pipedream; Temporal Cloud | n8n licence |
| Voice | Speech-to-text, LLM, text-to-speech and telephony in real time | LiveKit Agents; Pipecat | Vapi; Retell; Bland; Synthflow | All-in cost per minute |
| WhatsApp (India) | Template and service messaging | — | Meta's WhatsApp Business Platform, directly or through a partner (BSP) | INR migration by 31 Dec 2026 |
| Low-code builders | Visual agent and workflow building | Langflow (MIT); Dify (modified Apache) | Botpress; Copilot Studio; Stack AI | Flowise archived; Dify multi-tenant clause |
Serving and routing: one engine to self-host, one gateway in front of everything
vLLM and SGLang lead GPU serving after TGI's archival
vLLM is the engine to evaluate first. It has 93,564 stars and shipped v0.31.0 on 5 Oct 2026 (vLLM release). SGLang, the main challenger, has 36,990 stars and shipped v0.5.21 on 2 Oct 2026. Both are Apache-2.0, so self-hosting has no per-seat fee; the costs are GPU hours and staff time. An earlier research pass cited v0.30.0 (22 Sep 2026) from a Wikipedia snapshot (Wikipedia: vLLM). The GitHub API shows that snapshot is stale, and the API value is used here.
Hugging Face's Text Generation Inference shows what happens when an engine is retired. Its README says TGI "is now in maintenance mode" and will accept only minor bug fixes, documentation and lightweight maintenance. The repository was archived and made read-only on 21 Mar 2026 (banner re-read on 11 Oct 2026), and its last release was v3.3.7 on 19 Dec 2025 (TGI repository; TGI release). TGI's own documentation points users to "vllm, SGLang, as well as local engines with inter-compatibility such as llama.cpp or MLX" (TGI docs). A third-party migration guide dates the switch to maintenance mode to 11 Dec 2025, and sources disagree on whether TGI still gets security fixes (secondary, unverified) (Spheron migration guide). Existing TGI deployments can keep running, but each needs a migration plan.
No independent 2026 benchmark separates the leading engines. The only throughput comparison found is a single secondary benchmark on one A100 80GB configuration. It gave vLLM 2–24x TGI's throughput, while TGI had a lower time-to-first-token at low concurrency, and it has not been reproduced (Markaicode benchmark). Choosing between vLLM, SGLang and TensorRT-LLM therefore comes down to benchmarking each on the target model and hardware.
Above a single node, NVIDIA Dynamo and llm-d take over. NVIDIA announced Dynamo 1.0 as an open-source inference platform, with integrations for llm-d, vLLM, SGLang, LangChain and LMCache and three standalone modules: KVBM (KV-cache memory manager), NIXL (GPU-to-GPU transfer) and Grove (scaling). NVIDIA claims up to 7x higher inference performance on Blackwell (vendor claim) (NVIDIA press release). The March 2026 date for 1.0 comes from secondary coverage, and the current release is v1.5.1, so 1.0 is now an early milestone. llm-d "extends the capabilities of vLLM with Kubernetes-native architecture for large-scale inference deployments" and uses NIXL to move the KV cache between prefill and decode. Its community launched at Red Hat Summit 2025 (NVIDIA Developer Blog). Both add Kubernetes and NVIDIA dependencies, so they are worth adopting only when multi-node or disaggregated serving is a real requirement.
Local runtimes are developer tools rather than production servers. Ollama has 182,754 stars, the most in the category, and Stack Overflow's 2025 survey found that 51% of developers building agents use it (Stack Overflow 2025 AI survey). That figure measures developer reach, not support for multi-tenant production. GPU sizing and hardware cost are covered in Hardware. INR pricing for GPU cloud in Indian data centres was not checked here; India quotes E2E Networks' current H100 rates.
| Engine | Licence | Latest release (date) | GitHub stars | Price | Self-host | Best fit |
|---|---|---|---|---|---|---|
| vLLM | Apache-2.0 | v0.31.0 (5 Oct 2026) | 93,564 | Free; GPU cost only | Yes | General GPU serving; broadest model support |
| SGLang | Apache-2.0 | v0.5.21 (2 Oct 2026) | 36,990 | Free | Yes | High-throughput serving; benchmark against vLLM per model |
| TensorRT-LLM | Apache-2.0 per the LICENSE file (API: NOASSERTION) | v1.2.1 (20 Apr 2026); repo still pushed 11 Oct 2026 | 14,793 | Free; NVIDIA GPUs only | Yes | NVIDIA-tuned latency and throughput |
| NVIDIA Dynamo | Apache-2.0 per the LICENSE file (API: NOASSERTION); the NOTICE says test data under lib/llm/tests/data/deepseek-v3.2 derives from DeepSeek-V3.2 |
v1.5.1 (7 Oct 2026) | 8,258 | Free | Yes, designed for multi-node | Datacenter-scale distributed serving and KV-cache management |
| llm-d | Apache-2.0 | v0.10.0 (29 Sep 2026) | 4,792 | Free | Yes, on Kubernetes | Large-scale Kubernetes serving built on vLLM |
| Ollama | MIT | v0.40.3 (11 Oct 2026) | 182,754 | Local use free; cloud plans $0, $20/mo ($200/yr) and $100/mo (page labels unclear) | Yes | Developer laptops; simplest local runner |
| llama.cpp | MIT | v0.6.0 (5 Oct 2026) | 130,829 | Free | Yes | CPU, edge and quantised (GGUF) inference |
| LocalAI | MIT | v4.11.0 (2 Oct 2026) | 49,472 | Free | Yes | OpenAI-compatible self-hosted API for LLM, vision, voice and image |
| MLX / mlx-lm | MIT / MIT | MLX v0.32.3 (29 Sep 2026); mlx-lm v0.31.3 (22 Apr 2026) | 28,724 / 7,268 | Free | Yes (Apple silicon) | Mac laptops and Mac servers |
| LM Studio | Desktop app under the LM Studio app terms (23 Aug 2026): "solely for Your personal and / or internal business purposes"; bars sublicensing, distribution and "service bureau use, as an application service provider, or a software-as-a-service"; SDK lmstudio-js MIT | No GitHub release | 1,788 (SDK) | Internal business use allowed; no service to third parties | Yes (desktop) | Individual or internal desktop use; not for hosting a service for third parties |
| Hugging Face TGI | Archived 21 Mar 2026 | v3.3.7 (19 Dec 2025) | not recorded | — | Not for new work | Migrate to vLLM or SGLang |
Gateways split between a free MIT proxy and hosted routers that charge 5–8 percent
A gateway gives one API key across model providers and is where budgets, rate limits, fallbacks and logs are enforced. LiteLLM is the open-source default: an MIT core with 60,964 stars, v1.105.0 released on 11 Oct 2026, and an enterprise/ directory under a separate licence (LiteLLM licence; enterprise directory). The free self-hosted tier already includes virtual keys, users and teams, spend tracking, budgets, rate limits, fallbacks and logging. Enterprise is billed annually, "sized to your usage" and "never per token". It adds SSO with SCIM, OIDC/JWT, audit logs, secret-manager integration, RBAC, a multi-region control plane, a 24/7 SLA and air-gapped deployment (LiteLLM pricing). The pricing page still shows 58.8k stars, which the API figure supersedes. Self-hosting is not free in practice: it needs a server or Kubernetes pod, Redis for caching and engineering time. That cost list comes from a competitor's marketing, so it is biased (TKMX AI).
Hosted routers charge as a share of model spend, or else on logs. On $1,000 of monthly model spend, OpenRouter's fee is $55 on Standard or $80 on Business. On $1,000 of credits, Cloudflare's Unified Billing adds $50. (These are computed from list percentages.) The governance features worth paying for are tied to tiers. OpenRouter's in-region routing for the EU and US needs Business. Portkey's VPC deployment, SOC 2 Type 2 and HIPAA BAAs need Enterprise. Self-hosted LiteLLM keeps the whole data path inside your own cloud. Data residency therefore narrows the shortlist more than price does. Portkey's pricing page gives overages as "+$9 per additional 100k requests" while metering the tier in recorded logs, so confirm the unit on a live account. Azure API Management and OpenRouter's data-retention terms were not researched. AWS Bedrock's India-geography cross-region profiles (in. prefix) route only to Mumbai and Hyderabad for Claude Opus 5, Sonnet 5, Haiku 4.5, Kimi K3 and GPT-5.6 Terra/Luna; the newest models (Claude 5.5, GPT-6) are global-only from India. AWS says not to rely on the prefix alone (call GetInferenceProfile) (Bedrock regional availability).
| Gateway | Licence / form | Latest release (date) | GitHub stars | Price (list) | Self-host | Best fit |
|---|---|---|---|---|---|---|
| LiteLLM | MIT core; enterprise/ under separate licence |
v1.105.0 (11 Oct 2026) | 60,964 | Open source $0; Enterprise annual, quoted | Yes; air-gapped on Enterprise | Self-hosted multi-provider proxy with budgets and fallbacks |
| OpenRouter | Hosted service | n/a | n/a | Fee of 5.5% (Standard, pay-as-you-go) or 8% (Business); Enterprise discounts; free tier 50 requests/day | No | Many models without separate provider accounts |
| Portkey | Gateway MIT; hosted control panel | v1.15.2 (12 Jan 2026); repo last pushed 25 May 2026 | 13,166 | Developer free (10k logs/mo, 3-day retention); Production $49/mo (100k logs, +$9 per 100k, 30-day logs, RBAC); Enterprise custom | Yes, on Enterprise | Hosted routing with observability and guardrails built in |
| Kong AI Gateway | Kong Gateway Apache-2.0; AI Gateway is a Konnect product | 3.9.3 (17 Jun 2026) | 44,260 (Kong repo) | Sales-led; promotion of "$100k credits & 50% off AI Gateway" | Yes (self-managed Kong) | Firms already running Kong for APIs |
| Cloudflare AI Gateway | Hosted service | n/a | n/a | Core free (analytics, caching, rate limiting); gateways created from 24 Sep 2026 use Workers Logs pricing; DLP free; guardrails billed as Workers AI tokens (Llama Guard 3 8B); 5% fee on Unified Billing credits | No | Teams on Cloudflare wanting low-cost caching and analytics |
The retrieval layer can start almost free and scale into monthly minimums
Start with pgvector; Pinecone's $50 minimum pays off only on steady traffic
Open-source vector stores are mature and mostly permissively licensed, but managed pricing comes in four shapes that resist like-for-like comparison: monthly minimums plus usage (Pinecone pricing), per-GiB writes and storage (Chroma pricing), cluster resources with a free-forever tier (Qdrant pricing), and minimums with bring-your-own-cloud (BYOC) options (Turbopuffer pricing). For most business projects with a few million vectors, pgvector in a Postgres you already run is the lowest-risk first step. A dedicated store earns its place once filtering, scale or latency demands it, and a monthly minimum is a fixed cost that low-traffic pilots never use up.
Two licence details need attention. Elasticsearch is licensed under AGPL-3.0, SSPL-1.0 or Elastic License 2.0 depending on the directory (Elasticsearch licence). Weaviate is licensed under BSD-3-Clause or the Weaviate License, also by directory (Weaviate licence). Check the directory before either is embedded in a product you ship or one a partner builds for you. Release cadence is also worth checking: Chroma's latest GitHub release dates from 5 May 2026, five months before this snapshot. The vector store is also an attack surface: OWASP's 2025 LLM Top 10 lists "Vector and Embedding Weaknesses" as LLM08 (OWASP LLM Top 10; see Governance). No 2026 independent benchmark of recall or latency was found, and this research did not confirm a managed India region for any vendor. That decides whether a managed store can keep your data in India.
| Store | Licence | Latest release (date) | GitHub stars | Managed price (list) | Self-host | Best fit |
|---|---|---|---|---|---|---|
| pgvector | PostgreSQL License (per LICENSE header) | No GitHub releases | 23,301 | Runs on any managed Postgres | Yes | Existing Postgres apps; small-to-mid corpora |
| Qdrant | Apache-2.0 | v1.19.2 (5 Oct 2026) | 35,033 | Free cluster; paid by resources (rates not captured) | Yes | Filter-heavy search, self-hosted or cloud |
| Milvus / Zilliz | Apache-2.0 (Milvus) | v3.0.2 (20 Sep 2026) | 46,350 | Zilliz: free tier; Serverless from $0 (vCU-based); Dedicated from $126/GB/mo as captured | Yes | Very large corpora; GPU index options |
| Weaviate | BSD-3-Clause or Weaviate License, by directory | v1.40.0 (7 Oct 2026) | 16,875 | Free (100k objects, 1 GB memory, 10 GB disk); Flex from $45/mo; Premium prepaid; embeddings $0.025–$0.065 per 1M tokens | Yes | Hybrid search with built-in vectorisers |
| Chroma | Apache-2.0 | 1.5.9 (5 May 2026) | 29,478 | Starter $0 + $5 credits; write $2.50/GiB; storage $0.33/GiB/mo; query $0.0075/TiB; network $0.09/GiB | Yes | Prototypes and small-to-mid apps |
| LanceDB | Apache-2.0 | v0.40.0 (7 Oct 2026) | 11,638 | Cloud not checked | Yes (embedded library) | Embedded and multimodal data on object storage |
| OpenSearch | Apache-2.0 | 3.9.0 (29 Sep 2026) | 13,844 | Managed via AWS (not checked) | Yes | Hybrid keyword-plus-vector search for existing users |
| Elasticsearch | AGPL-3.0, SSPL-1.0 or ELv2, by directory | v9.5.5 (6 Oct 2026) | 78,226 | Elastic Cloud (not extracted) | Yes | Search-first teams already on Elastic |
| Pinecone | Closed, managed | n/a | n/a | Starter free; Builder $20; Standard $50 min; Enterprise $500 min | BYOC (GA) | Fully managed, low ops |
| Turbopuffer | Closed, managed | n/a | n/a | $16/mo minimum; $256/mo tier; audit log streams +$128/mo; customer-managed encryption keys (CMEK) per namespace from $4,096/mo | BYOC only | Search at scale backed by object storage |
Open-weight embeddings remove per-token fees; hosted ones start at $0.02 per million tokens
Open-weight embedding models are now competitive and permissively licensed. Qwen3-Embedding (0.6B, 4B and 8B) is Apache-2.0, and its model card states the 8B model ranked first on the MTEB multilingual leaderboard "as of June 5, 2025, score 70.58". That is a dated vendor claim and does not describe the 2026 ranking (Qwen3-Embedding-8B card). BGE-M3 is MIT and supports dense, multi-vector and sparse retrieval in 100+ languages, per its card (BGE-M3 card). The current MTEB leaderboard could not be read because it renders in JavaScript (MTEB leaderboard), so no 2026 ranking supports any model choice here.
Among hosted options, Voyage publishes the clearest per-token list prices. Embedding a 1-billion-token corpus once would cost about $20 on voyage-4-lite, $60 on voyage-4 or $120 on voyage-4-large, before the first 200M free tokens (computed from Voyage's per-1M-token list prices) (Voyage pricing). Cohere lists dedicated Embed 5 instances from $2,000 a month; per-token API rates also appear on its page, but their column mapping was unclear (Cohere pricing). Jina publishes rate limits rather than per-token prices in the captured text (Jina embeddings). OpenAI's embedding prices were not in the fetched text of its pricing page (OpenAI pricing). The researchers' working view is that adding a reranker usually buys more quality per dollar than switching embedding models. That is an inference, not a tested result. Retrieval quality for Hindi, other Indic scripts and code-mixed text was not tested for any model, so vendors' multilingual claims should not be read as covering Indian languages. Indian languages covers the Indic benchmarks and embedding options.
| Model / vendor | Form and licence | Version noted | GitHub stars | Price (list) | Self-host | Best fit |
|---|---|---|---|---|---|---|
| Voyage AI | Hosted API | voyage-4-large, voyage-4, voyage-4-lite; rerank-3, rerank-3-lite; voyage-multimodal-3.5 | n/a | $0.12 / $0.06 / $0.02 per 1M tokens; first 200M tokens free; rerank-3 $0.05, rerank-3-lite $0.02; multimodal $0.12 per 1M text tokens plus per-pixel image pricing | No | Low-cost hosted embeddings and reranking |
| Cohere | Hosted API and dedicated deployments | Embed 5 Fast, Embed 5 Pro; Rerank | n/a | Dedicated per month: Embed 5 Fast Small $2,000, Medium $3,250; Embed 5 Pro Small $2,000; per-token mapping unclear | Dedicated instance | Firms wanting a dedicated embedding instance |
| Jina AI | Hosted API; open weights for v5-text and v5-omni (licence not checked) | v5-text small (677M) and nano (239M), 32K context; v5-omni-small (1.6B); Reranker | n/a | Prepaid tokens (rates not extracted); reranker free key 500 RPM / 2M TPM, paid 5,000 RPM / 50M TPM | Partly (GGUF/MLX quantised weights) | High-rate-limit reranking ("SOTA" claims unverified) |
| Qwen3-Embedding | Open weights, Apache-2.0 | 0.6B, 4B, 8B | n/a | Free (self-host) | Yes | Multilingual self-hosted retrieval |
| BGE-M3 (BAAI) | Open weights, MIT | Model card | n/a | Free (self-host) | Yes | Dense, multi-vector and sparse retrieval in one model |
| OpenAI embeddings | Hosted API | Not captured | n/a | Not extracted | No | — |
Document parsing ranges from free to $40 per 1,000 pages
Retrieval can only find what the parser extracted, and the open-source parsers are strong. Docling (MIT, 68,677 stars, v2.137.0 on 9 Oct 2026) converts PDFs and Office files into layout-aware Markdown or JSON, and Unstructured (Apache-2.0) handles ETL-style partitioning and chunking. Both run in-house. Hosted parsers charge per page, and at volume the differences are large. At list prices, 100,000 pages a month cost about $1,350 on Unstructured (90,000 billable pages after the 10,000 free, at $0.015) (Unstructured pricing). The same volume costs $1,000–$4,000 on Reducto, depending on endpoint tier (Reducto pricing), and about $112.50 on LlamaParse's basic mode (90,000 credits after the 10K monthly free credits, at $1.25 per 1,000). Agentic LLM or VLM parsing costs more credits per page (LlamaParse pricing). All three figures are computed from list prices.
Mistral prices OCR per 1,000 pages, but the dollar figure was missing from the fetched text. Batch processing halves the price, and Mistral claims up to 2,000 pages a minute on one node (vendor claim) (Mistral pricing; Mistral OCR). Azure Document Intelligence's page renders in JavaScript (Azure pricing), but the Azure Retail Prices API lists Read at $0.60 or $1.50 per 1,000 pages (two unlabelled rows, unresolved), prebuilt models at $10 and custom models at $30 per 1,000 pages. Google Document AI Enterprise OCR costs $1.50 per 1,000 pages (1,000–5M pages; $0.60 above 5M) (Document AI pricing), and AWS Textract Detect Document Text costs $0.0015 a page for the first 1M (Textract pricing). The sensible default is to start with Docling or Unstructured and add a hosted parser only where accuracy on tables or handwriting falls measurably short. Indic-script OCR (Hindi, Tamil, Bengali) was not tested for any tool, so run a pilot on your own scans before relying on any accuracy claim. Indian-language OCR and document AI, with rupee page prices, are compared in Indian languages.
| Tool | Licence / form | Latest release (date) | GitHub stars | Price (list) | Self-host | Best fit |
|---|---|---|---|---|---|---|
| Docling | MIT | v2.137.0 (9 Oct 2026) | 68,677 | Free | Yes | Layout-aware PDF and Office conversion for RAG |
| Unstructured | Apache-2.0 | 0.27.25 (10 Oct 2026) | 15,558 | 10,000 free pages, then $0.015/page | Yes | ETL-style partitioning and chunking |
| LlamaParse | Commercial ("not open source"); repo MIT; LiteParse is the local OSS parser | llama-cloud-services-py 0.6.94 (13 Feb 2026), an SDK tag | 4,269 | 10K free credits/mo; $50 = 40K credits; $500 = 400K; basic from 1 credit/page | Partly (LiteParse) | Agentic parsing of complex tables and forms |
| Mistral OCR | Hosted API (mistral-ocr-latest) |
n/a | n/a | Per 1,000 pages (figure not captured); batch halves price | No | Fast bulk OCR |
| DeepSeek-OCR | Open weights, MIT | No GitHub release; last push 27 Jan 2026 | 23,926 | Free | Yes | Self-hosted OCR with optical compression |
| Reducto | Closed, hosted | n/a | n/a | $150 free credit; $10, $20 or $40 per 1,000 pages by tier ($40 tier not re-read on 12 Oct; 12 Oct read: Parse from $10, Extract from $20, parse included); migration credits up to $5,000 | No | High-accuracy table and form extraction |
| Azure Document Intelligence | Hosted (Microsoft) | n/a | n/a | Read $0.60 or $1.50 per 1,000 pages (unresolved rows); prebuilt $10; custom $30 (Retail Prices API) | Containers (not checked) | Microsoft-stack shops |
| Google Document AI (Enterprise Document OCR) | Hosted | n/a | n/a | First 1,000 pages free; $1.50 per 1,000 (1K–5M); $0.60 above 5M | No | Google Cloud shops |
| AWS Textract | Hosted | n/a | n/a | Detect Document Text $0.0015 a page (first 1M) | No | AWS shops |
| Sarvam document digitisation | Hosted, INR | n/a | n/a | ₹0.50 a page; extraction ₹1.00 a page (vendor) | No | INR-billed Indian-language documents |
GraphRAG earns its indexing bill only on multi-hop questions
Graph-based retrieval builds an entity-and-relation graph from the corpus. That helps with questions that span several documents, but every chunk costs LLM calls to index, and the cost recurs whenever the corpus changes. Microsoft GraphRAG (MIT, v3.3.0 on 8 Oct 2026) and LightRAG (MIT, 40,068 stars, v1.5.7 on 2 Sep 2026) are the two most-starred open frameworks (GraphRAG; LightRAG). LightRAG describes itself as an EMNLP 2025 paper, and its authors report faster indexing, which was not verified here. Neo4j is the mature graph-database option for GraphRAG pipelines. Its community repository is GPL-3.0, enterprise use requires a commercial licence, and its GitHub "latest release" is a 2017 alpha tag that cannot be used for version tracking (Neo4j). The pattern that fits is a stable, entity-heavy corpus such as contracts, policies or research. For FAQ-style support, GraphRAG usually costs more than plain RAG (inference, not benchmarked). No independent 2026 benchmark comparing GraphRAG with plain RAG on accuracy and cost was found.
The wider "RAG versus long context" debate is moving toward hybrids. A preprint submitted on 6 Oct 2026, UNREAL, uses one model-internal mechanism to select evidence both from a corpus and from inside a long prompt. It reports HotpotQA recall rising from 49.1% to 73.2%, 2WikiMultiHopQA from 31.7% to 60.1%, and NoLiMa accuracy from 1.0% to 24.83% at 128K tokens. It also reports lower FLOPs and time-to-first-token than full-context inference from about 32K tokens upward. These are the authors' own, non-peer-reviewed results (arXiv:2610.08463). The field is active: an arXiv query for "long context" AND RAG returned 249 papers on 11 Oct 2026 (arXiv query). Vendors' own memory features are built on retrieval: Claude's chat-memory search "use[s] Retrieval-Augmented Generation (RAG)" exposed as tool calls (Claude Help Center). The practical default is retrieval first (vector, keyword or hybrid), long context for the top results or for a single long document, and agentic search over an index for open-ended questions. Prompt length still drives cost and latency, so retrieval keeps mattering even as context windows grow.
| Tool | Licence | Latest release (date) | GitHub stars | Price | Self-host | Best fit |
|---|---|---|---|---|---|---|
| Microsoft GraphRAG | MIT | v3.3.0 (8 Oct 2026) | 36,289 | Free; LLM and embedding calls billed by provider | Yes | Reference graph-based RAG |
| LightRAG | MIT | v1.5.7 (2 Sep 2026) | 40,068 | Free | Yes | Lighter GraphRAG alternative |
| Neo4j (community) | GPL-3.0; commercial licence for enterprise | Not usable (2017 alpha tag) | 17,293 | Enterprise pricing not checked | Yes | Graph database under GraphRAG pipelines |
| Graphiti | Apache-2.0 | v0.30.2 (8 Sep 2026) | 31,642 | Free | Yes | Temporal knowledge graph for agent memory |
Memory layers compete on governance, and most of it is unpublished
Open-source memory engines: Mem0 leads on stars and disclosed funding
A memory layer stores facts about users, customers and the organisation so an assistant or agent can use them in later sessions. The open-source field is crowded: Mem0 has 66,978 stars, Cognee 32,012, Graphiti 31,642, Supermemory 31,185, Letta 25,102 and MemOS 11,813. Commercially there are two patterns. One is a venture-funded managed service (Mem0, Zep). The other is a deploy-anywhere open-source engine that sells enterprise support, BYOC or air-gapped installs (Cognee, Supermemory).
Funding is verified only for Mem0. TechCrunch reported $24M in total, a $3.9M seed plus a $20M Series A led by Basis Set Ventures, with Kindred, Y Combinator, Peak XV and GitHub Fund, announced on 28 Oct 2025 (TechCrunch). Aggregators disagree on the total: VCBacked lists $20.0M (VCBacked: Mem0), and Caplight lists about $24.4M with a $150M valuation estimate (Caplight: Mem0). TechCrunch's primary report is preferred because it gives the round breakdown. The same article carries company-stated traction at the time: 41k+ stars, 13M+ Python downloads, 80k+ cloud signups, and a claim to be the "exclusive memory provider" for AWS's new Agent SDK (company claims). Letta raised a $10M seed led by Felicis, dated to September 2024 by one listing (secondary) (Pulse 2.0). Supermemory's seed is reported as about $2.6M (Dealroom) or $3M (Let's Data Science), and the amount is disputed. Smaller 2026 rounds include xmemory (London), reported at $4.0M pre-seed in March 2026 (secondary, unverified) (VCBacked: xmemory). No funding was found for Zep or Cognee, and a 2026 round reported for MemOS's developer MemTensor gave no clear amount (secondary, unverified). In the disclosed sample, rounds run from about $2.6M to $24M, which suggests few players have the capital for heavy enterprise-governance engineering. That is an inference from a small sample.
| Product | Licence / deployment | Latest release (date) | GitHub stars | Price (list) | Self-host | Governance (vendor page) | Best fit |
|---|---|---|---|---|---|---|---|
| Mem0 | Apache-2.0; OSS plus hosted cloud | TS SDK ts-v3.3.1 (25 Sep 2026) | 66,978 | Hobby free (10k add, 1k retrieval requests/mo); Starter $19/mo (50k add, 5k retrieval); Pro $249/mo (500k add, 50k retrieval); Enterprise custom | Yes (OSS) | Audit logs, SSO and custom integrations on Enterprise only | Managed memory API with the largest community |
| Zep | Hosted (Zep Cloud). Zep Community Edition is deprecated and unsupported (code in legacy/, Apache-2.0); Graphiti (Apache-2.0) is the open successor (README) |
zep-ingest-v0.3.0 (28 Aug 2026) | 4,955 (examples repo) | Credit-based self-serve (prices not extracted); Enterprise custom with SLA | Enterprise options (not read) | SOC 2 Type II and HIPAA BAA on Enterprise | Regulated buyers wanting managed memory |
| Graphiti (Zep) | Apache-2.0 | v0.30.2 (8 Sep 2026) | 31,642 | Free | Yes | Operator's responsibility | Self-hosted temporal knowledge graph |
| Letta | Apache-2.0; stateful agents platform | 0.16.8 (14 May 2026); repo pushed 10 Sep 2026 | 25,102 | Pricing page not readable | Yes | Not read | Stateful agents (framework view in Agent frameworks) |
| Cognee | Apache-2.0; "run the full memory engine locally... free, forever" | v1.6.3 (7 Oct 2026) | 32,012 | Free $0/mo, $1.00 per 1M tokens, +$5 per extra workspace; Enterprise BYOC in customer VPC | Yes | SSO on Startup and Enterprise; BYOC; SLAs | Deploy-anywhere engine with BYOC enterprise path |
| Supermemory | MIT; "can be run fully locally" | server-v0.0.8 (17 Aug 2026) | 31,185 | Free ($5 credits); $19 ($20 incl.); $100 ($130 incl.); $399 ($600 incl.); Enterprise | Yes; air-gapped on Enterprise | SOC 2, HIPAA BAA, GDPR, SSO, Enterprise MCP | Self-host or managed; 187 ms median recall and 100B+ tokens/month (vendor claims) |
| MemOS | Apache-2.0; "self-evolving memory OS" | v2.0.34 (23 Sep 2026) | 11,813 | Not checked | Yes | Operator's responsibility | Research-led self-hosted memory |
| LangMem | MIT | No GitHub release; last push 2 Oct 2026 | 1,700 | Free | Yes | Operator's responsibility | LangChain-ecosystem memory |
| MCP memory server (reference) | Mixed: new contributions Apache-2.0, docs CC-BY-4.0, un-relicensed contributions MIT (LICENSE read; API: NOASSERTION) | Repo v1.0.0 (11 Oct 2026) | 91,143 (whole servers repo) | Free | Yes | README describes no access control, audit or retention | Single-user local knowledge graph; not a product |
Native assistant memory: four vendors, four admin models
The assistants that companies already license have their own memory, and the admin models differ in ways that matter to a compliance officer. Claude has the most detailed published admin model among the pages read (Claude Help Center). On Team and Enterprise, owners switch memory on for the organisation and each member stays off until they opt in. Owners cannot view or edit individual memories, and switching org memory off deletes all memory for all users immediately. The audit log records only the org-level switch. Microsoft 365 Copilot takes the opposite approach. Memory is on by default under a tenant "Enhanced personalization" control. Memories are stored in a hidden folder in each user's Exchange mailbox, and admins can search, export and delete them through Purview eDiscovery and Graph. But admins cannot restrict what is saved, and Purview retention policies do not apply to memory (Microsoft Learn). Gemini's personal-context features "are not available while signed in to a work, school, or supervised account" (Gemini Apps Help). ChatGPT's Business and Enterprise help pages returned HTTP 403, so its controls are known only from search snippets, below. Model-level detail is in Claude, OpenAI and Gemini.
| Product | Who gets memory | Admin controls | Retention and deletion | Audit and export | Limits |
|---|---|---|---|---|---|
| Claude (Team, Enterprise) | On by default for Free, Pro and Max; on Team and Enterprise the owner enables it and each member opts in | Owners enable it in Organization settings > Capabilities; separate "sensitive topics" control; owners cannot view or edit individual memories | Deleting a chat does not delete related memories; users delete single memories or reset; encrypted at rest; memories created before a retention policy are not removed | Audit log records the org switch, not individual edits; memory included in conversation exports; incognito chats in org exports and kept at least 30 days | Not available for HIPAA, public-sector or custom-retention orgs; chat search not available with customer-managed keys |
| Microsoft 365 Copilot | On by default; admins can disable it for users or the tenant, including via Graph enhancedPersonalizationSetting |
Tenant switch only; admins cannot restrict what is saved | Memories persist until the user deletes them; if the control is turned off, chat-history details are deleted after 30 days; deleting a chat does not delete its memories | Purview eDiscovery and Graph Explorer can search, export and delete; temporary chats discoverable; mailbox security, Customer Lockbox and encryption at rest apply | Retention labels and policies do not apply; Multi-Geo location unverified |
| Gemini | Personal Google Accounts only | Workspace admin controls for memory not found | Not read | Not read | Not available on work or school accounts |
| ChatGPT (Business, Enterprise) | Not verified (primary pages HTTP 403) | Snippet only: Workspace settings > Permissions & roles, with "Use shared memory" and nested "Use improved memory" toggles, scoped per role (OpenAI Help); Enterprise owners can turn memory off (OpenAI 2024 post, snippet) | Snippet: memories migrate when a personal account merges into a Business workspace (Business memory FAQ) | Not verified | Not verified |
Governance controls side by side
The table below compares what each vendor page says about the controls an enterprise buyer typically asks for. "Not read" means the page did not describe the control, not that the product lacks it.
| Product | Access control | Audit logs | Retention / deletion | PII handling | Certifications | Deployment |
|---|---|---|---|---|---|---|
| Mem0 | SSO (Enterprise) | Enterprise | Not described | Not described | Not stated | Cloud; OSS self-host |
| Zep | Enterprise "governed context" (details not read) | Not read | Not read | Not read | SOC 2 Type II, HIPAA BAA (Enterprise) | Cloud; Enterprise options |
| Cognee | SSO (Startup, Enterprise) | Not read | Not read | Not read | Not stated | Local, self-hosted, Enterprise BYOC |
| Supermemory | SSO (Enterprise) | Not read | Not read | Not read | SOC 2, HIPAA BAA, GDPR (Enterprise) | Cloud, self-hosted, air-gapped |
| Self-hosted OSS (Graphiti, MemOS, LangMem, MCP memory) | Built by the operator | Built by the operator | Built by the operator | Built by the operator | None | Anywhere |
| Claude Team / Enterprise | Org switch plus per-user opt-in; no owner read access | Org switch only | Org switch-off deletes all; per-user delete | "Sensitive topics" opt-in | Excluded for HIPAA orgs | Vendor cloud |
| Microsoft 365 Copilot | Tenant switch; no content restriction | Purview eDiscovery search and export | User-controlled; retention policies do not apply | Not described | Inherits Exchange mailbox controls | Vendor cloud (user mailbox) |
Three conclusions follow. First, compliance badges are table stakes on enterprise tiers: SOC 2 and HIPAA BAAs appear across Zep, Supermemory and Portkey's Enterprise gateway tier, so US regulated buyers will expect them. Second, the controls buyers most need are the least documented: no vendor page read describes retention periods, PII handling, admin audit of individual memory writes or data residency in detail. Third, the native models force a trade-off. Claude protects employee privacy from administrators, which a regulated buyer may find hard to accept. Microsoft gives administrators discovery but no control over what is remembered and no retention-policy coverage. For Indian deployments, memory stores hold personal data about employees and customers, so the DPDP Act and Rules apply. Consent-manager provisions take effect on 13 Nov 2026 and the substantive obligations on 13 May 2027, under the Rules notified as G.S.R. 846(E) (MeitY DPDP Rules 2025). See Governance and India.
Observability, evaluation and guardrails changed owners in 2026
Langfuse keeps an MIT core under ClickHouse; Phoenix is only source-available
Consolidation is the story of 2025 and 2026. ClickHouse acquired Langfuse, announced on 16 Jan 2026 alongside ClickHouse's own $400M Series D at a $15B valuation led by Dragoneer; the purchase price was not disclosed (ClickHouse blog; SiliconANGLE). Langfuse says its roadmap is unchanged and that it remains committed to open source and self-hosting (Langfuse discussion #11593). Its LICENSE, re-read on 11 Oct 2026, now reads "2023-2026 ClickHouse, Inc.", with the core under the MIT (Expat) licence and ee/ directories under a separate licence. Helicone joined Mintlify under a company post dated 3 Mar 2026; its services stay live "in maintenance mode", with security updates, new models and fixes still shipping (Helicone blog). OpenAI agreed to acquire promptfoo, Promptfoo's own blog said on 9 Mar 2026, adding that "the open-source project will continue". The LICENSE on main is still MIT (Promptfoo blog; promptfoo LICENSE). Traceloop (OpenLLMetry) is "joining ServiceNow", per its own blog in March 2026; no value was stated (Traceloop blog). CoreWeave acquired Weights & Biases on 5 May 2025 for $1.0B aggregate purchase consideration (CoreWeave 10-Q; primary), and the W&B pricing URL now redirects to CoreWeave (W&B pricing URL).
OpenAI is also retiring its own hosted evaluation product. Existing OpenAI Evals become read-only on 31 Oct 2026, and the dashboard and API shut down on 30 Nov 2026 (OpenAI deprecations). The same page names Promptfoo, which OpenAI agreed to acquire (above), as the migration path. Teams that rely on it have about seven weeks to move. Arize Phoenix is marketed as "Phoenix OSS", but its Elastic License 2.0 states, "You may not provide the software to third parties as a hosted or managed service" (Phoenix). LangSmith is a hosted product, and both its hybrid and fully self-managed deployments are Enterprise-only (LangSmith pricing). Among developers building agents, the most-used observability tools in Stack Overflow's 2025 survey were general-purpose ones: Grafana and Prometheus (43%) and Sentry (32%) (Stack Overflow 2025 AI survey). That makes the vendor-neutral OpenTelemetry GenAI semantic conventions (spec; the semantic-conventions repository's latest release is v1.44.0 of 4 Aug 2026) the safest instrumentation choice: traces then survive any change of observability vendor. The conventions have moved to github.com/open-telemetry/semantic-conventions-genai (the opentelemetry.io page now says "Moved") and are marked "Development", not stable (GenAI spans spec).
On price, Langfuse Core at $29 a month (100k units included, then $8 per 100k) is the cheapest paid hosted tier found. One million units a month would cost about $101 (computed) (Langfuse pricing). Helicone Pro ($79) and Braintrust Pro ($249) meter in different units (requests, GB and per-1,000 scores), so they cannot be compared directly (Helicone pricing; Braintrust pricing). Two maintenance signals matter as well. Ragas has had no release since 13 Jan 2026 and no push since 24 Feb 2026. Helicone's last GitHub release is from 21 Aug 2025, although the repository was still being pushed on 10 Oct 2026. Helicone's own post (3 Mar 2026) confirms that it is in maintenance mode after the Mintlify acquisition (above).
| Tool | Licence | Latest release (date) | GitHub stars | Price (list) | Self-host | Best fit |
|---|---|---|---|---|---|---|
| LangSmith | Proprietary SaaS | Not checked | Not checked | Developer $0/seat (1 seat, 5k base traces/mo); Plus $39/seat/mo (10k base traces); usage at $1.00 per LangChain Standard Unit; Enterprise custom | Enterprise only (hybrid or fully self-managed) | Teams already on LangChain/LangGraph |
| Langfuse | MIT core; ee/ under separate licence |
v4.56.0 (9 Oct 2026) | 35,648 | Hobby free; Core $29/mo; Pro $199/mo; Enterprise $2,499/mo; Teams add-on $300/mo | Yes | Open-source-first tracing and evals |
| Arize Phoenix | Elastic License 2.0 | arize-phoenix-v20.21.0 (11 Oct 2026) | 11,785 | Phoenix OSS free; AX Free $0; a $50/mo tier (25 issues, 50k spans, 10 GB; name not captured); AX Enterprise custom | Yes (no managed-service resale) | Internal tracing and evals |
| Braintrust | SDK Apache-2.0; platform proprietary | braintrust@3.37.2 (9 Oct 2026) | 29 (SDK) | Starter $0 ($10 credits, then $4/GB + $2.50 per 1k); Pro $249/mo; retention beyond 30 days $0.50/GB/mo | Not confirmed | Eval-centric SaaS teams |
| Helicone | Apache-2.0 | v2025.08.21-1 (21 Aug 2025) | 6,212 | Free (10k requests); Pro $79/mo; Team $799/mo | Repo open source; not checked | Low-cost request logging (Mintlify; maintenance mode since Mar 2026) |
| W&B Weave | Apache-2.0 | v0.53.7 (27 Aug 2026) | 1,140 | Not read | Not confirmed | Teams already on W&B |
| Datadog LLM Observability | Proprietary | n/a | n/a | Unit price not extracted; page mentions AI Guard billable tokens | No | Firms already on Datadog |
| promptfoo | MIT | code-scan-action-0.2.2 (8 Oct 2026), an Action tag | 25,897 | Open source; paid tiers not read | Yes (CLI) | Prompt and agent testing and red-teaming in CI |
| DeepEval | Apache-2.0 | python-v4.2.4 (22 Sep 2026) | 18,742 | Pricing page 404 | Yes | Python eval metrics |
| Ragas | Apache-2.0 | v0.4.3 (13 Jan 2026) | 15,992 | Free | Yes | RAG metrics; check activity first |
| OpenTelemetry GenAI conventions | Apache-2.0 | v1.44.0 (4 Aug 2026) | 667 | Free | n/a (spec) | Vendor-neutral LLM and agent spans; status "Development" (not stable); now in the semantic-conventions-genai repo |
AI security start-ups are being absorbed by security incumbents
Independent AI-security vendors are being bought by established security companies. Check Point announced it would acquire Lakera in September 2025, and the deal closed on 22 Oct 2025, as reported in Check Point's Q3 2025 results (search summary; not read directly). Lakera brings runtime protection, continuous red teaming and multilingual defences into Check Point's Infinity platform, and Zurich becomes Check Point's Global Centre of Excellence for AI Security (CXOToday release; Check Point Q3 2025). Lakera's site footer now carries Check Point's copyright (Lakera). Snyk acquired Invariant Labs, dated 24 Jun 2025 by Hacker News (Snyk news; HN item). Invariant had disclosed MCP "tool poisoning" attacks on 1 Apr 2025 and released MCP-Scan on 11 Apr 2025 (Invariant Labs). SentinelOne acquired Prompt Security: the agreement was signed on 5 Aug 2025 and completed on 5 Sep 2025, for total consideration of about $180 million in cash and shares (SentinelOne 8-K; primary). The higher price given on Wikipedia is not supported by the filing (Wikipedia: Prompt Security). HiddenLayer's homepage shows a "$100M Series B" banner, undated, and no acquisition (HiddenLayer). Palo Alto Networks completed its acquisition of Protect AI on 22 Jul 2025, for total purchase consideration of $634.5 million (Palo Alto Networks FY2025 10-K; primary).
On the open side, Meta's guard models are the cheapest self-hosted screening option on licence cost. Llama Guard 4 (12B) classifies inputs and outputs, and Llama Prompt Guard 2 (86M) detects prompt injection and jailbreaks. Both are released under the Llama 4 Community License. Anyone distributing them, or a product containing them, must display "Built with Llama", include the Notice file and follow Meta's Acceptable Use Policy. Derived models must have names beginning "Llama", and licensees above 700 million monthly active users need a separate licence from Meta (Llama 4 licence; Llama Guard 4; Prompt Guard 2). Gateways now embed guardrails too: Cloudflare bills guardrails as Workers AI tokens on Llama Guard 3 8B, and Portkey includes deterministic guardrails on its free tier. No tool here makes prompt injection a solved problem. OWASP's 2025 list ranks Prompt Injection as LLM01, and its LLM06 (Excessive Agency) mitigations are least-privilege tools, downstream authorisation and human approval for high-impact actions. Those are design controls that no guard model replaces (OWASP LLM Top 10). See Governance and, for agent-level security, Agent frameworks.
| Tool | Licence | Latest release (date) | GitHub stars | Price / access | Self-host | Best fit |
|---|---|---|---|---|---|---|
| NeMo Guardrails (NVIDIA) | Apache-2.0 per LICENSE.md (API: NOASSERTION) | v0.24.1 (16 Sep 2026) | 7,275 | Open source | Yes | Programmable dialogue and policy rails |
| Guardrails AI | Apache-2.0 | v0.11.0 (14 Aug 2026) | 7,507 | Open source; paid tier not read | Yes | Output structure and content validators |
| Llama Guard 4 (12B) | Llama 4 Community License | Model card | n/a | Free weights under licence | Yes | Input and output safety classifier |
| Llama Prompt Guard 2 (86M) | Llama 4 Community License | Model card | n/a | Free weights under licence | Yes | Prompt-injection and jailbreak classifier |
| MCP Scan (Snyk) | Apache-2.0 | v0.6.8 (29 Sep 2026) | 3,132 | Free tool | Yes | Scanning MCP servers and agent skills in CI |
| Lakera (Check Point) | Commercial | n/a | n/a | Not published | No | Enterprise runtime protection inside Check Point Infinity |
| Prompt Security (SentinelOne) | Commercial | n/a | n/a | Not read | No | Enterprise GenAI usage controls |
| HiddenLayer | Commercial | n/a | n/a | Not read | No | Enterprise AI model security |
| Protect AI (Palo Alto Networks) | Commercial | n/a | n/a | Not read | No | Owned by Palo Alto Networks since 22 Jul 2025 |
| Target | Acquirer | Date | Evidence | Confidence |
|---|---|---|---|---|
| Langfuse | ClickHouse | Announced 16 Jan 2026 | ClickHouse blog; LICENSE copyright | High |
| Helicone | Mintlify | 3 Mar 2026 | Company post | High |
| promptfoo | OpenAI | Agreed 9 Mar 2026 | Promptfoo's own blog | High |
| Traceloop (OpenLLMetry) | ServiceNow | March 2026; value not stated | Traceloop's own blog ("joining ServiceNow") | High (no price) |
| Weights & Biases (Weave) | CoreWeave | 5 May 2025; $1.0B | CoreWeave 10-Q | High |
| Lakera | Check Point | Closed 22 Oct 2025 (search summary) | Completion release; site footer | High (date medium) |
| Invariant Labs | Snyk | About 24 Jun 2025 | Snyk news page; site banner | High |
| Prompt Security | SentinelOne | Agreed 5 Aug 2025, completed 5 Sep 2025; about $180M | SentinelOne 8-K | High |
| Protect AI | Palo Alto Networks | Completed 22 Jul 2025; $634.5M | PANW FY2025 10-K | High |
Automation surfaces: workflow engines, voice, WhatsApp and low-code builders
n8n has the largest community and the tightest licence
n8n is the most-starred workflow tool in this comparison, at 206,996 stars (n8n@2.42.6 on 9 Oct 2026), but it is source-available rather than open source. Its Sustainable Use License says: "You may use or modify the software only for your own internal business purposes or for non-commercial or personal use" (n8n LICENSE). It allows distribution or provision to others only "free of charge for non-commercial purposes". Files with .ee. in their name, or .ee in their directory name, are outside that licence and need an n8n Enterprise License (licence re-read on 12 Oct 2026). Running n8n as a paid managed service for third parties therefore needs a commercial agreement with n8n (inference from the text; no n8n FAQ found). If a partner proposes to host n8n for you as a paid managed service, ask whether it has that agreement, and get a lawyer's reading where it matters. A direct read of n8n's pricing page on 12 Oct 2026 (annual billing) shows Starter at €20 a month (2,500 executions, one shared project, 1,600 AI-assistant credits), Pro at €50 (10,000) and Business at €667 (40,000, "for companies with < 100 employees") (n8n pricing). Business is labelled both "Self-hosted only" and "Hosted by n8n?", so its hosting option is ambiguous. An earlier summarised read of the same page adds Business overage of €4,000 per 300,000 extra executions (secondary; not re-checked on 12 Oct 2026). Secondary trackers give €24 and €60 on monthly billing and Business at $800 (Toolradar), and one says the Cloud free plan ended on 14 Apr 2026, which is unverified (AgentDeals).
The cleaner licences when a partner hosts and manages the workflow tool for you are Activepieces (MIT core with an ee/ carve-out; 25,000 stars; around 400 MCP servers per its repository description) and Windmill (Apache-2.0 and AGPLv3 dual-licensed, with some proprietary components; 18,162 stars). For durable, retry-safe, long-running agent workflows, Temporal (MIT; Cloud at $50 per million actions, $150 of free credits for 90 days, active storage at $0.042/GBhr) gives a predictable cost model (Temporal pricing). Prefect (Apache-2.0) and Airflow (Apache-2.0, 47,146 stars) remain the data-pipeline choices. Among hosted tools, Zapier's MCP product connects to 9,000+ apps (Zapier MCP), and Make offers AI Agents (beta) on all plans plus an on-prem agent for local networks. RPA-plus-AI combinations (UiPath, Power Automate) were not researched.
| Tool | Licence | Latest release (date) | GitHub stars | Price (list) | Self-host | Best fit |
|---|---|---|---|---|---|---|
| n8n | Sustainable Use License (source-available) | n8n@2.42.6 (9 Oct 2026) | 206,996 | Starter €20, Pro €50, Business €667 a month (annual billing; direct read 12 Oct 2026); Enterprise custom | Yes, within licence terms | Engineering-heavy automation with AI nodes, on infrastructure the user owns |
| Zapier | Proprietary SaaS | n/a | n/a | Free $0 (100 tasks); Professional from $19.99/mo and Team from $69/mo (direct read 12 Oct 2026, annual toggle); $29.99 and $103.50 monthly, with 750 and 2,000 tasks (earlier summarised read) | No | Non-technical SaaS-to-SaaS automation |
| Make | Proprietary SaaS | n/a | n/a | Official pricing page blocked (HTTP 403, 12 Oct 2026); prices not quoted | On-prem agent only | Visual scenario builder for mid-market |
| Pipedream | Proprietary SaaS | n/a | n/a | $0; $99/mo; $150/mo (tier labels not captured) | No | Developer-led integrations with code steps |
| Activepieces | MIT core; ee/ under enterprise licence |
0.92.2 (7 Oct 2026) | 25,000 | $0; $20/mo flat; $200 (labels not captured) | Yes | Open self-hosted no-code with MCP connectors |
| Windmill | Apache-2.0 / AGPLv3 dual, with proprietary parts | v1.830.0 (9 Oct 2026) | 18,162 | Self-hosted from $0; Enterprise from $120/mo | Yes | Scripts to internal tools and workflows |
| Temporal | MIT | v1.32.1 (8 Oct 2026) | 23,606 | Cloud $50 per 1M actions; $150 free credits | Yes | Durable long-running agent workflows |
| Prefect | Apache-2.0 | 3.8.8 (6 Oct 2026) | 24,003 | Hobby free; Starter $100/mo; Team $100/user/mo (service accounts, audit logs) | Yes | Python data and ML pipelines |
| Apache Airflow | Apache-2.0 | 3.3.2 (17 Sep 2026) | 47,146 | Free; managed options not checked | Yes | Scheduled data pipelines at scale |
Voice agents cost two to six times their headline platform rate
Voice cost has to be modelled per minute across five legs: platform, LLM, speech-to-text, text-to-speech and telephony. Retell's own page shows "$0.07–$0.31 / min", and its worked example of $0.11 a minute splits into $0.04 for the LLM, $0.055 for voice infrastructure and $0.015 for TTS, with telephony at $0.00 (Retell pricing). Secondary comparisons put a tuned Retell stack near $0.10 a minute and a current-generation model past $0.23 (Morph). Vapi's own page lists $0.05 a minute for Vapi hosting, with transcriber, model and voice billed as separate components (Vapi pricing; primary). Secondary comparisons put the all-in cost at $0.13–$0.31 once LLM, TTS, STT and Twilio are added (AI Agent Rank). Against that fee, the all-in range is 2.6 to 6.2 times higher, and Retell's example is double its infrastructure rate (computed). Vapi's own page lists Enterprise from a $999 monthly minimum and Twilio pass-through at $0.008 (inbound) and $0.014 (outbound) a minute (Vapi pricing). Bland bundles the models, at $0.14 a minute on Start and $0.12 on a $299 monthly plan (Bland pricing). Its blog adds a Scale tier at $0.11 on $499 a month, with telephony billed separately (vendor-authored) (Bland blog). Synthflow's enterprise contracts "start at $30,000 annually" (Synthflow pricing).
The self-host path is LiveKit Agents (Apache-2.0, 14,694 stars) or Pipecat (BSD-2-Clause, 16,356 stars). LiveKit's cloud charges $0.01 per agent-session minute beyond the included minutes (Ship $50/month for 5,000 minutes; Scale $500 for 50,000), and its calculator's example stack totals $0.0479 a minute with models billed separately (summarised read) (LiveKit pricing). For Indian languages, Sarvam publishes INR rates: ₹30 an hour for real-time or batch STT (₹0.50 a minute, computed), ₹45 an hour for batch with diarization, and ₹3 per 1,000 characters for streaming TTS (Sarvam API pricing). Pricing the speech leg in INR removes currency exposure on that leg, but Sarvam's quality against English-first vendors was not benchmarked independently. Indian-language speech-to-text, text-to-speech and a leg-by-leg rupee voice-agent minute are covered in Indian languages; the India document quotes the same Sarvam rates. Plivo's India page lists calls at ₹0.38 and ₹0.25 a minute (rows not labelled by direction), a domestic number at ₹200 a month and transcription at ₹0.81 a minute (Plivo India); its global page lists a Voice AI Agent at $0.03 a minute excluding telephony (Plivo). Bolna sells voice agents at ₹5.52 (6.00 US cents) a minute on its $15 pilot plan and 4.51 cents at a higher tier (Bolna pricing; vendor-reported). Exotel's pricing page is sales-led (Exotel); its blog reportedly puts Indian-number calls at about ₹0.80–1.00 a minute outbound and ₹0.30–0.50 inbound (Exotel blog; search summary, not read directly). Reseller figures of ₹4–6 a minute for Exotel AI agents conflict with one another and are not Exotel's own price (edesy; reseller, search summary). Twilio India (Twilio India voice) and Exotel rate cards remain unresolved.
TRAI's Direction of 4 May 2024 moved voice calling onto DLT (140-series within 60 days; a 160-series plan) (TRAI Direction). The draft TCCCPR Third Amendment Regulations 2026 add an A2P call definition, pre-declaration and termination charges for A2P calls, a lower complaint threshold before a sender is suspended, and operator "AI-flagging" (comments on the draft hosted by TRAI). As drafted, a fully automated voice agent appears to fall within A2P (inference). The final rules were reported as notified on 18 Sep 2026 (secondary); the official text was not read, and no explicit AI-voice disclosure rule is confirmed. Indian languages covers the draft in more detail.
| Vendor | Licence | Latest release (date) | GitHub stars | Price (list) | Self-host | Best fit |
|---|---|---|---|---|---|---|
| Vapi | Proprietary | n/a | n/a | Enterprise from $999/mo minimum; models and telephony passed through; $0.05/min hosting fee plus component costs (Vapi page, primary) | No | BYO-model voice agents with fine control |
| Retell AI | Proprietary | n/a | n/a | $0.07–$0.31/min; example $0.11/min | No | Transparent per-minute builds |
| Bland AI | Proprietary | n/a | n/a | $0.14/min (Start); $0.12/min on $299/mo; Custom | No | Bundled-model pricing |
| Synthflow | Proprietary | n/a | n/a | Enterprise from $30,000/yr; lower tiers not captured | No | Enterprise contracts |
| LiveKit Agents | Apache-2.0 | livekit-agents@1.8.6 (9 Oct 2026) | 14,694 | Build $0 (1,000 min, 5 concurrent); Ship $50/mo; Scale $500/mo; $0.01/min beyond | Yes | Self-hosted or cloud real-time voice |
| Pipecat | BSD-2-Clause | v1.12.0 (26 Sep 2026) | 16,356 | Open source | Yes | Framework; choose hosting separately |
| ElevenLabs Agents | Proprietary | n/a | n/a | Plans at $0, $1 and $22/mo (promotional); per-minute rate not extracted | No | Hosted voice agents (pricing incomplete) |
| Deepgram | Proprietary API | n/a | n/a | $200 free credit; Nova-3 pre-recorded $0.0043/min (multilingual $0.0052); Aura-2 TTS $0.030 per 1,000 characters (pay-as-you-go) | No | STT and TTS API |
| AssemblyAI | Proprietary API | n/a | n/a | Add-ons $0.21, $0.15 and $0.05/hr (unlabelled) | No | Speech API (map rates to products first) |
| Sarvam AI | Proprietary API | n/a | n/a | STT ₹30/hr; diarized batch ₹45/hr; TTS ₹3 per 1,000 chars | No | Indian-language speech billed in INR |
| Cartesia | Proprietary | n/a | n/a | Managed agents $0.06/min | No | Hosted voice agents |
| OpenAI Realtime / gpt-live-1 | Proprietary | n/a | n/a | gpt-live-1 voice sessions $0.05/min (billed per second; backend model and tools extra); gpt-realtime-2.1 audio $32 / $0.40 / $64 per 1M input / cached / output (text $4 / $0.40 / $24); gpt-realtime-2.1-mini audio $10 / $0.30 / $20; gpt-transcribe $0.0045/min | No | OpenAI-native voice |
WhatsApp India billing must move to INR by 31 December 2026
WhatsApp-based order and lead handling is among the likely high-demand automations for Indian SMEs (an inference in the India research, not a survey result), and Meta's own pricing page sets the rules (Meta WhatsApp pricing). Template messages are charged per message by category and country calling code. All non-template messages are free inside an open customer-service window, and so are utility templates delivered inside one. The binding date for eligible India-billed accounts is 31 Dec 2026. Billing localisation launched on 1 Jan 2026 for partners and directly integrated businesses whose Sold-To country is India. Eligible customers "must ensure all WABAs in their business portfolio are migrated to INR by December 31, 2026", because "as of January 1, 2027 Meta will no longer deliver the messages of non-INR WABAs of eligible customers" (page re-read on 11 Oct 2026 through a summarising reader). Meta's rate-card files (PDF and CSV) were not read. A vendor page gives India rates per message, excluding 18% GST, "effective 1 Oct 2026": marketing ₹0.8631, utility ₹0.1150, authentication ₹0.1150, authentication-international ₹2.4971 (ChatMaxima; vendor-reported). Gallabox's INR tab shows exactly 1.15 times those (marketing ₹0.9926; others ₹0.1323), reason not stated (Gallabox). At ₹0.8631, 10,000 marketing templates cost about ₹8,631 before GST and partner markups (computed). Rupee per-conversation costs for Indian-language bots are worked through in Indian languages. Business-solution-provider (BSP) markups were not researched, and for small businesses they may matter more than Meta's rate. The workflow tools above supply the automation logic. Because these flows process customer personal data, they fall under the DPDP timeline in Governance.
| Item | What Meta's page says | Other sources | Status |
|---|---|---|---|
| India marketing rate | "Higher marketing rate" effective 1 Jan 2026 | About 10% rise, ₹0.7846 to ₹0.8631 per message (Authkey) | Direction confirmed; figures secondary |
| Authentication-international | Higher rate effective 1 Apr 2026 | ₹2.4971 per message excl. GST (ChatMaxima, vendor-reported) | Direction confirmed; figure vendor-reported |
| Rate cards | Effective 1 Jul 2026; INR rates and volume tiers in PDF/CSV | — | Files not read |
| INR billing | Eligible customers whose Sold-To country is India (partners and directly integrated businesses) migrate all WABAs to INR by 31 Dec 2026; their non-INR WABAs are undelivered from 1 Jan 2027 | — | Confirmed (operational deadline; re-read 11 Oct 2026) |
| Service messages | Non-template messages free in an open window; "Service conversations are now free for all businesses" (update of 1 Nov 2024) | From 1 Oct 2026, 1,000 free service messages per business phone number per calendar month, then the utility rate of ₹0.1150 excl. GST (ChatMaxima, Gallabox; also TelecomTalk; vendor-reported) | Vendor-reported; not confirmed on Meta's page (as read on 11 Oct 2026 through a summarising fetch, Meta's page still says non-template messages are free) |
| BSP markups | — | Not researched | Gap |
Flowise's archival leaves Dify and Langflow as the open builders
Low-code builders let non-developers assemble agents, but two of the three big open projects carry warnings. Flowise was archived by its owner on 13 Aug 2026 (repository banner re-read on 11 Oct 2026), after an announcement and code freeze on 29 Jul 2026; end of life was 31 Aug 2026, and its npm packages and Docker images are deprecated (Flowise discussion #6727). Existing deployments are now unsupported and need migration plans. Dify (158,150 stars, 1.17.1 on 10 Sep 2026) uses a modified Apache-2.0 licence. It bars running a multi-tenant environment "unless explicitly authorized by Dify in writing", where "one tenant corresponds to one workspace", and it bars removing or modifying the logo or copyright in the console or applications whenever Dify's frontend is used (licence re-read on 11 Oct 2026) (Dify). That makes it suitable for a deployment dedicated to one organisation, but a shared hosted product serving many businesses needs Dify's written authorisation. Langflow (MIT, 155,498 stars, v1.12.5 on 6 Oct 2026) is the permissive alternative. Hosted builders can also disappear: OpenAI's visual Agent Builder shuts down on 30 Nov 2026, and OpenAI's migration guidance points to the Agents SDK or ChatGPT Workspace Agents (OpenAI deprecations). Microsoft Learn lists tenant-wide packs of 25,000 Copilot Credits at $200 a pack a month ($0.008 a credit, computed). A pay-as-you-go meter billed through Azure also exists; a rate of $0.01 per credit is reported in secondary sources, not read directly (Microsoft Learn: Copilot Studio billing).
| Tool | Licence | Latest release (date) | GitHub stars | Price (list) | Self-host | Best fit |
|---|---|---|---|---|---|---|
| Dify | Modified Apache-2.0 (multi-tenant needs Dify's written authorisation) | 1.17.1 (10 Sep 2026) | 158,150 | $590/workspace/yr (5,000 message credits/mo); $1,590/workspace/yr (10,000); Enterprise private deployment | Yes | Single-tenant deployment for one organisation |
| Langflow | MIT | v1.12.5 (6 Oct 2026) | 155,498 | Free start; cloud price not captured | Yes | Permissive low-code agent builder |
| Flowise | Apache-2.0 with enterprise carve-out | flowise@3.1.4 (29 Jul 2026) | 55,494 | Not read | Archived 13 Aug 2026; end of life 31 Aug 2026 | Migrate away |
| Botpress | Proprietary | n/a | n/a | Free; Plus $150/mo incl. $25 AI usage; 100 conversations for $65 | Not checked | Chat and voice bots |
| Microsoft Copilot Studio | Proprietary | n/a | n/a | 25,000-credit pack $200/mo (Microsoft Learn); pay-as-you-go meter via Azure (reported $0.01 per credit, secondary) | No | Microsoft 365 tenants |
| Voiceflow | Proprietary | n/a | n/a | Free trial; publishes no prices ("Request pricing") | Not checked | Conversation design |
| Stack AI | Proprietary | n/a | n/a | Free $0; paid tiers not captured | No | Enterprise agent builder |
| Relevance AI | Proprietary | n/a | n/a | Not captured | No | Agent workforce builder |
Licence traps to check when you or a partner runs a tool for you
Four kinds of trap appear across the stack. Use-restriction licences (n8n's SUL, Phoenix's ELv2, Dify's multi-tenant clause, LM Studio's app terms) allow self-hosting for your own business but restrict hosting the tool for several customers at once, which is how a managed-service or implementation partner may propose to run it for you. Directory-split open core (LiteLLM enterprise/, Langfuse and Activepieces ee/, n8n's .ee. files, Flowise's enterprise carve-out, and Elasticsearch and Weaviate by directory) makes a feature's licence depend on which folder its code lives in, so it has to be re-checked at each upgrade. Copyleft terms (AGPL-3.0 and SSPL-1.0 in Elasticsearch, AGPLv3 in Windmill, GPL-3.0 in Neo4j Community) matter when code is embedded or hosted for others. The same applies to the AGPL-licensed browser agent Skyvern, covered in Agent frameworks. Status traps are not licence clauses but behave like them: archived projects (TGI, Flowise), ownership changes, and stalled release cadences (Ragas, Helicone, Chroma, TensorRT-LLM). Across vendors, SSO and audit logs are gated to top tiers (LiteLLM, Mem0, Portkey, Prefect Team, and n8n Enterprise per secondary sources). The GitHub API returns NOASSERTION for several licences that the LICENSE files settle. Dynamo and NeMo Guardrails are Apache-2.0. The MCP servers repository is mixed: new contributions Apache-2.0, documentation CC-BY-4.0, un-relicensed contributions MIT. This is not legal advice: items marked "counsel" need a lawyer's reading before you rely on them in a contract with a vendor or partner.
| Tool | Licence | Clause or limit | Risk when you or a partner runs it | Safer pattern |
|---|---|---|---|---|
| n8n | Sustainable Use License | Use "only for your own internal business purposes or for non-commercial or personal use"; provision to others only "free of charge for non-commercial purposes" | A partner running n8n for you as a paid managed service needs a commercial agreement with n8n (inference; counsel); .ee. files need an Enterprise License |
An instance your business owns, or a partner with n8n's commercial licence; or Activepieces / Windmill |
| Dify | Modified Apache-2.0 | Written authorisation from Dify for multi-tenant service; keep logo and copyright when its frontend is used | A shared multi-tenant deployment breaches it without that authorisation | A deployment dedicated to your organisation; Dify Enterprise; or Langflow (MIT) |
| Arize Phoenix | Elastic License 2.0 | No providing it "as a hosted or managed service" | A partner providing it to you as a managed service breaches it | Run it internally yourself; Langfuse (MIT core) if a partner manages observability for you |
| Elasticsearch | AGPL-3.0 / SSPL-1.0 / ELv2 by directory | Different terms per directory | Code embedded in a product built for or by you (counsel) | OpenSearch (Apache-2.0) or pgvector |
| Weaviate | BSD-3-Clause or Weaviate License by directory | Directory-dependent | Same as above | Check the directory; or Qdrant (Apache-2.0) |
| Neo4j Community | GPL-3.0; commercial for enterprise | Copyleft | Embedding in proprietary products (counsel) | Commercial licence; check terms before embedding |
| Windmill | Apache-2.0 / AGPLv3 dual, proprietary parts | Mixed | Hosted use of AGPL parts (counsel) | Read the component map before hosting |
| LiteLLM, Langfuse, Activepieces | MIT core; enterprise/ or ee/ separate |
Enterprise folders not MIT | Accidentally shipping enterprise code | Pin to the core; re-check at upgrades |
| Llama Guard 4, Prompt Guard 2 | Llama 4 Community License | "Built with Llama" display, Notice file, Acceptable Use Policy; derived model names must begin "Llama"; separate licence above 700M monthly active users | Attribution and naming duties in any product that contains them; AUP compliance (counsel) | Read the licence; keep an alternative classifier |
| LlamaParse | Commercial ("not open source") | Hosted service | Lock-in for parsing | LiteParse, Docling or Unstructured |
| MCP servers repository | Mixed Apache-2.0 / MIT / CC-BY-4.0 | Un-relicensed contributions stay MIT | The licence differs by file | Check the licence of each server copied |
| TGI, Flowise | Archived | No further development | Unsupported production systems | Migrate to vLLM/SGLang and Langflow/Dify |
| LM Studio | Desktop app terms (23 Aug 2026) | "solely for Your personal and / or internal business purposes"; no "service bureau use, as an application service provider, or a software-as-a-service" | A partner running it for you as a hosted service breaches the terms | Internal use only; serve workloads with vLLM, llama.cpp or Ollama (MIT) |
Three reference stacks: budget SME, privacy-first self-hosted, enterprise and regulated
These stacks are recommendations drawn from the comparisons above, not tested deployments. They assume a business that runs its automations itself or through an implementation partner. Prices are list prices in USD, and INR billing and GST were not checked.
Stack A, SME on a budget, uses hosted models with minimal operations and keeps software subscriptions between about $0 (everything self-hosted) and about $70 a month: Langfuse Core $29 plus Mem0 Starter $19 plus Activepieces' $20 tier, excluding model usage, hosting and staff (computed). Stack B, privacy-first self-hosted, suits businesses that need data kept in their own or in-country infrastructure and DPDP-aligned retention. Licence fees are close to zero, and GPUs and operations dominate cost. Stack C, enterprise and regulated, suits US companies that require SOC 2, HIPAA BAAs, SSO and audit trails. Its fixed floor runs to thousands of dollars a month before quotes, for example Langfuse Enterprise at $2,499 plus a Pinecone Enterprise minimum of $500, or $2,999 together (computed).
| Layer | A. SME on a budget | B. Privacy-first self-hosted | C. Enterprise and regulated |
|---|---|---|---|
| Models and serving | Hosted model APIs; Ollama or llama.cpp for local prototypes | vLLM, with SGLang as the benchmark challenger, on own or in-country GPUs; llm-d only if multi-node; Indian managed endpoints are an in-country hosted option (vendor-reported): E2E Networks TIR ("OpenAI-style endpoint served from Indian data centers") and Yotta Shakti Cloud (Navi Mumbai and Greater Noida) (E2E; Yotta) | Hosted model APIs under enterprise terms; vLLM for sensitive workloads; Dynamo or llm-d at datacenter scale |
| Gateway | LiteLLM open source ($0) or OpenRouter Standard (5.5%) | LiteLLM open source inside your own cloud | LiteLLM Enterprise (SSO+SCIM, audit, air-gap) or Portkey Enterprise (VPC, SOC 2 Type 2, HIPAA BAA); Kong where already standard |
| Vector store | pgvector in existing Postgres; Qdrant or Chroma free tier for pilots | pgvector or Qdrant (Apache-2.0) | Pinecone Enterprise ($500/mo min, BYOC) or Turbopuffer (CMEK from $4,096/mo); OpenSearch/Elastic where already standard |
| Embeddings and rerank | voyage-4-lite ($0.02/1M, 200M free) with rerank-3-lite ($0.02) | Qwen3-Embedding or BGE-M3, self-hosted | Cohere Embed 5 dedicated (from $2,000/mo) or Voyage; benchmark on your own corpus |
| Parsing and OCR | Docling; Unstructured (10,000 free pages); LlamaParse basic for hard PDFs | Docling, Unstructured OSS, DeepSeek-OCR | Reducto ($10–$40 per 1,000 pages) or Azure Document Intelligence |
| GraphRAG | Skip | LightRAG or Microsoft GraphRAG only for multi-hop corpora | Microsoft GraphRAG on Neo4j (commercial licence) where multi-hop matters |
| Memory | Mem0 Hobby (free) or Starter ($19/mo), or none | Mem0, Graphiti, Cognee or Supermemory self-hosted, with retention and deletion built in | Zep or Supermemory Enterprise (SOC 2, HIPAA BAA) or Mem0 Enterprise (audit logs, SSO) |
| Observability and eval | Langfuse Hobby or Core ($29/mo); promptfoo and DeepEval in CI | Langfuse self-hosted (MIT core) on OpenTelemetry GenAI conventions | LangSmith Enterprise (self-managed) or Langfuse Enterprise ($2,499/mo); Datadog where it is already the APM |
| Guardrails | Llama Prompt Guard 2; Portkey deterministic or Cloudflare guardrails | Llama Guard 4 + Prompt Guard 2; NeMo Guardrails or Guardrails AI; MCP Scan in CI | Commercial runtime protection (Lakera, Prompt Security, HiddenLayer) plus open guard models; OWASP LLM06 controls |
| Workflow | Activepieces, or n8n on an instance you own; Zapier or Make for SaaS glue | Windmill or Activepieces self-hosted; Temporal for durable jobs | Temporal Cloud ($50 per 1M actions) or Prefect Team; n8n only under a commercial licence |
| Voice | Retell, Vapi or Bland pay-as-you-go; Sarvam for Indian-language speech | LiveKit Agents or Pipecat with self-hosted models | Vapi Enterprise ($999/mo min), Synthflow (from $30,000/yr) or Retell |
| WhatsApp (India) | Meta platform, direct or via a BSP, billed in INR | Same, with consent and retention logs | Same, plus DPDP processor terms |
| Low-code | Botpress (Plus $150/mo) or single-tenant Dify | Single-tenant Dify for your organisation, or Langflow (MIT) | Copilot Studio ($200 per 25,000 credits) in Microsoft shops; Dify Enterprise |
| Indicative software floor | About $0–$70/mo | About $0 in licences; GPUs and ops dominate | About $3,000/mo before quotes |
What this means for your business
Start with permissive defaults and keep hosted services swappable. Each layer now has a permissively licensed default (MIT, Apache-2.0, BSD or the PostgreSQL License): vLLM, LiteLLM, pgvector or Qdrant, Docling, Langfuse's core, Activepieces or Temporal, and LiveKit or Pipecat. Hosted alternatives mostly add cost at volume, at enterprise tiers or through monthly minimums. Put a gateway in front of every model call and use OpenTelemetry GenAI traces, so that switching a model, router or observability vendor is a configuration change rather than a rebuild. Nine of the observability, evaluation and security vendors in this document have been acquired or agreed to be acquired since May 2025. The same gateway can route Indian personal data to in-country options (Bedrock's in. profiles for the previous Claude generation, Indian managed endpoints or self-hosted vLLM), since first-party APIs and the newest models process outside India.
Budget in all-in units and plan for currency risk. Costs arrive per minute (voice, $0.07–$0.31 all-in), per page (parsing, $0.00125–$0.04), per message (WhatsApp, INR rate cards), as a percentage of model spend (5–8% on hosted routers) or as monthly minimums (Pinecone, Turbopuffer). Software floors run from about $0–$70 a month for the budget SME stack to about $3,000 a month before quotes for the enterprise stack (reference stacks above). Almost every vendor prices in USD. Sarvam, Plivo India and Bolna publish AI-service or telephony prices in INR (vendor-reported), and Meta now requires INR billing for eligible WhatsApp customers whose Sold-To country is India. If your revenue is in INR and a contract passes USD costs through to you, agree an FX clause or keep a buffer. Costs has the wider pricing models.
Put the dated deadlines in your plan. OpenAI Evals goes read-only on 31 Oct 2026; Evals and Agent Builder shut down on 30 Nov 2026; DPDP consent-manager provisions start on 13 Nov 2026; eligible India-billed WABAs must migrate to INR billing by 31 Dec 2026; the substantive DPDP obligations follow on 13 May 2027. If you run TGI or Flowise (end of life 31 Aug 2026), you already need a migration.
Test Indian-language quality yourself. No embedding model, OCR tool or memory layer in this research was tested on Hindi, other Indic scripts or code-mixed text, and vendors' multilingual claims do not settle the question. Pilot on your own documents, scans and call recordings before accepting any accuracy figure (Indian languages sets out a test plan). Memory layers that hold employee or customer data need retention, deletion and audit controls that the vendors themselves do not document.
Questions to ask any vendor or implementation partner
- Which licence covers each component, and does the way it will be run for you fit it? Hosting n8n, Dify, Phoenix or LM Studio for several customers can breach their terms (see the licence table above).
- Is the instance owned by your business, and does the contract record each component's licence, the self-host commitment and an export path?
- Is any component archived, end-of-life or in maintenance mode (TGI, Flowise, Helicone), or slow to release (Ragas)?
- Where are your data processed and stored, and which tier includes SSO, audit logs and retention controls?
Open questions and unverified items
| Item | Status | What would settle it |
|---|---|---|
| vLLM vs SGLang vs TensorRT-LLM performance; Dynamo 1.0 date and "up to 7x" | No independent 2026 benchmark; Dynamo date secondary, 7x a vendor claim | Benchmark on the target model and GPU; NVIDIA primary release |
| Azure API Management; OpenRouter retention and no-training terms; Portkey overage unit | Azure API Management and OpenRouter terms not researched. Bedrock's India in. profiles are documented (see gateways). Portkey's page says both "logs" and "requests" for the $9 per 100K overage (page inconsistency) |
Vendor documentation or a live account |
| India managed regions and INR/GST billing for USD-priced vendors | Not confirmed for any tool-stack vendor. GST treatment was not read from any statute; the usual position is reverse charge for B2B imports of services, so get tax advice. For model serving, see Bedrock in. profiles and Indian managed endpoints (vendor-reported) |
Vendor region lists and billing pages; tax advice |
| 2026 MTEB ranking; OpenAI embedding prices; Mistral OCR per-page price; Azure Document Intelligence Read rate | Still open; Azure's Retail Prices API shows two unlabelled Read rows ($0.60 vs $1.50 per 1,000 pages). Settled: Voyage unit (per 1M tokens), other Azure rates, Reducto parse from $10 and extract from $20 | Live pages; Azure meter documentation |
| Reducto's $40 tier | Stands from the 11 Oct read; not seen on the 12 Oct read | A fresh read of Reducto's pricing page |
| Indic OCR and Indic or code-mixed embedding quality | Untested for every tool | Pilot on your own documents and scans |
| GraphRAG vs plain RAG accuracy and cost; UNREAL preprint results | No independent benchmark; preprint not peer-reviewed | Controlled pilot; peer review or replication |
| Memory governance (retention, PII, audit of memory writes, residency); funding for Zep, Cognee, MemOS; Letta pricing | Not described or not found | Vendor security documentation, DPAs, primary announcements |
| ChatGPT Business/Enterprise memory controls; Gemini Workspace memory controls; Copilot Multi-Geo memory location | Snippets only (HTTP 403), not found, or unverified | Admin consoles and vendor help centres |
| n8n monthly-billed prices; Business hosting option; end of the n8n Cloud free plan on 14 Apr 2026 | Annual prices settled (Pro €50, Business €667 a month; direct read 12 Oct 2026). Business is labelled both "Self-hosted only" and "Hosted by n8n?"; the free-plan end is unverified (tracker only) | n8n pricing page and changelog |
| Make prices | Official pricing page blocked (HTTP 403), so no figures can be quoted | A readable official pricing page |
| Copilot Studio pay-as-you-go rate; Stack AI, Relevance AI, Langflow Cloud prices | The pay-as-you-go meter exists (billed via Azure), but its rate ($0.01 a credit) is reported only by secondary sources. Voiceflow publishes no prices. Stack AI, Relevance AI and Langflow Cloud prices are still not captured | Microsoft price list; live pages |
| ElevenLabs agents per-minute rate; AssemblyAI row labels | Not captured | Live pages |
| Twilio India and Exotel rate cards | Plivo India and Bolna INR rates captured (vendor-reported). Exotel's blog figures come only from a search summary | Provider rate sheets |
| TRAI rules for automated or AI calls | The 2024 DLT Direction is primary, and the draft TCCCPR Third Amendment would cover automated A2P calls. The final rules were reported notified on 18 Sep 2026 (secondary), but the Gazette text was not read, and no explicit AI-voice rule is confirmed | Final Gazette text |
| WhatsApp INR rate card; 1 Oct 2026 service-message charge; BSP markups | Meta's rate-card file is still unread. Per-message INR rates come from vendor pages (ChatMaxima; Gallabox at 1.15 times, unexplained). The service-message charge (1,000 free per number a month, then the utility rate) is vendor-reported and conflicts with Meta's page, which still says they are free. BSP markups are not researched | Meta rate-card PDF/CSV; BSP price lists |
| RPA plus AI (UiPath, Power Automate) | Not researched | Vendor documentation |
Sources
All sources were read or queried on 11 October 2026, or on 12 October 2026 where the text says so, unless a different date is given in the text.
- GitHub: vllm-project/vllm release v0.31.0
- Wikipedia: vLLM (secondary)
- GitHub: huggingface/text-generation-inference repository and README
- GitHub REST API: huggingface/text-generation-inference latest release
- Hugging Face: Text Generation Inference documentation
- Spheron: migrating from TGI to vLLM or SGLang, 2026 (secondary)
- Markaicode: Llama 3.3 on A100 80GB latency benchmark (secondary)
- NVIDIA investor press release: NVIDIA enters production with Dynamo
- NVIDIA Developer Blog: NVIDIA Dynamo accelerates llm-d community initiatives
- Stack Overflow 2025 Developer Survey: AI section
- GitHub REST API: vllm-project/vllm repository metadata
- GitHub REST API: vllm-project/vllm latest release
- GitHub REST API: sgl-project/sglang repository metadata
- GitHub REST API: sgl-project/sglang latest release
- GitHub REST API: NVIDIA/TensorRT-LLM repository metadata
- GitHub REST API: NVIDIA/TensorRT-LLM licence file
- GitHub REST API: NVIDIA/TensorRT-LLM latest release
- GitHub REST API: ai-dynamo/dynamo repository metadata
- NVIDIA Dynamo LICENSE
- GitHub REST API: ai-dynamo/dynamo latest release
- GitHub REST API: llm-d/llm-d repository metadata
- GitHub REST API: llm-d/llm-d latest release
- GitHub REST API: ollama/ollama repository metadata
- GitHub REST API: ollama/ollama latest release
- Ollama pricing
- GitHub REST API: ggml-org/llama.cpp repository metadata
- GitHub REST API: ggml-org/llama.cpp latest release
- GitHub REST API: mudler/LocalAI repository metadata
- GitHub REST API: mudler/LocalAI latest release
- GitHub REST API: ml-explore/mlx repository metadata
- GitHub REST API: ml-explore/mlx-lm repository metadata
- GitHub REST API: ml-explore/mlx latest release
- GitHub REST API: ml-explore/mlx-lm latest release
- LM Studio homepage
- LM Studio desktop app terms (23 Aug 2026)
- GitHub REST API: lmstudio-ai/lmstudio-js repository metadata
- GitHub REST API: huggingface/text-generation-inference repository metadata
- GitHub REST API: BerriAI/litellm licence file
- GitHub REST API: BerriAI/litellm contents, enterprise
- LiteLLM pricing
- TKMX AI: LiteLLM alternatives in 2026 (competitor marketing)
- AWS Bedrock: model support by Region (read 12 Oct 2026)
- GitHub REST API: BerriAI/litellm repository metadata
- GitHub REST API: BerriAI/litellm latest release
- OpenRouter pricing
- GitHub REST API: Portkey-AI/gateway repository metadata
- GitHub REST API: Portkey-AI/gateway latest release
- Portkey pricing
- Kong AI Gateway product page
- GitHub REST API: Kong/kong repository metadata
- GitHub REST API: Kong/kong latest release
- Kong pricing
- Cloudflare AI Gateway pricing documentation
- Pinecone pricing
- Chroma pricing
- Qdrant pricing
- Turbopuffer pricing
- GitHub REST API: elastic/elasticsearch licence file
- GitHub REST API: weaviate/weaviate licence file
- OWASP GenAI: Top 10 for LLM Applications 2025
- GitHub REST API: pgvector/pgvector repository metadata
- GitHub REST API: pgvector/pgvector licence file
- GitHub REST API: qdrant/qdrant repository metadata
- GitHub REST API: qdrant/qdrant latest release
- GitHub REST API: milvus-io/milvus repository metadata
- GitHub REST API: milvus-io/milvus latest release
- Zilliz pricing
- GitHub REST API: weaviate/weaviate repository metadata
- GitHub REST API: weaviate/weaviate latest release
- Weaviate pricing
- GitHub REST API: chroma-core/chroma repository metadata
- GitHub REST API: chroma-core/chroma latest release
- GitHub REST API: lancedb/lancedb repository metadata
- GitHub REST API: lancedb/lancedb latest release
- GitHub REST API: opensearch-project/OpenSearch repository metadata
- GitHub REST API: opensearch-project/OpenSearch latest release
- GitHub REST API: elastic/elasticsearch repository metadata
- GitHub REST API: elastic/elasticsearch latest release
- Elastic pricing
- Hugging Face: Qwen/Qwen3-Embedding-8B model card
- Hugging Face: BAAI/bge-m3 model card
- Hugging Face: MTEB leaderboard
- Voyage AI pricing documentation
- Cohere pricing
- Jina AI embeddings
- OpenAI API pricing
- Unstructured pricing
- Reducto pricing
- LlamaIndex (LlamaParse) pricing
- Mistral AI pricing
- Mistral AI: Mistral OCR announcement
- Microsoft Azure: Document Intelligence pricing
- Azure Retail Prices API: Document Intelligence
- Google Cloud Document AI pricing
- AWS Textract pricing
- GitHub REST API: docling-project/docling repository metadata
- GitHub REST API: docling-project/docling latest release
- GitHub REST API: Unstructured-IO/unstructured repository metadata
- GitHub REST API: Unstructured-IO/unstructured latest release
- GitHub REST API: run-llama/llama_parse repository metadata
- GitHub REST API: run-llama/llama_parse latest release
- GitHub REST API: deepseek-ai/DeepSeek-OCR repository metadata
- GitHub REST API: microsoft/graphrag repository metadata
- GitHub: HKUDS/LightRAG repository
- GitHub REST API: neo4j/neo4j repository metadata
- arXiv:2610.08463, UNREAL: Unifying Retrieval and Long-Context with a Single Model (preprint)
- arXiv API query: "long context" AND RAG
- Claude Help Center: Use Claude's chat search and memory to build on previous context
- GitHub REST API: microsoft/graphrag latest release
- GitHub REST API: HKUDS/LightRAG repository metadata
- GitHub REST API: HKUDS/LightRAG latest release
- GitHub REST API: getzep/graphiti repository metadata
- GitHub REST API: getzep/graphiti latest release
- TechCrunch (28 Oct 2025): Mem0 raises $24M from YC, Peak XV and Basis Set
- VCBacked: Mem0 (aggregator)
- Caplight: Mem0 (aggregator)
- Pulse 2.0: Letta raises $10 million seed (secondary)
- Dealroom: Supermemory secures $2.6M (secondary)
- Let's Data Science: Supermemory raises $3M (secondary)
- VCBacked: xmemory (aggregator)
- GitHub REST API: mem0ai/mem0 repository metadata
- GitHub REST API: mem0ai/mem0 latest release
- Mem0 pricing
- GitHub REST API: getzep/zep repository metadata
- Zep README (Community Edition deprecated)
- GitHub REST API: getzep/zep latest release
- Zep pricing
- GitHub REST API: letta-ai/letta repository metadata
- GitHub REST API: letta-ai/letta latest release
- GitHub REST API: topoteretes/cognee repository metadata
- GitHub REST API: topoteretes/cognee latest release
- Cognee pricing
- GitHub REST API: supermemoryai/supermemory repository metadata
- GitHub REST API: supermemoryai/supermemory latest release
- Supermemory pricing
- GitHub REST API: MemTensor/MemOS repository metadata
- GitHub REST API: MemTensor/MemOS latest release
- GitHub REST API: langchain-ai/langmem repository metadata
- GitHub REST API: modelcontextprotocol/servers repository metadata
- modelcontextprotocol/servers LICENSE
- GitHub REST API: modelcontextprotocol/servers contents, src/memory/README.md
- Microsoft Learn: Microsoft 365 Copilot personalization and memory
- Gemini Apps Help: personal context and memory
- OpenAI Help Center: Managing workspace settings in ChatGPT Enterprise (search snippet)
- OpenAI blog: Memory and new controls for ChatGPT (search snippet)
- OpenAI Help Center: Memory FAQ, Business version (search snippet)
- MeitY: Digital Personal Data Protection Rules, 2025, G.S.R. 846(E)
- ClickHouse blog: ClickHouse acquires Langfuse
- SiliconANGLE (16 Jan 2026): ClickHouse raises $400M, acquires Langfuse
- GitHub: Langfuse discussion #11593
- Helicone blog: Helicone is joining Mintlify (3 Mar 2026)
- Promptfoo blog: agreed to be acquired by OpenAI (9 Mar 2026)
- promptfoo LICENSE
- Traceloop blog: joining ServiceNow (March 2026)
- CoreWeave 10-Q, Q2 2025 (Weights & Biases acquisition)
- Weights & Biases pricing URL (redirects to CoreWeave)
- OpenAI API deprecations
- GitHub REST API: Arize-ai/phoenix repository metadata
- LangChain (LangSmith) pricing
- OpenTelemetry: semantic conventions for generative AI
- OpenTelemetry semantic-conventions-genai: GenAI spans
- Langfuse pricing
- Helicone pricing
- Braintrust pricing
- GitHub REST API: langfuse/langfuse repository metadata
- Arize pricing
- GitHub REST API: braintrustdata/braintrust-sdk repository metadata
- GitHub REST API: Helicone/helicone repository metadata
- GitHub REST API: wandb/weave repository metadata
- Datadog pricing
- GitHub REST API: promptfoo/promptfoo repository metadata
- promptfoo homepage
- GitHub REST API: confident-ai/deepeval repository metadata
- GitHub REST API: explodinggradients/ragas repository metadata
- GitHub REST API: open-telemetry/semantic-conventions repository metadata
- CXOToday: Check Point completes acquisition of Lakera
- Check Point Q3 2025 results (press release via Seeking Alpha)
- Lakera homepage
- Snyk news: Snyk acquires Invariant Labs
- Hacker News item 44370620 (Algolia API), Snyk and Invariant Labs
- Invariant Labs: MCP security notification, tool poisoning attacks (1 Apr 2025)
- SentinelOne 8-K (Prompt Security acquisition)
- Wikipedia: Prompt Security (secondary)
- HiddenLayer homepage
- Palo Alto Networks FY2025 10-K (Protect AI acquisition)
- Meta: Llama 4 Community License
- Hugging Face: meta-llama/Llama-Guard-4-12B model card
- Hugging Face: meta-llama/Llama-Prompt-Guard-2-86M model card
- NVIDIA docs: NeMo Guardrails library overview
- NVIDIA NeMo Guardrails LICENSE.md
- GitHub REST API: guardrails-ai/guardrails repository metadata
- GitHub REST API: invariantlabs-ai/mcp-scan repository metadata
- GitHub: n8n-io/n8n LICENSE.md (Sustainable Use License)
- n8n pricing
- Toolradar: n8n pricing 2026 (secondary)
- AgentDeals: n8n (tracker, secondary)
- Temporal pricing
- Zapier MCP
- GitHub REST API: n8n-io/n8n repository metadata
- Zapier pricing
- Make pricing
- Pipedream pricing
- Activepieces pricing
- Windmill pricing
- GitHub REST API: temporalio/temporal repository metadata
- GitHub REST API: PrefectHQ/prefect repository metadata
- Prefect pricing
- GitHub REST API: apache/airflow repository metadata
- Retell AI pricing
- Morph: best AI voice agent platforms 2026 (secondary)
- Vapi pricing
- AI Agent Rank: Vapi vs Retell vs Bland 2026 (secondary)
- Bland AI pricing
- Bland AI blog: voice AI pricing for enterprise (vendor-authored)
- Synthflow pricing
- LiveKit pricing
- Sarvam AI API pricing
- Plivo: voice pricing for India (vendor-reported)
- Plivo pricing
- Bolna pricing (vendor-reported)
- Exotel pricing
- Exotel blog: migrating from Twilio (search summary; not read directly)
- edesy: Exotel AI voice agent (reseller; search summary)
- Twilio: voice pricing for India
- TRAI Direction of 4 May 2024 (DLT-based voice calling)
- Comments on the draft TCCCPR Third Amendment Regulations 2026 (hosted by TRAI)
- GitHub REST API: livekit/agents repository metadata
- GitHub REST API: pipecat-ai/pipecat repository metadata
- ElevenLabs pricing
- Deepgram pricing
- AssemblyAI pricing
- Cartesia pricing
- Meta for Developers: WhatsApp Business Platform pricing
- ChatMaxima: WhatsApp API pricing in India (vendor-reported)
- Gallabox: WhatsApp pricing overview (vendor-reported)
- Authkey: WhatsApp API pricing update (secondary)
- TelecomTalk: WhatsApp Business price reveal (secondary)
- GitHub: FlowiseAI/Flowise discussion #6727, The Future of Flowise
- GitHub REST API: langgenius/dify repository metadata
- Microsoft Learn: Copilot Studio billing and licensing
- Dify pricing
- GitHub REST API: langflow-ai/langflow repository metadata
- GitHub REST API: FlowiseAI/Flowise repository metadata
- Botpress pricing
- Voiceflow pricing
- Stack AI pricing
- Relevance AI pricing
- E2E Networks: TIR inference endpoints (vendor-reported)
- Yotta Shakti Cloud: AI endpoints (vendor-reported)