AI automation research · What you need

The Production Tool Stack for AI Automation

Updated About 67 min read 504 source links

All research documents

Start here

AI models

Who is doing it

What you need

Countries

Reference

On this page
  1. Key takeaways (as of 12 October 2026)
  2. This document covers the layers around the model, not the agent framework
  3. Serving and routing: one engine to self-host, one gateway in front of everything
  4. The retrieval layer can start almost free and scale into monthly minimums
  5. Memory layers compete on governance, and most of it is unpublished
  6. Observability, evaluation and guardrails changed owners in 2026
  7. Automation surfaces: workflow engines, voice, WhatsApp and low-code builders
  8. Licence traps to check when you or a partner runs a tool for you
  9. Three reference stacks: budget SME, privacy-first self-hosted, enterprise and regulated
  10. What this means for your business
  11. Open questions and unverified items
  12. Sources

Key takeaways (as of 12 October 2026)

  • Serving: vLLM (Apache-2.0, 93,564 stars, v0.31.0 on 5 Oct 2026) is the default open GPU engine and SGLang the main alternative. Hugging Face's TGI was archived read-only on 21 Mar 2026; do not use it for new work.
  • Routing: LiteLLM's MIT proxy is free and already has budgets, rate limits and fallbacks. Hosted routers charge on top of model spend: OpenRouter 5.5% (Standard) or 8% (Business). No vendor's own API processes requests in India; AWS Bedrock's in. profiles keep calls to the previous Claude generation, Kimi K3 and GPT-5.6 Terra/Luna in India, while the newest models have no documented India processing.
  • Retrieval: pgvector, Docling (MIT) and open-weight embeddings (Qwen3-Embedding, BGE-M3) carry no licence fees. Hosted parsing costs about $1.25 (LlamaParse basic), $15 (Unstructured) or $10–$40 (Reducto) per 1,000 pages.
  • Memory: Mem0 leads on stars (66,978) and disclosed funding ($24M). Audit logs, SSO, SOC 2 and HIPAA BAAs are enterprise-tier features at almost every vendor read, and no vendor page read details retention or PII handling. Claude org owners cannot read members' memories; Microsoft 365 Copilot memories are discoverable in Purview but are not covered by retention policies.
  • Ownership churn: Weights & Biases (CoreWeave, $1.0B, May 2025), Invariant Labs (Snyk), Protect AI (Palo Alto Networks, $634.5M, July 2025), Prompt Security (SentinelOne, about $180M, September 2025), Lakera (Check Point), Langfuse (ClickHouse), Helicone (Mintlify; now in maintenance mode), promptfoo (OpenAI) and Traceloop (ServiceNow) have all been acquired or agreed to be acquired since May 2025.
  • Licence traps: n8n's Sustainable Use License limits use to "your own internal business purposes or for non-commercial or personal use". Dify may not be run as a multi-tenant service without Dify's written authorisation. Phoenix's ELv2 bans providing it to third parties as a hosted or managed service. Flowise was archived on 13 Aug 2026 and reached end of life on 31 Aug 2026. LM Studio's app terms allow only personal or internal business use and bar SaaS, ASP or service-bureau use. All five were re-read on 12 Oct 2026.
  • Voice: Retell's own page puts all-in voice-agent cost at $0.07–$0.31 a minute. Vapi's own page lists a $0.05 a minute platform fee plus component costs, and secondary comparisons put the all-in cost at 2.6–6.2 times that fee. Three vendors publish INR prices (vendor-reported): Sarvam (STT ₹30 an hour, TTS ₹3 per 1,000 characters), Plivo India (calls ₹0.38 and ₹0.25 a minute, transcription ₹0.81 a minute) and Bolna (voice agents ₹5.52 a minute on its pilot plan).
  • WhatsApp India: businesses whose Meta Sold-To country is India must move all their WhatsApp Business Accounts (WABAs) to INR billing by 31 Dec 2026, or Meta stops delivering those accounts' messages on 1 Jan 2027. Two vendor pages describe a charge from 1 Oct 2026 for service messages beyond 1,000 free per business phone number a month, at the utility rate (₹0.1150 excluding GST). Meta's own page did not confirm it (vendor-reported).

This document covers the layers around the model, not the agent framework

A model API on its own does not make a production automation. A working deployment also needs something to serve or route model calls, a place to store and search company documents, a parser that turns PDFs and scans into clean text, a memory that persists across sessions, traces and tests that show what the system did, guardrails that screen what goes in and out, and the workflow, voice, messaging and builder tools that connect it all to a business process. This document maps those supporting layers as of 12 October 2026 (licences, prices, deals and India-specific rates were re-checked against primary sources that day), for Indian SMEs, US and global companies, and the IT and operations leaders who run their automation. It leaves out agent SDKs, protocols such as MCP and A2A, coding agents and browser agents, which are covered in Agent frameworks and protocols. GPU choices are in Hardware, unit economics and pricing models in Costs, regulation including India's DPDP Act in Governance, and terms in the Glossary.

Method. GitHub stars, licences, archived flags and latest releases come from the GitHub REST API, queried on 11 Oct 2026. "Latest release" means the release GitHub flags as latest. Sometimes that is a sub-package or SDK tag rather than the product's headline version, and the tables say so where it happens. Prices are list prices read from vendor pricing pages on the same day. They are in USD unless stated otherwise, and INR billing, GST treatment and India-region availability were not confirmed for any USD-priced tool vendor (AWS Bedrock's India routing for model calls is noted under gateways). Labels used throughout: "vendor claim" marks a vendor's own statement about performance or traction; "secondary" marks third-party blogs, trackers or aggregators; "single source" marks a figure that only one source supports. Where research passes disagree, the later reading of a primary page is preferred, and the conflict is shown.

Layer Job in production Open-source default Hosted default Main watch-out
Inference serving Runs open-weight models on owned or rented GPUs vLLM; SGLang Model provider APIs TGI archived; no independent 2026 benchmark
Gateway / router One API across providers, with keys, budgets and fallbacks LiteLLM (MIT core) OpenRouter, Portkey, Cloudflare AI Gateway Percentage fees; SSO and audit logs only on enterprise tiers
Vector store Similarity search over embeddings pgvector; Qdrant Pinecone; Zilliz; Qdrant Cloud Monthly minimums; India regions not confirmed
Embeddings and rerankers Turn text into vectors; reorder search results Qwen3-Embedding; BGE-M3 Voyage; Cohere; Jina Indian-language quality untested
Document parsing / OCR PDF, Office files and scans to clean text Docling; Unstructured; DeepSeek-OCR Reducto; LlamaParse; Mistral OCR Per-page cost at volume; Indic scripts untested
GraphRAG Entity graph for multi-hop questions Microsoft GraphRAG; LightRAG — Indexing must be paid again on every corpus change
Memory layer Keeps user and organisation facts across sessions Mem0; Graphiti; Cognee; Supermemory Mem0, Zep and Supermemory clouds Governance only on enterprise tiers
Observability and evaluation Traces, cost, quality tests Langfuse; promptfoo; DeepEval LangSmith; Braintrust; Datadog Ownership changes; Phoenix is ELv2
Guardrails and security Screen prompts and outputs; scan tools Llama Guard 4; Prompt Guard 2; Guardrails AI; MCP Scan Lakera; Prompt Security; HiddenLayer Acquisitions; Llama licence conditions
Workflow and orchestration Triggers, integrations, durable steps Activepieces; Windmill; Temporal; Prefect; Airflow; n8n (source-available) Zapier; Make; Pipedream; Temporal Cloud n8n licence
Voice Speech-to-text, LLM, text-to-speech and telephony in real time LiveKit Agents; Pipecat Vapi; Retell; Bland; Synthflow All-in cost per minute
WhatsApp (India) Template and service messaging — Meta's WhatsApp Business Platform, directly or through a partner (BSP) INR migration by 31 Dec 2026
Low-code builders Visual agent and workflow building Langflow (MIT); Dify (modified Apache) Botpress; Copilot Studio; Stack AI Flowise archived; Dify multi-tenant clause

Serving and routing: one engine to self-host, one gateway in front of everything

vLLM and SGLang lead GPU serving after TGI's archival

vLLM is the engine to evaluate first. It has 93,564 stars and shipped v0.31.0 on 5 Oct 2026 (vLLM release). SGLang, the main challenger, has 36,990 stars and shipped v0.5.21 on 2 Oct 2026. Both are Apache-2.0, so self-hosting has no per-seat fee; the costs are GPU hours and staff time. An earlier research pass cited v0.30.0 (22 Sep 2026) from a Wikipedia snapshot (Wikipedia: vLLM). The GitHub API shows that snapshot is stale, and the API value is used here.

Hugging Face's Text Generation Inference shows what happens when an engine is retired. Its README says TGI "is now in maintenance mode" and will accept only minor bug fixes, documentation and lightweight maintenance. The repository was archived and made read-only on 21 Mar 2026 (banner re-read on 11 Oct 2026), and its last release was v3.3.7 on 19 Dec 2025 (TGI repository; TGI release). TGI's own documentation points users to "vllm, SGLang, as well as local engines with inter-compatibility such as llama.cpp or MLX" (TGI docs). A third-party migration guide dates the switch to maintenance mode to 11 Dec 2025, and sources disagree on whether TGI still gets security fixes (secondary, unverified) (Spheron migration guide). Existing TGI deployments can keep running, but each needs a migration plan.

No independent 2026 benchmark separates the leading engines. The only throughput comparison found is a single secondary benchmark on one A100 80GB configuration. It gave vLLM 2–24x TGI's throughput, while TGI had a lower time-to-first-token at low concurrency, and it has not been reproduced (Markaicode benchmark). Choosing between vLLM, SGLang and TensorRT-LLM therefore comes down to benchmarking each on the target model and hardware.

Above a single node, NVIDIA Dynamo and llm-d take over. NVIDIA announced Dynamo 1.0 as an open-source inference platform, with integrations for llm-d, vLLM, SGLang, LangChain and LMCache and three standalone modules: KVBM (KV-cache memory manager), NIXL (GPU-to-GPU transfer) and Grove (scaling). NVIDIA claims up to 7x higher inference performance on Blackwell (vendor claim) (NVIDIA press release). The March 2026 date for 1.0 comes from secondary coverage, and the current release is v1.5.1, so 1.0 is now an early milestone. llm-d "extends the capabilities of vLLM with Kubernetes-native architecture for large-scale inference deployments" and uses NIXL to move the KV cache between prefill and decode. Its community launched at Red Hat Summit 2025 (NVIDIA Developer Blog). Both add Kubernetes and NVIDIA dependencies, so they are worth adopting only when multi-node or disaggregated serving is a real requirement.

Local runtimes are developer tools rather than production servers. Ollama has 182,754 stars, the most in the category, and Stack Overflow's 2025 survey found that 51% of developers building agents use it (Stack Overflow 2025 AI survey). That figure measures developer reach, not support for multi-tenant production. GPU sizing and hardware cost are covered in Hardware. INR pricing for GPU cloud in Indian data centres was not checked here; India quotes E2E Networks' current H100 rates.

Engine Licence Latest release (date) GitHub stars Price Self-host Best fit
vLLM Apache-2.0 v0.31.0 (5 Oct 2026) 93,564 Free; GPU cost only Yes General GPU serving; broadest model support
SGLang Apache-2.0 v0.5.21 (2 Oct 2026) 36,990 Free Yes High-throughput serving; benchmark against vLLM per model
TensorRT-LLM Apache-2.0 per the LICENSE file (API: NOASSERTION) v1.2.1 (20 Apr 2026); repo still pushed 11 Oct 2026 14,793 Free; NVIDIA GPUs only Yes NVIDIA-tuned latency and throughput
NVIDIA Dynamo Apache-2.0 per the LICENSE file (API: NOASSERTION); the NOTICE says test data under lib/llm/tests/data/deepseek-v3.2 derives from DeepSeek-V3.2 v1.5.1 (7 Oct 2026) 8,258 Free Yes, designed for multi-node Datacenter-scale distributed serving and KV-cache management
llm-d Apache-2.0 v0.10.0 (29 Sep 2026) 4,792 Free Yes, on Kubernetes Large-scale Kubernetes serving built on vLLM
Ollama MIT v0.40.3 (11 Oct 2026) 182,754 Local use free; cloud plans $0, $20/mo ($200/yr) and $100/mo (page labels unclear) Yes Developer laptops; simplest local runner
llama.cpp MIT v0.6.0 (5 Oct 2026) 130,829 Free Yes CPU, edge and quantised (GGUF) inference
LocalAI MIT v4.11.0 (2 Oct 2026) 49,472 Free Yes OpenAI-compatible self-hosted API for LLM, vision, voice and image
MLX / mlx-lm MIT / MIT MLX v0.32.3 (29 Sep 2026); mlx-lm v0.31.3 (22 Apr 2026) 28,724 / 7,268 Free Yes (Apple silicon) Mac laptops and Mac servers
LM Studio Desktop app under the LM Studio app terms (23 Aug 2026): "solely for Your personal and / or internal business purposes"; bars sublicensing, distribution and "service bureau use, as an application service provider, or a software-as-a-service"; SDK lmstudio-js MIT No GitHub release 1,788 (SDK) Internal business use allowed; no service to third parties Yes (desktop) Individual or internal desktop use; not for hosting a service for third parties
Hugging Face TGI Archived 21 Mar 2026 v3.3.7 (19 Dec 2025) not recorded — Not for new work Migrate to vLLM or SGLang

Gateways split between a free MIT proxy and hosted routers that charge 5–8 percent

A gateway gives one API key across model providers and is where budgets, rate limits, fallbacks and logs are enforced. LiteLLM is the open-source default: an MIT core with 60,964 stars, v1.105.0 released on 11 Oct 2026, and an enterprise/ directory under a separate licence (LiteLLM licence; enterprise directory). The free self-hosted tier already includes virtual keys, users and teams, spend tracking, budgets, rate limits, fallbacks and logging. Enterprise is billed annually, "sized to your usage" and "never per token". It adds SSO with SCIM, OIDC/JWT, audit logs, secret-manager integration, RBAC, a multi-region control plane, a 24/7 SLA and air-gapped deployment (LiteLLM pricing). The pricing page still shows 58.8k stars, which the API figure supersedes. Self-hosting is not free in practice: it needs a server or Kubernetes pod, Redis for caching and engineering time. That cost list comes from a competitor's marketing, so it is biased (TKMX AI).

Hosted routers charge as a share of model spend, or else on logs. On $1,000 of monthly model spend, OpenRouter's fee is $55 on Standard or $80 on Business. On $1,000 of credits, Cloudflare's Unified Billing adds $50. (These are computed from list percentages.) The governance features worth paying for are tied to tiers. OpenRouter's in-region routing for the EU and US needs Business. Portkey's VPC deployment, SOC 2 Type 2 and HIPAA BAAs need Enterprise. Self-hosted LiteLLM keeps the whole data path inside your own cloud. Data residency therefore narrows the shortlist more than price does. Portkey's pricing page gives overages as "+$9 per additional 100k requests" while metering the tier in recorded logs, so confirm the unit on a live account. Azure API Management and OpenRouter's data-retention terms were not researched. AWS Bedrock's India-geography cross-region profiles (in. prefix) route only to Mumbai and Hyderabad for Claude Opus 5, Sonnet 5, Haiku 4.5, Kimi K3 and GPT-5.6 Terra/Luna; the newest models (Claude 5.5, GPT-6) are global-only from India. AWS says not to rely on the prefix alone (call GetInferenceProfile) (Bedrock regional availability).

Gateway Licence / form Latest release (date) GitHub stars Price (list) Self-host Best fit
LiteLLM MIT core; enterprise/ under separate licence v1.105.0 (11 Oct 2026) 60,964 Open source $0; Enterprise annual, quoted Yes; air-gapped on Enterprise Self-hosted multi-provider proxy with budgets and fallbacks
OpenRouter Hosted service n/a n/a Fee of 5.5% (Standard, pay-as-you-go) or 8% (Business); Enterprise discounts; free tier 50 requests/day No Many models without separate provider accounts
Portkey Gateway MIT; hosted control panel v1.15.2 (12 Jan 2026); repo last pushed 25 May 2026 13,166 Developer free (10k logs/mo, 3-day retention); Production $49/mo (100k logs, +$9 per 100k, 30-day logs, RBAC); Enterprise custom Yes, on Enterprise Hosted routing with observability and guardrails built in
Kong AI Gateway Kong Gateway Apache-2.0; AI Gateway is a Konnect product 3.9.3 (17 Jun 2026) 44,260 (Kong repo) Sales-led; promotion of "$100k credits & 50% off AI Gateway" Yes (self-managed Kong) Firms already running Kong for APIs
Cloudflare AI Gateway Hosted service n/a n/a Core free (analytics, caching, rate limiting); gateways created from 24 Sep 2026 use Workers Logs pricing; DLP free; guardrails billed as Workers AI tokens (Llama Guard 3 8B); 5% fee on Unified Billing credits No Teams on Cloudflare wanting low-cost caching and analytics

The retrieval layer can start almost free and scale into monthly minimums

Start with pgvector; Pinecone's $50 minimum pays off only on steady traffic

Open-source vector stores are mature and mostly permissively licensed, but managed pricing comes in four shapes that resist like-for-like comparison: monthly minimums plus usage (Pinecone pricing), per-GiB writes and storage (Chroma pricing), cluster resources with a free-forever tier (Qdrant pricing), and minimums with bring-your-own-cloud (BYOC) options (Turbopuffer pricing). For most business projects with a few million vectors, pgvector in a Postgres you already run is the lowest-risk first step. A dedicated store earns its place once filtering, scale or latency demands it, and a monthly minimum is a fixed cost that low-traffic pilots never use up.

Two licence details need attention. Elasticsearch is licensed under AGPL-3.0, SSPL-1.0 or Elastic License 2.0 depending on the directory (Elasticsearch licence). Weaviate is licensed under BSD-3-Clause or the Weaviate License, also by directory (Weaviate licence). Check the directory before either is embedded in a product you ship or one a partner builds for you. Release cadence is also worth checking: Chroma's latest GitHub release dates from 5 May 2026, five months before this snapshot. The vector store is also an attack surface: OWASP's 2025 LLM Top 10 lists "Vector and Embedding Weaknesses" as LLM08 (OWASP LLM Top 10; see Governance). No 2026 independent benchmark of recall or latency was found, and this research did not confirm a managed India region for any vendor. That decides whether a managed store can keep your data in India.

Store Licence Latest release (date) GitHub stars Managed price (list) Self-host Best fit
pgvector PostgreSQL License (per LICENSE header) No GitHub releases 23,301 Runs on any managed Postgres Yes Existing Postgres apps; small-to-mid corpora
Qdrant Apache-2.0 v1.19.2 (5 Oct 2026) 35,033 Free cluster; paid by resources (rates not captured) Yes Filter-heavy search, self-hosted or cloud
Milvus / Zilliz Apache-2.0 (Milvus) v3.0.2 (20 Sep 2026) 46,350 Zilliz: free tier; Serverless from $0 (vCU-based); Dedicated from $126/GB/mo as captured Yes Very large corpora; GPU index options
Weaviate BSD-3-Clause or Weaviate License, by directory v1.40.0 (7 Oct 2026) 16,875 Free (100k objects, 1 GB memory, 10 GB disk); Flex from $45/mo; Premium prepaid; embeddings $0.025–$0.065 per 1M tokens Yes Hybrid search with built-in vectorisers
Chroma Apache-2.0 1.5.9 (5 May 2026) 29,478 Starter $0 + $5 credits; write $2.50/GiB; storage $0.33/GiB/mo; query $0.0075/TiB; network $0.09/GiB Yes Prototypes and small-to-mid apps
LanceDB Apache-2.0 v0.40.0 (7 Oct 2026) 11,638 Cloud not checked Yes (embedded library) Embedded and multimodal data on object storage
OpenSearch Apache-2.0 3.9.0 (29 Sep 2026) 13,844 Managed via AWS (not checked) Yes Hybrid keyword-plus-vector search for existing users
Elasticsearch AGPL-3.0, SSPL-1.0 or ELv2, by directory v9.5.5 (6 Oct 2026) 78,226 Elastic Cloud (not extracted) Yes Search-first teams already on Elastic
Pinecone Closed, managed n/a n/a Starter free; Builder $20; Standard $50 min; Enterprise $500 min BYOC (GA) Fully managed, low ops
Turbopuffer Closed, managed n/a n/a $16/mo minimum; $256/mo tier; audit log streams +$128/mo; customer-managed encryption keys (CMEK) per namespace from $4,096/mo BYOC only Search at scale backed by object storage

Open-weight embeddings remove per-token fees; hosted ones start at $0.02 per million tokens

Open-weight embedding models are now competitive and permissively licensed. Qwen3-Embedding (0.6B, 4B and 8B) is Apache-2.0, and its model card states the 8B model ranked first on the MTEB multilingual leaderboard "as of June 5, 2025, score 70.58". That is a dated vendor claim and does not describe the 2026 ranking (Qwen3-Embedding-8B card). BGE-M3 is MIT and supports dense, multi-vector and sparse retrieval in 100+ languages, per its card (BGE-M3 card). The current MTEB leaderboard could not be read because it renders in JavaScript (MTEB leaderboard), so no 2026 ranking supports any model choice here.

Among hosted options, Voyage publishes the clearest per-token list prices. Embedding a 1-billion-token corpus once would cost about $20 on voyage-4-lite, $60 on voyage-4 or $120 on voyage-4-large, before the first 200M free tokens (computed from Voyage's per-1M-token list prices) (Voyage pricing). Cohere lists dedicated Embed 5 instances from $2,000 a month; per-token API rates also appear on its page, but their column mapping was unclear (Cohere pricing). Jina publishes rate limits rather than per-token prices in the captured text (Jina embeddings). OpenAI's embedding prices were not in the fetched text of its pricing page (OpenAI pricing). The researchers' working view is that adding a reranker usually buys more quality per dollar than switching embedding models. That is an inference, not a tested result. Retrieval quality for Hindi, other Indic scripts and code-mixed text was not tested for any model, so vendors' multilingual claims should not be read as covering Indian languages. Indian languages covers the Indic benchmarks and embedding options.

Model / vendor Form and licence Version noted GitHub stars Price (list) Self-host Best fit
Voyage AI Hosted API voyage-4-large, voyage-4, voyage-4-lite; rerank-3, rerank-3-lite; voyage-multimodal-3.5 n/a $0.12 / $0.06 / $0.02 per 1M tokens; first 200M tokens free; rerank-3 $0.05, rerank-3-lite $0.02; multimodal $0.12 per 1M text tokens plus per-pixel image pricing No Low-cost hosted embeddings and reranking
Cohere Hosted API and dedicated deployments Embed 5 Fast, Embed 5 Pro; Rerank n/a Dedicated per month: Embed 5 Fast Small $2,000, Medium $3,250; Embed 5 Pro Small $2,000; per-token mapping unclear Dedicated instance Firms wanting a dedicated embedding instance
Jina AI Hosted API; open weights for v5-text and v5-omni (licence not checked) v5-text small (677M) and nano (239M), 32K context; v5-omni-small (1.6B); Reranker n/a Prepaid tokens (rates not extracted); reranker free key 500 RPM / 2M TPM, paid 5,000 RPM / 50M TPM Partly (GGUF/MLX quantised weights) High-rate-limit reranking ("SOTA" claims unverified)
Qwen3-Embedding Open weights, Apache-2.0 0.6B, 4B, 8B n/a Free (self-host) Yes Multilingual self-hosted retrieval
BGE-M3 (BAAI) Open weights, MIT Model card n/a Free (self-host) Yes Dense, multi-vector and sparse retrieval in one model
OpenAI embeddings Hosted API Not captured n/a Not extracted No —

Document parsing ranges from free to $40 per 1,000 pages

Retrieval can only find what the parser extracted, and the open-source parsers are strong. Docling (MIT, 68,677 stars, v2.137.0 on 9 Oct 2026) converts PDFs and Office files into layout-aware Markdown or JSON, and Unstructured (Apache-2.0) handles ETL-style partitioning and chunking. Both run in-house. Hosted parsers charge per page, and at volume the differences are large. At list prices, 100,000 pages a month cost about $1,350 on Unstructured (90,000 billable pages after the 10,000 free, at $0.015) (Unstructured pricing). The same volume costs $1,000–$4,000 on Reducto, depending on endpoint tier (Reducto pricing), and about $112.50 on LlamaParse's basic mode (90,000 credits after the 10K monthly free credits, at $1.25 per 1,000). Agentic LLM or VLM parsing costs more credits per page (LlamaParse pricing). All three figures are computed from list prices.

Mistral prices OCR per 1,000 pages, but the dollar figure was missing from the fetched text. Batch processing halves the price, and Mistral claims up to 2,000 pages a minute on one node (vendor claim) (Mistral pricing; Mistral OCR). Azure Document Intelligence's page renders in JavaScript (Azure pricing), but the Azure Retail Prices API lists Read at $0.60 or $1.50 per 1,000 pages (two unlabelled rows, unresolved), prebuilt models at $10 and custom models at $30 per 1,000 pages. Google Document AI Enterprise OCR costs $1.50 per 1,000 pages (1,000–5M pages; $0.60 above 5M) (Document AI pricing), and AWS Textract Detect Document Text costs $0.0015 a page for the first 1M (Textract pricing). The sensible default is to start with Docling or Unstructured and add a hosted parser only where accuracy on tables or handwriting falls measurably short. Indic-script OCR (Hindi, Tamil, Bengali) was not tested for any tool, so run a pilot on your own scans before relying on any accuracy claim. Indian-language OCR and document AI, with rupee page prices, are compared in Indian languages.

Tool Licence / form Latest release (date) GitHub stars Price (list) Self-host Best fit
Docling MIT v2.137.0 (9 Oct 2026) 68,677 Free Yes Layout-aware PDF and Office conversion for RAG
Unstructured Apache-2.0 0.27.25 (10 Oct 2026) 15,558 10,000 free pages, then $0.015/page Yes ETL-style partitioning and chunking
LlamaParse Commercial ("not open source"); repo MIT; LiteParse is the local OSS parser llama-cloud-services-py 0.6.94 (13 Feb 2026), an SDK tag 4,269 10K free credits/mo; $50 = 40K credits; $500 = 400K; basic from 1 credit/page Partly (LiteParse) Agentic parsing of complex tables and forms
Mistral OCR Hosted API (mistral-ocr-latest) n/a n/a Per 1,000 pages (figure not captured); batch halves price No Fast bulk OCR
DeepSeek-OCR Open weights, MIT No GitHub release; last push 27 Jan 2026 23,926 Free Yes Self-hosted OCR with optical compression
Reducto Closed, hosted n/a n/a $150 free credit; $10, $20 or $40 per 1,000 pages by tier ($40 tier not re-read on 12 Oct; 12 Oct read: Parse from $10, Extract from $20, parse included); migration credits up to $5,000 No High-accuracy table and form extraction
Azure Document Intelligence Hosted (Microsoft) n/a n/a Read $0.60 or $1.50 per 1,000 pages (unresolved rows); prebuilt $10; custom $30 (Retail Prices API) Containers (not checked) Microsoft-stack shops
Google Document AI (Enterprise Document OCR) Hosted n/a n/a First 1,000 pages free; $1.50 per 1,000 (1K–5M); $0.60 above 5M No Google Cloud shops
AWS Textract Hosted n/a n/a Detect Document Text $0.0015 a page (first 1M) No AWS shops
Sarvam document digitisation Hosted, INR n/a n/a ₹0.50 a page; extraction ₹1.00 a page (vendor) No INR-billed Indian-language documents

GraphRAG earns its indexing bill only on multi-hop questions

Graph-based retrieval builds an entity-and-relation graph from the corpus. That helps with questions that span several documents, but every chunk costs LLM calls to index, and the cost recurs whenever the corpus changes. Microsoft GraphRAG (MIT, v3.3.0 on 8 Oct 2026) and LightRAG (MIT, 40,068 stars, v1.5.7 on 2 Sep 2026) are the two most-starred open frameworks (GraphRAG; LightRAG). LightRAG describes itself as an EMNLP 2025 paper, and its authors report faster indexing, which was not verified here. Neo4j is the mature graph-database option for GraphRAG pipelines. Its community repository is GPL-3.0, enterprise use requires a commercial licence, and its GitHub "latest release" is a 2017 alpha tag that cannot be used for version tracking (Neo4j). The pattern that fits is a stable, entity-heavy corpus such as contracts, policies or research. For FAQ-style support, GraphRAG usually costs more than plain RAG (inference, not benchmarked). No independent 2026 benchmark comparing GraphRAG with plain RAG on accuracy and cost was found.

The wider "RAG versus long context" debate is moving toward hybrids. A preprint submitted on 6 Oct 2026, UNREAL, uses one model-internal mechanism to select evidence both from a corpus and from inside a long prompt. It reports HotpotQA recall rising from 49.1% to 73.2%, 2WikiMultiHopQA from 31.7% to 60.1%, and NoLiMa accuracy from 1.0% to 24.83% at 128K tokens. It also reports lower FLOPs and time-to-first-token than full-context inference from about 32K tokens upward. These are the authors' own, non-peer-reviewed results (arXiv:2610.08463). The field is active: an arXiv query for "long context" AND RAG returned 249 papers on 11 Oct 2026 (arXiv query). Vendors' own memory features are built on retrieval: Claude's chat-memory search "use[s] Retrieval-Augmented Generation (RAG)" exposed as tool calls (Claude Help Center). The practical default is retrieval first (vector, keyword or hybrid), long context for the top results or for a single long document, and agentic search over an index for open-ended questions. Prompt length still drives cost and latency, so retrieval keeps mattering even as context windows grow.

Tool Licence Latest release (date) GitHub stars Price Self-host Best fit
Microsoft GraphRAG MIT v3.3.0 (8 Oct 2026) 36,289 Free; LLM and embedding calls billed by provider Yes Reference graph-based RAG
LightRAG MIT v1.5.7 (2 Sep 2026) 40,068 Free Yes Lighter GraphRAG alternative
Neo4j (community) GPL-3.0; commercial licence for enterprise Not usable (2017 alpha tag) 17,293 Enterprise pricing not checked Yes Graph database under GraphRAG pipelines
Graphiti Apache-2.0 v0.30.2 (8 Sep 2026) 31,642 Free Yes Temporal knowledge graph for agent memory

Memory layers compete on governance, and most of it is unpublished

Open-source memory engines: Mem0 leads on stars and disclosed funding

A memory layer stores facts about users, customers and the organisation so an assistant or agent can use them in later sessions. The open-source field is crowded: Mem0 has 66,978 stars, Cognee 32,012, Graphiti 31,642, Supermemory 31,185, Letta 25,102 and MemOS 11,813. Commercially there are two patterns. One is a venture-funded managed service (Mem0, Zep). The other is a deploy-anywhere open-source engine that sells enterprise support, BYOC or air-gapped installs (Cognee, Supermemory).

Funding is verified only for Mem0. TechCrunch reported $24M in total, a $3.9M seed plus a $20M Series A led by Basis Set Ventures, with Kindred, Y Combinator, Peak XV and GitHub Fund, announced on 28 Oct 2025 (TechCrunch). Aggregators disagree on the total: VCBacked lists $20.0M (VCBacked: Mem0), and Caplight lists about $24.4M with a $150M valuation estimate (Caplight: Mem0). TechCrunch's primary report is preferred because it gives the round breakdown. The same article carries company-stated traction at the time: 41k+ stars, 13M+ Python downloads, 80k+ cloud signups, and a claim to be the "exclusive memory provider" for AWS's new Agent SDK (company claims). Letta raised a $10M seed led by Felicis, dated to September 2024 by one listing (secondary) (Pulse 2.0). Supermemory's seed is reported as about $2.6M (Dealroom) or $3M (Let's Data Science), and the amount is disputed. Smaller 2026 rounds include xmemory (London), reported at $4.0M pre-seed in March 2026 (secondary, unverified) (VCBacked: xmemory). No funding was found for Zep or Cognee, and a 2026 round reported for MemOS's developer MemTensor gave no clear amount (secondary, unverified). In the disclosed sample, rounds run from about $2.6M to $24M, which suggests few players have the capital for heavy enterprise-governance engineering. That is an inference from a small sample.

Product Licence / deployment Latest release (date) GitHub stars Price (list) Self-host Governance (vendor page) Best fit
Mem0 Apache-2.0; OSS plus hosted cloud TS SDK ts-v3.3.1 (25 Sep 2026) 66,978 Hobby free (10k add, 1k retrieval requests/mo); Starter $19/mo (50k add, 5k retrieval); Pro $249/mo (500k add, 50k retrieval); Enterprise custom Yes (OSS) Audit logs, SSO and custom integrations on Enterprise only Managed memory API with the largest community
Zep Hosted (Zep Cloud). Zep Community Edition is deprecated and unsupported (code in legacy/, Apache-2.0); Graphiti (Apache-2.0) is the open successor (README) zep-ingest-v0.3.0 (28 Aug 2026) 4,955 (examples repo) Credit-based self-serve (prices not extracted); Enterprise custom with SLA Enterprise options (not read) SOC 2 Type II and HIPAA BAA on Enterprise Regulated buyers wanting managed memory
Graphiti (Zep) Apache-2.0 v0.30.2 (8 Sep 2026) 31,642 Free Yes Operator's responsibility Self-hosted temporal knowledge graph
Letta Apache-2.0; stateful agents platform 0.16.8 (14 May 2026); repo pushed 10 Sep 2026 25,102 Pricing page not readable Yes Not read Stateful agents (framework view in Agent frameworks)
Cognee Apache-2.0; "run the full memory engine locally... free, forever" v1.6.3 (7 Oct 2026) 32,012 Free $0/mo, $1.00 per 1M tokens, +$5 per extra workspace; Enterprise BYOC in customer VPC Yes SSO on Startup and Enterprise; BYOC; SLAs Deploy-anywhere engine with BYOC enterprise path
Supermemory MIT; "can be run fully locally" server-v0.0.8 (17 Aug 2026) 31,185 Free ($5 credits); $19 ($20 incl.); $100 ($130 incl.); $399 ($600 incl.); Enterprise Yes; air-gapped on Enterprise SOC 2, HIPAA BAA, GDPR, SSO, Enterprise MCP Self-host or managed; 187 ms median recall and 100B+ tokens/month (vendor claims)
MemOS Apache-2.0; "self-evolving memory OS" v2.0.34 (23 Sep 2026) 11,813 Not checked Yes Operator's responsibility Research-led self-hosted memory
LangMem MIT No GitHub release; last push 2 Oct 2026 1,700 Free Yes Operator's responsibility LangChain-ecosystem memory
MCP memory server (reference) Mixed: new contributions Apache-2.0, docs CC-BY-4.0, un-relicensed contributions MIT (LICENSE read; API: NOASSERTION) Repo v1.0.0 (11 Oct 2026) 91,143 (whole servers repo) Free Yes README describes no access control, audit or retention Single-user local knowledge graph; not a product

Native assistant memory: four vendors, four admin models

The assistants that companies already license have their own memory, and the admin models differ in ways that matter to a compliance officer. Claude has the most detailed published admin model among the pages read (Claude Help Center). On Team and Enterprise, owners switch memory on for the organisation and each member stays off until they opt in. Owners cannot view or edit individual memories, and switching org memory off deletes all memory for all users immediately. The audit log records only the org-level switch. Microsoft 365 Copilot takes the opposite approach. Memory is on by default under a tenant "Enhanced personalization" control. Memories are stored in a hidden folder in each user's Exchange mailbox, and admins can search, export and delete them through Purview eDiscovery and Graph. But admins cannot restrict what is saved, and Purview retention policies do not apply to memory (Microsoft Learn). Gemini's personal-context features "are not available while signed in to a work, school, or supervised account" (Gemini Apps Help). ChatGPT's Business and Enterprise help pages returned HTTP 403, so its controls are known only from search snippets, below. Model-level detail is in Claude, OpenAI and Gemini.

Product Who gets memory Admin controls Retention and deletion Audit and export Limits
Claude (Team, Enterprise) On by default for Free, Pro and Max; on Team and Enterprise the owner enables it and each member opts in Owners enable it in Organization settings > Capabilities; separate "sensitive topics" control; owners cannot view or edit individual memories Deleting a chat does not delete related memories; users delete single memories or reset; encrypted at rest; memories created before a retention policy are not removed Audit log records the org switch, not individual edits; memory included in conversation exports; incognito chats in org exports and kept at least 30 days Not available for HIPAA, public-sector or custom-retention orgs; chat search not available with customer-managed keys
Microsoft 365 Copilot On by default; admins can disable it for users or the tenant, including via Graph enhancedPersonalizationSetting Tenant switch only; admins cannot restrict what is saved Memories persist until the user deletes them; if the control is turned off, chat-history details are deleted after 30 days; deleting a chat does not delete its memories Purview eDiscovery and Graph Explorer can search, export and delete; temporary chats discoverable; mailbox security, Customer Lockbox and encryption at rest apply Retention labels and policies do not apply; Multi-Geo location unverified
Gemini Personal Google Accounts only Workspace admin controls for memory not found Not read Not read Not available on work or school accounts
ChatGPT (Business, Enterprise) Not verified (primary pages HTTP 403) Snippet only: Workspace settings > Permissions & roles, with "Use shared memory" and nested "Use improved memory" toggles, scoped per role (OpenAI Help); Enterprise owners can turn memory off (OpenAI 2024 post, snippet) Snippet: memories migrate when a personal account merges into a Business workspace (Business memory FAQ) Not verified Not verified

Governance controls side by side

The table below compares what each vendor page says about the controls an enterprise buyer typically asks for. "Not read" means the page did not describe the control, not that the product lacks it.

Product Access control Audit logs Retention / deletion PII handling Certifications Deployment
Mem0 SSO (Enterprise) Enterprise Not described Not described Not stated Cloud; OSS self-host
Zep Enterprise "governed context" (details not read) Not read Not read Not read SOC 2 Type II, HIPAA BAA (Enterprise) Cloud; Enterprise options
Cognee SSO (Startup, Enterprise) Not read Not read Not read Not stated Local, self-hosted, Enterprise BYOC
Supermemory SSO (Enterprise) Not read Not read Not read SOC 2, HIPAA BAA, GDPR (Enterprise) Cloud, self-hosted, air-gapped
Self-hosted OSS (Graphiti, MemOS, LangMem, MCP memory) Built by the operator Built by the operator Built by the operator Built by the operator None Anywhere
Claude Team / Enterprise Org switch plus per-user opt-in; no owner read access Org switch only Org switch-off deletes all; per-user delete "Sensitive topics" opt-in Excluded for HIPAA orgs Vendor cloud
Microsoft 365 Copilot Tenant switch; no content restriction Purview eDiscovery search and export User-controlled; retention policies do not apply Not described Inherits Exchange mailbox controls Vendor cloud (user mailbox)

Three conclusions follow. First, compliance badges are table stakes on enterprise tiers: SOC 2 and HIPAA BAAs appear across Zep, Supermemory and Portkey's Enterprise gateway tier, so US regulated buyers will expect them. Second, the controls buyers most need are the least documented: no vendor page read describes retention periods, PII handling, admin audit of individual memory writes or data residency in detail. Third, the native models force a trade-off. Claude protects employee privacy from administrators, which a regulated buyer may find hard to accept. Microsoft gives administrators discovery but no control over what is remembered and no retention-policy coverage. For Indian deployments, memory stores hold personal data about employees and customers, so the DPDP Act and Rules apply. Consent-manager provisions take effect on 13 Nov 2026 and the substantive obligations on 13 May 2027, under the Rules notified as G.S.R. 846(E) (MeitY DPDP Rules 2025). See Governance and India.

Observability, evaluation and guardrails changed owners in 2026

Langfuse keeps an MIT core under ClickHouse; Phoenix is only source-available

Consolidation is the story of 2025 and 2026. ClickHouse acquired Langfuse, announced on 16 Jan 2026 alongside ClickHouse's own $400M Series D at a $15B valuation led by Dragoneer; the purchase price was not disclosed (ClickHouse blog; SiliconANGLE). Langfuse says its roadmap is unchanged and that it remains committed to open source and self-hosting (Langfuse discussion #11593). Its LICENSE, re-read on 11 Oct 2026, now reads "2023-2026 ClickHouse, Inc.", with the core under the MIT (Expat) licence and ee/ directories under a separate licence. Helicone joined Mintlify under a company post dated 3 Mar 2026; its services stay live "in maintenance mode", with security updates, new models and fixes still shipping (Helicone blog). OpenAI agreed to acquire promptfoo, Promptfoo's own blog said on 9 Mar 2026, adding that "the open-source project will continue". The LICENSE on main is still MIT (Promptfoo blog; promptfoo LICENSE). Traceloop (OpenLLMetry) is "joining ServiceNow", per its own blog in March 2026; no value was stated (Traceloop blog). CoreWeave acquired Weights & Biases on 5 May 2025 for $1.0B aggregate purchase consideration (CoreWeave 10-Q; primary), and the W&B pricing URL now redirects to CoreWeave (W&B pricing URL).

OpenAI is also retiring its own hosted evaluation product. Existing OpenAI Evals become read-only on 31 Oct 2026, and the dashboard and API shut down on 30 Nov 2026 (OpenAI deprecations). The same page names Promptfoo, which OpenAI agreed to acquire (above), as the migration path. Teams that rely on it have about seven weeks to move. Arize Phoenix is marketed as "Phoenix OSS", but its Elastic License 2.0 states, "You may not provide the software to third parties as a hosted or managed service" (Phoenix). LangSmith is a hosted product, and both its hybrid and fully self-managed deployments are Enterprise-only (LangSmith pricing). Among developers building agents, the most-used observability tools in Stack Overflow's 2025 survey were general-purpose ones: Grafana and Prometheus (43%) and Sentry (32%) (Stack Overflow 2025 AI survey). That makes the vendor-neutral OpenTelemetry GenAI semantic conventions (spec; the semantic-conventions repository's latest release is v1.44.0 of 4 Aug 2026) the safest instrumentation choice: traces then survive any change of observability vendor. The conventions have moved to github.com/open-telemetry/semantic-conventions-genai (the opentelemetry.io page now says "Moved") and are marked "Development", not stable (GenAI spans spec).

On price, Langfuse Core at $29 a month (100k units included, then $8 per 100k) is the cheapest paid hosted tier found. One million units a month would cost about $101 (computed) (Langfuse pricing). Helicone Pro ($79) and Braintrust Pro ($249) meter in different units (requests, GB and per-1,000 scores), so they cannot be compared directly (Helicone pricing; Braintrust pricing). Two maintenance signals matter as well. Ragas has had no release since 13 Jan 2026 and no push since 24 Feb 2026. Helicone's last GitHub release is from 21 Aug 2025, although the repository was still being pushed on 10 Oct 2026. Helicone's own post (3 Mar 2026) confirms that it is in maintenance mode after the Mintlify acquisition (above).

Tool Licence Latest release (date) GitHub stars Price (list) Self-host Best fit
LangSmith Proprietary SaaS Not checked Not checked Developer $0/seat (1 seat, 5k base traces/mo); Plus $39/seat/mo (10k base traces); usage at $1.00 per LangChain Standard Unit; Enterprise custom Enterprise only (hybrid or fully self-managed) Teams already on LangChain/LangGraph
Langfuse MIT core; ee/ under separate licence v4.56.0 (9 Oct 2026) 35,648 Hobby free; Core $29/mo; Pro $199/mo; Enterprise $2,499/mo; Teams add-on $300/mo Yes Open-source-first tracing and evals
Arize Phoenix Elastic License 2.0 arize-phoenix-v20.21.0 (11 Oct 2026) 11,785 Phoenix OSS free; AX Free $0; a $50/mo tier (25 issues, 50k spans, 10 GB; name not captured); AX Enterprise custom Yes (no managed-service resale) Internal tracing and evals
Braintrust SDK Apache-2.0; platform proprietary braintrust@3.37.2 (9 Oct 2026) 29 (SDK) Starter $0 ($10 credits, then $4/GB + $2.50 per 1k); Pro $249/mo; retention beyond 30 days $0.50/GB/mo Not confirmed Eval-centric SaaS teams
Helicone Apache-2.0 v2025.08.21-1 (21 Aug 2025) 6,212 Free (10k requests); Pro $79/mo; Team $799/mo Repo open source; not checked Low-cost request logging (Mintlify; maintenance mode since Mar 2026)
W&B Weave Apache-2.0 v0.53.7 (27 Aug 2026) 1,140 Not read Not confirmed Teams already on W&B
Datadog LLM Observability Proprietary n/a n/a Unit price not extracted; page mentions AI Guard billable tokens No Firms already on Datadog
promptfoo MIT code-scan-action-0.2.2 (8 Oct 2026), an Action tag 25,897 Open source; paid tiers not read Yes (CLI) Prompt and agent testing and red-teaming in CI
DeepEval Apache-2.0 python-v4.2.4 (22 Sep 2026) 18,742 Pricing page 404 Yes Python eval metrics
Ragas Apache-2.0 v0.4.3 (13 Jan 2026) 15,992 Free Yes RAG metrics; check activity first
OpenTelemetry GenAI conventions Apache-2.0 v1.44.0 (4 Aug 2026) 667 Free n/a (spec) Vendor-neutral LLM and agent spans; status "Development" (not stable); now in the semantic-conventions-genai repo

AI security start-ups are being absorbed by security incumbents

Independent AI-security vendors are being bought by established security companies. Check Point announced it would acquire Lakera in September 2025, and the deal closed on 22 Oct 2025, as reported in Check Point's Q3 2025 results (search summary; not read directly). Lakera brings runtime protection, continuous red teaming and multilingual defences into Check Point's Infinity platform, and Zurich becomes Check Point's Global Centre of Excellence for AI Security (CXOToday release; Check Point Q3 2025). Lakera's site footer now carries Check Point's copyright (Lakera). Snyk acquired Invariant Labs, dated 24 Jun 2025 by Hacker News (Snyk news; HN item). Invariant had disclosed MCP "tool poisoning" attacks on 1 Apr 2025 and released MCP-Scan on 11 Apr 2025 (Invariant Labs). SentinelOne acquired Prompt Security: the agreement was signed on 5 Aug 2025 and completed on 5 Sep 2025, for total consideration of about $180 million in cash and shares (SentinelOne 8-K; primary). The higher price given on Wikipedia is not supported by the filing (Wikipedia: Prompt Security). HiddenLayer's homepage shows a "$100M Series B" banner, undated, and no acquisition (HiddenLayer). Palo Alto Networks completed its acquisition of Protect AI on 22 Jul 2025, for total purchase consideration of $634.5 million (Palo Alto Networks FY2025 10-K; primary).

On the open side, Meta's guard models are the cheapest self-hosted screening option on licence cost. Llama Guard 4 (12B) classifies inputs and outputs, and Llama Prompt Guard 2 (86M) detects prompt injection and jailbreaks. Both are released under the Llama 4 Community License. Anyone distributing them, or a product containing them, must display "Built with Llama", include the Notice file and follow Meta's Acceptable Use Policy. Derived models must have names beginning "Llama", and licensees above 700 million monthly active users need a separate licence from Meta (Llama 4 licence; Llama Guard 4; Prompt Guard 2). Gateways now embed guardrails too: Cloudflare bills guardrails as Workers AI tokens on Llama Guard 3 8B, and Portkey includes deterministic guardrails on its free tier. No tool here makes prompt injection a solved problem. OWASP's 2025 list ranks Prompt Injection as LLM01, and its LLM06 (Excessive Agency) mitigations are least-privilege tools, downstream authorisation and human approval for high-impact actions. Those are design controls that no guard model replaces (OWASP LLM Top 10). See Governance and, for agent-level security, Agent frameworks.

Tool Licence Latest release (date) GitHub stars Price / access Self-host Best fit
NeMo Guardrails (NVIDIA) Apache-2.0 per LICENSE.md (API: NOASSERTION) v0.24.1 (16 Sep 2026) 7,275 Open source Yes Programmable dialogue and policy rails
Guardrails AI Apache-2.0 v0.11.0 (14 Aug 2026) 7,507 Open source; paid tier not read Yes Output structure and content validators
Llama Guard 4 (12B) Llama 4 Community License Model card n/a Free weights under licence Yes Input and output safety classifier
Llama Prompt Guard 2 (86M) Llama 4 Community License Model card n/a Free weights under licence Yes Prompt-injection and jailbreak classifier
MCP Scan (Snyk) Apache-2.0 v0.6.8 (29 Sep 2026) 3,132 Free tool Yes Scanning MCP servers and agent skills in CI
Lakera (Check Point) Commercial n/a n/a Not published No Enterprise runtime protection inside Check Point Infinity
Prompt Security (SentinelOne) Commercial n/a n/a Not read No Enterprise GenAI usage controls
HiddenLayer Commercial n/a n/a Not read No Enterprise AI model security
Protect AI (Palo Alto Networks) Commercial n/a n/a Not read No Owned by Palo Alto Networks since 22 Jul 2025
Target Acquirer Date Evidence Confidence
Langfuse ClickHouse Announced 16 Jan 2026 ClickHouse blog; LICENSE copyright High
Helicone Mintlify 3 Mar 2026 Company post High
promptfoo OpenAI Agreed 9 Mar 2026 Promptfoo's own blog High
Traceloop (OpenLLMetry) ServiceNow March 2026; value not stated Traceloop's own blog ("joining ServiceNow") High (no price)
Weights & Biases (Weave) CoreWeave 5 May 2025; $1.0B CoreWeave 10-Q High
Lakera Check Point Closed 22 Oct 2025 (search summary) Completion release; site footer High (date medium)
Invariant Labs Snyk About 24 Jun 2025 Snyk news page; site banner High
Prompt Security SentinelOne Agreed 5 Aug 2025, completed 5 Sep 2025; about $180M SentinelOne 8-K High
Protect AI Palo Alto Networks Completed 22 Jul 2025; $634.5M PANW FY2025 10-K High

Automation surfaces: workflow engines, voice, WhatsApp and low-code builders

n8n has the largest community and the tightest licence

n8n is the most-starred workflow tool in this comparison, at 206,996 stars (n8n@2.42.6 on 9 Oct 2026), but it is source-available rather than open source. Its Sustainable Use License says: "You may use or modify the software only for your own internal business purposes or for non-commercial or personal use" (n8n LICENSE). It allows distribution or provision to others only "free of charge for non-commercial purposes". Files with .ee. in their name, or .ee in their directory name, are outside that licence and need an n8n Enterprise License (licence re-read on 12 Oct 2026). Running n8n as a paid managed service for third parties therefore needs a commercial agreement with n8n (inference from the text; no n8n FAQ found). If a partner proposes to host n8n for you as a paid managed service, ask whether it has that agreement, and get a lawyer's reading where it matters. A direct read of n8n's pricing page on 12 Oct 2026 (annual billing) shows Starter at €20 a month (2,500 executions, one shared project, 1,600 AI-assistant credits), Pro at €50 (10,000) and Business at €667 (40,000, "for companies with < 100 employees") (n8n pricing). Business is labelled both "Self-hosted only" and "Hosted by n8n?", so its hosting option is ambiguous. An earlier summarised read of the same page adds Business overage of €4,000 per 300,000 extra executions (secondary; not re-checked on 12 Oct 2026). Secondary trackers give €24 and €60 on monthly billing and Business at $800 (Toolradar), and one says the Cloud free plan ended on 14 Apr 2026, which is unverified (AgentDeals).

The cleaner licences when a partner hosts and manages the workflow tool for you are Activepieces (MIT core with an ee/ carve-out; 25,000 stars; around 400 MCP servers per its repository description) and Windmill (Apache-2.0 and AGPLv3 dual-licensed, with some proprietary components; 18,162 stars). For durable, retry-safe, long-running agent workflows, Temporal (MIT; Cloud at $50 per million actions, $150 of free credits for 90 days, active storage at $0.042/GBhr) gives a predictable cost model (Temporal pricing). Prefect (Apache-2.0) and Airflow (Apache-2.0, 47,146 stars) remain the data-pipeline choices. Among hosted tools, Zapier's MCP product connects to 9,000+ apps (Zapier MCP), and Make offers AI Agents (beta) on all plans plus an on-prem agent for local networks. RPA-plus-AI combinations (UiPath, Power Automate) were not researched.

Tool Licence Latest release (date) GitHub stars Price (list) Self-host Best fit
n8n Sustainable Use License (source-available) n8n@2.42.6 (9 Oct 2026) 206,996 Starter €20, Pro €50, Business €667 a month (annual billing; direct read 12 Oct 2026); Enterprise custom Yes, within licence terms Engineering-heavy automation with AI nodes, on infrastructure the user owns
Zapier Proprietary SaaS n/a n/a Free $0 (100 tasks); Professional from $19.99/mo and Team from $69/mo (direct read 12 Oct 2026, annual toggle); $29.99 and $103.50 monthly, with 750 and 2,000 tasks (earlier summarised read) No Non-technical SaaS-to-SaaS automation
Make Proprietary SaaS n/a n/a Official pricing page blocked (HTTP 403, 12 Oct 2026); prices not quoted On-prem agent only Visual scenario builder for mid-market
Pipedream Proprietary SaaS n/a n/a $0; $99/mo; $150/mo (tier labels not captured) No Developer-led integrations with code steps
Activepieces MIT core; ee/ under enterprise licence 0.92.2 (7 Oct 2026) 25,000 $0; $20/mo flat; $200 (labels not captured) Yes Open self-hosted no-code with MCP connectors
Windmill Apache-2.0 / AGPLv3 dual, with proprietary parts v1.830.0 (9 Oct 2026) 18,162 Self-hosted from $0; Enterprise from $120/mo Yes Scripts to internal tools and workflows
Temporal MIT v1.32.1 (8 Oct 2026) 23,606 Cloud $50 per 1M actions; $150 free credits Yes Durable long-running agent workflows
Prefect Apache-2.0 3.8.8 (6 Oct 2026) 24,003 Hobby free; Starter $100/mo; Team $100/user/mo (service accounts, audit logs) Yes Python data and ML pipelines
Apache Airflow Apache-2.0 3.3.2 (17 Sep 2026) 47,146 Free; managed options not checked Yes Scheduled data pipelines at scale

Voice agents cost two to six times their headline platform rate

Voice cost has to be modelled per minute across five legs: platform, LLM, speech-to-text, text-to-speech and telephony. Retell's own page shows "$0.07–$0.31 / min", and its worked example of $0.11 a minute splits into $0.04 for the LLM, $0.055 for voice infrastructure and $0.015 for TTS, with telephony at $0.00 (Retell pricing). Secondary comparisons put a tuned Retell stack near $0.10 a minute and a current-generation model past $0.23 (Morph). Vapi's own page lists $0.05 a minute for Vapi hosting, with transcriber, model and voice billed as separate components (Vapi pricing; primary). Secondary comparisons put the all-in cost at $0.13–$0.31 once LLM, TTS, STT and Twilio are added (AI Agent Rank). Against that fee, the all-in range is 2.6 to 6.2 times higher, and Retell's example is double its infrastructure rate (computed). Vapi's own page lists Enterprise from a $999 monthly minimum and Twilio pass-through at $0.008 (inbound) and $0.014 (outbound) a minute (Vapi pricing). Bland bundles the models, at $0.14 a minute on Start and $0.12 on a $299 monthly plan (Bland pricing). Its blog adds a Scale tier at $0.11 on $499 a month, with telephony billed separately (vendor-authored) (Bland blog). Synthflow's enterprise contracts "start at $30,000 annually" (Synthflow pricing).

The self-host path is LiveKit Agents (Apache-2.0, 14,694 stars) or Pipecat (BSD-2-Clause, 16,356 stars). LiveKit's cloud charges $0.01 per agent-session minute beyond the included minutes (Ship $50/month for 5,000 minutes; Scale $500 for 50,000), and its calculator's example stack totals $0.0479 a minute with models billed separately (summarised read) (LiveKit pricing). For Indian languages, Sarvam publishes INR rates: ₹30 an hour for real-time or batch STT (₹0.50 a minute, computed), ₹45 an hour for batch with diarization, and ₹3 per 1,000 characters for streaming TTS (Sarvam API pricing). Pricing the speech leg in INR removes currency exposure on that leg, but Sarvam's quality against English-first vendors was not benchmarked independently. Indian-language speech-to-text, text-to-speech and a leg-by-leg rupee voice-agent minute are covered in Indian languages; the India document quotes the same Sarvam rates. Plivo's India page lists calls at ₹0.38 and ₹0.25 a minute (rows not labelled by direction), a domestic number at ₹200 a month and transcription at ₹0.81 a minute (Plivo India); its global page lists a Voice AI Agent at $0.03 a minute excluding telephony (Plivo). Bolna sells voice agents at ₹5.52 (6.00 US cents) a minute on its $15 pilot plan and 4.51 cents at a higher tier (Bolna pricing; vendor-reported). Exotel's pricing page is sales-led (Exotel); its blog reportedly puts Indian-number calls at about ₹0.80–1.00 a minute outbound and ₹0.30–0.50 inbound (Exotel blog; search summary, not read directly). Reseller figures of ₹4–6 a minute for Exotel AI agents conflict with one another and are not Exotel's own price (edesy; reseller, search summary). Twilio India (Twilio India voice) and Exotel rate cards remain unresolved.

TRAI's Direction of 4 May 2024 moved voice calling onto DLT (140-series within 60 days; a 160-series plan) (TRAI Direction). The draft TCCCPR Third Amendment Regulations 2026 add an A2P call definition, pre-declaration and termination charges for A2P calls, a lower complaint threshold before a sender is suspended, and operator "AI-flagging" (comments on the draft hosted by TRAI). As drafted, a fully automated voice agent appears to fall within A2P (inference). The final rules were reported as notified on 18 Sep 2026 (secondary); the official text was not read, and no explicit AI-voice disclosure rule is confirmed. Indian languages covers the draft in more detail.

Vendor Licence Latest release (date) GitHub stars Price (list) Self-host Best fit
Vapi Proprietary n/a n/a Enterprise from $999/mo minimum; models and telephony passed through; $0.05/min hosting fee plus component costs (Vapi page, primary) No BYO-model voice agents with fine control
Retell AI Proprietary n/a n/a $0.07–$0.31/min; example $0.11/min No Transparent per-minute builds
Bland AI Proprietary n/a n/a $0.14/min (Start); $0.12/min on $299/mo; Custom No Bundled-model pricing
Synthflow Proprietary n/a n/a Enterprise from $30,000/yr; lower tiers not captured No Enterprise contracts
LiveKit Agents Apache-2.0 livekit-agents@1.8.6 (9 Oct 2026) 14,694 Build $0 (1,000 min, 5 concurrent); Ship $50/mo; Scale $500/mo; $0.01/min beyond Yes Self-hosted or cloud real-time voice
Pipecat BSD-2-Clause v1.12.0 (26 Sep 2026) 16,356 Open source Yes Framework; choose hosting separately
ElevenLabs Agents Proprietary n/a n/a Plans at $0, $1 and $22/mo (promotional); per-minute rate not extracted No Hosted voice agents (pricing incomplete)
Deepgram Proprietary API n/a n/a $200 free credit; Nova-3 pre-recorded $0.0043/min (multilingual $0.0052); Aura-2 TTS $0.030 per 1,000 characters (pay-as-you-go) No STT and TTS API
AssemblyAI Proprietary API n/a n/a Add-ons $0.21, $0.15 and $0.05/hr (unlabelled) No Speech API (map rates to products first)
Sarvam AI Proprietary API n/a n/a STT ₹30/hr; diarized batch ₹45/hr; TTS ₹3 per 1,000 chars No Indian-language speech billed in INR
Cartesia Proprietary n/a n/a Managed agents $0.06/min No Hosted voice agents
OpenAI Realtime / gpt-live-1 Proprietary n/a n/a gpt-live-1 voice sessions $0.05/min (billed per second; backend model and tools extra); gpt-realtime-2.1 audio $32 / $0.40 / $64 per 1M input / cached / output (text $4 / $0.40 / $24); gpt-realtime-2.1-mini audio $10 / $0.30 / $20; gpt-transcribe $0.0045/min No OpenAI-native voice

WhatsApp India billing must move to INR by 31 December 2026

WhatsApp-based order and lead handling is among the likely high-demand automations for Indian SMEs (an inference in the India research, not a survey result), and Meta's own pricing page sets the rules (Meta WhatsApp pricing). Template messages are charged per message by category and country calling code. All non-template messages are free inside an open customer-service window, and so are utility templates delivered inside one. The binding date for eligible India-billed accounts is 31 Dec 2026. Billing localisation launched on 1 Jan 2026 for partners and directly integrated businesses whose Sold-To country is India. Eligible customers "must ensure all WABAs in their business portfolio are migrated to INR by December 31, 2026", because "as of January 1, 2027 Meta will no longer deliver the messages of non-INR WABAs of eligible customers" (page re-read on 11 Oct 2026 through a summarising reader). Meta's rate-card files (PDF and CSV) were not read. A vendor page gives India rates per message, excluding 18% GST, "effective 1 Oct 2026": marketing ₹0.8631, utility ₹0.1150, authentication ₹0.1150, authentication-international ₹2.4971 (ChatMaxima; vendor-reported). Gallabox's INR tab shows exactly 1.15 times those (marketing ₹0.9926; others ₹0.1323), reason not stated (Gallabox). At ₹0.8631, 10,000 marketing templates cost about ₹8,631 before GST and partner markups (computed). Rupee per-conversation costs for Indian-language bots are worked through in Indian languages. Business-solution-provider (BSP) markups were not researched, and for small businesses they may matter more than Meta's rate. The workflow tools above supply the automation logic. Because these flows process customer personal data, they fall under the DPDP timeline in Governance.

Item What Meta's page says Other sources Status
India marketing rate "Higher marketing rate" effective 1 Jan 2026 About 10% rise, ₹0.7846 to ₹0.8631 per message (Authkey) Direction confirmed; figures secondary
Authentication-international Higher rate effective 1 Apr 2026 ₹2.4971 per message excl. GST (ChatMaxima, vendor-reported) Direction confirmed; figure vendor-reported
Rate cards Effective 1 Jul 2026; INR rates and volume tiers in PDF/CSV — Files not read
INR billing Eligible customers whose Sold-To country is India (partners and directly integrated businesses) migrate all WABAs to INR by 31 Dec 2026; their non-INR WABAs are undelivered from 1 Jan 2027 — Confirmed (operational deadline; re-read 11 Oct 2026)
Service messages Non-template messages free in an open window; "Service conversations are now free for all businesses" (update of 1 Nov 2024) From 1 Oct 2026, 1,000 free service messages per business phone number per calendar month, then the utility rate of ₹0.1150 excl. GST (ChatMaxima, Gallabox; also TelecomTalk; vendor-reported) Vendor-reported; not confirmed on Meta's page (as read on 11 Oct 2026 through a summarising fetch, Meta's page still says non-template messages are free)
BSP markups — Not researched Gap

Flowise's archival leaves Dify and Langflow as the open builders

Low-code builders let non-developers assemble agents, but two of the three big open projects carry warnings. Flowise was archived by its owner on 13 Aug 2026 (repository banner re-read on 11 Oct 2026), after an announcement and code freeze on 29 Jul 2026; end of life was 31 Aug 2026, and its npm packages and Docker images are deprecated (Flowise discussion #6727). Existing deployments are now unsupported and need migration plans. Dify (158,150 stars, 1.17.1 on 10 Sep 2026) uses a modified Apache-2.0 licence. It bars running a multi-tenant environment "unless explicitly authorized by Dify in writing", where "one tenant corresponds to one workspace", and it bars removing or modifying the logo or copyright in the console or applications whenever Dify's frontend is used (licence re-read on 11 Oct 2026) (Dify). That makes it suitable for a deployment dedicated to one organisation, but a shared hosted product serving many businesses needs Dify's written authorisation. Langflow (MIT, 155,498 stars, v1.12.5 on 6 Oct 2026) is the permissive alternative. Hosted builders can also disappear: OpenAI's visual Agent Builder shuts down on 30 Nov 2026, and OpenAI's migration guidance points to the Agents SDK or ChatGPT Workspace Agents (OpenAI deprecations). Microsoft Learn lists tenant-wide packs of 25,000 Copilot Credits at $200 a pack a month ($0.008 a credit, computed). A pay-as-you-go meter billed through Azure also exists; a rate of $0.01 per credit is reported in secondary sources, not read directly (Microsoft Learn: Copilot Studio billing).

Tool Licence Latest release (date) GitHub stars Price (list) Self-host Best fit
Dify Modified Apache-2.0 (multi-tenant needs Dify's written authorisation) 1.17.1 (10 Sep 2026) 158,150 $590/workspace/yr (5,000 message credits/mo); $1,590/workspace/yr (10,000); Enterprise private deployment Yes Single-tenant deployment for one organisation
Langflow MIT v1.12.5 (6 Oct 2026) 155,498 Free start; cloud price not captured Yes Permissive low-code agent builder
Flowise Apache-2.0 with enterprise carve-out flowise@3.1.4 (29 Jul 2026) 55,494 Not read Archived 13 Aug 2026; end of life 31 Aug 2026 Migrate away
Botpress Proprietary n/a n/a Free; Plus $150/mo incl. $25 AI usage; 100 conversations for $65 Not checked Chat and voice bots
Microsoft Copilot Studio Proprietary n/a n/a 25,000-credit pack $200/mo (Microsoft Learn); pay-as-you-go meter via Azure (reported $0.01 per credit, secondary) No Microsoft 365 tenants
Voiceflow Proprietary n/a n/a Free trial; publishes no prices ("Request pricing") Not checked Conversation design
Stack AI Proprietary n/a n/a Free $0; paid tiers not captured No Enterprise agent builder
Relevance AI Proprietary n/a n/a Not captured No Agent workforce builder

Licence traps to check when you or a partner runs a tool for you

Four kinds of trap appear across the stack. Use-restriction licences (n8n's SUL, Phoenix's ELv2, Dify's multi-tenant clause, LM Studio's app terms) allow self-hosting for your own business but restrict hosting the tool for several customers at once, which is how a managed-service or implementation partner may propose to run it for you. Directory-split open core (LiteLLM enterprise/, Langfuse and Activepieces ee/, n8n's .ee. files, Flowise's enterprise carve-out, and Elasticsearch and Weaviate by directory) makes a feature's licence depend on which folder its code lives in, so it has to be re-checked at each upgrade. Copyleft terms (AGPL-3.0 and SSPL-1.0 in Elasticsearch, AGPLv3 in Windmill, GPL-3.0 in Neo4j Community) matter when code is embedded or hosted for others. The same applies to the AGPL-licensed browser agent Skyvern, covered in Agent frameworks. Status traps are not licence clauses but behave like them: archived projects (TGI, Flowise), ownership changes, and stalled release cadences (Ragas, Helicone, Chroma, TensorRT-LLM). Across vendors, SSO and audit logs are gated to top tiers (LiteLLM, Mem0, Portkey, Prefect Team, and n8n Enterprise per secondary sources). The GitHub API returns NOASSERTION for several licences that the LICENSE files settle. Dynamo and NeMo Guardrails are Apache-2.0. The MCP servers repository is mixed: new contributions Apache-2.0, documentation CC-BY-4.0, un-relicensed contributions MIT. This is not legal advice: items marked "counsel" need a lawyer's reading before you rely on them in a contract with a vendor or partner.

Tool Licence Clause or limit Risk when you or a partner runs it Safer pattern
n8n Sustainable Use License Use "only for your own internal business purposes or for non-commercial or personal use"; provision to others only "free of charge for non-commercial purposes" A partner running n8n for you as a paid managed service needs a commercial agreement with n8n (inference; counsel); .ee. files need an Enterprise License An instance your business owns, or a partner with n8n's commercial licence; or Activepieces / Windmill
Dify Modified Apache-2.0 Written authorisation from Dify for multi-tenant service; keep logo and copyright when its frontend is used A shared multi-tenant deployment breaches it without that authorisation A deployment dedicated to your organisation; Dify Enterprise; or Langflow (MIT)
Arize Phoenix Elastic License 2.0 No providing it "as a hosted or managed service" A partner providing it to you as a managed service breaches it Run it internally yourself; Langfuse (MIT core) if a partner manages observability for you
Elasticsearch AGPL-3.0 / SSPL-1.0 / ELv2 by directory Different terms per directory Code embedded in a product built for or by you (counsel) OpenSearch (Apache-2.0) or pgvector
Weaviate BSD-3-Clause or Weaviate License by directory Directory-dependent Same as above Check the directory; or Qdrant (Apache-2.0)
Neo4j Community GPL-3.0; commercial for enterprise Copyleft Embedding in proprietary products (counsel) Commercial licence; check terms before embedding
Windmill Apache-2.0 / AGPLv3 dual, proprietary parts Mixed Hosted use of AGPL parts (counsel) Read the component map before hosting
LiteLLM, Langfuse, Activepieces MIT core; enterprise/ or ee/ separate Enterprise folders not MIT Accidentally shipping enterprise code Pin to the core; re-check at upgrades
Llama Guard 4, Prompt Guard 2 Llama 4 Community License "Built with Llama" display, Notice file, Acceptable Use Policy; derived model names must begin "Llama"; separate licence above 700M monthly active users Attribution and naming duties in any product that contains them; AUP compliance (counsel) Read the licence; keep an alternative classifier
LlamaParse Commercial ("not open source") Hosted service Lock-in for parsing LiteParse, Docling or Unstructured
MCP servers repository Mixed Apache-2.0 / MIT / CC-BY-4.0 Un-relicensed contributions stay MIT The licence differs by file Check the licence of each server copied
TGI, Flowise Archived No further development Unsupported production systems Migrate to vLLM/SGLang and Langflow/Dify
LM Studio Desktop app terms (23 Aug 2026) "solely for Your personal and / or internal business purposes"; no "service bureau use, as an application service provider, or a software-as-a-service" A partner running it for you as a hosted service breaches the terms Internal use only; serve workloads with vLLM, llama.cpp or Ollama (MIT)

Three reference stacks: budget SME, privacy-first self-hosted, enterprise and regulated

These stacks are recommendations drawn from the comparisons above, not tested deployments. They assume a business that runs its automations itself or through an implementation partner. Prices are list prices in USD, and INR billing and GST were not checked.

Stack A, SME on a budget, uses hosted models with minimal operations and keeps software subscriptions between about $0 (everything self-hosted) and about $70 a month: Langfuse Core $29 plus Mem0 Starter $19 plus Activepieces' $20 tier, excluding model usage, hosting and staff (computed). Stack B, privacy-first self-hosted, suits businesses that need data kept in their own or in-country infrastructure and DPDP-aligned retention. Licence fees are close to zero, and GPUs and operations dominate cost. Stack C, enterprise and regulated, suits US companies that require SOC 2, HIPAA BAAs, SSO and audit trails. Its fixed floor runs to thousands of dollars a month before quotes, for example Langfuse Enterprise at $2,499 plus a Pinecone Enterprise minimum of $500, or $2,999 together (computed).

Layer A. SME on a budget B. Privacy-first self-hosted C. Enterprise and regulated
Models and serving Hosted model APIs; Ollama or llama.cpp for local prototypes vLLM, with SGLang as the benchmark challenger, on own or in-country GPUs; llm-d only if multi-node; Indian managed endpoints are an in-country hosted option (vendor-reported): E2E Networks TIR ("OpenAI-style endpoint served from Indian data centers") and Yotta Shakti Cloud (Navi Mumbai and Greater Noida) (E2E; Yotta) Hosted model APIs under enterprise terms; vLLM for sensitive workloads; Dynamo or llm-d at datacenter scale
Gateway LiteLLM open source ($0) or OpenRouter Standard (5.5%) LiteLLM open source inside your own cloud LiteLLM Enterprise (SSO+SCIM, audit, air-gap) or Portkey Enterprise (VPC, SOC 2 Type 2, HIPAA BAA); Kong where already standard
Vector store pgvector in existing Postgres; Qdrant or Chroma free tier for pilots pgvector or Qdrant (Apache-2.0) Pinecone Enterprise ($500/mo min, BYOC) or Turbopuffer (CMEK from $4,096/mo); OpenSearch/Elastic where already standard
Embeddings and rerank voyage-4-lite ($0.02/1M, 200M free) with rerank-3-lite ($0.02) Qwen3-Embedding or BGE-M3, self-hosted Cohere Embed 5 dedicated (from $2,000/mo) or Voyage; benchmark on your own corpus
Parsing and OCR Docling; Unstructured (10,000 free pages); LlamaParse basic for hard PDFs Docling, Unstructured OSS, DeepSeek-OCR Reducto ($10–$40 per 1,000 pages) or Azure Document Intelligence
GraphRAG Skip LightRAG or Microsoft GraphRAG only for multi-hop corpora Microsoft GraphRAG on Neo4j (commercial licence) where multi-hop matters
Memory Mem0 Hobby (free) or Starter ($19/mo), or none Mem0, Graphiti, Cognee or Supermemory self-hosted, with retention and deletion built in Zep or Supermemory Enterprise (SOC 2, HIPAA BAA) or Mem0 Enterprise (audit logs, SSO)
Observability and eval Langfuse Hobby or Core ($29/mo); promptfoo and DeepEval in CI Langfuse self-hosted (MIT core) on OpenTelemetry GenAI conventions LangSmith Enterprise (self-managed) or Langfuse Enterprise ($2,499/mo); Datadog where it is already the APM
Guardrails Llama Prompt Guard 2; Portkey deterministic or Cloudflare guardrails Llama Guard 4 + Prompt Guard 2; NeMo Guardrails or Guardrails AI; MCP Scan in CI Commercial runtime protection (Lakera, Prompt Security, HiddenLayer) plus open guard models; OWASP LLM06 controls
Workflow Activepieces, or n8n on an instance you own; Zapier or Make for SaaS glue Windmill or Activepieces self-hosted; Temporal for durable jobs Temporal Cloud ($50 per 1M actions) or Prefect Team; n8n only under a commercial licence
Voice Retell, Vapi or Bland pay-as-you-go; Sarvam for Indian-language speech LiveKit Agents or Pipecat with self-hosted models Vapi Enterprise ($999/mo min), Synthflow (from $30,000/yr) or Retell
WhatsApp (India) Meta platform, direct or via a BSP, billed in INR Same, with consent and retention logs Same, plus DPDP processor terms
Low-code Botpress (Plus $150/mo) or single-tenant Dify Single-tenant Dify for your organisation, or Langflow (MIT) Copilot Studio ($200 per 25,000 credits) in Microsoft shops; Dify Enterprise
Indicative software floor About $0–$70/mo About $0 in licences; GPUs and ops dominate About $3,000/mo before quotes

What this means for your business

Start with permissive defaults and keep hosted services swappable. Each layer now has a permissively licensed default (MIT, Apache-2.0, BSD or the PostgreSQL License): vLLM, LiteLLM, pgvector or Qdrant, Docling, Langfuse's core, Activepieces or Temporal, and LiveKit or Pipecat. Hosted alternatives mostly add cost at volume, at enterprise tiers or through monthly minimums. Put a gateway in front of every model call and use OpenTelemetry GenAI traces, so that switching a model, router or observability vendor is a configuration change rather than a rebuild. Nine of the observability, evaluation and security vendors in this document have been acquired or agreed to be acquired since May 2025. The same gateway can route Indian personal data to in-country options (Bedrock's in. profiles for the previous Claude generation, Indian managed endpoints or self-hosted vLLM), since first-party APIs and the newest models process outside India.

Budget in all-in units and plan for currency risk. Costs arrive per minute (voice, $0.07–$0.31 all-in), per page (parsing, $0.00125–$0.04), per message (WhatsApp, INR rate cards), as a percentage of model spend (5–8% on hosted routers) or as monthly minimums (Pinecone, Turbopuffer). Software floors run from about $0–$70 a month for the budget SME stack to about $3,000 a month before quotes for the enterprise stack (reference stacks above). Almost every vendor prices in USD. Sarvam, Plivo India and Bolna publish AI-service or telephony prices in INR (vendor-reported), and Meta now requires INR billing for eligible WhatsApp customers whose Sold-To country is India. If your revenue is in INR and a contract passes USD costs through to you, agree an FX clause or keep a buffer. Costs has the wider pricing models.

Put the dated deadlines in your plan. OpenAI Evals goes read-only on 31 Oct 2026; Evals and Agent Builder shut down on 30 Nov 2026; DPDP consent-manager provisions start on 13 Nov 2026; eligible India-billed WABAs must migrate to INR billing by 31 Dec 2026; the substantive DPDP obligations follow on 13 May 2027. If you run TGI or Flowise (end of life 31 Aug 2026), you already need a migration.

Test Indian-language quality yourself. No embedding model, OCR tool or memory layer in this research was tested on Hindi, other Indic scripts or code-mixed text, and vendors' multilingual claims do not settle the question. Pilot on your own documents, scans and call recordings before accepting any accuracy figure (Indian languages sets out a test plan). Memory layers that hold employee or customer data need retention, deletion and audit controls that the vendors themselves do not document.

Questions to ask any vendor or implementation partner

  • Which licence covers each component, and does the way it will be run for you fit it? Hosting n8n, Dify, Phoenix or LM Studio for several customers can breach their terms (see the licence table above).
  • Is the instance owned by your business, and does the contract record each component's licence, the self-host commitment and an export path?
  • Is any component archived, end-of-life or in maintenance mode (TGI, Flowise, Helicone), or slow to release (Ragas)?
  • Where are your data processed and stored, and which tier includes SSO, audit logs and retention controls?

Open questions and unverified items

Item Status What would settle it
vLLM vs SGLang vs TensorRT-LLM performance; Dynamo 1.0 date and "up to 7x" No independent 2026 benchmark; Dynamo date secondary, 7x a vendor claim Benchmark on the target model and GPU; NVIDIA primary release
Azure API Management; OpenRouter retention and no-training terms; Portkey overage unit Azure API Management and OpenRouter terms not researched. Bedrock's India in. profiles are documented (see gateways). Portkey's page says both "logs" and "requests" for the $9 per 100K overage (page inconsistency) Vendor documentation or a live account
India managed regions and INR/GST billing for USD-priced vendors Not confirmed for any tool-stack vendor. GST treatment was not read from any statute; the usual position is reverse charge for B2B imports of services, so get tax advice. For model serving, see Bedrock in. profiles and Indian managed endpoints (vendor-reported) Vendor region lists and billing pages; tax advice
2026 MTEB ranking; OpenAI embedding prices; Mistral OCR per-page price; Azure Document Intelligence Read rate Still open; Azure's Retail Prices API shows two unlabelled Read rows ($0.60 vs $1.50 per 1,000 pages). Settled: Voyage unit (per 1M tokens), other Azure rates, Reducto parse from $10 and extract from $20 Live pages; Azure meter documentation
Reducto's $40 tier Stands from the 11 Oct read; not seen on the 12 Oct read A fresh read of Reducto's pricing page
Indic OCR and Indic or code-mixed embedding quality Untested for every tool Pilot on your own documents and scans
GraphRAG vs plain RAG accuracy and cost; UNREAL preprint results No independent benchmark; preprint not peer-reviewed Controlled pilot; peer review or replication
Memory governance (retention, PII, audit of memory writes, residency); funding for Zep, Cognee, MemOS; Letta pricing Not described or not found Vendor security documentation, DPAs, primary announcements
ChatGPT Business/Enterprise memory controls; Gemini Workspace memory controls; Copilot Multi-Geo memory location Snippets only (HTTP 403), not found, or unverified Admin consoles and vendor help centres
n8n monthly-billed prices; Business hosting option; end of the n8n Cloud free plan on 14 Apr 2026 Annual prices settled (Pro €50, Business €667 a month; direct read 12 Oct 2026). Business is labelled both "Self-hosted only" and "Hosted by n8n?"; the free-plan end is unverified (tracker only) n8n pricing page and changelog
Make prices Official pricing page blocked (HTTP 403), so no figures can be quoted A readable official pricing page
Copilot Studio pay-as-you-go rate; Stack AI, Relevance AI, Langflow Cloud prices The pay-as-you-go meter exists (billed via Azure), but its rate ($0.01 a credit) is reported only by secondary sources. Voiceflow publishes no prices. Stack AI, Relevance AI and Langflow Cloud prices are still not captured Microsoft price list; live pages
ElevenLabs agents per-minute rate; AssemblyAI row labels Not captured Live pages
Twilio India and Exotel rate cards Plivo India and Bolna INR rates captured (vendor-reported). Exotel's blog figures come only from a search summary Provider rate sheets
TRAI rules for automated or AI calls The 2024 DLT Direction is primary, and the draft TCCCPR Third Amendment would cover automated A2P calls. The final rules were reported notified on 18 Sep 2026 (secondary), but the Gazette text was not read, and no explicit AI-voice rule is confirmed Final Gazette text
WhatsApp INR rate card; 1 Oct 2026 service-message charge; BSP markups Meta's rate-card file is still unread. Per-message INR rates come from vendor pages (ChatMaxima; Gallabox at 1.15 times, unexplained). The service-message charge (1,000 free per number a month, then the utility rate) is vendor-reported and conflicts with Meta's page, which still says they are free. BSP markups are not researched Meta rate-card PDF/CSV; BSP price lists
RPA plus AI (UiPath, Power Automate) Not researched Vendor documentation

Sources

All sources were read or queried on 11 October 2026, or on 12 October 2026 where the text says so, unless a different date is given in the text.

  1. GitHub: vllm-project/vllm release v0.31.0
  2. Wikipedia: vLLM (secondary)
  3. GitHub: huggingface/text-generation-inference repository and README
  4. GitHub REST API: huggingface/text-generation-inference latest release
  5. Hugging Face: Text Generation Inference documentation
  6. Spheron: migrating from TGI to vLLM or SGLang, 2026 (secondary)
  7. Markaicode: Llama 3.3 on A100 80GB latency benchmark (secondary)
  8. NVIDIA investor press release: NVIDIA enters production with Dynamo
  9. NVIDIA Developer Blog: NVIDIA Dynamo accelerates llm-d community initiatives
  10. Stack Overflow 2025 Developer Survey: AI section
  11. GitHub REST API: vllm-project/vllm repository metadata
  12. GitHub REST API: vllm-project/vllm latest release
  13. GitHub REST API: sgl-project/sglang repository metadata
  14. GitHub REST API: sgl-project/sglang latest release
  15. GitHub REST API: NVIDIA/TensorRT-LLM repository metadata
  16. GitHub REST API: NVIDIA/TensorRT-LLM licence file
  17. GitHub REST API: NVIDIA/TensorRT-LLM latest release
  18. GitHub REST API: ai-dynamo/dynamo repository metadata
  19. NVIDIA Dynamo LICENSE
  20. GitHub REST API: ai-dynamo/dynamo latest release
  21. GitHub REST API: llm-d/llm-d repository metadata
  22. GitHub REST API: llm-d/llm-d latest release
  23. GitHub REST API: ollama/ollama repository metadata
  24. GitHub REST API: ollama/ollama latest release
  25. Ollama pricing
  26. GitHub REST API: ggml-org/llama.cpp repository metadata
  27. GitHub REST API: ggml-org/llama.cpp latest release
  28. GitHub REST API: mudler/LocalAI repository metadata
  29. GitHub REST API: mudler/LocalAI latest release
  30. GitHub REST API: ml-explore/mlx repository metadata
  31. GitHub REST API: ml-explore/mlx-lm repository metadata
  32. GitHub REST API: ml-explore/mlx latest release
  33. GitHub REST API: ml-explore/mlx-lm latest release
  34. LM Studio homepage
  35. LM Studio desktop app terms (23 Aug 2026)
  36. GitHub REST API: lmstudio-ai/lmstudio-js repository metadata
  37. GitHub REST API: huggingface/text-generation-inference repository metadata
  38. GitHub REST API: BerriAI/litellm licence file
  39. GitHub REST API: BerriAI/litellm contents, enterprise
  40. LiteLLM pricing
  41. TKMX AI: LiteLLM alternatives in 2026 (competitor marketing)
  42. AWS Bedrock: model support by Region (read 12 Oct 2026)
  43. GitHub REST API: BerriAI/litellm repository metadata
  44. GitHub REST API: BerriAI/litellm latest release
  45. OpenRouter pricing
  46. GitHub REST API: Portkey-AI/gateway repository metadata
  47. GitHub REST API: Portkey-AI/gateway latest release
  48. Portkey pricing
  49. Kong AI Gateway product page
  50. GitHub REST API: Kong/kong repository metadata
  51. GitHub REST API: Kong/kong latest release
  52. Kong pricing
  53. Cloudflare AI Gateway pricing documentation
  54. Pinecone pricing
  55. Chroma pricing
  56. Qdrant pricing
  57. Turbopuffer pricing
  58. GitHub REST API: elastic/elasticsearch licence file
  59. GitHub REST API: weaviate/weaviate licence file
  60. OWASP GenAI: Top 10 for LLM Applications 2025
  61. GitHub REST API: pgvector/pgvector repository metadata
  62. GitHub REST API: pgvector/pgvector licence file
  63. GitHub REST API: qdrant/qdrant repository metadata
  64. GitHub REST API: qdrant/qdrant latest release
  65. GitHub REST API: milvus-io/milvus repository metadata
  66. GitHub REST API: milvus-io/milvus latest release
  67. Zilliz pricing
  68. GitHub REST API: weaviate/weaviate repository metadata
  69. GitHub REST API: weaviate/weaviate latest release
  70. Weaviate pricing
  71. GitHub REST API: chroma-core/chroma repository metadata
  72. GitHub REST API: chroma-core/chroma latest release
  73. GitHub REST API: lancedb/lancedb repository metadata
  74. GitHub REST API: lancedb/lancedb latest release
  75. GitHub REST API: opensearch-project/OpenSearch repository metadata
  76. GitHub REST API: opensearch-project/OpenSearch latest release
  77. GitHub REST API: elastic/elasticsearch repository metadata
  78. GitHub REST API: elastic/elasticsearch latest release
  79. Elastic pricing
  80. Hugging Face: Qwen/Qwen3-Embedding-8B model card
  81. Hugging Face: BAAI/bge-m3 model card
  82. Hugging Face: MTEB leaderboard
  83. Voyage AI pricing documentation
  84. Cohere pricing
  85. Jina AI embeddings
  86. OpenAI API pricing
  87. Unstructured pricing
  88. Reducto pricing
  89. LlamaIndex (LlamaParse) pricing
  90. Mistral AI pricing
  91. Mistral AI: Mistral OCR announcement
  92. Microsoft Azure: Document Intelligence pricing
  93. Azure Retail Prices API: Document Intelligence
  94. Google Cloud Document AI pricing
  95. AWS Textract pricing
  96. GitHub REST API: docling-project/docling repository metadata
  97. GitHub REST API: docling-project/docling latest release
  98. GitHub REST API: Unstructured-IO/unstructured repository metadata
  99. GitHub REST API: Unstructured-IO/unstructured latest release
  100. GitHub REST API: run-llama/llama_parse repository metadata
  101. GitHub REST API: run-llama/llama_parse latest release
  102. GitHub REST API: deepseek-ai/DeepSeek-OCR repository metadata
  103. GitHub REST API: microsoft/graphrag repository metadata
  104. GitHub: HKUDS/LightRAG repository
  105. GitHub REST API: neo4j/neo4j repository metadata
  106. arXiv:2610.08463, UNREAL: Unifying Retrieval and Long-Context with a Single Model (preprint)
  107. arXiv API query: "long context" AND RAG
  108. Claude Help Center: Use Claude's chat search and memory to build on previous context
  109. GitHub REST API: microsoft/graphrag latest release
  110. GitHub REST API: HKUDS/LightRAG repository metadata
  111. GitHub REST API: HKUDS/LightRAG latest release
  112. GitHub REST API: getzep/graphiti repository metadata
  113. GitHub REST API: getzep/graphiti latest release
  114. TechCrunch (28 Oct 2025): Mem0 raises $24M from YC, Peak XV and Basis Set
  115. VCBacked: Mem0 (aggregator)
  116. Caplight: Mem0 (aggregator)
  117. Pulse 2.0: Letta raises $10 million seed (secondary)
  118. Dealroom: Supermemory secures $2.6M (secondary)
  119. Let's Data Science: Supermemory raises $3M (secondary)
  120. VCBacked: xmemory (aggregator)
  121. GitHub REST API: mem0ai/mem0 repository metadata
  122. GitHub REST API: mem0ai/mem0 latest release
  123. Mem0 pricing
  124. GitHub REST API: getzep/zep repository metadata
  125. Zep README (Community Edition deprecated)
  126. GitHub REST API: getzep/zep latest release
  127. Zep pricing
  128. GitHub REST API: letta-ai/letta repository metadata
  129. GitHub REST API: letta-ai/letta latest release
  130. GitHub REST API: topoteretes/cognee repository metadata
  131. GitHub REST API: topoteretes/cognee latest release
  132. Cognee pricing
  133. GitHub REST API: supermemoryai/supermemory repository metadata
  134. GitHub REST API: supermemoryai/supermemory latest release
  135. Supermemory pricing
  136. GitHub REST API: MemTensor/MemOS repository metadata
  137. GitHub REST API: MemTensor/MemOS latest release
  138. GitHub REST API: langchain-ai/langmem repository metadata
  139. GitHub REST API: modelcontextprotocol/servers repository metadata
  140. modelcontextprotocol/servers LICENSE
  141. GitHub REST API: modelcontextprotocol/servers contents, src/memory/README.md
  142. Microsoft Learn: Microsoft 365 Copilot personalization and memory
  143. Gemini Apps Help: personal context and memory
  144. OpenAI Help Center: Managing workspace settings in ChatGPT Enterprise (search snippet)
  145. OpenAI blog: Memory and new controls for ChatGPT (search snippet)
  146. OpenAI Help Center: Memory FAQ, Business version (search snippet)
  147. MeitY: Digital Personal Data Protection Rules, 2025, G.S.R. 846(E)
  148. ClickHouse blog: ClickHouse acquires Langfuse
  149. SiliconANGLE (16 Jan 2026): ClickHouse raises $400M, acquires Langfuse
  150. GitHub: Langfuse discussion #11593
  151. Helicone blog: Helicone is joining Mintlify (3 Mar 2026)
  152. Promptfoo blog: agreed to be acquired by OpenAI (9 Mar 2026)
  153. promptfoo LICENSE
  154. Traceloop blog: joining ServiceNow (March 2026)
  155. CoreWeave 10-Q, Q2 2025 (Weights & Biases acquisition)
  156. Weights & Biases pricing URL (redirects to CoreWeave)
  157. OpenAI API deprecations
  158. GitHub REST API: Arize-ai/phoenix repository metadata
  159. LangChain (LangSmith) pricing
  160. OpenTelemetry: semantic conventions for generative AI
  161. OpenTelemetry semantic-conventions-genai: GenAI spans
  162. Langfuse pricing
  163. Helicone pricing
  164. Braintrust pricing
  165. GitHub REST API: langfuse/langfuse repository metadata
  166. Arize pricing
  167. GitHub REST API: braintrustdata/braintrust-sdk repository metadata
  168. GitHub REST API: Helicone/helicone repository metadata
  169. GitHub REST API: wandb/weave repository metadata
  170. Datadog pricing
  171. GitHub REST API: promptfoo/promptfoo repository metadata
  172. promptfoo homepage
  173. GitHub REST API: confident-ai/deepeval repository metadata
  174. GitHub REST API: explodinggradients/ragas repository metadata
  175. GitHub REST API: open-telemetry/semantic-conventions repository metadata
  176. CXOToday: Check Point completes acquisition of Lakera
  177. Check Point Q3 2025 results (press release via Seeking Alpha)
  178. Lakera homepage
  179. Snyk news: Snyk acquires Invariant Labs
  180. Hacker News item 44370620 (Algolia API), Snyk and Invariant Labs
  181. Invariant Labs: MCP security notification, tool poisoning attacks (1 Apr 2025)
  182. SentinelOne 8-K (Prompt Security acquisition)
  183. Wikipedia: Prompt Security (secondary)
  184. HiddenLayer homepage
  185. Palo Alto Networks FY2025 10-K (Protect AI acquisition)
  186. Meta: Llama 4 Community License
  187. Hugging Face: meta-llama/Llama-Guard-4-12B model card
  188. Hugging Face: meta-llama/Llama-Prompt-Guard-2-86M model card
  189. NVIDIA docs: NeMo Guardrails library overview
  190. NVIDIA NeMo Guardrails LICENSE.md
  191. GitHub REST API: guardrails-ai/guardrails repository metadata
  192. GitHub REST API: invariantlabs-ai/mcp-scan repository metadata
  193. GitHub: n8n-io/n8n LICENSE.md (Sustainable Use License)
  194. n8n pricing
  195. Toolradar: n8n pricing 2026 (secondary)
  196. AgentDeals: n8n (tracker, secondary)
  197. Temporal pricing
  198. Zapier MCP
  199. GitHub REST API: n8n-io/n8n repository metadata
  200. Zapier pricing
  201. Make pricing
  202. Pipedream pricing
  203. Activepieces pricing
  204. Windmill pricing
  205. GitHub REST API: temporalio/temporal repository metadata
  206. GitHub REST API: PrefectHQ/prefect repository metadata
  207. Prefect pricing
  208. GitHub REST API: apache/airflow repository metadata
  209. Retell AI pricing
  210. Morph: best AI voice agent platforms 2026 (secondary)
  211. Vapi pricing
  212. AI Agent Rank: Vapi vs Retell vs Bland 2026 (secondary)
  213. Bland AI pricing
  214. Bland AI blog: voice AI pricing for enterprise (vendor-authored)
  215. Synthflow pricing
  216. LiveKit pricing
  217. Sarvam AI API pricing
  218. Plivo: voice pricing for India (vendor-reported)
  219. Plivo pricing
  220. Bolna pricing (vendor-reported)
  221. Exotel pricing
  222. Exotel blog: migrating from Twilio (search summary; not read directly)
  223. edesy: Exotel AI voice agent (reseller; search summary)
  224. Twilio: voice pricing for India
  225. TRAI Direction of 4 May 2024 (DLT-based voice calling)
  226. Comments on the draft TCCCPR Third Amendment Regulations 2026 (hosted by TRAI)
  227. GitHub REST API: livekit/agents repository metadata
  228. GitHub REST API: pipecat-ai/pipecat repository metadata
  229. ElevenLabs pricing
  230. Deepgram pricing
  231. AssemblyAI pricing
  232. Cartesia pricing
  233. Meta for Developers: WhatsApp Business Platform pricing
  234. ChatMaxima: WhatsApp API pricing in India (vendor-reported)
  235. Gallabox: WhatsApp pricing overview (vendor-reported)
  236. Authkey: WhatsApp API pricing update (secondary)
  237. TelecomTalk: WhatsApp Business price reveal (secondary)
  238. GitHub: FlowiseAI/Flowise discussion #6727, The Future of Flowise
  239. GitHub REST API: langgenius/dify repository metadata
  240. Microsoft Learn: Copilot Studio billing and licensing
  241. Dify pricing
  242. GitHub REST API: langflow-ai/langflow repository metadata
  243. GitHub REST API: FlowiseAI/Flowise repository metadata
  244. Botpress pricing
  245. Voiceflow pricing
  246. Stack AI pricing
  247. Relevance AI pricing
  248. E2E Networks: TIR inference endpoints (vendor-reported)
  249. Yotta Shakti Cloud: AI endpoints (vendor-reported)

About this research: compiled from public sources by an AI research assistant and checked against primary sources on 12 October 2026. Each section links its sources. Prices, model versions and laws change quickly, so check the linked source before acting. This is general research, not legal, financial or investment advice.

Find out what AI could take off your team

Describe the work and the systems involved. We offer a free consultation and a written estimate, and you will talk directly to the developer who would build it.