ChromaDotNet

ChromaDotNet.Client conformance: Chroma single server and Chroma Cloud

✓ every check passed · ✗ a check failed · ⚠ passed, with a defect of the Chroma server noted below · — not on a single server: a feature of distributed Chroma, the one Chroma Cloud runs on, and the check verified that the client reports the error of the server as documented · on Chroma Cloud, — is what an API key cannot do, with the error the check verified · ¹ a note under the table · a blank cell: the row is not about that column (the quotas of Chroma Cloud on a single server; on Chroma Cloud, the checks with no server or with a local container)

By feature

Chroma docs section Feature Windows · .NET Framework 4.6.2, 4.8 · x64, x86 Windows · .NET Core 3.1, .NET 5, 6, 7, 8, 9 · x64, x86 Windows · .NET 10 · x64, x86 Linux (Debian 11, Debian 12, Ubuntu 24.04) · .NET 6, 8, 9, 10 · x64 Alpine 3.24 (musl) · .NET 8, 10 · x64 Linux (Debian 12, Ubuntu 24.04) · .NET 8, 10 · arm64 NativeAOT, Ubuntu 24.04 · .NET 10 · x64 Chroma Cloud, AWS us-east-1 · .NET 10 · x64
Run Chroma Clients: local server, Chroma Cloud, authentication ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Tenants and databases ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓¹
Collections Manage collections ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Add, update, delete data (large writes in batches) ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Configure: HNSW, SPANN, embedding function ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
collections created when missing (lazy and now) ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Conditional transactions —² —² —² —² —² —² —² ✓
Attached functions: inputs —³ —³ —³ —³ —³ —³ —³ ⚠
Querying collections Query and get: l2, cosine, ip ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Metadata filtering, array metadata ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Full-text search and regex ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Chroma Cloud Collection forking — — — — — — — ✓
Schema: sparse vector search, BM25 — — — — — — — ✓
Search API (basics, filtering, ranking, group by, hybrid, pagination, batch) — — — — — — — ✓
Quotas & Limits: the client keeps to them or reports the error of Chroma ✓
Beyond the Chroma docs OpenTelemetry traces and metrics ✓ ✓⁴ ✓ ✓ ✓ ✓ ✓ ✓
Cancellation, timeouts, concurrent calls ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Dependency injection ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Testcontainers module ✓ ✓ ✓ ✓ ✓ ✓ ✓
Mocks in tests ✓ ✓ ✓ ✓ ✓ ✓ ✓
BM25 vectors computed by the client ✓ ✓ ✓ ✓ ✓ ✓ ✓
Search and filter requests built by the client ✓ ✓ ✓ ✓ ✓ ✓ ✓
Embeddings embeddings from a generator (IEmbeddingGenerator of Microsoft.Extensions.AI) ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓

¹ On cloud_aws-us-east-1, “create and get a tenant” is not available: an API key of Chroma Cloud cannot create a tenant: Chroma Cloud answers 403 "Permission denied.", which the client throws as a ChromaException; on cloud_aws-us-east-1, “collections in another tenant and database” is not available: an API key of Chroma Cloud cannot create a tenant for the collections of another tenant: Chroma Cloud answers 403 "Permission denied.", which the client throws as a ChromaException.
² On alpine_net10.0, alpine_net8.0, aot_net10.0, arm64_net10.0, arm64_net8.0, linux_net10.0, linux_net10.0_tr-TR, linux_net6.0, linux_net8.0, linux_net9.0, win32_net10.0, win32_net48, win32_net8.0, win_net10.0, win_net10.0_th-TH, win_net10.0_tr-TR, win_net462, win_net48, win_net48_de-DE, win_net48_fa-IR, win_net48_tr-TR, win_net5.0, win_net6.0, win_net6.0_ar-SA, win_net7.0, win_net8.0, win_net8.0_de-DE, win_net9.0, win_netcoreapp3.1, win_netcoreapp3.1_ja-JP, “begin, get, write and commit; a conflict; RunConditionalTransactionAsync again” is not available: distributed Chroma, the one Chroma Cloud runs on, has conditional transactions for the tenants that the configuration of its frontend enables; a single server answers 404 "NotFound: POST /api/v2/tenants/default_tenant/databases/default_database/collections/{collection_id}/conditional/get", which the client throws as a ChromaException.
³ On alpine_net10.0, alpine_net8.0, aot_net10.0, arm64_net10.0, arm64_net8.0, linux_net10.0, linux_net10.0_tr-TR, linux_net6.0, linux_net8.0, linux_net9.0, win32_net10.0, win32_net48, win32_net8.0, win_net10.0, win_net10.0_th-TH, win_net10.0_tr-TR, win_net462, win_net48, win_net48_de-DE, win_net48_fa-IR, win_net48_tr-TR, win_net5.0, win_net6.0, win_net6.0_ar-SA, win_net7.0, win_net8.0, win_net8.0_de-DE, win_net9.0, win_netcoreapp3.1, win_netcoreapp3.1_ja-JP, “another input (AddFunctionInputAsync)” is not available: distributed Chroma, the one Chroma Cloud runs on, has attached functions; a single server answers 404 "NotFound: POST /api/v2/tenants/default_tenant/databases/default_database/collections/{collection_id}/attached_functions/stats/add_input", which the client throws as a ChromaException.
⁴ On win_netcoreapp3.1, win_netcoreapp3.1_ja-JP, “the duration histogram and its buckets, with the OpenTelemetry SDK” is not available: the OpenTelemetry SDK exports no metric on this runtime, also from a meter of its own.

Same answers in every environment

The seeded fuzz of the test bench sends the same random requests from each environment to a fresh Chroma 1.5.9 and compares what comes back, suite by suite, with the answers on win_net10.0: 30 environments, two seeds. ✓ the same answers in every environment of the column, ✗ different somewhere.

Suite Windows · .NET Framework 4.6.2, 4.8 · x64, x86 Windows · .NET Core 3.1, .NET 5, 6, 7, 8, 9 · x64, x86 Windows · .NET 10 · x64, x86 Linux (Debian 11, Debian 12, Ubuntu 24.04) · .NET 6, 8, 9, 10 · x64 Alpine 3.24 (musl) · .NET 8, 10 · x64 Linux (Debian 12, Ubuntu 24.04) · .NET 8, 10 · arm64 NativeAOT, Ubuntu 24.04 · .NET 10 · x64
bm25 ✓ ✓ ✓ ✓ ✓ ✓ ✓
concurrency ✓ ✓ ✓ ✓ ✓ ✓ ✓
documents ✓ ✓ ✓ ✓ ✓ ✓ ✓
edges ✓ ✓ ✓ ✓ ✓ ✓ ✓
embeddings ✓ ✓ ✓ ✓ ✓ ✓ ✓
filters ✓ ✓ ✓ ✓ ✓ ✓ ✓
metadata ✓ ✓ ✓ ✓ ✓ ✓ ✓
names ✓ ✓ ✓ ✓ ✓ ✓ ✓
paging ✓ ✓ ✓ ✓ ✓ ✓ ✓
serialization ✓ ✓ ✓ ✓ ✓ ✓ ✓

Environments

Column Environment System Architecture Runtime Client build Culture Checks
Windows · .NET Framework 4.6.2, 4.8 · x64, x86 win_net462 Microsoft Windows 10.0.26200 X64 .NET Framework 4.8.9363.0 .NETFramework,Version=v4.6.2 en-GB 65 ✓ · 5 —
Windows · .NET Framework 4.6.2, 4.8 · x64, x86 win32_net48 Microsoft Windows 10.0.26200 X86 .NET Framework 4.8.9363.0 .NETFramework,Version=v4.6.2 en-GB 65 ✓ · 5 —
Windows · .NET Framework 4.6.2, 4.8 · x64, x86 win_net48 Microsoft Windows 10.0.26200 X64 .NET Framework 4.8.9363.0 .NETFramework,Version=v4.6.2 en-GB 65 ✓ · 5 —
Windows · .NET Framework 4.6.2, 4.8 · x64, x86 win_net48_de-DE Microsoft Windows 10.0.26200 X64 .NET Framework 4.8.9363.0 .NETFramework,Version=v4.6.2 de-DE 65 ✓ · 5 —
Windows · .NET Framework 4.6.2, 4.8 · x64, x86 win_net48_fa-IR Microsoft Windows 10.0.26200 X64 .NET Framework 4.8.9363.0 .NETFramework,Version=v4.6.2 fa-IR 65 ✓ · 5 —
Windows · .NET Framework 4.6.2, 4.8 · x64, x86 win_net48_tr-TR Microsoft Windows 10.0.26200 X64 .NET Framework 4.8.9363.0 .NETFramework,Version=v4.6.2 tr-TR 65 ✓ · 5 —
Windows · .NET Core 3.1, .NET 5, 6, 7, 8, 9 · x64, x86 win_netcoreapp3.1 Microsoft Windows 10.0.26200 X64 .NET Core 3.1.28 .NETStandard,Version=v2.0 en-GB 64 ✓ · 6 —
Windows · .NET Core 3.1, .NET 5, 6, 7, 8, 9 · x64, x86 win_netcoreapp3.1_ja-JP Microsoft Windows 10.0.26200 X64 .NET Core 3.1.28 .NETStandard,Version=v2.0 ja-JP 64 ✓ · 6 —
Windows · .NET Core 3.1, .NET 5, 6, 7, 8, 9 · x64, x86 win_net5.0 Microsoft Windows 10.0.26200 X64 .NET 5.0.16 .NETStandard,Version=v2.0 en-GB 65 ✓ · 5 —
Windows · .NET Core 3.1, .NET 5, 6, 7, 8, 9 · x64, x86 win_net6.0 Microsoft Windows 10.0.26200 X64 .NET 6.0.6 .NETStandard,Version=v2.0 en-GB 65 ✓ · 5 —
Windows · .NET Core 3.1, .NET 5, 6, 7, 8, 9 · x64, x86 win_net6.0_ar-SA Microsoft Windows 10.0.26200 X64 .NET 6.0.6 .NETStandard,Version=v2.0 ar-SA 65 ✓ · 5 —
Windows · .NET Core 3.1, .NET 5, 6, 7, 8, 9 · x64, x86 win_net7.0 Microsoft Windows 10.0.26200 X64 .NET 7.0.20 .NETStandard,Version=v2.0 en-GB 65 ✓ · 5 —
Windows · .NET Core 3.1, .NET 5, 6, 7, 8, 9 · x64, x86 win32_net8.0 Microsoft Windows 10.0.26200 X86 .NET 8.0.31 .NETStandard,Version=v2.0 en-GB 65 ✓ · 5 —
Windows · .NET Core 3.1, .NET 5, 6, 7, 8, 9 · x64, x86 win_net8.0 Microsoft Windows 10.0.26200 X64 .NET 8.0.34 .NETStandard,Version=v2.0 en-GB 65 ✓ · 5 —
Windows · .NET Core 3.1, .NET 5, 6, 7, 8, 9 · x64, x86 win_net8.0_de-DE Microsoft Windows 10.0.26200 X64 .NET 8.0.34 .NETStandard,Version=v2.0 de-DE 65 ✓ · 5 —
Windows · .NET Core 3.1, .NET 5, 6, 7, 8, 9 · x64, x86 win_net9.0 Microsoft Windows 10.0.26200 X64 .NET 9.0.20 .NETStandard,Version=v2.0 en-GB 65 ✓ · 5 —
Windows · .NET 10 · x64, x86 win32_net10.0 Microsoft Windows 10.0.26200 X86 .NET 10.0.12 .NETCoreApp,Version=v10.0 en-GB 65 ✓ · 5 —
Windows · .NET 10 · x64, x86 win_net10.0 Microsoft Windows 10.0.26200 X64 .NET 10.0.15 .NETCoreApp,Version=v10.0 en-GB 65 ✓ · 5 —
Windows · .NET 10 · x64, x86 win_net10.0_th-TH Microsoft Windows 10.0.26200 X64 .NET 10.0.15 .NETCoreApp,Version=v10.0 th-TH 65 ✓ · 5 —
Windows · .NET 10 · x64, x86 win_net10.0_tr-TR Microsoft Windows 10.0.26200 X64 .NET 10.0.15 .NETCoreApp,Version=v10.0 tr-TR 65 ✓ · 5 —
Linux (Debian 11, Debian 12, Ubuntu 24.04) · .NET 6, 8, 9, 10 · x64 linux_net6.0 Debian GNU/Linux 11 (bullseye) X64 .NET 6.0.36 .NETStandard,Version=v2.0 invariant 65 ✓ · 5 —
Linux (Debian 11, Debian 12, Ubuntu 24.04) · .NET 6, 8, 9, 10 · x64 linux_net8.0 Debian GNU/Linux 12 (bookworm) X64 .NET 8.0.34 .NETStandard,Version=v2.0 invariant 65 ✓ · 5 —
Linux (Debian 11, Debian 12, Ubuntu 24.04) · .NET 6, 8, 9, 10 · x64 linux_net9.0 Debian GNU/Linux 12 (bookworm) X64 .NET 9.0.23 .NETStandard,Version=v2.0 invariant 65 ✓ · 5 —
Linux (Debian 11, Debian 12, Ubuntu 24.04) · .NET 6, 8, 9, 10 · x64 linux_net10.0 Ubuntu 24.04.5 LTS X64 .NET 10.0.15 .NETCoreApp,Version=v10.0 invariant 65 ✓ · 5 —
Linux (Debian 11, Debian 12, Ubuntu 24.04) · .NET 6, 8, 9, 10 · x64 linux_net10.0_tr-TR Ubuntu 24.04.5 LTS X64 .NET 10.0.15 .NETCoreApp,Version=v10.0 tr-TR 65 ✓ · 5 —
Alpine 3.24 (musl) · .NET 8, 10 · x64 alpine_net8.0 Alpine Linux v3.24 X64 .NET 8.0.34 .NETStandard,Version=v2.0 invariant 65 ✓ · 5 —
Alpine 3.24 (musl) · .NET 8, 10 · x64 alpine_net10.0 Alpine Linux v3.24 X64 .NET 10.0.15 .NETCoreApp,Version=v10.0 invariant 65 ✓ · 5 —
Linux (Debian 12, Ubuntu 24.04) · .NET 8, 10 · arm64 arm64_net8.0 Debian GNU/Linux 12 (bookworm) Arm64 .NET 8.0.34 .NETStandard,Version=v2.0 invariant 65 ✓ · 5 —
Linux (Debian 12, Ubuntu 24.04) · .NET 8, 10 · arm64 arm64_net10.0 Ubuntu 24.04.5 LTS Arm64 .NET 10.0.15 .NETCoreApp,Version=v10.0 invariant 65 ✓ · 5 —
NativeAOT, Ubuntu 24.04 · .NET 10 · x64 aot_net10.0 Ubuntu 24.04.5 LTS X64 .NET 10.0.15, NativeAOT .NETCoreApp,Version=v10.0 invariant 65 ✓ · 5 —
Chroma Cloud, AWS us-east-1 · .NET 10 · x64 cloud_aws-us-east-1 Chroma Cloud, AWS us-east-1; the client on Microsoft Windows 10.0.26200 X64 .NET 10.0.15 .NETCoreApp,Version=v10.0 en-GB 79 ✓ · 1 ⚠ · 2 —

Checks

Clients: local server, Chroma Cloud, authentication

Tenants and databases

Manage collections

Add, update, delete data (large writes in batches)

Configure: HNSW, SPANN, embedding function

collections created when missing (lazy and now)

Conditional transactions

Attached functions: inputs

Query and get: l2, cosine, ip

Metadata filtering, array metadata

Full-text search and regex

Collection forking

Schema: sparse vector search, BM25

Search API (basics, filtering, ranking, group by, hybrid, pagination, batch)

Quotas & Limits: the client keeps to them or reports the error of Chroma

OpenTelemetry traces and metrics

Cancellation, timeouts, concurrent calls

Dependency injection

Testcontainers module

Mocks in tests

BM25 vectors computed by the client

Search and filter requests built by the client

embeddings from a generator (IEmbeddingGenerator of Microsoft.Extensions.AI)