GPU Acceleration

As of Typesense Server v0.25.0, Typesense can generate embeddings natively, with data in your JSON documents, using any of the built-in ML models listed here (or using OpenAI API or PaLM API).

When you use one of the built-in ML models, you can improve performance of the embedding generation significantly, during indexing and at search time (for eg, when doing semantic / hybrid search) by having Typesense utilize a GPU.

GPU Acceleration is available in the following RAM / vCPU configuration in select regions:

Memory vCPU
8 GB 4 vCPUs
16 GB 4 vCPUs
16 GB 8 vCPUs
32 GB 8 vCPUs
32 GB 16 vCPUs
64 GB 16 vCPUs
64 GB 32 vCPUs
128 GB 32 vCPUs
128 GB 64 vCPUs
192 GB 48 vCPUs
256 GB 64 vCPUs
384 GB 96 vCPUs

Still need help? Contact Us Contact Us