logoalt Hacker News

flecomet • today at 7:29 PM • 0 replies • view on HN

Nice tool. Does it support local embedding providers such as qdrant https://qdrant.tech/ ? Why only support paid, cloud-based embeddings provider ?

ChatGPT says it could work without updating the code, but since README doesn't advertise it, I was curious as to the reason behind this choice.

It says: "Can Slopdex run without paid embedding APIs?

Potentially yes, without modifying its code. [...] Slopdex supports a custom embeddingBaseUrl, allowing it to call a locally hosted, OpenAI-compatible embedding server. For example, with a local model producing 768-dimensional vectors: { "provider": "openai", "model": "your-local-embedding-model", "dimensions": 768, "symbolDimensions": 768, "embeddingBaseUrl": "http://localhost:1234/v1" }

Its code still requires an OPENAI_API_KEY value, but a dummy key should work if your local server doesn't enforce authentication.

The server must implement /v1/embeddings and accept Slopdex's request format, including the dimensions parameter. The relevant code is in vector_openai.rs."