Show HN: Use Third Party LLM API in JetBrains AI Assistant

1. this is cool / innovative

2. had lots of fun with similar we should chain / tunnel this to this it can’t be done easily projects

3. fond memories reverse engineering JNI 1.0 to let Java only devs use C libs, get C# 1.0 to pipe via C++ to call C serial port driver for early drone microcontroller etc

all to say / nice work / keep building / like that it solves your very specific AI anywhere problem in JetBrains even tho it seems like wait where to even start! It can’t be done! Like Microsoft once told me re: C# 1.0

I tried using the AI assistant when it came out but seemingly was too stupid to figure out how to use it correctly. I tried to get it to write single functions or short blocks of code for me, but it would always start rewriting the whole file from scratch which was way too slow.

Has it gotten better since, or did I just do it wrong from the beginning?

Neat!

But instead of hitting each provider's API separately, managing their keys, etc., it may be easier to go through OpenRouter, which is a single endpoint, has hundreds of models, and doesn't add any cost on top of public prices from the providers.

There’s also https://github.com/xsharov/enchanted-ollama-openrouter-proxy

Congrats for shipping!

Have you seen LiteLLM Gateway before? As a bonus it supports a lot of different providers.

https://docs.litellm.ai/docs/simple_proxy

One thing I thought was funny was remembering these AI services all have the customer noncompete clause and this morning realizing they can actually sue you (not just rug pull you, actually bankrupt you with legal fees) if you use em to develop competing stuff

Does that imply using OpenAI/Anthropic/Gemini API/Grok/Copilot for anything but the most trivial jokish personal uses ought to be considered a serious breach of fiduciary duty because it exposes your business to potentially massive legal costs?

I literally was working on something similar. Emphasis on `was` since you beat me to it! :D

Wouldn't an extension be more suitable that runs on Jetbrains boot?

What’s considered the best small local model for coding? Something that can run on an m1 max 32gb ram?

does not gpt4free [g4all] do the same?

JetBrains really needs to support alternatives fast. Cursor, CoPilot, etc all need much better integration. VS Code is becoming almost mandatory for companies that force the use of LLM tools.