Thanks for bringing up a service like this, it's quite important. A few serious questions if you don't mind.

Confidentiality? Do you use any sort of logging and if not do you have a way to guarantee that your hosting providers are not snooping?

Price vs Vast or Runpod? If i have a very large or a very small workload do you have a competitive rate vs a gpu provider that offers private gpu access?

Subscription vs Api costs? Do you only offer api rate or will you offer discounted tokens for subscription? Subscription friendly towards open source harnesses such as omp?

Heretic ablation vs other methods? KL divergence scores? Do you post train the weights yourselves or do you offer weights trained by other organizations and is this information available on the service?

Cache hit/miss pricing policy? 90/10 or a different cache pricing policy, and how long do conversions stay in kv cache?

Quantized cache and model? Do you offer a choice if i want a quantized model for speed or a quantized cache? If not do you publish the information?

SGlang vs vllm or other inference engine? Do you publish your engine stack details?

Thank you kindly I find the competition in this space very lacking.

You sir are a hero! As long as no guardrails or censorship gets erected in your offering, I hereby exclude it from my NEVER SUBSCRIBE statements! :^)

>legally speaking, in our jurisdiction, at least according to Claude -- we're talking to a real lawyer next week

That's going to be fun lol

Let us know what your insurance is like.