Thanks! Well, it had previously been about $5usd a day. Until today and this post... So far in the last 24 hours I've auto topped up while I was asleep 4 times and spent $170 bucks on inference alone.
The complexity of the model does heavily influence the cost. Some models can cost me at little as 7 cents to generate. Others can be a couple bucks.
At the moment I'm focusing on user experience. I just trying to make a product people love as number 1 priority. I'm constantly trying to improve the speed and quality of the model outputs for user. Thankfully, optimising speed helps bring costs down as a side effect too!
alt Hacker News
Thanks! Well, it had previously been about $5usd a day. Until today and this post... So far in the last 24 hours I've auto topped up while I was asleep 4 times and spent $170 bucks on inference alone.
The complexity of the model does heavily influence the cost. Some models can cost me at little as 7 cents to generate. Others can be a couple bucks.
At the moment I'm focusing on user experience. I just trying to make a product people love as number 1 priority. I'm constantly trying to improve the speed and quality of the model outputs for user. Thankfully, optimising speed helps bring costs down as a side effect too!