Amazon Bedrock is probably middlemanning an insane amount of token consumption these days for the same reasons.
Is Bedrock a "middleman?" I believe that they run all inference inside of AWS data centers, on their own infrastructure.
Their new endpoint even promises zero operator access [0]
[0] https://aws.amazon.com/blogs/machine-learning/exploring-the-...
alt Hacker News
Is Bedrock a "middleman?" I believe that they run all inference inside of AWS data centers, on their own infrastructure.
Their new endpoint even promises zero operator access [0]
[0] https://aws.amazon.com/blogs/machine-learning/exploring-the-...