Hello! I saw that tweet and thought it was awesome :-)
I’ve been wondering about the same thing lately - the best way to host (and monetize!) an API. Perhaps because I’m not the greatest designer and APIs come more naturally to me, and also because I’ve read the recent posts about LangChain / ReAct and it makes me think that creating APIs for LLM use might be a great business model - like the old saying, you’d be selling shovels in a gold rush, rather than doing the shovelling yourself.
Anyway I think perhaps something like
https://cloud.google.com/apigee might be good? It seems to me that when creating APIs, the code / logic is easy (and fun, and what you want to concentrate on)… and it’s everything else that’s hard, the admin and ops of authenticating users, rate limiting, stopping abuse, charging users… That’s what Apigee seems to be solving for.