Hi Folks, I am interested in LLM model integration. In the video below, Marco Argenti, the Chief Information Officer of Goldman Sachs, discusses it. Does someone know the solution to integrate several LLMs like API management?

we just released a product like this for compound ai systems at Baseten baseten.co/products/chains if you're looking for an API gateway for LLMs specifically (for things like auth), Kong's is open source and great. https://konghq.com/products/kong-ai-gateway