Hacker News Front Page · Jared Siegel ·
If you don't run your own LLM proxy, how the fuck do you even know whats going on?
El autor sostiene que quienes usan modelos de lenguaje deberían ejecutar su propio proxy de LLM para obtener métricas útiles, registrar qué claves y modelos se usan y controlar la ruta de los datos. Un proxy propio también permite usar varios proveedores desde un único endpoint, gestionar claves virtuales y cambiar de modelo con rapidez; el autor afirma que esa visibilidad ayuda a diagnosticar problemas como los fallos de caché.
I think the title captures the idea fully but I'll dig into it because this ain't Twitter. You're working an idea, a piece of code, or a multibillion a year SaaS app which is probably saving the world. Maybe you're automating the cloning process of grabbing new Labubu release images and taking the 2D image and using a ComfyUI to translate it into a 3D CAD to get the replica production started faster because CNY is on the horizon and global manufacturing halts around that time. Maybe you like to