Members-Only
Recent Talks & Demos are for members only
You must be an AI Tinkerers active member to view these talks and demos.
Open Source LLM Finetuning OR Hosting Llama / Mistral For $10/month with multi-lora serving
Learn how fine‑tuning open‑source LLMs improves performance and how multi‑LoRA adapters enable parallel hosting of finetuned models for just $10 monthly.
We went through YC’s S23 batch and are building a platform for fine-tuning and serving open source LLMs.
In general, we can tell a lot about the open source LLM landscape, which ones are currently the best ones available, and why we believe that in the long term, open source LLMs can win against OpenAI (we did not even believe this ourselves a month ago, but some interesting developments took place during the last weeks that changed our mind). To dive deeper into our product and tech, we could talk about two things:
1) how fine-tuning works, and how it improves model performance
2) how we are able to host finetuned models for as little as $10 per month by hosting lora adapters in parallel
Compose Email
Loading recent emails...