Wednesday, 9 October 2024

New top story on Hacker News: Show HN: FinetuneDB – AI fine-tuning platform to create custom LLMs

Show HN: FinetuneDB – AI fine-tuning platform to create custom LLMs
10 by felix089 | 4 comments on Hacker News.
Hey HN! We’re building FinetuneDB ( https://finetunedb.com/ ), an LLM fine-tuning platform. It enables teams to easily create and manage high-quality datasets, and streamlines the entire workflow from fine-tuning to serving and evaluating models with domain experts. You can check out our docs here: ( https://ift.tt/0sYyklv ) FinetuneDB exists because creating and managing high-quality datasets is a real bottleneck when fine-tuning LLMs. The quality of your data directly impacts the performance of your fine-tuned models, and existing tools didn’t offer an easy way for teams to build, organize, and iterate on their datasets. We’ve been working closely with our pilot customers, both AI startups and more traditional businesses like a large newspaper, which is fine-tuning models on their articles to automate content generation in their tone of voice. The platform is built with an end-to-end workflow in mind, from dataset building, fine-tuning, serving, and evaluating outputs. The centerpiece is a version-controlled, no-code dataset manager where you can upload existing datasets in JSONL, use production data, or collaborate with domain experts to create high-quality datasets for custom use cases. We also offer evaluation workflows that allow non-technical contributors to annotate data, review model outputs, and refine responses (LLM-as-judge also available). We offer: - A free tier for developers and hobbyists who want to streamline dataset management. - Business-tier with full feature access for teams, using per-seat pricing. - A custom tier for model hosting, custom integrations, and self-hosting. Most users still use OpenAI models, but if you're working with open-source LLMs, we offer pay-as-you-go pricing for serverless inference for Llama and Mistral models with up to €100 in free credits to get started. We're in public beta right now, so any feedback—whether it’s about features, usability, or anything else—would be incredibly valuable. If you've worked on fine-tuning models before or are curious about custom LLMs, we’d love to hear from you. Our goal is to make the fine-tuning process more accessible and help more companies leverage their data and domain experts to create custom LLMs. Thanks for checking it out!

No comments:

Post a Comment