LMSYS Org
LMSYS Org develops open models, benchmarks, and high-performance serving engines like Chatbot Arena and SGLang for large language models.
What it is
LMSYS Org is an open research organization that builds and maintains infrastructure, evaluation frameworks, and models for large language models. The organization provides developers with tools for high-performance serving, benchmarking, and routing.
Key features
- High-performance serving engine for language and multimodal models
- Crowdsourced benchmarking platform with randomized model battles
- Open-source platform for training, finetuning, and serving chatbots
- Framework for routing and evaluating different language models
- Open-source conversational models matching commercial quality
Who it's for
LMSYS Org is designed for researchers, machine learning engineers, and developers who need to train, serve, evaluate, and benchmark large language models efficiently.
Pricing
Check the official website for current pricing.
Use cases
- Benchmark language models
- Serve multimodal models
- Route inference requests
- Finetune chatbot models
FAQ
What is Chatbot Arena?
Chatbot Arena is a benchmarking platform featuring anonymous, randomized battles in a crowdsourced manner for language models.
What is SGLang?
SGLang is a high-performance serving engine designed for large language models and multimodal models.
Is FastChat available for training and finetuning?
Yes, FastChat is an open and scalable platform for training, finetuning, serving, and evaluating chatbot models.
Similar to LMSYS Org
