Open Source in the Age of LLMs

blog.mozilla.ai
Technology
6 min4/10/2024

Mozilla.ai is a company that focuses on developing large language models (LLMs) and building a platform for developers and organizations to independently develop, deploy, and evaluate LLMs within an open-source ecosystem. The company has been actively contributing to the open-source LLM development, evaluation, and serving communities, including enabling OpenAI-style chat completions in EleutherAI's lm-evaluation-harness, surfacing constructor logic in HuggingFace's PEFT library, improving KubeRay's Helm configuration chart, and more. The key to successful open-source contributions, according to Mozilla.ai, is to start small, be easy to work with, write unit tests, assume good intent, match the pace of the LLM ecosystem, and work in the open.