Open-weight LLMs and generative AI models provide unique advantages for enterprises, particularly around privacy, security, and version control. Some of these models can run on-device, enabling powerful new applications. Others allow you to take a model that another company invested millions in training and fine-tune it for your own needs. At the same time, these models bring distinct challenges—whether deployed on-device or in the cloud. Let’s share what we’ve learned and explore the possibilities together.
Erik Hermansen is an engineering director at Bayer, and author of the Decent Apps open source tools for creating local-LLM-based web apps.