Michael Yuan
Dr. Michael Yuan is a maintainer of the WasmEdge project and a co-founder of Second State. He is the author of 5 books on software engineering published by Addison-Wesley, Prentice-Hall, and O'Reilly. Michael is a long- time open-source developer and contributor. He had previously spoken in many industry conferences including Open Source Summit, RustLab Conference, KubeCon, KCD, Qcon and many more.
Sessions
Open-source projects often succeed on innovation but fail on operability: installation, upgrades, permissions, observability, and support. In this talk, we’ll walk through what it takes to turn an open-source AI infrastructure project into a system real users can run safely on their own hardware.
Using the open source AI OS Olares as the case study, we’ll cover packaging, app lifecycle, GPU support, private data access, and remote access for a local sovereign cloud. We’ll also discuss what breaks when a project moves from developer excitement to actual everyday usage, and how to design the system so contributors and users can both succeed.
Attendees will leave with a clearer mental model for how to package open-source infrastructure in a way that is both technically sound and community-friendly.
The intersection of cloud-native principles and edge computing necessitates robust, scalable architectures capable of handling intermittent connectivity and resource constraints. This talk explores the design patterns for building resilient hybrid infrastructure tailored for local inference tasks. We will discuss the challenges of maintaining state and orchestrating services across distributed environments using Kubernetes. The session will detail how to architect control planes that gracefully handle edge node disconnections and the strategies for deploying containerized AI workloads seamlessly across diverse hardware environments. By focusing on the foundational cloud-native technologies, attendees will learn how to construct reliable systems that bring computation directly to the user's environment.