KubeDay Japan 2024

This talk will focus on the advantages of using WebAssembly (Wasm) for running AI inference tasks in a cloud-native ecosystem. We will explore how Wasm empowers devs to develop on their own PC and have their AI inference uniformly performed across different hardwares, including GPUs, CPUs, operating systems, edge cloud etc. We'll discuss how Wasm and Wasm runtime facilitates seamless integration into cloud-native frameworks, enhancing the deployment and scalability of AI applications. Highlight how Wasm provides a flexible, efficient solution suitable for diverse cloud-native architectures, including K8s, to allow developers to fully tap the potential of LLMs, especially open source LLMs. The session is tailored for cloud-native practitioners and AI devs, offering insights into maximizing the potential of AI applications by leveraging the cross-platform capabilities of Wasm, ensuring consistency, low cost, and efficiency in AI inference across different computing environments.