Fastest File Storage for AI
WekaFS (Weka) is a modern file system that is built for those who solve big problems and that easily meets the IO requirements of the most demanding AI and analytics models. It is perfect for data-intensive applications, whether hosted on-premises or in the public cloud.
Managing large amounts of data is challenging when AI training models span multiple GPU servers. Local disks deliver predictable performance, but data must first be copied into the server’s SSD storage, introducing significant server idle time and adding complexity to the workflows. A shared file system eliminates this cumbersome operation, but legacy file systems cause GPU IO starvation from poor performance and latency. WekaFS solves both issues, presenting a shared POSIX file system to the GPU servers and delivering extreme performance to keep data-intensive applications compute-bound.