Rapidly scaling online storage to serve over 1 billion ChatGPT users (Part II)
OpenAI describes the technical architecture behind Habitat, its online storage system, which was scaled to support over 1 billion ChatGPT users through multi-tenancy, global caching, and Azure Cosmos DB integration. The system achieved 12× faster read performance compared to previous iterations.
Source: OpenAI