Reddit Migrates Media Metadata From S3 and Other Systems into AWS Aurora Postgres

▤ Summary

Reddit also observes trends in user behavior and expects more media content to be uploaded in the coming years. The company decided to create a unified system for managing media metadata and opted to use AWS Aurora Postgres for data storage over Apache Cassandra. Although both databases met Reddit’s requirements, Postgres was chosen because it offers better ad-hoc debugging and more flexible query patterns. Anticipating future growth (50TB of media metadata by 2030), the engineers employed table partitioning to support scalability in a Postgres-based solution. With all scalability and performance optimizations, the metadata store delivers a low read latency of 2.6ms (p50), 4.7ms (p90), and 17ms (p99) at 100k RPS (requests per second).

▦ Linked Companies