Bridging Worlds: The Story of 8kdata and the Evolution of Modern Database Architecture

In the fast-paced ecosystem of database technology, engineers have long faced a rigid dividing line: the structured, reliable world of Relational Database Management Systems (RDBMS) versus the flexible, schema-free world of NoSQL. For years, developers felt forced to choose between the ACID compliance and relational power of engines like PostgreSQL and the document-oriented, developer-friendly agility of platforms like MongoDB.

Enter 8kdata—an innovative database research and development company that set out to dissolve these artificial boundaries. By marrying the robust storage foundations of traditional relational systems with the dynamic needs of modern application development, 8kdata left a lasting footprint on open-source database architecture.

The Genesis: Rethinking NoSQL on Top of Postgres

Founded by seasoned database experts (including prominent PostgreSQL community contributors like Álvaro Hernández Tortosa), 8kdata positioned itself at the bleeding edge of database R&D.

Rather than building a NoSQL database entirely from scratch—a grueling process fraught with the challenges of reinventing concurrency control, durability, and journaling—the team asked a radical question: What if an RDBMS, specifically PostgreSQL, could natively speak NoSQL?

This core philosophy birthed ToroDB (originally developed by 8kdata). ToroDB was an open-source, document-oriented database completely compatible with MongoDB, yet built entirely on top of PostgreSQL.

How ToroDB Innovated:

• The Best of Both Worlds: It allowed developers to continue using the sophisticated MongoDB query language and schema-less document paradigm they loved.
• Relational Storage Engine: Unlike solutions that merely dumped JSON blobs into basic text columns, ToroDB mapped and stored document data relationally inside PostgreSQL. This unlocked powerful capabilities like executing complex SQL queries, business intelligence (BI) aggregation, and seamless reporting directly over MongoDB-style data.
• ACID Reliability: Because it leveraged PostgreSQL as its storage layer, users gained enterprise-grade transactional safety, robust concurrency, and high availability without sacrificing document flexibility.

Technical Contributions to the Open Source Community

Beyond flagship projects like ToroDB, the engineers at 8kdata contributed heavily to the broader database engineering toolkit, particularly around PostgreSQL optimization and connectivity. Some of their notable open-source work included:

• Phoebe: A toolkit designed for building asynchronous PostgreSQL drivers, helping modernize how applications communicate efficiently with Postgres clusters.
• Performance Tooling: Projects like javapgperf, which meticulously measured and benchmarked Java application overhead when querying PostgreSQL databases, providing deep insights for enterprise architects aiming to squeeze maximum throughput out of their systems.

Legacy and Impact

The innovations pioneered by 8kdata highlighted a crucial shift in data architecture: the convergence of workloads. Modern enterprises no longer want siloed databases for operational relational data, JSON documents, and analytical insights.