Together, we'll develop a series of databases and explore topics including:

• Client/server socket programming
• Managing concurrent operations through different locking approaches
• Persisting records and indices on disk for both read-only and read/write databases
• Partitioning data for enhanced concurrent performance
• Write ahead logs for durability
• Storing documents (.e.g., JSON objects) and providing secondary indexes on their attributes
• Replication using leader/follower versus multiple leaders
• Implementing atomicity and isolation through transactions
• Planning and executing queries
• Benchmarking performance
• Simulating failure scenarios

Initially, we'll develop our projects in Java due to its ergonomics and performance. Overtime, we'll explore the tradeoffs for using different languages including C++, Python, and Rust.

Two reasons primarily:

1. All software engineers use databases and developing prototype databases improves our intuition about how they work.
2. In implementing databases, we’ll get to explore a range of different programming and software engineering topics and become generally stronger software engineers.

This site is very much a work in progress and new projects will be added over time. I’d greatly appreciate your feedback on how this work could be improved and ideas for new projects. You can contact me at matthew.hagy@gmail.com.