Recently my database work hit a critical threshold and I'm working through how to present these results as well as re-checking the underlying data. I wasn't ready for the volume of data and it's only been recently that I've gotten a handle on it. The silver database records currently have over 104 millions rows (and 27 million for gold) - most of that is repeated information but it is a lot of data points to manage and index.