I’m continuing to work on my Medieval Realms project and one of the obstacles I’m faced with at the moment is the storage and retrieval of large amounts of data.

My initial test application which consists of approximately 410,000 data sets using a single insert per statement took a whopping 1 hour and 4 minutes to complete. This rang some alarm bells 😲 as my test data set was only a fraction of the intended final data set.

In overcoming this problem I created a program that would handle multiple inserts onto a table.

This turned out to be really effective. What originally took over an hour to process I knocked down to slightly over 7 minutes.

Having said this, this application is not limited to 10 inserts per statement. In fact, the way the application is written we can set the insert rate at whatever we want. I’ll soon be testing this out on much larger data sets and with much larger insert rates.

Here’s a nice graph. We all love graphs.