Refactor core code to better use dataframes

[justinfinkle]

This would make it much easier to use uneven data (e.g. more samples at one data point).