Validation Set
Separate part of training set
Optimize training to the point of maximum performance on training set, then test on validation set
Adjust training cycles and parameters to achieve max performance on validation set
Finally confirm result on true test set