Whats is the difference between train, validation and test set, in neural networks?
2017-03-23 14:06
691 查看
The training and validation sets are used during training.
Once you’re finished training, then you run against your testing set and verify that the accuracy is sufficient.
Training Set: this data set is used to adjust the weights on the neural network.
Validation Set: this data set is used to minimize overfitting. You’re not adjusting the weights of the network with this data set, you’re just verifying that any increase in accuracy over the training data set actually yields an increase in accuracy over a data set that has not been shown to the network before, or at least the network hasn’t trained on it (i.e. validation data set). If the accuracy over the training data set increases, but the accuracy over then validation data set stays the same or decreases, then you’re overfitting your neural network and you should stop training.
Testing Set: this data set is used only for testing the final solution in order to confirm the actual predictive power of the network.
stackoverflow origin answer
for each epoch for each training data instance propagate error through the network adjust the weights calculate the accuracy over training data for each validation data instance calculate the accuracy over the validation data if the threshold validation accuracy is met exit training else continue training
Once you’re finished training, then you run against your testing set and verify that the accuracy is sufficient.
Training Set: this data set is used to adjust the weights on the neural network.
Validation Set: this data set is used to minimize overfitting. You’re not adjusting the weights of the network with this data set, you’re just verifying that any increase in accuracy over the training data set actually yields an increase in accuracy over a data set that has not been shown to the network before, or at least the network hasn’t trained on it (i.e. validation data set). If the accuracy over the training data set increases, but the accuracy over then validation data set stays the same or decreases, then you’re overfitting your neural network and you should stop training.
Testing Set: this data set is used only for testing the final solution in order to confirm the actual predictive power of the network.
stackoverflow origin answer
相关文章推荐
- whats is the difference between train, validation and test set, in neural networks?
- What is the difference between Views and Materialized Views in Oracle?
- OpenStack: What is the difference between Block storage and Object storage?Also, In what way they ar
- What is the Difference Between Type and Class in
- In PHP5, what is the difference between using self and $this? When is each appropriate?
- what is the difference between static and normal variables in c++
- macro与inline的区别 What is the difference between macro and inline?
- what is the difference between the setTimeout and setInterval
- What is the difference between @staticmethod and @classmethod in Python?
- What is the difference between getWidth/heigth() and getMeasuredWidth/Heigth() in Android SDK?
- what is the difference between definition and declaration in c
- What is the difference between test, [ and [[ ?
- What exactly is the difference between “pass by reference” in C and in C++?
- what is the difference between _source and _all in Elasticsearch
- What is the difference between SVD and matrix factorization in context of recommendation engine?
- What is the difference between provider network and self-service network in OpenStack?
- What Is the Difference Between a Block, a Proc, and a Lambda in Ruby
- what is the difference between definition and declaration in c
- What is the difference between BIT and TINYINT in MySQL
- What is the difference between a soft reference and a weak reference in Java?