Вы находитесь на странице: 1из 3

3. Model selection and evaluation — scikit-learn 0.19.1 documentation http://scikit-learn.org/stable/model_selection.


Home Installation

3. Model selection and evaluation

3.1. Cross-validation: evaluating estimator
« performance
3.1.1. Computing cross-validated metrics The cross_validate function and multiple metric
evaluation Obtaining predictions by cross-validation
3.1.2. Cross validation iterators Cross-validation iterators for i.i.d. data K-fold Repeated K-Fold Leave One Out (LOO) Leave P Out (LPO) Random permutations cross-validation a.k.a.
Shuffle & Split Cross-validation iterators with stratification based on
class labels. Stratified k-fold Stratified Shuffle Split Cross-validation iterators for grouped data. Group k-fold Leave One Group Out Leave P Groups Out Group Shuffle Split Predefined Fold-Splits / Validation-Sets Cross validation of time series data Time Series Split
3.1.3. A note on shuffling
3.1.4. Cross validation and model selection

3.2. Tuning the hyper-parameters of an

3.2.1. Exhaustive Grid Search
3.2.2. Randomized Parameter Optimization
3.2.3. Tips for parameter search Specifying an objective metric Specifying multiple metrics for evaluation Composite estimators and parameter spaces Model selection: development and evaluation Parallelism Robustness to failure

3.2.4. Alternatives to brute force parameter search Next

1 of 3 6/19/2018, 12:37 PM
3. Model selection and evaluation — scikit-learn 0.19.1 documentation http://scikit-learn.org/stable/model_selection.html Model specific cross-validation sklearn.linear_model.ElasticNetCV sklearn.linear_model.LarsCV sklearn.linear_model.LassoCV Examples using
« sklearn.linear_model.LassoCV sklearn.linear_model.LassoLarsCV Examples using
sklearn.linear_model.LassoLarsCV sklearn.linear_model.LogisticRegressionCV sklearn.linear_model.MultiTaskElasticNetCV sklearn.linear_model.MultiTaskLassoCV
sklearn.linear_model.OrthogonalMatchingPursuitCV Examples using
suitCV sklearn.linear_model.RidgeCV Examples using
sklearn.linear_model.RidgeCV sklearn.linear_model.RidgeClassifierCV Information Criterion sklearn.linear_model.LassoLarsIC Examples using
sklearn.linear_model.LassoLarsIC Out of Bag Estimates sklearn.ensemble.RandomForestClassifier Examples using
sklearn.ensemble.RandomForestClassifier sklearn.ensemble.RandomForestRegressor Examples using
sklearn.ensemble.RandomForestRegressor sklearn.ensemble.ExtraTreesClassifier Examples using
sklearn.ensemble.ExtraTreesClassifier sklearn.ensemble.ExtraTreesRegressor Examples using
sklearn.ensemble.ExtraTreesRegressor sklearn.ensemble.GradientBoostingClassifier Examples using
r sklearn.ensemble.GradientBoostingRegressor Examples using

3.3. Model evaluation: quantifying the

quality of predictions
3.3.1. The scoring parameter: defining model evaluation

2 of 3 6/19/2018, 12:37 PM
3. Model selection and evaluation — scikit-learn 0.19.1 documentation http://scikit-learn.org/stable/model_selection.html

rules Common cases: predefined values Defining your scoring strategy from metric functions Implementing your own scoring object Using multiple metric evaluation
« 3.3.2. Classification metrics From binary to multiclass and multilabel Accuracy score Cohen’s kappa Confusion matrix Classification report Hamming loss Jaccard similarity coefficient score Precision, recall and F-measures Binary classification Multiclass and multilabel classification Hinge loss Log loss Matthews correlation coefficient Receiver operating characteristic (ROC) Zero one loss Brier score loss
3.3.3. Multilabel ranking metrics Coverage error Label ranking average precision Ranking loss
3.3.4. Regression metrics Explained variance score Mean absolute error Mean squared error Mean squared logarithmic error Median absolute error R² score, the coefficient of determination
3.3.5. Clustering metrics
3.3.6. Dummy estimators

3.4. Model persistence

3.4.1. Persistence example
3.4.2. Security & maintainability limitations

3.5. Validation curves: plotting scores to

evaluate models
3.5.1. Validation curve
3.5.2. Learning curve

Previous Next

3 of 3 6/19/2018, 12:37 PM