Error Estimation for Pattern Recognition
(Sprache: Englisch)
This book is the first of its kind to discuss error estimation with a model-based approach. From the basics of classifiers and error estimators to distributional and Bayesian theory, it covers important topics and essential issues pertaining to the...
Leider schon ausverkauft
versandkostenfrei
Buch (Gebunden)
122.00 €
Produktdetails
Produktinformationen zu „Error Estimation for Pattern Recognition “
Klappentext zu „Error Estimation for Pattern Recognition “
This book is the first of its kind to discuss error estimation with a model-based approach. From the basics of classifiers and error estimators to distributional and Bayesian theory, it covers important topics and essential issues pertaining to the scientific validity of pattern classification.Error Estimation for Pattern Recognition focuses on error estimation, which is a broad and poorly understood topic that reaches all research areas using pattern classification. It includes model-based approaches and discussions of newer error estimators such as bolstered and Bayesian estimators. This book was motivated by the application of pattern recognition to high-throughput data with limited replicates, which is a basic problem now appearing in many areas. The first two chapters cover basic issues in classification error estimation, such as definitions, test-set error estimation, and training-set error estimation. The remaining chapters in this book cover results on the performance and representation of training-set error estimators for various pattern classifiers.
Additional features of the book include:
* The latest results on the accuracy of error estimation
* Performance analysis of re-substitution, cross-validation, and bootstrap error estimators using analytical and simulation approaches
* Highly interactive computer-based exercises and end-of-chapter problems
This is the first book exclusively about error estimation for pattern recognition.
Ulisses M. Braga Neto is an Associate Professor in the Department of Electrical and Computer Engineering at Texas A&M University, USA. He received his PhD in Electrical and Computer Engineering from The Johns Hopkins University. Dr. Braga Neto received an NSF CAREER Award for his work on error estimation for pattern recognition with applications in genomic signal processing. He is an IEEE Senior Member.
Edward R. Dougherty is a Distinguished Professor, Robert F.
... mehr
Kennedy '26 Chair, and Scientific Director at the Center for Bioinformatics and Genomic Systems Engineering at Texas A&M University, USA. He is a fellow of both the IEEE and SPIE, and he has received the SPIE Presidents Award. Dr. Dougherty has authored several books including Epistemology of the Cell: A Systems Perspective on Biological Knowledge and Random Processes for Image and Signal Processing (Wiley-IEEE Press).
... weniger
Inhaltsverzeichnis zu „Error Estimation for Pattern Recognition “
PREFACE XIIIACKNOWLEDGMENTS XIX
LIST OF SYMBOLS XXI
1 CLASSIFICATION 1
1.1 Classifiers 1
1.2 Population-Based Discriminants 3
1.3 Classification Rules 8
1.4 Sample-Based Discriminants 13
1.4.1 Quadratic Discriminants 14
1.4.2 Linear Discriminants 15
1.4.3 Kernel Discriminants 16
1.5 Histogram Rule 16
1.6 Other Classification Rules 20
1.6.1 k-Nearest-Neighbor Rules 20
1.6.2 Support Vector Machines 21
1.6.3 Neural Networks 22
1.6.4 Classification Trees 23
1.6.5 Rank-Based Rules 24
1.7 Feature Selection 25
Exercises 28
2 ERROR ESTIMATION35
2.1 Error Estimation Rules 35
2.2 Performance Metrics 38
2.2.1 Deviation Distribution 39
2.2.2 Consistency 41
2.2.3 Conditional Expectation 41
2.2.4 Linear Regression 42
2.2.5 Confidence Intervals 42
2.3 Test-Set Error Estimation 43
2.4 Resubstitution 46
2.5 Cross-Validation 48
2.6 Bootstrap 55
2.7 Convex Error Estimation 57
2.8 Smoothed Error Estimation 61
2.9 Bolstered Error Estimation 63
2.9.1 Gaussian-Bolstered Error Estimation 67
2.9.2 Choosing the Amount of Bolstering 68
2.9.3 Calibrating the Amount of Bolstering 71
Exercises 73
3 PERFORMANCE ANALYSIS77
3.1 Empirical Deviation Distribution 77
3.2 Regression 79
3.3 Impact on Feature Selection 82
3.4 Multiple-Data-Set Reporting Bias 84
3.5 Multiple-Rule Bias 86
3.6 Performance Reproducibility 92
Exercises 94
4 ERROR ESTIMATION FOR DISCRETE CLASSIFICATION 97
4.1 Error Estimators 98
4.1.1 Resubstitution Error 98
4.1.2 Leave-One-Out Error 98
4.1.3 Cross-Validation Error 99
4.1.4 Bootstrap Error 99
4.2 Small-Sample
... mehr
Performance 101
4.2.1 Bias 101
4.2.2 Variance 103
4.2.3 Deviation Variance, RMS, and Correlation 105
4.2.4 Numerical Example 106
4.2.5 Complete Enumeration Approach 108
4.3 Large-Sample Performance 110
Exercises 114
5 DISTRIBUTION THEORY 115
5.1 Mixture Sampling Versus Separate Sampling 115
5.2 Sample-Based Discriminants Revisited 119
5.3 True Error 120
5.4 Error Estimators 121
5.4.1 Resubstitution Error 121
5.4.2 Leave-One-Out Error 122
5.4.3 Cross-Validation Error 122
5.4.4 Bootstrap Error 124
5.5 Expected Error Rates 125
5.5.1 True Error 125
5.5.2 Resubstitution Error 128
5.5.3 Leave-One-Out Error 130
5.5.4 Cross-Validation Error 132
5.5.5 Bootstrap Error 133
5.6 Higher-Order Moments of Error Rates 136
5.6.1 True Error 136
5.6.2 Resubstitution Error 137
5.6.3 Leave-One-Out Error 139
5.7 Sampling Distribution of Error Rates 140
5.7.1 Resubstitution Error 140
5.7.2 Leave-One-Out Error 141
Exercises 142
6 GAUSSIAN DISTRIBUTION THEORY: UNIVARIATE CASE 145
6.1 Historical Remarks 146
6.2 Univariate Discriminant 147
6.3 Expected Error Rates 148
6.3.1 True Error 148
6.3.2 Resubstitution Error 151
6.3.3 Leave-One-Out Error 152
6.3.4 Bootstrap Error 152
6.4 Higher-Order Moments of Error Rates 154
6.4.1 True Error 154
6.4.2 Resubstitution Err
4.2.1 Bias 101
4.2.2 Variance 103
4.2.3 Deviation Variance, RMS, and Correlation 105
4.2.4 Numerical Example 106
4.2.5 Complete Enumeration Approach 108
4.3 Large-Sample Performance 110
Exercises 114
5 DISTRIBUTION THEORY 115
5.1 Mixture Sampling Versus Separate Sampling 115
5.2 Sample-Based Discriminants Revisited 119
5.3 True Error 120
5.4 Error Estimators 121
5.4.1 Resubstitution Error 121
5.4.2 Leave-One-Out Error 122
5.4.3 Cross-Validation Error 122
5.4.4 Bootstrap Error 124
5.5 Expected Error Rates 125
5.5.1 True Error 125
5.5.2 Resubstitution Error 128
5.5.3 Leave-One-Out Error 130
5.5.4 Cross-Validation Error 132
5.5.5 Bootstrap Error 133
5.6 Higher-Order Moments of Error Rates 136
5.6.1 True Error 136
5.6.2 Resubstitution Error 137
5.6.3 Leave-One-Out Error 139
5.7 Sampling Distribution of Error Rates 140
5.7.1 Resubstitution Error 140
5.7.2 Leave-One-Out Error 141
Exercises 142
6 GAUSSIAN DISTRIBUTION THEORY: UNIVARIATE CASE 145
6.1 Historical Remarks 146
6.2 Univariate Discriminant 147
6.3 Expected Error Rates 148
6.3.1 True Error 148
6.3.2 Resubstitution Error 151
6.3.3 Leave-One-Out Error 152
6.3.4 Bootstrap Error 152
6.4 Higher-Order Moments of Error Rates 154
6.4.1 True Error 154
6.4.2 Resubstitution Err
... weniger
Autoren-Porträt von Ulisses M. Braga Neto, Edward R. Dougherty
Ulisses M. Braga Neto is an Associate Professor in the Department of Electrical and Computer Engineering at Texas A&M University, USA. He received his PhD in Electrical and Computer Engineering from The Johns Hopkins University. Dr. Braga Neto received an NSF CAREER Award for his work on error estimation for pattern recognition with applications in genomic signal processing. He is an IEEE Senior Member.Edward R. Dougherty is a Distinguished Professor, Robert F. Kennedy '26 Chair, and Scientific Director at the Center for Bioinformatics and Genomic Systems Engineering at Texas A&M University, USA. He is a fellow of both the IEEE and SPIE, and he has received the SPIE Presidents Award. Dr. Dougherty has authored several books including Epistemology of the Cell: A Systems Perspective on Biological Knowledge and Random Processes for Image and Signal Processing (Wiley-IEEE Press).
Bibliographische Angaben
- Autoren: Ulisses M. Braga Neto , Edward R. Dougherty
- 2015, 1. Auflage, 336 Seiten, Maße: 24,1 cm, Gebunden, Englisch
- Verlag: Wiley & Sons
- ISBN-10: 1118999738
- ISBN-13: 9781118999738
Sprache:
Englisch
Kommentar zu "Error Estimation for Pattern Recognition"
0 Gebrauchte Artikel zu „Error Estimation for Pattern Recognition“
Zustand | Preis | Porto | Zahlung | Verkäufer | Rating |
---|
Schreiben Sie einen Kommentar zu "Error Estimation for Pattern Recognition".
Kommentar verfassen