|
|
|
篇目详细内容 |
|
【篇名】 |
Boosting and margin theory |
|
【刊名】 |
Frontiers of Electrical and Electronic Engineering |
|
【刊名缩写】 |
Front. Electr. Electron. Eng. |
|
【ISSN】 |
2095-2732 |
|
【EISSN】 |
2095-2740 |
|
【DOI】 |
10.1007/s11460-012-0188-9 |
|
【出版社】 |
Higher Education Press and Springer-Verlag Berlin
Heidelberg |
|
【出版年】 |
2012 |
|
【卷期】 |
7
卷1期 |
|
【页码】 |
127-133
页,共
7
页 |
|
【作者】 |
Jufu FENG;
Liwei WANG;
Masashi SUGIYAMA;
Cheng YANG;
Zhi-Hua ZHOU;
Chicheng ZHANG;
|
|
【关键词】 |
boosting; margin; explanation; generalization |
【摘要】 |
|
Many researchers have worked on the explanation of AdaBoost’s good experimental results in theory. Some work give an upper bound of generalization error in terms of the margin distribution function, while Breiman gave a sharper generalization error bound based on minimum margin. He also developed the arcgv algorithm to maximize the minimum margin, then made the minimum margin larger than AdaBoost. However, its empirical results are even worse than AdaBoost. Therefore, is the minimum margin bound not practical? This paper gives a new concept called Equilibrium margin (Emargin) and proves a new generalization error bound using Emargin, which is always better than minimum margin bound. In addition, we show Emargin is a good indicator of generalization. Then, we conduct experiments showing that the Emargin of AdaBoost is larger than arc-gv, but the generalization error of Ada-Boost is usually better. |
|
