Oct 22nd, 2009| 07:08 pm | Posted by hlee
[arXiv:stat.ME:0910.2585]
Variable Selection and Updating In Model-Based Discriminant Analysis for High Dimensional Data with Food Authenticity Applications
by Murphy, Dean, and Raftery
Classifying or clustering (or semi supervised learning) spectra is a very challenging problem from collecting statistical-analysis-ready data to reducing the dimensionality without sacrificing complex information in each spectrum. Not only how to estimate spiky (not differentiable) curves via statistically well defined procedures of estimating equations but also how to transform data that match the regularity conditions in statistics is challenging.
Continue reading ‘[ArXiv] classifying spectra’ »
Tags:
BIC,
Classification,
clustering,
cross-validation,
curse of dimensionality,
discriminant analysis,
graphical model,
mclust,
model based,
semi-supervised learning,
statistical learning,
variable selection Category:
Algorithms,
arXiv,
Cross-Cultural,
Data Processing,
Jargon,
Methods,
Spectral,
Stat |
Comment
Sep 18th, 2008| 07:48 pm | Posted by hlee
Another deduced conclusion from reading preprints listed in arxiv/astro-ph is that astronomers tend to confuse classification and clustering and to mix up methodologies. They tend to think any algorithms from classification or clustering analysis serve their purpose since both analysis algorithms, no matter what, look like a black box. I mean a black box as in neural network, which is one of classification algorithms. Continue reading ‘Classification and Clustering’ »
Tags:
black box,
book,
catalog,
Classification,
clustering,
haste,
outliers,
R,
Robert Serfling,
semi-supervised learning,
survey Category:
Algorithms,
arXiv,
Astro,
Bad AstroStat,
Cross-Cultural,
Data Processing,
Frequentist,
Jargon,
Methods,
Stat |
Comment