Comments on: [Q] systematic error http://hea-www.harvard.edu/AstroStat/slog/2008/q-systematic-error/ Weaving together Astronomy+Statistics+Computer Science+Engineering+Intrumentation, far beyond the growing borders Fri, 01 Jun 2012 18:47:52 +0000 hourly 1 http://wordpress.org/?v=3.4 By: hlee http://hea-www.harvard.edu/AstroStat/slog/2008/q-systematic-error/comment-page-1/#comment-269 hlee Thu, 03 Jul 2008 00:19:01 +0000 http://hea-www.harvard.edu/AstroStat/slog/?p=334#comment-269 There is a page about systematic error in <a href="http://en.wikipedia.org/wiki/Systematic_error" rel="nofollow">Wikipedia</a>! It is put closer to bias than uncertainty; bias to be calibrated so that it can be removed. Someone has to add more. There is a page about systematic error in Wikipedia! It is put closer to bias than uncertainty; bias to be calibrated so that it can be removed. Someone has to add more.

]]>
By: hlee http://hea-www.harvard.edu/AstroStat/slog/2008/q-systematic-error/comment-page-1/#comment-265 hlee Wed, 02 Jul 2008 18:10:49 +0000 http://hea-www.harvard.edu/AstroStat/slog/?p=334#comment-265 Those errors, next to measurement columns should be treated with either hyperparameters in Bayesian or nuisance parameters in Frequentist but not the sigma in normal distribution presumed to explain statistical errors, unless those measurement errors in the catalog coincide with statistical uncertainty, such as stochastic deviation of observations with respect to the model. I checked books and papers on measurement errors and asked some friends who are specialized in measurement error models but was not able to get any example similar to the measurement error columns in the astronomical catalogs. Both systematic error and measurement error are very cross cultural things but statistically are not justified well. Now I become curious how Bayesian handles heteroscedasticity? We know measurement errors are not homogeneous. Those errors, next to measurement columns should be treated with either hyperparameters in Bayesian or nuisance parameters in Frequentist but not the sigma in normal distribution presumed to explain statistical errors, unless those measurement errors in the catalog coincide with statistical uncertainty, such as stochastic deviation of observations with respect to the model. I checked books and papers on measurement errors and asked some friends who are specialized in measurement error models but was not able to get any example similar to the measurement error columns in the astronomical catalogs. Both systematic error and measurement error are very cross cultural things but statistically are not justified well.

Now I become curious how Bayesian handles heteroscedasticity? We know measurement errors are not homogeneous.

]]>
By: vlk http://hea-www.harvard.edu/AstroStat/slog/2008/q-systematic-error/comment-page-1/#comment-262 vlk Tue, 01 Jul 2008 18:05:30 +0000 http://hea-www.harvard.edu/AstroStat/slog/?p=334#comment-262 <em>addition columns adjacent to measurement columns in catalogs which often come from calibration, not from repeated measures nor from bayesian modeling</em> These numbers are invariably derived from data, and therefore represent some kind of model parameter. Errors on the model parameters are most definitely affected by both statistical (aka measurement) and systematic errors. People may sometimes misuse the term "measurement error" to include the errors that describe such parameter uncertainties, but by and large, I think astronomers are quite clear on what is measurement error: it is the uncertainty in the measurement, i.e., a measure of how well you know the data, and thus is entirely statistical in nature. A proper understanding of the data will of course require a knowledge of the systematic effects that may affect the model that is being used to match to the data. It may be that all the confusion in terminology is just a Bayesian vs Frequentist thing. When in doubt, think Bayesian! addition columns adjacent to measurement columns in catalogs which often come from calibration, not from repeated measures nor from bayesian modeling

These numbers are invariably derived from data, and therefore represent some kind of model parameter. Errors on the model parameters are most definitely affected by both statistical (aka measurement) and systematic errors. People may sometimes misuse the term “measurement error” to include the errors that describe such parameter uncertainties, but by and large, I think astronomers are quite clear on what is measurement error: it is the uncertainty in the measurement, i.e., a measure of how well you know the data, and thus is entirely statistical in nature. A proper understanding of the data will of course require a knowledge of the systematic effects that may affect the model that is being used to match to the data.

It may be that all the confusion in terminology is just a Bayesian vs Frequentist thing. When in doubt, think Bayesian!

]]>
By: hlee http://hea-www.harvard.edu/AstroStat/slog/2008/q-systematic-error/comment-page-1/#comment-258 hlee Tue, 24 Jun 2008 22:56:05 +0000 http://hea-www.harvard.edu/AstroStat/slog/?p=334#comment-258 I probably read too many astro-ph preprints. The phrase, <u>systematic errors</u> occurred too often in various places, not just in x-ray astronomy, which confuses me. The only error I know before reading astro-ph was so called statistical errors having stochastic nature that can be modeled. To distinguish non statistical errors, I think astronomers use the term systematic error or measurement error. My understanding of measurement errors is the additional columns adjacent to measurement columns in catalogs which often come from calibration, not from repeated measures nor from bayesian modeling. I probably read too many astro-ph preprints. The phrase, systematic errors occurred too often in various places, not just in x-ray astronomy, which confuses me. The only error I know before reading astro-ph was so called statistical errors having stochastic nature that can be modeled. To distinguish non statistical errors, I think astronomers use the term systematic error or measurement error. My understanding of measurement errors is the additional columns adjacent to measurement columns in catalogs which often come from calibration, not from repeated measures nor from bayesian modeling.

]]>
By: vlk http://hea-www.harvard.edu/AstroStat/slog/2008/q-systematic-error/comment-page-1/#comment-255 vlk Sat, 21 Jun 2008 12:30:25 +0000 http://hea-www.harvard.edu/AstroStat/slog/?p=334#comment-255 Hyunsook, I am puzzled that you are asking this question. Is this not already answered in your HEAD2008 poster? Or in the forthcoming SPIE2008 paper? btw, I don't think it is correct to say that "Astronomers sometimes call it measurement error" -- we don't do that except by mistake. Measurement error invariably refers to the statistical uncertainty that attaches to the data. Systematic errors are attached to the <a href="http://hea-www.harvard.edu/AstroStat/slog/eotw/" rel="nofollow">calibration</a>. Hyunsook, I am puzzled that you are asking this question. Is this not already answered in your HEAD2008 poster? Or in the forthcoming SPIE2008 paper?

btw, I don’t think it is correct to say that “Astronomers sometimes call it measurement error” — we don’t do that except by mistake. Measurement error invariably refers to the statistical uncertainty that attaches to the data. Systematic errors are attached to the calibration.

]]>