Comments on: A test for global maximum http://hea-www.harvard.edu/AstroStat/slog/2008/a-test-for-global-maximum/ Weaving together Astronomy+Statistics+Computer Science+Engineering+Intrumentation, far beyond the growing borders Fri, 01 Jun 2012 18:47:52 +0000 hourly 1 http://wordpress.org/?v=3.4 By: hlee http://hea-www.harvard.edu/AstroStat/slog/2008/a-test-for-global-maximum/comment-page-1/#comment-270 hlee Thu, 03 Jul 2008 03:28:14 +0000 http://hea-www.harvard.edu/AstroStat/slog/?p=354#comment-270 Very good point. I do understand that and that's the reason I wrote <a href="http://hea-www.harvard.edu/AstroStat/slog/2008/my-first-aas-normalization/" rel="nofollow">my first aas: normalization</a>, but not from an astrophysicist's viewpoint. No statistic is panacea, I believe. By following generalized information criterion notation, J (first derivative) and I (2nd derivative) are what we need for this test which does not promise <u>finding</u> a global maximum. It only tells that if a best fit satisfies J^2+I~0, it is a global maximum. For a better answer to your question, I'd rather quote a few sentences from the paper: <blockquote> ... if the test rejects, then one concludes that there is either a problem of model misspecification or a problem of a best not being a global maximum, but one cannot distinguish between these two. However, in many cases other techniques are available for model checking. ... to the best of our knowledge no statistical method is available for checking whether a given root corresponds to a global maximum, even if the the model has been determined correct. This is the main reason for writing this article.</blockquote> Thanks to physics, astrophysicists know evidently the chosen model is correct but the model could have a complex parameter space providing multiple solutions. I thought this test for a global maximum would be useful under this circumstance. It's cheaper to run the fitting process with different initial values instead of searching full parameter space. On the other hand, the circumstance that the global maximum in unphysical part of the parameter space does not satisfy the regularity conditions. Very good point. I do understand that and that’s the reason I wrote my first aas: normalization, but not from an astrophysicist’s viewpoint. No statistic is panacea, I believe. By following generalized information criterion notation, J (first derivative) and I (2nd derivative) are what we need for this test which does not promise finding a global maximum. It only tells that if a best fit satisfies J^2+I~0, it is a global maximum. For a better answer to your question, I’d rather quote a few sentences from the paper:

… if the test rejects, then one concludes that there is either a problem of model misspecification or a problem of a best not being a global maximum, but one cannot distinguish between these two. However, in many cases other techniques are available for model checking. … to the best of our knowledge no statistical method is available for checking whether a given root corresponds to a global maximum, even if the the model has been determined correct. This is the main reason for writing this article.

Thanks to physics, astrophysicists know evidently the chosen model is correct but the model could have a complex parameter space providing multiple solutions. I thought this test for a global maximum would be useful under this circumstance. It’s cheaper to run the fitting process with different initial values instead of searching full parameter space. On the other hand, the circumstance that the global maximum in unphysical part of the parameter space does not satisfy the regularity conditions.

]]>
By: aneta http://hea-www.harvard.edu/AstroStat/slog/2008/a-test-for-global-maximum/comment-page-1/#comment-268 aneta Thu, 03 Jul 2008 00:14:47 +0000 http://hea-www.harvard.edu/AstroStat/slog/?p=354#comment-268 The global maximum is only a part of the issue. The global maximum could be located in "unphysical" part of parameter the space. Do these test work in such situation, i.e. when the parameter space is constrained within the physically acceptable solutions while the global max is not? When you work with observations you typically think about how well the global max is constrained given the data. Within the "confidence" regions in the parameter space you can find a range of acceptable solutions, so even if you determine that yes, this is a global max, your goal is to collect such data that this range is small. so if within the constrained 90% intervals you have many "local" maxima does it really matter that you landed in one of them? I think you need to be sure that you can constrain the 90% intervals well. The global maximum is only a part of the issue.

The global maximum could be located in “unphysical” part of parameter the space. Do these test work in such situation, i.e. when the parameter space is constrained within the physically acceptable solutions while the global max is not?

When you work with observations you typically think about how well the global max is constrained given the data. Within the “confidence” regions in the parameter space you can find a range of acceptable solutions, so even if you determine that yes, this is a global max, your goal is to collect such data that this range is small. so if within the constrained 90% intervals you have many “local” maxima does it really matter that you landed in one of them? I think you need to be sure that you can constrain the 90% intervals well.

]]>