Comments on: Change Point Problem http://hea-www.harvard.edu/AstroStat/slog/2007/change-point-problem/ Weaving together Astronomy+Statistics+Computer Science+Engineering+Intrumentation, far beyond the growing borders Fri, 01 Jun 2012 18:47:52 +0000 hourly 1 http://wordpress.org/?v=3.4 By: vlk http://hea-www.harvard.edu/AstroStat/slog/2007/change-point-problem/comment-page-1/#comment-64 vlk Fri, 17 Aug 2007 22:09:06 +0000 http://hea-www.harvard.edu/AstroStat/slog/2007/change-point-problem/#comment-64 The Connors & van Dyk SCMA4 paper (with color figures) is now accessible <a href="http://hea-www.harvard.edu/AstroStat/etc/scma4_ac_dvd.pdf" rel="nofollow">online as a pdf document</a> at the CHASC website. The Connors & van Dyk SCMA4 paper (with color figures) is now accessible online as a pdf document at the CHASC website.

]]>
By: vlk http://hea-www.harvard.edu/AstroStat/slog/2007/change-point-problem/comment-page-1/#comment-63 vlk Tue, 14 Aug 2007 17:11:32 +0000 http://hea-www.harvard.edu/AstroStat/slog/2007/change-point-problem/#comment-63 Finding the peak is indeed a huge problem. That is what is keeping us from a completely general algorithm for line and source detection (in spectra and images respectively). By its very nature, it is a multiscale problem, because it is not sufficient to just find the largest excursions in histograms of the data, but it needs to be done <i>robustly</i>. That is, a single large fluctuation in one bin should NOT overwhelm a nearby lower plateau where a number of adjacent bins are all showing similar deviations. This leads to the same issues encountered when trying to determine whether an extended feature in an image is real or not (see van Dyk & Connors, 2007, on Poisson Goodness-of-fit, SCMA IV) Finding the peak is indeed a huge problem. That is what is keeping us from a completely general algorithm for line and source detection (in spectra and images respectively). By its very nature, it is a multiscale problem, because it is not sufficient to just find the largest excursions in histograms of the data, but it needs to be done robustly. That is, a single large fluctuation in one bin should NOT overwhelm a nearby lower plateau where a number of adjacent bins are all showing similar deviations. This leads to the same issues encountered when trying to determine whether an extended feature in an image is real or not (see van Dyk & Connors, 2007, on Poisson Goodness-of-fit, SCMA IV)

]]>
By: hlee http://hea-www.harvard.edu/AstroStat/slog/2007/change-point-problem/comment-page-1/#comment-62 hlee Tue, 14 Aug 2007 14:37:35 +0000 http://hea-www.harvard.edu/AstroStat/slog/2007/change-point-problem/#comment-62 I received another type of changing point problem, defining a peak precisely, from a x-ray school student, who tried bayesian block but said it didn't work. Defining peaks sounds like point estimation from functional data analysis. Eyes could tell the peak most easily and accurately but when it comes to automatization, I wonder what approaches were taken in astronomy. By the way, the student was interested in gamma ray burst light curves. I received another type of changing point problem, defining a peak precisely, from a x-ray school student, who tried bayesian block but said it didn’t work. Defining peaks sounds like point estimation from functional data analysis. Eyes could tell the peak most easily and accurately but when it comes to automatization, I wonder what approaches were taken in astronomy. By the way, the student was interested in gamma ray burst light curves.

]]>
By: vlk http://hea-www.harvard.edu/AstroStat/slog/2007/change-point-problem/comment-page-1/#comment-61 vlk Thu, 09 Aug 2007 05:03:28 +0000 http://hea-www.harvard.edu/AstroStat/slog/2007/change-point-problem/#comment-61 Yaming and Xiao-li have proposed just such an ARCH-like model (I do not know enough about ARCH to tell who I am insulting by comparing the two) to characterize astronomical light curves. See <a href="http://adsabs.harvard.edu/abs/2004HEAD....8.1631Y" rel="nofollow">Poster 16.31</a>, <a href="http://hea-www.harvard.edu/AstroStat/HEAD2004/" rel="nofollow">AAS-HEAD 2004</a>. I believe that their method is actually more general than ARCH, and even works in the Poisson regime. Unfortunately, it needs to be validated, coded, and written up in an astronomer friendly way. Yaming started to do the validation using sunspot number data, but that exercise morphed into <a href="http://www.samsi.info/workshops/2005astro-workshop200601.shtml#schedule" rel="nofollow">something completely different</a>. Yaming and Xiao-li have proposed just such an ARCH-like model (I do not know enough about ARCH to tell who I am insulting by comparing the two) to characterize astronomical light curves. See Poster 16.31, AAS-HEAD 2004. I believe that their method is actually more general than ARCH, and even works in the Poisson regime. Unfortunately, it needs to be validated, coded, and written up in an astronomer friendly way. Yaming started to do the validation using sunspot number data, but that exercise morphed into something completely different.

]]>