The AstroStat Slog » FFT http://hea-www.harvard.edu/AstroStat/slog Weaving together Astronomy+Statistics+Computer Science+Engineering+Intrumentation, far beyond the growing borders Fri, 09 Sep 2011 17:05:33 +0000 en-US hourly 1 http://wordpress.org/?v=3.4 A Conversation with Peter Huber http://hea-www.harvard.edu/AstroStat/slog/2008/a-conversation-with-peter-huber/ http://hea-www.harvard.edu/AstroStat/slog/2008/a-conversation-with-peter-huber/#comments Sat, 06 Sep 2008 00:46:59 +0000 hlee http://hea-www.harvard.edu/AstroStat/slog/?p=585 The problem with data analysis is of course that it is a performing art. It is not something you easily write a paper on; rather, it is something you do. And so it is difficult to publish.]]>

The problem with data analysis is of course that it is a performing art. It is not something you easily write a paper on; rather, it is something you do. And so it is difficult to publish.

quoted from this conversation ——————————————————-

Statistical Science has a nice “conversations” series with renown statisticians. This series always benefits me because of 1. learning the history of statistics through a personal life, 2. confronting various aspects in statistics as many statisticians as were interviewed, and 3. acquiring an introductory education in the statistics that those interviewees have perfected over many years in a plain language. One post in the slog from this series was a conversation with Leo Breiman about the two cultures in statistical modeling. Because of Prof. Huber’s diverse experiences and many contributions in various fields, this conversation may entertain astronomers and computer scientists as well as statisticians.

The dialog is available through arxiv.org: [stat.ME:0808.0777] written by Andreas Buja, Hans R. Künsch.

He became famous due to his early year paper in robust statistics titled, Robust Estimation of a Location Parameter but I see him as a pioneer in data mining, laying a corner stone for massive/multivariate data analysis when computers were not as much capable as today’s. His book, Robust Statistics (Amazon link) and the paper Projection Pursuit in Annals of Statistics (Vol. 13, No. 2, pp. 435-475, yr. 1985) are popular among many well known publications.

He has publications in geoscience and Babylonian astronomy. This conversation includes names like Steven Weinberg, the novel laureate (The First Three Minutes is a well known general science book) and late Carl Sagan (famous for books/a movie like Cosmos and Contact) showing his extent scholarly interests and genius beyond statistics. At the beginning, I felt like learning the history of computation and data analysis apart from statistics.

]]>
http://hea-www.harvard.edu/AstroStat/slog/2008/a-conversation-with-peter-huber/feed/ 0
[ArXiv] 5th week, Apr. 2008 http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-5th-week-apr-2008/ http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-5th-week-apr-2008/#comments Mon, 05 May 2008 07:08:42 +0000 hlee http://hea-www.harvard.edu/AstroStat/slog/?p=281 Since I learned Hubble’s tuning fork[1] for the first time, I wanted to do classification (semi-supervised learning seems more suitable) galaxies based on their features (colors and spectra), instead of labor intensive human eye classification. Ironically, at that time I didn’t know there is a field of computer science called machine learning nor statistics which do such studies. Upon switching to statistics with a hope of understanding statistical packages implemented in IRAF and IDL, and learning better the contents of Numerical Recipes and Bevington’s book, the ignorance was not the enemy, but the accessibility of data was.

I’m glad to see this week presented a paper that I had dreamed of many years ago in addition to other interesting papers. Nowadays, I’m more and more realizing that astronomical machine learning is not simple as what we see from machine learning and statistical computation literature, which typically adopted data sets from the data repository whose characteristics are well known over the many years (for example, the famous iris data; there are toy data sets and mock catalogs, no shortage of data sets of public characteristics). As the long list of authors indicates, machine learning on astronomical massive data sets are never meant to be a little girl’s dream. With a bit of my sentiment, I offer the list of this week:

  • [astro-ph:0804.4068] S. Pires et al.
    FASTLens (FAst STatistics for weak Lensing) : Fast method for Weak Lensing Statistics and map making
  • [astro-ph:0804.4142] M.Kowalski et al.
    Improved Cosmological Constraints from New, Old and Combined Supernova Datasets
  • [astro-ph:0804.4219] M. Bazarghan and R. Gupta
    Automated Classification of Sloan Digital Sky Survey (SDSS) Stellar Spectra using Artificial Neural Networks
  • [gr-qc:0804.4144]E. L. Robinson, J. D. Romano, A. Vecchio
    Search for a stochastic gravitational-wave signal in the second round of the Mock LISA Data challenges
  • [astro-ph:0804.4483]C. Lintott et al.
    Galaxy Zoo : Morphologies derived from visual inspection of galaxies from the Sloan Digital Sky Survey
  • [astro-ph:0804.4692] M. J. Martinez Gonzalez et al.
    PCA detection and denoising of Zeeman signatures in stellar polarised spectra
  • [astro-ph:0805.0101] J. Ireland et al.
    Multiresolution analysis of active region magnetic structure and its correlation with the Mt. Wilson classification and flaring activity

A relevant post related machine learning on galaxy morphology from the slog is found at svm and galaxy morphological classification

< Added: 3rd week May 2008>[astro-ph:0805.2612] S. P. Bamford et al.
Galaxy Zoo: the independence of morphology and colour

  1. Wikipedia link: Hubble sequence
]]>
http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-5th-week-apr-2008/feed/ 0
[ArXiv] 3rd week, Apr. 2008 http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-3rd-week-apr-2008/ http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-3rd-week-apr-2008/#comments Mon, 21 Apr 2008 01:05:55 +0000 hlee http://hea-www.harvard.edu/AstroStat/slog/?p=269 The dichotomy of outliers; detecting outliers to be discarded or to be investigated; statistics that is robust enough not to be influenced by outliers or sensitive enough to alert the anomaly in the data distribution. Although not related, one paper about outliers made me to dwell on what outliers are. This week topics are diverse.

  • [astro-ph:0804.1809] H. Khiabanian, I.P. Dell’Antonio
    A Multi-Resolution Weak Lensing Mass Reconstruction Method (Maximum likelihood approach; my naive eyes sensed a certain degree of relationship to the GREAT08 CHALLENGE)

  • [astro-ph:0804.1909] A. Leccardi and S. Molendi
    Radial temperature profiles for a large sample of galaxy clusters observed with XMM-Newton

  • [astro-ph:0804.1964] C. Young & P. Gallagher
    Multiscale Edge Detection in the Corona

  • [astro-ph:0804.2387] C. Destri, H. J. de Vega, N. G. Sanchez
    The CMB Quadrupole depression produced by early fast-roll inflation: MCMC analysis of WMAP and SDSS data

  • [astro-ph:0804.2437] P. Bielewicz, A. Riazuelo
    The study of topology of the universe using multipole vectors

  • [astro-ph:0804.2494] S. Bhattacharya, A. Kosowsky
    Systematic Errors in Sunyaev-Zeldovich Surveys of Galaxy Cluster Velocities

  • [astro-ph:0804.2631] M. J. Mortonson, W. Hu
    Reionization constraints from five-year WMAP data

  • [astro-ph:0804.2645] R. Stompor et al.
    Maximum Likelihood algorithm for parametric component separation in CMB experiments (separate section for calibration errors)

  • [astro-ph:0804.2671] Peeples, Pogge, and Stanek
    Outliers from the Mass–Metallicity Relation I: A Sample of Metal-Rich Dwarf Galaxies from SDSS

  • [astro-ph:0804.2716] H. Moradi, P.S. Cally
    Time-Distance Modelling In A Simulated Sunspot Atmosphere (discusses systematic uncertainty)

  • [astro-ph:0804.2761] S. Iguchi, T. Okuda
    The FFX Correlator

  • [astro-ph:0804.2742] M Bazarghan
    Automated Classification of ELODIE Stellar Spectral Library Using Probabilistic Artificial Neural Networks

  • [astro-ph:0804.2827]S.H. Suyu et al.
    Dissecting the Gravitational Lens B1608+656: Lens Potential Reconstruction (Bayesian)
]]>
http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-3rd-week-apr-2008/feed/ 0
[ArXiv] 1st week, Apr. 2008 http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-1st-week-apr-2008/ http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-1st-week-apr-2008/#comments Sun, 06 Apr 2008 15:10:15 +0000 hlee http://hea-www.harvard.edu/AstroStat/slog/?p=263 I’m very curious how astronomers began to use Monte Carlo Markov Chain instead of Markov chain Monte Carlo. The more it becomes popular, the more frequently Monte Carlo Markov Chain appears. Anyway, this week, I added non astrostatistical papers in the list: a tutorial, big bang, and biblical theology.

  • [astro-ph:0803.4089] R. Trotta
    Bayes in the sky: Bayesian inference and model selection in cosmology (Bayesian cosmology tutorial).

  • [astro-ph:0804.0070] W. Cui et al.
    An ideal mass assignment scheme for measuring the Power Spectrum with FFTs

  • [astro-ph:0804.0155] L. Wang et al.
    Timeline analysis and wavelet multiscale analysis of the AKARI All-Sky Survey at 90 micron

  • [astro-ph:0804.0278]L. Colombo and E. Pierpaoli
    Model independent approaches to reionization in the analysis of upcoming CMB data

  • [astro-ph:0804.0285]L. Vergani et al.
    Dark Matter – Dark Energy coupling biasing parameter estimates from CMB data

  • [astro-ph:0804.0294] A. Romeo et al.
    Discreteness Effects in Lambda Cold Dark Matter Simulations: A Wavelet-Statistical View

  • [astro-ph:0804.0373] F. Schmidt et al.
    Weak Lensing Effects on the Galaxy Three-Point Correlation Function

  • [astro-ph:0804.0382] R. U. Abbasi et al.
    Search for Correlations between HiRes Stereo Events and Active Galactic Nuclei

  • [astro-ph:0804.0543] M. Schmalzl et al.
    The Initial Mass Function of the Stellar Association NGC 602 in the Small Magellanic Cloud with Hubble Space Telescope ACS Observations

gravitational microlensing tutorial? [astro-ph:0803.4324]
Recent Developments in Gravitational Microlensing by A. Gould

paper with a very interesting title: [astro-ph:0803.3604]
Was There A Big Bang? by R. K. Soberman and M. Dubin

not astrostatistics but atypical statistical application, interesting topic, and good discussions:[stat.AP:0804.0079]
Statistical analysis of an archeological find by A. Feuerverger
Discussants are S.M. Stigler, C. Fuchs, D.L. Bentley, S.M. Bird, H. Höfling, L. Wasserman, R. Ingermanson, J. Mortera, P. Vicard, J.B. Kadane (Click names).

]]>
http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-1st-week-apr-2008/feed/ 0