Oct 29th, 2008| 12:41 am | Posted by Jaesub
- So, there is a state of matter other than solid, liquid and gas?
= Of course, are you thinking what I am thinking?
- ….
= Yes, it’s time for a jello-shot.
- ….
We cannot deny the arbitrary nature of units we use, but there is also a useful feature: a linkability to other arbitrary units.
Continue reading ‘A confession from a former “keV” junkie (2. Meet Ms. Electron)’ »
Oct 27th, 2008| 11:05 am | Posted by hlee
The first step of data analysis or applications is reading the data sets into a tool of choice. Recent years, I’ve been using R (see also Learning R) for that regard but I’ve enjoyed freedoms for the same purpose from these languages and tools: BASIC, fortran77/90/95, C/C++, IDL, IRAF, AIPS, mongo/supermongo, MATLAB, Maple, Mathematica, SAS, SPSS, Gauss, ARC, Minitab, and recently Python and ciao which I just began to learn. Many of them I lost the fluency of how to use it. Quick learning tends to be flash memory. Some will need brain defragmentation and recovering time for extensive scientific work. A few I don’t like to use at all. No matter what, I’m not a computer geek. I’m not good at new gadgets, new softwares, nor welcome new and allegedly versatile computing systems. But one must be if he/she want to handle data. Until recently I believed R has such versatility in the aspect of reading in data. Yet, there is nothing without exceptions. Continue reading ‘read.table()’ »
Oct 27th, 2008| 09:24 am | Posted by hlee
The notions of missing data are overall different between two communities. I tend to think missing data carry as good amount of information as observed data. Astronomers…I’m not sure how they think but my impression so far is that a missing value in one attribute/variable from a object/observation/informant, all other attributes related to that object become useless because that object is not considered in scientific data analysis or model evaluation process. For example, it is hard to find any discussion about imputation in astronomical publication or statistical justification of missing data with respect to inference strategies. On the contrary, they talk about incompleteness within different variables. Putting this vague argument with a concrete example, consider a catalog of multiple magnitudes. To draw a color magnitude diagram, one needs both color and magnitude. If one attribute is missing, that star will not appear in the color magnitude diagram and any inference methods from that diagram will not include that star. Nonetheless, one will trying to understand how different proportions of stars are observed according to different colors and magnitudes. Continue reading ‘missing data’ »
Tags:
bootstrap,
catalog,
Efron,
estimator,
ignorable,
imputation,
incompleteness,
Little,
MAR,
MCAR,
missing data,
nonparametric,
Rubin,
Schafer,
survey Category:
Astro,
Cross-Cultural,
Data Processing,
Stat |
2 Comments
Oct 23rd, 2008| 12:25 pm | Posted by vlk
Oct 23rd, 2008| 12:13 pm | Posted by hlee
I’ve talked about IMSL on my pyIMSL post, which is a commercial scientific library. There is a GNU version of IMSL, GSL. Finding GSL is the courtesy of Jiangang, who was the author of the poster that I most liked from the 212th AAS, (see My first AAS. V. measurement error and EM and his comment.) Continue reading ‘GSL – GNU Scientific Library’ »
Oct 19th, 2008| 12:33 am | Posted by vlk
Last month, Senator McCain (R-AZ) wildly dissed on Chicago’s Adler Planetarium, characterizing a funding request on its behalf as “planetariums and other foolishness.” Continue reading ‘“planetariums and other foolishness”’ »
Oct 18th, 2008| 11:27 pm | Posted by vlk
The iPhone is an amazing device. I have heard that some people use it as a phone, too, but it really is an extraordinary portable computer. It is faster and more powerful than the Sparcstations I used as a grad student, and will fit into your pocket. And most importantly, you can fit an entire planetarium on it.
There are many good planetarium programs that you can access on laptops, but it is really not that much fun to lug them around on camping trips or even out on to the roof at night. But now, thanks to the iPhone (and the iPod Touch) there has been a great leap forward. Continue reading ‘Killer App’ »
Tags:
AppStore,
GoSkyWatch,
iAstronomica,
iPhone,
iPod Touch,
iStellar,
planetarium,
review,
Starmap Category:
Astro,
Misc,
News,
Optical |
4 Comments
Oct 13th, 2008| 01:07 pm | Posted by vlk
Our hometown rag (the Boston Globe) runs an occasional series of photo collections that highlight news stories called The Big Picture. This week, they take a look at the Sun: http://www.boston.com/bigpicture/2008/10/the_sun.html
The pictures come from space and ground observatories, from SoHO, TRACE, Hinode, STEREO, etc. Goes without saying, the images are stunning, and some are even animated. The real kicker is that images such as these are being acquired by the hundreds, every hour upon the hour, 24/7/365.25 . It is like sipping from a firehose. Nobody can sit there and look at them all, so who knows what we are missing out on. Can statistics help? Can we automate a statistically robust “interestingness” criterion to filter the data stream that humans can then follow up on?
Tags:
Big Picture,
Boston Globe,
EIT,
Hinode,
SoHO,
Solar,
STEREO,
Sun,
TRACE,
XRT Category:
Astro,
Imaging,
News,
Stars |
3 Comments
Oct 10th, 2008| 01:09 pm | Posted by hlee
I do not like to be serious. papers…papers…papers. Off from papers for bridging two, allow me to talk about something relevant to the cultural difference between astronomers and statisticians. I hope this could generate a series of comments.
Continue reading ‘Off the line’ »
Oct 9th, 2008| 04:28 pm | Posted by hlee
Without signal processing courses, the following equation should be awfully familiar to astronomers of photometry and handling data:
$$c_k=\int_\Lambda l(\lambda) r(\lambda) f_k(\lambda) \alpha(\lambda) d\lambda +n_k$$
Terms are in order, camera response (c_k), light source (l), spectral radiance by l (r), filter (f), sensitivity (α), and noise (n_k), where Λ indicates the range of the spectrum in which the camera is sensitive.
Or simplified to $$c_k=\int_\Lambda \phi_k (\lambda) r(\lambda) d\lambda +n_k$$
where φ denotes the combined illuminant and the spectral sensitivity of the k-th channel, which goes by augmented spectral sensitivity. Well, we can skip spectral radiance r, though. Unfortunately, the sensitivity α has multiple layers, not a simple closed function of λ in astronomical photometry.
Or $$c_k=\Theta r +n$$
Inverting Θ and finding a reconstruction operator such that r=inv(Θ)c_k leads spectral reconstruction although Θ is, in general, not a square matrix. Otherwise, approach from indirect reconstruction. Continue reading ‘[tutorial] multispectral imaging, a case study’ »
Tags:
matrix,
Mona Lisa,
multispectral,
noise,
signal processing,
signal processing magazine,
Tutorial Category:
Algorithms,
arXiv,
Cross-Cultural,
Data Processing,
Fitting,
Imaging,
Methods,
Quotes,
Spectral,
Stat,
Uncertainty |
2 Comments
Oct 9th, 2008| 11:55 am | Posted by hlee
I bet there are various scams. One of them is automatic user registration. This blog requires a registration for contributing free of approval comments unless one does not put many web links. Recently, there were frequent anonymous user registrations. What I mean by anonymous is that I don’t see their names or part of identities (for example, someone uses initials of their names in their email accounts or uses email accounts from their affiliations). This slog is open to anyone who is interested in AstroStatistics, although not many are currently active. Upon your request, this can be changed very simply and you immediately start writing your ideas about AstroStatistics. However, I must restrict those scams from now on. Please, provide me a small information about you if you do not want to be eliminated after your registration. As I mentioned, the information does not require your full name, nor email account of academic institution. When you register, use your email account that you use daily bases, not the ones that look like results from phishing.
Oct 8th, 2008| 07:55 pm | Posted by hlee
All of a sudden, partially owing to a thought provoking talk about visualization by Felice Frankel at IIC, I recollected a book, The Grammar of Graphics by Leland Wilkinson (2nd Ed. – I partially read the 1st ed. and felt little of use several years ago because there seemed no link for visualization of data from astronomy.) Continue reading ‘[Book] The Grammar of Graphics’ »
Oct 8th, 2008| 01:31 am | Posted by hlee
In order to understand a learning procedure statistically it is necessary to identify two important aspects: its structural model and its error model. The former is most important since it determines the function space of the approximator, thereby characterizing the class of functions or hypothesis that can be accurately approximated with it. The error model specifies the distribution of random departures of sampled data from the structural model.
Continue reading ‘A Quote on Model’ »
Tags:
error model,
Friedman,
Hastie,
model,
structural model,
Tibshirani Category:
Astro,
Cross-Cultural,
Jargon,
Methods,
Quotes,
Stat |
1 Comment
Oct 1st, 2008| 04:16 pm | Posted by hlee
People of experience would say very differently and wisely against what I’m going to discuss now. This post only combines two small cross sections of each branch of two trees, astronomy and statistics. Continue reading ‘survey and design of experiments’ »
Tags:
213,
AAS,
Alanna Connors,
catalog,
census,
detection,
experimental design,
Long Beach,
special session,
SPS,
survey Category:
Astro,
CHASC,
Cross-Cultural,
Data Processing,
Jargon,
Methods,
Misc,
News,
Stat |
3 Comments