Book review: The R Cookbook by Paul Teetor

2011-07-06T16:57:00.000-07:00

I haven't seen a better introduction to R than Paul Teetor's R Cookbook, published by O'Reilly. While it follows the familiar O'Reilly cookbook format, it also provides a gentle introduction, with all the necessary information to get started As a particularly nice touch for a cookbook, it includes basic statistics and input/output in the early chapters so that the reader doesn't need to wade through (or fearfully skip over) a lot of material before getting to the needed resources.

A common complaint with other R resources is that the novice in
statistics is overwhelmed with statistical terminology. Teetor
is not trying to provide a statistics textbook, but he includes refreshing
explanations for the underlying statistics.

Some chapters are particular standouts:

Chapter 2: Some Basics. This chapter is an appetizer of what R can do,
and it's very helpful to get this early. Aside from the basic usage of R covered in this chapter, section 2.6 (Computing Basic Statistics) provides a quick introduction to performing basic statistics with R.

Chapter 4: Input and Output. R's input/output support is a bit cumbersome, but the R Cookbook provides examples for many common cases that newcomers need to handle (text files, CSV's, etc).

Chapter 9: General Statistics. This is the meat and potatoes of R for many statistical users. Students in a basic statistics course (or practitioners needing to do most fundamental analyses) will find chapter 9 to be indispensable.

Chapter 10: Graphics provides a nice dessert as visualizing data is often critical to understanding it. Teetor provides simple, concrete examples that cover many of the common graphics, as well as how to handle their titles, labels, and legends.

As an added bonus, Teetor and O'Reilly provide Chapter 14: Time Series Analysis. The coverage here goes beyond standard cookbook fare and provides a good starting point for those interested in Time Series Analysis.

Overall, the R Cookbook is the best O'Reilly cookbook I've read since the release of the Perl Cookbook, and it's by far the best introduction to R that I've seen. It's a must-have for every newcomer to R.

[Disclaimer: I got this book for free as part of the Oreilly blogger review program I was not required to write a positive review. The opinions I have expressed are my own. I am disclosing this in accordance with the Federal Trade Commission’s 16 CFR, Part 255 : “Guides Concerning the Use of Endorsements and Testimonials in Advertising.”]

OpenAFS, Acopia, and Panasas

2007-08-20T20:31:00.000-07:00

AFS (as the Andrew File System, IBM AFS, and, now, OpenAFS) has been around for a long time. That longevity has brought it some distinct advantages: the userbase is both broad and deep; the product is also stable. There are lots of competitors to OpenAFS, though, with money to be made in the storage market. Witness the recent acquisition of Acopia by F5 Networks. Another vendor, Panasas, is clearly viewed as a potential good business (e.g., take a look at their Board of Directors -- venture capitalists would not be on the Board if they did not think the company would be profitable).

Those two companies, Acopia and Panasas, represent two different market segments that have historically been in the sweet spot of AFS usage. AFS is still strong in one of those areas, but it has soured a bit in the other.

Acopia's claim-to-fame is virtualization, the ability to keep a namespace constant while changing the back ends around. They also do data migrations. They export via NFS or CIFS, so virtually any modern operating system can access data through their systems. This is very nice. The downside, though, is that Acopia is a hardware solution. Lori MacVittie's neat article about her personal NAS notwithstanding, using Acopia's ARX to provide seamless migration for your failed personal NAS just does not make fiscal sense.

AFS provides the same kind of virtualization, but at a different cost. First, no special hardware is needed. The cost comes in complexity: clients have to run the AFS client. Ports exist to lots of modern operating systems (from AIX to Windows), but installing clients is definitely more expensive than plugging a network-transparent NFS proxy into your network. The other cost is in administration: the ramp-up for AFS is fairly steep. While efforts have been made to help people get started with AFS, there is still a lot of work to be done.

The two key features of AFS that provide this virtualization are the @sys magic, and the separation of filesystems into volumes, with volume metadata managed by database servers. These key pieces let administrators glue together namespaces seamlessly. The stable semantics of volume migration also lets administrators migrate data around a site even while users are accessing that data, letting users stay even further from the underlying details of the storage infrastructure.

Panasas, on the other hand, is a clear winner over AFS in its product niche: high-performance NFS. Like Lustre and several other filesystem products that live in the High-Performance Filesystem niche, Panasas accomplishes this by parallelizing remote filesystem accesses. AFS gets some performance benefits from its caching, but the filesystem accesses are done against a single filesystem. AFS also doesn't really do NFS.

So who is buying Panasas? While l have no knowledge of the sales, I can make some fairly educated guesses: Organizations with large data sets in NFS (or CIFS) that need greater performance. The large research organizations (high-energy physics labs, TeraGRID research groups, etc) might be interested in Panasas (except they already have Lustre, with support via ClusterFS). The most direct competitors to Panasas, then, are the NAS appliance vendors. It is interesting that most of the large research organizations have historically been heavy AFS users as well, and many still are. AFS is widely used for the cross-site sharing of data, but it simply doesn't perform well enough to be competitive with NAS appliances running NFS.

My suggestion, then, to the OpenAFS community is to get serious about helping people get started with AFS, and compete with the Acopias of the world. Also, look into improving AFS performance: as AFS is more complex than NFS, there is likely never to be a performance comparison in favor of AFS; however, parallel filesystem accesses have been around for quite a while, and an implementation of it in AFS could be very interesting.

Systems

Book review: The R Cookbook by Paul Teetor

OpenAFS, Acopia, and Panasas