The current weather in Palo Alto, CA, as reported by The Weather Channel:

This seems to be about as accurate as the data used to claim that 2010 is the “hottest year on record”, recently announced with breathless excitement by teams of increasingly-desperate climatologers.

“Congratulations. You’ve moved your unit.”

Suppose you had a big XML file in an odd, complicated structure (such as JMdict_e, a Japanese-English dictionary), and you wanted to load it into a database for searching and editing. You could faithfully replicate the XML schema in a relational database, with carefully-chosen foreign keys and precisely-specified joins, and you might end up with something like this.

Go ahead, look at it. I’ll wait. Seriously, it deserves a look. All praise to Stuart for making it actually work, but damn.

…

Done? Okay, now let’s slurp the whole thing into MongoDB:

more...

Before I ramble, let me sum up my feelings about MongoDB:

Good: easy to install, easy to start using, easy to dump a metric crapload of loosely-structured data into, easy to write basic queries and indexes, rapid high-quality (free!) support from the core development team, phenomenal cosmic power.

Bad: hard to install some drivers (Perl in particular pulls in an amazing number of poorly-specified dependencies), hard to get a metric crapload of data back out quickly, hard to write advanced queries and indexes, easy to reach “here there be dragons” territory outside the scope of documentation and guarantees and available tools, easy to lock up a server process for minutes or hours with simple operations, easy to lose everything unless you replicate to at least one other machine that has independent power, eats RAM like you wouldn’t believe.

It is, if you like, the Perl of databases, immensely powerful and versatile, but extremely dangerous in the hands of amateurs. And, like early releases of Perl, it is a rapidly-moving target that grows new functionality every time you turn your back on it.

The past few weeks have been a heady mix of excitement, frustration, satisfaction, and annoyance, as my first large-scale use of MongoDB has moved from simple prototype, to initial production version, through major bugs and poorly-documented limitations (often “already fixed in next release”), to what I hope is finally “stuff I can just leave running and go work on other projects again”.

more...

Some guy bought some off-the-shelf parts and attached a Canon SLR lens to an iPhone, and without even releasing sample photos from his “iPhone DSLR prototype”, suckered several major sites into giving him traffic. The “tech bloggers” and most of the commenters are excited about the “potential” of this “cool idea”, going so far as to say that even if the initial results are low-quality, surely someone can refine it.

Optically speaking, this is precisely as cool as taping a 50-cent magnifying glass to your camera, just a lot more expensive and clumsy. It’s like putting on a pair of reading glasses: put a prime lens in front of another prime lens, and you get something that can only focus on nearby objects, with some amount of magnification.

Here, watch me turn my Blackberry into a large format view camera, with full movements!

more...

Something I found on Google Earth:

Usually, if none of the informational layers in GE has something, you can find a nearby picture in the Panoramio layer that will give you a clue, but there’s nothing nearby. A Street View camera on a nearby highway caught it, though, so I knew what sort of thing it had to be.

Not that I really had to work that hard. Opening the area in Google Maps revealed a clear label on a nearby building, for anyone who can read Japanese…

more...

When life hands you scattered plots of land…

more...

“I will not laugh. I will not laugh. I will not laugh.”

At this.

I suppose there’s a chance that he’s being deliberately vague about his actual project and the scale of the data involved, but he sounds so earnest.