Short clip: Technorati serves up sub-second responses

watch ticking

>>

Host: The technology doesn't always work the way you want it, too, though. Technority phonetic has faced criticism for technical problems. Index outages, search results that are stale. How do you handle that?

>>

Interviewee: We had outages. We've blogged about them. We tried to share, you know, a little bit of the pain that we felt. We've grown tremendously. When I started four years ago, we were indexing about three and a half million blogs. Today, sort of cumulatively, I think over the five years that the company's been in existence, we've indexed over 130 million. Now, a lot of those blogs are dormant. They're, they're not active anymore. The active blogosphere is probably between 15 and 30 million blogs, and that's really what makes up the core of what we're tying to do. Now, we have all of the rest of this data hanging around, and that's been part of the challenge for us is how can we scale our architecture to deal with this massive amount of data while at the same time being able to serve up sub-second response time queries for things that are less than a minute old. And these are the kinds of challenges that I'm very proud to say the team has been able to address. I think we've probably gone through five major architectural overhauls in the four years that I've been there, and, you know, it's like changing a tires on a, on a speedster while you're racing cross country. And it's a non-trivial problem. Technority is a small company. We're about 38 people right now. Only have of those people are in the technical organization. So it's an amazingly talented group of people that are trying to tackle a really large problem, and no, I can't say we do it a hundred percent of the time, but we really try our hardest.

watch ticking

==== Transcribed by Automatic Sync Technologies ====