Thursday, September 17, 2009

MySpace OpenSourcing its Recommendation Engine

Qizmt, internally-developed recommendation framework was created by the Data Mining team at MySpace. You can see it in action right now with the “People You May Know” feature. But soon, MySpace plans to roll it out to other areas of the site for recommendations soon. MySpace plans to open-source the technology for anyone to use. They made the announcement today at the Computerworld Conference in Chicago
What makes Qizmt unique is that it was developed using C#.NET specifically for Windows platforms. This extends the rapid development nature of the .NET environment to the world of large scale data crunching and enables .NET developers to easily leverage their skill set to write MapReduce functions. Not only is Qizmt easy to use but based on our internal benchmarks we have shown its processing speeds to be competitive with the leading MapReduce open source projects on a lesser number of cores.
MySpace says it has published the code for Qizmt today. They also note that they have recently open-sourced MSFast, a service they built to help developers track page load performance. Rival Facebook has been doing a bit of its own open-sourcing recently. Last week, they opened up Tornado, the platform that help to power FriendFeed, which they recently acquired.

No comments:

Post a Comment