Earlier this year I added to this post: Social Graph Engines (Updated). Below are some other interesting efforts:
X-RIME: Hadoop based large scale social network analysis
Motivation
Today's Internet-based social network sites possess huge user communities. They hold large amount of data about their users and want to generate core competency from the data. A key enabler for this is a cost efficient solution for social data management and social network analysis (SNA).
Such a solution faces a few challenges. The most important one is that the solution should be able to handle massive and heterogeneous data sets. Facing this challenge, the traditional data warehouse based solutions are usually not cost efficient enough. On the other hand, existing SNA tools are mostly used in single workstation mode, and not scalable enough. To this end, low cost and highly scalable data management and processing technologies from cloud computing society should be brought in to help.
However, most of existing cloud based data analysis solutions are trying to provide SQL-like general purpose query languages, and do not directly support social network analysis. This makes them hard to optimize and hard to use for SNA users. So, we came up with X-RIME to fix this gap.
So, briefly speaking, X-RIME wants to provide a few value-added layers on top of existing cloud infrastructure, to support smart decision loops based on massive data sets and SNA. To end users, X-RIME is a library consists of Map-Reduce programs, which are used to do raw data pre-processing, transformation, SNA metrics and structures calculation, and graph / network visualization. The library could be integrated with other Hadoop based data warehouses (e.g., HIVE) to build more comprehensive solutions.
X-RIME: Hadoop based large scale social network analysis
Collaborative Thinking: New Policy, New Voice
Since the acquisition of Burton Group by Gartner, I have been pretty busy becoming acquainted with new colleagues and reconnecting with former Meta Group co-workers. It has been a hectic past couple of months and my blogging activity has unfortunately taken a back seat. As we integrate the research teams, I had a normal workload of documents and preparations for our Catalyst Prague event on top of the orientation and on-boarding activities. February-April has been more than just a little busy. As things return to a more normal pace, there are a few updates I wanted to share:
Once I am setup to blog on GBN (no date established yet), I'll cross-post some links here so readers/subscribers can continue to follow my thoughts on IT. I will also post on the Burton Group Collaboration and Content blog (again, sharing the links to those posts here) during the transition phase since that blog is still an acceptable platform. As for Collaborative Thinking - the Gartner blog policy pertains to IT so I will continue to share my thoughts on the non-IT aspects of social computing and collaboration (perhaps more academic, touching on the non-IT aspects of social structures, group formation, communities, networks, etc). I believe that sharing links to other articles can also continue. And of course, you can still follow me on Twitter @MikeGotta.
April 21, 2010 in Commentary | Permalink | Comments (3) | TrackBack (0)