May 2008

Sun Mon Tue Wed Thu Fri Sat
        1 2 3
4 5 6 7 8 9 10
11 12 13 14 15 16 17
18 19 20 21 22 23 24
25 26 27 28 29 30 31

April 09, 2008

Atom + XBRL = Smart Move By The SEC

From Sam Ruby's blog:

The SEC started using RSS feeds two or three years ago to push information about XBRL filings received under the SEC's Voluntary Filing Program. See http://www.sec.gov/Archives/edgar/xbrlrss.xml

See the prior entry on this blog for a link to the iBlanket widget which makes use of one of the ATOM feeds.

You can go look at the Edgar system and see the ATOM feed here.  Look for the little orange icon, click on it.  You can read the feed in your browser, but the important thing to understand is that a computer application can read this also.

Basically, according to a IRWebReport blog entry, each filer to the SEC has its own ATOM feed which a user can subscribe to.  Imagine that the ATOM feed making you aware of information in an XBRL filing.  A computer application watches the ATOM feed, becomes aware of a new filing, reads the information from the XBRL filing, and updates your internal analysis models or other applications.  That is extremely powerful.

"The SEC, they totally get it." - Blog: Financial Reporting Using XBRL - XBRL as used for financial reporting by business users.

April 08, 2008

Atom Wins? Not Until The Fat Lady Sings

Some parts of Microsoft are adopting Atom/APP ... other groups remain somewhat vague and non-committal. It would be great for the SharePoint team to make a clear statement of direction on support for Atom and AtomPub. Given the growing deployment estimates of MOSS - which for some odd reason implemented only RSS - it seems that someone should commit to fixing an architectural "oops" .

But, put succinctly, Google + Microsoft = AtomPub wins. To paraphrase Dave Winer, the act of putting aside ego and saying a competitor's API is good enough, and that you're going to support it, is a brave and important act in the world of technology. That makes this convergence particularly exciting.

Anil Dash: Atom Wins: The Unified Cloud Database API

March 18, 2008

Building A Robust Feed Syndication Platform (Part 2)

Lawrence was kind enough to respond to my earlier post on the infrastructure NewsGator has put together to build out its feed syndication platform. I mentioned that I remain amazed at how poorly large vendors (e.g., IBM, Microsoft) are responding to this strategic middleware/infrastructure requirement that large enterprise customers will need as part of Web 2.0/Enterprise 2.0 efforts.

I stand by that statement.

Regarding Microsoft, I would refer people to this post where I summarize its efforts "Microsoft Announces FeedSync But Its Strategy Remains Un-Sync'd". It is true that Microsoft has implemented RSS support quite broadly throughout SharePoint. The important point business and IT decision makers is that the implementation is more application-like than infrastructure-like. Microsoft does little to nothing concerning the need to manage feeds from an end-to-end perspective (thus the partnership with NewsGator). Additionally, Microsoft needs to be much more clear on where it will be implementing Atom and AtomPub within SharePoint. The continued support only for RSS is architecturally a dead-end and reflects a poor upstream design decision.

Regarding IBM, they are almost as bad. There is no cohesive strategy coming from IBM concerning a feed syndication platform either. They do support RSS and Atom (in fact, IBM has been very aggressive with Atom/AtomPub and it is well implemented within Lotus Connections). But overall, its implementation of XML feeds across its product portfolio (e.g., Lotus Notes/Domino, Connections, Mashups) still does not meet the requirements of a feed syndication platform (as represented in the market by Attensa, KnowNow and NewsGator). There is some work being done that appears to be under-the-radar. At Lotusphere, IBM demonstrated a possible feed syndication platform in its Innovation Lab. There is also some interesting work being done by some IBM'ers around Abdera. Still, there is no clear product roadmap message from IBM regarding a feed syndication platform that could be deployed at the middleware layer. It also (like Microsoft), implements this capability as part of a product capability (which is more application-like than infrastructure-like).

Lawrence Liu
Senior Technical Product Manager for Community and Social Computing
Microsoft SharePoint Products and Technologies

We (the SharePoint team) understand feed syndication just fine, which is why we have RSS feeds for practically everything in SharePoint, and the feeds are easily configurable by the end user if necessary. SharePoint also has a built-in RSS Viewer web part to consume RSS feeds. As for feed aggregation, management, and sharing, we were hoping that the Exchange team would build that, but they had other priorities. NewsGator has been and will continue to be an excellent partner for us in this area.

Collaborative Thinking: Building A Robust Feed Syndication Platform

March 15, 2008

Building A Robust Feed Syndication Platform

Interesting case study of NewsGator's SaaS-based offering. While this type of scale may not be necessary within an enterprise per se - it does illustrate how such platforms should be approached as a core infrastructure decision. With only three enterprise-class vendors in this space (Attensa, KnowNow and NewsGator), I remain amazed at how poorly large vendors (e.g., IBM, Microsoft, Oracle) understand feed syndication and continue to treat it as an application decision. Stunning.

Solution Overview

http://www.newsgator.com

Customer Size: 65 employees

Organization Profile

Based in Denver, Colorado, NewsGator Technologies develops and markets solutions for the aggregation and viewing of Really Simple Syndication (RSS) feeds.

Business Situation

NewsGator needed to enhance the relational database infrastructure it uses to support 2.5 billion RSS articles totaling 4 terabytes, as part of its RSS aggregation and custom delivery solutions.

Solution

NewsGator is upgrading to Microsoft® SQL Server® 2008 Enterprise Edition (64-bit) database software running on the Windows Server® for 64-Bit Systems operating system.

Benefits

  • High availability with Database Mirroring
  • Reduced backup storage needs with Backup Compression
  • Better control with Resource Governor
  • Scalability
  • Easier data management

Hardware

  • Dell PowerEdge server computers with 4-way, 64-bit, dual-core processors and 32 GB of RAM

Software and Services
Microsoft SQL Server 2008
Windows Server 2008

Vertical Industries
IT Services

Country/Region
United States

Microsoft Case Studies: NewsGator

December 06, 2007

Microsoft Announces FeedSync But Its Strategy Remains Un-Sync'd

Personally, I find this very confusing. Microsoft has not articulated any coherent vision on feeds in general so my initial reaction is that this announcement strikes me as somewhat of a "one off". FeedSync (the evolution of Simple Sharing Extensions, or SSE), tries to solve more advanced problems that are outside mainstream adoption of XML feeds within enterprises right now. It also leaves Microsoft clients without a clear framework for how XML feeds and feed syndication comes together for those investing in the Microsoft platform. What I do believe is that we need to move away from feed synchronization being left up to individual vendors - so there is a clear need for a community-effort to standardize in this area (as mentioned by Sam Snell of IBM at the bottom of a blog post of the FeedSync topic). There is also the broader challenge of data synchronization (where tools like Groove and Notes have advanced replication engines that are unfortunately locked up inside those respective products).

Perhaps someone will take this spec and run with it - creating some interesting and innovative applications that can better showcase its value. But I wish Microsoft would fix some of the more basic gaps and glaring holes in how it is approaching XML feeds and feed syndication in general. Right now, "the cart is before the horse" so to speak.

Initially, Microsoft delivered the Windows RSS Platform as part of IE7. IE7 included its own lightweight feed reader (which I actually like, it does what it is supposed to do and no more). Windows RSS Platform (which I also like), was positioned as common client-side infrastructure to provide consistent feed-related services for desktop applications (e.g., feed subscriptions, download, storage).

Then the Outlook team undercut that effort by implementing (essentially), its own version of Windows RSS Platform as part of Outlook 2007. That's bad enough - but the implementation is absolutely horrible when you use it for a large number of feeds (BTW, my machine literally dies when Outlook 2007 syncs and despite deleting feeds several times, they keep coming back - very frustrating, sorry I turned the feature on to tell you the truth).

Then, you had essentially a failed effort to build a hosted feed platform with Niall Kennedy coming on board and then leaving.

SharePoint exposes a lot of information via RSS feeds but apparently has no support for Atom - in fact, Microsoft seems to be very unclear on its support for Atom and perhaps might prefer to play with RSS extensions that muddy the waters given RSS is essentially an architectural dead-end. SharePoint is not a feed syndication platform - it's just another application that exposes feeds. This gap forced Microsoft to partner with NewsGator (i.e., Social Sites), but even that integration does not eliminate the need for enterprise IT organizations to look at what Attensa, KnowNow and NewsGator offer themselves as complete feed syndication platforms.

Surprisingly, IBM is also completely absent regarding a feed syndication platform. I find it amazing (in an underwhelming manner), that a company touting social computing (e.g., Lotus Connections) and "Info 2.0" has not articulated a strategic vision related to XML feeds outside a simplistic client implementation in Notes 8 and surfacing XML feeds in its related back-end products (e.g., Domino, QuickR, etc). For now - Attensa, KnowNow and NewsGator remain the only credible options with perhaps Oracle as perhaps the only large vendor that could make a move here.

Synchronization for the Web

The creation of FeedSync was catalyzed by the observation that RSS and Atom feeds were exploding on the web, and that by harnessing their inherent simplicity we might enable the creation of a “decentralized data bus” among the world’s web sites. Just like RSS and Atom, FeedSync feeds can be synchronized to any device or platform.

Previously known as Simple Sharing Extensions, FeedSync was originally designed by Ray Ozzie in 2005 and has been developed by Microsoft with input from the Web community. The initial specification, FeedSync for Atom and RSS, describes how to synchronize data through Atom and RSS feeds.

...

Data synchronization is a key enabling feature for the software plus services world.

End users increasingly expect and want access to their data from servers, clients, and devices. They expect the data to always be up to date no matter where they access it, and users must never lose data in the process, or see duplicated items.

...

Everyone has data that they want to share: contact lists, calendar entries, blog postings, and so on. This data must be up-to-date, real-time, across any of the programs, services, or devices you choose to use and share with.

Too often today data is “locked up” in proprietary applications and services or on various devices. As an open extension to RSS and Atom, FeedSync enables you to “unlock” your data—making it easy to synchronize the data you choose to any other authorized FeedSync-enabled service, computer, or mobile device. FeedSync enables many compelling scenarios:

  • Collaboration over the web using synchronized feeds
  • Roaming data to multiple client devices
  • Publishing reference data and updates in an open format that can be synchronized easily

...

What does FeedSync add to RSS and Atom?

RSS and Atom were designed as notification mechanisms, to alert clients that some new resource is available on a server. This is a great fit for simple applications like blogging.

But those feed formats are not a natural fit for representing collections of resources that change, such as a contact list, or a collection of calendar items. Atom Publishing Protocol is designed for resource collections, but it is a client-server protocol and isn’t suitable (by itself) for multi-master scenarios. FeedSync extends RSS and Atom so that FeedSync-enabled RSS and Atom feeds can be used for reliable, efficient content replication and multi-master data synchronization.

Windows Live Dev

December 05, 2007

Social Software Vendor Roundup

Quick partial listing of vendors that frequently come up in my client inquiries (either from clients themselves, or referenced by myself):

Category Vendor/Product Comment
Blogs
Apache Roller Open source, also used in IBM Lotus Connections
BEA Pages
Jive Software Clearspace Blogs one component of platform
Microsoft SharePoint Products & Technologies
Six Apart, Moveable Type
Traction Software TeamPage
WordPress Open source, backed by Automattic
Wikis
Atlassian Confluence
BEA Pages
IBM Wiki capability within Domino, QuickR and QEDwiki
Jive Software Clearspace Wiki one component of suite
Media Wiki Open source
Microsoft SharePoint Products & Technologies
Mindtouch Deki Wiki Open source community at OpenGarden.org.
Socialtext
Traction Software TeamPage
Twiki Open Source
Social Bookmark Systems
BEA Pathways
Cogenz
Connectbeam
IBM Lotus Connections dogear component
Scuttle Open source
Feed Syndication Platforms
Attensa
KnowNow
NewsGator
Social Network & Community Sites Typically offer a mix of user profiles, blogs, wikis, social networking, etc.
Awareness Networks
CollectiveX
Communispace
HiveLive
IBM Lotus Connections
iCohere
KickApps
Lithium
Microsoft SharePoint Products & Technologies
Ning
Ramius CommunityZero
Select Minds
Sparta Social Networks
Prospero
Telligent Community Server
Tomoye
Wetpaint

December 04, 2007

Common Craft Adds Additional Videos

Blogs is the latest addition. Nicely done and great for level-setting experience for an audience unfamiliar with social software. Even if you are familiar with these tools, the presentation is so engaging in its simplicity that it is still enjoyable to watch. The ability to simplify what can become a complex collections of topics is an admirable skill:

Video: Blogs in Plain English

Video: Wikis in Plain English

Video: RSS in Plain English

Video: Social Bookmarking in Plain English

Video: Social Networking in Plain English

November 05, 2007

Microsoft Sync Framework: More Details On XML Feeds Please...

Interesting - but unclear whether this leverages Windows RSS Platform for the sync services... 

Microsoft Sync Framework includes a number of providers that support common data sources. Although you can write custom providers for these data sources, it is recommended that you use the providers that we supply wherever possible. This can minimize development time and enable you to reuse existing tested code. The following providers are included:

  • Sync Services for ADO.NET: Synchronization for ADO.NET enabled data sources
  • Sync Services for File Systems: Synchronization for files and folders
  • Sync Services for SSE: Synchronization for Simple Sharing Extensions (SSE) such as RSS and ATOM feeds

.....

RSS Feeds and Web services provided by an external organization such as Amazon or EBay are both examples of simple participants. These organizations may give you the ability to execute Web services and get results back, but they do not give you the ability to create your own data stores or the ability to execute your own applications on their Web servers. 

Introduction to the Microsoft Sync Framework Runtime

October 04, 2007

OUseful Info: UC Berkeley Lectures on Youtube, via Grazr

Building on my earlier posts (below), an interesting application at OUseful Info.

Extending UC Berkeley's YouTube Site:

TechCrunch reported today that UC Berkeley have been putting a wide selection of their lectures up on YouTube: UC Berkeley Puts Courses On YouTube, though AJ isn't much impressed...

I was intrigued as to whether it's possible to search videos by user on YouTube and get the result via a feed using the YouTube/GData API, and it's easy... For example: http://gdata.youtube.com/feeds/videos?q=skeletal+biology&author=ucberkeley.

Using a simple bit of GrazrScript, it doesn't take much to build a little search widget around this feed, that you could then embed in your own page.

To make things a little more interesting, though, I also added a feed embellishment via a Yahoo Pipe that adds the movie as an enclosure to the feed so that it can be played directly within the Grazr widget (scroll down on the result in the widget... the embedded player may look a little broken at first, but it works fine if you click on it).

So here it is: UCB Video search via Grazr

OUseful Info: UC Berkeley Lectures on Youtube, via Grazr

The era of grazing has begun

Applications like Grazr and its use of OPML deserve more attention from IT strategists ... there are interesting application scenarios.

A few weeks ago we assembled all the pieces that would become Grazr 2.0, and I started doing demos in the Boston area and the Valley. What I soon discovered by watching people react to this product, and listening to their ideas on how they could use it, was that this was much more than just a cool way of managing feeds. I am now convinced that Grazr 2.0 introduces a new medium for online collaboration and publishing. What do I mean by a medium? The combination of HTML, servers and browsers defined the Web as a medium. Weblog software, RSS, and feed readers created the medium of blogging. By this definition a medium is a combination of content, technology, and human behaviors. In the same way, grazing is a medium that combines the data standards of OPML and feeds with our widget, drag and drop reading list editor, and new site design. Add in the type of behaviors these components make possible, and you have the medium of grazing.

This is a pretty bold claim. Watch this video of Grazr 2.0 in action, then try the Grazr 2.0 site and decide for yourself.

Feedonomics » Blog Archive » The era of grazing has begun

Another innovative example:

Ever since I started developing Grazr RSS applications, I've been wondering if it were possible to integrate other services into the Grazr widget. Today I'm presenting you with my most advanced project to date: Podcasting Professionals. This news radar demonstrates that Grazr RSS applications can be enhanced with the functionality of other, quite useful services. For this particular Grazr I picked ZapTXT, Particls and BlogRovR. In this post I'll discuss the value they each add to this particular news radar.

A full-page version of the Podcasting Professionals news radar is hosted on the PODHANDLE servers.

CleverClogs: Podcasting Professionals : Advanced News Radar using Grazr#more