IBM, Databricks, and the Spark Movement

Many people consider "Hadoop" and "big data" to be synonyms, and certainly there is significant overlap between them. Yet in my mind, Hadoop is an ecosytem of data management tools, and big data is an approach to understanding complex situations. So the one can be used for the other, but surely isn't the only way to go.

Topics: IBM Analytics Big Data hadooop machine learning spark

The Big Data Platform Metamorphosis

Many key big data suppliers have moved beyond the piece-part larval form, shed their respective skins to varying degrees, and are in the process of blooming into big data platform butterflies. Which vendor(s) will emerge as the stunning Blue Morpho of big data butterflies remains to be seen. The elements of what a big data platform consists of, while still somewhat hazy and varied based on what an organization thinks it wants to accomplish with big data, seem more sharply defined than six months ago. Suffice it to say that a transmutative race down a path of platform evolution is well under way, driven by the recognition that most enterprises will not invest in too many big data piece-parts. Consider some of the offerings and announcements, many of which have appeared around or during the past crazy data conference week:

Topics: IBM Storage EMC Analytics Big Data Data Management & Analytics IT Infrastructure Cloudera Hortonworks Teradata MapR business intelligence aster hadooop Greenplum