While big data is not a new concept, it’s gaining more significance as IT embraces new ways to generate and leverage big data. Mobility, cloud, social, analytics, and IoT are all important initiatives that are driving the production and consumption of big data. Therefore, IT needs to take big data management seriously. The challenge is to find a way to manage big data that does not create a big problem.
This ESG Lab Report presents the results of hands-on testing of the NetApp Solutions for Hadoop, with a focus on the ability of the solutions to provide ready-to-deploy, enterprise-class infrastructures for the Hadoop platform and enable fast, actionable insights while improving cluster uptime and reducing capital and operating costs.
Just before Halloween (10/27), Cisco announced its acquisition of security analytics veteran Lancope for $453m. Given the timing of the deal, it’s fair to ask an appropriate question: Trick or treat? There’s no debate here – treat. With the Lancope purchase, Cisco walked into the security analytics neighborhood, knocked on just one door, and grabbed a bag full of candy. Okay, enough of the Halloween metaphors, this was a very good deal for Cisco for several reasons...
For a company that many competing vendors want to write off as “last gen” analytics, Teradata has two things going for it. First, Teradata customers have little interest in throwing out the enterprise-grade data warehouse baby with the Hadoop data lake bathwater. Second, the company is incredibly active in making the transition to the modern big data world.
In this ESG Video Capsule, ESG Senior Analyst Nik Rouda discusses the increasing use of sensor data in data analytics and business intelligence, and the impact that will have on storage.
My dad was a programmer for IBM in the 1970s, but I doubt he’d recognize the company today. Heck, I hardly recognize the company today. In a conversation with an IBM executive on the Analytics business unit, I was asked today, “What is IBM missing?” My response was, “just the story to tie it all together.” Even setting aside Watson, this is a company with an (over-)abundance of analytics tools, BI products, and mature databases
In this ESG Video Capsule, ESG Senior Analyst Nik Rouda reviews the current state of the Hadoop market, as of mid-2015.
Pentaho World 2015 was held in sunny Orlando this year, with over 500 attendees, and was by all accounts a friendly and informative affair. About the only question no one could answer is why the company is called Pentaho, but a rose by any other name is still very nice. One thing that was quite clear is that the team is hitting its stride with HDS as a powerful running mate.
So by now you have probably heard that Dell is planning on acquiring EMC, while leaving VMware as a publicly traded entity. Hot stuff indeed. This has big implications for the IT market as a whole, but I'm most interested in how it sets up change for the big data, database, and analytics space. A few immediate opportunities and a risk are in store...
While attending Splunk.conf 15, I sat in on an interesting presentation given by Christof Jungo, head of security architecture and engineering at Swisscom. Jungo described Swisscom’s cybersecurity strategy as anchored by a “nerve center” (based on Splunk) that centralizes all security data – network data, endpoint forensics, application logs, identity and access management, threat intelligence, etc. Christof mentioned that this process has helped Swisscom accelerate threat detection.
When I first became familiar with Splunk years ago, I thought of it as a freeware log management tool for inquisitive security analysts. Useful for general purposes, but I didn’t see it as a true enterprise security management system, a category defined by vendors like ArcSight, Intellitactics, and Network Intelligence at that time.
In this ESG Video Capsule, Senior Analyst Nik Rouda discusses why--when it comes to Big Data and Analytics--more organizations are turning to the cloud for solutions.
Conventional relational databases and recently-developed NoSQL databases have led some enterprises to an impasse. They want to scale the systems that are handling their data. However, an RDBMS used to guarantee transaction integrity is difficult to expand. NoSQL systems, although scalable, typically do not offer full transaction integrity via the ACID properties discussed in earlier posts. The latest solution in the SQL/NoSQL saga—next-generation SQL databases—may have the answer.
For the last decade or so, data and data structures have been moving at the speed of the web. They change rapidly to keep pace with end-users and markets that are in constant flux. The data model is volatile and will continue to be as more and more unstructured data (images, videos, social media content, online purchase histories, and more) is generated. The solution of the pre-Internet era, meaning the RDBMS, can’t keep up.
ESG's research crack team has been working hard on getting the insider's view of the big data and analytics marketplace, including Hadoop and Spark trends. While we're not quite ready to release our findings yet, I thought I'd share a little teaser of what is coming.
The relational database management system was a breakthrough when it first appeared about 40 years ago. A relational database puts power into a user’s hands. Few assumptions are needed about how data is related or how it is to be extracted. Data can then be viewed in a variety of ways, each one illustrating different connections or correlations. This power, history, and a little user inertia have led to the RDBMS being implanted and used in practically every sector of business today.
Everyone loves the concept of Schrodinger's cat, with the possible exception of a few serious PETA members. The metaphor that an entrapped feline can be both poisoned and/or not poisoned until directly observed is a catchy way to understand uncertainty around various possible states and outcomes.
Big data has a real complexity/credibility problem. There are too many variables to the system that make even basic product evaluation tricky for even the sharpest technical decision maker in the IT shack.
In this ESG Overview, Senior Analyst Nik Rouda previews upcoming ESG research on the Big Data and Analytics Market.