Click here to close now.

Welcome!

Apache Authors: Liz McMillan, Dana Gardner, Pat Romanski, Carmen Gonzalez, Plutora Blog

News Feed Item

DataTorrent Raises the Bar on Real-Time Data Analytics With Industry's First Enterprise Class Real-Time Streaming Platform

DataTorrent RTS Delivers Greater Than 1 Billion Operations/Second With High Availability On Wide Set of Hadoop Distributions

SANTA CLARA, CA -- (Marketwired) -- 06/03/14 -- DataTorrent, creator of the world's first enterprise grade real-time stream processing platform on Hadoop, today announced the general availability of DataTorrent RTS. DataTorrent RTS enables enterprises to take action in real-time as a result of high-performance complex processing of data as it is created. Separately, DataTorrent announced a strategic go-to-market partnership with Trace3.

With today's release, DataTorrent RTS becomes the industry's first commercial offering to deliver real-time streaming analytic capabilities on Hadoop with performance greater than 1 billion data events per second -- equivalent to processing 46 cumulative hours of streaming Twitter data in one second. Additionally, DataTorrent RTS' fault tolerant architecture ensures zero downtime and is certified to run on all major Hadoop and Cloud distributions.

"We are seeing increasing interest in stream-processing platforms for real-time analytics, as a complement to data warehouses and Apache Hadoop," said Jason Stamper, Research Analyst, 451 Group. "Enterprise adoption of stream-processing requires fast, in-memory processing of a large volume of events at scale -- and in many cases a fault-tolerant architecture too."

By 2020, the number of smartphones, tablets, and personal computers in use will reach 7.3 billion units. Additionally, the number of Internet of Things (IoT) connected devices will grow to 26 billion units, a nearly 30-fold increase from 0.9 billion in 2009.(1)

As this massive amount of human and machine-generated data outpaces the capabilities of traditional databases, organizations are seeking ways to find scalable, predictable technology that enables reduced operational costs, increased revenue and increased customer satisfaction. Current Hadoop technology provides a scalable way to store and process data in a batch-oriented mode, but processing data in this way can take hours or even days.

DataTorrent RTS Streaming Analytics Platform

DataTorrent RTS allows organizations to harness the full potential of big data by enabling faster data ingestion, data processing, and more timely data insights. Key capabilities include:

  • Streaming, scalable data ingestion & extraction from any source: DataTorrent RTS connects to thousands of systems simultaneously using pre-built operators and processes millions of incoming data events without delay.
  • High performance data transformation and complex computation: In-memory processing on data and events as they happen provides near-zero latency. With the ability to scale to billions of data events per second, DataTorrent RTS delivers the needs of today's enterprises and future-proofs tomorrow's unexpected requirements.
  • Real-time monitoring, alerting and action: DataTorrent RTS' architecture provides the ability to extend analytic capabilities beyond static queries. Custom business logic written in Java enables monitoring, alerting, analysis, and action all taken in real-time, saving organizations time and money while also increasing customer satisfaction.
  • Compatibility with existing Big Data processes: DataTorrent RTS archives and loads results into any data store for archiving and query-based analytics. This ensures that an organization's existing processes work the same, just sooner -- they no longer need to wait hours or days to do data analysis.
  • Fault tolerant, highly available, dynamic system: DataTorrent RTS' streaming window implementation allows for in-line system checkpointing to ensure high availability and guarantees processing of every event. The fault tolerant implementation provides the flexibility to change business logic and insert or delete operators on a running system with no downtime.

"Hadoop has made big data analytics a reality; however, the true value of big data is unlocked when it can be acted upon in real-time," said Phu Hoang, co-founder and CEO, DataTorrent. "DataTorrent RTS is designed specifically to address this need for the enterprise. Through the advances provided by Hadoop 2.0, we are proud to raise the bar on real-time analytics to offer the industry's first true real-time data ingestion and analysis platform at scale."

Open Platform Support Provides Customer Choice

DataTorrent RTS is a Hadoop 2.0 (YARN) native application. One hundred percent Hadoop 2.0 compliance allows DataTorrent RTS and Hadoop Map Reduce to exist side-by-side. With more than 400 Apache 2.0 open source DataTorrent operators, creating and deploying real time streaming analytic application is now easier than ever.

DataTorrent's open approach is validated by certifications on the industry leading Hadoop distributions from Cloudera, Hortonworks and MapR Technologies as well as the leading cloud providers, Amazon Web Services and Google Compute Engine.

"The certification of DataTorrent RTS on Cloudera Enterprise 5, provides our joint customers the ability to ingest, analyze, and act on voluminous streams of data in real-time as data flows into an enterprise data hub," said Amr Awadallah, co-founder and chief technology officer, Cloudera. "This real-time capability allows joint customers to uncover real-time insights and enables them to realize the full value of Cloudera's industry leading platform for big data."

"We're pleased to certify DataTorrent RTS on Hortonworks Data Platform 2.1, the industry's only 100-percent open source Apache Hadoop distribution," said John Kreisa, vice president of strategic marketing at Hortonworks. "With partners like DataTorrent and their YARN Ready applications in the Hadoop ecosystem, we're able to provide enterprises with the ability to aggregate new types of data from sensors/machines, server logs, clickstreams, and other sources to a Data Lake, empowering a true modern data architecture that delivers business insights in real-time."

"Real-time data analysis at large scale with fault tolerance is a key customer requirement," said M.C. Srivas, CTO and Co-Founder of MapR Technologies. "DataTorrent RTS certification provides an enterprise-grade, real-time streaming application managed by YARN within the mission-critical, high-performance MapR Distribution for Apache Hadoop."

DataTorrent RTS for Hadoop is generally available today. For more information, or to download, click here.

Additional Resources

  • Visit the DataTorrent RTS Webpage
  • Learn how DataTorrent handles over 1 billion data events per second
  • Check out the DataTorrent blog
  • Follow us on Twitter

About DataTorrent
DataTorrent RTS is the world's most powerful Big Data streaming platform built exclusively on Hadoop. With its massively scalable architecture, DataTorrent RTS allows enterprises to process, monitor, analyze and act on data instantaneously. Based in Santa Clara, California, DataTorrent is backed by leading investors including August Capital, Morado Ventures, and Yahoo co-founder Jerry Yang. For more information, visit our website or follow us on Twitter.

(1) Gartner Press Release, "Gartner Says the Internet of Things Installed Base Will Grow to 26 Billion Units By 2020." December 12, 2013. http://www.gartner.com/newsroom/id/2636073

Media Contact:
Fitzgerald Barth
LEWIS PR for DataTorrent
(415) 432-2457
Email Contact

More Stories By Marketwired .

Copyright © 2009 Marketwired. All rights reserved. All the news releases provided by Marketwired are copyrighted. Any forms of copying other than an individual user's personal reference without express written permission is prohibited. Further distribution of these materials is strictly forbidden, including but not limited to, posting, emailing, faxing, archiving in a public database, redistributing via a computer network or in a printed form.

@ThingsExpo Stories
Hadoop as a Service (as offered by handful of niche vendors now) is a cloud computing solution that makes medium and large-scale data processing accessible, easy, fast and inexpensive. In his session at Big Data Expo, Kumar Ramamurthy, Vice President and Chief Technologist, EIM & Big Data, at Virtusa, will discuss how this is achieved by eliminating the operational challenges of running Hadoop, so one can focus on business growth. The fragmented Hadoop distribution world and various PaaS solutions that provide a Hadoop flavor either make choices for customers very flexible in the name of opti...
Even as cloud and managed services grow increasingly central to business strategy and performance, challenges remain. The biggest sticking point for companies seeking to capitalize on the cloud is data security. Keeping data safe is an issue in any computing environment, and it has been a focus since the earliest days of the cloud revolution. Understandably so: a lot can go wrong when you allow valuable information to live outside the firewall. Recent revelations about government snooping, along with a steady stream of well-publicized data breaches, only add to the uncertainty
As organizations shift toward IT-as-a-service models, the need for managing and protecting data residing across physical, virtual, and now cloud environments grows with it. CommVault can ensure protection &E-Discovery of your data – whether in a private cloud, a Service Provider delivered public cloud, or a hybrid cloud environment – across the heterogeneous enterprise. In his session at 16th Cloud Expo, Randy De Meno, Chief Technologist - Windows Products and Microsoft Partnerships, will discuss how to cut costs, scale easily, and unleash insight with CommVault Simpana software, the only si...
The explosion of connected devices / sensors is creating an ever-expanding set of new and valuable data. In parallel the emerging capability of Big Data technologies to store, access, analyze, and react to this data is producing changes in business models under the umbrella of the Internet of Things (IoT). In particular within the Insurance industry, IoT appears positioned to enable deep changes by altering relationships between insurers, distributors, and the insured. In his session at @ThingsExpo, Michael Sick, a Senior Manager and Big Data Architect within Ernst and Young's Financial Servi...
PubNub on Monday has announced that it is partnering with IBM to bring its sophisticated real-time data streaming and messaging capabilities to Bluemix, IBM’s cloud development platform. “Today’s app and connected devices require an always-on connection, but building a secure, scalable solution from the ground up is time consuming, resource intensive, and error-prone,” said Todd Greene, CEO of PubNub. “PubNub enables web, mobile and IoT developers building apps on IBM Bluemix to quickly add scalable realtime functionality with minimal effort and cost.”
The Workspace-as-a-Service (WaaS) market will grow to $6.4B by 2018. In his session at 16th Cloud Expo, Seth Bostock, CEO of IndependenceIT, will begin by walking the audience through the evolution of Workspace as-a-Service, where it is now vs. where it going. To look beyond the desktop we must understand exactly what WaaS is, who the users are, and where it is going in the future. IT departments, ISVs and service providers must look to workflow and automation capabilities to adapt to growing demand and the rapidly changing workspace model.
Sensor-enabled things are becoming more commonplace, precursors to a larger and more complex framework that most consider the ultimate promise of the IoT: things connecting, interacting, sharing, storing, and over time perhaps learning and predicting based on habits, behaviors, location, preferences, purchases and more. In his session at @ThingsExpo, Tom Wesselman, Director of Communications Ecosystem Architecture at Plantronics, will examine the still nascent IoT as it is coalescing, including what it is today, what it might ultimately be, the role of wearable tech, and technology gaps stil...
In the consumer IoT, everything is new, and the IT world of bits and bytes holds sway. But industrial and commercial realms encompass operational technology (OT) that has been around for 25 or 50 years. This grittier, pre-IP, more hands-on world has much to gain from Industrial IoT (IIoT) applications and principles. But adding sensors and wireless connectivity won’t work in environments that demand unwavering reliability and performance. In his session at @ThingsExpo, Ron Sege, CEO of Echelon, will discuss how as enterprise IT embraces other IoT-related technology trends, enterprises with i...
When it comes to the Internet of Things, hooking up will get you only so far. If you want customers to commit, you need to go beyond simply connecting products. You need to use the devices themselves to transform how you engage with every customer and how you manage the entire product lifecycle. In his session at @ThingsExpo, Sean Lorenz, Technical Product Manager for Xively at LogMeIn, will show how “product relationship management” can help you leverage your connected devices and the data they generate about customer usage and product performance to deliver extremely compelling and reliabl...
The Internet of Things (IoT) is causing data centers to become radically decentralized and atomized within a new paradigm known as “fog computing.” To support IoT applications, such as connected cars and smart grids, data centers' core functions will be decentralized out to the network's edges and endpoints (aka “fogs”). As this trend takes hold, Big Data analytics platforms will focus on high-volume log analysis (aka “logs”) and rely heavily on cognitive-computing algorithms (aka “cogs”) to make sense of it all.
With several hundred implementations of IoT-enabled solutions in the past 12 months alone, this session will focus on experience over the art of the possible. Many can only imagine the most advanced telematics platform ever deployed, supporting millions of customers, producing tens of thousands events or GBs per trip, and hundreds of TBs per month. With the ability to support a billion sensor events per second, over 30PB of warm data for analytics, and hundreds of PBs for an data analytics archive, in his session at @ThingsExpo, Jim Kaskade, Vice President and General Manager, Big Data & Ana...
HP and Aruba Networks on Monday announced a definitive agreement for HP to acquire Aruba, a provider of next-generation network access solutions for the mobile enterprise, for $24.67 per share in cash. The equity value of the transaction is approximately $3.0 billion, and net of cash and debt approximately $2.7 billion. Both companies' boards of directors have approved the deal. "Enterprises are facing a mobile-first world and are looking for solutions that help them transition legacy investments to the new style of IT," said Meg Whitman, Chairman, President and Chief Executive Officer of HP...
One of the biggest impacts of the Internet of Things is and will continue to be on data; specifically data volume, management and usage. Companies are scrambling to adapt to this new and unpredictable data reality with legacy infrastructure that cannot handle the speed and volume of data. In his session at @ThingsExpo, Don DeLoach, CEO and president of Infobright, will discuss how companies need to rethink their data infrastructure to participate in the IoT, including: Data storage: Understanding the kinds of data: structured, unstructured, big/small? Analytics: What kinds and how responsiv...
Since 2008 and for the first time in history, more than half of humans live in urban areas, urging cities to become “smart.” Today, cities can leverage the wide availability of smartphones combined with new technologies such as Beacons or NFC to connect their urban furniture and environment to create citizen-first services that improve transportation, way-finding and information delivery. In her session at @ThingsExpo, Laetitia Gazel-Anthoine, CEO of Connecthings, will focus on successful use cases.
Sensor-enabled things are becoming more commonplace, precursors to a larger and more complex framework that most consider the ultimate promise of the IoT: things connecting, interacting, sharing, storing, and over time perhaps learning and predicting based on habits, behaviors, location, preferences, purchases and more. In his session at @ThingsExpo, Tom Wesselman, Director of Communications Ecosystem Architecture at Plantronics, will examine the still nascent IoT as it is coalescing, including what it is today, what it might ultimately be, the role of wearable tech, and technology gaps stil...
The true value of the Internet of Things (IoT) lies not just in the data, but through the services that protect the data, perform the analysis and present findings in a usable way. With many IoT elements rooted in traditional IT components, Big Data and IoT isn’t just a play for enterprise. In fact, the IoT presents SMBs with the prospect of launching entirely new activities and exploring innovative areas. CompTIA research identifies several areas where IoT is expected to have the greatest impact.
Wearable devices have come of age. The primary applications of wearables so far have been "the Quantified Self" or the tracking of one's fitness and health status. We propose the evolution of wearables into social and emotional communication devices. Our BE(tm) sensor uses light to visualize the skin conductance response. Our sensors are very inexpensive and can be massively distributed to audiences or groups of any size, in order to gauge reactions to performances, video, or any kind of presentation. In her session at @ThingsExpo, Jocelyn Scheirer, CEO & Founder of Bionolux, will discuss ho...
Cloud data governance was previously an avoided function when cloud deployments were relatively small. With the rapid adoption in public cloud – both rogue and sanctioned, it’s not uncommon to find regulated data dumped into public cloud and unprotected. This is why enterprises and cloud providers alike need to embrace a cloud data governance function and map policies, processes and technology controls accordingly. In her session at 15th Cloud Expo, Evelyn de Souza, Data Privacy and Compliance Strategy Leader at Cisco Systems, will focus on how to set up a cloud data governance program and s...
Containers and microservices have become topics of intense interest throughout the cloud developer and enterprise IT communities. Accordingly, attendees at the upcoming 16th Cloud Expo at the Javits Center in New York June 9-11 will find fresh new content in a new track called PaaS | Containers & Microservices Containers are not being considered for the first time by the cloud community, but a current era of re-consideration has pushed them to the top of the cloud agenda. With the launch of Docker's initial release in March of 2013, interest was revved up several notches. Then late last...
Roberto Medrano, Executive Vice President at SOA Software, had reached 30,000 page views on his home page - http://RobertoMedrano.SYS-CON.com/ - on the SYS-CON family of online magazines, which includes Cloud Computing Journal, Internet of Things Journal, Big Data Journal, and SOA World Magazine. He is a recognized executive in the information technology fields of SOA, internet security, governance, and compliance. He has extensive experience with both start-ups and large companies, having been involved at the beginning of four IT industries: EDA, Open Systems, Computer Security and now SOA.