Welcome!

Apache Authors: Pat Romanski, Liz McMillan, Elizabeth White, Christopher Harrold, Janakiram MSV

Blog Feed Post

Cleversafe Boosts Storage Ingest Rates to 1-Terabyte Per Second for 10-Exabyte Data Storage System

By

When modernizing your enterprise to enable better sensemaking over all your information stores one of the factors you will need to consider is your throughput during ingest. You need to know and design for the right ingest for your system.  As you map out your requirements you should keep in mind the kind of benchmarks the best in industry are meeting. That’s why we wanted to share this interesting fact: Cleversafe has not only engineered systems that scale limitlessly in terms of amount of data that can be stored and accessed, but they have designed systems that can capture data at an incredibly fast ingest rate of 1 Terabyte per second. This is impressive.

The following is from a Cleversafe press release on this topic:

Cleversafe Inc., the solution for limitless data storage, today announced a new series of storage appliances, based on Intel® Xeon® processors, to achieve performance level throughput for ingesting and storing data at Exabyte scale. Cleversafe’s new 3000 series of appliances can be configured in a system capable of capturing data at 1 Terabyte per second at Exabyte capacity, making the company’s Object-based Dispersed Storage® solution extremely effective for high levels of data throughput.

“The inherent problem that companies are struggling with is building the right infrastructure to enable the world’s data scientists to make accurate predictions. That means being able to store more data over longer periods of time.” said Russ Kennedy, Vice President of Product Strategy, Marketing and Customer Solutions for Cleversafe. “At Petabyte and Exabyte scale the ability to ingest and store those volumes of data requires a significant boost in performance throughput,” said Kennedy. “We can scale this system to achieve an ingest rate of 1 Terabyte/second – that’s 20,000,000-3MB photos per minute, 180,000,000-20MB digital x-rays per hour, and even 1,728,000-50 GB HD videos per day. To finally be able to achieve that scale – that’s a serious shift in business for any company.”

Cleversafe’s new 3000 series appliances allow thousands of simultaneous readers/writers to maintain continuous, aggregate performance at a data throughput rate of 1-TB/second in a 10-Exabyte system configuration. Cleversafe’s innovative Object-based Dispersed Storage® technology combined with the performance benefits of Intel® Xeon® processors delivers the most reliable, cost effective, and power efficient big data storage solution in the industry.

“Today’s business requirements for capturing, storing and analyzing data at massive scale require CIOs to optimize their infrastructure strategies. Intel® Xeon® processors help solve big data storage challenges by providing energy efficient performance, scalability and built-in data protection required for today’s storage systems, ” said David Tuhy, Intel Storage General Manager.

Cleversafe is eliminating limitations on the movement, management and storage of massive data stores for analytical purposes. This past year the company announced the capability to store data at the 10 Exabyte scale, and just recently the company announced it was combining computation with its dispersed storage solution to deliver high reliability and efficiency to users of Hadoop MapReduce. Today’s announcement continues to show how Cleversafe is shaping the new data storage and analytics landscape to solve the challenges of Big Data.

“Petabyte and Exabyte scale data sets simply exceed the boundaries of normal data processing capabilities. When you get to those levels of scale you need to take a non-traditional approach to storage for cost-effectively capturing, storing and analyzing data.” said Terri McClure, Senior Analyst at Enterprise Strategy Group. “With traditional storage systems there are too many potential performance bottlenecks to capture data flow at such volumes. Cleversafe’s new series of storage appliances is a non-traditional approach that sets an extremely high ground for performance. This should help enable its customers to realize the real benefits associated with leveraging long-term Exabyte-scale data stores for analytics to deliver real business value.”

Product Features:

  • The Accesser 3100 model is powered by dual 8 core Intel® Xeon® ProcessorE5-2650 CPUs. It features 10GbE saturation on multiple ports to provide maximum throughput per Accesser.
  • The Slicestor 3510 model features high-density drive enclosures for extreme efficiency – 252 TB to 336 TB respectively (84 3TB drive enclosures in 5U with 84 4TB drive enclosures in Q4).
  • The dsNet Manager 3100 model is capable of managing up to 100 PBs with a single appliance.

Cleversafe’s new 3000 appliance series models will be available this Fall.

Cleversafe’s dsNet system protects both data and metadata equally and is inherently more reliable than traditional storage systems. By applying the company’s unique Information Dispersal technology to slice and disperse data, single points of failure are eliminated. As data is distributed evenly across all Slicestor nodes metadata can scale linearly and infinitely as new nodes are added, thus reducing any scalability bottlenecks and increasing performance and reliability. Cleversafe’s unique approach delivers the powerful combination of analytics and storage in a geographically distributed single system allowing organizations to efficiently scale their Big Data environments to hundreds of petabytes and even exabytes today.

Tweet This:[email protected] Scales to Deliver 1-TB/Second Performance for 10 Exabyte system.

About Cleversafe Inc.

Cleversafe has created a breakthrough technology that solves petabyte and beyond big data storage problems. This solution drives up to 90 percent of the storage cost out of the business while enabling secure and reliable global access and collaboration. The world’s largest data repositories rely on Cleversafe. To learn more about Cleversafe and its solutions, please visit www.cleversafe.com, call 312-423-6640 or email us at [email protected].

Read the original blog entry...

More Stories By Bob Gourley

Bob Gourley writes on enterprise IT. He is a founder and partner at Cognitio Corp and publsher of CTOvision.com

@ThingsExpo Stories
SYS-CON Events announced today that Super Micro Computer, Inc., a global leader in compute, storage and networking technologies, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Supermicro (NASDAQ: SMCI), the leading innovator in high-performance, high-efficiency server technology, is a premier provider of advanced server Building Block Solutions® for Data Center, Cloud Computing, Enterprise IT, Hadoop/...
NHK, Japan Broadcasting, will feature the upcoming @ThingsExpo Silicon Valley in a special 'Internet of Things' and smart technology documentary that will be filmed on the expo floor between November 3 to 5, 2015, in Santa Clara. NHK is the sole public TV network in Japan equivalent to the BBC in the UK and the largest in Asia with many award-winning science and technology programs. Japanese TV is producing a documentary about IoT and Smart technology and will be covering @ThingsExpo Silicon Val...
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
The 20th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held June 6-8, 2017, at the Javits Center in New York City, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Containers, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit your speaking proposal ...
The age of Digital Disruption is evolving into the next era – Digital Cohesion, an age in which applications securely self-assemble and deliver predictive services that continuously adapt to user behavior. Information from devices, sensors and applications around us will drive services seamlessly across mobile and fixed devices/infrastructure. This evolution is happening now in software defined services and secure networking. Four key drivers – Performance, Economics, Interoperability and Trust ...
SYS-CON Events announced today that CollabNet, a global leader in enterprise software development, release automation and DevOps solutions, will be a Bronze Sponsor of SYS-CON's 20th International Cloud Expo®, taking place from June 6-8, 2017, at the Javits Center in New York City, NY. CollabNet offers a broad range of solutions with the mission of helping modern organizations deliver quality software at speed. The company’s latest innovation, the DevOps Lifecycle Manager (DLM), supports Value S...
With billions of sensors deployed worldwide, the amount of machine-generated data will soon exceed what our networks can handle. But consumers and businesses will expect seamless experiences and real-time responsiveness. What does this mean for IoT devices and the infrastructure that supports them? More of the data will need to be handled at - or closer to - the devices themselves.
Web Real-Time Communication APIs have quickly revolutionized what browsers are capable of. In addition to video and audio streams, we can now bi-directionally send arbitrary data over WebRTC's PeerConnection Data Channels. With the advent of Progressive Web Apps and new hardware APIs such as WebBluetooh and WebUSB, we can finally enable users to stitch together the Internet of Things directly from their browsers while communicating privately and securely in a decentralized way.
In his keynote at @ThingsExpo, Chris Matthieu, Director of IoT Engineering at Citrix and co-founder and CTO of Octoblu, focused on building an IoT platform and company. He provided a behind-the-scenes look at Octoblu’s platform, business, and pivots along the way (including the Citrix acquisition of Octoblu).
Multiple data types are pouring into IoT deployments. Data is coming in small packages as well as enormous files and data streams of many sizes. Widespread use of mobile devices adds to the total. In this power panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists will look at the tools and environments that are being put to use in IoT deployments, as well as the team skills a modern enterprise IT shop needs to keep things running, get a handle on all this data, and deli...
Grape Up is a software company, specialized in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market across the USA and Europe, we work with a variety of customers from emerging startups to Fortune 1000 companies.
Financial Technology has become a topic of intense interest throughout the cloud developer and enterprise IT communities. Accordingly, attendees at the upcoming 20th Cloud Expo at the Javits Center in New York, June 6-8, 2017, will find fresh new content in a new track called FinTech.
The Internet of Things is clearly many things: data collection and analytics, wearables, Smart Grids and Smart Cities, the Industrial Internet, and more. Cool platforms like Arduino, Raspberry Pi, Intel's Galileo and Edison, and a diverse world of sensors are making the IoT a great toy box for developers in all these areas. In this Power Panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists discussed what things are the most important, which will have the most profound e...
SYS-CON Events announced today that Interoute, owner-operator of one of Europe's largest networks and a global cloud services platform, has been named “Bronze Sponsor” of SYS-CON's 20th Cloud Expo, which will take place on June 6-8, 2017 at the Javits Center in New York, New York. Interoute is the owner-operator of one of Europe's largest networks and a global cloud services platform which encompasses 12 data centers, 14 virtual data centers and 31 colocation centers, with connections to 195 add...
SYS-CON Events announced today that Hitachi, the leading provider the Internet of Things and Digital Transformation, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Hitachi Data Systems, a wholly owned subsidiary of Hitachi, Ltd., offers an integrated portfolio of services and solutions that enable digital transformation through enhanced data management, governance, mobility and analytics. We help globa...
SYS-CON Events announced today that Grape Up will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct. 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company specializing in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market across the U.S. and Europe, Grape Up works with a variety of customers from emergi...
@ThingsExpo has been named the Most Influential ‘Smart Cities - IIoT' Account and @BigDataExpo has been named fourteenth by Right Relevance (RR), which provides curated information and intelligence on approximately 50,000 topics. In addition, Right Relevance provides an Insights offering that combines the above Topics and Influencers information with real time conversations to provide actionable intelligence with visualizations to enable decision making. The Insights service is applicable to eve...
SYS-CON Events announced today that Hitachi Data Systems, a wholly owned subsidiary of Hitachi LTD., will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City. Hitachi Data Systems (HDS) will be featuring the Hitachi Content Platform (HCP) portfolio. This is the industry’s only offering that allows organizations to bring together object storage, file sync and share, cloud storage gateways, and sophisticated search an...
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm.
@GonzalezCarmen has been ranked the Number One Influencer and @ThingsExpo has been named the Number One Brand in the “M2M 2016: Top 100 Influencers and Brands” by Analytic. Onalytica analyzed tweets over the last 6 months mentioning the keywords M2M OR “Machine to Machine.” They then identified the top 100 most influential brands and individuals leading the discussion on Twitter.