DataCenterNews Asia logo
Specialist data center news for Asia
Story image

How history will retell the flash storage story, and how we will look back at this transition

Fri 21 Oct 2016
FYI, this story is more than a year old

In five to ten years, we will look back with awe on the storage-media transition from spinning, rust-coated platters and electro-mechanical recording arms to solid-state, silicon-based media. We will look back on the magnetic hard disk era of data storage with glee and relief. Archeologists will unearth these things and ponder how they ever worked in the first place.

Make no mistake about it – the magnetic hard disk is being replaced by solid-state storage, or flash. It’s happening now and it’s just a matter of time until the last hard disk is given a ceremonial “so long and thanks for all the IO’s.” Already in Asia, companies in developing markets, unburdened by legacy infrastructure, are upgrading directly to all-flash to “leap-frog” competition. In more developed markets like Singapore and Australia, public and private sector organisations are embracing – and investing in – hyper convergence and flash technology to gain competitive edge through digital transformation. 

How will we look back on this transition? How will the flash storage story pan out?

They say the best way to predict the future is to look at the past. If anyone has doubts that the end of the spinning disk is on the horizon, then ask yourself one question: When was the last time you met anyone running their workloads from magnetic tape? I would imagine the answer to be, around 35 to 45 years ago.

There will be three distinct phases to the flash storage story: Vertical, Horizontal, and Tardis.

The Vertical Phase

By my reckoning, this phase ended one or two years ago. Flash started its three-phase journey by accelerating niche and individual workloads. Flash was expensive, but no one cared. These workloads, mostly database and online transaction processing (OLTP), needed to go fast at any cost. Spending money on hardware to accelerate via all-flash was a better option than spending millions on hard disks.

We typically saw direct-connect flash appliances providing all-flash storage to one or maybe two servers to accelerate mission critical applications. Think financial services, stock trading, high-volume online auctions, and so on. Application managers were prepared to trade off data service richness and simplicity for the performance gains.

The flash technology was “SLC media,” packaged in some proprietary manner, and the big topic of discussion was endurance and wear-out. How many page erases? How many writes, and so on? Those in charge of performance-critical applications didn’t really care because flash took the monkey off their backs and bought them time.

This vertical era of single (or few) flash-workload acceleration is over. It was, however, a very important time for learning about and getting ready for what came next.

The Horizontal Phase

Flash has gone mainstream and the all-flash data center for primary workloads is no longer just a possibility, it is a reality. The economics and mainstream availability of flash in mature and proven array solutions has combined to form the perfect storm against the hard disk. Start preparing for that ceremonial “so long and thanks for all the IO’s” farewell event!

The horizontal phase, mainstreaming, began around 2014-2015. The NAND media technology had evolved from SLC to MLC to TLC, and most commonly now 3D-TLC (or “3D-NAND”). We have already seen flash shipments surpass 15K RPM HDD shipments. The tipping point here was probably the culmination of data-reduction services, higher capacity and lower cost 3D-NAND, and platforms offering the trifecta of requirements in an all-flash data center platform. More on that trifecta later.

Within the horizontal phase, concerns over flash endurance and wear out has all but ceased. Every popular platform from mainstream vendors has this issue well under control now. Typical ROI periods for a migration from a legacy HDD array to an all-flash array are typically less than 18 months. As all those HDD arrays reach the end of their lives, customers are skipping the hybrid approach and moving directly to all-flash. This simplifies life for the storage admins and returns free floor tiles back to the data center manager.

Upon replacement of the all-HDD array with an all-flash array, the storage admin becomes a hero. Application managers wonder why they waited so long, and the “what if” discussions commence. Enter phase three.

The Tardis Phase

Once the benefits of the migration to all-flash were absorbed and understood, clever people who experienced the sheer performance capability of the technology started to think and ponder. They realised that flash has much more to offer. They realised that flash removed the data processing bottlenecks and constraints that ultimately limited application capability.

Software vendors and application innovators combined to create a new breed of app. I’ll call them “flash apps.” These are apps that couldn’t possibly run on traditional infrastructure. They fully leverage flash (or other solid-state storage) technology to deliver a new breed of application that is dependent on near-instantaneous, high-volume data processing.

The first of these “flash apps” was the combination of data warehouses and their associated transaction-processing workloads into one stack. These were originally separated because storage couldn’t cope with multiple workloads referencing the same dataset. Soon we will witness an avalanche of data-analytics apps that bring the notion of real-time Big Data to the stage. One only has to couple what’s happening at present with flash storage and compute interconnects with the Moore’s Law continuum of compute capacity and it is easy to see that the “flash apps” era is just around the corner. What will soon be possible is unimaginable from where we are now.

Back to the Trifecta

In the horizontal phase, the single biggest use-case is the replacement of shared all-HDD arrays with shared all-flash arrays. Storage bottlenecks disappear overnight, and ROI is just 18 months away. It’s a quick win.

However, there is no need to compromise on what will turn that “quick win” into a “long-term win.” The long-term success of the all-flash data center, and the innovation offered by the Tardis phase, will be governed by a no-compromise migration from HDD to all-flash.

This no-compromise migration will require attention to three key evaluation dimensions for all-flash storage solutions:

  • Performance and Quality of Service performance management
  • Enterprise mature-data management services
  • Cost effectiveness and known TCO

Many vendors often focus their discussions on just one of these dimensions, but be wary. This is often a ploy used to emphasise a single-strength and avoid discussing weaknesses. What will determine long-term success is achieving balance across all three of these dimensions.

Beyond Tardis

There actually could be a fourth phase in the flash story. The all-flash data center for primary workloads is an absolute given, as mentioned earlier. What is less clear is the obsolescence of the low-performance, bulk-capacity HDD’s, the 7200K RPM units. I believe the fourth phase, what I will call “Bye-Bye HDD,” will be driven by the next flash technology evolution, 3D-QLC (quad level cells). These will be high-capacity, high-density, 4-bits per cell flash. 3D-QLC has the potential to be that replacement technology for archive-grade HDD storage.

With each major transition in storage media, capacity has increased, performance has increased, and costs have decreased, allowing bigger workloads and bigger ideas to become a reality. History is on our side here.  So it’s not a matter of if, but when, and how fast, making the flash story an archetype of “Speed and Change” – the two defining attributes of IT today.

Article by Paul Haverfield, Chief Technology Officer, Storage, HPE Asia Pacific and Japan

Related stories
Top stories
Story image
Migration
SNP unveils next generation of CrystalBridge software platform
Data is a key pillar of every customer-centric organisation, as it relies on agile decisions to become increasingly sustainable and intelligent.
Story image
Cybersecurity
Zscaler launches co-located data centres in Canberra and Auckland
The investment will offer public and private sector enterprises greater resilience in support of their zero trust cybersecurity posture.
Story image
Hybrid Cloud
HPE GreenLake advances hybrid cloud experience with new services
"The innovations unveiled today further build on our vision to provide the market with an unmatched platform to spur innovation and drive transformation.”
Story image
Public Cloud
Public cloud services revenues top $400 billion in 2021
"For the next several years, leading cloud providers will play a critical role in helping enterprises navigate the current storms of disruption."
Story image
Infrastructure
Global investment in data centers more than doubled in 2021
DLA Piper's latest global survey finds the total investment in data center infrastructure worldwide rose from USD $24.4 billion in 2020 to USD $53.8 billion in 2021.
Story image
Vietnam
Viettel IDC deploys Cloudian Hyperstore object storage for enhanced cloud solutions
Cloudian has announced that its Hyperstore object storage has been deployed by Vietnam telco Viettel IDC, citing the technology’s flexibility, multi-tenancy and ransomware protection as significant advantages.
Story image
Cloud
Vertiv introduces line of redundant power transfer switches
Vertiv has introduced Vertiv Geist Rack Transfer Switch (RTS), a new line of transfer switches that provides redundant power to single-corded devices.
Story image
Employment
Tech job moves - Forcepoint, Malwarebytes, SolarWinds & VMware
We round up all job appointments from May 13-20, 2022, in one place to keep you updated with the latest from across the tech industries.
Story image
CASB
Juniper expands SASE offering with data loss prevention capabilities
Juniper has announced the expansion of its SASE offering with the addition of cloud access security broker (CASB) and data loss prevention (DLP) capabilities.
Story image
Sisense
Data and analytics could be key to higher selling prices in APAC
Sisense's latest report has found that almost half of data professionals in APAC think customised data and analytics can create better selling prices for their products.
Story image
Colocation
Digital Edge chooses Nortek’s StatePoint for new data center
Digital Edge will use Nortek's StatePoint liquid cooling technology in its new data center, the first commercial colocation operator in Asia to do so.
Story image
Cybersecurity
Kaspersky opens three new centers to boost data management
Cybersecurity company Kaspersky has opened three new Transparency Centers, one in Japan, the second in Singapore and the third in the United States.
Story image
Secure access service edge / SASE
Cisco unveils new cloud-managed networking offerings
Cisco has announced new cloud management capabilities that offer a unified experience across the Cisco Meraki, Cisco Catalyst and Cisco Nexus portfolios.
Story image
Cloud
QuSecure partners with DataBridge Sites to showcase platform
QuSecure has partnered with DataBridge Sites to showcase its Quantum-as-a-Service (QaaS) orchestration platform, QuProtect.
Story image
Infrastructure
SolarWinds IT Trends Report highlights increased cloud complexity for businesses
SolarWinds' new IT Trends report has signalled a significant shift in the way businesses are dealing with hybrid cloud and infrastructure.
Story image
Artificial Intelligence
Databricks announces new offering for Unity Catalog
Databricks has significantly expanded data governance capabilities on the lakehouse by unveiling data lineage for Unity Catalog.
Story image
Expansion
Colt Technology expands into South Korea data center market
Colt Technology Services has expanded its network into the South Korean market, offering the country’s businesses cost-effective, low latency connectivity.
Story image
Sustainability
AirTrunk boosts Japan presence with West Tokyo data center
AirTrunk is planning to build TOK2, a new hyperscale data center in Japan which will strengthen the company’s presence in the country.
Story image
Sustainability
Evolution Data Centres reveals target of 20 tonnes of CO2 per GWh
Evolution Data Centres launches their new Sustainable Data Centre Charter, which includes targets like only 20 tonnes of carbon emissions per GWh by 2030.
Story image
Sustainability
Aligned Data Centers increases sustainability-linked loan
Aligned Data Centers has increased its sustainability-linked loan from $375 million to $1.75 billion to speed up the next phase of its strategic growth.
Story image
Cloud
Boomi surpasses 20,000 customers. Sets record for the iPaaS space
Boomi has announced it has surpassed the 20,000 customer mark, setting the record for the largest customer base among iPaaS vendors.
Story image
Sydney
Equinix and PGIM Real Estate open data centre in Sydney
Equinix and PGIM Real Estate, the real estate investment and financing arm of PGIM, have announced the first xScale data centre in Sydney, named SY9x.
Story image
Microsoft
Microsoft, Cloudian partnership offers data center flexibility
Cloudian’s HyperStore object storage platform is now integrated and validated to work with Microsoft SQ Server 2022, offering more flexible and scalable data centers.
Story image
Infosys
Preparing for the digital decade with the right workforce strategies
For a decade that started under the pall of the pandemic, the 2020s is poised to end with a bang with the digital economy swelling to a high across the world.
Story image
Robotic Process Automation / RPA
Micro Focus unveils Data Center Automation for SaaS delivery
MicroFocus has released Data Center Automation (DCA) for software-as-a-service (SaaS) delivery, offering more cost-effective vulnerability risk and IT compliance management.
Story image
Sustainability
Daikin and SP Group to build new energy efficient district cooling system
The project, set to be complete by 2025, will create a system with a cooling capacity of up to 36,000 refrigerant tonnes (RT). 
Story image
Cloud
Cisco Live showcases new offerings in its first hybrid event
Cisco Live 2022 has seen Cisco executives and customers take the stage to present a range of discussions in the company’s first-ever hybrid event.
Story image
Sustainability
Huawei unveils next-generation sustainable data centers
Huawei says its next-generation data centers will be powered by PowerPOD 3.0, which reduces the footprint by 40% and cuts the energy consumption by 70%.
Story image
Partnerships
Thailand announces launch of the Thailand 5G Alliance
It will promote collaboration between the public and private sector, through companies such as Huawei, to commercially drive Thailand's 5G development.
Story image
Cloud
Talend introduces new data health solutions for businesses
Talend has announced its latest version of Talend Data Fabric, with the release of Talend Trust Score enabling data teams to establish a foundation for data health.
Story image
Digital Transformation
The Huawei APAC conference kicks off with digital transformation
More than 1500 people from across APAC have gathered for the Huawei APAC Digital Innovation Congress to explore the future of digital innovation.
Story image
Sustainability
Legrand unveils Nexpand, a data center cabinet platform
Legrand has unveiled a new data center cabinet platform, Nexpand, to offer the necessary scalability and future-proof architecture for digital transformation.
Story image
Infrastructure
Oracle Cloud Infrastructure expands distributed cloud services
“Distributed cloud is the next evolution of cloud computing, and provides customers with more flexibility and control in how they deploy cloud resources."
Story image
Amazon Web Services / AWS
Qualtrics goes live on AWS Cloud Infrastructure in Japan
Organisations across Japan will now be able to access the Qualtrics XM/OS platform locally via data centre in the AWS Asia Pacific (Tokyo) region.
Story image
Cybersecurity
Secureworks researches new threat to Elasticsearch databases
Researchers from Secureworks' Counter Threat Unit have identified indexes of multiple internet-facing Elasticsearch databases replaced with a ransom note.
Story image
Sustainability
Intel unveils new investments for data center sustainability
Intel has announced two new investments, continuing its efforts to create more sustainable data center technology.
Story image
Cloud
SnapLogic improves Intelligent Integration Platform
SnapLogic has released new features and improvements to its Intelligent Integration Platform, which will allow IT, data and business teams to make select processes faster and more straightforward.
Story image
Sustainability
SoftIron named global leader for efficient DC infrastructure solutions
SoftIron has been named a global leader for supplying energy-efficient data infrastructure solutions for core-to-edge data centers after an assessment by Earth Capital Ltd.
Story image
Healthcare
SnapLogic launches Accelerator for Amazon HealthLake
SnapLogic has launched Accelerator to allow healthcare and life sciences organisations to turn raw data into healthcare-related insights and actions.
Story image
Infrastructure
New Uptime analysis highlights worsening downtime costs and consequences
New data from Uptime Institute has found that downtime costs and consequences are worsening as those involved in data infrastructure fail to find ways to curb outages.
Story image
Microsoft
SAS Viya on Microsoft Azure to deliver 204% return - study
The Forrester Total Economic Impact study finds SAS Viya on Microsoft Azure brings a 204% return on investment over three years.
Story image
Sustainability
RDA and MVGX partner for sustainable data center development
Red Dot Analytics (RDA) and MetaVerse Green Exchange (MVGX) have entered a strategic partnership to make Singapore's data center development and operations more sustainable.
Story image
Broadband
Singapore found to have the speediest internet rates in the world
New research from BanklessTimes has shown that Singapore has the highest recorded median internet speed in the world at 207.61 MBPS.
Story image
Cloud
Cloudflare outage in 19 data centers worldwide due to own error
Cloudflare says its outage for 19 of its data centers yesterday was because of a change in a long-running project to increase resilience in its busiest locations.