DataCenterNews Asia logo
Specialist data center news for Asia
Story image

Meeting the challenges of big data in the modern data centre

Tue 6 Jun 2017
FYI, this story is more than a year old

We generate, process and store big data every day.

Demand for bandwidth is growing at a rapid pace and every new technological innovation, from artificial intelligence to the Internet of Things (IoT), brings new challenges in managing this data.

We’re in the midst of a communications revolution where enterprise data center networks must keep pace with ever increasing capacity demands. Not only do data centers need to enable high data rates for next-generation solutions, they must also face the additional challenges of maximising uptime and minimising latency.

Some of the challenges are completely unprecedented, with connected devices inviting new security threats. Telsyte expects the IoT market will be a favoured vector of cyberattacks, with the Australian ‘IoT at home’ market to climb to $3.2 billion in 2019.

As ‘IoT at home’ is only a section of the rapidly expanding IoT market, it’s crucial to note the security pitfalls these devices can pose, not only to their owners but to external organisations as well. 

As more businesses realise that effective data management and security play a key factor in the success of their future, data centers are becoming one of the fastest growing market segments.

Increasing demand for real-time data access and cloud services is creating a pressing need for large data centers to support enterprise development. 

Let’s take a look at why today’s successful data center solution must provide predictable performance, fast deployment, flexibility and scalability:

Understanding the options

With so many new options available for data center technology, deciding which transceiver types and cabling systems to install can be overwhelming. The benefits of multimode vs single-mode transceivers have long been debated, and the introduction of new form factors, fibre choices and techniques, make the conversation even more complicated.

While the higher speeds provided by single-mode are attractive to system designers – particularly with this focus on increased capacity – multimode transceivers continue to be the cost-effective choice for shorter-reach data center applications. And when coupled with extended-reach multimode transceivers, multimode fibre can achieve significant distances.

Wavelength division multiplexing (WDM) is also an option, but the expensive components required to multiplex signals combined with the lack of interoperability with other transceivers is not an optimal scenario.

Increasing data center density is another method of maximising bandwidth. Disaggregating 40G ports into 4 x 10G ports – made possible with parallel optics through harnesses or port breakout modules – provides significant density advantages both in terms of the attached electronics and the housings in the wiring areas.

For example, using 40G instead of 10G QSFP line cards for 10G connectivity reduces overall cost per port for the electronics, as well as power and cooling costs, and it means that users will have the technology in place when they are ready to upgrade to 40G.

There isn’t a one-size-fits-all solution. Data Center operators must speak with their cabling infrastructure providers to understand how their specific requirements can be addressed.

For example, cyber security should be a key consideration given the proliferation of new threats. So, a tapping solution that can analyse potential security threats should be integrated into the installation.

Addressing latency with a 2-level spine-and-leaf network structure

Compared to the traditional enterprise where the data center traffic is dominated by local client-to-server interactions (north to south), the network traffic of the large internet data center is dominated by server-to-server traffic (east to west).

This is required for cloud computing applications. The large number of users of these data centers has diversified demands, and increased requirement for uninterrupted user experiences.

The current mainstream 3-level tree network architecture is based on the traditional north to south transmission model. When a server needs to communicate with another server from a different network segment, its server must pass through the path from access layer, to aggregation layer, to core layer and back.

In a big data service with thousands of servers communicating in a cloud computing environment, this model is not effective as it consumes a large amount of system bandwidth and creates latency concerns.

To address these problems in recent years, large internet data centers have increasingly used the spine-and-leaf network architecture, which transfers data between the servers (east to west) more efficiently. 

This network architecture mainly consists of two parts – a spine switching layer and leaf switching layer. Each leaf switch is connected to each spine switch within a pod, which greatly improves the communication efficiency and reduces the delay between different servers.

In addition, the spine-and-leaf 2-level network architecture does not require the purchase of an expensive core-layer switching device. This architecture also enables easy moves, adds and changes for expansion based on business needs, thereby saving on further investment.

Since each leaf switch is required to connect each spine switch, dealing with a massive quantity of cabling can be a challenge. However, the latest in mesh interconnection module technology provides a neat solution.

When utilised correctly to achieve a full fabric mesh of the spine-and-leaf network, the current 40G network is supported and also allows a seamless transition to future 100G network capabilities.

Avoid signal loss and network downtime

Beyond boosting bandwidth capacity, enabling network consistency and maximising uptime are crucial for processing data on demand. Most systems have power budgets and operate within certain parameters to protect against signal failure.

However, bend-induced attenuation can result in the system loss exceeding the power budget and failing due to the signal power being too weak at the receiver.

Innovations in multimode fibre design have created bend-insensitive fibres that effectively have a barrier around the core to minimise macrobend loss.

The result is an optical fibre that exhibits up to a tenfold reduction in loss at the point of the bend, when compared to conventional multimode fibre. This protects the system margin or power budget headroom and prevents unscheduled downtime.

When considering data center density, remember that bend-insensitive fibre enable increased port density, reduced duct congestion and improved airflow.

Overall, the future data center demands more.

This is a challenge, as the focus shifts from traditional enterprise data centers, which have historically focused on data storage and preparation for disaster recovery, to real-time analysis and processing of data based on demand.

Now is the time for data center operators to ensure they’re well equipped to achieve greater design flexibility, ease of installation and a smaller cable footprint.

Collaborating with their cabling infrastructure provider is key to doing just that, to ultimately create a data center that is tailored to meet their network’s unique demands.

Article by Clive Hogg, Technical Manager, Corning Optical Communications

Related stories
Top stories
Story image
Macquarie Data Centres
Macquarie deal to pioneer CO2-cutting data centre tech in Australia
Macquarie Data Centres has signed a multi-year deal with ResetData, an Australian first provider using Submer data centre technology. 
Story image
Migration
SNP unveils next generation of CrystalBridge software platform
Data is a key pillar of every customer-centric organisation, as it relies on agile decisions to become increasingly sustainable and intelligent.
Story image
Cybersecurity
Zscaler launches co-located data centres in Canberra and Auckland
The investment will offer public and private sector enterprises greater resilience in support of their zero trust cybersecurity posture.
Story image
Hybrid Cloud
HPE GreenLake advances hybrid cloud experience with new services
"The innovations unveiled today further build on our vision to provide the market with an unmatched platform to spur innovation and drive transformation.”
Story image
Colocation
Digital Edge chooses Nortek’s StatePoint for new data center
Digital Edge will use Nortek's StatePoint liquid cooling technology in its new data center, the first commercial colocation operator in Asia to do so.
Story image
Vietnam
Viettel IDC deploys Cloudian Hyperstore object storage for enhanced cloud solutions
Cloudian has announced that its Hyperstore object storage has been deployed by Vietnam telco Viettel IDC, citing the technology’s flexibility, multi-tenancy and ransomware protection as significant advantages.
Story image
Expansion
Colt Technology expands into South Korea data center market
Colt Technology Services has expanded its network into the South Korean market, offering the country’s businesses cost-effective, low latency connectivity.
Story image
Amazon Web Services / AWS
Qualtrics goes live on AWS Cloud Infrastructure in Japan
Organisations across Japan will now be able to access the Qualtrics XM/OS platform locally via data centre in the AWS Asia Pacific (Tokyo) region.
Story image
Sustainability
Huawei unveils next-generation sustainable data centers
Huawei says its next-generation data centers will be powered by PowerPOD 3.0, which reduces the footprint by 40% and cuts the energy consumption by 70%.
Story image
Sustainability
Aligned Data Centers increases sustainability-linked loan
Aligned Data Centers has increased its sustainability-linked loan from $375 million to $1.75 billion to speed up the next phase of its strategic growth.
Story image
Cloud
Cisco Live showcases new offerings in its first hybrid event
Cisco Live 2022 has seen Cisco executives and customers take the stage to present a range of discussions in the company’s first-ever hybrid event.
Story image
Sustainability
Intel unveils new investments for data center sustainability
Intel has announced two new investments, continuing its efforts to create more sustainable data center technology.
Story image
Infosys
Preparing for the digital decade with the right workforce strategies
For a decade that started under the pall of the pandemic, the 2020s is poised to end with a bang with the digital economy swelling to a high across the world.
Story image
Data Science
Neo4j announces service delivery alliance with Deloitte
Neo4j has announced a service delivery alliance with Deloitte Consulting Southeast Asia for a range of services to customers within the region.
Story image
Employment
Tech job moves - Forcepoint, Malwarebytes, SolarWinds & VMware
We round up all job appointments from May 13-20, 2022, in one place to keep you updated with the latest from across the tech industries.
Story image
Cloud
SnapLogic improves Intelligent Integration Platform
SnapLogic has released new features and improvements to its Intelligent Integration Platform, which will allow IT, data and business teams to make select processes faster and more straightforward.
Story image
Cloud
QuSecure partners with DataBridge Sites to showcase platform
QuSecure has partnered with DataBridge Sites to showcase its Quantum-as-a-Service (QaaS) orchestration platform, QuProtect.
Story image
Broadband
Singapore found to have the speediest internet rates in the world
New research from BanklessTimes has shown that Singapore has the highest recorded median internet speed in the world at 207.61 MBPS.
Story image
Sisense
Data and analytics could be key to higher selling prices in APAC
Sisense's latest report has found that almost half of data professionals in APAC think customised data and analytics can create better selling prices for their products.
Story image
Microsoft
SAS Viya on Microsoft Azure to deliver 204% return - study
The Forrester Total Economic Impact study finds SAS Viya on Microsoft Azure brings a 204% return on investment over three years.
Story image
Robotic Process Automation / RPA
Micro Focus unveils Data Center Automation for SaaS delivery
MicroFocus has released Data Center Automation (DCA) for software-as-a-service (SaaS) delivery, offering more cost-effective vulnerability risk and IT compliance management.
Story image
Sustainability
Legrand unveils Nexpand, a data center cabinet platform
Legrand has unveiled a new data center cabinet platform, Nexpand, to offer the necessary scalability and future-proof architecture for digital transformation.
Story image
Sustainability
Daikin and SP Group to build new energy efficient district cooling system
The project, set to be complete by 2025, will create a system with a cooling capacity of up to 36,000 refrigerant tonnes (RT). 
Story image
Sustainability
AirTrunk boosts Japan presence with West Tokyo data center
AirTrunk is planning to build TOK2, a new hyperscale data center in Japan which will strengthen the company’s presence in the country.
Story image
Cybersecurity
Kaspersky opens three new centers to boost data management
Cybersecurity company Kaspersky has opened three new Transparency Centers, one in Japan, the second in Singapore and the third in the United States.
Story image
Sustainability
SoftIron named global leader for efficient DC infrastructure solutions
SoftIron has been named a global leader for supplying energy-efficient data infrastructure solutions for core-to-edge data centers after an assessment by Earth Capital Ltd.
Story image
Artificial Intelligence
Databricks announces new offering for Unity Catalog
Databricks has significantly expanded data governance capabilities on the lakehouse by unveiling data lineage for Unity Catalog.
Story image
Healthcare
SnapLogic launches Accelerator for Amazon HealthLake
SnapLogic has launched Accelerator to allow healthcare and life sciences organisations to turn raw data into healthcare-related insights and actions.
Story image
Sustainability
Evolution Data Centres reveals target of 20 tonnes of CO2 per GWh
Evolution Data Centres launches their new Sustainable Data Centre Charter, which includes targets like only 20 tonnes of carbon emissions per GWh by 2030.
Story image
Digital Transformation
The Huawei APAC conference kicks off with digital transformation
More than 1500 people from across APAC have gathered for the Huawei APAC Digital Innovation Congress to explore the future of digital innovation.
Story image
Infrastructure
Global investment in data centers more than doubled in 2021
DLA Piper's latest global survey finds the total investment in data center infrastructure worldwide rose from USD $24.4 billion in 2020 to USD $53.8 billion in 2021.
Story image
Infrastructure
SolarWinds IT Trends Report highlights increased cloud complexity for businesses
SolarWinds' new IT Trends report has signalled a significant shift in the way businesses are dealing with hybrid cloud and infrastructure.
Story image
Public Cloud
Public cloud services revenues top $400 billion in 2021
"For the next several years, leading cloud providers will play a critical role in helping enterprises navigate the current storms of disruption."
Story image
Cloud
Talend introduces new data health solutions for businesses
Talend has announced its latest version of Talend Data Fabric, with the release of Talend Trust Score enabling data teams to establish a foundation for data health.
Story image
Partnerships
Thailand announces launch of the Thailand 5G Alliance
It will promote collaboration between the public and private sector, through companies such as Huawei, to commercially drive Thailand's 5G development.
Story image
Cloud
Cloudflare outage in 19 data centers worldwide due to own error
Cloudflare says its outage for 19 of its data centers yesterday was because of a change in a long-running project to increase resilience in its busiest locations.
Story image
Infrastructure
Oracle Cloud Infrastructure expands distributed cloud services
“Distributed cloud is the next evolution of cloud computing, and provides customers with more flexibility and control in how they deploy cloud resources."
Story image
Cybersecurity
Secureworks researches new threat to Elasticsearch databases
Researchers from Secureworks' Counter Threat Unit have identified indexes of multiple internet-facing Elasticsearch databases replaced with a ransom note.
Story image
Infrastructure
New Uptime analysis highlights worsening downtime costs and consequences
New data from Uptime Institute has found that downtime costs and consequences are worsening as those involved in data infrastructure fail to find ways to curb outages.
Story image
CASB
Juniper expands SASE offering with data loss prevention capabilities
Juniper has announced the expansion of its SASE offering with the addition of cloud access security broker (CASB) and data loss prevention (DLP) capabilities.
Story image
Microsoft
Microsoft, Cloudian partnership offers data center flexibility
Cloudian’s HyperStore object storage platform is now integrated and validated to work with Microsoft SQ Server 2022, offering more flexible and scalable data centers.
Story image
Cloud
Boomi surpasses 20,000 customers. Sets record for the iPaaS space
Boomi has announced it has surpassed the 20,000 customer mark, setting the record for the largest customer base among iPaaS vendors.
Story image
Secure access service edge / SASE
Cisco unveils new cloud-managed networking offerings
Cisco has announced new cloud management capabilities that offer a unified experience across the Cisco Meraki, Cisco Catalyst and Cisco Nexus portfolios.
Story image
Cloud
Vertiv introduces line of redundant power transfer switches
Vertiv has introduced Vertiv Geist Rack Transfer Switch (RTS), a new line of transfer switches that provides redundant power to single-corded devices.