DataCenterNews Asia logo
Specialist data center news for Asia
Story image

New algorithm looks to help streamline data restoration of event logs

By Mitchell Hageman
Wed 15 Dec 2021

New tertiary research out of Korea has led to the development of an algorithm capable of streamlining the restoration of event data logs.

According to the researchers from Pusan National University, they have developed a data restoration algorithm that uses correlations between existing information to restore missing data in an event log with a high degree of accuracy.

They see the new technology as not only able to be utilised in current enterprises but also future AI applications.

Missing data can lead to a myriad of problems for multiple parties involved, and the increase in digitisation has increased the risk of failures in log keeping and development.

The algorithm has been designed to collect data from multiple perspectives in numerous information systems. Therefore there is a relationship between the collected data.

In most event logs, the researchers say that events have attributes linked to other events in "single event" or "multiple event relationships. 

In the former case, each attribute of an event corresponds to a unique attribute in another event. Based on this relationship, the researchers developed a Systematic Event Imputation (SEI) method that restores a missing value by simply referring to the available value it is linked to.

In cases where attributes have multiple correspondences, however, matching of attributes is not possible. To help remedy this situation, researchers developed a multiple event imputation (MEI) method where missing events are first estimated and used to create event sequences or event chains. 

These sequences can then be compared with an event log without missing data to restore the missing event attributes. 

When conducting tests with real-world event logs, the researchers found that their algorithm improved restoration accuracy by 1030% compared to existing restoration algorithms. In addition, it could restore almost 90% of the data accuracy even when more than half of it was missing. 

Dr. Sunghyun Sim and Prof. Hyerim Bae, along with Prof. Ling Liu from Georgia Institute of Technology are spearheading this new research. They say it will significantly improve working processes and solve many business challenges.

"Since data is collected from multiple perspectives in numerous information systems, there is a relationship between the collected data. Starting with this point, our study suggested a method of restoring missing event values by utilising the relationship among entities in the event log, which can overcome human error or system," explains Sim.  

Hyerim elaborates that it can further enhance AI aspects, saying, "It is possible to improve the performance of artificial intelligence by improving the quality of data in its learning process. The algorithm will also help prevent model malfunction by improving the quality of data it collects in real-time in a real-time environment."

The title of the original paper published is "Bagging recurrent event imputation for repair of imperfect event log with missing categorical events." It is published in the online journal IEEE transactions on services computing.

Related stories
Top stories
Story image
Sustainability
Empyrion DC announces 40MW green data center in South Korea
Empyrion DC has announced it is developing a 40MW green data center in Gangnam, Seoul, South Korea (GDC).
Story image
Google Cloud
Google Cloud to open first cloud region in NZ - among others
Google Cloud has announced plans to bring three new cloud regions, one each in New Zealand, Malaysia and Thailand.
Story image
Data
Talend announces support for Amazon Redshift Serverless
Talend has announced its support for Amazon Redshift Serverless, with the company saying the integration reinforces its commitment and leadership in supporting businesses.
Story image
Storage
DCI Data Centers breaks ground on AKL02 center
DCI Data Centers has commenced construction on Auckland's largest data center.
Story image
Data center
Macquarie Asset Management acquires stake in ST Telemedias VIRTUS Data Centres
"We will further strengthen VIRTUS' focus on sustainability by backing investment in its technology and enhancing the lifecycle management of its equipment."
Story image
Partnership
NCS, FPT Software launch Strategic Delivery Centre in Vietnam
The new partnership is designed to support increasing demand for high quality digital services across the region.
Story image
Data Centre Maintenance / Management
Vertiv releases update to Smart InfraSight platform
Vertiv has unveiled an update to its Smart InfraSight data centre management platform, featuring improved intelligence and the ability to manage multiple IT devices.
Story image
Hybrid Cloud
ERP implementations biggest concern for customers - report
"Companies are setting a higher bar for their ERP providers to deliver on more than just the technology itself."
Story image
Migration
SNP unveils next generation of CrystalBridge software platform
Data is a key pillar of every customer-centric organisation, as it relies on agile decisions to become increasingly sustainable and intelligent.
Story image
Cybersecurity
Cloudflare expands A/NZ footprint with four new data centres
New data centres in Adelaide, Canberra, Hobart, and Christchurch will bring faster, more reliable, and more secure internet to A/NZ.
Story image
Big Data
DataStax, Nanyang Polytechnic partner to grow big data management talent in Singapore
The collaboration will deliver technology, curricula and certifications in big data management to accelerate innovation and sustainability.
Story image
Development
Intel Labs unveils integrated photonics research advancement
"This new research demonstrates that its possible to achieve well-matched output power with uniform and densely spaced wavelengths."
AWS Marketplace
Learn how security orchestration, automation, and response (SOAR) enhances your security strategy.
Link image
Story image
Microsoft
Cloudian’s HyperStore validated to work with Microsoft Azure
Cloudian’s HyperStore object storage is now validated to work with Microsoft Azure Stack HCI, a joint offering that will give customers public cloud benefits within their own data centres.
Story image
Schneider Electric
Schneider Electric University adds new courses to lineup
The new updates include fundamentals of power, cooling, racks and physical security, and guidance on how to optimise data centre designs.
Story image
Cybersecurity
Zscaler launches co-located data centres in Canberra and Auckland
The investment will offer public and private sector enterprises greater resilience in support of their zero trust cybersecurity posture.
Story image
Sustainability
ST Engineering launches cooling system for greener data centers
ST Engineering says its Airbitat DC Cooling System cools down data centers and achieves annual net energy savings of more than 20% over conventional chiller systems alone. 
Story image
Cloud
Cloudflare outage in 19 data centers worldwide due to own error
Cloudflare says its outage for 19 of its data centers yesterday was because of a change in a long-running project to increase resilience in its busiest locations.
Story image
Sustainability
SoftIron joins Sustainable Digital Infrastructure Alliance
SoftIron has joined the Sustainable Digital Infrastructure Alliance (SDIA), a platform designed to help the digital sector reduce its environmental impact.
Story image
Public Cloud
Public cloud services revenues top $400 billion in 2021
"For the next several years, leading cloud providers will play a critical role in helping enterprises navigate the current storms of disruption."
Story image
Data center
Tokyo, Sydney and Seoul lead data center growth in APAC
Knight Frank’s latest report in partnership with DC Byte, which looks at centers in APAC, has found the region had an increase of 488 MW of new capacity in Q1, driven mainly by Tokyo, Sydney and Seoul.
Story image
Southern Cross Cable
Southern Cross Cable launches the SX NEXT cable to connect NZ to the world
The new Southern Cross NEXT fibre cable (SX NEXT) is set to connect Australasia to the US and further enhance connectivity between New Zealand, Australia, and the US.
Story image
Migration
New Relic launches Agentless Monitoring for SAP Solutions
The company says the solution empowers IT teams to better support business operations by harnessing existing SAP data sources to access all necessary telemetry data.
Story image
Quinbrook Infrastructure Partners
Quinbrook launches $2.5 billion ‘Supernode’ 800MW data storage project
Quinbrook says the new Supernode will be one of the largest permit-approved data storage campus projects in the Southern Hemisphere.
Story image
Energy
Sustainability huge factor for APAC data centre managers
A new report reveals that 85% of data centre managers in APAC believe that sustainability will significantly impact operations and decision making.
AWS Marketplace
Watch this webinar to gain building blocks for data mesh, and how AWS customers today are successfully enabling domain driven data.
Link image
Story image
Artificial Intelligence
Vectra AI named as AWS security competency partner
Threat detection and response company Vectra AI has announced that it has become an Amazon Web Services Security Competency Partner.
Story image
Amazon Web Services / AWS
Qualtrics goes live on AWS Cloud Infrastructure in Japan
Organisations across Japan will now be able to access the Qualtrics XM/OS platform locally via data centre in the AWS Asia Pacific (Tokyo) region.
Story image
SaaS
Iron Mountain InSight SaaS platform extends capabilities on AWS
Company deepens work with AWS, helps customers to accelerate their journey from physical to digital on a global scale.
Story image
Infrastructure
Oracle Cloud Infrastructure expands distributed cloud services
“Distributed cloud is the next evolution of cloud computing, and provides customers with more flexibility and control in how they deploy cloud resources."
Story image
Amazon Web Services / AWS
Sapporo City selects Nutanix Cloud Clusters on AWS
The city first used a hyper-converged infrastructure (HCI) solution from Nutanix to modernize and improve the efficiency of its on-premise datacenter.
Story image
Macquarie Data Centres
Macquarie deal to pioneer CO2-cutting data centre tech in Australia
Macquarie Data Centres has signed a multi-year deal with ResetData, an Australian first provider using Submer data centre technology. 
Story image
Sustainability
Kohler Power Systems diesel generators now more sustainable
Kohler Power Systems has announced its diesel generators are compatible with Hydrotreated Vegetable Oil (HVO), a major breakthrough in the usage of alternative fuels in backup power.
Story image
Microsoft
Schneider Electric named Microsoft Energy & Sustainability Partner of the Year
"The award is a great recognition of the collaborative impact we are making together, to tackle climate change."
Story image
Digital Realty
Digital Realty joins forces with CypressTel to deliver enhanced interconnectivity
The collaboration expands access across the Greater China region with Digital Realty's PlatformDIGITAL and CypressTel's hybrid WAN capabilities.
Story image
Data center
Keppel deepens inroads into China’s data centre market
This latest development marks Keppel’s sixth project since entering mainland China’s data centre market in 2020. 
Story image
Hybrid Cloud
HPE GreenLake advances hybrid cloud experience with new services
"The innovations unveiled today further build on our vision to provide the market with an unmatched platform to spur innovation and drive transformation.”
Story image
Infrastructure
Global investment in data centers more than doubled in 2021
DLA Piper's latest global survey finds the total investment in data center infrastructure worldwide rose from USD $24.4 billion in 2020 to USD $53.8 billion in 2021.
Story image
Data center
Schneider Electric launches education platform to address data center talent shortage
Schneider Electric has announced a series of updates to its vendor-agnostic and CPD-accredited digital education platform.
AWS Marketplace
Whitepaper: A practical guide for mitigating risk in today’s modern applications
Link image