When streaming movies, users can feel as if they are the only one using the service even when logging in at peak hours. This is made possible in part by virtualization1 technology, which plays a key role in enabling the stable performance of cloud-based services such as streaming platforms.
1Virtualization: A technology which uses software to divide a single physical machine’s hardware resources such as servers and networks between multiple virtual machines. Each virtual machine runs its own operating system, enabling it to operate like an independent system despite sharing the hardware of a single machine.
In recent years, however, companies which offer such services have faced challenges in ensuring consistent quality due to the growing demands on cloud systems. Moreover, the advent of the AI era has only increased the complexity of the cloud environment. Amid these changes, attention has turned to advancing virtualization technology and applying it to not only server systems but also enterprise SSDs2 (eSSDs) to better serve customer needs. SK hynix has been leading the charge in this respect, implementing its outstanding virtualization technology to its eSSD lineup.
2Enterprise SSDs (eSSDs): High-performance storage drives designed specifically for enterprise applications, such as data centers and cloud storage.
This episode of Rulebreakers’ Revolutions will focus on how, despite being a latecomer to the SSD market, SK hynix rose above the competition to apply virtualization technology at the eSSD level.
![[Rulebreakers’ Revolutions] Flexible & Collaborative eSSD Virtualization Development for Today’s Data Centers](https://d36ae2cxtn9mcr.cloudfront.net/wp-content/uploads/2024/11/21065003/SK-hynix_Rulebreakers-Revolution-5_eSSD_01.png "[Rulebreakers’ Revolutions] Flexible & Collaborative eSSD Virtualization Development for Today’s Data Centers")
The Mission: Optimizing eSSD Performance in the Data Explosion Era
Over the last decade, the applications of cloud services have greatly expanded to various areas from file storage to banking and defense. The proliferation of online services and the recent AI boom has further driven the growth of the cloud environment. This has sparked a data explosion as more users access various cloud resources, significantly increasing the likelihood of bottlenecks in data centers. As a result, there is a growing need for improved system-wide performance, including optimizing and broadening the use of virtualization technology.
Originating at the end of 1960s, virtualization technology has played a key role in the evolution of data centers which utilize cloud computing. By enabling multi-tenancy3 systems to run on a single physical machine, virtualization leads to more efficient use of hardware resources compared to systems operating single-tenancy4 environments.
3Multi-tenancy: A software architecture where a single instance of an application or software serves multiple users, but each tenant’s data remains independent.
4Single-tenancy: A software architecture where a single instance of an application or software serves an individual user.
Through virtualization, computing resources can be used more efficiently in a multi-tenancy environment
While virtualization technology was previously applied primarily to host systems such as servers, eSSDs must now also support virtualization to store and retrieve data for multiple virtual machines. In addition, eSSDs need to deliver high levels of performance, security, and quality of service (QoS)5 as more tasks are offloaded from the host system. In response to this demand, SK hynix looked to optimize its lineup of eSSDs with the highest level of virtualization technology. However, the company faced obstacles as a latecomer to the SSD market and lacked a test environment that supported input/output (I/O) virtualization6.
5Quality of service (QoS): For an SSD, QoS refers to the consistency and predictability of the latency and input/output (I/O) performance while servicing a read/write workload.
6Input/output (I/O) virtualization: A technology that allows multiple virtual machines to efficiently share I/O devices, such as SSDs, by managing data flow between the virtual environment and physical hardware.
Tasked with improving the performance of eSSDs with limited experience in the field, SK hynix tapped into its broader SSD expertise to develop products with groundbreaking virtualization technology.
Flexibly Applying Virtualization Tech to eSSDs With cSSD Knowhow
To develop eSSD products which support best-in-class virtualization, SK hynix changed its traditional approach to SSD development. While the eSSD and client SSD7 (cSSD) teams had previously only worked separately, they closely collaborated on the eSSD development. For the cSSD team, its strengths lie in achieving power efficiency, while the eSSD team has expertise in performance stabilization and optimization. Through their joint efforts based on a common architecture, the teams were able to harness their respective expertise and secure top-tier technological capabilities.
7Client SSDs (cSSDs): Storage device designed for consumer devices such as PCs, tablets, and laptops.
SK hynix developed eSSDs with leading virtualization technology to help tackle bottlenecks in data centers
These technological developments include securing leading I/O virtualization and enhancing the PCIe8 multi-physical function, which helps to reduce the overhead of the hypervisor9. The addition of the ATS10 feature was also key as it improves performance by offloading address translation—the primary cause of bottlenecks in the hypervisor—and alleviating bottlenecks across the entire system. Moreover, the application of low-power characteristics already established in cSSDs, such as improved throttling11 performance, crucially improved power efficiency.
8Peripheral Component Interconnect Express (PCIe): A serial-structured, high-speed I/O interface used in the mainboard of digital devices.
9Hypervisor: Also known as a virtual machine monitor (VMM), a hypervisor allocates the physical computing resources such as the CPU and memory to individual virtual machines as required, supporting the optimal use of hardware.
10Address Translation Service (ATS): A mechanism often used in hardware-based virtualization which allows PCIe storage devices to request memory address translations from the Input/Output Memory Management Unit (IOMMU). ATS enhances performance by enabling devices to cache translations, reducing the latency associated with memory access.
11Throttling: A deliberate reduction in the performance of an SSD when it reaches certain temperature thresholds, typically to prevent overheating and damage to the drive.
As well as the eSSD and cSSD teams, other teams also worked together on this project to address issues. Although SK hynix lacked a test environment that supported I/O virtualization, the company was able to overcome this problem by establishing a taskforce involving the design, verification, and firmware teams. This taskforce brought together the necessary resources and expertise of the respective teams, enabling them to soon establish a suitable test environment.
Coupled with this pooling of resources, SK hynix was also quick to adapt to any changes in the development process. The company focused on flexible architecture design which can quickly reflect the development direction and customer needs by expanding customer communication channels in collaboration with its U.S. subsidiary, Solidigm. This close contact also enabled SK hynix to provide tailored solutions for each customer.
Through this collaborative, flexible and customized approach, SK hynix was able to develop leading I/O virtualization technology for eSSDs which supports a stable multi-tenancy environment. This means that, when streaming a film for example, one’s experience is not impacted when another user downloads a movie.
Supporting Virtualization & Multi-Tenancy: SK hynix’s eSSD Lineup for Today’s Data Centers
As a result of its differentiated approach, SK hynix developed flagship eSSDs such as the PE9010 and PEB110 equipped with I/O virtualization technology. These products not only meet the performance, security, and QoS demands required by data center companies and cloud service providers, but also contribute to reducing data center cooling costs due to their low-power characteristics.
The company’s high-performance eSSD lineup meets power, security, and QoS demands from data centers
Having already been commercialized, the eSSDs are currently adopted by global technology companies operating on cloud platforms. These customers which leverage SK hynix’s virtualization technology can offer independent services with consistent performance, an essential aspect of multi-tenancy systems. Notably, by offloading part of the virtualization overhead to devices, these customers can deliver high-quality services without the need for additional system expansion.
Beyond simply supplying products, SK hynix actively communicates with customers to provide solutions that go beyond SSD-only options to address their entire system. Moreover, the company makes it a priority to effectively respond to various cases at the highest level. Consequently, customers now recognize SK hynix as a trusted partner despite the fact it was a latecomer in the SSD market. The company will continue to engage in ongoing communication with its customers and secure firmware flexibility to address customer needs even after product development.
Rulebreaker Interview: Gijo Jeong, SSD Design
To find out more about the company’s rulebreaking mentality for virtualization, the SK hynix Newsroom spoke with Gijo Jeong of SSD Design. Jeong, who leads the team in designing controllers12, discussed the challenges the team faced when working on the eSSDs and the company’s unique approach to development.
12Controller: An SSD controller is the central processor of an SSD. It manages all operations, including reading and writing data, handling error correction, managing flash memory, and optimizing performance.
What challenges did you face when developing the eSSDs?
“The first eSSD product development proved to be the most difficult, and in the process of controller design, there was no test environment that supported I/O virtualization. We therefore faced the challenge of developing the product on a tight schedule, but we managed to overcome this through early engagement with various related departments, including design, validation and firmware.
“One of the other major challenges we faced was the fact that new customer needs can arise even after controller development. We addressed this issue through various approaches including modifying the firmware to ensure the best results.
“Through this process, I realized that the synergy effect of collaboration between different members and departments is more powerful than you can imagine.”
How did your team demonstrate a rulebreaker mentality when developing the eSSDs?
“When developing eSSDs, we took the road less travelled by changing our approach to development. We ensured we had the flexibility to quickly identify customer needs and later implement them through changes to the firmware.
“Also, we didn’t conform to the usual stereotype of what eSSDs and cSSDs are supposed to be. As we possessed expertise for both types of SSDs, we focused on their convergence and approached the solutions without bias, adapting either technology as needed to meet customer needs.
“By utilizing our company-wide expertise and taking a flexible approach, we have reimagined the concept of eSSDs and taken them to the next level.”
<Other articles from this series>
[Rulebreakers’ Revolutions] How MR-MUF’s Heat Control Breakthrough Elevated HBM to New Heights
[Rulebreakers’ Revolutions] Innovative Design Scheme Helps HBM3E Reach New Heights
