{"id":2303,"date":"2023-11-20T00:00:57","date_gmt":"2023-11-20T00:00:57","guid":{"rendered":"http:\/\/localhost:8080\/sk-hynix-debuts-at-sc23-to-showcase-next-gen-ai-and-hpc-solutions\/"},"modified":"2026-07-29T14:56:22","modified_gmt":"2026-07-29T05:56:22","slug":"sk-hynix-debuts-at-sc23-to-showcase-next-gen-ai-and-hpc-solutions","status":"publish","type":"post","link":"https:\/\/news.skhynix.com\/en\/sk-hynix-debuts-at-sc23-to-showcase-next-gen-ai-and-hpc-solutions\/","title":{"rendered":"SK hynix Debuts at SC23 to Showcase Next-Gen AI & HPC Solutions"},"content":{"rendered":"

SK hynix presented its leading AI and high-performance computing (HPC) solutions at Supercomputing 2023 (SC23) held in Denver, Colorado between November 12\u201317. Organized by the Association for Computing Machinery and IEEE Computer Society since 1988, the annual SC conference showcases the latest advancements in HPC, networking, storage, and data analysis. SK hynix marked its first appearance at the conference by introducing its groundbreaking memory solutions to the HPC community. During the six-day event, several SK hynix employees also made presentations revealing the impact of the company\u2019s memory solutions on AI and HPC.<\/p>\n

\"SK<\/p>\n

\u25b2 Figure 1 . SK hynix\u2019s exhibition booth at SC23<\/p>\n

\u00a0<\/p>\n

\n
\n
<\/div>\n

Displaying Advanced HPC & AI Products<\/h3>\n
<\/div>\n<\/div>\n<\/div>\n

At SC23, SK hynix showcased its products tailored for AI and HPC to underline its leadership in the AI memory field. Among these next-generation products, HBM3E<\/span><\/a> attracted attention as the HBM* <\/sup> solution meets the industry\u2019s highest standards of speed, capacity, heat dissipation, and power efficiency. These capabilities make it particularly suitable for data-intensive AI server systems. HBM3E was presented alongside NVIDIA\u2019s H100<\/span><\/a>, a high-performance GPU for AI that uses HBM3 for its memory.<\/p>\n

* <\/sup>High Bandwidth Memory (HBM): A high-value, high-performance product that possesses much higher data processing speeds compared to existing DRAMs by vertically connecting multiple DRAMs with through-silicon via (TSV).<\/p>\n

\n
\n
\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n

\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n<\/div>\n

<\/div>
<\/div>
<\/div><\/div><\/div>\n\n

\u25b2 Figure 2. HBM3E, an HBM solution applicable to data-intensive AI server systems<\/p>\n

SK hynix also held a demonstration of AiMX* <\/sup>, the company\u2019s generative AI accelerator* <\/sup> card which specializes in large language models (LLM) using GDDR6-AiM<\/span><\/a> chips that leverage PIM* <\/sup> technology. This product is set to play a key role in the advancement of data-intensive generative AI inference systems as it significantly reduces the AI inference time of server systems compared to systems with GPUs, while also offering lower power consumption.<\/p>\n

* <\/sup>Accelerator-in-Memory Based Accelerator (AiMX): SK hynix\u2019s accelerator card product that specializes in large language models (AI that learns with large amounts of text data such as ChatGPT) using GDDR6-AiM chips.
\n* <\/sup>Accelerator: A special-purpose hardware device that uses a chip designed specifically for processing and computing information.
\n* <\/sup>Processing-In-Memory (PIM): A next-generation technology that adds computational capabilities to semiconductor memories to solve the problem of data movement congestion in AI and big data processing.<\/p>\n

\n
\n
\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n

\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n<\/div>\n

<\/div>
<\/div>
<\/div><\/div><\/div>\n\n

\u25b2 Figure 3. SK hynix\u2019s booth providing a demonstration of AiMX, an AI accelerator card<\/p>\n

CXL<\/span><\/a>* <\/sup> was another highlight at SK hynix\u2019s booth. Based on PCle* <\/sup>, CXL is a standardized interface that helps increase the efficiency of HPC systems. Offering flexible memory expansion, CXL is a promising interface for HPC systems such as AI and big data-related applications. In particular, SK hynix\u2019s Niagara CXL disaggregated memory prototype platform was showcased as a pooled memory solution that can improve system performance in AI and big data distributed processing systems.<\/p>\n

* <\/sup>Compute Express Link (CXL): A PCIe-based next-generation interconnect protocol on which high-performance computing systems are based.
\n* <\/sup>Peripheral Component Interconnect Express (PCIe): A high-speed input\/output series interface used in the mainboard of digital devices. PCIe\u2019s data-transfer speed doubles in accordance with a generation shift.<\/p>\n

\n
\n
\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n

\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n

\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n<\/div>\n

<\/div>
<\/div>
<\/div><\/div><\/div>\n\n

\u25b2 Figure 4. SK hynix\u2019s CXL pooled memory solution, Niagara, and CXL-based computational memory solution (CMS)<\/p>\n

Additionally, SK hynix was able to present the results of its collaboration with Los Alamos National Laboratory (LANL) to improve the performance and reduce the energy requirements of applications that utilize HPC physics. Called CXL-based computational memory solution (CMS)<\/span><\/a>* <\/sup>, the product has the capability to accelerate indirect memory accesses while also significantly reducing data movement. Such technological enhancements are also applicable to various memory-intensive domains such as AI and graph analytics.<\/p>\n

* <\/sup>Computational Memory Solution (CMS):\u00a0 A memory solution that offers the functions of machine learning and data filtering, which are frequently performed by big data analytics applications. Just like CXL, CMS\u2019s memory capacity is highly scalable.<\/p>\n

Lastly, object-based computational storage (OCS) was shown as part of SK hynix\u2019s efforts to develop an analytics ecosystem with multiple partners. It minimizes data movement between analytics application systems and storage, reduces storage software stack weight, and accelerates data analysis speed. And through a demonstration, the company showed how its interface technology enhances data processing capabilities in OCS.<\/p>\n

\"\"<\/p>\n

\u25b2 Figure 5. Object-based computational storage (OCS) was developed as part of SK hynix\u2019s efforts to form an analytics ecosystem<\/p>\n

\u00a0<\/p>\n

\n
\n
<\/div>\n

Innovative Data Center & eSSD Solutions<\/h3>\n
<\/div>\n<\/div>\n<\/div>\n

\"\"<\/p>\n

\u25b2 Figure 6. A presentation of data center solutions including MCR DIMM, PS1010, and PS1030<\/p>\n

SK hynix also displayed a range of its data center solutions at the conference, including its DDR5 Registered Dual In-line Memory Module (RDIMM). Equipped with 1bnm, the fifth generation of the 10nm process technology, DDR5 RDIMM reaches speeds of up to 6,400 megabits per second (Mbps). The display also featured DDR5 Multiplexer Combined Ranks (MCR) DIMM, which reaches speeds of up to 8,800 Mbps. With such rapid speeds, these DDR5 solutions are suited for AI computing in high-performance servers.<\/p>\n

Visitors to the SK hynix booth could also see its latest enterprise SSD (eSSD) products, including the PCle Gen5-based PS1010 E3.S and PS1030. In particular, the PS1030 delivers the industry\u2019s fastest sequential read speed of 14,800 megabytes per second (MBps) which makes it ideal for big data and machine learning.<\/p>\n

\u00a0<\/p>\n

\n
\n
<\/div>\n

Sharing the Potential of SK hynix\u2019s Memory Solutions<\/h3>\n
<\/div>\n<\/div>\n<\/div>\n

\"\"<\/p>\n

\u25b2 Figure 7. Technical Leader Yongkee Kwon presents about LLM inference solution using SK hynix\u2019s AiM<\/p>\n

During the conference, SK hynix employees also held presentations on the application of the company\u2019s memory solutions for AI and HPC. On the fourth day of the conference, Technical Leader of PIM Hardware in Solution Advanced Technology Division Yongkee Kwon held a talk titled \u201cCost-Effective Large Language Model (LLM) Inference Solution Using SK hynix\u2019s AiM.\u201d Kwon revealed how SK hynix\u2019s AiM, a PIM device that is specialized for LLMs, can significantly improve the performance and energy efficiency of LLM inference. When applied to Meta\u2019s Open Pre-trained Transformers (OPT) language model, an open-source alternative to Open AI\u2019s GPT-3, AiM can reach speeds up to ten times higher than state-of-the-art GPU systems while also offering lower costs and energy consumption.<\/p>\n

\"\"<\/p>\n

\u25b2 Figure 8. Technical Leader Hokyoon Lee talks about the innovative solutions offered by SK hynix\u2019s CXL solution, Niagara<\/p>\n

On the same day, Technical Leader of System Software in Memory Forest x&D Hokyoon Lee held a presentation titled \u201cCXL-based Memory Disaggregation for HPC and AI Workloads.\u201d SK hynix\u2019s Niagara addresses the issue of stranded memory\u2014or unused memory in each server that can never be utilized by other servers\u2014with its elastic memory* <\/sup> feature. Additionally, Niagara\u2019s memory sharing feature provides a solution to heavy network traffic in conventional distributed computing. In the session, the presenters demonstrated the effectiveness of memory sharing during a real simulation with the Ray distributed AI framework which is used in ChatGPT.<\/p>\n

* <\/sup>Elastic memory: A type of memory with capacity that can be adjusted as required by servers when multiple hosts share memory, such as pooled memory.<\/p>\n

A day later, Director and Technical Leader of SOLAB in Memory Forest x&D Jongryool Kim presented on \u201cAccelerating Data Analytics Using Object Based Computational Storage in an HPC.\u201d By introducing SK hynix\u2019s collaboration with LANL in researching computational storage technologies, Kim proposed object-based computational storage (OCS) as a new computational storage platform for data analytics in HPC. Due to its high scalability and data-aware characteristics, OCS can perform analytics independently without help from compute nodes\u2014highlighting its potential as the future of computational storage in HPC.<\/p>\n

Similarly, SK hynix will continue to develop solutions that enable the advancement of AI and HPC as a globally leading AI memory provider.<\/p>\n

\"\"<\/p>\n

\u25b2 Figure 9. Technical Leader Jongryool Kim explains how SK hynix participated in collective research into computational storage technologies<\/p>\n","protected":false},"excerpt":{"rendered":"

SK hynix presented its leading AI and high-performance computing (HPC) solutions at Supercomputing 2023 (SC23) held in Denver, Colorado between November 12\u201317. Organized by the Association for Computing Machinery and IEEE Computer Society since 1988, the annual SC conference showcases the latest advancements in HPC, networking, storage, and data analysis. SK hynix marked its first [\u2026]<\/p>\n","protected":false},"author":23,"featured_media":2289,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_migrated_source_id":13586,"footnotes":"","_members_access_role":[],"_members_access_error":""},"categories":[5],"tags":[234,155,25,36,1301,1302,1327,1328],"class_list":["post-2303","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech-and-ai","tag-aimx","tag-cxl","tag-essd","tag-hbm3e","tag-high-performance-computing","tag-ocs","tag-sc23","tag-supercomputing-2023"],"acf":[],"_links":{"self":[{"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/posts\/2303","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/users\/23"}],"replies":[{"embeddable":true,"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/comments?post=2303"}],"version-history":[{"count":3,"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/posts\/2303\/revisions"}],"predecessor-version":[{"id":11722,"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/posts\/2303\/revisions\/11722"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/media\/2289"}],"wp:attachment":[{"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/media?parent=2303"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/categories?post=2303"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/tags?post=2303"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}