{"id":1640,"date":"2024-11-21T01:00:07","date_gmt":"2024-11-21T01:00:07","guid":{"rendered":"http:\/\/localhost:8080\/sk-hynix-presents-innovative-ai-and-hpc-solutions-at-sc24\/"},"modified":"2026-06-11T15:38:45","modified_gmt":"2026-06-11T15:38:45","slug":"sk-hynix-presents-innovative-ai-and-hpc-solutions-at-sc24","status":"publish","type":"post","link":"https:\/\/news.skhynix.com\/en\/sk-hynix-presents-innovative-ai-and-hpc-solutions-at-sc24\/","title":{"rendered":"SK hynix Presents Innovative AI & HPC Solutions at SC24"},"content":{"rendered":"

SK hynix is showcasing its advanced memory solutions for AI and high-performance computing (HPC) at Supercomputing 2024 (SC24) in Atlanta, the U.S., held from November 17\u201322. This annual event, organized by the Association for Computing Machinery and the IEEE Computer Society since 1988, features the latest developments in HPC, networking, storage, and data analysis.<\/p>\n

\n
\n
\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n

\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n<\/div>\n

<\/div>
<\/div>
<\/div><\/div><\/div>\n\n

\u25b2 SK hynix\u2019s booth at SC24<\/p>\n

Returning for its second year, SK hynix is underlining its AI memory leadership through a display of innovative memory products and insightful presentations on AI and HPC technologies. In line with the conference\u2019s \u201cHPC Creates\u201d theme which underscores the impact of supercomputing across various industries, the company is showing how its memory solutions drive progress in diverse fields.<\/p>\n

\n
\n
<\/div>\n

Showcasing Advanced Memory Solutions for AI & HPC<\/h3>\n
<\/div>\n<\/div>\n<\/div>\n

At the booth, SK hynix is demonstrating and displaying a range of groundbreaking products tailored for AI and HPC. The products being demonstrated include its CMM (CXL\u00ae<\/sup> Memory Module)-DDR5* <\/sup>, AiMX* <\/sup> accelerator card, and Niagara 2.0 among others.<\/p>\n

* <\/sup>Compute Express Link\u00ae<\/sup> (CXL\u00ae<\/sup>): A PCIe-based next-generation interconnect protocol on which high-performance computing systems are based.
\n* <\/sup>CXL Memory Module-DDR5 (CMM-DDR5): A next-generation DDR5 memory module utilizing CXL technology to boost bandwidth and performance for AI, cloud, and high-performance computing.
\n* <\/sup>Accelerator-in-Memory Based Accelerator (AiMX): SK hynix\u2019s specialized accelerator card tailored for large language model processing using GDDR6-AiM chips.<\/p>\n

\n
\n
\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n

\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n

\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n<\/div>\n

<\/div>
<\/div>
<\/div><\/div><\/div>\n\n

\u25b2 Live demonstrations of CMM-DDR5 and AiMX at the booth<\/p>\n

The live demonstration of CMM-DDR5 with a server platform featuring Intel\u00ae<\/sup> Xeon\u00ae<\/sup> 6 processors shows how CXL\u00ae<\/sup> memory technology accelerates AI workloads under various usage models. Moreover, visitors to the booth can learn about the latest CMM-DDR5 product with EDSFF* <\/sup> which offers improvements in TCO* <\/sup> and performance. Another live demonstration features AiMX integrated in an ASRock Rack Server to run Meta\u2019s Llama 3 70B, a large language model (LLM) with 70 billion parameters. This demonstration highlights AiMX\u2019s efficiency in processing large datasets while achieving high performance and low power consumption, addressing the computational load challenges posed by attention layers* <\/sup> in LLMs.<\/p>\n

* <\/sup>Enterprise and Data Center Standard Form Factor (EDSFF): A collection of SSD form factors specifically used for data center servers.
\n* <\/sup>Total cost of ownership (TCO): The complete cost of acquiring, operating, and maintaining an asset, including purchase, energy, and maintenance expenses.
\n* <\/sup>Attention layer: A mechanism that enables a model to assess the relevance of input data, prioritizing more important information for processing.<\/p>\n

\n
\n
\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n

\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n

\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n

\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n

\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n<\/div>\n

<\/div>
<\/div>
<\/div><\/div><\/div>\n\n

\u25b2 SK hynix\u2019s Niagara 2.0, customized HBM, OCS, and SSD products<\/p>\n

Among the other technologies being demonstrated is Niagara 2.0. The CXL pooled memory solution enables data sharing to minimize GPU memory shortages during AI inference* <\/sup>, making it ideal for LLM models. The company is also demonstrating an HBM with near-memory processing (NMP)* <\/sup> which accelerates indirect memory access* <\/sup>, a frequent occurrence in HPC. Developed with Los Alamos National Laboratory (LANL), the solution highlights the potential of NMP-enabled HBM to advance next-generation technologies.<\/p>\n

Another demonstration is showcasing SK hynix\u2019s updated OCS* <\/sup> solution, which offers significant improvements in analytical performance for real-world HPC workloads compared to the iteration displayed at SC23<\/span><\/a>. Co-developed with LANL, OCS addresses performance issues in traditional HPC systems by enabling storage to independently analyze data, reducing unnecessary data movement and improving resource efficiency. Additionally, the company is demonstrating a checkpoint offloading SSD* <\/sup> prototype that improves LLM training resource utilization by enhancing performance and scalability.<\/p>\n

* <\/sup>AI inference: The process of using a trained AI model to analyze live data for predictions or task completions.
\n* <\/sup>Near-memory processing (NMP): A technique that performs computations near data storage, reducing latency and boosting performance in high-bandwidth tasks like AI and HPC.
\n* <\/sup>Indirect memory access: A computing addressing method in which an instruction providing the address of a memory location that contains the actual address of the desired data or instruction.
\n* <\/sup>Object-based computational storage (OCS): A storage architecture that integrates computation within the storage system, enabling local data processing and minimizing movement to enhance analytical efficiency.
\n* <\/sup>Checkpoint offloading SSD: A storage solution that stores intermediate data during AI training, improving efficiency and reducing training time.<\/p>\n

\n
\n
\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n

\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n

\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n

\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n<\/div>\n

<\/div>
<\/div>
<\/div><\/div><\/div>\n\n

\u25b2 SK hynix presented various data center solutions, including HBM3E, DDR5, and eSSD products<\/p>\n

In addition to running product demonstrations, SK hynix is also displaying a robust lineup of data center solutions, including its industry-leading HBM3E* <\/sup>. The fifth-generation HBM provides high-speed data processing, optimal heat dissipation, and high capacity, making it essential for AI applications. Alongside HBM3E are the company\u2019s rapid DDR5 RDIMM and MCR DIMM products, which are tailored for AI computing in high-performance servers. Enterprise SSDs (eSSDs) including the Gen 5 PS1010 and PEB110 are also on display. Offering ultra-fast read\/write speeds, these SSD solutions are vital for accelerating AI training and inference in large-scale environments.<\/p>\n

* <\/sup>HBM3E: The fifth-generation High Bandwidth Memory (HBM), a high-value, high-performance product that revolutionizes data processing speeds by connecting multiple DRAM chips with through-silicon via (TSV).<\/p>\n

\n
\n
<\/div>\n

Highlighting the Potential of Memory Through Expert Presentations<\/h3>\n
<\/div>\n<\/div>\n<\/div>\n

During the conference, Jongryool Kim, research director of AI System Infra, presented on \u201cMemory & Storage: The Power of HPC\/AI,\u201d highlighting the memory needs for HPC and AI systems. He focused on two key advancements including near-data processing technology using CXL, HBM, and SSDs to improve performance, and CXL pooled memory for better data sharing across systems.<\/p>\n

\n
\n
\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n

\n\t\"\"

<\/p><\/div><\/a><\/div>\n<\/div>\n<\/div>\n

<\/div>
<\/div>
<\/div><\/div><\/div>\n\n

\u25b2 (From first image) Research Director Jongryool Kim presenting on advancements in memory and storage for HPC and AI systems; Technical Leader Jeoungahn Park delivering a presentation on OCS<\/p>\n

Technical Leader Jeoungahn Park of the Sustainable Computing team also took to the stage for his talk on \u201cLeveraging Open Standardized OCS to Boost HPC Data Analytics.\u201d Park explained how OCS enables storage to automatically recognize and analyze data, thereby accelerating data analysis in HPC. He added how OCS enhances resource efficiency and integrates seamlessly with existing analytics systems, as well as how its analysis performance has been verified in real-world HPC applications.<\/p>\n

At SC24, SK hynix is solidifying its status as a pioneer in memory solutions which are driving innovations in AI and HPC technologies. Looking ahead, the company will continue to push technological boundaries with support from its partners to shape the future of AI and HPC.<\/p>\n

\"\"<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

SK hynix is showcasing its advanced memory solutions for AI and high-performance computing (HPC) at Supercomputing 2024 (SC24) in Atlanta, the U.S., held from November 17\u201322. This annual event, organized by the Association for Computing Machinery and the IEEE Computer Society since 1988, features the latest developments in HPC, networking, storage, and data analysis. SK [\u2026]<\/p>\n","protected":false},"author":23,"featured_media":1623,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_migrated_source_id":16873,"footnotes":"","_members_access_role":[],"_members_access_error":""},"categories":[5],"tags":[14,234,968,155,25,36,1301,1302,1303,1304],"class_list":["post-1640","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech-and-ai","tag-ai-memory","tag-aimx","tag-artificial-intelligence","tag-cxl","tag-essd","tag-hbm3e","tag-high-performance-computing","tag-ocs","tag-sc24","tag-supercomputing-2024"],"acf":[],"_links":{"self":[{"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/posts\/1640","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/users\/23"}],"replies":[{"embeddable":true,"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/comments?post=1640"}],"version-history":[{"count":2,"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/posts\/1640\/revisions"}],"predecessor-version":[{"id":8280,"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/posts\/1640\/revisions\/8280"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/media\/1623"}],"wp:attachment":[{"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/media?parent=1640"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/categories?post=1640"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news.skhynix.com\/en\/wp-json\/wp\/v2\/tags?post=1640"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}