{"id":1075,"date":"2025-10-01T06:00:00","date_gmt":"2025-10-01T06:00:00","guid":{"rendered":"http:\/\/localhost:8080\/ai-infra-summit-2025\/"},"modified":"2026-06-15T08:56:27","modified_gmt":"2026-06-15T08:56:27","slug":"ai-infra-summit-2025","status":"publish","type":"post","link":"https:\/\/news.skhynix.com\/en\/ai-infra-summit-2025\/","title":{"rendered":"AI Infra Summit 2025: SK hynix Showcases Innovative AiM Solution for Accelerating AI"},"content":{"rendered":"
<\/div>\n
\"\"<\/figure>\n

SK hynix showcased its enhanced AiM* <\/sup>-based AI memory solution at the AI Infra Summit 2025 in Santa Clara, California from September 9\u201311, highlighting its technological leadership in future AI services.<\/p>\n

* <\/sup>Accelerator-in-Memory (AiM): SK hynix\u2019s Processing-in-Memory (PIM) semiconductor product name, which includes GDDR6-AiM.<\/p>\n

\n
\n
\n\t\"\"<\/a>
<\/div><\/div>\n<\/div>\n
\n\t\"\"<\/a>
<\/div><\/div>\n<\/div>\n<\/div>\n
<\/div>
<\/div>
<\/div><\/div><\/div>\n\n

\u25b2 SK hynix\u2019s booth at the AI Infra Summit 2025<\/p>\n

Global AI industry leaders in enterprise and research gathered at the summit to demonstrate the latest hardware and software infrastructure technologies. Formerly known as the AI Hardware & Edge AI Summit, the event attracted more than 3,500 attendees and over 100 partners under the slogan \u201cPowering Fast, Efficient & Affordable AI\u201d.<\/p>\n

At the summit, SK hynix revealed the latest developments in its PIM* <\/sup>-based AiM solution, AiMX* <\/sup>. At its booth operated under the theme \u201cBoost Your AI: AiM is What You All Need\u201d, the company ran live demonstrations of a Supermicro server system (GPU SuperServer SYS-421GE-TNRT3) featuring two NVIDIA H100 GPUs and four of its AiMX cards. Visitors could see the system\u2019s performance under real-world conditions, witnessing firsthand AiM\u2019s technological capabilities and competitiveness.<\/p>\n

* <\/sup>Processing-In-Memory (PIM): A next-generation memory technology that integrates computational capabilities into memory, addressing data movement bottlenecks in AI and big data processing.
\n* <\/sup>AiM-based Accelerator (AiMX): SK hynix\u2019s accelerator card featuring a GDDR6-AiM chip which is specialized for large language models (LLMs) \u2014 AI systems such as ChatGPT trained on massive text datasets.<\/p>\n

\"\"<\/p>\n

\u25b2 A demonstration of the AiM-based solution<\/p>\n<\/figure>\n

The demonstration also highlighted how to scale the memory wall* <\/sup> in LLM* <\/sup> inferences. In GPU-only systems, both compute-bound* <\/sup> and memory-bound* <\/sup> processes are handled together which can lead to inefficiencies as the user requests or context lengths increase. In contrast, an AiMX-based disaggregated inference system* <\/sup> divides its workload into two distinct phases: the memory-bound stage executed on the AiMX accelerator and the compute-bound phase which runs on the GPU. This workload allocation enables the system to simultaneously process more user requests and longer input prompts.<\/p>\n

* <\/sup>Memory wall: A bottleneck that occurs when memory access speed lags behind data processor speed.
\n* <\/sup>Large language model (LLM): An AI model trained on massive datasets that understands and generates natural language processing tasks.
\n* <\/sup>Compute-bound: A workload in which the overall processing speed is limited by the processor\u2019s computational capabilities.
\n* <\/sup>Memory-bound: A workload in which the overall processing speed is limited by memory access speed.
\n* <\/sup>Disaggregated inference system: An architecture that allocates computational tasks based on different types of processing units, enabling a dualized structure for processing operations.<\/p>\n

\n
\n
\n\t\"\"<\/a>
<\/div><\/div>\n<\/div>\n
\n\t\"\"<\/a>
<\/div><\/div>\n<\/div>\n
\n\t\"\"<\/a>
<\/div><\/div>\n<\/div>\n<\/div>\n
<\/div>
<\/div>
<\/div><\/div><\/div>\n\n

\u25b2 The new AiMX card features updated architecture and software<\/p>\n

SK hynix also introduced the software enhancements to its AiMX card. The application of the vLLM* <\/sup> framework widely used in AI service development not only increased functionality but also provided stable support for long token generation, even in reasoning models* <\/sup> that involve complex inference processes.<\/p>\n

* <\/sup>Virtual large language model (vLLM): An AI framework designed for efficient and optimized LLM inference.
\n* <\/sup>Reasoning model: An advanced AI model that can perform complex reasoning tasks beyond simple prompt responses.<\/p>\n

With its updated architecture and enhanced software, the new AiM-based solution addresses cost, performance, and power consumption challenges in LLM service management while also reducing operational costs compared to GPU-only systems.<\/p>\n

\"\"<\/p>\n

\u25b2 SK hynix\u2019s Vice President Euicheol Lim presenting on attention offloading with PIM \u2013 GPU heterogeneous systems<\/p>\n<\/figure>\n

On the second day of the event, Vice President Euicheol Lim, head of Solution Advanced Technology, took to the stage for a presentation. Titled \u201cMemory\/Storage: Crushing the Token Cost Wall of LLM Service: Attention Offloading* <\/sup> With PIM \u2013 GPU Heterogeneous System,\u201d Lim\u2019s session outlined methods for cutting token processing costs in LLM services and highlighted AI memory technology\u2019s impact on the industries\u2019 digital transformation.<\/p>\n

* <\/sup>Attention offloading: A technique in LLMs\/transformer models that distributes or caches portions of attention computations to external memory devices, alleviating the workload on GPUs or main memory.<\/p>\n

The AI Infra Summit 2025 showcased the current state of AI infrastructure, spanning from hardware to data centers and edge AI industries. Looking ahead, SK hynix is committed to strengthening its technological leadership by delivering emerging AI memory solutions which tackle the challenges of future AI services.<\/p>\n

\n
\n

\u00a0<\/p>\n