What is High Bandwidth Memory?
HBM
It is a high-performance special memory technology vertically stacked on top of each other, enabling very fast data transfer to the processor.
Overview
Unlike traditional memories, it is a technology created by vertically stacking memory chips and positioned physically very close to the processor. Thanks to this vertical design, data transmission paths become shorter and wider, making it possible to transfer terabytes of data per second. It is especially used in situations requiring massive data transfer, such as the training and running of artificial intelligence models.
How it works
Memory layers are connected to each other with very thin vertical connections and placed directly next to the main processor, namely the GPU. As a result, data does not have to travel through long paths on the motherboard and reaches the processor at the speed of light.
Where it is used
It frequently appears in high-end graphics processors used in artificial intelligence servers and in high-performance data centers.
Commonly confused with
It is confused with standard computer memories used in our homes, i.e., RAM. Standard memories have a horizontal layout and their data transfer speeds are much lower compared to this special vertical technology.
Questions and answers
Why is this memory technology not common in regular computers?
Its production costs are extremely high and since it requires special cooling systems, it is currently preferred only in professional data centers.
Why is it so important for artificial intelligence?
Artificial intelligence models have to read billions of parameters instantaneously while running; this speed can only be achieved with this technology.
Related terms
This explanation was written in plain language for TreScout with AI and machine-translated from the Turkish original · the Turkish version prevails. If something looks wrong or missing, write to hello@trescout.com. Read in Turkish →