When does fragmentation occur in the CUDA caching allocator?

Software Development, Programming Languages, CUDA(docs.pytorch.org)view on HackerNews

CUDAcaching allocatorfragmentationexpandable segmentsPyTorch

Author: matt_d

Date: 6/1/2026

Article Summary:

This article discusses the fragmentation issue in the CUDA caching allocator and how it can be solved with expandable segments.