low-memory – Tarik Billa

Memory-mapped files and low-memory scenarios

August 17, 2023 by Tarik

Memory-mapped files copy data from disk into memory a page at a time. Unused pages are free to be swapped out, the same as any other virtual memory, unless they have been wired into physical memory using mlock(2). Memory mapping leaves the determination of what to copy from disk to memory and when to the … Read more

How to avoid “CUDA out of memory” in PyTorch

December 30, 2022 by Tarik

Although import torch torch.cuda.empty_cache() provides a good alternative for clearing the occupied cuda memory and we can also manually clear the not in use variables by using, import gc del variables gc.collect() But still after using these commands, the error might appear again because pytorch doesn’t actually clears the memory instead clears the reference to … Read more