memory – Page 2 – Tarik Billa

RuntimeError: CUDA out of memory. How can I set max_split_size_mb?

February 18, 2024 by Tarik

The max_split_size_mb configuration value can be set as an environment variable. The exact syntax is documented, but in short: The behavior of caching allocator can be controlled via environment variable PYTORCH_CUDA_ALLOC_CONF. The format is PYTORCH_CUDA_ALLOC_CONF=<option>:<value>,<option2>:<value2>… Available options: … max_split_size_mb prevents the allocator from splitting blocks larger than this size (in MB). This can help prevent … Read more

How to access data that an offset of a register in gdb?

January 7, 2024 by Tarik

x/16xb $edx+0x14 The +0x14 will give you what you are looking for.

Why does std::unordered_map have a reserve method?

January 7, 2024 by Tarik

The unordered_map container has a reserve method because it is implemented using buckets, and not a tree as in map. A bucket is: a slot in the container’s internal hash table to which elements are assigned based on the hash value of their key. Buckets are numbered from 0 to (bucket_count-1). (source) A single bucket … Read more

Java using up far more memory than allocated with -Xmx

January 6, 2024 by Tarik

Top command reflects the total amount of memory used by the Java application. This includes among other things: A basic memory overhead of the JVM itself the heap space (bounded with -Xmx) The permanent generation space (-XX:MaxPermSize – not standard in all JVMs) threads stack space (-Xss per stack) which may grow significantly depending on … Read more

-Xms: Initial heap size or minimum heap size?

January 6, 2024 by Tarik

The initial heap size is the minimum heap size. It won’t get smaller than the initial heap size. From Tuning Garbage Collection with the 5.0 Java[tm] Virtual Machine: By default, the virtual machine grows or shrinks the heap at each collection to try to keep the proportion of free space to live objects at each … Read more

what’s ARM TCM memory

January 6, 2024 by Tarik

TCM, Tightly-Coupled Memory is one (or multiple) small, dedicated memory region that as the name implies is very close to the CPU. The main benefit of it is, that the CPU can access the TCM every cycle. Contrary to the ordinary memory there is no cache involved which makes all memory accesses predictable. The main … Read more

How does the internal implementation of memcpy work?

January 5, 2024 by Tarik

Depends. In general, you couldn’t physically copy anything larger than the largest usable register in a single cycle, but that’s not really how machines work these days. In practice, you really care less about what the CPU is doing and more about the characteristics of DRAM. The memory hierarchy of the machine is going to … Read more

Haskell recursion and memory usage

January 4, 2024 by Tarik

Don’t worry quite so much about the stack. There is nothing fundamental that says function calls have to be implemented using stack frames; that is merely one possible technique for implementing them. Even when you have “the stack”, there’s certainly nothing that says the stack has to be limited to a small fraction of available … Read more

ESP32: Best way to store data frequently?

January 2, 2024 by Tarik

That’s a great question that I wish more people would ask. ESP32s use NOR flash storage, which is usually rated for between 10,000 to 100,000 write cycles (100,000 seems to be the standard these days). Flash can’t write single bytes; instead of writes a “page” of bytes, which I believe is 256 bytes. So each … Read more

How is read-only memory implemented in C?

January 2, 2024 by Tarik

That’s not a feature of the C language but a feature of the compiler/linker and the operating system working together. When you compile such code the following happens: The compiler will put the string into a read-only data-section. The linker collects all the data in such read-only sections and puts them into a single segment. … Read more