contiguous – Tarik Billa

What does std::vector look like in memory?

May 1, 2023 by Tarik

It roughly looks like this (excuse my MS Paint masterpiece): The std::vector instance you have on the stack is a small object containing a pointer to a heap-allocated buffer, plus some extra variables to keep track of the size and and capacity of the vector. So it seems as though when I push_back() to the … Read more

What does .contiguous() do in PyTorch?

October 25, 2022 by Tarik

There are a few operations on Tensors in PyTorch that do not change the contents of a tensor, but change the way the data is organized. These operations include: narrow(), view(), expand() and transpose() For example: when you call transpose(), PyTorch doesn’t generate a new tensor with a new layout, it just modifies meta information … Read more