Seems I found the solution. I hadn’t properly noticed the keyAt(index) function.
So I’ll go with something like this:
for(int i = 0; i < sparseArray.size(); i++) {
int key = sparseArray.keyAt(i);
// get the object by the key.
Object obj = sparseArray.get(key);
}