Limiting Memory Use in a *Large* Django QuerySet
What about using django core’s Paginator and Page objects documented here: https://docs.djangoproject.com/en/dev/topics/pagination/ Something like this: from django.core.paginator import Paginator from djangoapp.models import SomeModel paginator = Paginator(SomeModel.objects.all(), 1000) # chunks of 1000 for page_idx in range(1, paginator.num_pages): for row in paginator.page(page_idx).object_list: # here you can do what you want with the row print “done processing page … Read more