Try using the --verbose option to see what actually happens. Even if you did small changes, some internal things might cause git to push a lot more data.
Have a look at git gc. It cleans up your local repository and might speed up things, depending on you issue. Backup strongly advised.