GZip every file separately

You can use gzip *

Note:

• This will zip each file individually and DELETE the original.
• Use -k (--keep) option to keep the original files.
• This may not work if you have a huge number of files due to limits of the shell
• To run gzip in parallel see @MarkSetchell’s answer below.