I found the reason why it’s not working on this question:
HTML5 video will not loop
Our server doesn’t understand partial content right now.
As a result chrome is sending requests for content that doesn’t get answered which in turn makes our video’s and audio unseekable (and unloopable).