It looks like in most cases this exception is a client issue. Previous versions of StackExchange.Redis used Win32 socket directly which sometimes has a negative impact. Probably Asp.net internal routing somehow related to it.
The good news is that StackExchange.Redis’s network infra was completely rewritten recently. The last version is 2.0.513. Try it and there is a good chance that your problem will go.