After upgrading to .NET 5 I forgot to include the reference in _Host.cshtml in my Blazor Server project. Thanks for pointing it out in the question above 🙂
Including the reference fixes the problem:
<link href="AssemblyName.styles.css" rel="stylesheet">