And I just stumbled onto something that helped me figure it out.
Just in case anyone wants to know
In your Startup.ConfigureServices
services.AddMvc().AddJsonOptions(options =>
{
options.SerializerSettings.DateTimeZoneHandling = DateTimeZoneHandling.Utc;
});