The primary reference “Microsoft.CSharp”, which is a framework assembly, could not be resolved in the currently targeted framework

In most/all project templates in VS 2010 for .NET 4, the Microsoft.CSharp assembly reference is added. So when you created the project you were given this assembly reference automatically. You shouldn’t have any problems just removing the reference.