I don’t know if there’s special concerns with RDLC files, but here’s the general approach for making sure other files get published.
Right click the file in the solution explorer, select Properties. Set the “Build Action” to “Content”, and “Copy to output Directory to “Copy if newer”.
Go to the project properties->Publish page. Hit “Application Files Button”, check “Show all files”. Set the “Publish Status” to “Include (auto)”
File Properties
Application Files