I’m not using remote containers, just local once, so not sure if this applies but for locally running containers, you can go to the “Docker” tab (you need to install the official Microsoft Docker VS Code Plugin) where you can see your running containers. Just right-click on the container you want to see the logs for and select “View Logs”:
You’ll see a new “Task” appear in the Terminal pane that will show all your docker logs: