How can I find all public comments for a Github user?

You can do this with an advanced search query. In the Issues search box, enter “commenter:username“.

Or if you want to search a specific repo: “RepositoryName commenter:username“.