Is there with_fileglob that works remotely in ansible?

Use find module to filter the files and then process the resulting list:

- name: Get files on remote machine
  find:
    paths: /path/on/remote
  register: my_find

- debug:
    var: item.path
  with_items: "{{ my_find.files }}"