Use:
git lfs track --filename [file path]
Source: git lfs track --help
–filename
Treat the arguments as literal filenames, not as patterns. Any special glob
characters in the filename will be escaped when writing the .gitattributes
file.
This option has been available since v2.9.0 of the LFS extension (pull request). You can check your local version: git lfs version.