The file won’t be deleted automatically, from the JavaDoc:

This method provides only part of a temporary-file facility. To
arrange for a file created by this method to be deleted automatically,
use the deleteOnExit() method.

So you have to explicitly call deleteOnExit():

Requests that the file or directory denoted by this abstract pathname
be deleted when the virtual machine terminates.