Do index names have to be unique across entire database in Mysql?

Yes you can use same index name for both the tables.

CREATE [UNIQUE|FULLTEXT|SPATIAL] INDEX IDnum
[index_type]
ON tbl_name (index_col_name,…)
[index_type]