As of 15th August, 2022, The answer is No.
They won’t allow it. So the billing will continue for your Azure Database starting the day you create it. There really is no way to pause / stop billing for your Azure SQL Database.
Official Source: feedback.azure.com Please add ability to temporarily turn off/on SQL Azure server to pause billing
Microsoft’s official answer appears to be “Yes, you can export your database. Delete the Azure SQL database and that will pause billing. Then when you need it you can create a new database and import your previously expored DB.”
I don’t believe this is acceptable as an answer for “Allow me to temporarily turn off SQL Server to save on my billing”
