In the current Azure portal the deployment credentials can be set by going to App Services → select the relevant app service item → in the Deployment section → Deployment Center → FTP → Dashboard. You can either chose to use the preprovided App Credentials or assign User Credentials.
In the previous generation Azure portal the deployment credentials can be set up by going to WEB APPS → select relevant item → DASHBOARD → Reset your deployment credentials.
Make sure you’re specifying siteName\userName as your login name. The site name portion is required!
The default directory for the web content is \site\wwwroot which can be set as the initial directory for many FTP clients.