Got this on an app that has previously worked and I definately knew everything was installed on my local PC.

The problem was that the Web tab of Properties had a url set in project Url that was pointing to a live site (which I usually have redirected in the hosts file to 127.0.0.1). Pressing debug, the project was trying to connect to that live site, which obviously doesn't have remote debugger installed and was failing.

Simples! Just added the entry back into the hosts file so VS can connect to the debugger on the local machine and we're all good again.