Hi Rob,
The error message we return is the same that is presented when you run the commands from PowerShell (our app is essentially constructing and passing PowerShell commands to SfB). It sounds like one of the pools cannot be contacted for some reason – permissions, network access, or similar. We are not specifically connecting to any server, this is left up to the PowerShell commandlets. The Response Group commandlets seem to try all servers, and this can also hold up loading- do you find this?
I will see if we can do anything further to enhance this experience. We have some related performance work already slated.