Android backup to Google account on multiple devices

I have multiple Android devices, and if I have a new device, after signing in with a Google account, I don't get a choice on which device's backup I want to restore. Google seems to pick one for me and it may not be what I want. Is there a way for this process to be controlled by the user?