Switching GPUs

I wanted to know if I could possibly change gpus without physically swapping them out (having two gpus in my pc). Right now I have an rtx 2070 but I want to buy an rx 560 for gpu acceleration. Is this possible?