No. Keep swapping the interconnects, don't try what you're proposing, it won't work well even if the unused component is off or unplugged from the wall. There was another thread about this general question not too long ago that went into some more detail on what Kal says, which you might find in the archives (although I don't know what you'd search under), but anyway that's the deal.