I have those switches set-up correctly. And they are working fine either way (I mean I get volume differences when i set them adversely). So I don't think it is a hardware problem. I think the core of the problem  is using dual inputs and a mono output. 

 But I'd like to read Achaput's opinion on all this.