My setup is exactly the same for the consoles I have on SCART, but I still have a few on component as well. Ultimately it doesn’t matter which I use in my setup, as the SCART goes through a Shinybow to convert to Component anyway.
I do find it a very slight pain to have two separate outputs of Component video, so I have to switch inputs on the TV. I would like to do a loopback of one Component, into the switch, and back out the other output. Ii’s doable, but you have to connect to the switch with an RS232 connection and do some custom configurations. I bought the cable, but haven’t dug into making it work yet.