Okay, I went out on the Internet and checked to make sure my keycaps were in fact in the right locations when I started this. Well, even if they weren't the keyboard needs some serious cleaning, and maybe some paint on the metal frame to ensure rust doesn't spread.
But if I want > I get :
I believe it is only when I use shift, but I could be remembering wrong, would one of the chips (there is a MOS and a TI) cause this issue, or would something else this. The 1 key at the top left needs the switch cleaned, but the number and letter keys work as they should.