Do Upenn and columbia have a physics major?

Yes, pretty much every 4-year college does. However, UPenns program is not well-known for physics - Cornell, Penn State, SUNY Stony Brook would be better choices, especially if you plan to continue on to grad school in physics.