Shoes like that may be ok with jeans but shorts? No.
If you're wearing shoes and socks with shorts you have a problem.
You might as well get some walk shorts (which you don't see these days, but in some parts of the world, a couple of decades ago, for a short time, were a bit popular.)
Basically cut off suit pants worn with a short sleeve business shirt (if a short sleeve shirt can be called a business shirt) and tie.
Picture Ian Turpy (R.I.P.) in Swift and Shift. (over the womans left shoulder)
Don't forget to get some long socks and business shoes.
Shorts should be worn with sandals or these (sans socks.)