Major plans for solar panels at an Oxfordshire town's leisure centre are set to be decided, despite an objection from a neighbour.