The plans for two sites mirroring each other, each with one static caravan, a pitch for a touring caravan, and an L-shaped stable building and day room, faced objection from three neighbouring parish councils.
The proposals, and a subsequent planning application, were declined and lost at appeal.
An enforcement notice was then issued by Wiltshire Council in 2024, and appealed against.
This week the planning inspector found in favour of the council.
Mr Bowers will be allowed to keep ponies, which are part of his trade and of his Gypsy heritage, the inspector added.