Some Exalted Orbs can drop from certain Divination Cards, like Abandoned Wealth Wealth, the Hoarder, which can drop in different maps, farming on those locations may ostensibly gain the orbs.
Orbs are what every Exile needs in their backpack, as the benefits to your in-game strength and finances can be astounding thanks to these little round currency balls.