I am sure this scenario is not far-fetched at all, and I have given some thought to the changing of scarcity in the future.
Replicating systems of robots will eventually become the norm, so that robots are built and maintained by other robots. Due to the very small size of the nanotech robots, these will almost certainly outnumber the larger robots and machines (machines of the type where you could look at one machine without a microscope and understand it's workings).
Uncluttered / attractively laid-out spaces become scarce, and attention from other people remains relatively scarce. Perhaps "paying [with] attention" will be the basis of the currency of the future.
For example, suppose you create a large park, keep it free of the clutter that others could easily and cheaply put there. You pay for the defence of the park. Perhaps I would offer you one hour of my attention-time in exchange for permission to spend 50 hours relaxing in your park. Perhaps you are wealthy, don't need me to use that attention time on you, so you donate it to a friend, and I sit and listen to your friend, participate in a conversation which I might not choose for my own pleasure, as a way to pay for use of your park.
Another example: perhaps I have thousands of attention-hours owed to me, and I use that to buy into a neighbourhood in which all landowners have agreed to build dwellings and transport routes below ground level, and keep the surface uncluttered to a specified standard, conforming with a theme, with competent arbiters of conformance to thematics and reduction of clutter. I have used attention-currency to buy a home where, above ground, I see water-features, benches, pedestrians and cyclists. No buildings, no motor vehicles, only what I care to see. The seller of the home I bought, can now get thousands of hours of attention from whoever previously owed those to me.
To sum up: uncluttered spaces potentially become scarce (because making stuff becomes cheap), the attention of [other] people remains at current level of scarcity.