This always sounds great but it's been a disaster everywhere it's been tried.
The problem becomes rotten fruit. Ripe fruit falls off the tree unpicked, particularly when most of it becomes ripe at the same time and it's more than the neighborhood can eat. Then it ferments and rots and brings bugs and disease.
Not to mention crab apples suck to eat.