When wasps become a problem
Sure, wasps offer real benefits outdoors, but a nest in the wrong spot changes the equation fast. Problems tend to show up when a colony builds close to doors, windows, patios, or anywhere people spend time, since wasps become far more defensive near an active nest.
A single nest can hold dozens to hundreds of wasps by mid-summer, and disturbing it, even by accident, can trigger multiple stings.
Nests built inside wall voids, attics, or sheds are also a concern, since they're easy to miss until the colony has grown large and the wasps have already established regular flight paths in and out of the space. At that point, removing the nest becomes trickier and riskier to attempt without the right training and equipment.