An overnight process got into a loop that caused emails to be sent repeatedly for approximately 5 hours before it was caught and stopped. Two separate protections have already been added to the codebase to guard against this from ever happening again.
Approximately 10% of the businesses that use our platform were impacted (thankfully, 90% were not!) and in most cases only one or two clients received the barrage of emails (thankfully not a large number of clients per business). While the scope was somewhat contained, the impact to clients that did receive 80-90 emails was terrible, and we are deeply sorry about this.
This sounds canned, but we really do take this stuff very seriously. We'll be holding a meeting with the technical staff to dig into this deeper and to see if there are other changes that need to be made.
To those that were impacted by this morning's email problem, please accept our deepest apologies.