Today the service was down for2.5 hours due to the Network incident that was related to unexpected IP address changes for all our servers on Amazon AWS.
Despite having the dedicated addresses, Amazon for some reason suddenly changed them, so we lost connections with our other services including DB.
It took time to find the route reason and apply changes to all connection points.
We're in touch with the Amazon team to understand why it was changed, despite our contract conditions to prevent such cases in the future.
All reports were run but with delay because of the incident.
Please, take our apologies and sorry for such inconvenience.
We'll do our best to avoid it in the future.
Unfortunately, we're experiencing a series of incidents today.
The first one had started 3 hours ago. The Standuply service lost connection between our Amazon instances and cloud database Mongo Atlas and wasn't able to reconnect all that time.
When we were figuring out and trying to fix the issue with the Mongo support team, Slack events API was automatically disabled for the app, because the service can't get API events from Slack. That's a usual procedure.
More than 1 hour ago Mongo resolved the connection error but we're not able to turn on back the API events for the app for some unknown reason.
We're in touch right now with the Slack team and they are looking for the problem to resolve it.
Unfortunately, we can only wait because can't control this module at all.
The whole our team is on and we'll find the solution and fix everything for sure, but it can take a few more hours of downtime.
Please, take our apologies for such inconvenience.
We're doing our best.
Thanks for your patience and understanding,
We've just got the update from Slack team that they fixed the problem with events API and we've been able to restart it for our app.
Standuply is stable right now and all components work properly.
Sorry again for the inconvenience, despite on the root of the incidents wasn't on our end, it's our fail for sure .
We'll do the retrospective tomorrow to understand can we be able to prevent the same cases in the future somehow, because today is 3am for our dev team. 😴😴😴
Thanks for your understanding. 🙏🙏🙏
We want to make you aware that this Friday (04/24) from 10 pm PST to 2 am PST (04/25), there will be scheduled downtime of service.
We will be using this time to add more capacity to our infrastructure and speed up overall service.
To ensure uptime and stability of the platform, we are performing this upgrade during this weekend so we can ensure a smooth transition.
Today many tech companies provide solutions to help us in the current unprecedented time.
We, at Standuply, are also joining this movement.
We’ve built a unique workflow to run company-wide surveys to check on people’s health conditions, travels, and contacts with travelers.
Of course, it’s FREE for any team size during the pandemic.
Here’s how it works:
- you create a report in Standuply with the unique flow and questions;
- then Standuply asks your team members every week questions like “Did anyone you’re in close contact with traveled last week?” or “Do you feel any of those symptoms?”, etc.;
- only the list of people answered “Yes” is shared with the responsible person to take action It means you can survey thousands of people and don’t get flooded with hundreds of ‘no’ and only focus on ‘yes’ cases.
We hope it will make a positive impact and encourage other companies to provide their solutions to fight with the pandemic.
Stay well and wash hands often.
We've got already joined hundreds of great, experienced experts in different areas: development and engineering, product and project management, marketing and sales, enterprise and scaling, startups and grows and so on.
Each of them has a proven and validated profile. ✔️✔️✔️
To let you meet the Mentors better, Standuply starts the RAFFLE. 🎁🎁🎁
Leave the comment under this post with the Mentor name and your Standuply-account associated email and:
🏆 First 10 users will be credited on 100% to ask the selected mentor a question;
🏆🏆 The next 20 users will get the credit for 50% of the Mentor's price;
🏆🏆🏆 The last 30 users will get a discount of 25%.
Share the offer within your team to let your team members get a world-class education. That's what the real manager should care about and we'll do it for you on behalf Standupply - A Digital Assistant for Project Management. 📚📚📚
Hurry up, the offer is limited and it's going to be sold out very quickly.
Thanks for subscribing!
Check your inbox to verify your email