Update - Mail has been flowing for about a week now, however some domains still remain throttled or delivery delayed, for instance qq.com. We've escalated to their IT team.
Apr 17, 12:55 UTC
Apr 17, 12:55 UTC
Update - Most delays in mail should be mitigated, however the mail queue is still very large. We're continuing to monitor for the time being.
Apr 11, 13:47 UTC
Apr 11, 13:47 UTC
Update - Outgoing apache.org mail is known to be delayed to yahoo.com and outlook.com destinations due to IP reputation. We have opened cases with both companies. Due to the size of the queue, incoming mail is also delayed.
Apr 8, 20:13 UTC
Apr 8, 20:13 UTC
Update - Mail delivery is still delayed while the queue catches up and our IP builds a good mail reputation. Pretty soon, we'll have enough street cred to take on other mail servers in a battle royale style cage match. This current process can take a few hours and in some cases a day or more.
Apr 8, 02:36 UTC
Apr 8, 02:36 UTC
Update - We're continuing to monitor the new mail server. The mail queue is increasing, but that's likely due to a backup running. Current errors are related to CNAME lookups, but they will resolve with time. Yahoo users might see increased bounced/blocked mail. Fluxo's curry was burnt, it was a total loss.
Apr 7, 18:55 UTC
Apr 7, 18:55 UTC
Monitoring - Basic functionality has now been restored and we will be monitoring the service as it catches up again. We will assess the situation and incident in the coming days and deliver a postmortem once we have gathered sufficient information.
Apr 7, 06:43 UTC
Apr 7, 06:43 UTC
Update - We are currently working on implementing emergency protocols for restoring the mail service. ETA 1-2 hours for service to be restored. Some additional work may be required in the coming days to address issues with auxiliary services.
Apr 7, 06:17 UTC
Apr 7, 06:17 UTC
Identified - We have identified the issue and are working to restore services. No ETA as of yet.
Apr 7, 02:16 UTC
Apr 7, 02:16 UTC
Investigating - Due to a hardware fault, mail delivery to our mailing lists is currently experiencing delays. We are investigating, and will update this notice as we progress.
Apr 7, 00:39 UTC
Apr 7, 00:39 UTC
About This Site
We do more than 7 million weekly checks to ensure that our services are always up and running.
Comments? Suggestions? Let us know at: users@infra.apache.org!
You can always contact us on Slack too! - Slack #asfinfra channel
For historical uptime charts please look at the NodePing Report
While updates on this site are posted to Twitter, feel free to follow Infrabot for updates.
External Infrastructure Services
Operational
AWS EC2 US East (Virginia)
Operational
AWS EC2 US West 2 (Oregon)
Operational
Bintray Downloads
Operational
Datadog Metrics Pipeline
Operational
GitHub
Operational
Google Cloud Platform Google Compute Engine
Operational
PagerDuty Events API
Operational
Travis CI Mac Builds
Operational
Travis CI Web App
Operational
Slack Messaging
Operational
Slack Login/SSO
Operational
Slack Connections
Operational
Slack Workspace/Org Administration
Operational
Travis CI Linux and Windows Builds
Operational
Internal Infrastructure Services
Operational
Infra On Call
Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
had a major outage
had a partial outage