Closed. Outage Report
17/03/2009 09:30 – We’re currently experiencing some issues with our Sheffield POPs network connectivity.
17/03/2009 09:53 – Engineers are on-site and investigating the issue which seems to be impacting customers taking Telewest routes (via our Telewest lines).
17/03/2009 10:50 – Services should now be coming back online for some customers.
17/03/2009 11:00 – We seem to be having some residual issues, including expected high mail load, These issues are continued to be investigated.
17/03/2009 11:30 – Mail services should now be returning to normal as after-outage backlog is cleared.
17/03/2009 12:11 – All servers and services are operating as normal however we still have some routing and speed issues for a minority of customers. We are continuing to monitor, isolate, trace and resolve these issues as they occur.
17/03/2009 13:10 – An issue with outbound SMTP for mail.pipeten.co.uk has now been resolved.
17/03/2009 13:25 – There are still a few customers having routing issues to our Sheffield facility.
17/03/2009 14:00 – Thanks to all customers who have responded with the requested information and for those who have confirmed that the issue is no longer present for them.
17/03/2009 15:24 – Further routing changes have been made which should resolve issues for some customers. We are still working on routing issues for customers coming in via our Telewest lines.
17/03/2009 16:45, 20:38, 22:45 and 18/03/2009 02:57, 05:36, 07:27, 10:20, 12:00 – on going – We are *still* working with our connectivity and facilities providers on routing and connectivity issues.
18/03/2009 13:15 – Services to the problematic networks are starting to return, hopefully full normal service should resume within the hour.
18/03/2009 13:45 – All affected services should now be fully back up and running.
18/03/2009 17:30 – All services have been running fine all afternoon and there have not been any further reports of any issues connecting from any other networks. If any customers do still notice anything unusual please contact support via the usual methods.
19/03/2009 12:46 – We have no further reported issues and continue to work with our connectivity providers on a full outage report, future mitigation and procedural review which will be posted here when available.
20/03/2009 14:24 – We are still waiting on suitably detailed outage reports from our connectivity providers, as soon as these are available we will be providing a full report.
A full investigation and report will be posted here as it becomes available.
All my sites are down, is this due to this problem as well? Do you have a rough idea as to when it will be sorted?
The office phone is ringing off the hook and I need to tell my clients something…
i am finding that it is not only POP activity that is down. i cannot access the following websites; http://www.titleresearch.com, http://www.squareball.it, http://www.overflowinggently.com or even http://www.pipeten.com.
Finally, the status site is also unavailable; http://status.pipeten.co.uk/
Hi Carl
I cannot get onto our own site,, nor email,, nor the pipeten homepage !!!!!!!!!!
All my websites and email are down so this issue is also affecting dedicated servers. Also I am unable to access http://www.pipeten.com...
A system where we could be alerted by SMS would be good as I only found out when one of my customers called me.
Hi David,
Please continue checking the blog post for updates which will be posted when available.
Thanks.
Hi Martyn,
POP means “Point Of Presence” in this context.
Thanks.
It’s affecting all my reseller DNS domains too.
Hi Mark,
We recommend http://www.pingdom.com/ or http://www.websitepulse.com/ for the monitoring of your dedicated solution.
Thanks.
Hi Andy,
Yes, it was an issue affecting connectivity for all customers in our Sheffield facility.
Thanks
11:15am and I still cannot access http://www.cooltxt.com, email or my client sites…
Hi Mark,
We’re not seeing any further issues at present other than higher than usual load. Please contact support through the normal methods which should be available.
Thanks.
I can now access all sites mentioned, but have heard from clients elsewhere who cannot. Not sure if that helps anyone, but there you go!
Hi Ryan,
Our international monitoring suggests no connectivity or speed issues from multiple continents/many countries. Please contact support through the usual methods with additional information so we can take a further look for you.
Thanks.
Seems better now, but dnsstuff.com still shows 213.143.3.4 (ns1.pipeten.co.uk) as not responding.
Hi Carl
Still having issues picking up emails, seems extremely slow, how long do you think it will last for?
Thanks
Hi Andy,
There still seems to be some residual issues on certain routes for ns1.pipeten.co.uk and we’re looking into these as a matter of urgency.
Thanks.
Hi Alan,
The mail server itself is nolonger under duress but we do have some routing issues for specific customers which are being looked into at present.
Thanks.
My mail and my website are back, but the website is really slow???
Hi Anselme,
Please keep checking the post for updates.
Thanks.
We still have no access at all to our email through either pop3 or webmail since early this morning.
Should it be coming back anytime soon?
I am still having problems with e-mail (getting errors 0*8004210B and 0*800CCC0B) from my send/receive status e-mail. Internet is also very slow. (I have tried to get onto your main Pipeten website, but connection still not made after 5 mins.
Please advise.
Hi Carl,
Any further news, on the email issues?
Thanks
Hi Alan,
Please check the blog post and provide the information requested if you are still having issues.
Thanks.
Hi Tony,
The blog post is constantly being updated with additional information as it’s available. There are only a very small minority of people affected by the issue at present and those still affected need to provide the additional information requested.
Thanks.
Hi Andrew,
Please check the blog posts for updates and additional requested information.
Thanks.
Hi Matt,
Please check the blog posts for updates and additional requested information.
Thanks.
Ok, haven’t commented until now as I can see you are working on things. Mail server is fine but can’t get website or access http://www.pipeten.com. Are Pipeten aware that there are still problems? This post seems to have gone a bit quiet.
Thanks, Tony
Hello,
When can we expect the report and explanation for the outage?
Hi Jamie,
I would say within the next 24 hours. It’s being written at the moment now that we’ve had most of the necessary meetings, information, etc.
Best Regards,
Carl