[go: up one dir, main page]

Recent posts
Timeline view of events on our network and systems

Events from the AAISP network from the last few months on a scrollable timeline. Mouseover for brief details, click incident to view the full post.

MAINTENANCE Assumed Completed IRC
AFFECTING
IRC
STARTED
Oct 26, 10:00 AM (4¼ days ago)
DESCRIPTION
[minor] We run a pool of three IRC servers, and usually have two live at any one time. One of these IRC servers is being rebooted on Sunday midday as part maintenance at the hosting provider - it's not in DNS at the moment but IRC clients will still be connected to it and may well drop and reconnect on Sunday.

MINOR Open AWS
AFFECTING
AWS
STARTED
Oct 23, 09:45 AM (7¼ days ago)
DESCRIPTION
We've had reports of customers having problems routing to some IPs within Amazon

MAJOR Closed CityFibre
AFFECTED
CityFibre
STARTED
Oct 22, 09:55 PM (7¾ days ago)
CLOSED
Oct 22, 10:22 PM (7¾ days ago)
DESCRIPTION
We are investigating a problem with our CityFibre services.
Resolution: We do apologise for this outage. We are looking into making our interconnect to CityFibre more resilient.

MINOR Closed VoIP
AFFECTED
VoIP
STARTED
Oct 15, 11:00 AM (15¼ days ago)
CLOSED
Oct 17, 05:00 PM (13 days ago)
DESCRIPTION
Some customers have been experiencing irregular phone call behaviour - such as when incoming calls are set to ring multiple phones, some phones carry on ringing after the call has been successfully answered elsewhere.
Resolution: Some call and registration failures have been the result of slow back-end systems. We have made various optimisations and code changes which have been working well throughout the day (Friday). We also have avenues for further improvements which we be implemented in the near future. We do apologise to those who had calls disrupted due to this.

MAINTENANCE Completed Network
AFFECTING
Network
STARTED
Oct 09, 01:00 AM (21½ days ago)
CLOSED
Oct 22, 09:02 AM (8¼ days ago)
DESCRIPTION

We'll be performing routine overnight software upgrades on our pool of LNSs and BGP routers, starting Thursday 9th October. One LNS will be done per night, and this involves moving lines between the LNSs and upgrading when lines have been moved off. Customers may see a PPP drop and reconnect in the early hours of the morning as this work is carried out.

Upgrades to our BGP routers will also happen overnight but should have little to no impact. Resolution: This work has been completed.


MINOR Closed BT
AFFECTED
BT
STARTED
Oct 03, 05:30 AM (27½ days ago)
CLOSED
Oct 03, 05:35 AM (27½ days ago)
DESCRIPTION

Between 5AM and 5:30AM we saw a reasonable number of BT SoGEA lines drop for around 100 seconds and reconnect.

They only dropped off once, but over a period of around 30 minutes we saw a few hundred drop and reconnect. As far as we can see the only common factor is that they are BT SoGEA lines. We don't have any planned work notifications for work on this scale, and the sites are dotted around the country.


Resolution: These lines were migrated from VDSL to SoGEA two days ago and we suspect this could be a normal, automatic, DLM resync event.

MAINTENANCE Completed authoritative DNS
AFFECTING
authoritative DNS
STARTED
Jun 03, 10:35 AM (1¼ years ago)
CLOSED
Jun 05, 01:04 PM (4¾ months ago)
DESCRIPTION

This is only relevant to customers who run their own authoritative DNS servers and use our secondary-dns.co.uk as an additional nameserver.

Overview: We run a "secondary" DNS service for customers where they run the master DNS server and we are secondary slaves. We have a project underway that involves migrating all our authoritative DNS services to a new platform. As part of this we are needing to disable some of the automation we do for adding and updating the customer's master IP address automatically.

The change: From June 17th, If you run your own master DNS server for your domain(s) and secondary-dns.co.uk is a slave, if you change the IP address of your master you will need to contact support@aa.net.uk to request us to update our side.

We have more information about our Authoritative DNS project on our Support Site: https://support.aa.net.uk/New_Authoritive_DNS


Resolution: