Just formally declared as fixed.
Most of the time they are DNS issues
99% of the time the issues are down to a change going wrong.
Donât even get me started when people start fucking about with BGP, that can and has taken down huge chunks of the interwebs.
2 Likes
Not this time - issue was with one of their bot-mitigation services. It is however something that sits right across their entire edge network service.
yep, havenât bothered looking what the root cause was but itâs normally DNS 
A Cloudflare spokesperson told The Register : "We saw a spike in unusual traffic to one of Cloudflareâs services beginning at 1120 UTC.
A Cloudflare spokesperson told The Register that the incident began at 1120 UTC and was fully resolved at 1430. They said: "The root cause of the outage was a configuration file that is automatically generated to manage threat traffic. The file grew beyond an expected size of entries and triggered a crash in the software system that handles traffic for a number of Cloudflareâs services.
"To be clear, there is no evidence that this was the result of an attack or caused by malicious activity.
Whatâs worse admitting your platform designed to protect people from attacks is vulnerable to attacks or saying it was design errors?
Fallen foul to similar issues to this, but not one than took down a global system. At least AI coding is learning off the worlds highest quality services so nothing to worry about going forward.
This is the new reality with everyoneâs eggs in one big cloudy basket. BCM has been forgotten about as cloud canât fail, my arse. A prolonged outage to MS Teams will fck so many companies and more importantly, CNI like hospitals and health services right up. They use it for voice, ccommunication, meetings and links to documentation. It will come and when it does there will be a lot of CEOs being asked where the fck was your BCP? Eh we had a comprehensive BCP channel in teams will be the answer.
At my last place there was a legendary tale of an engineer migrating all the exchange accounts and mail to a new exchange server and had a script that copied everything across.
Dopey fucker got the source and destination wrong and migrated zero mailboxes from the new system to old system wiping out 1200 mailboxes.
Then took them 3 months to restore them from tape backups 
Being the civil service they promoted him to a management role to stop him touching stuff.
1 Like
Also some of those big cloudy baskets are considered to be the best/only option. This was a whole discussion point at one of our incident meetings related to todayâs issues. Cloudflare is considered best protector, and the amount of work to configure any alternative was deemed a big piece of work/very complex. Also to implement would likely take longer than likely outage.
Glad I donât have too many more years in this game.
Oh shit, that sounds a nightmare. Perhaps that explains why I am in a management role.
Yep, can think of plenty of MIâs caused by poorly scripted stuff.
1 Like
New head of IT at the coastguard
âwe spend too much money on blue light comms we can just use MS Teams for voice and MS dynamics for the incident managementâ
Me
âI wonât be renewing my contract.â
3 Likes
Is that the Director who will be gone in 2-3 years, cashing in on their amazing insight they brought to the public sector, whilst returning to the private sector for more dosh. Never seen that cycle happen with MDâs and CTOâs with the same regularity as a MS outage that never ever provides a proper root cause.
3 Likes
4 Likes
3 Likes
Ummfuckingwhat?
This is AI.
AI is trained on the contents of the internet.
In shocking news today it is revealed that as well as the internet containing mostly âdumb shiteâ (shite written by dumb people) there is also a surprising amount of âdishonest shiteâ (shite written by people pretending to be other people largely, it seems, for the purpose of fooling the dumb and thereby being paid).
In my prayers tonight I will ask the Lord not to allow AI ever to be put in charge of anything. Not anything at all. Not ever. Please. Particularly not children.
1 Like
âŚand we all know that lazy parents - the sort who used to see the telly as an unpaid childminder - who now expect teachers and entry-level smartphones to do their parenting for them, are definitely not gonna let Pedobear-AI raise the withered fruit of their rancid loins, right?
Thoughts & prayers from me, too 
2 Likes
Last quarter I rolled out Microsoft Copilot to 4,000 employees.
$30 per seat per month.
$1.4 million annually.
I called it âdigital transformation.â
The board loved that phrase.
They approved it in eleven minutes.
No one asked what it would actually do.
Including me.
I told everyone it would â10x productivity.â
Thatâs not a real number.
But it sounds like one.
HR asked how weâd measure the 10x.
I said weâd âleverage analytics dashboards.â
They stopped asking.
Three months later I checked the usage reports.
47 people had opened it.
12 had used it more than once.
One of them was me.
I used it to summarize an email I could have read in 30 seconds.
It took 45 seconds.
Plus the time it took to fix the hallucinations.
But I called it a âpilot success.â
Success means the pilot didnât visibly fail.
The CFO asked about ROI.
I showed him a graph.
The graph went up and to the right.
It measured âAI enablement.â
I made that metric up.
He nodded approvingly.
Weâre âAI-enabledâ now.
I donât know what that means.
But itâs in our investor deck.
A senior developer asked why we didnât use Claude or ChatGPT.
I said we needed âenterprise-grade security.â
He asked what that meant.
I said âcompliance.â
He asked which compliance.
I said âall of them.â
He looked skeptical.
I scheduled him for a âcareer development conversation.â
He stopped asking questions.
Microsoft sent a case study team.
They wanted to feature us as a success story.
I told them we âsaved 40,000 hours.â
I calculated that number by multiplying employees by a number I made up.
They didnât verify it.
They never do.
Now weâre on Microsoftâs website.
âGlobal enterprise achieves 40,000 hours of productivity gains with Copilot.â
The CEO shared it on LinkedIn.
He got 3,000 likes.
Heâs never used Copilot.
None of the executives have.
We have an exemption.
âStrategic focus requires minimal digital distraction.â
I wrote that policy.
The licenses renew next month.
Iâm requesting an expansion.
5,000 more seats.
We havenât used the first 4,000.
But this time weâll âdrive adoption.â
Adoption means mandatory training.
Training means a 45-minute webinar no one watches.
But completion will be tracked.
Completion is a metric.
Metrics go in dashboards.
Dashboards go in board presentations.
Board presentations get me promoted.
Iâll be SVP by Q3.
I still donât know what Copilot does.
But I know what itâs for.
Itâs for showing weâre âinvesting in AI.â
Investment means spending.
Spending means commitment.
Commitment means weâre serious about the future.
The future is whatever I say it is.
As long as the graph goes up and to the right.
10 Likes
Pinched that to share with fellow skeptics/old school IT colleagues at work.
1 Like