Peoplenomics is still down – when it returns will depend on what happens in Phoenix next.
…your hosting server (az1-ss4-redact) in our Arizona data center) is currently affected by an active incident involving elevated ambient temperatures at the Phoenix data center facility. This platform-level issue is causing reachability and performance issues for servers on that infrastructure, which is why your site and admin login are currently unresponsive. Our operations team is actively working on the Phoenix data center facility issue.
Actually an interesting “lived admin” issue in this. 12 years ago, or longer – I decided to keep Urban and Peoplenomics in separate cities because of just this kind of condition.
As you may be aware storms through Phoenix (it’s hot summer monsoon season there) caused a lot of outages and the Salt River Project and Arizona Public Services have had their crews jumping. On the back side of the t-storms? Heat and server farm issues. We will keep you posted here.
But the real-life lesson? It was failure-domain separation. Urban and Peoplenomics could both be perfectly healthy applications, but if they sit behind the same power grid, cooling plant, network core, provider control plane, or physical facility, they’re still effectively one bet. Putting them in different cities meant a Phoenix heat/cooling/power event could take PN down but not Urban at the same time. That was theory then. Practicum came knocking today.
“Splitting your hand” – even a dozen years ago – can be a useful continuity tool. Useful to remember with brokers, bankers, and boxes of web content.
EARLIER
From the server surgeons:
Dear Customers, We’re currently responding to an emergency caused by a power outage at our Phoenix datacenter. As a result, the following services may be affected: We’re also experiencing an issue with our support helpdesk and are currently unable to assist via live chat. You can still reach our Customer Support Team via Microsoft Teams .
We would like to inform you about the upcoming software maintenance that will take place on Thursday, August 13, at 3:00 AM EDT | 07:00 UTC. Affected servers: Regular: 360, 362, 364 Maintenance window: 8 hours.Expected downtime: up to 10 minutes twice.Impact: the affected server will be unavailable during the downtime. Once maintenance starts, we will update you
This may impact both Urban and Peoplenomics today…
~ure
Damm G-pops !
sounds like its rub-a dub-in-the HOTUB time…too HOT in the hottub!
James Brown Celebrity Hottub-https://youtu.be/yAJnpaFRrlw?
With temps down Ure way set to spike into next week, should be hot time in Phoenix, as usual Aridzona in August.
“Peoplenomics is still down – when it returns will depend on what happens in Phoenix next.”
Glen Campbell – By The Time I Get To Phoenix
https://m.youtube.com/watch?v=aMb681nTLIo&list=RDaMb681nTLIo&start_radio=1&pp=ygUvZ2xlbiBjYW1wYmVsbCBieSB0aGUgdGltZSBpIGdldCB0byBwaG9lbml4IGxpdmWgBwE%3D
hmm . AI is lost . circus time . ringling bros from mississipi . brace yourselves
re: “Hoot”, 2006
feat: partially filmed in Fort Lauderdale
Let’s chill out and climb four corporate stepped thermals above darkened Phoenix servers for a bird’s eye view. Avian UV lenses engaged for possible invisible red ink?
Does the Park Avenue parent have an alleged $25+ billion data centre deal with Meta? Is $750 million allegedly being raised this month from an “expanded high-grade debt offering”? Will a 5% redemption cap limit allegedly imposed upon existing parent funds’ woo woo spooked clientele stem congestion at exits?
As chance might have it, didn’t George call something like this a while back?
Seriously – I know Winnipeg is hard to beat in the summer. But even the odd itinerant Canuck will find fall-winter-spring alongd the New River (our fave part of Laundrydale) especially up around the railroad bridge and riverside eateries (with passable sfish (grouper in lieu of cad) chips. Why, if we hadn’t been dialing back the ETOH (as an aging mileage extender) and were still back in our (think Andy rabbit-age youth), we’d be back in Lauderdale and upriver as the ultimate hurricane hideyhole for rag boaters,,, if we could just dig up El Dorado in the back 40 somewhere…
Spent my whole professional life in IT. 14 years at Huhtamaki in network ops and 13 years senior IT engineer at Comcast. Retired ten years ago at 57. It’s all going to unravel soon enough. Been a nice ride though.
Yeah – on the docket for Sept/October weill be tehe definitive updatre to my 2012 book Broken Web: which was on the coming collapse of the internet. Got a lot righet – but lots ofs missed calls, too.
Grab you Reiman rectangle estimates, your failure modes from the integral developing from outages and server farms, and the end will be along soonlish – I am just waiting for fiber here so I can swing DNS to a local server here instead of a hellenized phoenofarm
My sister lives just outside Phoenix. Her and my Bro in law live in an RV trailer. They used to travel and just wintered there. They are doing OK for now but may have to find cooler digs temporarily. When I spoke to her today she was a little freaky since they cannot stray far from the VA hospital so I did not give her any crap about living someplace where people have to wear oven mitts to open their car doors.
Here at the ranch we lost one of the controllers in the greenhouse, The second is limping along and may be damaged as well. Seems to possibly be a combination of heat and humidity and a utility problem. Both of our UPS in the house dropped off line while main power dropped off and on. It came back up around sundown. The COOP has no explanation……..yet. All our backups held.
Stay safe and cool. 73
Head north! Arizona’s “Mormon highlands” may be cold as hell in the winter, but seriously, up around Mormon Lakes are (on the diagonal, north of Payson up toward Flagstaff…hard to be that with a stick – especially if you don’t mind (god-awful tiny) trout bones… High in Snowflake was 82F…Show Low was 73!!! What are they doing in the Valley? Miss an IQ check, or what>?>>>
They used to manage campgrounds during the summers and wintered in Benson then both of their health went south making them take residence close to a VA hospital, don’t get me started on that. A few years ago BIL said he would never spend another winter in Missouri. Get rid of that damn cracker box and get into a home or condo for Pete’s sake.
I like Payson myself but I hear it’s pretty pricey now. Spent some time at Fort Huachuka and really liked it there. 50 years ago, sheesh.
Ah – ft. we-gotcha!
Those who have never lived full-time in a “cracker box” (RV or a boat) will never know the freedom of living in a box with wheels. It’s a perfect example of “whatever you own, owns you.” The fewer things you have to maintain, the freer you are. Unfortunately, I had to forsake my nomad life to live in a box WITHOUT wheels, and I’m not sure I’ve yet recovered from that blow. The only disadvantage to such a life is that it’s not suitable for prepping, and prepping is a MUST at this point in time.
For the more than a decade I lived aboard, that was my thinking, too. Post 9/11 though, the police state mechanisms deployed/ For example big tri-=engine offshore RIB boats when I was leisurely sailing at 4 1/2 knots ion light air. Kinda takes the buzz off.
As for the RV side, you haven’t been through many interstate “checkpoints” have you> The mythos is there but it ain’t what it used to be. Freedom is being nibble-in from the edges.
re: PN Atlanta
feat: Resurgens
George,
Welcome back. The motto of Atlanta is “Resurgens (Latin for ‘rising again’, alluding to the phoenix)” says Wikipedia.
Interestingly although the current PN hostname seems to be pointing to Atlanta, the nearest data centre infrastructure would appear to be in Fort Lauderdale.
When you know people – and they are super-smart….