Brief Outage Sep. 4 2021

[GAD]

Sorry about that. Here's how disaster chains work in IT:

~Two months ago: I upgraded the server

Today:
18:30: My wife complains that email isn't working
18:31: I confirm that she's right
18:31: Seems the certificates on my server didn't update automatically
18:35: But they did, and they didn't "take". Weird
18:37: I manually force certificate reload
18:40: I reboot to make sure it works after applying changes
18:44: The server comes back and email is fixed. Yay!
18:45: But no websites run
18:48: Apache (Website server software) Will NOT load
18:52: I bang my head furiously against the keyboard
19:00: I discover that Apache won't load because there's already another webserver running (NGINX). Why? WHY!
19:05: More head-keyboard interfacing
19:10: I kill NGINX
19:12: I start Apache

All is well. Probably.

So what caused this? I *assume* that during the server upgrade some automation somewhere decided that I should be running NGINX and enabled that even though I'm already running Apache.

I hate computers.

 

[walrus]

I hate computers.

And that's why you are in charge!

walrus

 

[chazmo]

SSL certs are such a pain in the patootie... I can't tell you how much grief they've caused us at my company.

I like NGINX, but we do almost all our work with Apache. I wonder why NGINX started on your system like that, GAD. Weird, indeed.

 

[Doons]

Been in the IT biz for 36 years now, I refer to all computers, large and small as FRED…. Fu**ing Retar*ed Electronic Device… it’s never boring and always annoying!

 

[Opsimath]

"Head-keyboard interfacing". That's funny. So is " FRED".

 

[adorshki]

I hate computers.

The best is yet to come.

 

[Nuuska]

http://www.millsworks.net/blog/wp-content/uploads/2009/04/writing_process.gif

 

[LeFinPepere]

Thanks for the word "patootie".I like that one.Can't wait for an opportunity to use it. In my attempts with computer music, I have smashed several keyboards against the trees in the garden..I felt like Daltrey swirling his mike.Nice but temporary relief !!! Then,I had to rake all the letters , buy another keyboard ( and a spare one, just in case!),and I went back to "increment-the-goddam-reverb-on-the-bloody-snare-drum-at- measure-16", thinking: "I don't know why I am doing this, but I'll get you,M*****f*****!"GAD, thanks for making this whole thing work,but , let me ask, what's that printed on your forehead?

 

[gjmalcyon]

"Head-keyboard interfacing". That's funny.

I am shamelessly admitting - in advance, mind you - that I am stealing that.

And there will be no royalties paid.

Perhaps a grudging acknowledgement, at best.

 

[Teleguy61]

Sorry about that. Here's how disaster chains work in IT:

~Two months ago: I upgraded the server

Today:
18:30: My wife complains that email isn't working
18:31: I confirm that she's right
18:31: Seems the certificates on my server didn't update automatically
18:35: But they did, and they didn't "take". Weird
18:37: I manually force certificate reload
18:40: I reboot to make sure it works after applying changes
18:44: The server comes back and email is fixed. Yay!
18:45: But no websites run
18:48: Apache (Website server software) Will NOT load
18:52: I bang my head furiously against the keyboard
19:00: I discover that Apache won't load because there's already another webserver running (NGINX). Why? WHY!
19:05: More head-keyboard interfacing
19:10: I kill NGINX
19:12: I start Apache

All is well. Probably.

So what caused this? I *assume* that during the server upgrade some automation somewhere decided that I should be running NGINX and enabled that even though I'm already running Apache.

I hate computers.

Sometimes technology is not our partner.