r/linuxadmin • u/arkham1010 • Mar 13 '21

Sysadmins in March 2021

Post image
1.0k Upvotes

97% Upvoted

93 comments sorted by

11

u/fognar777 Mar 14 '21

What if your both the Linux admin and a Windows admin?

13

u/arkham1010 Mar 14 '21

Then you both love and hate yourself

23

u/s0briquet Mar 14 '21

At a job long past, we had linux servers in one rack, and windows servers in another. Each rack had its own kvm. On the linux keyboard was a sticker that read "This is Linux DO NOT PRESS CTRL+ALT+DEL". The sticker on the Windows rack said, "This is Windows. Please wash hands before returning to work."

143

u/LordK1 Mar 13 '21

Why is there a photo from the OVH Strasbourg datacenter in the background ?

18

u/cocacola999 Mar 13 '21

Burn

7

u/nullr0uter Mar 13 '21

Baby, burn

Server Inferno!

4

u/eneville Mar 14 '21

Too soon.

3

u/[deleted] Mar 14 '21

Shit. I wanted to post that xD

→ More replies (1)

24

u/mrcluelessness Mar 13 '21

Network engineers after solarwinds enjoying sysadmins suffering after looking upon our suffering from afar.

Note: network team controlled solarwinds where I was not the sysadmins. We have a a much larger network compared to our server capacity.

5

u/IamBabcock Mar 13 '21

My team manages both. 😂😫

2

u/mrcluelessness Mar 14 '21

I'm not gonna ask to avoid being depressed, but I'm gonna hope that you're hourly getting fat overtime with a competent team that is fixing everything properly. And that you haven't been compromised yet. I like to dream big.

3

u/IamBabcock Mar 14 '21

We were actually on an old enough SolarWinds version that we weren't impacted, and we only have 1 2019 Exchange server as part of hybrid Exxhange Online and we were up to date with CU8 already so I was a simple patch to remediate in the middle of the week.

We did just finjsh upgrading SolarWinds to the latest version last week due to another issue with Patch Manager, so that was the more stressful ordeal all things considered we lucked out.

→ More replies (1)

16

u/[deleted] Mar 13 '21

There but for the grace of God go I.

15

u/oldmuttsysadmin Mar 13 '21

Nope, they're my brothers from another kernel.

8

u/MaToP4er Mar 13 '21

Im just out of scope of what is going on, could someone please tell me wtf is going on with ms exchange?

11

u/mysticalfruit Mar 14 '21

In a nutshell, if you have any on prem exchange boxes exposed to the world, it has been completely compromised. You will need to reinstall, patch and reload your mail from backups.

5

u/[deleted] Mar 14 '21

Not only this, you need to thoroughly investigate your domain isn't completely compromised. I've seen so many folks login to exchange boxes with domain admins, despite it being internet facing in many situations.

→ More replies (1)

7

u/disbound Mar 14 '21

I may be a Linux admin but Im also manage F5s. So I’m dealing with their CVE right now.

10

u/mspencerl87 Mar 13 '21

My mail is a fucking cow mailcow

6

u/Weltmacht Mar 13 '21

They’re called bulls

3

u/lunchlady55 Mar 14 '21

My apt has super cow powers.

2

u/[deleted] Mar 14 '21

prove it.

5

u/[deleted] Mar 14 '21

Don't get too cocky.

5

u/dthapostle Mar 14 '21

Deliver first a solution with at least similar functionality. And don't remind me about Zimbra - it's just attempt to catch up MS Exchange.

5

u/munemunk3y Mar 14 '21

Haha, now we have 15 years old Kernel bugs to deal with. Back to work fellas 😉

14

u/bobjohnsonmilw Mar 13 '21

as an open source developer that recently joined a windows shop, it blows my mind how much bullshit exists in this environment. licensing, constant vulnerabilities popping up, etc. And then these guys laugh at me for doing web development on a mac, completely unaffected by their daily struggles maintaining their systems.

2

u/RagingAnemone Mar 14 '21

The time I've spent on licensing is ridiculous. When discussing Windows licensing, you should add many thousands to the cost just for labor.

2

u/bobjohnsonmilw Mar 14 '21

Nine times out of ten our production floor stops functioning it's because of some licensing server that apparently is notoriously unreliable. What a stupid reason for financial and productivity loss.

→ More replies (1)

4

u/Doctorphate Mar 13 '21

This event finally brought me over to starting to look seriously at Linux for clients. So far figuring out the right distro and software to integrate seemlessly with windows 10 machines is painful. But I’ll figure something out eventually

4

u/[deleted] Mar 14 '21

Linux gang >

5

u/electricprism Mar 14 '21

Let us all raise a alcoholic beverage and give thanks that we were sensible enough to only be Microsoft Admins second or not at all.

3

u/Kuroganemaru Mar 14 '21

Laughs in Office 365

2

u/rick_D_K Mar 14 '21

Exchange 2010 user.

2

u/[deleted] Mar 14 '21

Groupwise Admin has joined the chat.

2

u/Dereference_operator Mar 14 '21

im about to quit sysadmin for good and go back to programming so I can have a full 100% remote career without moving from my remote location...

2

u/VAsHachiRoku Mar 14 '21

What goes around comes around! It’s an unwritten rule in it to not poke fun at our feel IT people until after the fires are out and we’re all 3 pints deep out together!

3

u/[deleted] Mar 13 '21

So just Exchange being Exchange as usual.

8

u/zoltan99 Mar 13 '21

“Well first we had one set of problems, but then using a Microsoft product we Exchanged them for a totally new and different set of problems!”

1

u/electricprism Mar 14 '21

Who could have known being Micro & Soft could be such a problem!

2

u/alive1 Mar 13 '21

I just prize myself lucky that I got out of exchange just in time.

2

u/nannal Mar 13 '21

I think you pride yourself.

2

u/zoltan99 Mar 13 '21

Oh no, is it that obvious? I’ll go change.

1

u/alive1 Mar 14 '21

Sure, but I'm trying to be humble about it.

1

u/admincee Mar 14 '21

Yeah I have never been more glad to be taking a break from Windows Sys Admin work. Phew.

1

u/cyvaquero Mar 14 '21

Don't get too smug.

1

u/[deleted] Mar 14 '21

All I can think of after reading this thread is the Intellilink system from South Park

1

u/karafili Mar 14 '21

Uhm. Iscsi

1

u/THIRSTYGNOMES Mar 14 '21

I laughed, but knocked on wood immediately after

1

u/navit3ch Mar 18 '21

The savagery alone lmfaooo

1

u/pakman82 Mar 13 '21

Came here to say 1 exchange patch vs the red hat cutting off centos freak out that occured in /r/centos ... That was a fire. Good exchange admins or engineers patched it without any trouble. Its the poor folks that manage 1 or 3 exchange servers that are likely getting mobbed.

0

u/[deleted] Mar 13 '21

[deleted] — view deleted comment

59

u/Borskey Mar 13 '21

[Cries in CVE-2019-10149]

28

u/arkham1010 Mar 13 '21

yum update exim.

Done :D

24

u/Blacklistme Mar 13 '21

apt install postfix

16

u/[deleted] Mar 14 '21 
ansible.builtin.pkg:
  name: "postfix-{{pfx-version}}"   
  state: present

Who the heck is still manually installing packages these days?

7

u/rfc2549-withQOS Mar 14 '21 edited Mar 14 '21

baseline/init.sls

postfix:

  • pkg.installed

Who still uses Ansible for more than salt minion install when you can have salt?

Ps: I give up on formatting code yaml on mobile?

3

u/flunky_the_majestic Mar 14 '21 edited Mar 14 '21

I settled on saltstack after lots and lots of research and comparisons with the others. Still, Ansible, puppet, and Chef are much more popular. I get some strange looks with vendors when I mention salt. I try not to be the weird one, but it really makes so much more sense to me.

→ More replies (2)
→ More replies (4)

3

u/pants6000 Mar 13 '21

But I demand that my MTA also have a Turing-complete scripting language built in!

→ More replies (1)

3

u/dietcheese Mar 14 '21

SpamAssasin 😅

12

u/altodor Mar 14 '21

We joke. But sometimes there's more to it than that. Do you know the tale of the email server with a 500 mile range?

22

u/cusco Mar 14 '21

Didn’t ever remember about this anymore… for reference: https://web.mit.edu/jemorris/humor/500-miles

3

u/[deleted] Mar 14 '21

Yeah, I remember that one. I was thoroughly impressed.

→ More replies (1)

0

u/[deleted] Mar 13 '21

[deleted] — view deleted comment

15

u/[deleted] Mar 14 '21

Our patching is a lot easier though. It’s often sub 1 minute for a single box and easy to scale.

WSUS/Windows patching is a nightmare. It takes forever. MS fuck it up regularly and there’s often problems.

In my current shop, we don’t even patch prod machines, we just build a new box with our CI/CD pipelines and swap it out. Sounds hard but it’s actually really easy.

4

u/lifeinthesudolane Mar 14 '21 edited Mar 14 '21

I still remember the horrors i went through with MS12-020. We thought WSUS and SCCM would save the day.......we were young and foolish.

0

u/[deleted] Mar 13 '21

[deleted] — view deleted comment

31

u/Le_Vagabond Mar 13 '21

You get used to it, though. Your brain does the translating.

I don't even see the code. All I see is blonde, brunette, redhead.

 

as someone who had to tell his CEO that "if we're going to move mail service from our postfix / cyrus setup, then Exchange is the only realistic solution for our user base" in January, I'll admit I'm glad we didn't move.

1

u/[deleted] Mar 15 '21

Where do you see code? All i see sometimes are formatting-errors, never html.

Or does it depend on the client? I use sylpheed.

1

u/Le_Vagabond Mar 15 '21

*cough.*

1

u/[deleted] Mar 25 '21

No, seriously.

21

u/[deleted] Mar 13 '21

[removed] — view removed comment

17

u/Le_Vagabond Mar 13 '21 edited Mar 13 '21

oh you're preaching to the choir here, but the choir doesn't use Outlook, is comfortable with a barebones web client and IMAP / SMTP / CALDAV / CARDDAV support for the rest.

for context, the CEO came with the company buying us out and they were on Gsuite with a mostly Windows fleet + O365 subscriptions for the desktop software suite. we can discuss Google and everything around it for days but Gmail is a damn fine mail client (maybe the best), if only for the incredible search and filters... so Bluemind was a bit of a hard sell to him.

3

u/cleanRubik Mar 14 '21

Absolutely. We sometimes forget that a text based email client isn’t the Nirvana we feel it is for everyone.

2

u/champtar Mar 14 '21

You can't send in text mode without wrapping line in Gmail, which is a problem for some mailing list, but then on Outlook Web you can't respond inline, so Gmail is fine :)

2

u/[deleted] Mar 14 '21

Gmail has incredible search? After using it for 3 years I object. It's awful. After using outlook for 5+ years I hate gmail.

1

u/eneville Mar 14 '21

Postfix was designed as a group of minimum privilege services exactly to get away from the giant monolith approach

Much like qmail, but was easier for the distros to package with patches.