Software

Techie pulled an all-nighter that one mistake turned into an all-weekender

Don’t trust your tired self to do rm -rf right


Who, Me? Well, would you look at the calendar? It’s Monday already, and by lunchtime any fond memories of the weekend will have been erased by work worries of the sort The Register celebrates each week in “Who, Me?” – the reader-contributed column that tells your stories of making messes and somehow escaping.

This week, meet a reader we’ll Regomize as “Alejandro” who told us he once worked for a major multinational company and in the early 1990s was trained to perform a mainframe migration project. The plan was to bring a payroll app into the late 20th century by moving from a 1970s-vintage IBM box to a new NCR machine that ran Unix.

To make this happen, Alejandro trained for five weeks and made sure he was confident in Unix, as the old IBM box used one of Big Blue’s ancient Oses.

The project was described as a “remote unboxing” for the NCR machine, an odd term that Alejandro explained by telling us “The system was located about 1,000 miles away, in Colorado, and I had to install and configure all the system and user packages, user home directories, set up system security, initiate databases, inter-system file transfers, and so on.”

To do all that, he needed to use telnet to access the NCR Box. Readers of a certain age will recall that telnet was a tool that allowed remote access to virtual terminals.

Alejandro planned to use two virtual terminals for this job, so fired up telnet on a Friday night and got to work.

“I pulled an all-nighter and by Saturday evening I was done, and it was time to clean up,” he told Who, Me?

At the top of the cleaning list was removing the packages he’d used during the installation process, which Alejandro knew were in a certain directory. With his newfound Unix skills he typed the command he thought would wipe only the temporary files.

But with almost 24 hours of unbroken work behind him, Alejandro was a long way up the directory tree. His rm rf * command was now busy wiping the entire system he’d just built.

“I was really tired and didn't think twice about it,” he told Who, Me? And then the telnet session he was using went pear-shaped.

“It stopped responding and some strange errors were popping up,” he told Who, Me?

The obvious thing to do was check the other telnet session, which he soon saw “was busy deleting files.”

“The memory of the command I had typed returned and I felt the ground sinking below me and my chest tightening,” Alejandro wrote.

Thankfully, Alejandro knew the chap who handled backup tapes in the Colorado office. He reinstalled the OS, leaving Alejandro to once again telnet in and install the apps.

“The job was finished before start of day on Monday and my boss did not fire me,” he recalled. “And I was very happy the weekend was over.”

Have you made a mistake that meant you had to re-do a job? If so, click here to send us an email. The “Who, Me?” mailbag is in a sorry state and could really use your story! ®

Send us news
56 Comments

Untrained techie botched a big hardware sale by breaking client's ERP

'If I wasn't already taking blood pressure meds, I'm sure I would not have survived'

Techie pointed out meetings are pointless, and was punished for it

When asked to offer honest feedback, maybe pause to ponder how well you play office politics

Does this thing run on a 220 V power supply? Oh. That puff of smoke suggests not

That's not even the worst part of this story, which features a flood, broken promises, and plenty of panic

CompSci teacher sets lab task: Accidentally breaking the university

Hey! Teacher! Leave our network alone!

Tired techie botched preventative maintenance he soon learned wasn't needed

Epic late-night road trip would have been awesome if not for a secret change of plans

Developers feared large chaps carrying baseball bats could come to kneecap their ... test account?

A whole different kind of 'technical debt' turned into real-world trouble

Life lesson: Don't delete millions of accounts on the same day you go to the dentist

Or ignore documentation that warns you are about to do something dangerous

Brackets go <i>there</i>? Oops. That’s not where I used them and now things are broken

Weird syntax AND/OR a junior techie can be very bad for business

Coder wrote a bug so bad security guards wanted a word when he arrived at work

Working for a startup is supposed to end with getting rich overnight, but not like this

Panic at the Cisco tech, thanks to ancient IOS syntax helper that outsmarted itself

Misplaced shortcut led to communication breakdown

NetAdmin learns that wooden chocks, unlike swipe cards, open doors when networks can't

Burglary skills are surprisingly important when building networks

Network engineer chose humiliation over a night on the datacenter floor

To avoid lock-in, it helps if you remember your keys