Programmer Humor

I will now attempt a full comment ... brace your hard drives

I smell something, but it's not overheating electronics.

I've processed over 5 million records on a laptop that's almost 10 years old. it took two days to get my results.

there's no way 60,000 records overheated ANYTHING.

I'm a data engineer that processes 2 billion row 3000 column datasets every day, and I open shit in Excel with more than 60k rows. What the hell is this chick talking about?

60k rows of anything will be pulled into the file cache and do very little work on the drive. Possibly none after the first read.

When the only thing that is stopping kids from dismantling your government is an O(N^N) algorithm

“I store my records on vinyl. You’ve probably never heard of them.”

From the same group that doesn't understand joins and thinks nobody uses SQL this is hardly surprising .

Probably got an LLM running locally and asking it to get data which is then running 10 level deep sub queries to achieve what 2 inner joins would in a fraction of the time.

my hard drive overheated

So, this means they either have a local copy on disk of whatever database they're querying, or they're dumping a remote db to disk at some point before/during/after their query, right?

Either way, I have just one question - why?

Edit: found the thread with a more in-depth explanation elsewhere in the thread: https://xcancel.com/DataRepublican/status/1900593377370087648#m

So yeah, she's apparently toting around an external hard drive with a copy of the "multiple terabytes" large US spending database, running queries against it, then dumping the 60k-row result set to CSV for further processing.

I'm still confused at what point the external drive overheats, even if she is doing all this in a "hot humid" hotel room that she can't run any fans I guess because her kids were asleep?

But like, all of that just adds more questions, and doesn't really answer the first one - why?

Wow.

I've been processing a couple of billion rows of data on my machine, the fans didn't even come on. WTF are they teaching "experts" these days, or has Elmo only hired people who claim that they can "wrangle data" and say "yes" ?

60k isn't that much, I frequently run scripts against multiple hundreds of thousands at work. Wtf is he doing? Did he duplicate the government database onto his 2015 MacBook Air?

As a reasonably experienced "data guy," this seems obviously laughable, but the discussion on X is scary. This guy is a savior in the MAGA world.

We can criticize and poke fun all day, but it doesn't matter much if our message isn't challenging the mindset of those with other opinions.

How do we make better use of our time to impact outside opinion?

Hard drive was made by Tesla

I didn't know hard drive overheating was a thing. Should I be worried that my 5 year old hard drive is about to overheat. I mean is this actually a floppy disk or something?

I cannot believe these people make more than me lol.

This shit sounds like when your mom tells you that the Facebook printed out her bank statement on the fax machine. I'm not smart enough to even guess how you did something dumb enough to make that happen.

How bad are you at writing queries? How does your hard drive overheat even under 100% load? Do you have it smothered under a blanket? Did you crack it up and expose it to cheeto dust? What does running a query on your, presumably, remote database even have to do with your harddrive in the first place? Are you trying to copy the entire database locally to a laptop? Do you know how to tie your shoes yet, or are you still on the velcro?