LateralEntry

For local LLM - Mac Studio M5 max with 128gb memory or ultra with 96gb memory?

What’s more important, speed or memory? Does the extra speed really make a difference? Does the extra 32gb of memory really make a difference?

I want to be able to run good models like 27b with long context window at good speeds. Capability to run 70b models would be great.

And yeah, I know 256gb would be even better, but it’s way out of budget.

I work at a small law firm and we want to train a local model based on our writing samples, maybe 100 pages of our best stuff, so the model can act as a paralegal that emulates our reasoning and writing.

The problem is… our IT department is run by a fucking idiot who hardly knows anything about tech. And that person is me.

So I was wondering for anyone who has done LoRA training. What kind of results can I expect? I’ll probably do Gemma 26b. I’m currently running a RTX 5080 but thinking of switching to Mac Studio 128gb, is that powerful enough for the LoRA training? What’s the process like, is it easy to do for someone without much coding background (I assume in unsloth studio)?

When it’s

Anyone watching the new Season 5 of Fauda on Netflix? It’s really good!

For those who don’t know, it’s an Israeli show about a team of undercover agents who speak perfect Arabic. They infiltrate Palestinian terror groups like Hamas, and other terror groups like ISIS and Hezbollah, to gather intel, make arrests and thwart attacks. Very intense, lots of exciting action and moral gravity.

The new season is about a retired member of the team whose family was murdered on Oct 7. The killers are now living happily in France, and he goes on an unsanctioned revenge mission. It also covers antisemitism in Europe, the Palestine protest movement, and what happens when naive westerner supporters meet

Do access points and routers powered by Power over Ethernet run hotter than AP’s plugged into a normal outlet?

I recently added a PoE AP to my home network and it’s significantly hotter than my existing AP’s, which all plug into the wall. This AP runs at least 10 degrees Fahrenheit hotter. However, my sample size is 1, so I’m wondering if this is generally true or just this particular model.

I’m intrigued by PoE but don’t want to add significant heat my home. Whats your experience?

You know, mocking them, repeating things they say back in a high-pitched voice, making snide remarks about them to colleagues. Any time they try to call me out on it, I just claim they’re being rude to me out of nowhere for no reason.

So far, my bullying is going great. If anyone asks, my claim is that I’m trying to toughen this person up and show them how to grow a thick skin in this rough industry. But really, I’m just a huge jerk with a hole inside because my parents were mean to me, and I like to take it out on others.

Please feel free to share any bullying tips or ideas here. Thanks, and have a day as nice as you are!

One thing about re-watching this show that’s surprising, in addition to all the misogyny and gay jokes that have aged poorly… is the big money numbers. They seem kind of quaint today.

For example, in Season 2, Vince buys Marlon Brando’s old mansion for $5mm. Obviously $5mm is still a lot of money, but the actual house apparently sold for almost $25mm last year. $5mm might buy you just a regular house in the nicer parts of LA today.

When Warner Bros gives Vince a $1mm bonus for Aquaman, it’s not quite as eye-watering today.

Good news! Someone here made a post a few days ago about a blatantly antisemitic and vile game that went on sale on Steam this week, the post is here:

https://www.reddit.com/r/Jewish/comments/1uaw3qp/antisemitic\_game\_is\_on\_steam/

A bunch of people reported it to Steam, including me, and I got a string of dismissive responses from Valve.

That pissed me off. So I did some research and found that Valve HQ is in the congressional district of Representative Kim Schrier, who sits on the Congressional Jewish Caucus.

I reached out to her office, along with my local congressman and senators, with screenshots from the Steam listing. They responded quickly and asked me for follow up info, and i

Has anyone replaced the stock front intake fans on Fractal North XL pc case?

I want to replace the three front fans, but it looks like I’d have to take apart the whole PC to get access to anything other than the top fan. Is that true, or is the front fan bracket somehow removable?

…I miss them. Hardly any rain in months, no meaningful rain in the forecast, whole state in moderate to severe drought.

Climate change sucks. I hate limiting my shower time.

Hope we get some rain.

Wondering if anyone has played this mod for Hades 2? It looks amazing, but I’d have to buy Hades 1 on Steam to play it (currently only have Hades 1 on Xbox).

The mod idea is that you can play as Melinoe through the world of Hades 1. My question is, is this a mod where you play a few runs and you’re done? Or does it actually change the game where it’s worth a new playthrough? Ultimately I’d like to play through the game with a fresh save that feels new, wondering if this scratches the itch.

Thanks!

When I first moved from an apartment to a house, it felt like a giant mansion. But now, with a couple kids, pets and the accumulation of junk, it’s starting to feel cramped again.

What did you do that made your house feel bigger? Actually adding space, like finishing a basement or creating an addition? Cleaning and decluttering? Adding a closet? Marie Kondo-ing the whole place? Something else? What worked for you?

When I first moved from an apartment to a house, it felt like a giant mansion. But now, with a couple kids, pets and the accumulation of junk, it’s starting to feel cramped again.

What did you do that made your house feel bigger? Actually adding space, like finishing a basement or creating an addition? Cleaning and decluttering? Adding a closet? Marie Kondo-ing the whole place? Something else? What worked for you?