The FSF has published its evaluation of the “Llama 3.1 Community License Agreement.” This is not a free software license and you should not use it, nor any software released under it.

Dumb question here, but why shouldn’t I use it? Maybe I’m missing something in the article.

That’s pretty cool. I’ve tried a few of the distills, but I’ve mostly gone back to regular models.

My Mastodon instance disappeared a few weeks ago, so I’m getting a kick out of this post.

And we make it worse by saying “Just pick one. It doesn’t matter what instance you’re on because they’re federated.”

Some people are going to be very upset to find their local feed is a lot of content they don’t agree with. Or when they go out into the fediverse and people automatically assume they’re an A-hole because of the instance they’re from. I mean, it’s generally not that bad, but there are a few instances that are that bad.

And for people like me who gravitate toward smaller instances, that instance is probably gonna die. Happened to me twice already, 4 times if you count Mastodon and Peertube.

ASUS’ website has the 128Gb version at $2,800.

I guess if I get REALLY bored, I might do a fresh install and load up legacy drivers just to see what the performance is like with the old cards. It would be interesting to see how they stack up to the Vega APU.

I’m not going to actually use these cards, just trying them out for the heck of it.

I saw the SR+RoadCraft package on Steam. I might check it out.

😁

I’m still playing Mudrunner. Is there a big difference?

I mean I don’t really see the point here.

There isn’t one. I guess I should have made that more clear. Sorry. 🫤

And I’m not sure if I’m missing something …

Nope, just a guy with too much time on his hands. I mean, I hope someone out there found it a little informative. There are a lot of people thinking “If Ollama doesn’t work then I’m out of luck.” I’m just trying to let people know there are other options.

Yes, the Nvidia cards get 30+ t/s together or individually, but the point of this was to see if AMD and Nvidia could work together. Now that this works, I might actually buy an AMD GPU.

No, I didn’t change my drivers at all. I figured it would probably work with older drivers. But then the problem is my 4060 won’t work with anything older than 545(I think).

I do have another PC I could put the 770 in. That might be worth trying.

It just kills me to have these old cards sitting around doing nothing. The 770 was kind of a beast in its time. But that’s life.

I guess I could donate them to some Peertuber who does retro videos or something.

A few pics of them in their heyday (ok, they were already past their prime at the time)

I’ve read you can force the new Vulkan Driver on it with some kernel flags.

Not gonna lie, that sounds beyond my scope. Once I got llama.cpp compiled, everything just worked. I would have no idea how to troubleshoot anything.

I saw a video where someone got the new Indiana Jones running on a Vega 64, so there’s really no telling what’s possible on AMD hardware. They put so much effort into designing chips, but so little into supporting them.

My laptop (RX 7600s) gets more tokens/sec in Vulkan than in ROCm. I don’t know what that’s all about.

I agree with CameronDev, not so much on the capacity, but the bandwidth. At 100+ Gb, the Ryzen/Core platforms are really holding you back with their weak I/O.

If you need that much memory, you might be better off picking up a used Xeon/Epyc from Ebay. Their CPU speeds are lower, but the quad channel RAM could make up for it, depending on what you’re trying to do.

😄

I’ll wait and see what they come out with. If I wanted to buy AMD, I’d just get a 7600 XT for $360 or so.

I’ve already got 3 Nvidia cards, so I’d need a real incentive from AMD to switch.

How about you?

That would be nice, but I’m not hopeful. I’ve pretty much given up on the higher-mid-range. I bought a 4060ti last year at MSRP, but now they’re $700+.

I think I’m just going to buy more 3060s. They’re plentiful and selling at MSRP, plus I’ve already got a PCIe extender setup.

Mastodon is still confusing to me. But that’s probably because I’ve never been on Twitter, FB, Insta, etc.

One day it was the 18th largest Lemmy instance, then it just disappeared. No word from the owner or anything.

https://tchncs.de/en/ has a pretty good landing page.

It’s not so focused on the US. I live in the US and I’m getting tired of hearing about us.