It’s necessary for my very important hobby of generating anime nudes.

  • ornery_chemist@mander.xyz
    0·
    1 year ago

    Man I just built a new rig last November and went with nvidia specifically to run some niche scientific computing software that only targets CUDA. It took a bit of effort to get it to play nice, but it at least runs pretty well. Unfortunately, now I’m trying to update to KDE6 and play games and boy howdy are there graphics glitches. I really wish HPC academics would ditch CUDA for GPU acceleration, and maybe ifort + mkl while they’re at it.

      • wurstgulasch3000@lemmy.world
        0·
        1 year ago

        I mean the barrier of entry is kind of high if you’re used to more traditional package managers.

        Source: I tried using nix on my Debian machine

        • JovialSodium@lemmy.sdf.org
          0·
          1 year ago

          There’s definitely a steep initial learning curve as you observed and dialing in your configuration is time consuming in my experience but once you’ve got things the way you like, it’s pretty smooth sailing from there.

          Edit: removed compared to arch references. Not relevant to the comment.

          • Pyro@lemmy.worldEnglish
            0·
            1 year ago

            As someone who tried NixOS recently for the first time, it feels like an uphill battle.

            Some immediate concerns I have as a newbie are below. Bear in mind that I’m a single user on a single system.

            Organisation is daunting as fuck
            Even a relatively simple desktop config seems rather large to me. I expect the complexity of my config to balloon if I were to use this as my primary OS. There seems to be no consensus on how things should be separated.
            I’ve heard home-manager is good, but I don’t really get the point of it. What does it achieve for me that editing configuration.nix doesn’t? I’ve yet to find a benefit. It’s just another place to dump endless configs and another command to remember to run.

            Installing software feels like the roll of a dice
            I installed NixOS to try Hyprland, and their docs say to just use programs.hyprland.enable = true, which I’ve come to learn is a module. But that’s not the only way to install things! You also have system packages and user packages! I just want to install some software, I don’t want to have to look up whether it’s a module or a package every time I want something new. I’m never sure what I should add to which section. No other distro that I know of has this problem! Having 3 different places to add software seems excessive. What am I using? Windows? And now there’s Flakes too. I’m sure they’re great, but right now I just see them as yet another way to install software on Nix. Great.

            There’s more, but I’ll leave it there for now. I’m sure there are reasonable answers to all that I’ve said, but I’m just frustrated. I really want to like Nix, but it’s not making it easy.

            tl;dr: Two things. 1) Lack of consensus on how configs are organised is confusing. 2) Having 3 different ways of installing software (modules/packages/flakes) does not feel better than apt install or pacman -Syu etc.

            • Euphoma@lemmy.mlEnglish
              0·
              1 year ago

              Nix is a programming language, so you have to organize your configuration yourself like you would for any programming project, usually by splitting it into multiple files. Also you can search system modules on the same page that you search for packages though usually there’s not much of an explanation for what it does outside of reading the source code.

              System modules use the package from the repository while enabling some systemd stuff and whatever other options that you will want enabled with it. On a single user system, there is no meaningful difference between system packages and user packages.

              Home-manager can be used to manage files in your home directory, like your configs for apps and stuff. It also can have more module options for apps so you can set up their settings declaratively. Its not for everyone but this is what its supposed to do, outside of your normal nix configuration.

              Nix flakes aren’t a way to install packages, but a way to manage the nix based projects which include nix packages and your nixos configuration and is supposed to make it more reproducible, so its not directly related to installing packages. However if a package for something isn’t in the repos, someone may make a nix flake for installing and building the package.

              Its understandable that you are having trouble though, because the documentation for nix and nixos is terrible, and it only got better for me once I actually spent time learning the nix programming language.

            • Shareni@programming.dev
              0·
              1 year ago

              Organisation is daunting as fuck

              Read up on modules. It’s obvious you haven’t even googled it.

              I’ve heard home-manager is good, but I don’t really get the point of it. What does it achieve for me that editing configuration.nix doesn’t?

              1. You’re not supposed to use configuration.nix for userland packages. Separation of concerns, and so you don’t need to rebuild all the time.

              2. Declarative package management and configuration

              3. You only need to remember one command to install and update all your packages

              Installing software feels like the roll of a dice

              There are many ways to install a package, and that allows you to chose the one you want to use. Nobody’s forcing you to use the module instead of just the package…

              And now there’s Flakes too. I’m sure they’re great, but right now I just see them as yet another way to install software on Nix. Great.

              You don’t use flakes to install packages. You use them to control the package definitions, pin specific versions, add packages from outside of nixpkgs in a declarative manner, and so on.

              I really want to like Nix, but it’s not making it easy.

              You really want to like Nix, but don’t want to learn basic concepts and instead expect it to behave like every other distro.

              If installing packages is too much for you, give up on nixos and use something else. That’s literally the easiest and most issue free part of using it. You can install hyperland through nix on Debian or whatever distro you want.

              does not feel better than apt install or pacman -Syu etc.

              Yeah, why would anyone want a list of packages they currently have installed. Can’t think of any benefits, nope…

      • xlash123@sh.itjust.works
        0·
        1 year ago

        I mean at this point, people use that phrase themselves, so I don’t think it really makes fun of them anymore.

        I use EndeavorOS, btw

  • Rusty Shackleford@programming.devEnglish
    0·
    1 year ago

    Earlier in my career, I compiled one container with tensorflow with CUDA/cuDNN (NVIDIA) and another with ROCm (AMD) for cancerous tissue detection in computer vision tasks. GPU acceleration in training the model was significantly more performant with NVIDIA libraries.

    It’s not like you can’t train deep neural networks without NVIDIA, but their tensor cores in Turing and beyond make things WAY faster.

    • carl://@upload.chat
      0·
      1 year ago

      I can confirm that it works just fine for me. In my case I’m on Arch Linux btw and a 7900XTX, but it needed a few tweaks:

      - Having xformers installed at all would sometimes break startup of stable-diffusion depending on the fork
      - I had an internal and an external GPU, I want to set HIP_VISIBLE_DEVICE so that it only sees the correct one
      - I had to update torch/torchvision and set HSA_OVERRIDE_GFX_VERSION

      I threw what I did into https://github.com/icedream/sd-multiverse/blob/main/scripts/setup-venv.sh#L381-L386 to test several forks.

    • HakFoo@lemmy.sdf.org
      0·
      1 year ago

      What distro are you using? Been looking for an excuse to strain my 6900XT.

      I started looking at getting it running on Void and it seemed like (at the time) there were a lot of specific version dependencies that made it awkward.

      I suspect the right answer is to spin up a container, but I resent Docker’s licensing BS too much for that. Surely by now there’d be a purpose built live image- write it to a flash drive, reboot, and boom, anime vampire princes hot girls

      • ichbinjasokreativ@lemmy.world
        0·
        1 year ago

        I use stable diffusion on rocm in an ubuntu distrobox container. Super easy to set up and there’s a good guide in the opensuse forum for it.

        • Russ@bitforged.spaceEnglish
          0·
          1 year ago

          That is exactly what I do too and it works perfectly! This is a link to said guide.

          It’s effectively install distrobox, save the config, run distrobox assemble and then distrobox enter rocm and clone the Automatic1111 stable diffusion webui somewhere and run bash webui.sh to launch it.

        • HakFoo@lemmy.sdf.org
          0·
          1 year ago

          I think people don’t like dramatic changes in business model. I had installed it for like 3 days, long before the switchover, to test out something from another dev. When they made the announcements, the hammer went down in our org not to use it. But that didn’t stop them from sending sales-prospecting/vaguely threateningly worded email to me, who has no cheque-writing authority anyway.

          Plus, I’m not a fan of containers.

          STOP DOING CONTAINERS.

          • Machines were not meant to contain other smaller machines.
          • Years of virtualization yet no real-world use found for anything but SNES emulation
          • Wanted to “ship your machine to the end-user” anyway for a laugh? We had a tool for that. It was called “FedEx”.
          • “Yes, Please give me docker compose up meatball-hero of something. Please give me Alpine Linux On Musl of it” – Statements dreamed up by the utterly deranged.

          “Hello, I would like 7.5GB of VM worth of apples please”

          THEY HAVE PLAYED US FOR ABSOLUTE FOOLS.

      • Pumpkin Escobar@lemmy.worldEnglish
        0·
        1 year ago

        If you don’t like docker take a look at containerd and podman. I haven’t done any cuda with podman but it is supposed to work

    • nexussapphire@lemm.eeEnglish
      0·
      1 year ago

      I’m tired of people taking sides like companies give a shit about us. I wouldn’t be surprised to see five comments saying something like “you shouldn’t buy Nvidia AMD is open source” or “you should sell your card and get an amd card.”

      I’d say whatever you have is fine, it’s better for the environment if you keep it for longer anyway. There are soo many people who parrot things without giving much though to an individuals situation or the complexity of a company’s behavior. Every companies job is to maximize profit while minimizing loss.

      Basically if everyone blindly chose AMD over Nvidia the roles would flip and AMD would start doing the things Nvidia is doing to maintain dominance, increase profit, reduce cost and Nvidia would start trying to gain more market share from AMD by opening up, becoming more consumer friendly, competitively priced

      For individuals, selling your old card and buying a new AMD card for the same price will net you with a slower card in general or if you go used there is a good chance it doesn’t work properly and the buyer ghosts you. I should know, I tried to get a used AMD card and it died every time I ran a GPU intensive game.

      I also went the other way upgrading my mother’s Nvidia card with a new AMD card that was three times as expensive as her Nvidia card ($50) would be on eBay and it runs a bit slower than her Nvidia card did. She was happy about the upgrade though because I used that Nvidia card in her movie server resulting in better live video transcoding than a cheap AMD card would.

        • nexussapphire@lemm.eeEnglish
          0·
          1 year ago

          You’d be surprised it happens quite a bit, especially when your trying to help an Nvidia user with technical issues.

          The problems I see people have are kinda trivial and is usually fixed by installing a package or changing a kernel parameter. Stuff you spend a few minutes researching for a half second fix. It’s like saying “Apple pages unintuitive to use? Throw out your MacBook and get a PC!”

          I don’t like MacBooks but I’m not going to tell them to replace it.

        • michaelmrose@lemmy.worldEnglish
          0·
          1 year ago

          A collection of folks ranging from moralizing open source fans, Wayland aficionados, and AMD fanboy. They also like to blame any Linux problem the user might be having on Nvidia use even when the user hasn’t actually mentioned Nvidia. Daughter got chlamydia? Shouldn’t have gone with Nvidia.

  • ByteWelder@lemmy.ml
    0·
    1 year ago

    My only regret for picking team red is that DaVinci Resolve doesn’t support hardware encoding.

  • Diplomjodler@feddit.de
    0·
    1 year ago

    Oh please. There are better templates than this stupid Nazi cunt. I really don’t want to see this fuckface.

  • Holzkohlen@feddit.de
    0·
    1 year ago

    3D rendering with optix. I don’t do AI nonsense other than chatgpt for the occasional shell script or python function.