Yup; hopefully there are some advances in the training space, but I’d guess that having large quantities of VRAM is always going to be necessary in some capacity for training specifically.
also at beehaw
Yup; hopefully there are some advances in the training space, but I’d guess that having large quantities of VRAM is always going to be necessary in some capacity for training specifically.
Yup; hopefully there are some advances in the training space, but I’d guess that having large quantities of VRAM is always going to be necessary in some capacity for training specifically.
So I’m no expert at running local LLMs, but I did download one (the 7B vicuña model recommended by the LocalLLM subreddit wiki) and try my hand at training a LoRA on some structured data I have.
Based on my experience, the VRAM available to you is going to be way more of a bottleneck than PCIe speeds.
I could barely hold a 7B model in 10 GB of VRAM on my 3080, so 8 GB might be impossible or very tight. IMO to get good results with local models you really have large quantities of VRAM and be using 13B or above models.
Additionally, when you’re training a LoRA the model + training data gets loaded into VRAM. My training dataset wasn’t very large, and even so, I kept running into VRAM constraints with training.
In the end I concluded that in the current state, running a local LLM is an interesting exercise but only great on enthusiast level hardware with loads of VRAM (4090s etc).
Using it to separate work from other uses makes sense to me - I think if I worked from my desktop rather than the company laptop, I’d be more inclined to use the virtual desktops.
Wanting to pin a floating window was always something I wanted on Windows, so I was excited to see that being natively supported by KDE.
Agree on disliking alt-tab because it’s non-deterministic! Cycling through a whole list of apps has always felt clunky to me so I never use it.
I really wish I could load Sway on my desktop… unfortunately I’ve got an Nvidia card and I couldn’t get the live ISO to boot with sway. :<
Very tempting to try it on my laptop though! All the setups I’ve seen using it look really clean.
How far away from your monitor do you sit to see all of the 49”?! It must all be in your peripheral vision, haha. (Edit: oh, I overlooked the ultra wide mention and was picturing a 49” tv type thing, haha. Ultra wide makes more sense!)
I actually went down from two monitors on my desktop to one… nothing wrong with the second monitor now sitting in my closet, but I’m liking the extra space on my desk and it feels more ergonomic to not be swiveling my neck as much.
It’s so interesting the different ways people organize their windows! I have a strong preference for never overlapping windows where possible at home, but on my work computer it happens all the time and I don’t mind. Each window definitely has its own “zone” on the screen though (browser in the upper left, slack in the bottom right, finder in the bottom middle, and so forth).
I’ve accidentally tried to switch workspaces with the i3 shortcuts when on a windows machine before! that muscle mememory, haha.
when I’m booting Windows on my desktop, I use MS PowerToys to snap windows around which gives me the same feeling of nice organization as tiling but feels more intuitive in the Windows environment for me.
Makes sense! I agree laptops tend to be too small for tiling; I don’t really use the tiling part of i3 on my laptop very much - usually only to pop open a terminal window on the side that I close after a few minutes.
I appreciate this point of view! My BA is in visual arts, but I’ve also leaned heavily into tech, programming as a hobby, etc.
I think there’s a lot of different topical threads at play when it comes to AI art (classism and fine art, what average viewers vs trained viewers find appealing in a visual medium, etc) – but the economic issue that you point out are really key. Many artists rely on their craft for their literal bodily survival, so AI art is very much a real threat to them.
But, when I first interacted with Midjourney, and seeing my mom (just an average lady) being excited about AI generated art, I can’t help but see it like photography – all of a sudden the average person gets access to a way of visually capturing things that make them happy, that they think look cool, something they saw in a dream but didn’t have the skill to create visually… and that doesn’t sound like an inherently bad thing to me.
That’s helpful; this sounds like a docker issue or qBit issue then. The default qBit location for torrents is /downloads, but you’d need to make sure to point it towards the container volume mapping you’re setting up in docker.
my relevant qBittorrent compose volume mapping is as follows:
volumes:
- /volume1/shared/torrents:/data/torrents
Personally, I don’t separate my torrent downloads by type; I use incoming & completed folders. Here’s how I set up my qBittorrent config:
Original Value | New Value |
---|---|
Session\DefaultSavePath=/downloads/ | Session\DefaultSavePath=/data/torrents/1_completed/ |
Session\TempPath=/downloads/incomplete/ | Session\TempPath=/data/torrents/2_incoming/ |
Downloads\SavePath=/downloads/ | Downloads\SavePath=/data/torrents/1_completed/ |
Downloads\TempPath=/downloads/incomplete/ | Downloads\TempPath=/data/torrents/2_incoming/ |
This should just be part of configuring Sonarr/Radarr settings correctly. Do you have a red message in the settings that says a download client is missing, or have you filled out the download clients settings section with your torrent client info? If yes, have you checked the “auto import from client” box? and, have you set your root library folder in the media management section?
Never heard of them, but just looking at a registrar comparison chart, their renewal costs are pretty high. eg. $20 for .wiki
renewal at Porkbun and $30 at Hover. Maybe they bundle in a lot of services along with it that make the price worth it? but unless you’re taking full advantage of those (if they’re offered) then you could def get a better deal elsewhere.
For me it was really the price of domain renewals. Namecheap has great starting deals, but eg. I have a .studio
domain and it costs $28.16 to renew at Namecheap and $21.09 at Porkbun. My .xyz
domain costs $9.92 to renew at Porkbun, $14.16 at Namecheap. (Registrar comparison chart here.)
In terms of pure price, Cloudflare is cheaper to renew for all the domains I have, but Porkbun is only a dollar or two off and I like supporting a smaller company. Edit: Porkbun offers free SSL which is nice if you don’t feel like bothering with LetsEncrypt yourself.
(Also, I find Namecheap’s domain management console absolutely horrible to work with in terms of UI.)
Namecheap has okay starting prices but man their renewal prices aren’t great compared to other registrars.
I just transferred all my domains out of Namecheap into Porkbun. I think Porkbun is 10 to 50 cents more expensive than Cloudflare, but they seemed a bit easier to use and could hold all my TLDs. So far, a way better experience than Namecheap!
You can use this docker container with gluetun to use ProtonVPN’s port forwarding.
And from falcoignis:
Just remember that to get port forwarding over openvpn on proton you have to add +pmp to the end of your assigned openvpn username
Cool! I’ve used Svelte a little bit for a personal project, but I’m more on the programming hobby side vs pro dev side so not sure what help I’d be. Will bookmark and keep in mind though!
I don’t know anything about GPU design but expandable VRAM is a really interesting idea. Feels too consumer friendly for Nvidia and maybe even AMD though.