Off-and-on trying out an account over at @[email protected] due to scraping bots bogging down lemmy.today to the point of near-unusability.
Also, when you talk about fsck, what could be good options for this to check the drive?
I’ve never used proxmox, so I can’t advise how to do so via the UI it provides. As a general Linux approach, though, if you’re copying from a source Linux filesystem, it should be possible to unmount it — or boot from a live boot Linux CD, if that filesystem is required to run the system — and then just run fsck /dev/sda1 or whatever the filesystem device is.
I’d suspect that too. Try just reading from the source drive or just writing to the destination drive and see which causes the problems. Could also be a corrupt filesystem; probably not a bad idea to try to fsck it.
IME, on a failing disk, you can get I/O blocking as the system retries, but it usually won’t freeze the system unless your swap partition/file is on that drive. Then, as soon as the kernel goes to pull something from swap on the failing drive, everything blocks. If you have a way to view the kernel log (e.g. you’re looking at a Linux console or have serial access or something else that keeps working), you’ll probably see kernel log messages. Might try swapoff -a before doing the rsync to disable swap.
At first I was under suspicion was temperature.
I’ve never had it happen, but it is possible for heat to cause issues for hard drives; I’m assuming that OP is checking CPU temperature. If you’ve ever copied the contents of a full disk, the case will tend to get pretty toasty. I don’t know if the firmware will slow down operation to keep temperature sane — all the rotational drives I’ve used in the past have had temperature sensors, so I’d think that it would. Could try aiming a fan at the things. I doubt that that’s it, though.
GPU prices are coming to earth
https://lemmy.today/post/42588975
Nvidia reportedly no longer supplying VRAM to its GPU board partners in response to memory crunch — rumor claims vendors will only get the die, forced to source memory on their own
If that’s true, I doubt that they’re going to be coming to earth for long.
Prices rarely, if ever, go down in a meaningful degree.
Prices on memory have virtually always gone down, and at a rapid pace.
https://ourworldindata.org/grapher/historical-cost-of-computer-memory-and-storage
If consumers aren’t going to or are much less likely to upgrade, then that affects demand from them, and one would expect manufacturers to follow what consumers demand.
If you have or can create a LoRA trained on images of the character you’re presenting, that may be helpful. Or if you have a checkpoint model trained on that character. Would be like having a character that the base model is trained on.
I remember when it wasn’t uncommon to buy a prebuilt system and then immediately upgrade its memory with third party DIMMs to avoid paying the PC manufacturer’s premium on memory. Seeing that price relationship becoming inverted is a little bonkers. Though IIRC Framework’s memory-on-prebuilt-systems didn’t have much of a premium.
I also wonder if it will push the market further towards systems with soldered memory or on-core memory.
You can have applications where wall clock tine time is not all that critical but large model size is valuable, or where a model is very sparse, so does little computation relative to the size of the model, but for the major applications, like today’s generative AI chatbots, I think that that’s correct.
Last I looked, a few days ago on Google Shopping, you could still find some retailers that had stock of DDR5 (I was looking at 2x16GB, and you may want more than that) and hadn’t jacked their prices up, but if you’re going to buy, I would not wait longer, because if they haven’t been cleaned out by now, I expect that they will be soon.
My limited experience is that stable characters across a number of images are a weakness today, and I wouldn’t be confident that genAI is a great way to go about it. If you want to try it, here’s what I’d go with:
If you can get images with consistent outlines via some other route, you can try using ControlNet to do the rest of the image.
If you just need slight variations on a particular image, you can use inpainting to regenerate the relevant portions (e.g. an image with a series of different expressions).
If you want to work from a prompt, try picking a real-life person or character as a starting point, that may help, as models have been trained on them. Best is if you can get them at once point in time (e.g. “actor in popularmovie”). If you have a character description that you’re slapping into each prompt, only describe elements that are actually visible in a given image.
I’ve found that a consistent theme is something that is much more achievable, in that you can add “by <artist name>” to your prompt terms for any artist that the model has been trained on a number of images from. If you’re using a model that supports prompt term weighting (e.g. Stable Diffusion), you can increase the weight here to increase the strength of the effect. Flux doesn’t support prompt term weighting (though it’s really aimed at photographic images anyway). It’s possible to blend multiple artists or genres as prompt terms.
Thanks for the added insights! I haven’t used it myself, so appreciated.
Linux has a second, similar “compressed memory” feature called zswap. This guy has used both, and thinks that if someone is using a system with NVMe, that zswap is preferable.
https://linuxblog.io/zswap-better-than-zram/
Based on his take, zram is probably a better choice for that rotational-disk Celeron, but if you’re running Cities: Skylines on newer hardware, I’m wondering if zswap might be more advantageous.
https://en.wikipedia.org/wiki/Apple_II
The original retail price of the computer was US$1,298 (equivalent to $6,700 in 2024)[18][19] with 4 KB of RAM and US$2,638 (equivalent to $13,700 in 2024) with the maximum 48 KB of RAM.
Few people actually need a full 48KB of RAM, but if you have an extra $6k lying around, it can be awfully nice.
TECO’s kinda-sorta emacs’s parent in sorta the same way that ed kinda-sorta is vi’s parent.
I compiled and tried out a Linux port the other day due to a discussion on editors we were having on the Threadiverse, so was ready to mind. Similar interface to ed, also designed to run on teletypes.
It’s a compressed RAM drive being used as swap backing. The kernel’s already got the functionality to have multiple tiers of priority for storage; this just leverages that. Like, you have uncompressed memory, it gets exhausted and you push some out to compressed memory, that gets exhausted and you push it out to swap on NVMe or something, etc.
Kinda like RAM Doubler of yesteryear, same sort of thing.
https://en.wikipedia.org/wiki/Zram
zram, formerly called compcache, is a Linux kernel module for creating a compressed block device in RAM, i.e. a RAM disk with on-the-fly disk compression. The block device created with zram can then be used for swap or as general-purpose RAM disk. The two most common uses for zram are for the storage of temporary files (/tmp) and as a swap device. Initially, zram had only the latter function, hence the original name “compcache” (“compressed cache”). Unlike swap, zram only uses 0.1% of the maximum size of the disk when not in use.[1]
Open-source RAM is better.
Many text editors today just load the whole file into RAM.
been the case for decades
One data point: emacs normally loads the whole file, unless you’re using the vlf package or similar.
TECO and ed might not. Dunno.
Another user in the BlueSky thread showed a photo that appears to be a Best Buy case of RAM, showing a 32GB set of two DDR5 DIMMs going for over $400 USD, a 64GB kit for over $900.
If I hit Google Shopping, which indexes a ton of retailer sites, I can find 2x16GB DDR5 DIMMs for far less than that at various retailers that haven’t jacked up prices yet.
https://www.google.com/shopping?udm=28
My first hit for “2x16gb 32gb ddr5” sorted by price is this:
https://pcpartshawaii.com/products/kingston-fury-ddr5-32gb-2x16gb-5200mhz-cl40-ram
Kingston Fury DDR5 32GB (2x16GB) 5600MHz CL40 RAM KF556C40BBK2-32
$100.00
They say that they have two in stock.
These guys are next lowest:
https://www.barcodediscount.com/catalog/kingston/part-kcp548us8k2-32.htm
Price: $103.06
I don’t know, haven’t used it. I’d imagine that if a service somewhere blocks VPNs, that it is liable to also block someone who is providing free IPv6 tunnels, as from their standpoint, it’d have a similar effect.
From my /etc/resolv.conf on Debian trixie, which isn’t using openresolv:
I mean, if you want to just write a static resolv.conf, I don’t think that you normally need to have it flagged immutable. You just put the text file you want in place of the symlink.