Proeliata

u/Proeliata


r/LocalLLaMA•

I'm new to all this LLM stuff and I've been trying to see if I can adapt the Hugging Face language modeling example to use MPT-7B, but it runs out of memory on the training step basically no matter what I do--in regular Colab, using Colab Pro, and using various configurations of GPUs in RunPod (I've tried pods ranging from one 40GB A100 to 4 80GB A100s).

Has anyone fine-tuned MPT-7B successfully? What system configuration did you use? Did you have to do anything special in code, like using PyTorch's DistributedDataParallel or anything in that vein?

13

r/gardening•

https://i.imgur.com/OmjDG8i.jpg

I planted this fig tree a couple of months ago and although at first the leaves looked good, the new ones have been increasingly more yellowed. I water it once a week, about five gallons at a time, a couple of times if the weather is above 90 during the day for several days. It grows in pretty much full sun (until probably about 5pm during the summer). I am in zone 8B.

I realize the photo makes it look like there is grass underneath it, but that's just clippings, I've kept the area around it pretty clear of grass, there is a border and I also weed regularly.

The soil around it is pretty heavy clay, but we filled in better soil in a hole around 18 inches dia

30

r/askscience•

My friend and I had a conversation the other day that surfaced a longstanding confusion of mine. We had roasted some potatoes wrapped in aluminum foil in a campfire, and a few were left over. The next day as we were packing up, she said that we probably shouldn't eat those as she had heard that someone died of botulism poisoning after eating a baked potato. I said that sounded a bit like an urban myth, but some Googling unearthed that this does seem to have happened at least once. My questions are mostly about the "anaerobic environment" part of the required conditions:

  1. I had always understood this to mean that the food item needs to be cut off from the air completely. Will foil-wrappin
18


r/IWantOut•

Hey guys,

I'm a 28 year old software engineer, thinking of moving to a northernwestern-ish (read: no Spain/Italy/Greece or Eastern Europe) European country. I probably wouldn't be able to move for another 2 years (waiting for my husband to get his US citizenship first; I'm already a citizen). How hard would this be to achieve? Am I in a good field for this? Anything I can put in motion now to help me with this goal later?

1737