coedude

So i just got up and running with ollama and i was wondering about resource management. My system has 384gb of ram and my gpu has 32gb of ram. If i am running a large model that wont fit exclusively in vram am i better off disabling my gpu via the environment variable CUDA_VISIBLE_DEVICES or will ollama manage my resources accordingly? Does it support heterogeneous computing? So far it seems like when i run a model too big for my gpu it does run faster with the gpu enabled but i am unsure if that will scale or i am losing precision.

I spent most of the day unsuccessfully trying to host an llm on my linux workstation (fedora 44). I started with docker desktop and once that was running i got the issue that the option to enable model runner was not showing up. Saw that other people experienced that as well and seems they gave up too. So then i decided to use cli instead and i would get the failed to bind port issue every time. So then i installed ollama. Ollama would start the server successfully however it would never see my gpu. I have cuda installed and the drivers are working. Seems to be an issue with how fedora stores files in the /usr/ directory. So i decided to forgo gpu acceleration and just do cpu. After installi

Has anyone on here imported a used made in usa guitar from another country to the US since the recent tariffs? Specifically i purchased a guitar from canada and i believe it being a used guitar originally made in america should make it exempt from tariffs however i dont know much about the process.

Have tried selling in meta mask to no avail. Even small transactions like 1000 coins. Anyone know what to use?