Why? What would “Pasta Robles” even means? Robles has no meaning in Italian and doesn’t even sound like Italian at all … :)

Llama CPP can run models offloading with CPU (es MoE models), you have much more control over how you run your models, and overall it’s very much actively developed.

For starters and people without too much willingness to mess up with stuff, ollama is a great choice. Llama.cpp gives you that extra power and flexibility that is so much worth for people who like to tweak and do more.

My personal opinion, of course. But based on having used both and ditched ollama for llama.cpp, so I am also biased, keep in mind.

But I will hardly go back to ollama now :)

Every use case is different and there is when you can customize it being Linux.

So good, sladapt your swappines and/or ditch swap completely or try zram, according to your needs. Standard use case works fine for most people tough.

Here is my experience https://wiki.gardiol.org/7-services/llamacpp

No ads no monetization just a wiki I keep for my future reference.

Never been happier than moving to llamacpp from ollama.

As a suggestion, ditch ollama and setup llama.cpp. it will work fine with openwebui and it’s much more efficient. (Unrelated to the ram/swap issue)

You can enable zram and remove your on disk swap file if you prefer to spare the SSD write cycles…

That is expected and a good thing.

Free ram is wasted ram, so every file touched by any service will be cached and cache will stay there until ram is needed. This means that over time cache and buffers will always grow, because any subsequent access to those will be faster. The moment more ram is needed by programs, those buffers and cache will be freed immediately.

This is also the reason why some swap will be used even if there is free ram. Some stuff and pages can be swapped out without impact on performance.

Look at it this way: free ram is a wasted opportunity to increase performance by caching some file from disk.

Does this app run in a browser or on a server?

How is this self hosted? Seems a desktop application

Thanks! Corrected.

This comes up every time GIMP is mentioned. To be honest, outside US and UK (and few others) for the rest of the world the word GIMP has no negative meaning (no meaning at all). So, yeah, maybe who cares about the name? Well, change it if it’s really a problem. But, is it really a problem?

Fair point is GIMP (GNU Image Manipulation Program) doesn’t sound as a reasonable acronym. I would maybe find a better acronym, but changing the name itself feels like changing the name of the town of Bra in Italy or the town of Fuck in Austria, or why not, even the town of Love in Sweden… Good luck if we need to only find and use names that do not offend anybody in any language of the world.

Krita, the main FOSS competitor to GIMP, feels a much worse sounding name to me. By the way, i read GIMP with a soft G (like a j) not even as English speakers do pronounce it.

I own a few orange berry pi.

Nice boards.

A few OPi zero+ and an OPi 3b+.

Cheaper than rasps, quite similar hardware.

Then host your own instance.

Water has a different refractive* index (how ever it’s called in English) than air, which means it behaves like a magnifying glass somehow

So some visual defects can benefit from that. Also, you don’t read a book under water so harder to compare.

No water doesn’t fix your eyes, maybe you are just lucky to see a bit better due to the magnification effect.

Also, it distort what you see, mess up with distances and does not have any effect in focus, so if you have issues with focusing or see at close distance that will do nothing for you

• Thank you for the correction.

Never used it. Your could selfhost matrix or xmpp as well and lock it down by not federating the server to anything maybe?

Asking chatgpt Claude or any other llm usually is a good starting point

Cool man… I did the same last year, best decision ever.

Pretty easy too

AI is here to stay. Better we learn how to use, regulate and control it properly.

We need good regulation, identify and grow an ethical use of it and learn how to cope.

This is as big as the petrol engine, even bigger. Entire categories of people will be put out of business and work by AI, entire professions will be made obsolete.

New professions and work opportunities will be created in the future decades out of it.

Weather we like it or not (and I don’t like it, my job will be deleted by AI sooner or later).

Or drive a car

That’s true…