Just a stranger trying things.
Indeed, Ollama is going a shady route. https://github.com/ggml-org/llama.cpp/pull/11016#issuecomment-2599740463
I started playing with Ramalama (the name is a mouthful) and it works great. There is one or two more steps in the setup but I’ve achieved great performance and the project is making good use of standards (OCI, jinja, unmodified llama.cpp, from what I understand).
Go and check it out, they are compatible with models from HF and Ollama too.
Oh I didn’t mean to ask for the link, I just meant to get more information about what you were doing with it, totally understandable! Anyway, cool project!
Oh very interesting! How cool :) Do you then host some kind of website for people to view your animated progress in real time as you run?
Yes!! I wish there were more open source options to interface with fitness trackers and smart watches… I’m upset about all this proprietary crap forcing you to share your data with the manufacturer and depend on their availability and goodwill to access our data… Very frustrating :(
There are great app recommendations here. Perhaps not the habit tracking type, but I love FitoTrack for tracking my runs. No social, no BS, just pure local metrics. Not perfect but entirely usable and serves its purpose.
https://f-droid.org/packages/de.tadris.fitness
Edit: what I love most about all these apps is that they are so lightweight. I have so many apps today which are well above 100MB, sometimes around 500MB and I’m not talking games.
This is so outrageous to me. All of these open source apps by comparison are 10MB or less. Absolutely beautiful.
I didn’t take it as a critique of Ente, not to worry! I’m not affiliated in any way, I just wanted to provide some context to people who may be concerned about the vendor locking aspect specifically.
Of course how you manage your media, your needs and your finances are all a very personal matter, I also self-host my photo backup, but I use ente in a complementary fashion, and I don’t backup everything to it. It just makes it convenient to collect, share and aggregate media between ente members and non-members.
Cheers!
In the case of ente, they have gone above and beyond to give full control to their users of their backing up process and backed up media:
To me, it really shows they care about the users and do their best to avoid vendor lock-in.
And I personally feel much more confident in a company when their business model is a paid one. I’m a very happy customer, I have also convinced multiple people who seem happy too.
I will always remember my first experience using MacOS: I am comfortable with computers and a relative needed help with their recently purchased macbook. I had plugged in a USB stick to transfer some files and was done and wanted to eject it. I spent way too much time than I care to admit, trying all possible options, right-clicks, settings, everything imaginable, to eject the damn thing.
It was impossible to me to find the simplest operation with a USB stick, something required to operate it. I capitulated and looked online. The solution? I had to drag and drop the USB stick icon into the trashcan!?!?!?
To this day, I will never understand the absolute ridicule of this and I will never comprehend how anyone is expected to figure it out on their own. And this is from the OS touted as the most user friendly and intuitive. Go figure.
Edit: this was a long while back, no idea how it is nowadays.
Remove unused conda packages and caches:
conda clean --all
If you are a Python developer, this can easily be several or tens of GB.
Would you be able to share more info? I remember reading their issues with docker, but I don’t recall reading about whether or what they switched to. What is it now?
In this case, without clicking any links in the email, why don’t you just simply go to the proton website manually and log in for good measure?
This is an article about the following youtube video: https://www.youtube.com/watch?v=VTsBP21-XpI
Edit: I recommend
Regarding photos, and videos specifically:
I know you said you are starting with selfhosting so your question was focusing on that, but I would like to also share my experience with ente which has been working beautifully for my family, partner and myself. They are truly end to end encrypted, with the source code available on github.
They have reasonable prices. If you feel adventurous you can actually also host it yourself. They have advanced search features and face recognition which all run on device (since they can’t access your data) and it works very well. They have great sharing and collaborating features and don’t lock features behind accounts so you can actually gather memories from people on your quota by just sharing a link. You can also have a shared family plan.
Removed by mod
Removed by mod
To run the full 671B sized model (404GB in size), you would need more than 404GB of combined GPU memory and standard memory (and that’s only to run it, you would most probably want it all to be GPU memory to make it run fast).
With 24GB of GPU memory, the largest model which would fit from the R1 series would be the 32b-qwen-distill-q4_K_M (20GB in size) available at ollama (and possibly elsewhere).
Ollama is very useful but also rather barebones. I recommend installing Open-Webui to manage models and conversations. It will also be useful if you want to tweak more advanced settings like system prompts, seed, temperature and others.
You can install open-webui using docker or just pip, which is enough if you only care about serving yourself.
Edit: open-webui also renders markdown, which makes formatting and reading much more appealing and useful.
Edit2: you can also plug ollama into continue.dev, an extension to vscode which brings the LLM capabilities to your IDE.
Perhaps I need to review my thoughts and either see how I really feel about this topic or find another way to express them.
Either way, you are making a compelling argument and I am not in disagreement.
You’re confusing proton with our stance as a community which cares about privacy.
As a community the question is, will we shun anyone who cares about furthering our rights to privacy, because they have other stances on other issues?
Doing so is only isolating us and prevents us from making our issues heard and gathering more support across the political spectrum.
You can fight alongside someone you don’t agree with on other topics. It is not an endorsement for all they stand for.
Perhaps give Ramalama a try?
https://github.com/containers/ramalama