Skip to main content

in reply to liv

@liv

Right πŸ˜€ Good luck to him. Real life does not work that way. I have seen the quality of AI generated code. It is worse than the code being generated by sweat shops in India, and that is very bad. AI is great for providing an intellisense feel to Vim, code completion. But it cannot be trusted to write applications.

Besides, why would I want to stop doing something I love to do? Telling me good news, you can now stop writing code is sort of like telling the average American good news, you can now stop watching TV πŸ˜‰ Good luck with that!

@liv
This entry was edited (5 days ago)
in reply to Unus Nemo

@Unus Nemo If only πŸ˜„, I post memes just for fun.
Totally agree though β€” AI code quality is still rough. but for me
if it could handle chores like cooking and cleaning and other everyday boring tasks, that would be real progress. kek.πŸ˜‡
in reply to liv

@liv

lol, give it time. I use only local AI and train the LLMs myself. Though, even then I would not trust code produced by the AI just yet in any case. The quality of the material you train the LLM with will definitely show in the results. My LLMs will produce far better code than most commercial AIs that are trained on anything they can scrape from the internet. Though, I do not focus on training my LLMs to code. I mainly train them in philosophy and psychology and nutrition πŸ˜‰

@liv
in reply to Unus Nemo

@Unus Nemo wow, its cool. I’ve been running models like Llama 3.1 8B, Mistral 7B, and Dolphin-Mistral locally for a bit, but I haven't dived into training or fine-tuning them myself yet. i wonder what kind of hardware it requires to train those?
in reply to liv

@liv

You will not be able to train a base model with it, but you can train with a RTX 5060ti it will just take a while, and of course you will have to train small models. To train larger models I am afraid you have to spend a lot more. At the least you would need a RTX Pro 6000 with 96gb of ddr 7. Which will set you back around $8500.00 dollars. Though that is what is required for serious training.

You can do a lot with a consumer grade gpu these days, though serious AI gpu for commercial use (above the RTX Pro 6000) start at around $16,000.00 which is a bit steep for a hobby πŸ˜‰.

@liv
in reply to Unus Nemo

@Unus Nemo ThanksπŸ˜‡, do u train those models for fun?? or professionally?
in reply to liv

@liv
This entry was edited (1 day ago)
in reply to Unus Nemo

@Unus Nemo Thanks a lot, I’ve played a bit with Ollama already. Appreciate you taking the time to explain❄️
⇧