Skip to main content




friendica (DFRN) - Link to source

Jeezes X-Mas Super fucked up Christo Blanco


Machine I wrote... would you all ever forgive me?

$ cd $HOME/llama.cpp && \
./build/bin/llama-server -m ./models/qwen/qwen1.5-7b-chat-q5_k_m.gguf --port 8080 --temp 0.3 --top-p 0.85 --repeat-penalty 1.15 --ctx-size 8192 --n-gpu-layers 50 > /var/log/llm/qwen.log 2>&1 & \
./build/bin/llama-server -m ./models/deepseek/deepseek-coder-7b-instruct-q5_k_m.gguf --port 8081 --temp 0.3 --top-p 0.85 --repeat-penalty 1.15 --ctx-size 8192 --n-gpu-layers 50 > /var/log/llm/deepseek.log 2>&1 & \
./build/bin/llama-server -m ./models/llama3/Meta-Llama-3-8B-Instruct-Q5_K_M.gguf --port 8082 --temp 0.3 --top-p 0.85 --repeat-penalty 1.15 --ctx-size 8192 --n-gpu-layers 50 > /var/log/llm/llama3.log 2>&1 & \
python3 code_agent.py > /var/log/llm/code_agent.log 2>&1 & \
sleep 5 && firefox http://localhost:8080 


chemdmart.com/