Rogue Project's Friendica Social Network

en.wikipedia.org/wiki/John_Tru…
#people

Native American rights activist, musician, poet, and actor (1946-2015)
^{Contributors to Wikimedia projects (Wikimedia Foundation, Inc.)}

Unus Nemo likes this.

Radio Free Trumpistan

3 days ago •

Radio Free Trumpistan
3 days ago •

#HashtagGames
#BarnYardAnimalsSideHustle

Kalshi: working to monitor on the gamblers who actually PONY up.

#hashtaggames #barnyardanimalssidehustle

Blaise

3 days ago •

Blaise
3 days ago •

If you're stupid and you know it, write a bill.👏👏
If you're stupid and you know it, write a bill....

cbsnews.com/news/greenland-ran…

Republican congressman proposes bill to make Greenland 51st state

Republican Rep. Randy Fine of Florida introduced a bill to annex Greenland and make it the 51st U.S. state.

^{CBS News}

Don't worry when you see scrape it does a HTTP/GET-POST only on sites that matter for my LLM.
Hardcoded fetching to text file , no aggressive scraping (e.g., rapid requests, full mirror downloads)
Guthenberg's site even allow 1 book per time to .txt, also bot's
It uses a single, polite request with a proper User-Agent
It does not hammer the server just one file, once and gone from there.
This has No telemetry, no cloud, no external logging
Only fetches public domain content
It runs locally as all all libraries used (PyQt6, requests, BeautifulSoup) are open-source and permissively licensed ; )
This is a private, offline, ethical knowledge assistant.
meet the monster

Only 3 of the 12 widgets need a live LLM server open.

Unus Nemo likes this.

in reply to plan-A ᕦ(ò_óˇ)ᕤ

plan-A ᕦ(ò_óˇ)ᕤ

in reply to plan-A ᕦ(ò_óˇ)ᕤ • 2 days ago — (Proud Eskimo!) •

@adingbatponder If you can see my text it's not a server that blocked me but a bug , I've had it multiple times myself mostly on fediverse not local, while some appear after a while, I don't know the cause.
But the pictures show a bot GUI called llmfeederBot with emoticons, black background but colored widget names with yet for each a suiting one, there is a URL search bar with a Add URL and Scrape button (it fetches html to .txt ) a welcome screen with a brief explanation of what each widget do which is essentially grabbing .txt file then fetch , a GPG widget to check integrity, a man page fetcher, a Cheetsheet that activates a shell extension like --help and 2 others,, a summarize widget for book or long text widget, but my fav is ask LLM this is connected to it 2 others as well but from there you can choose a man text file and ask it a question with a response bar in that Bot's GUI > the response bar has a scroll down slider at the side and as well put the r

edit: in shell there is a 1 command

man systemd | col -b > systemd_guide.txt
ask systemd_guide.txt "How do I restart a service?"

but it applies only for 1 prompt and response appear in CLI while the ask LLM widget places 1 where you can interact there the man page pushes it and keeps it on that manual text file as well.

the command

@adingbatponder

in reply to plan-A ᕦ(ò_óˇ)ᕤ

adingbatponder

in reply to plan-A ᕦ(ò_óˇ)ᕤ • 2 days ago • •

This looks awesome. Is it in a repo? (I still cannot access url without making myself an account).

plan-A ᕦ(ò_óˇ)ᕤ likes this.

in reply to adingbatponder

plan-A ᕦ(ò_óˇ)ᕤ

in reply to adingbatponder • 2 days ago — (Proud Eskimo!) •

@adingbatponder No I wrote it myself with some help from my LLM at choke points it was a whole day work so that my arse still hurt : )
However you can read this ibb.co/N6G2Nn5r this picture is an example of that widget in the right tab click add URL then scrape and watch it fetch the content and converting it to .txt , picture dissapears after a day.
Also that widget and the working code for that alone as the whole script may not appeal to you is

       # 🤖 Custom URL Tab with 4 Bot Emoticons in Corners + LOG WIDGET (FIXED)
        custom_tab = QWidget()
        custom_layout = QVBoxLayout()

        top_row = QHBoxLayout()
        top_left = QLabel("🤖")
        top_left.setAlignment(Qt.AlignmentFlag.AlignTop | Qt.AlignmentFlag.AlignLeft)
        top_left.setStyleSheet("color: #4ade80; font-size: 24px;")
        top_right = QLabel("

       # 🤖 Custom URL Tab with 4 Bot Emoticons in Corners + LOG WIDGET (FIXED)
        custom_tab = QWidget()
        custom_layout = QVBoxLayout()

        top_row = QHBoxLayout()
        top_left = QLabel("🤖")
        top_left.setAlignment(Qt.AlignmentFlag.AlignTop | Qt.AlignmentFlag.AlignLeft)
        top_left.setStyleSheet("color: #4ade80; font-size: 24px;")
        top_right = QLabel("⚙️")
        top_right.setAlignment(Qt.AlignmentFlag.AlignTop | Qt.AlignmentFlag.AlignRight)
        top_right.setStyleSheet("color: #4ade80; font-size: 24px;")
        top_row.addWidget(top_left)
        top_row.addStretch()
        top_row.addWidget(top_right)

        
        self.custom_log = QTextEdit()
        self.custom_log.setReadOnly(True)
        self.custom_log.setMinimumHeight(300)

        bottom_row = QHBoxLayout()
        bottom_left = QLabel("🧠")
        bottom_left.setAlignment(Qt.AlignmentFlag.AlignBottom | Qt.AlignmentFlag.AlignLeft)
        bottom_left.setStyleSheet("color: #4ade80; font-size: 24px;")
        bottom_right = QLabel("⚡")
        bottom_right.setAlignment(Qt.AlignmentFlag.AlignBottom | Qt.AlignmentFlag.AlignRight)
        bottom_right.setStyleSheet("color: #4ade80; font-size: 24px;")
        bottom_row.addWidget(bottom_left)
        bottom_row.addStretch()
        bottom_row.addWidget(bottom_right)

        custom_layout.addLayout(top_row)
        custom_layout.addWidget(self.custom_log)  # ← Connected to add_url() and start_web_fetch()
        custom_layout.addLayout(bottom_row)
        custom_tab.setLayout(custom_layout)
        self.tabs.addTab(custom_tab, "🌐 Custom URL")

Full code 503 lines.
Build PyQt6 1st , This is a privacy-safe, offline, local-first tool and Uses no cloud services, no serverless.
Scrapes URLs using requests + BeautifulSoup

@adingbatponder

in reply to plan-A ᕦ(ò_óˇ)ᕤ

Unus Nemo

in reply to plan-A ᕦ(ò_óˇ)ᕤ • 2 days ago •

@plan-A ᕦ(ò_óˇ)ᕤ

You know that Project Gutenberg offers all of their books in text form right? For that site you would not need to convert it. For other sites converting html to text is quite simple with pandoc

pandoc -f html -t plain input.html -o output.txt

pandoc also handles the conversion of many other document type formats as well.

@plan-A ᕦ(ò_óˇ)ᕤ

This entry was edited (2 days ago)

in reply to Unus Nemo

plan-A ᕦ(ò_óˇ)ᕤ

in reply to Unus Nemo • 1 day ago — (Proud Eskimo!) •

@Unus Nemo yes I know the HTML > .txt works only when needed from the general app, tab guthenberg is for their books the search bar as for RFC's if you look here but be fast I set it to auto delete for @adingbatponder after 1 day you see a html converted to text ibb.co/N6G2Nn5r
I have filled it with man pages from all codes, how to use those codes, networking in a broad part, developing a whole list was busy for hours so the amount of man .txt pages is huge and all is set so that my LLM adhere to those manuals once I fetch it out as fetch all manuals (did some changes) and my LLM now is 100% accurate thanks to the man pages so today is test all but all features then I'll make a codeberg or git account

@Unus Nemo @adingbatponder

This entry was edited (1 day ago)

in reply to plan-A ᕦ(ò_óˇ)ᕤ

adingbatponder

in reply to plan-A ᕦ(ò_óˇ)ᕤ • 1 day ago • •

@unusnemo Really neat. Limiting an AI to your validated library of info is ultra smart. I tried something in this direction by grabbing manual pages for e.g. ssh commands by writing a rust application using ratatui called ssh-key-manager which is in within my flake in my repo. It was hard to do and just an experiment in using claude AI for writing hard rust stuff. But it was amazing to see how to parallelise it to make the nixos flake build faster.

@Unus Nemo

plan-A ᕦ(ò_óˇ)ᕤ likes this.

in reply to adingbatponder

plan-A ᕦ(ò_óˇ)ᕤ

in reply to adingbatponder • 1 day ago — (Proud Eskimo!) •

@adingbatponder @Unus Nemo
I've made some modification, removed the stupid emoticon bar for ASCII art and special symbols widget. I adapted a better welcome as info screen. and if you wondered as you can't see the pictures I posted if you'd ask yourself what is it good for, well it respond in the bot answered by the LLM in an answer console. Or you can just use your LLM as the files you will scrape will be in /opt/llmfeed/ a location your LLM can access.
ibb.co/nsgCVk59
ibb.co/Fb3rZVnw
ibb.co/DfbccdSN

edit: Your local LLM (running via llama.cpp at 127.0.0.1:8080) only sees what your Python script (llm_bot.py) sends it in the prompt field of the JSON request.

you select a .txt file in the “❓ Ask LLM” tab (e.g., /opt/llmfeed/man/git.txt)
Your llm_bot.py script reads that file from disk:

Also avoid to scrape from some sites as Cisco docs, ComPtia + network and the likes you will get a 403 and possibly your ip banned.

@Unus Nemo @adingbatponder

This entry was edited (1 day ago)

in reply to plan-A ᕦ(ò_óˇ)ᕤ

adingbatponder

in reply to plan-A ᕦ(ò_óˇ)ᕤ • 1 day ago • •

This post looks very useful. I made a similar tool (still in beta with errors) to grab screenshots and raw data of manual pages #manpages for #linux commands, in this case #ssh info, and to present the different layers that are the OS, app and nixos settings. The program ssh-key-manager is in my flake repoducible.org ( features/security/packages #flake #part can be pulled out into another flake) & bit of a monster. Yours looks ultra compact #nixos
#flakepart #flakeparts

ssh-key-manager menu Manage SSH settings (in development, throws errors)

ssh-key-manager menu Manage SSH settings (in development, throws errors) with option of showing documentation that has been cached

ssh-key-manager menu Manage SSH settings (in development, throws errors) showing an example of cached manual pages...

Radicle Explorer

Explore the Radicle network

^{repoducible.org}

#linux #nixos #ssh #flake #part #manpages #flakepart #flakeparts

This entry was edited (1 day ago)

Unus Nemo likes this.

in reply to adingbatponder

plan-A ᕦ(ò_óˇ)ᕤ

in reply to adingbatponder • 1 day ago •

@adingbatponder Thanks! Your's looks cool and is handy and well structured. The grab from HTTP to .txt as it must be text for my LLM I don't know if other models works the same was a simple command AFTER coding the script and It helped me keep it compact and no telemetry as local, The idea came from @Unus Nemo
a possibility to train models by downloading the knowledge and he added the bot way as an other option. He pointed me earlier as well to self hosting a LLM> he showed the door. So part of credit goes to him though

@Unus Nemo @adingbatponder

Unus Nemo likes this.

in reply to adingbatponder

plan-A ᕦ(ò_óˇ)ᕤ

in reply to adingbatponder • 1 day ago •

@Unus Nemo @adingbatponder

in reply to adingbatponder

Unus Nemo

in reply to adingbatponder • 2 days ago •

@adingbatponder

Most Apps are geared toward Mastodon not Friendica, so you will have issues with it when accessing Friendica Instances, in my experience.

@plan-A ᕦ(ò_óˇ)ᕤ

Put your code on github so that your friend can download it from there, play nice 😉.

@adingbatponder @plan-A ᕦ(ò_óˇ)ᕤ

plan-A ᕦ(ò_óˇ)ᕤ likes this.

in reply to Unus Nemo

plan-A ᕦ(ò_óˇ)ᕤ

in reply to Unus Nemo • 1 day ago — (Proud Eskimo!) •

@Unus Nemo @adingbatponder Testing 1st day each widget to the detail, re make a github page as I'm new in dev I used it before for other purposes way long ago, the coding were limited to tool automation, Scilla long ago, Bash, python and the tools commands using cheat cheats, in general network commands...
Thing is it's a rinse repeat process of trial and failure and by modifying it that much it learns me a lot of things (the LLM that helped me)
But I will certainly do as I made a lot of projects sitting here. I'll open source them, that's the spirit! ; )

@Unus Nemo @adingbatponder

This entry was edited (1 day ago)

like this

in reply to plan-A ᕦ(ò_óˇ)ᕤ

adingbatponder

in reply to plan-A ᕦ(ò_óˇ)ᕤ • 1 day ago • •

@unusnemo Public repo is a big step and worth doing when it works nicely but this in my experience can take many weeks! I think the idea has been shown and is great.

@Unus Nemo