Skip to content
  • Categories
  • Recent
  • Popular
  • World
  • Users
  • Feed
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse

NodeBB Playground

  1. Home
  2. Categories
  3. Selfhosted
  4. Looking for an RSS aggregator/summarizer/maybe-LLM thing

Looking for an RSS aggregator/summarizer/maybe-LLM thing

Scheduled Pinned Locked Moved Selfhosted
17 Posts 15 Posters 27 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • barkingspiders@infosec.pubB barkingspiders@infosec.pub

    I've been using miniflux in docker with a miniflux-ai container I found on GitHub, I seem to recall I had issues out of the box and had to tweak it but that was quite a while ago, can't remember the details. I have it configured to generate summaries of a list of feeds in miniflux when it sees new items. Works pretty well, needs to be restarted occasionally but has been just fine for the amount of time it took to setup.

    karnasubarna@lemmy.mlK This user is from outside of this forum
    karnasubarna@lemmy.mlK This user is from outside of this forum
    karnasubarna@lemmy.ml
    wrote last edited by
    #4

    Using Miniflux for more than year now with 0 issue so far.

    1 Reply Last reply
    3
    • torsiT Online
      torsiT Online
      torsi
      wrote last edited by
      #5

      Just found this thread from March looking for the exact same thing, with no helpful suggestions unfortunately. I think folks either don't understand what's being asked or don't understand how Google News works.

      https://lemmy.world/post/26280691

      I 1 Reply Last reply
      4
      • torsiT torsi

        Basically I want a self-hosted version of Google News. If 10 feeds have near-identical coverage of the same story, I want just 1 item, with an option to see the other 9.

        I went looking for something like this a couple years ago and found ~nothing. Checked again today and now there are Entirely Too Many Things.

        Hoping to find something a bit more established than somebody's abandoned weekend project. There seems to be an awful lot of that out there right now.

        Looking for XML or similar output. Do not need or necessarily want any sort of front end.

        svengarlic@lemmy.worldS This user is from outside of this forum
        svengarlic@lemmy.worldS This user is from outside of this forum
        svengarlic@lemmy.world
        wrote last edited by
        #6

        N8n can do a lot of this, easy too.

        1 Reply Last reply
        1
        • torsiT torsi

          Basically I want a self-hosted version of Google News. If 10 feeds have near-identical coverage of the same story, I want just 1 item, with an option to see the other 9.

          I went looking for something like this a couple years ago and found ~nothing. Checked again today and now there are Entirely Too Many Things.

          Hoping to find something a bit more established than somebody's abandoned weekend project. There seems to be an awful lot of that out there right now.

          Looking for XML or similar output. Do not need or necessarily want any sort of front end.

          I This user is from outside of this forum
          I This user is from outside of this forum
          innerscientist@lemmy.world
          wrote last edited by innerscientist@lemmy.world
          #7

          I've searched for something like this in the past and didn't find anything.
          I've though of hacking together a few scripts or 8n8 to interface with freshrss to do this but it's far down my list™

          1 Reply Last reply
          1
          • torsiT torsi

            Basically I want a self-hosted version of Google News. If 10 feeds have near-identical coverage of the same story, I want just 1 item, with an option to see the other 9.

            I went looking for something like this a couple years ago and found ~nothing. Checked again today and now there are Entirely Too Many Things.

            Hoping to find something a bit more established than somebody's abandoned weekend project. There seems to be an awful lot of that out there right now.

            Looking for XML or similar output. Do not need or necessarily want any sort of front end.

            C This user is from outside of this forum
            C This user is from outside of this forum
            comrademiao@lemmy.world
            wrote last edited by
            #8

            Why though? The joy is reading not reading bad versions of the same content?

            R 1 Reply Last reply
            2
            • C comrademiao@lemmy.world

              Why though? The joy is reading not reading bad versions of the same content?

              R This user is from outside of this forum
              R This user is from outside of this forum
              ryanpdg1@lemmy.ca
              wrote last edited by
              #9

              I'm with OP on this one.
              I enjoy reading quality content, not just the act of reading.
              I think the idea is that by using an LLM to help sort through the drivel you have more time to do the reading of the quality content.

              And really, I'm always suspicious of the why when an algorithm suggests me an article... Having something less tied directly to a companies bottom line might help me trust the content more.

              S 1 Reply Last reply
              0
              • torsiT torsi

                Just found this thread from March looking for the exact same thing, with no helpful suggestions unfortunately. I think folks either don't understand what's being asked or don't understand how Google News works.

                https://lemmy.world/post/26280691

                I This user is from outside of this forum
                I This user is from outside of this forum
                infeeeee@lemmy.zip
                wrote last edited by infeeeee@lemmy.zip
                #10

                Then can you explain how google news works? I never used it, maybe a lot others have also no idea.

                From google reader i switched to feedly after google shut it down in 2013, when I started self hosting switched to ttrss, then to freshrss when it became apparent the developer of ttrss is an actual neonazi. It was always working for me so i never looked for a replacement.

                torsiT 1 Reply Last reply
                1
                • torsiT torsi

                  Basically I want a self-hosted version of Google News. If 10 feeds have near-identical coverage of the same story, I want just 1 item, with an option to see the other 9.

                  I went looking for something like this a couple years ago and found ~nothing. Checked again today and now there are Entirely Too Many Things.

                  Hoping to find something a bit more established than somebody's abandoned weekend project. There seems to be an awful lot of that out there right now.

                  Looking for XML or similar output. Do not need or necessarily want any sort of front end.

                  artyom@piefed.socialA This user is from outside of this forum
                  artyom@piefed.socialA This user is from outside of this forum
                  artyom@piefed.social
                  wrote last edited by artyom@piefed.social
                  #11

                  Honestly Brave News is the only solution I've found for that. Just go to Brave search and search for "news". It will aggregate the top stories of the day, group the different sources, then provide an AI generated digest of the stories upon request.

                  1 Reply Last reply
                  0
                  • I infeeeee@lemmy.zip

                    Then can you explain how google news works? I never used it, maybe a lot others have also no idea.

                    From google reader i switched to feedly after google shut it down in 2013, when I started self hosting switched to ttrss, then to freshrss when it became apparent the developer of ttrss is an actual neonazi. It was always working for me so i never looked for a replacement.

                    torsiT Online
                    torsiT Online
                    torsi
                    wrote last edited by
                    #12

                    @infeeeee@lemmy.zip It's a matter of duplication.

                    Say you have 10 feeds from major news publishers in your reader, BBC, NY Times, Le Monde, etc. because you value wide coverage. When the King of England dies you will have 10 nearly identical articles in your feed with the facts of his death from those outlets, plus at least another 10 nearly identical ones reminiscing about his life and impact, and dozens more related ones from various contributors. Your feed will be clogged for days with repeated info about one old dead guy. This is an annoying reality of RSS.

                    On Google News there will be one box dedicated to His Royal Corpse showing maybe a few stories, semi-randomly selected for relevance by an algorithm. If you want the fire hose coverage it's a click away, but on the front page it's contained and doesn't dominate everything else. I want that for RSS.

                    ladfrombrad@lemdro.idL 1 Reply Last reply
                    3
                    • torsiT torsi

                      Basically I want a self-hosted version of Google News. If 10 feeds have near-identical coverage of the same story, I want just 1 item, with an option to see the other 9.

                      I went looking for something like this a couple years ago and found ~nothing. Checked again today and now there are Entirely Too Many Things.

                      Hoping to find something a bit more established than somebody's abandoned weekend project. There seems to be an awful lot of that out there right now.

                      Looking for XML or similar output. Do not need or necessarily want any sort of front end.

                      R This user is from outside of this forum
                      R This user is from outside of this forum
                      rumba@lemmy.zip
                      wrote last edited by
                      #13

                      Go check out network chucks review of N8N.

                      He builds a small news aggregator with LLM that crap stuff into discord but you could easily put it anywhere.

                      1 Reply Last reply
                      1
                      • torsiT torsi

                        @infeeeee@lemmy.zip It's a matter of duplication.

                        Say you have 10 feeds from major news publishers in your reader, BBC, NY Times, Le Monde, etc. because you value wide coverage. When the King of England dies you will have 10 nearly identical articles in your feed with the facts of his death from those outlets, plus at least another 10 nearly identical ones reminiscing about his life and impact, and dozens more related ones from various contributors. Your feed will be clogged for days with repeated info about one old dead guy. This is an annoying reality of RSS.

                        On Google News there will be one box dedicated to His Royal Corpse showing maybe a few stories, semi-randomly selected for relevance by an algorithm. If you want the fire hose coverage it's a click away, but on the front page it's contained and doesn't dominate everything else. I want that for RSS.

                        ladfrombrad@lemdro.idL This user is from outside of this forum
                        ladfrombrad@lemdro.idL This user is from outside of this forum
                        ladfrombrad@lemdro.id
                        wrote last edited by
                        #14

                        Are you telling us we should put a bet on Charlie copping it soon? 🤔

                        1 Reply Last reply
                        0
                        • B bulwark@lemmy.world

                          I've been really happy with Fresh-RSS. Someone else on here put me onto about 6 months ago and it's changed how I consume news.

                          I find the most time consuming part was/is curating my feed but with tools like RSS-Bridge I can really get fine grain control on what makes it through.

                          On your LLM summarizer question, yes they have several plug-ins. I've recently started piping the whole feed into Gemini and telling it to pick the top 5 and summarize. But I do that in bash and emacs :

                          thetondog@feddit.ukT This user is from outside of this forum
                          thetondog@feddit.ukT This user is from outside of this forum
                          thetondog@feddit.uk
                          wrote last edited by
                          #15

                          This looks amazing , appreciate the steer on it.

                          I don't suppose you know if Kindle delivery is supported at all? I use my own dockerized fork of news-sender-kindle which works well in terms of folding everything down into a .epub, but the RSS control is a little fiddly, it doesn't let me preview the articles and amending feeds involves SSHing into an txt file on my server (not ideal).

                          1 Reply Last reply
                          1
                          • R ryanpdg1@lemmy.ca

                            I'm with OP on this one.
                            I enjoy reading quality content, not just the act of reading.
                            I think the idea is that by using an LLM to help sort through the drivel you have more time to do the reading of the quality content.

                            And really, I'm always suspicious of the why when an algorithm suggests me an article... Having something less tied directly to a companies bottom line might help me trust the content more.

                            S This user is from outside of this forum
                            S This user is from outside of this forum
                            simsalabim@lemmy.world
                            wrote last edited by
                            #16

                            LLMs aren't sorting algorithms, they're fancy keyboard predictions.

                            1 Reply Last reply
                            0
                            • torsiT torsi

                              Basically I want a self-hosted version of Google News. If 10 feeds have near-identical coverage of the same story, I want just 1 item, with an option to see the other 9.

                              I went looking for something like this a couple years ago and found ~nothing. Checked again today and now there are Entirely Too Many Things.

                              Hoping to find something a bit more established than somebody's abandoned weekend project. There seems to be an awful lot of that out there right now.

                              Looking for XML or similar output. Do not need or necessarily want any sort of front end.

                              K This user is from outside of this forum
                              K This user is from outside of this forum
                              koala@programming.dev
                              wrote last edited by
                              #17

                              Remember that Google News has RSS feeds! They are very well hidden, but they are there.

                              However, they are also a bit bad.

                              I started https://github.com/las-noticias/news-rss to postprocess a bit Google News RSS feeds and also play with categorization. I found spaCy worked well to find "topics", but unfortunately I lost steam.

                              1 Reply Last reply
                              0
                              Reply
                              • Reply as topic
                              Log in to reply
                              • Oldest to Newest
                              • Newest to Oldest
                              • Most Votes


                              • Login

                              Powered by NodeBB Contributors
                              • First post
                                Last post
                              0
                              • Categories
                              • Recent
                              • Popular
                              • World
                              • Users
                              • Feed