Epium | London

Real AI Automation Isn’t a Prompt. It’s a Pipeline

AI isn’t about calling the biggest model. It’s about building smart, layered systems that use the right model for the right job. This real-world automation pulls, scrapes, filters, deduplicates, scores, summarizes, and publishes using GPT-4.1, GPT-4o, 4o-mini, and DALL·E 3 where they shine, not just where they’re trendy.

How I Built a Fully Automated News Aggregator That Actually Works.

Everyone’s talking about AI like it’s a magic box. Ask a question, get an answer, call it a day. But if you want to build something that actually runs without breaking, scales without drama, and doesn’t cost more than your rent, you need more than prompts. You need architecture.

Here’s what I built.

I run a fully autonomous AI-driven news aggregator. Every day, it pulls in 150–175 articles from Google and various RSS feeds. It scrapes full pages (with fallback logic to Node.js and Puppeteer when things get weird), deduplicates them in two stages: fast local similarity filtering using Levenshtein in Node.js, followed by semantic deduplication using GPT-4o-mini to catch paraphrased overlap and fluff.

Each article is summarized using GPT-4.1, because that model gives the cleanest, most coherent extracts, even if it’s a bit pricier. Then, each summary is scored for importance using GPT-4o: cheaper, faster, and more than good enough for classification tasks.

Only articles above a certain threshold make the cut. Those get pushed to WordPress with a symbolic image generated by DALL·E 3, themed to the content. Every component writes to a central MariaDB database, which acts as the system’s source of truth. Each stage moves data forward in a controlled, restartable flow – with full fallback handling and zero need to rerun the whole thing when something fails.

This isn’t a bunch of prompts duct-taped together. It’s a layered, resilient automation system, and every layer uses the right tool for the job.

Not the cheapest model.
Not the most hyped model.
The one that fits the task.

Models used as of May 2025:

Summarization needs precision: Use GPT-4.1
Deduplication in AI: Use gpt-4o-mini
Scoring needs speed: Use 4o
Image needs visual flair: Use DALL·E 3
Scraping needs fallback: Use code, not hope.

That’s the difference between playing with AI and actually engineering it.

The whole thing costs around $20–25/month to run. It publishes 10–20 articles a day, entirely unsupervised. If something breaks, I can restart at any step with zero data loss.

So next time someone shows off their “AI pipeline,” ask them this:

  • Are you using the right model, or just the cheapest one?
  • Can your system recover from failure without a human?
  • Is it a toy, or is it an actual layer in your stack?

AI isn’t magic. It’s tools, tuned for purpose, arranged with intent.

Christian Holmgreen is the Founder of Epium and holds a Master’s in Computer Science with a focus on AI.

News aggregation model

Latest Blog Posts

AGI Won’t Explode – It’ll Crawl (And We’ll Still Have Time to Pull the Plug)

September 12, 2025

The Hollywood fantasy says AGI will wake up, rewrite itself in seconds, and take over the world. Reality says no. Training frontier models takes months, costs millions, and burns megawatts. Compute, math, and bandwidth don’t vanish because a script demands it.

AGI won’t explode – it’ll crawl. The real threat isn’t machines escaping, it’s humans rushing to give them power before they’re ready.

RAG Decay: Why Your Knowledge Bot Gets Dumber Every Week

August 14, 2025

Retrieval-Augmented Generation (RAG) can make your AI sound like it knows your business inside-out – until it quietly rots. This post explains what RAG really is, why it decays into stale, bloated answers, and the unglamorous maintenance work that keeps it sharp and trustworthy.

AI in eCommerce: A Revolution or Just Another Overhyped Buzzword?

July 14, 2025

AI is often seen as the cure-all for ecommerce problems, from customer service to inventory management. But AI is just a tool, not a magic bullet. While it can automate tasks and improve efficiency, it won’t fix a flawed business model or poor strategy. AI is most useful for optimization, like inventory sorting or personalizing customer experiences. Using it just to follow trends or avoid the hard work, like keyword research, is a waste. The real value of AI comes when it solves specific problems, not when it’s used for everything. If used correctly, AI can revolutionize parts of your business; otherwise, it’s just another overhyped tool.

Hallucination Nation AI

June 20, 2025

Most people use AI wrong, expecting brilliance from nothing and getting polished nonsense in return. Here’s the hard truth: AI’s great at summaries and rewrites, but leave it alone with a blank page and it’ll invent facts, companies, even your next Nobel Prize. Learn how to make AI useful, or enjoy your trip through hallucination nation.