Rainshadow Systems

Weekend Projects: Build a Tougher Agent Stack (Less Hype, More Shipping)

Weekend Projects: Build a Tougher Agent Stack (Less Hype, More Shipping)

This week’s theme was “agents that actually ship work” — not just chatbots with fancy prompts. On Monday we talked about hybrid architectures and the economics of long context. On Wednesday we looked at how the workflow layer is becoming the product. Here are three weekend builds that turn those ideas into something you can run on Monday morning.

Project 1 — An “agent step” you can trust: Draft vs. Publish for your automations

  • Time: 2–4 hours
  • Tools: Zapier (or any automation tool you use), one LLM provider, a simple test dataset (10–20 real messages/emails you’ve seen), and a spreadsheet

What you’ll build: A tiny governance system for AI inside your automation. The idea is simple: you don’t let the AI change your live workflow until it’s proven.

Zapier has been moving this direction with Agents features like “drafts vs published” versions, plus clearer “needs review” states and checkpoints for changes (Zapier product updates). You can copy that pattern even if you’re not on Zapier.

Build steps:

  1. Pick one real job: summarize an inbound lead and extract fields (name, phone, job type, address, urgency).
  2. Create two modes:
    • Draft mode: AI output goes to a Google Sheet column called Proposed. A human approves it.
    • Published mode: after you’ve got 20 clean approvals, the AI writes directly into your Final fields.
  3. Add a “needs review” gate: if the AI is uncertain (missing phone, low confidence, weird address), it flags the row and stops.

What you’ll learn: The fastest way to make AI safe isn’t more rules — it’s versioning + a clear rollback path. That’s how you keep the tool helpful without turning it into a liability.

Project 2 — Build a field-service “front office” agent in n8n (intake → plan → follow-up)

  • Time: 4–6 hours
  • Tools: n8n (self-hosted or cloud), Gmail/Outlook, Google Sheets (or Airtable), Twilio (optional for SMS), and an LLM node

What you’ll build: A practical intake pipeline for a small service business:

  • Customer email/text comes in.
  • AI turns it into a clean job card (what, where, when, photos/attachments, and next action).
  • Automation schedules the next step (quote request, calendar slot hold, or a “we got your message” reply).

If you’re looking for patterns, n8n has been publishing real-world agent examples like email summarizers and database chat agents (n8n).

Build steps:

  1. Use a plan-first prompt: have the model output a short plan plus a JSON object (fields you need).
  2. Store everything: raw message, AI summary, extracted fields, and a status column (New / Needs Review / Scheduled / Quoted).
  3. Human-in-the-loop: if the model can’t extract a key field, route to a “needs review” Slack/email, not a best guess.

What you’ll learn: The real win is the combo: automation handles the boring repeatable steps, and AI handles the messy language in the middle.

Project 3 — Make your agent cheaper: add a “fast lane” with smaller models + caching

  • Time: 3–5 hours
  • Tools: any API-based model, a small “fast” model option (or a cheaper endpoint), Redis (or even a simple file cache), and a test harness script

What you’ll build: A two-tier inference setup:

  • Fast lane: cheap model handles simple jobs (classification, field extraction, short replies).
  • Heavy lane: bigger model only runs when the fast lane is unsure.

This matters because inference economics are shifting fast. NVIDIA highlighted examples where providers cut cost per token significantly on newer inference stacks — including a DeepInfra example dropping from 20¢ to 10¢ to 5¢ per million tokens moving from Hopper to Blackwell and then to NVFP4 (NVIDIA).

Build steps:

  1. Define “simple” vs “hard”: simple = extraction from one message; hard = negotiation email + policy constraints.
  2. Add confidence scoring: if the small model can’t produce valid JSON, or misses required fields, escalate.
  3. Cache repeat questions: for FAQs and standard replies, store the final output and reuse it.

What you’ll learn: Most businesses don’t need “the best model” for every step. They need the right model for each step, plus guardrails that stop bad outputs from slipping into the real world.

Optional extension — Try an agent framework without locking yourself in

If you want to go deeper, pick one open-source agent framework and build the same “intake → plan → execute” loop. A recent roundup compares options like LangGraph, OpenAI Agents SDK, CrewAI, Dify, and Mastra (Firecrawl). The point isn’t to worship frameworks — it’s to learn what you need: state, tool calling, and good logs.

Bottom line: You don’t need a magic agent. You need a system that can be tested, versioned, and rolled back — like any other piece of equipment you’d trust on a jobsite.

← All posts Work with us