Running Celery at Scale: Lessons from 2M Daily Tasks
Worker pool tuning, Redis memory management, and the retry storm that taught us everything.
Marc DuvalSpiderIQ Journal
Blog
Operating notes, product releases, and field-tested playbooks for agencies building with agents, data, and owned infrastructure.
10 published postsRendered from SpiderPublish posts. Publish a new article and this page updates without editing template HTML.
All Articles
Marc Duval
Self-Hosting SpiderIQ: Docker Compose on a Single €9 VPS
Your data, your infra. Full Docker Compose stack on one affordable Hetzner node with production-grade TLS.
Marc Duval
From Zero to 500-Lead Campaign in Under 4 Minutes
A step-by-step walkthrough: one prompt → SpiderMaps → SpiderVerify → SpiderMail. No code, no dashboards.
Lena Hartmann
157 MCP Tools: How We Built the Largest Agent-Callable Surface in Martech
A deep-dive into the architecture behind SpiderIQ's 157 MCP tools — schema layer, multi-tenant isolation, and the bet on Model Context Protocol.
Lena Hartmann