Portrait of Carlos André Ferreira

AI Engineering · Multi-Agent Systems

I build agent systems that can be trusted in production.

Senior software engineer and PhD researcher focused on agent orchestration, workflow design and agent evaluation — the reliability layer that turns LLM demos into systems teams can actually ship.

What I focus on

Three connected problems: making agents work together, proving they work, and keeping humans in control of what matters.

Agent orchestration

Designing multi-agent topologies — supervisor patterns, hub-and-spoke architectures, per-node model routing with cost circuit breakers — using LangGraph and Pydantic AI, with MCP for shared tooling.

Evaluation & reliability

Agent evaluation is the bottleneck nobody budgets for. I work on pass^k metrics, Reliability@Cost, failure taxonomies and verification gates — treating evals as CI, not as an afterthought.

Observability & oversight

Instrumenting agent workflows with OpenTelemetry GenAI conventions, and designing explicit human-in-the-loop gates so autonomy stays proportional to demonstrated reliability.

Selected work

Independent research and engineering projects. Client work at Critical Software (automotive, safety-critical domains) is under NDA — happy to discuss the approach in conversation.

Framework · Author

EvalGraph

An agent evaluation and self-improvement framework: pass^k reliability metrics, Reliability@Cost, MAST failure taxonomy, Wilson confidence intervals and a honesty gate that blocks unverifiable success claims. Positioned as a reliability-science layer that couples to LangGraph or Temporal through OpenTelemetry GenAI semantic conventions.

python78 testsotel genaipass^k
Research · Accepted for publication

CIRA-MAS

A multi-agent architecture for cybersecurity incident response, combining LangGraph orchestration with LightRAG retrieval. Accepted at CENTERIS 2026 — agents triage, correlate and draft response actions under explicit human approval gates.

langgraphlightragmulti-agentcenteris 2026
Toolkit · Author

Agent Skill Library

A library of transferable reasoning skills for coding agents — plan-then-execute, verification gates, debugging methodology, stop-and-escalate, context discipline and failure-mode awareness — grounded in empirical research on what actually transfers between models via text instructions.

skill.md6 modulesmodel-agnostic
Architecture · Design

Orchestration reference architecture

A three-tier hub-and-spoke reference design for running fleets of coding agents: a single source of truth in AGENTS.md with per-agent shims, MCP for shared tools, and CI gates as the real standardisation mechanism rather than convention documents.

hub-and-spokemcpci gates
Delivery · Web platforms

European tourism platforms

Before specialising in AI systems, I designed and shipped several tourism websites and platforms for European markets — multilingual, content-heavy products where performance, SEO and editorial workflows decide whether the site earns bookings. That delivery experience is why my AI work stays anchored to what survives contact with real users.

multilingualseofull-stackeu markets

Research & background

Doctoral Researcher in Data Science and Web Technologies (UTAD / Universidade Aberta), with ~8 years of industry experience. Senior engineer at Critical Software, working on large-scale automotive software. My research programme sits at the intersection of multi-agent systems, retrieval architectures and agent evaluation — the thesis is simple: autonomy without measurement is a liability, so the interesting engineering problem is building the measurement layer.

currentPhD research on multi-agent orchestration & evaluation · CIRA-MAS accepted at CENTERIS 2026
industrySenior software engineer, Critical Software — automotive programme
locationViseu, Portugal · remote-friendly · PT / EN

Credentials

Degrees and certifications, verifiable by ID. The testing certification is not an accident — evaluation of AI systems is software testing taken seriously.

now Doctoral Researcher, Data Science & Web TechnologiesUTAD / Universidade Aberta in progress
2025 MSc in Informatics Engineering & Web TechnologyUniversidade de Trás-os-Montes e Alto Douro (UTAD) — final grade 17/20 MESTRE
2025 ISTQB® Certified Tester, Foundation Level (CTFL v4.0)PSTQB — Portuguese Software Testing Qualifications Board CTFL4-2025-00297-PSTQB
2025 Certified Trainer — e-learning specialisation (CCP, Formador a Distância + Digital)IEFP — Instituto do Emprego e Formação Profissional FEe-f+769105/2025

Stack

Tools chosen for one property: they let me reason about what the system is doing.

agentsLangGraph · Pydantic AI · MCP · OpenTelemetry GenAI conventions
backendPython · FastAPI · PostgreSQL + pgvector · Neo4j · Graphiti
modelsvLLM · llama.cpp · Unsloth · PEFT · quantised local inference
practiceEvals as CI · append-only audit logs · row-level security · HITL gates

Contact

Open to conversations about agent orchestration, evaluation infrastructure and applied-AI consulting — from recruiters, and from teams whose agent systems work in the demo and fail in production.