AI Agents & Orchestration

Agent (topic)

Last updated 2026-08-01

What's new

2026-08-01
  • AI can help create a virtual executive officer (a digital assistant for business tasks) using tools like Claude Code (a coding assistant) and frameworks like Seed (a planning tool) and Skill Smith (a skill-building tool).
  • To build this officer, you need to know what you want it to do, what data it can use, and how to connect it to your other software tools using MCPs (command-line tools that act as bridges).
  • The focus is on AI augmentation (using AI to improve decisions) rather than full automation (replacing all human tasks), especially if your business processes aren't clearly defined yet.
  • You can use tools like Appify (a data scraper) to gather data from platforms like Instagram and YouTube, and integrate it with your officer for tasks like competitor analysis.
2026-07-31
  • Forward-deployed engineering (working closely with customers to solve problems) started as a way to ensure software stability (DevOps) and data integration (combining different data sources) for companies like Palantir (a data analysis company).
  • The term "forward-deployed engineering" has become too broad and vague, but it's still considered a hot job in AI (artificial intelligence).
  • A new discipline called agent engineering (AI systems that perform tasks for users) has emerged, with harness engineering (managing and coordinating AI agents) as a subset.
  • The speaker argues that everyone is essentially a forward-deployed engineer, working directly with customers and AI tools to solve problems.

Key points

What it is

  • An AI agent is an AI system that works toward a goal on its own, like an employee rather than a chatbot.
  • It has three main parts: a model (the AI brain), tools (like web search or file readers), and a loop (the process of deciding, acting, and checking results).
  • Unlike a chatbot, an agent is non-deterministic, meaning it adapts and changes as it goes, sometimes succeeding and sometimes failing.
  • Agents can read and work with text, code, images, or PDFs, and use tools to complete tasks.

How to use it

  • Start by defining the agent's purpose with a clear, plain-language instruction of what it should do and when to use it.
  • Add context, like examples of previous successful tasks, to help the agent understand what you expect.
  • Define the tools the agent can use, like search or data retrieval, and let it loop through reasoning and acting until the task is done.
  • Test your agent using evals (evaluations that measure performance) to ensure it follows guidelines and uses appropriate tone and vocabulary.

Watch out for

  • Avoid adding too much complexity to your agent, as this can degrade its performance.
  • Start with a simple agent and apply it to recurring tasks first, not one-off experiments.
  • Break complex systems into smaller, domain-specific agents to reduce the "vectors for failure" and make each agent more reliable.
  • Watch for "cascading failures," where an early mistake goes unnoticed, and design your attention like a system to prevent this.

Tools named

  • Claude (an AI assistant that can generate and manage sub-agents), Codex (a tool for building and testing AI agents)

Lesson 1: What is Agent (topic) and why it matters

An AI agent is a system that can work toward a goal on its own. The simplest way to picture it is a folder with three things inside: a model (the AI brain), tools (things like web search or file readers), and a loop (the process of deciding, acting, and checking results). One researcher found over 200 definitions, but the core idea is simple. You give an agent a goal. It decides what to do next, calls a tool, looks at the result, and keeps going until the task is done.

This matters for AI development because it changes how we use AI. A regular chatbot is like a meeting — you ask a question and get an answer. An agent is like an employee — you tell it what you want done, and it runs the full workflow. Think of a vending machine versus a slot machine. A vending machine is deterministic (same input, same output every time). An agent is non-deterministic — sometimes it wins, sometimes it loses, and it adapts as it goes.

Developers are moving away from supervising every step. Instead, they give guidance and let the agent handle the loop. An agent can read text, code, images, or PDFs, then work through tools instead of just producing chat. Understanding this shift — from simple chat to goal-directed autonomy — is one of the most important skills to learn in AI development today.

Sources

Lesson 2: How to use Agent (topic): step-by-step

To use an agent (an AI that performs tasks autonomously), start by defining its purpose. An agent is essentially a folder with three things: instructions, context, and tools. Begin with the core instruction—a plain-language description of what the agent should do and when to use it. In Claude, you can "generate with Claude" by typing something like "Create me a sub agent that criticizes all of my work." For the best results, be comprehensive in your description. The system prompt (the main instruction file) goes into a file named `claude.md` (if using Claude Code) or `agents.md` (if using Codex). This file holds the agent's behavioral rules.

Next, add context. Include an examples subfolder with previous winning proposals for the AI to reference. This helps the agent understand the quality and style you expect. Then, define tools—the functions the agent can call, like search or data retrieval. The agent works by looping through reasoning and acting: it thinks, checks the user input, decides if it should use a tool, acts, then cycles until finished.

To test your agent, use evals (evaluations that measure performance). For example, check if the agent follows business guidelines and uses appropriate tone and vocabulary. Evals become especially important when your agent has multiple steps or uses tools like search. They help catch when the agent goes off the rails. Start by applying your agent to a recurring task you do often—that's where agents are most useful.

Sources

Lesson 3: Best practices and pitfalls

When building an AI agent (a model using tools in a loop), the most common pitfall is adding too much complexity. As one expert warns, "every single thing you add to an agent risks making it worse." Large system prompts and too many edge cases often degrade performance rather than improve it.

The first best practice is to start simple. A basic agent needs three things: instructions, tools it can call, and the ability to run in a loop. Apply agents to recurring tasks first, not one-off experiments. Once you have a working agent, create evals (evaluations that test agent behavior) using specific examples that represent hard cases your agent must handle. Run the agent against these evals to identify exactly where it fails.

Break complex systems into smaller, domain-specific agents. When you find one agent trying to do too much, split it into separate subject matter experts. This reduces the "vectors for failure" and makes each agent more reliable. Use verifiers to check agent outputs, especially looking for disagreement between the agent and its reviewers. Have a subject matter expert tune the review process when conflicts arise.

A common failure mode is the "cascading failure" where an agent makes an early mistake that goes unnoticed because the system runs autonomously. To prevent this, design your attention like a system—be intentional about where you enter, what you require, and what you reuse. Also watch for agents that "don't do enough leg work" on a step, like failing to ask clarifying questions or explore a codebase thoroughly before proceeding.

Sources