Code Standards Enforcement
Last updated 2026-09-22What's new
- A skill is like a recipe that an AI agent (a tool that follows instructions) can use to consistently produce a desired output, such as a specific dish or a professional email.
- To create a skill, start with the final output you want and work backwards to figure out the steps needed to create it, similar to reverse engineering a favorite dish from a restaurant.
- Skills are written in a simple language called markdown (a way of formatting text using symbols like # and *) and include a section called YAML front matter (a way to add extra information) that describes the skill's name and when to use it.
- Skills can be as simple as a prompt to make an email sound more professional or as complex as a process to analyze stocks and recommend investments.
- Mike Chambers, a senior AI specialist at Amazon AWS, discusses two types of AI agents: those we use (like Claude Code, Cursor, and Kirao for productivity and coding) and those we build (custom agents for specific audiences).
- A "harness" in AI is like a set of straps controlling an animal, but for AI models; it's the non-model parts of an agent, including memory, skills, and tools (like documentation servers).
- AWS offers a free Agent Toolkit on GitHub to help deploy and manage AI agents, aiming to reduce "slop ops" (messy, inefficient operations) in cloud development.
- The new updates focus on adding safety checks to a support agent (a tool that helps customers) to prevent it from sharing private information or giving unsafe answers.
- The system now includes "guardrails" (safety barriers) that check incoming messages for sensitive data (like credit card numbers) before the AI processes them, and outgoing messages for brand alignment before the customer sees them.
- If a message contains sensitive data or is off-brand, the system stops the AI and sends the request to a human for review, ensuring safety and privacy.
- The updates also include a way to test both safe and unsafe paths to ensure the guardrails work as expected.
- Uber built a system called U Review (automated code review software) to speed up their software engineering teams' work, as manual code reviews were taking too long.
- U Review connects with Uber's existing tools, Fabricator (Uber's old code management system) and GitHub (a popular online code management service), and ensures consistent code review rules for both human engineers and AI agents (AI tools that help with coding tasks).
- The system collects feedback and data to improve its performance, tracking things like how often developers act on the AI's suggestions and the AI's decision-making process to reduce costs and increase quality.
- Uber found that AI models (the brains behind AI tools) need guidance and rules to work well, as they can be overly confident and may not catch team-specific coding styles or issues without proper training.
- **AI in healthcare is growing but has serious risks**: AI tools are now used by millions for health advice, but there are dangerous failures, like giving harmful diet tips or missing life-threatening emergencies.
- **Architecture is key to safety**: Most AI failures in healthcare come from poor design, not the AI models themselves, so building safe systems starts with good architecture.
- **Critical decisions should not rely on AI**: Things like emergency calls or handling sensitive health data should be handled by code, not AI, because AI can make mistakes.
- **Protecting health data is crucial**: Health data (PHI) must be secured at every level, not just with policies, and access should be limited based on roles and locations to follow strict laws like HIPAA.
- Claude code (Anthropic's coding agent tool) helps manage tasks by using structured inputs and outputs, like a contract, to make sure everything works reliably.
- It keeps context (relevant information) manageable by compacting and pruning, so old details don't mess up new tasks, and isolates tasks to keep them clean and focused.
- Claude code offers different workflow modes (like sessions or streaming output) and tools (like built-in code editors and search) to match the task at hand.
- It uses standing instructions (persistent project guidance), skills (packaged procedures), and commands (to invoke work) to streamline coding tasks and make them reusable.
- New lessons teach how to use AI tools like Claude (an AI assistant) responsibly, focusing on appropriate tasks, safe data handling, following policies, and keeping human oversight.
- AI should only be used for tasks where a human can review and correct its output, like drafting or summarizing, not for high-stakes decisions like legal or medical choices.
- Before using AI, check if the data is sensitive (like personal or business information) and follow rules like GDPR or company policies to protect it.
- Always use AI in a way that follows your organization's rules and policies, and when in doubt, ask for clarification or escalate the decision.
- The video walks you through creating a SaaS (software you pay for monthly online) product using AI, from idea to launch, with tools like Codex (AI coding assistant), Claude (AI thought partner), and Glido (voice-to-text AI).
- It focuses on six key areas: identifying a problem (pain), making a clear promise, building the product, setting up essentials (plumbing), making it look professional (packaging), and verifying everything works.
- The creator uses AI tools to speed up the process, but emphasizes that you're still in control and responsible for the final product.
- Different AI models are used together to get varied perspectives, with Claude for creative input and Codex for execution.
- Companies like WiseDocs (a medical claims processor) face challenges with slow AI pipelines, complex codebases, and difficulty updating systems.
- Technical debt (bad code that causes problems later) can slow down progress, but AI advancements are helping teams work faster.
- AI tools, like orchestrators (software that manages AI tasks), are improving, but it's important to verify claims (like those from Google and OpenAI) to avoid "AI psychosis" (believing hype over reality).
- Modern AI models, such as Sonnet 4.6 and Opus 4.8, are making coding tasks faster and more accurate, reducing manual work.
- **AI agents (automated digital assistants) are being used to build and run companies, automating tasks and improving productivity, like a "brain agent" at Verscell (a big company) that 1,000 employees use daily.**
- **Coding agents (AI that writes or assists with code) are a "killer app" (essential tool) for agents, helping both expert and beginner coders, with platforms like Vzero and Lovable making software creation more accessible.**
- **Agents can manage company data and tasks, like tracking customer info or navigating internal systems, making businesses more efficient, though this concept may still seem unfamiliar to many.**
- **Open-source models (free, community-developed AI tools) like Kimmy K3 are being used to build and improve agents for business workflows.**
- **Claude Code (Anthropic's AI coding assistant)** helps teams edit code, run commands, and follow project rules, making it easier to work together safely and efficiently.
- **Agent SDK (a toolkit for custom agents)** and **Claude API (a tool for custom apps)** let teams build their own automation and apps, choosing the right tool for the job.
- **Shared settings, hooks (automatic checks), and permissions** help teams work faster and safer, like giving a new hire a handbook, clear rules, and the right tools for the job.
- **Project memory (like a team handbook in Claude.md)** keeps everyone on the same page, while **skills and sub-agents (specialist tools)** help with specific tasks, making teamwork smoother.
- **Forward deployed engineering (FDE)** is a hot AI trend where companies like OpenAI and Google DeepMind send expert engineers to work directly with customers to customize AI tools for real-world use.
- **Factory**, a new AI tool, aims to automate software engineering tasks for businesses, acting as a "software factory" that builds and deploys code based on customer needs and feedback.
- Unlike traditional consulting, Factory's engineers focus on improving their product by learning from customers, rather than doing the work for them, to create a scalable business model.
- Factory's process involves capturing signals (like customer feedback or bug reports), prioritizing them, and automating the software development pipeline to create a smooth, AI-driven workflow.
- **Control Stack**: AI systems need multiple layers of review, like guardrails (rules limiting behavior) and threat models (identifying potential attackers and their goals), to prevent and diagnose failures.
- **Hallucination**: AI can confidently make up false information, so it's important to ground answers in provided evidence, use citations, and verify reasoning to prevent this.
- **Injection Attacks**: Both direct (user tricks) and indirect (hostile third-party content) injection attacks can redirect AI behavior, requiring different controls like input classifiers and isolation techniques.
- **Human Oversight**: Humans should maintain control over consequential actions, with clear authority and visibility in the system's architecture, using methods like Human-in-the-Loop (HITL) for high-stakes tasks.
- Learn to create unique web designs by first building a personal library of design inspiration from sites like Dribble (a website for designers to share their work), Pinterest (a visual bookmarking tool), and Twitter (a social media platform), to help cultivate your own taste.
- Use tools like Impeccable (an open-source design improvement tool with 23 different commands) to enhance and refine your web designs, making them more impactful and easier to understand.
- Develop a flexible roadmap for AI design work, including how to prototype, iterate, and tweak your designs until you achieve a result you like.
- AI tools are getting better at coding tasks, but they still make mistakes, especially with security and complexity, which can lead to problems later on.
- AI can make coding much faster at first, but after a few months, the extra speed goes away because of the extra work needed to fix mistakes and manage the more complicated code.
- AI tools can generate code that seems correct but isn't, which can cause big problems for businesses that rely on it, like law firms and accounting companies.
- AI is improving quickly, but it's not perfect yet, and it's important to find ways to make sure the code it generates is accurate and safe to use.
- Loops (automated processes that use AI to perform tasks) are becoming a key part of software development, with some experts arguing they're inevitable and already transforming how engineers work.
- Pro-loop advocates, like Jeff Huntley (creator of the Ralph loop, a type of AI automation), believe loops can automate tasks like coding and research, making them faster and more efficient.
- Critics, however, argue that loops aren't a perfect solution and that the hype around them might be outpacing their real-world effectiveness.
- The debate highlights that while loops show promise, there are still challenges and unknowns in their practical application.
- Engineers of the future will focus on deciding what's worth doing and being accountable for production decisions, with AI agents (automated tools) handling tasks.
- AI-assisted code is becoming common, making it crucial to have clean, maintainable code that helps both humans and AI agents.
- As AI generates more code than humans can review, it's important to make verification cheaper and clearer to ensure safety and trust.
- The value of humans in this process lies in judgment backed by evidence, with the focus shifting from what AI can do to where human judgment is most impactful.
- **Semantic tool selection** (picking the right tools for the job) helps AI agents (computer programs that use AI to do tasks) use fewer tokens (units of text AI processes), reducing costs and hallucinations (making up incorrect information).
- **Graph rack** (structured data search) replaces text searches with precise queries, helping AI agents find verifiable answers for tasks like counting or multi-step reasoning.
- **Multi-agent validation** (using a second AI agent) checks responses before they reach users, improving accuracy and catching errors.
- **Neuro-symbolic guardians** (rules written in Python programming language) ensure AI agents follow specific rules, preventing incorrect or unwanted actions.
- A new tool called Vector V1 was created to check the work of AI coding assistants (like Claude) using something called Claude hooks, which automatically runs Vector after Claude finishes a task.
- The speaker initially built Vector to ensure AI tasks were completed correctly, but later learned that future AI models might not need such checks due to increased smarts.
- Even with better AI models, verification is still crucial, as good instructions don't guarantee reliable results; guardrails and checks can help smaller, cheaper models perform well.
- The speaker realized that companies are building their own enforcement tools, so a universal, language-agnostic pattern is needed for widespread use and sharing.
- Gable 5 (a powerful AI model by Anthropic) is back after a temporary suspension, but with new safety measures that sometimes switch to a less capable model, Claude Opus 4.8 (another AI model), causing confusion in performance tests.
- Some benchmarks (tests that measure AI performance) may incorrectly show Gable 5 as worse because they don't account for these safety measures switching to Opus 4.8.
- While there are slight performance changes in Gable 5, many users blame the AI for poor results when they might not be using it correctly, highlighting the importance of proper AI usage techniques.
- Anthropic added improved safety classifiers (tools that detect and block unsafe or inappropriate requests) to prevent specific manipulation techniques.
- **Domain-specific agents** (AI tools designed for specific tasks or industries) are becoming crucial, as businesses want to integrate their unique data with AI for better efficiency.
- **Agents** (software that uses AI to complete tasks) are hard to build, requiring careful management of the "agentic loop" (the process the agent follows to complete tasks) and other complex challenges.
- **Tools like Vercel AI SDK** (a set of pre-built code for common AI tasks) and Eve (a framework for building agents) are emerging to help simplify the agent-building process.
- **Many businesses**, from small agencies to large corporations, are trying to build their own custom agents to leverage AI for significant gains.
- A public text file called Claude.md (a guide for an AI tool named Claude that writes code) was created based on complaints from a tech expert, reducing Claude's coding mistakes from 41% to 11%.
- Adding 12 specific rules to Claude.md further reduced coding errors to just 3%, without overwhelming the AI tool.
- Key rules include thinking before coding, prioritizing simplicity, making surgical changes, and setting token budgets (limits on how much text the AI can process).
- Additional rules help manage conflicts, encourage reading before writing, and reserve the AI for judgment calls, not fixed rules.
- OpenAI launched GPT-5.5 Cyber, a powerful AI model for cybersecurity, scoring higher than competitors like Anthropic's Mythos 5 on various benchmarks (tests that measure how well AI models perform specific tasks).
- GPT-5.5 Cyber is part of OpenAI's Daybreak initiative, which aims to not just find software vulnerabilities but also help fix them, addressing the issue of AI finding bugs faster than developers can patch them.
- The model is designed for authorized cybersecurity work and is more permissive, meaning it's less likely to reject legitimate security tasks, a common problem with other AI models.
- OpenAI also updated its Codex Security plugin, which helps developers scan code for vulnerabilities and generate patches, with the goal of making cybersecurity more accessible and integrated into development workflows.
- OpenAI and Enthropic, two leading AI companies, have both called for the world to slow down AI development, despite their own competitive incentives.
- OpenAI's plan includes creating AI that can do its own research, accelerating the economy, and forming an international group to coordinate AI development and slow it down if needed.
- Both companies acknowledge that they can't slow down on their own, as competition is too strong, and propose a global referee to ensure everyone stops together.
- The gap between AI developers and the general public is wide, with many people viewing AI negatively due to lack of understanding and exposure.
- New tools like "Grill Me Codeex" and "Grill with Docs Codeex" help turn fuzzy ideas into clear plans using AI, building on Matt PCO's original skills (tools that guide you through planning and building with AI).
- These tools add an extra step where Codeex (an AI that reviews code) checks Claude Code's (an AI that writes code) work, ensuring the plan makes sense to both, like a neutral referee.
- The process is iterative, meaning Claude Code and Codeex talk back and forth up to five times to improve the plan, giving you more confidence in the final result.
- This is especially helpful for non-technical users, as it bridges the gap between their ideas and optimal code, which can be hard to judge without expert knowledge.
- Spec 27 (a new tool for testing AI agents) helps you check if automated programs are working correctly.
- ADRs (short documents that record why a design choice was made) keep your team and AI from forgetting important reasons later.
- BDD (a way to describe product behavior in simple language) lets you write readable tests that both humans and AI can understand and run.
- AI agents (software that writes code for you) shift focus to instructions—what you tell them (called "context") now matters way more than traditional code.
- Reusable instructions (called "skills") beat individual code solutions because they adapt—tell an agent to detect your package manager (software installer) instead of coding for each situation.
- Test your instructions the same way you test code, using automated checks (called "evals"), to verify your agent produces good results when it uses them.
- Pull information from GitHub (code storage), Slack (team chat), and documentation so your agent has current details instead of guessing which library versions you use.
Key points
What it is
- Code Standards Enforcement means using automated rules to check every line of code (written by humans or AI) against your team's style, security, and quality guidelines.
- It creates hard constraints (rules locked into your tools that cannot be bypassed) to prevent bad code from reaching production.
- This is crucial for AI development, as over 50% of new code comes from AI, and 48% of AI-generated code contains security vulnerabilities.
- It catches common vulnerabilities and compliance failures automatically, reducing the need for manual reviews.
How to use it
- Start by creating a markdown file with a strict order: think, plan, build, review, test, ship, reflect. Each step becomes a command that feeds into the next one.
- Write a specifications document up front, laying out your intent, constraints, and acceptance criteria clearly.
- Add a pre-tool use hook (a script that runs automatically before tools execute) to enforce your allow list and deny list for the AI.
- Include rules like "code shall not be written by humans" or "code shall not be reviewed by humans" to enforce standards.
Watch out for
- Mixing global rules with task-specific instructions; keep project-wide standards separate from task-specific expertise.
- Letting your rules list grow too large; aim for around nine active rules per domain.
- Building redundant enforcement; check if the tool already supports what you need before building custom enforcement.
Tools named
- Slash security review (a tool for instant code analysis while writing).
Lesson 1: What is Code Standards Enforcement and why it matters
Code Standards Enforcement means using automated rules to check that every line of code—whether written by a human or an AI—follows your team’s agreed-upon style, security, and quality guidelines. When you enforce code standards, you are essentially creating hard constraints (rules locked into your tooling that cannot be bypassed) to prevent bad code from reaching production. This matters enormously for AI development because AI coding assistants now write a large and growing percentage of your codebase: over 50% of all new code comes from AI today, and that share is rising fast.
The problem is that 48% of AI-generated code contains security vulnerabilities. AI models also have a documented tendency to drift from your original guidelines over time, starting strong on day one but gradually ignoring constraints by day three. Without code standards enforcement, every AI-generated function and every autocompleted block becomes a potential vulnerability that needs manual review. That review bottleneck is already crushing developer productivity. Code standards enforcement solves this by catching common vulnerabilities and compliance failures automatically on every push, flagging issues before they ever reach a human reviewer.
Developers using AI have actually scored 17% lower on coding tests than those working by hand, primarily because they trusted AI output too readily. Enforcing standards forces the opposite behavior: you treat AI output like code from a junior developer, reviewing it carefully and testing it thoroughly. The best teams store their behavioral specifications outside the codebase entirely, so the AI never sees them during development—then enforce those specifications through code-level rules that check everything before merge. Code Standards Enforcement turns a chaotic, vulnerability-prone AI coding pipeline into a controlled, safe, and reviewable process.
Sources
- 2026-02-21 — Claude Found Zero-Day Vulnerabilities Traditional Scanners Missed
- 2026-04-13 — 100 Hours Testing Claude Code vs Antigravity (honest results)
- 2026-03-06 — Cursor Automations Clearly Explained (worth learning)
- 2026-02-25 — Goose Is Destroying Pi.dev and Claude Code
- 2026-03-01 — The Pattern Nobody's Talking About AI Safety Collapse 🔥
- 2026-02-10 — GPT-5.3 makes every other AI look ancient #AI #comparison
- 2026-01-29 — From Coder to Orchestrator The Developer Role Shift Nobody's Talking About
- 2026-03-12 — Build & Sell with Claude Code (10+ Hour Course)
- 2026-02-27 — Intent Engineering vs Context Engineering Which Actually Works
- 2026-03-03 — The One Skill AI Can't Replace -- Are You Developing It
- 2026-04-09 — Claude Code + Graphify = Local Rag (Unlimited Memory)
- 2026-02-25 — Claude Code Just Added What Everyone Wanted (Remote Control)
- 2026-02-02 — AI Coders Scored 17% Lower—Here's What They Did Wrong
Lesson 2: How to use Code Standards Enforcement: step-by-step
To enforce code standards, top engineers don't manually review every line. Instead, they set up workflows (instruction files written in markdown) that an AI agent follows for each task. Start by creating a markdown file with a strict order: think, plan, build, review, test, ship, reflect. Each step becomes a command that feeds into the next one.
First, write a specifications document up front. Lay out your intent, constraints, and acceptance criteria clearly. This saves time and tokens because the AI builds exactly what you specify. Next, add a pre-tool use hook (a script that runs automatically before tools execute). This hook enforces your allow list and deny list — telling the AI what it can do freely, what it must ask permission for, and what it cannot do at all.
For enforcement, include rules like "code shall not be written by humans" or "code shall not be reviewed by humans." Your workflow should lock architecture before any code is written, using a QA lead role that tests in a real browser and a release manager who opens pull requests. Each role challenges assumptions or audits with checklists.
Finally, keep everything in a single markdown file with plain language and simple formatting like headers and bold text. The agent reads these instruction files and builds software accordingly. By following this step-by-step process — writing a clear spec, adding a pre-tool hook, and using an ordered workflow — you enforce consistent standards without human oversight.
Sources
- 2026-05-04 — MCP vs Skills the real difference in Claude Code!
- 2026-04-20 — 9 Opus 4.7 Changes That Broke Your Claude Code!
- 2026-02-23 — From Zero to Your First Agentic AI Workflow in 26 Minutes (Claude Code)
- 2026-05-06 — Master 97% of Codex in 1 Hour (full course)
- 2026-03-20 — Gary Tan Just Open-Sourced His Entire Coding System #ai #programming #shorts
- 2026-03-06 — AI wrote this entire software factory #ai #coding
- 2026-03-12 — Build & Sell with Claude Code (10+ Hour Course)
- 2026-03-27 — Claude Channels + Google CLI = A Dead Lobster
- 2026-04-03 — 2 Claude Code Repos NOBODY'S Talking About Yet
- 2026-03-19 — This Free Claude Code Plugin Replaced My Entire Content Team
- 2026-02-02 — I Tested All 10 of Claude Code's Creator Tips 2026
- 2026-03-24 — STOP Using Bypass Permissions, Use This New Feature Instead
Lesson 3: Best practices and pitfalls
Code standards enforcement has several common pitfalls. One major mistake is mixing global rules with task-specific instructions. The rule is simple: project-wide standards that always apply go in Claude.md, while task-specific expertise that is only relevant sometimes should be separate skills. Don't mix them up. Another pitfall is letting your rules list grow too large. The best practice is to keep around nine active rules per domain; having 15 rules is a flag that your system needs hygiene.
A common error is building enforcement that becomes redundant. For example, one team built a hook (script that runs on events) to enforce P4 edit in a Perforce code base, but it became redundant the moment Claude code added native Perforce mode. Before building custom enforcement, check if the tool already supports what you need.
The top engineers enforce standards by acting like product managers and architects. They spend less time typing and more time thinking, reviewing, and directing. They use structured workflows like "think, plan, build, review, test, ship, reflect" and assign ownership with dedicated engineers building suites of plugins. They treat code review seriously — whenever you have code, always run builds, and consider building custom sub-agents whose only job is to review and QA everything before shipping. These reviewing agents catch things humans miss. For quick enforcement, use tools like slash security review to get instant analysis while you write code.
Sources
- 2026-03-19 — We Fixed the #1 Reason Claude Code Apps Fail
- 2026-05-04 — MCP vs Skills the real difference in Claude Code!
- 2026-03-20 — Gary Tan Just Open-Sourced His Entire Coding System #ai #programming #shorts
- 2026-01-16 — Build ANYTHING with Claude Code & n8n (Beginner's Guide)
- 2026-03-21 — You've Been Using Claude Skills Wrong #ClaudeAI #Tips
- 2026-04-03 — 2 Claude Code Repos NOBODY'S Talking About Yet
- 2026-01-29 — From Coder to Orchestrator The Developer Role Shift Nobody's Talking About
- 2026-05-15 — Anthropic Just Dropped Their Claude Code Playbook (Here's What Changed)
- 2026-04-16 — Claude Opus 4.7 vs 4.6 — Is It Just a Rebrand The Honest Benchmark Breakdown!
- 2026-04-16 — Claude Opus 4.7 Just Dropped... Or Did It Really
- 2026-01-25 — Agentic Workflows Just Changed AI Automation Forever! (Claude Code)
- 2026-02-21 — Claude Found Zero-Day Vulnerabilities Traditional Scanners Missed
- 2026-03-21 — Stop Learning n8n in 2026...Learn THIS Instead