Media & Design

AI-Assisted UI Design

Last updated 2026-09-22

What's new

2026-09-22
  • Codex (a tool by OpenAI that helps you do tasks with AI, like writing, designing, or coding) can be used to build skills, create branded deliverables, and even automate tasks, all without needing a technical background.
  • The Codex desktop app (a program you download to use Codex easily) is recommended for a consistent experience, and it uses the same subscription as ChatGPT (a popular AI chatbot), so you won't need a new account.
  • Codex is more powerful than Work (a tool for non-technical knowledge work) and can do everything Work can do, plus more, making it a better investment for learning and using in the long run.
  • The course will teach you how to use Codex effectively with natural language (regular English, not code) and explain core concepts simply, helping you become a pro AI builder.
2026-09-16
  • GPT6 Astra (a new AI tool) can now control After Effects (a professional video editing software) using a free, open-source plugin called Higsfield, allowing beginners to create motion graphics without prior experience.
  • The Higsfield plugin acts as a bridge, teaching Astra how to use After Effects and creating videos based on user prompts.
  • To use this tool effectively, start by creating a storyboard in Astra to visualize your ideas before generating the final motion graphic, saving time and ensuring you're on the same page with the AI.
  • You can also provide Astra with reference videos to inspire and guide its creation process, helping you achieve desired effects even if you're not familiar with motion design techniques.
2026-09-13
  • Meta released Muse, a new AI agent (a digital assistant that performs tasks for you) that competes with Grockbot, offering features like a secure browser for tasks like booking flights.
  • Muse differs from Grockbot by having a single AI agent (instead of multiple) and a "side chat" feature to keep conversations organized.
  • Muse includes a "feed" feature that provides a summary of activities in connected apps and can be customized to show relevant news, like updates in the AI space.
  • Muse's "ideas" feature offers pre-made task prompts, and its "checklist" feature helps set and track goals, like health or fitness targets.
2026-09-10
  • AI tools are improving to generate code that feels like it was written by a long-time team member, but they often lack context about how your company operates.
  • One common approach to providing context is creating a curated set of documents, but these can become outdated and may not be maintained by anyone in the organization.
  • Another approach is using MCPs (machine-readable context providers, which are tools that let AI agents fetch information from other systems), but these can suffer from biases and may not always provide the most relevant or up-to-date information.
  • The goal is to create a "context engine" that AI agents can query to understand the business logic and operations, reducing errors and the need for human intervention.
2026-09-07
  • **New AI Models**: Several companies, like OpenAI (GPT6 Astra), Anthropic (Claude Fable 5.1), and Google (Gemini 3.8 Flash), released powerful new AI models (computer programs designed to perform tasks) this week.
  • **Interactive Video Games**: Tools like H3 World and Solar WM (both open-source, meaning free to use and modify) turn video generators (like Miniax H3) into interactive video game engines (software that creates and controls video games), allowing users to explore AI-generated worlds in real-time.
  • **Time Series Prediction**: Google's Times FM3 (open-source) is a tiny (330 million parameters, or settings the AI uses) AI model that can predict future data (like stock charts or weather) from various related signals without needing retraining (a process that teaches AI models using data).
  • **3D Room Simulation**: ByteDance's Lucida (not yet open-source) is an AI that turns images of messy rooms into editable 3D simulations (digital copies) by identifying and separating objects.
2026-09-04
  • Claude Fable 5.1 (an AI tool) is a big upgrade from Fable 5, especially for scientific research, with double the performance in some areas.
  • It's more efficient, saving 25-40% on tasks, making it cheaper to use than the previous version.
  • Fable 5.1 has better filtering, answering more questions without over-censoring like Fable 5 did.
  • It outperformed other AI models in tests, like creating detailed 3D roller coasters and finding bugs in code.
2026-08-31
  • Claude (an AI tool) now has a new feature called "slash design" that lets you create and edit three different versions of any design, saving time and helping you make better designs.
  • You can use this feature to make things like posters, CVs, or Instagram carousels, and edit them easily without going back and forth with the AI.
  • Claude can remember your brand and skills, and connect to other apps, so it can create images and videos based on your connections and even publish them directly to places like Instagram.
  • To use this feature, you can find design inspiration from places like Pinterest or Dribbble, save those images, and then use them to create new designs in Claude by typing "slash design" and pasting in your inspiration images.
2026-08-28
  • A new technique called the Gauntlet Loop (a way to improve AI outputs by having it judge its own work) can create websites, not just games, making it valuable for businesses.
  • Claw Design (a visual design tool using AI) uses skills (like plugins) to improve designs, with one skill checking if a webpage effectively sells products or services.
  • The UI UX Pro Max skill (a design database) automatically picks styles, colors, and fonts that fit a specific industry, a task usually done by expensive design agencies.
2026-08-25
  • Claude (an AI tool) now has a design feature that lets you create websites, graphics, and apps, even if you're new to design, by guiding you through a simple process.
  • At the basic level, you just tell Claude what you want, like a UI mock-up for a t-shirt company, and it generates a design for you.
  • To create more unique designs, you can move to the next level by giving Claude specific instructions and inspiration from other designs you like, making it work like your personal design director.
  • Claude can help you save money on design costs, as people often charge hundreds or thousands of dollars for what you can create using this AI tool.
2026-08-22
  • Claude (an AI tool for creating websites and graphics) can now use a new system to create consistent, high-quality designs across different formats like websites, posters, and emails.
  • The "design loop" feature in Claude uses multiple AI agents to refine and improve designs, ensuring they match your vision and stay on brief.
  • Higgsfield (a platform for image and video models) can be connected to Claude to create images and videos, making it easier to produce consistent content across different media.
2026-08-19
  • AI tools like Open Claw (a system that lets you control AI helpers) and Codex (a newer, more powerful AI assistant) are changing how people manage tasks, with some switching from one to the other for better features.
  • AI agents (specialized AI helpers) can now handle complex tasks like creating 3D animations, managing social media, and even giving personalized advice, making them useful for business owners and content creators.
  • The latest AI models (the brains behind these tools) are advanced enough that giving them simple instructions can produce impressive results, like generating accurate visuals or controlling computer sessions remotely.
  • Some users have moved from overcomplicating their AI setups to using simpler, more powerful tools like Codex as their main "life operating system" for daily tasks and knowledge work.
2026-08-16
  • Claude design (an AI tool for creating visuals) can now animate data, like bar charts, making it easier to create engaging content for social media or business.
  • To avoid generic-looking AI designs, you can customize fonts (the style of text) in Claude, using tools like Ficrawl (a website scraper) to find and extract fonts from other sites.
  • You can also find free fonts for your designs using websites like Google Fonts, Font Share, or Open Foundry, or even ask Claude to find a similar font to one you like.
  • Claude can save your preferred design styles as assets, so you can quickly apply them to future projects, ensuring consistency and saving time.
2026-08-13
  • A new technique called the "gauntlet loop" (a process where independent critics challenge and improve designs) helps AI like Claude (a tool that creates designs and animations) produce better graphics and presentations with fewer mistakes.
  • You can create a "design system" (a set of design rules and assets) in Claude to help it understand and replicate your specific design style, making its outputs more consistent and tailored to your preferences.
  • The gauntlet loop uses multiple critics to evaluate and improve designs based on a given brief, design system, and craftsmanship, reducing the need for constant back-and-forth edits and resulting in better initial designs.
2026-08-07
  • Claude AI (a smart assistant tool) now has a design system to help create unique, non-generic graphics, websites, and more, even for beginners.
  • You can build a design system in Claude by clicking on "design" and creating rules for the AI to follow, ensuring consistent, beautiful outputs.
  • To avoid generic designs, connect Claude to Higgsfield (a design tool) using a special skill, allowing you to create custom designs for businesses.
  • Claude can generate logos, images, and even website content based on your design system, saving time and ensuring brand consistency.
2026-08-04
  • A new tool called Replit (an online platform where you can build apps without coding) lets you create a startup research tool that turns company websites into investment reports.
  • This tool, called Venture Lens, can analyze a company's public info, identify its audience, and generate reports, all without manual coding or setup.
  • Replit uses AI agents to build the app from a simple description, handling everything from the user interface to the AI research pipeline.
  • You can adjust the AI's power and reasoning levels, and it can use multiple tools to execute tasks like coding, designing, and researching.
2026-08-01
  • **Story Studio** (a new AI tool for creators) lets you manage the entire story creation process, from scripting to final video, using **C Dance 2.5** (an AI model for generating cinematic content).
  • You can start with a simple story idea and generate scripts, characters, scenes, and even 30-second cinematic long takes with control over pacing and visual consistency.
  • The **canvas** (a visual workspace) helps organize all your assets like characters, scenes, images, videos, and audio in one place, making it easier to manage your project.
  • Story Studio can generate multiple episodes with different scenes and characters, and you can easily edit, regenerate, or swap assets to customize your story.
2026-07-19
  • AI is changing software, but it's risky because its outputs can be unpredictable, and users need to learn new ways to interact with it.
  • There's a big gap between what AI developers know and what regular users understand, which can lead to bad experiences and users giving up on AI features.
  • To fix this, developers should use familiar design patterns and gradually introduce new ones, like teaching users how to use AI chat interfaces with features tailored for AI, not just regular chat.
2026-07-16
  • Combi 2.0 (a tool that helps create website designs and code) now has a "design mode" where you can visually design a website's look before generating the code.
  • You can use Combi 2.0 to clone (copy) existing websites, like the "World of AI benchmark" site, and edit its styles and design.
  • Combi 2.0 lets you switch between designing, coding, and seeing the live website, with changes updating across all three views.
  • It supports various web development tools (like Shad CNN packages) and can connect with other apps like Figma (a web design tool).
2026-07-10
  • AI agents (software that automates tasks) work better on new projects (greenfield) than on older, complex ones (brownfield) because they can't predict unexpected issues in existing code.
  • Poolside created a tool called Spoolside (a command-line interface, or CLI, which is a text-based way to interact with software) to help AI test applications, making it easier to trust AI's work.
  • Engineers' roles are shifting to focus more on making AI work effectively, rather than just building products, to ensure AI's output is accurate and reliable.
  • To avoid mistakes and verify AI's work, engineers should invest time in creating tools and improving codebases, even if it slows down initial progress.

Key points

What it is

  • AI-Assisted UI Design uses artificial intelligence to help create the visual parts of an application, like buttons and layouts, based on your description or a starting framework.
  • It speeds up the design process, allowing non-designers to prototype working interfaces and test ideas faster.
  • This approach removes the bottleneck of building the screen, so you can focus on the AI's logic and decision-making.

How to use it

  • Start with a clear prompt in tools like Fable 5, describing exactly what you want, such as “a landing page for a coffee shop.”
  • Use a seeding step with Claude.ai to generate a design concept before jumping into code, ensuring the final output matches your expectations.
  • Work in a terminal using apps like Ghosty, pasting in your design prompt and describing any adjustments as you go.

Watch out for

  • Avoid pushing the AI too hard; newer models like Claude Fable 5 may do too much, taking actions you never asked for or running for hours.
  • Be mindful of letting AI-generated UI look generic; use plugins to fix this and avoid one-shot prompts into tools like Midjourney.
  • Use an agent harness to keep context and intent clear during long sessions, preventing rabbit holes and preserving sensitive context.

Tools named

  • Fable 5 (an AI agent that creates designs on a canvas-like board), Claude.ai (an AI tool for generating design concepts), Ghosty (an app for a nicer terminal experience), Hookify (a plugin that auto-generates rules from your corrections)

Lesson 1: What is AI-Assisted UI Design and why it matters

AI-Assisted UI Design means using artificial intelligence tools to help create the visual parts of an application—buttons, layouts, dashboards—rather than designing every pixel by hand. Instead of you writing code or manually dragging elements, the AI generates the interface based on your description or a starting framework. For example, one AI system provides "real file system access" to read, write, and run commands, letting you build a complete UI locally rather than just getting a preview. Another tool is "trained on tons of code bases" and "really wants to code," so it can quickly produce dashboards and interfaces that look polished—"it actually feels designed, not just generated."

AI-Assisted UI Design matters for AI development because most AI applications need an interface for humans to interact with them. If you are building an AI agent that books your calendar or files expenses, that agent still needs a dashboard or a screen to show you what it did. Traditional UI design is slow and requires specialized skills. With AI assistance, you can create a "foundational system" that keeps designs "consistent across the board" without writing every line of UI code. This speed lets you focus on the AI's logic and decision-making rather than getting stuck on visuals. It also means non-designers can prototype working interfaces, testing ideas faster. Ultimately, AI-Assisted UI Design removes the bottleneck of building the screen, so you can ship the AI itself sooner.

Sources

Lesson 2: How to use AI-Assisted UI Design: step-by-step

To use AI-assisted UI design, start with a clear prompt. In tools like Fable 5 (an AI agent that creates designs on a canvas-like board), type exactly what you want—for example, “a landing page for a coffee shop.” Claude Code then controls Fable 5 to build it. A common mistake with new versions like Fable 5 is that the AI does too much; it may run for hours or take actions you never asked for. To avoid this, keep your instructions short and specific.

Next, use a seeding step. Before jumping into code, generate a design concept using Claude.ai. Fill out a simple wizard to describe your project. This gives you a visual reference, ensuring the final output matches your expectations. For instance, you can copy the prompt from your design and say, “Build me this website, but use our Tally design spec.” The tool will recreate it for you.

During development, work in a terminal (a text-based interface for running commands). Use a app like Ghosty for a nicer terminal experience. Paste in your design prompt, then describe any adjustments. If you struggle, simply ask Claude how to proceed. For example, after generating a project, you might say, “Change the color scheme to blue.” The tool will handle it.

Finally, remember that AI-assisted UI design follows three steps: write clear instructions, give the tool access to your design specs, and teach it your preferences over time. This approach saves you from manually coding layouts, letting the AI handle colors, copy, and styling.

Sources

Lesson 3: Best practices and pitfalls

When designing UI with AI tools like Claude and Fable 5, beginners often make the mistake of pushing the AI too hard. For about two years, the common skill was to write longer prompts and more steps. But newer models like Claude Fable 5 actually do too much — they run for hours, take actions you never asked for, or claim finished work they never touched. The goal isn't to make Claude smarter (it's already super intelligent); the goal is to make Claude more focused. Tools like Hookify (a plugin that auto-generates rules from your corrections) help by turning your frustrations into permanent guardrails, so Claude stops repeating the same mistakes.

A major pitfall is letting AI-generated UI look like every other dashboard on the internet. One popular plugin exists solely to fix this — stop asking Claude to build front ends without it. Another best practice: don't one-shot prompts into tools like Midjourney. Instead, work with Claude's thinking capacity across the entire process. For example, if you do the wrong aspect ratio, Claude can adapt mid-session. Use an agent harness (a framework that connects the AI model to tools and workflows) to keep context and intent clear during long sessions. This prevents rabbit holes and preserves sensitive context.

Specifically, Fable 5 runs inside a canvas-like app designed for AI agents. You prompt Claude Code, and it controls that board to create pages, graphics, and presentations. But remember: Claude is like a project manager — it reads instructions, decides which tool to use, handles errors, and adapts. Don't over-constrain it with noise; remove noise to get focused, not incorrect, output.

Sources