The Tech ArchiveThe Tech ArchiveThe Tech Archive
Small BusinessMarketingDevelopers
ArticlesTopicsSeriesAbout

Get the practical AI brief

Verified, no-hype AI tips you can actually use - in your inbox. Free.

No spam. We verify what we send. Unsubscribe anytime.

The Tech ArchiveThe Tech Archive

The Tech Archive

AI news, analysis & explainers

AboutSmall BusinessMarketingDevelopersArticlesTopicsSeriesMethodologyAI DisclosureCorrections

© 2026 All rights reserved.

Back to home
0 readers reading
  1. Home
  2. Articles
  3. Artificial Intelligence
  4. How to Build AI Agent Skills Instead of Collecting Them: A 2026 Framework

Contents

How to Build AI Agent Skills Instead of Collecting Them: A 2026 Framework
Artificial Intelligence

How to Build AI Agent Skills Instead of Collecting Them: A 2026 Framework

Stop collecting random AI skills from GitHub like trading cards. Learn the 5-step framework for building, auditing, and maintaining agent skills that actually work for your work.

Sham

Sham

AI Engineer & Founder, The Tech Archive

17 min read
0 views
August 1, 2026

Most AI agent skills installed from random GitHub repositories are dead weight — they bloat your context window, trigger unreliably, and can even introduce security risks. The better approach is to build a small set of focused, custom skills that encode your own business judgment, audit them for conflicts regularly, and treat them as evolving capability documents rather than collectible apps. This framework shows you how.

Last verified: 2026-08-01 — Skills are reusable instruction packages (SKILL.md files) that AI agents like Claude Code load on-demand to handle specific tasks. The right approach is building your own from your unique workflow knowledge, not hoarding community skills.

Table of Contents

  • What Are AI Agent Skills (and Why They're Not Apps)?
  • Why Installing Random Skills From GitHub Backfires
  • The Progressive Disclosure Architecture: How Skills Actually Load
  • How to Build a Custom AI Agent Skill (Step-by-Step)
  • The Skill Audit: Why More Skills = Worse Results
  • Skill Lineage: How to Fork and Evolve Skills Responsibly
  • What This Means for You
  • FAQ
  • Sources
  • Updates & Corrections

What Are AI Agent Skills (and Why They're Not Apps)?

AI agent skills are directories containing a SKILL.md file — a markdown document with YAML frontmatter and structured instructions — that teach an AI agent how to handle a specific type of task in a repeatable, consistent way. They are the most underused power feature in the Claude ecosystem, and in 2026, the community has grown from a handful of official examples to over a million community contributions indexed across marketplaces (Build Fast With AI, 2026).

The critical reframe: skills are not apps. When you install an app on your phone, it comes with a certificate, a sandbox, and a guarantee of how it works. Skills have none of that. A skill is simply a set of instructions — a recipe — that your AI reads at a particular point in time to get a job done. When you install someone else's skill, you are importing their set of decisions about the job, the tools, the acceptable shortcuts, and what "done" means for them. Those decisions may not align with your work.

Anthropic's official documentation defines the structure clearly: each skill is a folder with a SKILL.md file containing YAML frontmatter (at minimum, name and description) and a markdown body with instructions. Optional supporting files — scripts, templates, references — sit alongside SKILL.md and load only when needed (Claude Docs, Skills Overview).

Why Installing Random Skills From GitHub Backfires

The most common mistake in 2026 is treating skills like collectible cards — grab everything that looks interesting from GitHub, stuff it into your AI, and hope for the best. There are three concrete reasons this fails:

1. Security risk. A 2026 security audit of the Claude Code skills ecosystem found that 36.82% of published skills have at least one security flaw, and 13.4% contain critical-severity issues including malware distribution, prompt injection payloads, and exposed secrets. When a skill's scripts run, they execute with the same permissions as the user running Claude Code — full filesystem access, network access, and access to every environment variable in scope (Protego AI, 2026). A separate study found that 26.1% of community skills carry a security vulnerability (Atlan, 2026).

2. Unreliable triggering. The agent only sees the skill's name and description at startup (about ~100 tokens each). When your task matches that description, the full SKILL.md loads. If the description is vague or overly broad, the skill either never fires — making it dead weight — or fires on tasks where it doesn't belong, plugging up your context window with irrelevant instructions (Claude Docs, Skills Overview; Anthropic Claude Cookbooks, Skills README).

3. Skill conflict. When you accumulate 25+ skills, they start averaging out each other's instructions. The agent spends attention navigating conflicts between skills that give contradictory guidance, producing dull, diluted output. Worse, adding a skill to fix a problem can actually make output worse — and you won't know because there's no conflict detection built into the system. A 2026 UC Irvine study of 238 real skills found that 99% of SKILL.md files contain at least one skill smell — structural issues that degrade performance (Atlan, 2026).

The bottom line: installation can succeed perfectly on the filesystem and what you installed can be completely unusable. There is no app store certification, no sandboxing, and no standard for how skills interact.

The Progressive Disclosure Architecture: How Skills Actually Load

Progressive disclosure is the core mechanism that makes skills efficient. Instead of loading all skill content upfront, skills expose information in three stages, each loaded only when needed (Claude Docs, Skills Overview; Anthropic Claude Cookbooks, Skills README).

Stage What Loads When Token Cost
1. Metadata Skill name + description (YAML frontmatter) Always — at startup, for every installed skill ~100 tokens per skill
2. Instructions Full SKILL.md body When Claude determines the task matches the description Varies (keep under 5,000 tokens)
3. Resources Scripts, templates, reference docs Only when instructions point to them during execution On-demand only

This is why skills are more useful than pasting a giant prompt into every chat: the agent doesn't need every example, template, and script in its head for every conversation. It sees enough metadata to recognize the job, loads the operating instructions when the job arrives, and reaches for supporting material only when the instructions explicitly point there.

But this same advantage is why a badly written skill fails silently:

  • Vague description leads to the agent never knowing when to use it, producing a dead skill
  • Broad description leads to it appearing in unrelated jobs, polluting context
  • Bloated SKILL.md leads to the agent spending attention navigating a manual instead of doing the work

The recommendation from Anthropic's own cookbooks: keep SKILL.md under 500 lines and 5,000 tokens. Move detailed reference material to separate files in a references/ directory so Claude reads them only when the task needs them (Claude Code Docs, Skills).

How to Build a Custom AI Agent Skill (Step-by-Step)

Building your own skill is the better path for most users. You encode your own judgment — the decisions, the shortcuts, the definition of "done" that is unique to your work — into a reusable package the agent can execute reliably. Here is the process:

Step 1: Identify a Repeating Task

The best candidates for skills are tasks you do more than once a week with consistent output requirements: content formats, code review patterns, research synthesis structures, slide templates, outreach writing — anything that follows a repeatable pattern. If you keep pasting the same instructions into chat, that is a signal to create a skill.

Step 2: Capture Your Judgment — Use Your Voice

The most effective way to capture your implicit knowledge is to talk it out. Use GPT Live, WhisperFlow, or any voice-to-text tool, and explain what you want done as comfortably as you can. Your unique goals and objectives — the way you want tasks approached — are what make a skill worth building. Nobody else has your specific workflow context.

A practical example: someone reformatted a bread-baking recipe into a simple table structure that made the process dramatically easier to understand. That was their unique insight. Get that uniqueness out of your head and into a structured format the AI can follow.

Step 3: Write the SKILL.md File

Create a directory structure:

my-skill/
├── SKILL.md           # Main instructions (required, under 500 lines)
├── references/        # Detailed docs (optional, loaded on-demand)
│   └── workflow.md
├── examples/          # Example outputs (optional)
│   └── sample.md
└── scripts/           # Executable scripts (optional)
    └── validate.sh

Write the YAML frontmatter. The description is the most important field — it is the trigger mechanism. Use this formula: what it does + when to use it + what it produces. Be specific enough that the agent recognizes "this is a job for the skill, not for me." Keep it under 200 characters for Claude.ai skills; for Claude Code there is no hard limit but shorter is always better (Build Fast With AI, 2026).

---
name: quarterly-report-writer
description: >
  Generates quarterly business reports from CSV data. Use when the user
  shares sales/revenue data and asks to analyze, chart, or produce a
  formatted quarterly summary. Triggers on "quarterly report", "Q1 summary".
---

Write the markdown body. Be specific and actionable — state what to do, not why or how. Use numbered steps for procedures, because Claude follows sequences more reliably than unstructured prose. Include examples (they are the most effective way to steer output quality), and explain the reasoning behind decisions (Claude generalizes better from reasoning than from rigid rules) (AI for Developers, 2026).

Step 4: Test With Real Prompts

Pose 5 variant questions near the trigger and check whether Claude activates the skill correctly. Especially check for false positives — the skill activating on unrelated questions. Test with the kind of language real users actually type, including casual phrasing and typos. The first draft is rarely the best. Iterate based on what actually happens (AI for Developers, 2026).

A practical test framework:

  1. Write the prompt you would naturally type
  2. Write 2 variations with different wording
  3. Write 2 prompts that should NOT trigger the skill
  4. Check: does the skill fire reliably on steps 1-3 and stay silent on step 4?

Step 5: Version Like Code

Keep skills in git with semantic versioning. A breaking change (rename, drop a section) is a major version. Adding a step is minor. Wording fixes are patch. Pin versions if you need stability. This matters because skill lineage — the ability to trace how a skill evolved and fork it for a different purpose — is one of the most powerful patterns in the ecosystem (AnhTu.dev, 2026).

The Skill Audit: Why More Skills = Worse Results

If you are an advanced user with 25+ skills, you are almost certainly averaging out performance. Here is how to audit your stack:

1. Check for Description Conflicts

Read every skill's description. Do two or more skills claim overlapping territory? If so, the agent cannot reliably distinguish which to invoke. The fix: merge overlapping skills, or narrow each description to a specific, non-overlapping trigger. A skill whose description would trigger on 80% of questions is doing CLAUDE.md's job — it needs to be scoped down (AnhTu.dev, 2026).

2. Check for Instruction Conflicts

Do any two skills give contradictory guidance on the same type of task? For example, one skill says "always write tests first" and another says "generate code then add tests." The agent will average those instructions, producing output that satisfies neither. The fix: decide your house style and make sure all skills align.

3. Check for Dead Skills

A skill that never fires is dead weight — it costs ~100 tokens of metadata on every conversation and contributes nothing. Anthropic's internal research on its 300+ Claude Code skills used PreToolUse tracking to find low-trigger-rate skills. You can do the same: after a week of use, check which skills actually fired. If a skill never triggered, either its description is wrong (fix it) or you don't need it (remove it) (Atlan, 2026).

4. Check for Security Issues

Read every script file in every skill. Look for: outbound network calls, reads to .env files or credential stores, eval() or exec() calls, and anything that sends data to an external URL. A legitimate skill from a trusted author can still have security-sensitive behavior — one documented case involved a well-intentioned skill that loaded the project's entire .env file on first run (Protego AI, 2026).

The SkillsBench benchmark found that curated skills lift pass rates 16.2 points on average, but 16 of 84 tasks actually regressed after skill application. Removing the wrong skills can improve output more than adding new ones (Atlan, 2026, citing SkillsBench, arXiv:2602.12670).

Skill Lineage: How to Fork and Evolve Skills Responsibly

One of the most powerful patterns in 2026 is skill lineage — the practice of taking an existing skill, understanding what it does, and modifying it for your specific purpose rather than building from scratch every time. Approximately 80% of the time, you will want some kind of modification: taking inspiration from an existing skill, forking it for a different goal, or building on top of it. Only about 20% of the time will you find a community skill that works perfectly as-is.

The lineage pattern works like this:

  1. Find a trusted source. Only fork skills from people you know or repositories you trust. Anthropic's official skills repository on GitHub is the most reliable starting point.
  2. Read the SKILL.md completely. Understand what the skill does, what decisions it encodes, and what "done" means to the original author.
  3. Identify what you want to change. Maybe you want the skill's core behavior but with different output persistence, a different questioning approach, or different domain expertise.
  4. Fork and modify. Keep the parts that work. Change the parts that don't fit your workflow. Document what you changed and why — this is your skill's lineage record.
  5. Test the fork. Make sure your modifications still trigger reliably and produce better output for your specific use case.

A concrete example: the "Grill Me" skill, which questions you until a plan is fully thought through, was originally written with just four body sentences in its SKILL.md. It was easy to read, understand, and try in minutes. Another developer forked it because they wanted the questioning loop but with a different goal — making the resulting context persistent and inspectable so you only had to be questioned once. The fork kept the interview core from the original but changed the persistence behavior. Both skills serve different purposes, and the lineage is clear.

This is the key insight: skills are an evolving capability envelope, not a static collection. The secret to getting more out of your AI is not adding more skills — it is evolving the ones you have to better encode your judgment.

What This Means for You

For beginners: Stop installing skills you don't understand. Start by identifying one repeating task in your work, capturing how you want it done (use your voice — it makes you more specific), and building a single custom skill. Test it, iterate, and only add more when you genuinely need them.

For intermediate users: Audit your skill stack for conflicts and dead skills. Run the 4-point audit above — description conflicts, instruction conflicts, dead skills, and security issues. Removing 5 skills that conflict with each other will produce sharper output than adding 5 new ones.

For advanced users (25+ skills): You are the most at risk of averaging out your AI's performance. The more skills you have, the more conflicts the agent sorts through on every request. Run a full audit quarterly: trigger-rate analysis, conflict mapping, and security review. Treat skill management like knife sharpening — the goal is fewer, sharper skills, not more tools in the drawer. For managing your broader agent infrastructure, see our guide on AI agent operating system selection and how to cut Claude Code tokens with open-source tools.

For teams: Version skills in git. Distribute them through plugins (which bundle skills, commands, sub-agents, and hooks into a single package). Establish a review process for any skill that runs scripts or accesses external resources. The same skepticism you bring to running an arbitrary shell script should apply to installing a skill.


Related reading

  • Claude Skills tutorial for beginners
  • open source AI agent skills security infrastructure

FAQ

Q: What is a Claude skill vs. a Claude Code skill?

A: They use the same SKILL.md format but are two different systems. Claude.ai skills (browser-based) have descriptions limited to 200 characters and are available on Pro, Max, Team, and Enterprise plans. Claude Code skills (terminal-based) have no hard description limit, support additional features like subagent execution and dynamic context injection, and can be installed locally at .claude/skills/<name>/SKILL.md (Claude Docs, Skills Overview; Claude Code Docs, Skills).

Q: How many AI agent skills should I install?

A: Start with 3-5 focused skills that encode your most frequent recurring tasks. More than 10-15 skills without an audit process almost certainly produces conflicts that dilute output quality. The SkillsBench benchmark found that curated skills improve performance by 16.2 points on average, but 16 of 84 tested tasks actually regressed — meaning more skills can make things worse (Atlan, 2026).

Q: How do I write a skill description that triggers reliably?

A: Use the formula: what it does + when to use it + what it produces. Write in third person with explicit trigger language. Include example phrases that should activate the skill. Add anti-triggers ("do NOT use for X") when two similar skills might conflict. Keep it specific — a description like "Use this skill for any code task" will trigger on everything, breaking progressive disclosure (Build Fast With AI, 2026; AnhTu.dev, 2026).

Q: Are community AI skills from GitHub safe to install?

A: Not automatically. A 2026 security audit found 36.82% of published skills have at least one security flaw and 13.4% contain critical-severity issues. When a skill's scripts run, they execute with your full filesystem and network permissions. Always read SKILL.md and every script file before installing, check outbound network calls, and minimize the credentials in scope (Protego AI, 2026).

Q: How big should a SKILL.md file be?

A: Keep SKILL.md under 500 lines and 5,000 tokens. Move detailed reference material, long API docs, and bulky templates into separate files in a references/ directory. Claude reads these supporting files only when the instructions point to them — saving context tokens. Anthropic's official docs confirm this progressive disclosure architecture (Claude Code Docs, Skills; Anthropic Claude Cookbooks).

Q: How do I audit my existing AI skills for conflicts?

A: Run a 4-point audit: (1) check for overlapping descriptions that confuse the trigger mechanism, (2) check for contradictory instructions between skills on the same task type, (3) check trigger rates after a week of use to find dead skills, and (4) read every script for security issues. Anthropic used PreToolUse tracking on their 300+ internal skills to find low-trigger-rate skills — you can apply the same approach (Atlan, 2026).


Sources
  1. Claude Docs — Skills Overview. Anthropic. https://claude.com/docs/skills/overview
  2. Claude Code Docs — Extend Claude with Skills. Anthropic. https://code.claude.com/docs/en/skills
  3. Anthropic Claude Cookbooks — Skills README (Progressive Disclosure). Anthropic. https://github.com/anthropics/claude-cookbooks/blob/main/skills/README.md
  4. Claude Skills: The Complete 2026 Guide — Build, Install and Use. Build Fast With AI, May 2026. https://www.buildfastwithai.com/blogs/claude-skills-complete-guide-2026
  5. Agent Skill Best Practices: What Most Guides Skip. Atlan, July 2026. https://atlan.com/know/ai-agent/ai-agent-skills/agent-skill-best-practices/
  6. SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks. arXiv:2602.12670. https://arxiv.org/abs/2602.12670
  7. From Anatomy to Smells: An Empirical Study of SKILL.md in Agent Skills. arXiv:2607.01456 (UC Irvine, 2026). https://arxiv.org/html/2607.01456v1
  8. The Hidden Risk of AI Skills and MCP Servers: What to Check Before You Install. Protego AI, June 2026. https://protego.me/blog/claude-code-skills-mcp-security-risks-2026
  9. Claude Code Skills 2026 — Progressive Disclosure and How to Standardise Workflow. AnhTu.dev, 2026. https://anhtu.dev/claude-code-skills-2026-progressive-disclosure-and-how-to-standardise-workflow-for-engineering-teams-1062
  10. The Complete Guide to Creating and Using Claude Skills 2026. AI for Developers. https://aifordevelopers.substack.com/p/the-complete-guide-to-creating-and
  11. Claude best practices 2026: the complete power user guide. The AI Corner, April 2026. https://www.the-ai-corner.com/p/claude-best-practices-power-user-guide-2026
  12. OWASP Security Skill for Claude Code. GitHub, 2026. https://github.com/agamm/claude-code-owasp

Updates & Corrections
  • 2026-08-01 — Article published. All facts verified against primary sources on this date. Security statistics from Protego AI (June 2026) and Atlan (July 2026) are subject to change as the skills ecosystem evolves.

Get the practical AI brief

Verified, no-hype AI tips you can actually use - in your inbox. Free.

No spam. We verify what we send. Unsubscribe anytime.

Tags

#SKILL.md#"AI productivity"#"Claude Code"#"AI agent skills"#"prompt engineering"]

Discussion

0 comments
Sham

Sham

AI Engineer & Founder, The Tech Archive

AI engineer (Azure AI-102/AI-900). Writes practical, tested, hype-free guides on using AI for real work and small business at The Tech Archive.

Related Articles

View all
Claude Skills Tutorial for Beginners: The Complete 2026 Guide
Artificial Intelligence

Claude Skills Tutorial for Beginners: The Complete 2026 Guide

17 min
AI Agent Setup Decay: Why You Must Delete Your Prompt Scaffolding Every New Model Release (2026)
Artificial Intelligence

AI Agent Setup Decay: Why You Must Delete Your Prompt Scaffolding Every New Model Release (2026)

14 min
MiniMax H3: The AI Video Model That Generates 2K Film With Sound in One Prompt (2026)
Artificial Intelligence

MiniMax H3: The AI Video Model That Generates 2K Film With Sound in One Prompt (2026)

15 min
How to Fix AI Slop: The 2026 Framework for Subjective Quality in Generated Content
Artificial Intelligence

How to Fix AI Slop: The 2026 Framework for Subjective Quality in Generated Content

15 min
ChatGPT Voice on Desktop: How to Control Your Computer by Talking in 2026
Artificial Intelligence

ChatGPT Voice on Desktop: How to Control Your Computer by Talking in 2026

16 min
Kimi K3 AI Agent Setup: How to Pair a 2.8T Model With an Agent Framework (2026)
Artificial Intelligence

Kimi K3 AI Agent Setup: How to Pair a 2.8T Model With an Agent Framework (2026)

17 min