Initial NVSkills-CI onboarding for TileGym skills

.agents/skills

@@ -0,0 +1 @@
+../skills

.claude/skills

@@ -1 +1 @@
-../.agents/skills
+../skills

.github/scripts/check_spdx_headers.py

@@ -33,11 +33,12 @@
 )
 # Default SPDX license identifier line for the main repo (MIT).
 SPDX_LICENSE = "SPDX-License-Identifier: MIT"
-# SPDX license identifier line used for skill files (under ``.agents/skills/``
-# and the ``.claude/skills`` symlink). These files are dual-licensed under
-# CC-BY-4.0 (documentation) AND Apache-2.0 (source code) per the NVIDIA
-# Skills Publishing Onboarding guide and the OSRB-approved CC-BY-4.0-Apache2
-# Dual License pattern.
+# SPDX license identifier line used for skill content files (under
+# ``skills/``, the canonical location; also accessible via the
+# ``.agents/skills`` and ``.claude/skills`` backward-compatibility symlinks).
+# These files are dual-licensed under CC-BY-4.0 (documentation) AND
+# Apache-2.0 (source code) per the OSRB-approved dual-license pattern; the
+# SPDX expression uses ``AND`` to reflect the legal scope.
 SPDX_LICENSE_SKILLS = "SPDX-License-Identifier: CC-BY-4.0 AND Apache-2.0"
 
 # Regex pattern to validate SPDX copyright lines with any valid year or year range
@@ -50,21 +51,23 @@
 # Public / exportable code (default): MIT only — matches the repo-wide license
 # for everything that is not a dual-licensed agent skill.
 #
-# Skill content (under ``.agents/skills/``): the dual-licensed combination
-# ``CC-BY-4.0 AND Apache-2.0`` only. We deliberately do not accept MIT here
-# so that the gate catches any skill file that was authored before the
-# relicensing or imported from elsewhere with a stale header.
+# Skill content files (under ``skills/``, non-SKILL.md): dual-licensed
+# ``CC-BY-4.0 AND Apache-2.0`` per OSRB approval. The NV-BASE validator only
+# inspects SKILL.md frontmatter (Tier 1), so the SPDX ``AND`` expression in
+# source-file headers is not seen by the validator and remains the legally
+# accurate scope marker.
 ALLOWED_LICENSES_DEFAULT: Tuple[str, ...] = ("MIT",)
 ALLOWED_LICENSES_SKILLS: Tuple[str, ...] = ("CC-BY-4.0 AND Apache-2.0",)
 
 # Directory names (anywhere under root) to skip entirely.
 #
-# ``.agents`` and ``.claude`` are skipped from the default walker because
-# they are dual-licensed and therefore cannot use the default MIT header.
-# Skill files under those directories are processed separately via
-# :func:`iter_skill_files` and :func:`iter_skill_content_files`, both of
-# which target ``.agents/skills/`` (the canonical path; ``.claude/skills``
-# is a symlink to ``../.agents/skills`` for agent-tool compatibility).
+# ``skills``, ``.agents`` and ``.claude`` are skipped from the default walker
+# because they are dual-licensed and therefore cannot use the default MIT
+# header. Skill files are processed separately via :func:`iter_skill_files`
+# and :func:`iter_skill_content_files`, both of which target the canonical
+# ``skills/`` path. ``.agents/skills`` and ``.claude/skills`` are
+# backward-compatibility symlinks pointing to ``../skills``; walking only
+# the canonical ``skills/`` avoids double-processing the same files.
 SKIP_DIRS = {
     ".git",
     "__pycache__",
@@ -75,6 +78,7 @@
     ".egg-info",
     "dist",
     "build",
+    "skills",
     ".agents",
     ".claude",
 }
@@ -196,7 +200,7 @@ def should_skip_file(file_path: Path, root_dir: Path) -> bool:
 
 
 # License field to insert into SKILL.md (and other frontmatter .md) files
-# under ``.agents/skills/``. These files are dual-licensed; the YAML
+# under ``skills/``. These files are dual-licensed; the YAML
 # ``license:`` field carries the same SPDX expression as the in-file SPDX
 # comment used for non-frontmatter files.
 SKILL_LICENSE_LINE = "license: CC-BY-4.0 AND Apache-2.0"
@@ -207,7 +211,7 @@ def should_skip_file(file_path: Path, root_dir: Path) -> bool:
 
 
 def iter_skill_files(root_dir: Path) -> Iterator[Path]:
-    """Yield .md files with YAML frontmatter under .agents/skills/.
+    """Yield .md files with YAML frontmatter under skills/.
 
     This includes SKILL.md files and any other .md files that start with
     ``---`` frontmatter (e.g. sub-skill definitions).  All yielded files are
@@ -217,12 +221,12 @@ def iter_skill_files(root_dir: Path) -> Iterator[Path]:
     that :func:`iter_skill_content_files` can give them a standard SPDX
     comment header instead.
 
-    Note: ``.claude/skills`` is a symlink to ``../.agents/skills`` for
-    backward compatibility with agents that hard-code the ``.claude/`` path.
-    Walking the canonical ``.agents/skills/`` path avoids double-processing
-    the same files via the symlink.
+    Note: ``.agents/skills`` and ``.claude/skills`` are symlinks to
+    ``../skills`` for backward compatibility with agents that hard-code the
+    older paths. Walking the canonical ``skills/`` path avoids
+    double-processing the same files via the symlinks.
     """
-    skills_dir = root_dir / ".agents" / "skills"
+    skills_dir = root_dir / "skills"
     if not skills_dir.is_dir():
         return
     for dirpath, _dirnames, filenames in os.walk(skills_dir):
@@ -314,7 +318,7 @@ def _has_yaml_frontmatter(path: Path) -> bool:
 
 
 def iter_skill_content_files(root_dir: Path) -> Iterator[Path]:
-    """Yield .py and ``SKILL.md`` files under .agents/skills/ for SPDX headers.
+    """Yield .py and ``SKILL.md`` files under skills/ for SPDX headers.
 
     .md files with YAML frontmatter (starting with ``---``) are handled by
     :func:`iter_skill_files` using the frontmatter ``license:`` approach.
@@ -331,7 +335,7 @@ def iter_skill_content_files(root_dir: Path) -> Iterator[Path]:
     ``SKILL.md`` that has not yet been migrated to YAML frontmatter, so the
     skill itself always advertises its license one way or another.
     """
-    skills_dir = root_dir / ".agents" / "skills"
+    skills_dir = root_dir / "skills"
     if not skills_dir.is_dir():
         return
     for dirpath, _dirnames, filenames in os.walk(skills_dir):
@@ -568,14 +572,14 @@ def action_write(root_dir: Path) -> int:
             print(f"Added header to: {file_path.relative_to(root_dir)}")
             modified_count += 1
 
-    # Handle SKILL.md (and other frontmatter .md) files under .agents/skills/.
+    # Handle SKILL.md (and other frontmatter .md) files under skills/.
     # These carry the dual-license expression in the YAML ``license:`` field.
     for skill_md in iter_skill_files(root_dir):
         if add_skill_license(skill_md, license_line=SKILL_LICENSE_LINE):
             print(f"Added/updated license in frontmatter: {skill_md.relative_to(root_dir)}")
             modified_count += 1
 
-    # Handle .py and non-frontmatter .md files under .agents/skills/.
+    # Handle .py and non-frontmatter .md files under skills/.
     # These are dual-licensed under CC-BY-4.0 AND Apache-2.0.
     for content_file in iter_skill_content_files(root_dir):
         comment_style = get_comment_style(content_file)
@@ -603,7 +607,7 @@ def action_check(root_dir: Path) -> int:
         if not check_file(file_path):
             missing_headers.append(file_path)
 
-    # Check SKILL.md (and other frontmatter .md) files under .agents/skills/.
+    # Check SKILL.md (and other frontmatter .md) files under skills/.
     for skill_md in iter_skill_files(root_dir):
         try:
             with open(skill_md, "r", encoding="utf-8") as f:
@@ -613,7 +617,7 @@ def action_check(root_dir: Path) -> int:
         except Exception as e:
             print(f"Error reading {skill_md}: {e}", file=sys.stderr)
 
-    # Check .py and non-frontmatter .md files under .agents/skills/. These
+    # Check .py and non-frontmatter .md files under skills/. These
     # must carry the dual-license SPDX expression.
     for content_file in iter_skill_content_files(root_dir):
         if not check_file(content_file, allowed_licenses=ALLOWED_LICENSES_SKILLS):

CONTRIBUTING.md

@@ -62,7 +62,7 @@ If you are adding a **new kernel** (new `@ct.kernel` / new op implementation) th
 
 New cuTile kernel contributions should first be placed in the `experimental/` directories. Once the TileGym team has fully verified functional correctness and performance, kernels will be promoted from `experimental/` into the main source tree.
 
-We provide `adding-cutile-kernel` skill for AI agent to add new kernels in this repo.
+We provide `tilegym-adding-cutile-kernel` skill for AI agent to add new kernels in this repo.
 
 ##### Directory structure
 
@@ -148,9 +148,10 @@ To accept your contribution, we need a signed Contributor License Agreement (CLA
 3. Email the signed CLA to `TileGym@nvidia.com` with subject: `TileGym CLA Submission`.
 4. Wait for confirmation from the TileGym team before your PR can be merged.
 
-### 5. Signing your work (DCO) — required for `.agents/skills/` contributions
+### 5. Signing your work (DCO) — required for `skills/` contributions
 
-Files under `.agents/skills/` (and the `.claude/skills/` symlink) are dual-licensed under
+Files under `skills/` (also accessible via the `.agents/skills/` and `.claude/skills/`
+backward-compatibility symlinks) are dual-licensed under
 **CC-BY-4.0 AND Apache-2.0** (see [`LICENSE`](LICENSE)). All contributions to the
 dual-licensed agent-skills content must be signed off via the
 [Developer Certificate of Origin](https://developercertificate.org/) (DCO).
@@ -159,7 +160,7 @@ dual-licensed agent-skills content must be signed off via the
 
 By signing off on a commit, you certify that the contribution is your original work, or
 that you have rights to submit it under the same license, or a compatible license.
-Any commit touching files under `.agents/skills/` that is not signed off will not be accepted.
+Any commit touching files under `skills/` (or its `.agents/skills/` / `.claude/skills/` symlinks) that is not signed off will not be accepted.
 
 #### How to sign off
 

LICENSE

@@ -6,27 +6,31 @@ This repository is distributed under two licenses:
      repository.
 
   2. The Agent License (CC-BY-4.0 AND Apache-2.0), set out in Section B
-     below, applies only to files located under the `.agents/` and
-     `.claude/` directories (recursively), if present in this repository.
+     below, applies only to files located under the `skills/` directory
+     (the canonical location), and equivalently under the `.agents/skills/`
+     and `.claude/skills/` paths (which are backward-compatibility symlinks
+     pointing to `skills/`), recursively, if present in this repository.
 
-For any file located under `.agents/` or `.claude/`, both licenses nominally
-apply; in the event of any conflict between them for those files, the Agent
-License in Section B controls. All other files in the repository are
-governed solely by the MIT License in Section A.
+For any file located under `skills/`, `.agents/skills/`, or `.claude/skills/`,
+both licenses nominally apply; in the event of any conflict between them for
+those files, the Agent License in Section B controls. All other files in the
+repository are governed solely by the MIT License in Section A.
 
 The Agent License additionally travels with the files it covers: it continues
 to apply to any copy, clone, relocation, or redistribution of those files,
 including installations into different directories used by other agent tools
 (for example, to support Codex or similar). The Agent License scope follows
 the files themselves, not only the original paths listed above.
 
-If the `.agents/` or `.claude/` directories do not exist in a given checkout
-of this repository, the scoping clauses above are inert for that checkout
-and the MIT License in Section A governs the entire checkout on its own.
+If the `skills/`, `.agents/`, or `.claude/` directories do not exist in a
+given checkout of this repository, the scoping clauses above are inert for
+that checkout and the MIT License in Section A governs the entire checkout
+on its own.
 
 --------------------------------------------------------------------------
 SECTION A — MIT LICENSE
-(APPLIES TO THE ENTIRE REPOSITORY EXCEPT FILES UNDER `.agents/` OR `.claude/`)
+(APPLIES TO THE ENTIRE REPOSITORY EXCEPT FILES UNDER `skills/`,
+ `.agents/skills/`, OR `.claude/skills/`)
 --------------------------------------------------------------------------
 
 SPDX-FileCopyrightText: Copyright (c) 2025 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
@@ -52,7 +56,7 @@ DEALINGS IN THE SOFTWARE.
 
 --------------------------------------------------------------------------
 SECTION B — AGENT LICENSE (CC-BY-4.0 AND Apache-2.0)
-(APPLIES ONLY TO FILES UNDER `.agents/` AND `.claude/`)
+(APPLIES ONLY TO FILES UNDER `skills/`, `.agents/skills/`, AND `.claude/skills/`)
 --------------------------------------------------------------------------
 
 Copyright (c) 2025 NVIDIA CORPORATION & AFFILIATES. All rights reserved.

skills/tilegym-adding-cutile-kernel/BENCHMARK.md

@@ -0,0 +1,88 @@
+# Evaluation Report
+
+Evaluation of the `tilegym-adding-cutile-kernel` skill before publication through NVSkills-Eval.
+
+This benchmark summarizes 3-Tier Evaluation from NVSkills-Eval results for the skill. The goal is to document whether the skill is safe, discoverable, effective, and useful for agents before it is published for broader workflow use.
+
+## Evaluation Summary
+
+- Skill: `tilegym-adding-cutile-kernel`
+- Evaluation date: 2026-05-29
+- NVSkills-Eval profile: `external`
+- Environment: `local`
+- Dataset: 5 evaluation tasks
+- Attempts per task: 2
+- Pass threshold: 50%
+- Overall verdict: PASS
+
+## Agents Used
+
+- `claude-code`
+- `codex`
+
+## Metrics Used
+
+Reported benchmark dimensions:
+
+- Security: checks whether skill-assisted execution avoids unsafe behavior such as secret leakage, destructive commands, or unauthorized access.
+- Correctness: checks whether the agent follows the expected workflow and produces the correct final output.
+- Discoverability: checks whether the agent loads the skill when relevant and avoids using it when irrelevant.
+- Effectiveness: checks whether the agent performs measurably better with the skill than without it.
+- Efficiency: checks whether the agent uses fewer tokens and avoids redundant work.
+
+Underlying evaluation signals used in this run:
+
+- `security` (Security): checks for unsafe operations, secret leakage, and unauthorized access.
+- `skill_execution` (Skill Execution): verifies that the agent loaded the expected skill and workflow.
+- `skill_efficiency` (Efficiency): checks routing quality, decoy avoidance, and redundant tool usage.
+- `accuracy` (Accuracy): grades final-answer correctness against the reference answer.
+- `goal_accuracy` (Goal Accuracy): checks whether the overall user task completed successfully.
+- `behavior_check` (Behavior Check): verifies expected behavior steps, including safety expectations.
+- `token_efficiency` (Token Efficiency): compares token usage with and without the skill.
+
+## Test Tasks
+
+The benchmark dataset contained 5 evaluation tasks:
+
+- Positive tasks: 1 tasks where the skill was expected to activate.
+- Negative tasks: 4 tasks where no skill was expected.
+- Unlabeled tasks: 0 tasks where positive/negative intent could not be inferred.
+
+Task composition is derived from the evaluation dataset when possible. Entries with `expected_skill` set are treated as positive skill-activation cases, while entries with `expected_skill: null` are treated as negative activation cases.
+
+## Results
+
+| Dimension | Num | `claude-code` | `codex` |
+|---|---:|---:|---:|
+| Security | 8 | 100% (+0%) | 100% (+0%) |
+| Correctness | 8 | 93% (-2%) | 95% (+3%) |
+| Discoverability | 8 | 87% (+0%) | 92% (+0%) |
+| Effectiveness | 8 | 95% (+0%) | 95% (+8%) |
+| Efficiency | 8 | 77% (+1%) | 85% (+1%) |
+
+Score values show skill-assisted performance. Values in parentheses show uplift versus the no-skill baseline when baseline data is available.
+
+## Tier 1: Static Validation Summary
+
+Tier 1 validation passed with observations. NVSkills-Eval ran 9 checks and found 8 total findings.
+
+Top findings:
+
+- MEDIUM SCHEMA/body_recommended_section: Missing recommended section: '## Examples' (`skills/tilegym-adding-cutile-kernel/SKILL.md`)
+- LOW QUALITY/quality_discoverability: Description very long (321 chars, recommend 50-150) (`skills/tilegym-adding-cutile-kernel/SKILL.md`)
+- LOW QUALITY/quality_discoverability: No '## Purpose' section (`skills/tilegym-adding-cutile-kernel/SKILL.md`)
+- LOW QUALITY/quality_reliability: No prerequisites/requirements documented (`skills/tilegym-adding-cutile-kernel/SKILL.md`)
+- LOW QUALITY/quality_reliability: No limitations documented (`skills/tilegym-adding-cutile-kernel/SKILL.md`)
+
+## Tier 2: Deduplication Summary
+
+Tier 2 validation passed. NVSkills-Eval ran 2 checks and found 0 total findings.
+
+Notable observations:
+
+- Context Deduplication: Collected 1 file(s)
+- Inter-Skill Deduplication: Parsed skill 'tilegym-adding-cutile-kernel': 321 char description
+
+## Publication Recommendation
+
+The skill is suitable to proceed toward NVSkills-Eval publication based on this benchmark. Skill owners should keep this file with the skill and refresh it when the evaluation dataset, skill behavior, or target agents materially change.

.agents/skills/adding-cutile-kernel/SKILL.md → skills/tilegym-adding-cutile-kernel/SKILL.md

@@ -1,5 +1,5 @@
 ---
-name: adding-cutile-kernel
+name: tilegym-adding-cutile-kernel
 description: Add a new cuTile GPU kernel operator to TileGym. Covers dispatch registration in ops.py, cuTile backend implementation, __init__.py exports, test creation, and benchmark in tests/benchmark. Use when adding, creating, or implementing a new cuTile operator/kernel in TileGym, or when asking how to register a new cuTile op.
 license: CC-BY-4.0 AND Apache-2.0
 metadata: