Better logs and shell

.beads/.gitignore

@@ -0,0 +1,17 @@
+# SQLite databases
+*.db
+*.db-journal
+*.db-wal
+*.db-shm
+
+# Daemon runtime files
+daemon.log
+daemon.pid
+bd.sock
+
+# Legacy database files
+db.sqlite
+bd.db
+
+# Keep JSONL exports (source of truth for git)
+!*.jsonl

.env.1password

@@ -0,0 +1,3 @@
+SCOTTY__DOCKER__REGISTRIES__FACTORIAL__PASSWORD=op://Kubernetes/Deploybot Kubernetes token/password
+SCOTTY__API__OAUTH__CLIENT_ID=op://Scotty/scotty local oauth gitlab/application_id
+SCOTTY__API__OAUTH__CLIENT_SECRET=op://Scotty/scotty local oauth gitlab/Secret

.github/workflows/ci.yml

@@ -57,6 +57,17 @@ jobs:
 
         steps:
             - uses: actions/checkout@v4
+
+            # Setup Rust toolchain for TypeScript generation
+            - uses: dtolnay/rust-toolchain@stable
+              with:
+                  toolchain: stable
+
+            # Generate TypeScript types from Rust code
+            - name: Generate TypeScript types
+              run: cargo run
+              working-directory: ts-generator
+
             - uses: oven-sh/setup-bun@v2
 
             # run any `bun` or `bunx` command

.github/workflows/claude-code-review.yml

@@ -17,16 +17,14 @@ jobs:
     #   github.event.pull_request.user.login == 'external-contributor' ||
     #   github.event.pull_request.user.login == 'new-developer' ||
     #   github.event.pull_request.author_association == 'FIRST_TIME_CONTRIBUTOR'
-
-    if: github.event.pull_request.user.type != 'Bot'
 
     runs-on: ubuntu-latest
     permissions:
       contents: read
       pull-requests: read
       issues: read
       id-token: write
-    
+
     steps:
       - name: Checkout repository
         uses: actions/checkout@v4
@@ -35,46 +33,25 @@ jobs:
 
       - name: Run Claude Code Review
         id: claude-review
-        uses: anthropics/claude-code-action@beta
+        uses: anthropics/claude-code-action@v1
         with:
-          anthropic_api_key: ${{ secrets.ANTHROPIC_API_KEY }}
-
-          # Optional: Specify model (defaults to Claude Sonnet 4, uncomment for Claude Opus 4.1)
-          # model: "claude-opus-4-1-20250805"
+          claude_code_oauth_token: ${{ secrets.CLAUDE_CODE_OAUTH_TOKEN }}
+          prompt: |
+            REPO: ${{ github.repository }}
+            PR NUMBER: ${{ github.event.pull_request.number }}
 
-          # Direct prompt for automated review (no @claude mention needed)
-          direct_prompt: |
             Please review this pull request and provide feedback on:
             - Code quality and best practices
             - Potential bugs or issues
             - Performance considerations
             - Security concerns
             - Test coverage
-
-            Be constructive and helpful in your feedback.
 
-          # Optional: Use sticky comments to make Claude reuse the same comment on subsequent pushes to the same PR
-          # use_sticky_comment: true
-
-          # Optional: Customize review based on file types
-          # direct_prompt: |
-          #   Review this PR focusing on:
-          #   - For TypeScript files: Type safety and proper interface usage
-          #   - For API endpoints: Security, input validation, and error handling
-          #   - For React components: Performance, accessibility, and best practices
-          #   - For tests: Coverage, edge cases, and test quality
-
-          # Optional: Different prompts for different authors
-          # direct_prompt: |
-          #   ${{ github.event.pull_request.author_association == 'FIRST_TIME_CONTRIBUTOR' && 
-          #   'Welcome! Please review this PR from a first-time contributor. Be encouraging and provide detailed explanations for any suggestions.' ||
-          #   'Please provide a thorough code review focusing on our coding standards and best practices.' }}
-
-          # Optional: Add specific tools for running tests or linting
-          # allowed_tools: "Bash(npm run test),Bash(npm run lint),Bash(npm run typecheck)"
-
-          # Optional: Skip review for certain conditions
-          # if: |
-          #   !contains(github.event.pull_request.title, '[skip-review]') &&
-          #   !contains(github.event.pull_request.title, '[WIP]')
+            Use the repository's CLAUDE.md for guidance on style and conventions. Be constructive and helpful in your feedback.
+
+            Use `gh pr comment` with your Bash tool to leave your review as a comment on the PR.
+
+          # See https://github.com/anthropics/claude-code-action/blob/main/docs/usage.md
+          # or https://docs.claude.com/en/docs/claude-code/cli-reference for available options
+          claude_args: '--allowed-tools "Bash(gh issue view:*),Bash(gh search:*),Bash(gh issue list:*),Bash(gh pr comment:*),Bash(gh pr diff:*),Bash(gh pr view:*),Bash(gh pr list:*)"'
 

.github/workflows/claude.yml

@@ -32,33 +32,19 @@ jobs:
 
       - name: Run Claude Code
         id: claude
-        uses: anthropics/claude-code-action@beta
+        uses: anthropics/claude-code-action@v1
         with:
-          anthropic_api_key: ${{ secrets.ANTHROPIC_API_KEY }}
+          claude_code_oauth_token: ${{ secrets.CLAUDE_CODE_OAUTH_TOKEN }}
 
           # This is an optional setting that allows Claude to read CI results on PRs
           additional_permissions: |
             actions: read
-
-          # Optional: Specify model (defaults to Claude Sonnet 4, uncomment for Claude Opus 4.1)
-          # model: "claude-opus-4-1-20250805"
-
-          # Optional: Customize the trigger phrase (default: @claude)
-          # trigger_phrase: "/claude"
-
-          # Optional: Trigger when specific user is assigned to an issue
-          # assignee_trigger: "claude-bot"
-
-          # Optional: Allow Claude to run specific commands
-          # allowed_tools: "Bash(npm install),Bash(npm run build),Bash(npm run test:*),Bash(npm run lint:*)"
-
-          # Optional: Add custom instructions for Claude to customize its behavior for your project
-          # custom_instructions: |
-          #   Follow our coding standards
-          #   Ensure all new code has tests
-          #   Use TypeScript for new files
-
-          # Optional: Custom environment variables for Claude
-          # claude_env: |
-          #   NODE_ENV: test
+
+          # Optional: Give a custom prompt to Claude. If this is not specified, Claude will perform the instructions specified in the comment that tagged it.
+          # prompt: 'Update the pull request description to include a summary of changes.'
+
+          # Optional: Add claude_args to customize behavior and configuration
+          # See https://github.com/anthropics/claude-code-action/blob/main/docs/usage.md
+          # or https://docs.claude.com/en/docs/claude-code/cli-reference for available options
+          # claude_args: '--allowed-tools Bash(gh pr:*)'
 

.gitignore

@@ -1,5 +1,8 @@
 /target
+/ts-generator/target
 frontend/node_modules
+frontend/src/generated/
+scotty-types/bindings/
 docs/node_modules
 docs/_site
 apps/test-nginx-creation

.zed/debug.json

@@ -0,0 +1,18 @@
+// Project-local debug tasks
+//
+// For more documentation on how to configure debug tasks,
+// see: https://zed.dev/docs/debugger
+[
+    {
+        "label": "Build & Debug scotty server",
+        "build": {
+            "command": "cargo",
+            "args": ["build", "--bin", "scotty"]
+        },
+        "program": "$ZED_WORKTREE_ROOT/target/debug/scotty",
+        // sourceLanguages is required for CodeLLDB (not GDB) when using Rust
+        "sourceLanguages": ["rust"],
+        "request": "launch",
+        "adapter": "CodeLLDB"
+    }
+]

CLAUDE.md → AGENTS.md

@@ -1,4 +1,6 @@
-# CLAUDE.md
+# AGENTS.md
+
+BEFORE ANYTHING ELSE: run 'bd onboard' and follow the instructions
 
 This file provides guidance to Claude Code (claude.ai/code) when working with code in this repository.
 
@@ -7,7 +9,7 @@ This file provides guidance to Claude Code (claude.ai/code) when working with co
 Scotty is a Rust-based Micro-PaaS (Platform as a Service) that provides an API to manage Docker Compose-based applications. It consists of three main components:
 
 - **scotty**: HTTP server providing REST API and web UI for managing applications
-- **scottyctl**: CLI application for interacting with the Scotty server  
+- **scottyctl**: CLI application for interacting with the Scotty server
 - **scotty-core**: Core library containing shared data structures and settings
 
 ## Architecture
@@ -23,7 +25,7 @@ Scotty manages applications by:
 
 Scotty supports three authentication modes (configured via `auth_mode`):
 - **Development**: No authentication required, uses fixed dev user
-- **OAuth**: Authentication via oauth2-proxy with GitLab OIDC integration  
+- **OAuth**: Authentication via oauth2-proxy with GitLab OIDC integration
 - **Bearer**: Traditional token-based authentication
 
 Authentication is handled by the `basic_auth.rs` middleware which extracts user information based on the configured mode.
@@ -56,7 +58,7 @@ cd frontend
 # Install dependencies (use bun instead of npm)
 bun install
 
-# Run development server  
+# Run development server
 bun run dev
 
 # Build for production
@@ -109,7 +111,7 @@ cd examples/oauth2-proxy
 # Start in development mode (no auth)
 ./start-dev.sh dev
 
-# Start with OAuth (requires GitLab app configuration)  
+# Start with OAuth (requires GitLab app configuration)
 op run --env-file="./.env.1password" -- ./start-dev.sh oauth --build
 
 # Start in bearer token mode
@@ -137,7 +139,7 @@ op run --env-file="./.env.1password" -- ./start-dev.sh oauth --build
 apps/
 ├── my-app/
 │   ├── docker-compose.yml          # Required
-│   ├── .scotty.yml                 # Optional app settings  
+│   ├── .scotty.yml                 # Optional app settings
 │   ├── docker-compose.override.yml # Generated by Scotty
 │   └── ... (other app files)
 ```
@@ -162,15 +164,41 @@ Scotty generates appropriate configurations for:
 - Supports custom middlewares, basic auth, robots.txt prevention
 - Automatic SSL via Let's Encrypt integration
 
-### HAProxy-Config (Legacy)  
+### HAProxy-Config (Legacy)
 - Uses environment variables for configuration
 - Limited feature set compared to Traefik
 
 ## Development Notes
 
 - Use workspace-level Cargo.toml for shared dependencies
-- Frontend uses Bun instead of npm for package management  
+- Frontend uses Bun instead of npm for package management (62% faster builds)
+- TypeScript generation optimized with standalone `ts-generator` crate (6s vs 27s)
+- All shared types consolidated in `scotty-types` crate (single source of truth)
+- Docker builds support multiple platforms (ARM64, x86_64, glibc, musl)
 - Conventional commits are enforced via git-cliff
 - Pre-push hooks via cargo-husky perform quality checks
 - Container apps directory must have identical paths on host and container for bind mounts
-- Use conventional commit messages
+- Use conventional commit messages
+- **IMPORTANT**: Always run quality checks before committing:
+  - Rust code: `cargo fmt` and `cargo clippy`
+  - Frontend code: `cd frontend && bun run lint` (runs Prettier and ESLint)
+  - If linting fails, run `bun run format` to auto-fix formatting issues
+
+## Current Work in Progress
+
+### Unified Output System Implementation
+
+**Branch:** `feat/better-logs-and-shell`
+
+See beads issues (scotty-1 and children) for current implementation status and remaining work.
+
+**Reference Documents:**
+- `docs/prds/unified-output-system.md` - Complete PRD and technical specifications
+- `docs/technical-spike-bollard-findings.md` - Bollard API validation results
+
+**Key Notes:**
+- The build files of scotty_frontend will be embedded into scotty, so restart scotty after the frontend files got rebuilt
+- Backend log streaming and shell services are fully implemented and tested
+- CLI `app:logs` command is fully functional with real-time streaming
+- Frontend task output viewer uses WebSocket integration
+- Breaking change: TaskDetails no longer contains stdout/stderr fields (uses WebSocket streaming instead)