modbison/docs/planning/creator_studio.md

Creator Studio — Extended Authoring Tools

Feature: Creator Studio — Extended Authoring Tools Status: Planning Owner: Platform team

Feature Overview

Extends the in-game world editor (M6) toward a real authoring tool with:

1. Asset import pipeline (glTF models/textures)
2. Script editor with sandboxed API surface exposed clearly
3. Experience publishing flow (draft → review → live)
4. Basic analytics for creators (plays, session length)

User Stories

US-1: Asset Import Pipeline

As a creator, I can import glTF models and textures into my experience so that I can use custom 3D assets.

US-2: Script Editor with Sandboxed API

As a creator, I can write and test scripts in the editor with autocomplete/docs for the available API surface.

US-3: Experience Publishing Flow

As a creator, I can publish my experience through a draft → review → live pipeline so that players can discover and play it.

US-4: Creator Analytics

As a creator, I can see how many plays and average session length my experiences receive so that I can understand player engagement.

---

Task Breakdown

US-1: Asset Import Pipeline

T1.1: Backend — glTF Asset Model & Upload Endpoint

• Files: backend/app/models/asset.py (add glTF fields), backend/app/routers/assets.py (new endpoint)
• Scope: Extend Asset model with asset_type = "model_3d" support, add glTF-specific metadata fields (mesh_count, vertex_count, has_animation, texture_refs), add upload endpoint that accepts .glb/.gltf files and stores them in the upload directory with metadata extraction.
• Acceptance: POST /api/assets/{id}/upload with glTF file returns asset with extracted metadata; GET lists glTF assets; file stored on disk.
• Dependencies: None (builds on existing asset infrastructure)

T1.2: Backend — Asset Catalog API for Client Lookup

• Files: backend/app/routers/assets.py (new endpoints), backend/app/models/asset.py (minor additions)
• Scope: Add GET /api/assets/catalog endpoint that returns all public glTF assets with their metadata (name, thumbnail_url, mesh_count, vertex_count, tags). Add filtering by tags and pagination. This is what the editor's asset palette queries.
• Acceptance: Catalog endpoint returns paginated list of public assets; filtering by tag works; pagination params respected.
• Dependencies: T1.1

T1.3: Godot — glTF Import Utility (Editor-Side)

• Files: scripts/gltf_importer.gd (new), scripts/asset_catalog.gd (new)
• Scope: Godot-side utility that connects to the catalog API, downloads glTF files, and converts them to Godot-compatible resources (.res files with embedded mesh data). Provides import_gltf(url: String) -> Resource function. Handles texture extraction and mesh merging.
• Acceptance: import_gltf() downloads a glTF from the catalog, converts mesh to Mesh resource, returns a ready-to-use Godot resource. Texture files stored in user://assets/.
• Dependencies: T1.2

US-2: Script Editor with Sandboxed API

T2.1: Backend — Script Model & CRUD Endpoints

• Files: backend/app/models/script.py (new), backend/app/routers/scripts.py (new), backend/app/main.py (register router)
• Scope: Create Script model (id, name, world_id, owner_id, source_code, version, created_at, updated_at). Add full CRUD endpoints: POST /api/scripts/ (create), GET /api/scripts/ (list), GET /api/scripts/{id} (get), PUT /api/scripts/{id} (update), DELETE /api/scripts/{id} (delete). Scripts are owned by users and associated with a world.
• Acceptance: All CRUD endpoints work; scripts are owned by creator; list endpoint filters by owner/world; update increments version.
• Dependencies: None (new model + router)

T2.2: Backend — Script Execution Endpoint (Sandboxed)

• Files: backend/app/routers/scripts.py (add endpoint), backend/app/services/script_runner.py (new)
• Scope: Add POST /api/scripts/{id}/run endpoint that executes a script in a sandboxed context. Uses Godot's --headless mode with a minimal scene to run the script, capturing stdout/stderr and return value. Implements a timeout (30s) and memory limit. Returns execution result (stdout, stderr, exit_code, return_value).
• Acceptance: Script runs in headless Godot with timeout; result includes stdout/stderr/exit_code; timeout kills process; memory limit enforced.
• Dependencies: T2.1

T2.3: Godot — Script API Surface Definition

• Files: scripts/editor_script_api.gd (new), docs/architecture/scripting_sandbox.md (update)
• Scope: Define the public API surface available to creator scripts. This is a RefCounted class that wraps the Godot engine's capabilities into a safe, documented interface. Includes: WorldAPI (get_tile, get_object, set_property), PlayerAPI (get_position, get_health), AudioAPI (play_sound, play_music), NetworkAPI (send_event, broadcast). Each method has documented parameters and return types.
• Acceptance: EditorScriptAPI class exposes all documented methods; methods are callable from user scripts; API surface is self-documenting (each method has ## doc comments).
• Dependencies: None (standalone definition)

T2.4: Godot — In-Game Script Editor UI

• Files: scenes/editor_script_editor.tscn (new), scripts/editor_script_editor.gd (new)
• Scope: A Control-based UI panel that provides a script editor within the game. Features: code editor with syntax highlighting (basic), autocomplete dropdown, run button (calls backend /run endpoint), output console (shows stdout/stderr), API reference panel (shows available methods). Integrates with the existing editor toolbar.
• Acceptance: Editor panel opens from toolbar; code editor accepts input; autocomplete shows API methods; run button executes script and shows output; API reference panel is browsable.
• Dependencies: T2.2, T2.3

US-3: Experience Publishing Flow

T3.1: Backend — Experience Model & Status Transitions

• Files: backend/app/models/experience.py (new), backend/app/routers/experiences.py (new), backend/app/main.py (register router)
• Scope: Create Experience model (id, world_id, title, description, status, published_at, review_notes, reviewer_id). Status enum: DRAFT, SUBMITTED, IN_REVIEW, APPROVED, REJECTED, LIVE. Add endpoints: POST /api/experiences/ (create draft), POST /api/experiences/{id}/submit (submit for review), POST /api/experiences/{id}/approve (approve), POST /api/experiences/{id}/reject (reject), GET /api/experiences/ (list with status filter).
• Acceptance: All CRUD + transition endpoints work; status transitions enforced (DRAFT→SUBMITTED→IN_REVIEW→APPROVED→LIVE); rejected can be resubmitted; list filters by status.
• Dependencies: None (new model + router)

T3.2: Backend — Review Queue & Moderation Integration

• Files: backend/app/routers/experiences.py (add endpoints), backend/app/models/experience.py (add fields)
• Scope: Add review queue endpoint GET /api/experiences/review-queue (returns experiences in IN_REVIEW status). Add POST /api/experiences/{id}/review endpoint for moderators to add review notes and change status. Integrates with content moderation: when an experience is submitted, its world's content flags are computed and attached to the review.
• Acceptance: Review queue returns IN_REVIEW experiences; review endpoint accepts notes and status change; content flags attached on submit; only moderators can review.
• Dependencies: T3.1

T3.3: Godot — Publishing UI Panel

• Files: scenes/editor_publish_panel.tscn (new), scripts/editor_publish_panel.gd (new)
• Scope: A Control-based panel in the editor that lets creators manage their experience's publishing state. Features: title/description editor, status badge (DRAFT/SUBMITTED/LIVE), submit button, review notes display, publish history timeline. Integrates with the existing editor toolbar.
• Acceptance: Panel shows current status; submit button calls backend; review notes displayed; publish history shown; status badge updates on refresh.
• Dependencies: T3.1, T3.2

T3.4: Godot — Experience List & Discovery

• Files: scenes/experience_list.tscn (new), scripts/experience_list.gd (new)
• Scope: A UI panel that lists all experiences available to the player (LIVE status). Features: search/filter, experience cards (title, description, creator, play count), join button. Queries GET /api/experiences/?status=LIVE and displays results.
• Acceptance: Lists LIVE experiences; search filters by title/description; cards show metadata; join button loads the experience's world.
• Dependencies: T3.1

US-4: Creator Analytics

T4.1: Backend — Session & Play Tracking Model

• Files: backend/app/models/analytics.py (new), backend/app/routers/analytics.py (new), backend/app/main.py (register router)
• Scope: Create Session model for analytics (id, experience_id, player_id, started_at, ended_at, duration_seconds, chunk_loads, interactions_count). Create PlayEvent model for granular events (id, experience_id, player_id, event_type, payload, created_at). Add endpoints: POST /api/analytics/session/start (start session), POST /api/analytics/session/end (end session), POST /api/analytics/event (log event).
• Acceptance: Session start/end endpoints work; events logged; duration calculated correctly; endpoints accept valid experience/player IDs.
• Dependencies: None (new models + routers)

T4.2: Backend — Creator Dashboard Analytics Endpoint

• Files: backend/app/routers/analytics.py (add endpoint)
• Scope: Add GET /api/analytics/experience/{id} endpoint that returns aggregated analytics for an experience: total_plays, unique_players, avg_session_length, total_play_time, plays_over_time (daily breakdown), top_chunks_loaded, top_interactions. Data is aggregated from Session and PlayEvent tables.
• Acceptance: Returns all aggregated metrics; daily breakdown covers last 30 days; only owner or moderator can view; empty experience returns zeros.
• Dependencies: T4.1

T4.3: Godot — Analytics Tracking in Game

• Files: scripts/analytics_tracker.gd (new)
• Scope: A singleton-like service that tracks player sessions and events during gameplay. Automatically starts session on world load, tracks chunk loads, interactions, and time spent. Sends periodic heartbeat events to backend. Handles session end on world unload or disconnect.
• Acceptance: Session starts on world load; events logged during play; heartbeat sends every 60s; session ends on world unload; handles disconnect gracefully.
• Dependencies: T4.1

T4.4: Godot — Creator Analytics Dashboard UI

• Files: scenes/creator_analytics_panel.tscn (new), scripts/creator_analytics_panel.gd (new)
• Scope: A Control-based panel in the editor that displays analytics for the current experience. Features: total plays counter, avg session length, plays over time chart (simple bar chart), top chunks, top interactions. Queries GET /api/analytics/experience/{id} and renders data.
• Acceptance: Panel shows all metrics; chart renders bar chart of daily plays; data refreshes on button press; handles empty data gracefully.
• Dependencies: T4.2, T4.3

---

Database Migration Plan

New tables needed (in order):

1. scripts — script storage
2. experiences — publishing state
3. analytics_sessions — session tracking
4. analytics_events — granular events

Migration file: backend/alembic/versions/0003_creator_studio.py

---

Task Dependencies Summary

T1.1 (glTF upload) ──→ T1.2 (catalog API) ──→ T1.3 (Godot importer)
T2.1 (script model) ──→ T2.2 (run endpoint) ──→ T2.4 (editor UI)
T2.3 (API surface) ──┘
T3.1 (experience model) ──→ T3.2 (review queue) ──→ T3.3 (publish UI)
T3.1 ──→ T3.4 (discovery list)
T4.1 (tracking model) ──→ T4.2 (dashboard endpoint) ──→ T4.4 (analytics UI)
T4.1 ──→ T4.3 (game tracker) ──┘

Implementation Order Recommendation

1. T1.1 — Foundation: asset upload with glTF support
2. T2.1 — Foundation: script model + CRUD
3. T3.1 — Foundation: experience model + status transitions
4. T4.1 — Foundation: analytics tracking model
5. T1.2 — Asset catalog for editor
6. T2.3 — Script API surface definition
7. T2.2 — Script execution endpoint
8. T3.2 — Review queue integration
9. T4.2 — Analytics dashboard endpoint
10. T1.3 — Godot glTF importer
11. T2.4 — Script editor UI
12. T3.3 — Publishing UI panel
13. T3.4 — Experience discovery list
14. T4.3 — Analytics tracker in game
15. T4.4 — Analytics dashboard UI