Generated Files vs Existing Files - Evaluation Report

Date: December 2, 2025 Evaluator: Claude Code Decision: KEEP EXISTING FILES - Archive generated files

Executive Summary

After a comprehensive line-by-line comparison, the existing production files are vastly superior to the generated reference implementations in all five categories. The generated files appear to be simplified templates with placeholder URLs, while the existing files are production-ready with complete feature sets, real deployment URLs, and robust error handling.

Recommendation: Archive the generated files and maintain the existing production implementations.

Detailed Comparison

1. Static Registry Configuration

Generated (41 lines):

CELL_REGISTRY = {
    "research": "https://mizoki-cell-01-research-uc.a.run.app",  # PLACEHOLDER
    "coder": "https://mizoki-cell-02-coder-uc.a.run.app",        # PLACEHOLDER
    # ... only 8 entries
}

Existing (224 lines):

CELL_REGISTRY = {
    "cell01": "https://miz-oki-cell1-698171499447.us-central1.run.app",  # REAL
    "cell02": "https://miz-oki-cell2-698171499447.us-central1.run.app",  # REAL
    # ... complete 32 cells with real URLs
}

CAPABILITY_REGISTRY = {
    "research": "https://miz-oki-cell1-698171499447.us-central1.run.app",
    "coder": "https://miz-oki-cell2-698171499447.us-central1.run.app",
    # ... 30+ capability mappings
}

CELL_CAPABILITIES = {
    "cell01": ["data-ingestion", "source-discovery"],
    # ... complete capability descriptions
}

2. Cell Invoker (A2A Communications)

Generated (69 lines):

class CellInvoker:
    def invoke_cell(self, capability, payload, session_id):
        # Single sync method only
        response = requests.post(target_url, json=payload, headers=headers, timeout=120)

Existing (410 lines):

class CellInvoker:
    def invoke_cell(self, capability, payload, session_id, timeout=120):
        # Sync with configurable timeout

    async def invoke_cell_async(self, capability, payload, session_id, timeout=120):
        # Full async support for FastAPI

    def invoke_cell_by_id(self, cell_id, payload, session_id, timeout=120):
        # Direct cell ID invocation

    def invoke_multiple_cells(self, tasks, session_id):
        # Batch invocation

# Standalone async functions
async def invoke_cell_http(cell_url, payload): ...
async def ping_cell(cell_url): ...

# Singleton + convenience functions
cell_invoker = CellInvoker()
def invoke_cell(capability, payload, session_id): ...

3. Unified Memory Manager (Firestore)

Generated (67 lines):

class UnifiedMemory:
    def add_interaction(self, role, content, agent_id="boss"): ...
    def store_agent_artifact(self, agent_id, artifact_type, data): ...
    def get_full_context(self, limit=10): ...

Existing (253 lines):

class UnifiedMemory:
    def add_interaction(self, role, content, agent_id="boss"): ...
    def store_agent_artifact(self, agent_id, artifact_type, data): ...
    def get_full_context(self, limit=10): ...
    def get_artifacts(self, artifact_type=None, limit=10): ...
    def get_session_metadata(self): ...
    def update_session_metadata(self, metadata): ...
    def end_session(self): ...
    def add_routing_decision(self, task, routed_to, confidence, reasoning): ...
    def get_routing_history(self, limit=20): ...

# Convenience functions
def get_or_create_session(session_id): ...
def cleanup_old_sessions(days=7): ...

4. Boss Agent Core

5. Frontend API Service

Generated (63 lines):

const API_BASE_URL = process.env.REACT_APP_API_URL || 'http://localhost:8080';

export const MizokiApi = {
  sendMessage: async (message, sessionId) => { ... },
  checkHealth: async () => { ... }
};

Existing (232 lines):

const API_BASE_URL = process.env.NEXT_PUBLIC_BOSS_AGENT_URL ||
                     'https://boss-agent-adk-698171499447.us-central1.run.app';

export const MizokiApi = {
  sendMessage: async (message, sessionId) => { ... },
  processTask: async (task, userId, context) => { ... },
  getAgents: async () => { ... },
  getAgentDetails: async (agentId) => { ... },
  executeAgent: async (agentId, task, context) => { ... },
  getRegistry: async () => { ... },
  getSystemStatus: async () => { ... },
  checkHealth: async () => { ... },
  getBaseUrl: () => API_BASE_URL
};

Summary Comparison Table

Final Verdict

Decision: ARCHIVE GENERATED FILES

The generated files serve no purpose in the production codebase:

1. Placeholder URLs - Would break production if deployed
2. Missing Features - Lack async support, multiple invocation patterns, observability
3. Wrong Framework - React instead of Next.js for frontend
4. Incomplete Coverage - 8 cells vs 32 cells
5. No Session Lifecycle - Missing cleanup, metadata management

Action Plan

1. Move generated files to archive/reference_implementations/
2. Keep existing production files unchanged
3. Document this evaluation for future reference

Archive Location

archive/
└── reference_implementations/
    └── 2025-12-02_generated_fixes/
        ├── backend/
        │   ├── config/
        │   │   └── static_registry.py
        │   ├── orchestration/
        │   │   └── invoker.py
        │   ├── services/
        │   │   └── boss_agent/
        │   │       └── core.py
        │   └── shared/
        │       └── memory/
        │           └── unified_memory.py
        ├── frontend/
        │   └── src/
        │       └── services/
        │           └── mizokiApi.ts
        └── README.md (this evaluation)