Strong Dev Environment
SAM LMS reaches Level 2 with 50% Dev Environment pass rate. Currently building team readiness with 12/55 criteria passing (22%). Key areas for improvement include the opportunities listed below.
Strengths
01
Build Cmd Doc
README.md documents build commands: npm run build for both workspaces.
02
Single Command Setup
README documents 'npm run setup' for complete project setup.
03
Vcs Cli Tools
gh CLI is installed and authenticated.
Opportunities
01
Cyclomatic Complexity
Add complexity analysis to identify and refactor overly complex functions.
02
Feature Flag Infrastructure
Add feature flags to enable safer deployments and gradual rollouts.
03
Integration Tests Exist
Add integration tests to verify component interactions and catch issues unit tests miss.
All Criteria
Style & Validation0/11 (0%)
—code_modularizationSkipped: No module boundary enforcement tools found.
✗cyclomatic_complexityNo complexity analysis tools (ESLint complexity, lizard, SonarQube) found.
✗dead_code_detectionNo dead code detection tools (knip, ts-prune, vulture, ESLint no-unused-vars) found.
✗duplicate_code_detectionNo duplicate code detection tools (jscpd, PMD CPD, SonarQube) found.
✗formatterNo Prettier config (.prettierrc*) found in either application.
✗large_file_detectionNo git hooks, CI checks, .gitattributes with LFS, or linter rules for file size found.
✗lint_configFrontend has eslint.config.js; backend has no ESLint config.
—n_plus_one_detectionSkipped: No ORM or N+1 query detection tools found.
✗naming_consistencyNo ESLint naming-convention rules, documented conventions, or naming enforcement found.
✗pre_commit_hooksNo Husky, lint-staged, or .pre-commit-config.yaml found.
✗strict_typingBackend has strict: true in tsconfig; frontend uses JSX (not TypeScript).
✗tech_debt_trackingNo TODO/FIXME scanners, tech debt tracking tools, or SonarQube found.
✗type_checkBackend tsconfig.json has strict: true; frontend uses JSX (no TypeScript).
Build System3/9 (33%)
✗agentic_developmentNo agent co-authorship in git log, no .factory/droids/, no agent CI workflows.
—automated_pr_reviewSkipped: No automated review generation found in PR list.
✓build_cmd_docREADME.md documents build commands: npm run build for both workspaces.
—build_performance_trackingSkipped: No build caching or performance tracking found.
—dead_feature_flag_detectionSkipped: Prerequisite failed (feature_flag_infrastructure).
—deployment_frequencySkipped: No releases or deploy workflows found.
✗deps_pinnedNo lockfiles committed (package-lock.json, yarn.lock, or pnpm-lock.yaml not found).
—fast_ci_feedbackSkipped: No .github/workflows directory found, cannot verify CI duration.
✗feature_flag_infrastructureNo LaunchDarkly, Statsig, Unleash, GrowthBook, or custom feature flags found.
—heavy_dependency_detectionSkipped: No bundle analyzer for frontend; backend is not bundled.
—monorepo_toolingSkipped: Uses npm workspaces (built-in), no Turborepo/Nx/Lerna needed.
—progressive_rolloutSkipped: Not an infrastructure repository.
✗release_automationNo CD pipelines, semantic-release, GitOps, or automated releases found.
✗release_notes_automationNo semantic-release, changesets, standard-version, or release automation found.
—rollback_automationSkipped: Not an infrastructure repository.
✓single_command_setupREADME documents 'npm run setup' for complete project setup.
✗unused_dependencies_detectionNo unused dependency detection tools (depcheck, npm-check, deptry) found.
✓vcs_cli_toolsgh CLI is installed and authenticated.
—version_drift_detectionSkipped: No syncpack, manypkg, or version drift detection for monorepo.
Testing0/6 (0%)
—flaky_test_detectionSkipped: No tests exist.
✗integration_tests_existNo integration test directories (cypress/, playwright.config.ts) found.
✗test_coverage_thresholdsNo coverage thresholds (jest coverageThreshold, pytest --cov-fail-under) found.
✗test_isolationNo test parallelization or isolation configured (Jest, pytest-xdist).
✗test_naming_conventionsNo test framework naming patterns (Jest testMatch, pytest naming) configured.
✗test_performance_trackingNo test timing output or test analytics platforms found.
✗unit_tests_existNo test files (*.test.ts, __tests__/) found in either application.
—unit_tests_runnableSkipped: OSS evaluation without dev environment. No test infrastructure to run.
Documentation3/7 (43%)
✓agents_mddocs/agents.md exists with comprehensive setup/workflow documentation (5852 chars).
✗agents_md_validationNo CI validation, automated updates, or pre-commit hooks for agents.md found.
—api_schema_docsSkipped: No OpenAPI/Swagger or GraphQL schema files found for backend API.
✗automated_doc_generationNo API doc generators, JSDoc, Sphinx, or automated doc tools found.
✓documentation_freshnessREADME.md and docs/agents.md both modified within last 180 days (git log).
✓readmeREADME.md exists at repo root with comprehensive setup/usage instructions.
✗service_flow_documentedNo architecture diagrams (.mermaid, .puml), service dependency docs, or flow diagrams found.
✗skillsNo .factory/skills/, .skills/, or .claude/skills/ directories found.
Dev Environment2/4 (50%)
✓database_schemaSupabase migrations exist (5 SQL migration files in supabase/migrations/).
✗devcontainerNo .devcontainer/devcontainer.json found.
—devcontainer_runnableSkipped: Prerequisite failed (devcontainer not configured).
✓env_template.env.example files exist for both backend and frontend.
✗local_services_setupNo docker-compose.yml for local dependencies (Postgres, Redis) found.
Debugging & Observability0/7 (0%)
✗alerting_configuredNo PagerDuty, OpsGenie, or alerting configuration found.
—circuit_breakersSkipped: No circuit breaker libraries or resilience patterns found.
—code_quality_metricsSkipped: OSS evaluation without admin access. Code scanning API returned 403.
✗deployment_observabilityNo monitoring dashboard links (Datadog, Grafana, New Relic) found in docs.
✗distributed_tracingNo trace ID or request ID propagation (OpenTelemetry, X-Request-ID) found.
✗error_tracking_contextualizedNo Sentry, Bugsnag, or Rollbar configuration found in dependencies or code.
—health_checksSkipped: No /health, /healthz endpoints found in backend routes.
✗metrics_collectionNo telemetry instrumentation (Datadog, Prometheus, New Relic, CloudWatch) found.
—profiling_instrumentationSkipped: No profiling tools (APM, continuous profiling) found.
✗runbooks_documentedNo runbooks/ directory or links to external runbooks in README/docs found.
✗structured_loggingNo logging libraries (winston, pino, bunyan, structlog) found in dependencies.
Security2/5 (40%)
—automated_security_reviewSkipped: OSS evaluation without admin access. Code scanning API returned 403.
—branch_protectionSkipped: OSS evaluation without admin access. No rulesets or branch protection found (404).
✗codeownersNo CODEOWNERS file in root or .github/ directory.
—dast_scanningSkipped: No DAST tools (OWASP ZAP, Burp) found in CI.
✗dependency_update_automationNo Dependabot or Renovate configuration found.
✓gitignore_comprehensive.gitignore excludes .env, node_modules, .DS_Store, IDE configs (.vscode, .idea).
✗log_scrubbingNo log sanitization/redaction configured in logging setup.
—pii_handlingSkipped: No PII detection or data classification tools found.
—privacy_complianceSkipped: No consent management, GDPR/CCPA handling, or privacy compliance infrastructure found.
—secret_scanningSkipped: OSS evaluation without admin access. Secret scanning API returned 404.
✓secrets_management.env files properly gitignored with .env.example templates; AWS secrets mentioned in docs.
Task Discovery2/4 (50%)
✗backlog_health21 open issues, but many (>50%) have no labels; poor backlog health.
✗issue_labeling_systemIssues exist but inconsistent labels; no clear priority/type/area labeling system.
✓issue_templates.github/ISSUE_TEMPLATE/ exists with bug.yml, feature_request.yml templates.
✓pr_templates.github/PULL_REQUEST_TEMPLATE.md exists with comprehensive sections.
Product & Analytics0/2 (0%)
✗error_to_insight_pipelineNo Sentry-GitHub integration or error-to-issue automation found.
✗product_analytics_instrumentationNo product analytics (Mixpanel, Amplitude, PostHog, GA4) found.