Testing

What it does

This skill automates model performance evaluation against LobeHub datasets, streamlining testing workflows and ensuring consistent results. It utilizes vitest to run tests within various project locations (webapp, packages, desktop) and provides guidance on best practices for writing effective and maintainable tests. The tool focuses on behavior-driven development and encourages targeted mocking strategies.

When to use it

• To automatically execute unit tests across different parts of a codebase.
• When verifying the performance of models against specific LobeHub datasets.
• During development to ensure new code changes don't break existing functionality.
• As part of a continuous integration/continuous delivery (CI/CD) pipeline for automated testing.
• To quickly run a subset of tests, focusing on recently modified files or specific test categories.

Key capabilities

• Runs vitest tests in specified locations (src/**/*.test.ts(x), packages/*/**/*.test.ts, apps/desktop/**/*.test.ts).
• Provides guidance on preferred mocking techniques (e.g., vi.spyOn over vi.mock).
• Includes test structure examples and mock patterns for browser APIs and direct dependencies.
• Offers detailed guides for specific testing scenarios like database model, Electron IPC, Zustand store actions, agent runtime E2E, and desktop controller testing (accessible via references/).
• Provides advice on handling failing tests – whether to fix or delete based on the reason for failure.

Example prompts

• "Run the tests in the packages/database directory."
• "Execute only the tests that have passed so far, specifically targeting the file at '[file-path]'."
• "Run the unit tests for the webapp component."

Tips & gotchas

• Avoid running bun run test as it executes all tests (over 3000), which takes approximately 10 minutes. Use more targeted commands instead.
• Ensure that new tests pass a type check by running bun run type-check.
• Prioritize behavior testing over implementation details to create more robust and maintainable tests.