hyperdx/packages/app/tests/e2e/utils/api-helpers.ts
Warren Lee 6e8ddd3736
feat: isolate dev environment for multi-agent worktree support (#1994)
## Summary
- Isolate dev, E2E, and integration test environments so multiple git worktrees can run all three simultaneously without port conflicts
- Each worktree gets a deterministic slot (0-99) with unique port ranges: dev (30100-31199), E2E (20320-21399), CI integration (14320-40098)
- Dev portal dashboard (http://localhost:9900) auto-discovers all running stacks, streams logs, and provides a History tab for past run logs

## Port Isolation

| Environment | Port Range | Project Name |
|---|---|---|
| Dev stack | 30100-31199 | `hdx-dev-<slot>` |
| E2E tests | 20320-21399 | `e2e-<slot>` |
| CI integration | 14320-40098 | `int-<slot>` |

All three can run simultaneously from the same worktree with zero port conflicts.

## Dev Portal Features

**Live tab:**
- Auto-discovers dev, E2E, and integration Docker containers + local services (API, App)
- Groups all environments for the same worktree into a single card
- SSE log streaming with ANSI color rendering, capped at 5000 lines
- Auto-starts in background from `make dev`, `make dev-e2e`, `make dev-int`

**History tab:**
- Logs archived to `~/.config/hyperdx/dev-slots/<slot>/history/` on exit (instead of deleted)
- Each archived run includes `meta.json` with worktree/branch metadata
- Grouped by worktree with collapsible cards, search by worktree/branch
- View any past log file in the same log panel, delete individual runs or clear all
- Custom dark-themed confirm modal (no native browser dialogs)

## What Changed

- **`scripts/dev-env.sh`** — Slot-based port assignments, portal auto-start, log archival on exit
- **`scripts/test-e2e.sh`** — E2E port range (20320-21399), log capture via `tee`, portal auto-start, log archival
- **`scripts/ensure-dev-portal.sh`** — Shared singleton portal launcher (works sourced or executed)
- **`scripts/dev-portal/server.js`** — Discovery for dev/E2E/CI containers, history API (list/read/delete), local service port probing
- **`scripts/dev-portal/index.html`** — Live/History tabs, worktree-grouped cards, search, collapse/expand, custom confirm modal, ANSI color log rendering
- **`docker-compose.dev.yml`** — Parameterized ports/volumes/project name with `hdx.dev.*` labels
- **`packages/app/tests/e2e/docker-compose.yml`** — Updated to new E2E port defaults
- **`Makefile`** — `dev-int`/`dev-e2e` targets with log capture + portal auto-start; `dev-portal-stop`; `dev-clean` stops everything + wipes slot data
- **`.env` files** — Ports use `${VAR:-default}` syntax across dev, E2E, and CI environments
- **`agent_docs/development.md`** — Full documentation for isolation, port tables, E2E/CI port ranges

## How to Use

```bash
# Start dev stack (auto-starts portal)
make dev

# Run E2E tests (auto-starts portal, separate ports)
make dev-e2e FILE=navigation

# Run integration tests (auto-starts portal, separate ports)
make dev-int FILE=alerts

# All three can run simultaneously from the same worktree
# Portal at http://localhost:9900 shows everything

# Stop portal
make dev-portal-stop

# Clean up everything (all stacks + portal + history)
make dev-clean
```

## Dev Portal

<img width="1692" height="944" alt="image" src="https://github.com/user-attachments/assets/6ed388a3-43bc-4552-aa8d-688077b79fb7" />

<img width="1689" height="935" alt="image" src="https://github.com/user-attachments/assets/8677a138-0a40-4746-93ed-3b355c8bd45e" />

## Test Plan
- [x] Run `make dev` — verify services start with slot-assigned ports
- [x] Run `make dev` in a second worktree — verify different ports, no conflicts
- [x] Run `make dev-e2e` and `make dev-int` simultaneously — no port conflicts
- [x] Open http://localhost:9900 — verify all stacks grouped by worktree
- [x] Click a service to view logs — verify ANSI colors render correctly
- [x] Stop a stack — verify logs archived to History tab with correct worktree
- [x] History tab — search, collapse/expand, view archived logs, delete
- [x] `make dev-clean` — stops everything, wipes slot data and history
2026-03-31 18:24:24 +00:00

104 lines
2.9 KiB
TypeScript

/**
* API Helper utilities for E2E tests
*
* Provides common functions for interacting with the HyperDX API
* in end-to-end tests, including authentication and resource access.
*/
import { Page } from '@playwright/test';
const API_PORT = process.env.HDX_E2E_API_PORT || '21000';
const API_URL = process.env.E2E_API_URL || `http://localhost:${API_PORT}`;
/**
* Fetches the current user's access key for API authentication
*
* @param page - Playwright page instance with authenticated session
* @returns The user's access key (Bearer token)
* @throws If the user endpoint fails or access key is not available
*
* @example
* ```typescript
* const accessKey = await getUserAccessKey(page);
* const response = await page.request.get(`${API_URL}/api/v2/dashboards`, {
* headers: { 'Authorization': `Bearer ${accessKey}` }
* });
* ```
*/
export async function getUserAccessKey(page: Page): Promise<string> {
const userResponse = await page.request.get(`${API_URL}/me`);
if (!userResponse.ok()) {
throw new Error(
`Failed to fetch user data: ${userResponse.status()} ${userResponse.statusText()}`,
);
}
const userData = await userResponse.json();
if (!userData.accessKey) {
throw new Error('User access key not found in response');
}
return userData.accessKey;
}
/**
* Fetches available data sources for the authenticated user's team
*
* @param page - Playwright page instance with authenticated session
* @param kind - Optional filter for source kind ('log', 'trace', 'metric', 'session')
* @returns Array of source objects (filtered by kind if specified)
* @throws If the sources endpoint fails or no sources match the filter
*
* @example Get all sources
* ```typescript
* const sources = await getSources(page);
* const firstSourceId = sources[0]._id;
* ```
*
* @example Get log sources only
* ```typescript
* const logSources = await getSources(page, 'log');
* const logSourceId = logSources[0]._id;
* ```
*/
export async function getSources(
page: Page,
kind?: 'log' | 'trace' | 'metric' | 'session',
): Promise<any[]> {
const sourcesResponse = await page.request.get(`${API_URL}/sources`);
if (!sourcesResponse.ok()) {
throw new Error(
`Failed to fetch sources: ${sourcesResponse.status()} ${sourcesResponse.statusText()}`,
);
}
const sources = await sourcesResponse.json();
if (!Array.isArray(sources)) {
throw new Error('Invalid sources response: expected an array');
}
// Filter by kind if specified
if (kind) {
const filteredSources = sources.filter(source => source.kind === kind);
if (filteredSources.length === 0) {
throw new Error(
`No sources found with kind '${kind}'. Available sources: ${sources.map(s => `${s.name} (${s.kind})`).join(', ')}`,
);
}
return filteredSources;
}
return sources;
}
/**
* Gets the API base URL
*
* @returns The API base URL
*/
export function getApiUrl(): string {
return API_URL;
}