8000 Add window bounds to list_windows and get_active_window · Issue #11 · Mnehmos/mnehmos.ooda.mcp · GitHub
[go: up one dir, main page]

Skip to content

Add window bounds to list_windows and get_active_window #11

Open

Description

@Mnehmos

list_windows returns {title, pid, handle, className} and get_active_window returns {title, pid, handle}. Neither returns window geometry.

Impact

Without bounds an agent cannot:

  • Take a cropped, per-window screenshot — the single biggest token lever in computer-use work (frontier harnesses crop to the relevant window rather than sending 1920x1080 every step).
  • Convert window-relative coordinates to screen coordinates.
  • Tell whether a window is offscreen, minimized, or occluded before clicking into it.
  • Verify that a move_window / resize_window call actually took effect.

get_screen_info already returns full monitor bounds, so the response shape exists — it just stops at the monitor level.

Fix

Add bounds: {x, y, width, height} (via GetWindowRect) plus isMinimized / isVisible to both list_windows and get_active_window.

This is also the prerequisite for a UI Automation perception layer (per-window tree scoping), which is the follow-up sprint.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions

      0