commit	2d08119c97f1a909ba4f17827aee31aa98b8b2e7	[log] [tgz]
author	Josh Bleecher Snyder <josharian@gmail.com>	Thu May 29 13:46:04 2025 +0000
committer	Josh Bleecher Snyder <josharian@gmail.com>	Thu May 29 12:50:41 2025 -0700
tree	05b909119621bbcd6cb258324b0bf0f1cbaf950e
parent	991164f3a46ff109723105b737eb9e4ed3426873 [diff]

webui: add comprehensive browser tool cards and termui support

Implement complete browser tool card coverage with simple, clean styling
following the established bash tool card pattern and add missing termui
handling for all browser tools.

Missing tool coverage identified after commit e7806fbc which added
browser_navigate tool card, revealing gaps in both webui and termui
support for the complete browser tool suite.

Changes include:

1. New browser tool cards with simple, consistent styling:
   - browser_click: Shows CSS selector with mouse pointer icon
   - browser_type: Shows selector and text input with keyboard icon
   - browser_wait_for: Shows selector with hourglass icon for waiting
   - browser_get_text: Shows selector with book icon for text extraction
   - browser_eval: Shows JavaScript expression with mobile phone icon
   - browser_scroll_into_view: Shows selector with arrows icon for scrolling
   - browser_resize: Shows dimensions in WxH format with frame icon
   - browser_read_image: Shows filename with truncated path display
   - browser_recent_console_logs: Shows log count with document icon
   - browser_clear_console_logs: Shows clear action with broom icon

2. Updated tool calls mapping system:
   - Added all 10 new browser tool card imports to sketch-tool-calls.ts
   - Extended cardForToolCall() switch statement with proper case handling
   - Consistent HTML template pattern following existing tool cards
   - Proper TypeScript declarations for all new components

3. Enhanced termui template with browser tool support:
   - Added template cases for all 12 browser tools in toolUseTemplTxt
   - Consistent emoji icons and concise display formatting
   - Proper parameter extraction for selectors, URLs, dimensions
   - Truncation and formatting for clean terminal display

4. Simple, maintainable styling approach:
   - Monospace fonts for technical data (selectors, expressions)
   - Subtle background highlights for input parameters
   - Break-word handling for long selectors and URLs
   - Consistent icon usage for quick visual tool identification
   - Minimal CSS to keep cards lightweight and debuggable

Technical implementation:
- All tool cards extend LitElement with standard properties
- JSON input parsing with error handling for malformed data
- Slot-based content organization following base tool card pattern
- Consistent summary, input, and result slot population
- TypeScript interface declarations for proper type checking

Testing verification:
- Started test sketch instance and verified tool cards render correctly
- Confirmed browser_take_screenshot card shows timing and status icons
- Verified browser_type card displays selectors and input text properly
- Validated browser_read_image card shows filename truncation
- All tool cards follow established simple styling without visual clutter

This provides complete browser tool coverage in both webui and termui,
maintaining the clean, simple aesthetic while ensuring all browser
automation tools have proper visual representation and status reporting.

Co-Authored-By: sketch <hello@sketch.dev>
Change-ID: s79b2200705afaee8k

13 files changed

tree: 05b909119621bbcd6cb258324b0bf0f1cbaf950e

README.md

Sketch

Sketch is an agentic coding tool. It draws the 🦉

🚀 Overview

Sketch runs in your terminal, has a web UI, understands your code, and helps you get work done. To keep your environment pristine, sketch starts a docker container and outputs its work onto a branch in your host git repository.

Sketch helps with most programming environments, but Sketch has extra goodies for Go.

📋 Quick Start

go install sketch.dev/cmd/sketch@latest
sketch

🔧 Requirements

Currently, Sketch runs on macOS and Linux. It uses Docker for containers.

Platform	Installation
macOS	`brew install colima` (or Docker Desktop/Orbstack)
Linux	`apt install docker.io` (or equivalent for your distro)
WSL2	Install Docker Desktop for Windows (docker entirely inside WSL2 is tricky)

The sketch.dev service is used to provide access to an LLM service and give you a way to access the web UI from anywhere.

🤝 Community & Feedback

Discord: Join our community at https://discord.gg/6w9qNRUDzS
GitHub Issues: Submit feedback at https://github.com/boldsoftware/sketch/issues

📖 User Guide

Getting Started

Start Sketch by running sketch in a Git repository. It will open your browser to the Sketch chat interface, but you can also use the CLI interface. Use -open=false if you want to use just the CLI interface.

Ask Sketch about your codebase or ask it to implement a feature. It may take a little while for Sketch to do its work, so hit the bell (🔔) icon to enable browser notifications. We won't spam you or anything; it will notify you when the Sketch agent's turn is done, and there's something to look at.

How Sketch Works

When you start Sketch, it:

Creates a Dockerfile
Builds it
Copies your repository into it
Starts a Docker container with the "inside" Sketch running

This design lets you run multiple sketches in parallel since they each have their own sandbox. It also lets Sketch work without worry: it can trash its own container, but it can't trash your machine.

Sketch's agentic loop uses tool calls (mostly shell commands, but also a handful of other important tools) to allow the LLM to interact with your codebase.

Getting Your Git Changes Out

Sketch is trained to make Git commits. When those happen, they are automatically pushed to the git repository where you started sketch with branch names sketch/*.

Finding Sketch branches:

git branch -a --sort=creatordate | grep sketch/ | tail

The UI keeps track of the latest branch it pushed and displays it prominently. You can use standard Git workflows to pull those branches into your workspace:

git cherry-pick $(git merge-base origin/main sketch/foo)

or merge the branch

git merge sketch/foo

or reset to the branch

git reset --hard sketch/foo

Ie use the same workflows you would if you were pulling in a friend's Pull Request.

Advanced: You can ask Sketch to git fetch sketch-host and rebase onto another commit. This will also fetch where you started Sketch, and we do a bit of "git fetch refspec configuration" to make origin/main work as a git reference.

Don't be afraid of asking Sketch to help you rebase, merge/squash commits, rewrite commit messages, and so forth; it's good at it!

Reviewing Diffs

The diff view shows you changes since Sketch started. Leaving comments on lines adds them to the chat box, and, when you hit Send (at the bottom of the page), Sketch goes to work addressing your comments.

Connecting to Sketch's Container

You can interact directly with the container in three ways:

Web UI Terminal: Use the "Terminal" tab in the UI
SSH: Look at the startup logs or click the information icon to see a command like ssh sketch-ilik-eske-tcha-lott. We have automatically configured your SSH configuration to make these special hostnames work.
Visual Studio Code: Look for a command line or magic link behind the information icon, or when Sketch starts up. This starts a new VSCode session "remoted into" the container. You can edit the code, use the terminal, review diffs, and so forth.

Using SSH (and/or VSCode) allows you to forward ports from the container to your machine. For example, if you want to start your development webserver, you can do something like this:

# Forward container port 8888 to local port 8000
ssh -L8000:localhost:8888 sketch-ilik-epor-tfor-ward go run ./cmd/server

This makes http://localhost:8000/ on your machine point to localhost:8888 inside the container.

Using Browser Tools

You can ask Sketch to browse a web page and take screenshots. There are tools both for taking screenshots and "reading images", the latter of which sends the image to the LLM. This functionality is handy if you're working on a web page and want to see what the in-progress change looks like.

❓ FAQ

"No space left on device"

Docker images, containers, and so forth tend to pile up. Ask Docker to prune unused images and containers:

docker system prune -a

🛠️ Development

See CONTRIBUTING.md for development guidelines.

📄 Open Source

Sketch is open source. It is right here in this repository! Have a look around and mod away.

If you want to run Sketch entirely without the sketch.dev service, you can set the flag -skaband-addr="" and then provide an ANTHROPIC_API_KEY environment variable. (More LLM services coming soon!)