Add browse tool support.
I reviewed some MCPs (using OpenAI's deep research to help), and it
helped me choose chromedp as the relevant library and helped me come up
with an interface. This commit adds chrome to the Docker image which is
kind of big. (I've noticed that it's smaller on Ubuntu, where it doesn't
pull in X11.) go-playwright was a library contender as well.
Implement browser automation tooling using chromedp
This implementation adds browser automation capabilities to the system via the chromedp library,
enabling Claude to interact with web content effectively.
Key features include:
1. Core browser automation functionality:
- Created new browsertools package in claudetool/browser
- Implemented tools for navigating, clicking, typing, waiting for elements,
getting text, evaluating JavaScript, taking screenshots, and scrolling
- Added lazy browser initialization that defers until first use
- Integrated with the agent to expose these tools to Claude
2. Screenshot handling and display:
- Implemented screenshot storage with UUID-based IDs in /tmp/sketch-screenshots
- Added endpoint to serve screenshots via /screenshot/{id}
- Created dedicated UI component for displaying screenshots
- Ensured proper responsive design with loading states and error handling
- Fixed URL paths for proper rehomed URL support
- Modified tool calls component to auto-expand screenshot results
3. Error handling and reliability:
- Added graceful error handling for browser initialization failures
- Implemented proper cleanup of browser resources
The browser automation tools provide a powerful way for Claude to interact with web content,
making it possible to scrape data, test web applications, and automate web-based tasks.
Co-Authored-By: sketch <hello@sketch.dev>
diff --git a/claudetool/browse/README.md b/claudetool/browse/README.md
new file mode 100644
index 0000000..6c03e1a
--- /dev/null
+++ b/claudetool/browse/README.md
@@ -0,0 +1,116 @@
+# Browser Tools for Claude
+
+This package provides a set of tools that allow Claude to control a headless
+Chrome browser from Go. The tools are built using the
+[chromedp](https://github.com/chromedp/chromedp) library.
+
+## Available Tools
+
+1. `browser_navigate` - Navigate to a URL and wait for the page to load
+2. `browser_click` - Click an element matching a CSS selector
+3. `browser_type` - Type text into an input field
+4. `browser_wait_for` - Wait for an element to appear in the DOM
+5. `browser_get_text` - Get the text content of an element
+6. `browser_eval` - Evaluate JavaScript in the browser context
+7. `browser_screenshot` - Take a screenshot of the page or a specific element
+8. `browser_scroll_into_view` - Scroll an element into view
+
+## Usage
+
+```go
+// Create a context
+ctx := context.Background()
+
+// Register browser tools and get a cleanup function
+tools, cleanup := browse.RegisterBrowserTools(ctx)
+defer cleanup() // Important: always call cleanup to release browser resources
+
+// Add tools to your agent
+for _, tool := range tools {
+ agent.AddTool(tool)
+}
+```
+
+## Requirements
+
+- Chrome or Chromium must be installed on the system
+- The `chromedp` package handles launching and controlling the browser
+
+## Tool Input/Output
+
+All tools follow a standard JSON input/output format. For example:
+
+**Navigate Tool Input:**
+```json
+{
+ "url": "https://example.com"
+}
+```
+
+**Navigate Tool Output (success):**
+```json
+{
+ "status": "success"
+}
+```
+
+**Tool Output (error):**
+```json
+{
+ "status": "error",
+ "error": "Error message"
+}
+```
+
+## Example Tool Usage
+
+```go
+// Example of using the navigate tool directly
+navTool := tools[0] // Get browser_navigate tool
+input := map[string]string{"url": "https://example.com"}
+inputJSON, _ := json.Marshal(input)
+
+// Call the tool
+result, err := navTool.Run(ctx, json.RawMessage(inputJSON))
+if err != nil {
+ log.Fatalf("Error: %v", err)
+}
+fmt.Println(result)
+```
+
+## Screenshot Storage
+
+The browser screenshot tool has been modified to save screenshots to a temporary directory and identify them by ID, rather than returning base64-encoded data directly. This improves efficiency by:
+
+1. Reducing token usage in LLM responses
+2. Avoiding encoding/decoding overhead
+3. Allowing for larger screenshots without message size limitations
+
+### How It Works
+
+1. When a screenshot is taken, it's saved to `/tmp/sketch-screenshots/` with a unique UUID filename
+2. The tool returns the screenshot ID in its response
+3. The web UI can fetch the screenshot using the `/screenshot/{id}` endpoint
+
+### Example Usage
+
+Agent calls the screenshot tool:
+```json
+{
+ "id": "tool_call_123",
+ "name": "browser_screenshot",
+ "params": {}
+}
+```
+
+Tool response:
+```json
+{
+ "id": "tool_call_123",
+ "result": {
+ "id": "550e8400-e29b-41d4-a716-446655440000"
+ }
+}
+```
+
+The screenshot is then accessible at: `/screenshot/550e8400-e29b-41d4-a716-446655440000`
diff --git a/claudetool/browse/browse.go b/claudetool/browse/browse.go
new file mode 100644
index 0000000..a76cd24
--- /dev/null
+++ b/claudetool/browse/browse.go
@@ -0,0 +1,633 @@
+// Package browse provides browser automation tools for the agent
+package browse
+
+import (
+ "context"
+ "encoding/json"
+ "fmt"
+ "log"
+ "os"
+ "path/filepath"
+ "sync"
+ "time"
+
+ "github.com/chromedp/chromedp"
+ "github.com/google/uuid"
+ "sketch.dev/llm"
+)
+
+// ScreenshotDir is the directory where screenshots are stored
+const ScreenshotDir = "/tmp/sketch-screenshots"
+
+// BrowseTools contains all browser tools and manages a shared browser instance
+type BrowseTools struct {
+ ctx context.Context
+ cancel context.CancelFunc
+ browserCtx context.Context
+ browserCtxCancel context.CancelFunc
+ mux sync.Mutex
+ initOnce sync.Once
+ initialized bool
+ initErr error
+ // Map to track screenshots by ID and their creation time
+ screenshots map[string]time.Time
+ screenshotsMutex sync.Mutex
+}
+
+// NewBrowseTools creates a new set of browser automation tools
+func NewBrowseTools(ctx context.Context) *BrowseTools {
+ ctx, cancel := context.WithCancel(ctx)
+
+ // Ensure the screenshot directory exists
+ if err := os.MkdirAll(ScreenshotDir, 0755); err != nil {
+ log.Printf("Failed to create screenshot directory: %v", err)
+ }
+
+ b := &BrowseTools{
+ ctx: ctx,
+ cancel: cancel,
+ screenshots: make(map[string]time.Time),
+ }
+
+ return b
+}
+
+// Initialize starts the browser if it's not already running
+func (b *BrowseTools) Initialize() error {
+ b.mux.Lock()
+ defer b.mux.Unlock()
+
+ b.initOnce.Do(func() {
+ // ChromeDP.ExecPath has a list of common places to find Chrome...
+ opts := chromedp.DefaultExecAllocatorOptions[:]
+ allocCtx, _ := chromedp.NewExecAllocator(b.ctx, opts...)
+ browserCtx, browserCancel := chromedp.NewContext(
+ allocCtx,
+ chromedp.WithLogf(log.Printf),
+ )
+
+ b.browserCtx = browserCtx
+ b.browserCtxCancel = browserCancel
+
+ // Ensure the browser starts
+ if err := chromedp.Run(browserCtx); err != nil {
+ b.initErr = fmt.Errorf("failed to start browser (please apt get chromium or equivalent): %w", err)
+ return
+ }
+ b.initialized = true
+ })
+
+ return b.initErr
+}
+
+// Close shuts down the browser
+func (b *BrowseTools) Close() {
+ b.mux.Lock()
+ defer b.mux.Unlock()
+
+ if b.browserCtxCancel != nil {
+ b.browserCtxCancel()
+ b.browserCtxCancel = nil
+ }
+
+ if b.cancel != nil {
+ b.cancel()
+ }
+
+ b.initialized = false
+ log.Println("Browser closed")
+}
+
+// GetBrowserContext returns the context for browser operations
+func (b *BrowseTools) GetBrowserContext() (context.Context, error) {
+ if err := b.Initialize(); err != nil {
+ return nil, err
+ }
+ return b.browserCtx, nil
+}
+
+// All tools return this as a response when successful
+type baseResponse struct {
+ Status string `json:"status,omitempty"`
+}
+
+func successResponse() string {
+ return `{"status":"success"}`
+}
+
+func errorResponse(err error) string {
+ return fmt.Sprintf(`{"status":"error","error":"%s"}`, err.Error())
+}
+
+// NavigateTool definition
+type navigateInput struct {
+ URL string `json:"url"`
+}
+
+// NewNavigateTool creates a tool for navigating to URLs
+func (b *BrowseTools) NewNavigateTool() *llm.Tool {
+ return &llm.Tool{
+ Name: "browser_navigate",
+ Description: "Navigate the browser to a specific URL and wait for page to load",
+ InputSchema: json.RawMessage(`{
+ "type": "object",
+ "properties": {
+ "url": {
+ "type": "string",
+ "description": "The URL to navigate to"
+ }
+ },
+ "required": ["url"]
+ }`),
+ Run: b.navigateRun,
+ }
+}
+
+func (b *BrowseTools) navigateRun(ctx context.Context, m json.RawMessage) (string, error) {
+ var input navigateInput
+ if err := json.Unmarshal(m, &input); err != nil {
+ return errorResponse(fmt.Errorf("invalid input: %w", err)), nil
+ }
+
+ browserCtx, err := b.GetBrowserContext()
+ if err != nil {
+ return errorResponse(err), nil
+ }
+
+ err = chromedp.Run(browserCtx,
+ chromedp.Navigate(input.URL),
+ chromedp.WaitReady("body"),
+ )
+ if err != nil {
+ return errorResponse(err), nil
+ }
+
+ return successResponse(), nil
+}
+
+// ClickTool definition
+type clickInput struct {
+ Selector string `json:"selector"`
+ WaitVisible bool `json:"wait_visible,omitempty"`
+}
+
+// NewClickTool creates a tool for clicking elements
+func (b *BrowseTools) NewClickTool() *llm.Tool {
+ return &llm.Tool{
+ Name: "browser_click",
+ Description: "Click the first element matching a CSS selector",
+ InputSchema: json.RawMessage(`{
+ "type": "object",
+ "properties": {
+ "selector": {
+ "type": "string",
+ "description": "CSS selector for the element to click"
+ },
+ "wait_visible": {
+ "type": "boolean",
+ "description": "Wait for the element to be visible before clicking"
+ }
+ },
+ "required": ["selector"]
+ }`),
+ Run: b.clickRun,
+ }
+}
+
+func (b *BrowseTools) clickRun(ctx context.Context, m json.RawMessage) (string, error) {
+ var input clickInput
+ if err := json.Unmarshal(m, &input); err != nil {
+ return errorResponse(fmt.Errorf("invalid input: %w", err)), nil
+ }
+
+ browserCtx, err := b.GetBrowserContext()
+ if err != nil {
+ return errorResponse(err), nil
+ }
+
+ actions := []chromedp.Action{
+ chromedp.WaitReady(input.Selector),
+ }
+
+ if input.WaitVisible {
+ actions = append(actions, chromedp.WaitVisible(input.Selector))
+ }
+
+ actions = append(actions, chromedp.Click(input.Selector))
+
+ err = chromedp.Run(browserCtx, actions...)
+ if err != nil {
+ return errorResponse(err), nil
+ }
+
+ return successResponse(), nil
+}
+
+// TypeTool definition
+type typeInput struct {
+ Selector string `json:"selector"`
+ Text string `json:"text"`
+ Clear bool `json:"clear,omitempty"`
+}
+
+// NewTypeTool creates a tool for typing into input elements
+func (b *BrowseTools) NewTypeTool() *llm.Tool {
+ return &llm.Tool{
+ Name: "browser_type",
+ Description: "Type text into an input or textarea element",
+ InputSchema: json.RawMessage(`{
+ "type": "object",
+ "properties": {
+ "selector": {
+ "type": "string",
+ "description": "CSS selector for the input element"
+ },
+ "text": {
+ "type": "string",
+ "description": "Text to type into the element"
+ },
+ "clear": {
+ "type": "boolean",
+ "description": "Clear the input field before typing"
+ }
+ },
+ "required": ["selector", "text"]
+ }`),
+ Run: b.typeRun,
+ }
+}
+
+func (b *BrowseTools) typeRun(ctx context.Context, m json.RawMessage) (string, error) {
+ var input typeInput
+ if err := json.Unmarshal(m, &input); err != nil {
+ return errorResponse(fmt.Errorf("invalid input: %w", err)), nil
+ }
+
+ browserCtx, err := b.GetBrowserContext()
+ if err != nil {
+ return errorResponse(err), nil
+ }
+
+ actions := []chromedp.Action{
+ chromedp.WaitReady(input.Selector),
+ chromedp.WaitVisible(input.Selector),
+ }
+
+ if input.Clear {
+ actions = append(actions, chromedp.Clear(input.Selector))
+ }
+
+ actions = append(actions, chromedp.SendKeys(input.Selector, input.Text))
+
+ err = chromedp.Run(browserCtx, actions...)
+ if err != nil {
+ return errorResponse(err), nil
+ }
+
+ return successResponse(), nil
+}
+
+// WaitForTool definition
+type waitForInput struct {
+ Selector string `json:"selector"`
+ TimeoutMS int `json:"timeout_ms,omitempty"`
+}
+
+// NewWaitForTool creates a tool for waiting for elements
+func (b *BrowseTools) NewWaitForTool() *llm.Tool {
+ return &llm.Tool{
+ Name: "browser_wait_for",
+ Description: "Wait for an element to be present in the DOM",
+ InputSchema: json.RawMessage(`{
+ "type": "object",
+ "properties": {
+ "selector": {
+ "type": "string",
+ "description": "CSS selector for the element to wait for"
+ },
+ "timeout_ms": {
+ "type": "integer",
+ "description": "Maximum time to wait in milliseconds (default: 30000)"
+ }
+ },
+ "required": ["selector"]
+ }`),
+ Run: b.waitForRun,
+ }
+}
+
+func (b *BrowseTools) waitForRun(ctx context.Context, m json.RawMessage) (string, error) {
+ var input waitForInput
+ if err := json.Unmarshal(m, &input); err != nil {
+ return errorResponse(fmt.Errorf("invalid input: %w", err)), nil
+ }
+
+ timeout := 30000 // default timeout 30 seconds
+ if input.TimeoutMS > 0 {
+ timeout = input.TimeoutMS
+ }
+
+ browserCtx, err := b.GetBrowserContext()
+ if err != nil {
+ return errorResponse(err), nil
+ }
+
+ timeoutCtx, cancel := context.WithTimeout(browserCtx, time.Duration(timeout)*time.Millisecond)
+ defer cancel()
+
+ err = chromedp.Run(timeoutCtx, chromedp.WaitReady(input.Selector))
+ if err != nil {
+ return errorResponse(err), nil
+ }
+
+ return successResponse(), nil
+}
+
+// GetTextTool definition
+type getTextInput struct {
+ Selector string `json:"selector"`
+}
+
+type getTextOutput struct {
+ Text string `json:"text"`
+}
+
+// NewGetTextTool creates a tool for getting text from elements
+func (b *BrowseTools) NewGetTextTool() *llm.Tool {
+ return &llm.Tool{
+ Name: "browser_get_text",
+ Description: "Get the innerText of an element",
+ InputSchema: json.RawMessage(`{
+ "type": "object",
+ "properties": {
+ "selector": {
+ "type": "string",
+ "description": "CSS selector for the element to get text from"
+ }
+ },
+ "required": ["selector"]
+ }`),
+ Run: b.getTextRun,
+ }
+}
+
+func (b *BrowseTools) getTextRun(ctx context.Context, m json.RawMessage) (string, error) {
+ var input getTextInput
+ if err := json.Unmarshal(m, &input); err != nil {
+ return errorResponse(fmt.Errorf("invalid input: %w", err)), nil
+ }
+
+ browserCtx, err := b.GetBrowserContext()
+ if err != nil {
+ return errorResponse(err), nil
+ }
+
+ var text string
+ err = chromedp.Run(browserCtx,
+ chromedp.WaitReady(input.Selector),
+ chromedp.Text(input.Selector, &text),
+ )
+ if err != nil {
+ return errorResponse(err), nil
+ }
+
+ output := getTextOutput{Text: text}
+ result, err := json.Marshal(output)
+ if err != nil {
+ return errorResponse(fmt.Errorf("failed to marshal response: %w", err)), nil
+ }
+
+ return string(result), nil
+}
+
+// EvalTool definition
+type evalInput struct {
+ Expression string `json:"expression"`
+}
+
+type evalOutput struct {
+ Result any `json:"result"`
+}
+
+// NewEvalTool creates a tool for evaluating JavaScript
+func (b *BrowseTools) NewEvalTool() *llm.Tool {
+ return &llm.Tool{
+ Name: "browser_eval",
+ Description: "Evaluate JavaScript in the browser context",
+ InputSchema: json.RawMessage(`{
+ "type": "object",
+ "properties": {
+ "expression": {
+ "type": "string",
+ "description": "JavaScript expression to evaluate"
+ }
+ },
+ "required": ["expression"]
+ }`),
+ Run: b.evalRun,
+ }
+}
+
+func (b *BrowseTools) evalRun(ctx context.Context, m json.RawMessage) (string, error) {
+ var input evalInput
+ if err := json.Unmarshal(m, &input); err != nil {
+ return errorResponse(fmt.Errorf("invalid input: %w", err)), nil
+ }
+
+ browserCtx, err := b.GetBrowserContext()
+ if err != nil {
+ return errorResponse(err), nil
+ }
+
+ var result any
+ err = chromedp.Run(browserCtx, chromedp.Evaluate(input.Expression, &result))
+ if err != nil {
+ return errorResponse(err), nil
+ }
+
+ output := evalOutput{Result: result}
+ response, err := json.Marshal(output)
+ if err != nil {
+ return errorResponse(fmt.Errorf("failed to marshal response: %w", err)), nil
+ }
+
+ return string(response), nil
+}
+
+// ScreenshotTool definition
+type screenshotInput struct {
+ Selector string `json:"selector,omitempty"`
+ Format string `json:"format,omitempty"`
+}
+
+type screenshotOutput struct {
+ ID string `json:"id"`
+}
+
+// NewScreenshotTool creates a tool for taking screenshots
+func (b *BrowseTools) NewScreenshotTool() *llm.Tool {
+ return &llm.Tool{
+ Name: "browser_screenshot",
+ Description: "Take a screenshot of the page or a specific element",
+ InputSchema: json.RawMessage(`{
+ "type": "object",
+ "properties": {
+ "selector": {
+ "type": "string",
+ "description": "CSS selector for the element to screenshot (optional)"
+ },
+ "format": {
+ "type": "string",
+ "description": "Output format ('base64' or 'png'), defaults to 'base64'",
+ "enum": ["base64", "png"]
+ }
+ }
+ }`),
+ Run: b.screenshotRun,
+ }
+}
+
+func (b *BrowseTools) screenshotRun(ctx context.Context, m json.RawMessage) (string, error) {
+ var input screenshotInput
+ if err := json.Unmarshal(m, &input); err != nil {
+ return errorResponse(fmt.Errorf("invalid input: %w", err)), nil
+ }
+
+ browserCtx, err := b.GetBrowserContext()
+ if err != nil {
+ return errorResponse(err), nil
+ }
+
+ var buf []byte
+ var actions []chromedp.Action
+
+ if input.Selector != "" {
+ // Take screenshot of specific element
+ actions = append(actions,
+ chromedp.WaitReady(input.Selector),
+ chromedp.Screenshot(input.Selector, &buf, chromedp.NodeVisible),
+ )
+ } else {
+ // Take full page screenshot
+ actions = append(actions, chromedp.CaptureScreenshot(&buf))
+ }
+
+ err = chromedp.Run(browserCtx, actions...)
+ if err != nil {
+ return errorResponse(err), nil
+ }
+
+ // Save the screenshot and get its ID
+ id := b.SaveScreenshot(buf)
+ if id == "" {
+ return errorResponse(fmt.Errorf("failed to save screenshot")), nil
+ }
+
+ // Return the ID in the response
+ output := screenshotOutput{ID: id}
+ response, err := json.Marshal(output)
+ if err != nil {
+ return errorResponse(fmt.Errorf("failed to marshal response: %w", err)), nil
+ }
+
+ return string(response), nil
+}
+
+// ScrollIntoViewTool definition
+type scrollIntoViewInput struct {
+ Selector string `json:"selector"`
+}
+
+// NewScrollIntoViewTool creates a tool for scrolling elements into view
+func (b *BrowseTools) NewScrollIntoViewTool() *llm.Tool {
+ return &llm.Tool{
+ Name: "browser_scroll_into_view",
+ Description: "Scroll an element into view if it's not visible",
+ InputSchema: json.RawMessage(`{
+ "type": "object",
+ "properties": {
+ "selector": {
+ "type": "string",
+ "description": "CSS selector for the element to scroll into view"
+ }
+ },
+ "required": ["selector"]
+ }`),
+ Run: b.scrollIntoViewRun,
+ }
+}
+
+func (b *BrowseTools) scrollIntoViewRun(ctx context.Context, m json.RawMessage) (string, error) {
+ var input scrollIntoViewInput
+ if err := json.Unmarshal(m, &input); err != nil {
+ return errorResponse(fmt.Errorf("invalid input: %w", err)), nil
+ }
+
+ browserCtx, err := b.GetBrowserContext()
+ if err != nil {
+ return errorResponse(err), nil
+ }
+
+ script := fmt.Sprintf(`
+ const el = document.querySelector('%s');
+ if (el) {
+ el.scrollIntoView({behavior: 'smooth', block: 'center'});
+ return true;
+ }
+ return false;
+ `, input.Selector)
+
+ var result bool
+ err = chromedp.Run(browserCtx,
+ chromedp.WaitReady(input.Selector),
+ chromedp.Evaluate(script, &result),
+ )
+ if err != nil {
+ return errorResponse(err), nil
+ }
+
+ if !result {
+ return errorResponse(fmt.Errorf("element not found: %s", input.Selector)), nil
+ }
+
+ return successResponse(), nil
+}
+
+// GetAllTools returns all browser tools
+func (b *BrowseTools) GetAllTools() []*llm.Tool {
+ return []*llm.Tool{
+ b.NewNavigateTool(),
+ b.NewClickTool(),
+ b.NewTypeTool(),
+ b.NewWaitForTool(),
+ b.NewGetTextTool(),
+ b.NewEvalTool(),
+ b.NewScreenshotTool(),
+ b.NewScrollIntoViewTool(),
+ }
+}
+
+// SaveScreenshot saves a screenshot to disk and returns its ID
+func (b *BrowseTools) SaveScreenshot(data []byte) string {
+ // Generate a unique ID
+ id := uuid.New().String()
+
+ // Save the file
+ filePath := filepath.Join(ScreenshotDir, id+".png")
+ if err := os.WriteFile(filePath, data, 0644); err != nil {
+ log.Printf("Failed to save screenshot: %v", err)
+ return ""
+ }
+
+ // Track this screenshot
+ b.screenshotsMutex.Lock()
+ b.screenshots[id] = time.Now()
+ b.screenshotsMutex.Unlock()
+
+ return id
+}
+
+// GetScreenshotPath returns the full path to a screenshot by ID
+func GetScreenshotPath(id string) string {
+ return filepath.Join(ScreenshotDir, id+".png")
+}
diff --git a/claudetool/browse/browse_test.go b/claudetool/browse/browse_test.go
new file mode 100644
index 0000000..b3168da
--- /dev/null
+++ b/claudetool/browse/browse_test.go
@@ -0,0 +1,241 @@
+package browse
+
+import (
+ "context"
+ "encoding/json"
+ "os"
+ "slices"
+ "strings"
+ "testing"
+ "time"
+
+ "github.com/chromedp/chromedp"
+ "sketch.dev/llm"
+)
+
+func TestToolCreation(t *testing.T) {
+ // Create browser tools instance
+ tools := NewBrowseTools(context.Background())
+
+ // Test each tool has correct name and description
+ toolTests := []struct {
+ tool *llm.Tool
+ expectedName string
+ shortDesc string
+ requiredProps []string
+ }{
+ {tools.NewNavigateTool(), "browser_navigate", "Navigate", []string{"url"}},
+ {tools.NewClickTool(), "browser_click", "Click", []string{"selector"}},
+ {tools.NewTypeTool(), "browser_type", "Type", []string{"selector", "text"}},
+ {tools.NewWaitForTool(), "browser_wait_for", "Wait", []string{"selector"}},
+ {tools.NewGetTextTool(), "browser_get_text", "Get", []string{"selector"}},
+ {tools.NewEvalTool(), "browser_eval", "Evaluate", []string{"expression"}},
+ {tools.NewScreenshotTool(), "browser_screenshot", "Take", nil},
+ {tools.NewScrollIntoViewTool(), "browser_scroll_into_view", "Scroll", []string{"selector"}},
+ }
+
+ for _, tt := range toolTests {
+ t.Run(tt.expectedName, func(t *testing.T) {
+ if tt.tool.Name != tt.expectedName {
+ t.Errorf("expected name %q, got %q", tt.expectedName, tt.tool.Name)
+ }
+
+ if !strings.Contains(tt.tool.Description, tt.shortDesc) {
+ t.Errorf("description %q should contain %q", tt.tool.Description, tt.shortDesc)
+ }
+
+ // Verify schema has required properties
+ if len(tt.requiredProps) > 0 {
+ var schema struct {
+ Required []string `json:"required"`
+ }
+ if err := json.Unmarshal(tt.tool.InputSchema, &schema); err != nil {
+ t.Fatalf("failed to unmarshal schema: %v", err)
+ }
+
+ for _, prop := range tt.requiredProps {
+ if !slices.Contains(schema.Required, prop) {
+ t.Errorf("property %q should be required", prop)
+ }
+ }
+ }
+ })
+ }
+}
+
+func TestGetAllTools(t *testing.T) {
+ // Create browser tools instance
+ tools := NewBrowseTools(context.Background())
+
+ // Get all tools
+ allTools := tools.GetAllTools()
+
+ // We should have 8 tools
+ if len(allTools) != 8 {
+ t.Errorf("expected 8 tools, got %d", len(allTools))
+ }
+
+ // Check that each tool has the expected name prefix
+ for _, tool := range allTools {
+ if !strings.HasPrefix(tool.Name, "browser_") {
+ t.Errorf("tool name %q does not have prefix 'browser_'", tool.Name)
+ }
+ }
+}
+
+// TestBrowserInitialization verifies that the browser can start correctly
+func TestBrowserInitialization(t *testing.T) {
+ // Skip long tests in short mode
+ if testing.Short() {
+ t.Skip("skipping browser initialization test in short mode")
+ }
+
+ // Create browser tools instance
+ ctx, cancel := context.WithTimeout(context.Background(), 30*time.Second)
+ defer cancel()
+
+ tools := NewBrowseTools(ctx)
+
+ // Initialize the browser
+ err := tools.Initialize()
+ if err != nil {
+ // If browser automation is not available, skip the test
+ if strings.Contains(err.Error(), "browser automation not available") {
+ t.Skip("Browser automation not available in this environment")
+ } else {
+ t.Fatalf("Failed to initialize browser: %v", err)
+ }
+ }
+
+ // Clean up
+ defer tools.Close()
+
+ // Get browser context to verify it's working
+ browserCtx, err := tools.GetBrowserContext()
+ if err != nil {
+ t.Fatalf("Failed to get browser context: %v", err)
+ }
+
+ // Try to navigate to a simple page
+ var title string
+ err = chromedp.Run(browserCtx,
+ chromedp.Navigate("about:blank"),
+ chromedp.Title(&title),
+ )
+ if err != nil {
+ t.Fatalf("Failed to navigate to about:blank: %v", err)
+ }
+
+ t.Logf("Successfully navigated to about:blank, title: %q", title)
+}
+
+// TestNavigateTool verifies that the navigate tool works correctly
+func TestNavigateTool(t *testing.T) {
+ // Skip long tests in short mode
+ if testing.Short() {
+ t.Skip("skipping navigate tool test in short mode")
+ }
+
+ // Create browser tools instance
+ ctx, cancel := context.WithTimeout(context.Background(), 30*time.Second)
+ defer cancel()
+
+ tools := NewBrowseTools(ctx)
+ defer tools.Close()
+
+ // Check if browser initialization works
+ if err := tools.Initialize(); err != nil {
+ if strings.Contains(err.Error(), "browser automation not available") {
+ t.Skip("Browser automation not available in this environment")
+ }
+ }
+
+ // Get the navigate tool
+ navTool := tools.NewNavigateTool()
+
+ // Create input for the navigate tool
+ input := map[string]string{"url": "https://example.com"}
+ inputJSON, _ := json.Marshal(input)
+
+ // Call the tool
+ result, err := navTool.Run(ctx, json.RawMessage(inputJSON))
+ if err != nil {
+ t.Fatalf("Error running navigate tool: %v", err)
+ }
+
+ // Verify the response is successful
+ var response struct {
+ Status string `json:"status"`
+ Error string `json:"error,omitempty"`
+ }
+
+ if err := json.Unmarshal([]byte(result), &response); err != nil {
+ t.Fatalf("Error unmarshaling response: %v", err)
+ }
+
+ if response.Status != "success" {
+ // If browser automation is not available, skip the test
+ if strings.Contains(response.Error, "browser automation not available") {
+ t.Skip("Browser automation not available in this environment")
+ } else {
+ t.Errorf("Expected status 'success', got '%s' with error: %s", response.Status, response.Error)
+ }
+ }
+
+ // Try to get the page title to verify the navigation worked
+ browserCtx, err := tools.GetBrowserContext()
+ if err != nil {
+ // If browser automation is not available, skip the test
+ if strings.Contains(err.Error(), "browser automation not available") {
+ t.Skip("Browser automation not available in this environment")
+ } else {
+ t.Fatalf("Failed to get browser context: %v", err)
+ }
+ }
+
+ var title string
+ err = chromedp.Run(browserCtx, chromedp.Title(&title))
+ if err != nil {
+ t.Fatalf("Failed to get page title: %v", err)
+ }
+
+ t.Logf("Successfully navigated to example.com, title: %q", title)
+ if title != "Example Domain" {
+ t.Errorf("Expected title 'Example Domain', got '%s'", title)
+ }
+}
+
+// TestScreenshotTool tests that the screenshot tool properly saves files
+func TestScreenshotTool(t *testing.T) {
+ // Create browser tools instance
+ ctx := context.Background()
+ tools := NewBrowseTools(ctx)
+
+ // Test SaveScreenshot function directly
+ testData := []byte("test image data")
+ id := tools.SaveScreenshot(testData)
+ if id == "" {
+ t.Fatal("SaveScreenshot returned empty ID")
+ }
+
+ // Get the file path and check if the file exists
+ filePath := GetScreenshotPath(id)
+ _, err := os.Stat(filePath)
+ if err != nil {
+ t.Fatalf("Failed to find screenshot file: %v", err)
+ }
+
+ // Read the file contents
+ contents, err := os.ReadFile(filePath)
+ if err != nil {
+ t.Fatalf("Failed to read screenshot file: %v", err)
+ }
+
+ // Check the file contents
+ if string(contents) != string(testData) {
+ t.Errorf("File contents don't match: expected %q, got %q", string(testData), string(contents))
+ }
+
+ // Clean up the test file
+ os.Remove(filePath)
+}
diff --git a/claudetool/browse/register.go b/claudetool/browse/register.go
new file mode 100644
index 0000000..a540c8f
--- /dev/null
+++ b/claudetool/browse/register.go
@@ -0,0 +1,28 @@
+package browse
+
+import (
+ "context"
+ "log"
+
+ "sketch.dev/llm"
+)
+
+// RegisterBrowserTools initializes the browser tools and returns all the tools
+// ready to be added to an agent. It also returns a cleanup function that should
+// be called when done to properly close the browser.
+func RegisterBrowserTools(ctx context.Context) ([]*llm.Tool, func()) {
+ browserTools := NewBrowseTools(ctx)
+
+ // Initialize the browser
+ if err := browserTools.Initialize(); err != nil {
+ log.Printf("Warning: Failed to initialize browser: %v", err)
+ }
+
+ // Return all tools and a cleanup function
+ return browserTools.GetAllTools(), func() {
+ browserTools.Close()
+ }
+}
+
+// Tool is an alias for llm.Tool to make the documentation clearer
+type Tool = llm.Tool
diff --git a/dockerimg/createdockerfile.go b/dockerimg/createdockerfile.go
index 9c50e2b..bccdc6d 100644
--- a/dockerimg/createdockerfile.go
+++ b/dockerimg/createdockerfile.go
@@ -65,12 +65,10 @@
RUN apt-get update; \
apt-get install -y --no-install-recommends \
- git jq sqlite3 npm nodejs gh ripgrep fzf python3 curl vim && \
+ git jq sqlite3 npm nodejs gh ripgrep fzf python3 curl vim chromium && \
apt-get clean && \
- rm -rf /var/lib/apt/lists/*
-
-# Strip out docs from debian.
-RUN rm -rf /usr/share/{doc,doc-base,info,lintian,man,groff,locale,zoneinfo}/*
+ rm -rf /var/lib/apt/lists/* && \
+ rm -rf /usr/share/{doc,doc-base,info,lintian,man,groff,locale,zoneinfo}/*
ENV PATH="$GOPATH/bin:$PATH"
diff --git a/dockerimg/pushdockerimg.go b/dockerimg/pushdockerimg.go
index 41d1b65..3b3b710 100644
--- a/dockerimg/pushdockerimg.go
+++ b/dockerimg/pushdockerimg.go
@@ -25,7 +25,8 @@
sudo apt-get update
sudo apt-get install docker.io docker-buildx qemu-user-static
# Login to Docker with GitHub credentials
- # You can get #GH_ACCESS_TOK from github.com or from 'gh auth token'.
+ # You can get $GH_ACCESS_TOK from github.com or from 'gh auth token'.
+ # On github.com, User icon in top right...Settings...Developer Settings.
# Make sure the token is configured to write containers for the boldsoftware org.
echo $GH_ACCESS_TOK | docker login ghcr.io -u $GH_USER --password-stdin
diff --git a/dockerimg/testdata/testcreatedockerfile_basic_repo_with_readme.dockerfile b/dockerimg/testdata/testcreatedockerfile_basic_repo_with_readme.dockerfile
index e91413f..195b3c9 100644
--- a/dockerimg/testdata/testcreatedockerfile_basic_repo_with_readme.dockerfile
+++ b/dockerimg/testdata/testcreatedockerfile_basic_repo_with_readme.dockerfile
@@ -1,4 +1,4 @@
-FROM ghcr.io/boldsoftware/sketch:f5b4ebd9ca15d3dbd2cd08e6e7ab9548
+FROM ghcr.io/boldsoftware/sketch:99a2e4afe316b3c6cf138830dbfb7796
ARG GIT_USER_EMAIL
ARG GIT_USER_NAME
@@ -7,7 +7,7 @@
git config --global user.name "$GIT_USER_NAME" && \
git config --global http.postBuffer 524288000
-LABEL sketch_context="3226456072fc35733ff1b5e0f1a4dfc06bceafcf8824dbbb80face06aa167285"
+LABEL sketch_context="45ae7c2a65560701f1da47223747d1e8d9e62d75b5fc28b51d3a5f6afb0daa3e"
COPY . /app
RUN rm -f /app/tmp-sketch-dockerfile
@@ -17,8 +17,8 @@
# Switch to lenient shell so we are more likely to get past failing extra_cmds.
SHELL ["/bin/bash", "-uo", "pipefail", "-c"]
-# No additional commands needed for this simple Go test project
-# The base Dockerfile already includes all necessary Go development tools
+# No special commands needed for this simple Go test project
+# The base image already provides all necessary Go tools
# Switch back to strict shell after extra_cmds.
SHELL ["/bin/bash", "-euxo", "pipefail", "-c"]
diff --git a/dockerimg/testdata/testcreatedockerfile_basic_repo_with_readme.httprr b/dockerimg/testdata/testcreatedockerfile_basic_repo_with_readme.httprr
index 23adfaa..e9f4989 100644
--- a/dockerimg/testdata/testcreatedockerfile_basic_repo_with_readme.httprr
+++ b/dockerimg/testdata/testcreatedockerfile_basic_repo_with_readme.httprr
@@ -1,9 +1,9 @@
httprr trace v1
-4024 1901
+4014 1797
POST https://api.anthropic.com/v1/messages HTTP/1.1
Host: api.anthropic.com
User-Agent: Go-http-client/1.1
-Content-Length: 3827
+Content-Length: 3817
Anthropic-Version: 2023-06-01
Content-Type: application/json
@@ -15,7 +15,7 @@
"content": [
{
"type": "text",
- "text": "\nCall the dockerfile tool to create a Dockerfile.\nThe parameters to dockerfile fill out the From and ExtraCmds\ntemplate variables in the following Go template:\n\n```\nFROM golang:1.24-bookworm\n\n# Switch from dash to bash by default.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\n# attempt to keep package installs lean\nRUN printf '%s\\n' \\\n 'path-exclude=/usr/share/man/*' \\\n 'path-exclude=/usr/share/doc/*' \\\n 'path-exclude=/usr/share/doc-base/*' \\\n 'path-exclude=/usr/share/info/*' \\\n 'path-exclude=/usr/share/locale/*' \\\n 'path-exclude=/usr/share/groff/*' \\\n 'path-exclude=/usr/share/lintian/*' \\\n 'path-exclude=/usr/share/zoneinfo/*' \\\n \u003e /etc/dpkg/dpkg.cfg.d/01_nodoc\n\nRUN apt-get update; \\\n\tapt-get install -y --no-install-recommends \\\n\t\tgit jq sqlite3 npm nodejs gh ripgrep fzf python3 curl vim \u0026\u0026 \\\n\tapt-get clean \u0026\u0026 \\\n\trm -rf /var/lib/apt/lists/*\n\n# Strip out docs from debian.\nRUN rm -rf /usr/share/{doc,doc-base,info,lintian,man,groff,locale,zoneinfo}/*\n\nENV PATH=\"$GOPATH/bin:$PATH\"\n\n# While these binaries install generally useful supporting packages,\n# the specific versions are rarely what a user wants so there is no\n# point polluting the base image module with them.\n\nRUN go install golang.org/x/tools/cmd/goimports@latest; \\\n\tgo install golang.org/x/tools/gopls@latest; \\\n\tgo install mvdan.cc/gofumpt@latest; \\\n\tgo clean -cache -testcache -modcache\n\nENV GOTOOLCHAIN=auto\nENV SKETCH=1\n\nRUN mkdir -p /root/.cache/sketch/webui\n\nARG GIT_USER_EMAIL\nARG GIT_USER_NAME\n\nRUN git config --global user.email \"$GIT_USER_EMAIL\" \u0026\u0026 \\\n git config --global user.name \"$GIT_USER_NAME\" \u0026\u0026 \\\n git config --global http.postBuffer 524288000\n\nLABEL sketch_context=\"{{.InitFilesHash}}\"\nCOPY . /app\nRUN rm -f /app/tmp-sketch-dockerfile\n\nWORKDIR /app{{.SubDir}}\nRUN if [ -f go.mod ]; then go mod download; fi\n\n# Switch to lenient shell so we are more likely to get past failing extra_cmds.\nSHELL [\"/bin/bash\", \"-uo\", \"pipefail\", \"-c\"]\n\n{{.ExtraCmds}}\n\n# Switch back to strict shell after extra_cmds.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\nCMD [\"/bin/sketch\"]\n\n```\n\nIn particular:\n- Assume it is primarily a Go project.\n- Python env setup is challenging and often no required, so any RUN commands involving python tooling should be written to let docker build continue if there is a failure.\n- Include any tools particular to this repository that can be inferred from the given context.\n- Append || true to any apt-get install commands in case the package does not exist.\n- MINIMIZE the number of extra_cmds generated. Straightforward environments do not need any.\n- Do NOT expose any ports.\n- Do NOT generate any CMD or ENTRYPOINT extra commands.\nHere is the content of several files from the repository that may be relevant:\n\n"
+ "text": "\nCall the dockerfile tool to create a Dockerfile.\nThe parameters to dockerfile fill out the From and ExtraCmds\ntemplate variables in the following Go template:\n\n```\nFROM golang:1.24-bookworm\n\n# Switch from dash to bash by default.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\n# attempt to keep package installs lean\nRUN printf '%s\\n' \\\n 'path-exclude=/usr/share/man/*' \\\n 'path-exclude=/usr/share/doc/*' \\\n 'path-exclude=/usr/share/doc-base/*' \\\n 'path-exclude=/usr/share/info/*' \\\n 'path-exclude=/usr/share/locale/*' \\\n 'path-exclude=/usr/share/groff/*' \\\n 'path-exclude=/usr/share/lintian/*' \\\n 'path-exclude=/usr/share/zoneinfo/*' \\\n \u003e /etc/dpkg/dpkg.cfg.d/01_nodoc\n\nRUN apt-get update; \\\n\tapt-get install -y --no-install-recommends \\\n\t\tgit jq sqlite3 npm nodejs gh ripgrep fzf python3 curl vim chromium \u0026\u0026 \\\n\tapt-get clean \u0026\u0026 \\\n\trm -rf /var/lib/apt/lists/* \u0026\u0026 \\\n\trm -rf /usr/share/{doc,doc-base,info,lintian,man,groff,locale,zoneinfo}/*\n\nENV PATH=\"$GOPATH/bin:$PATH\"\n\n# While these binaries install generally useful supporting packages,\n# the specific versions are rarely what a user wants so there is no\n# point polluting the base image module with them.\n\nRUN go install golang.org/x/tools/cmd/goimports@latest; \\\n\tgo install golang.org/x/tools/gopls@latest; \\\n\tgo install mvdan.cc/gofumpt@latest; \\\n\tgo clean -cache -testcache -modcache\n\nENV GOTOOLCHAIN=auto\nENV SKETCH=1\n\nRUN mkdir -p /root/.cache/sketch/webui\n\nARG GIT_USER_EMAIL\nARG GIT_USER_NAME\n\nRUN git config --global user.email \"$GIT_USER_EMAIL\" \u0026\u0026 \\\n git config --global user.name \"$GIT_USER_NAME\" \u0026\u0026 \\\n git config --global http.postBuffer 524288000\n\nLABEL sketch_context=\"{{.InitFilesHash}}\"\nCOPY . /app\nRUN rm -f /app/tmp-sketch-dockerfile\n\nWORKDIR /app{{.SubDir}}\nRUN if [ -f go.mod ]; then go mod download; fi\n\n# Switch to lenient shell so we are more likely to get past failing extra_cmds.\nSHELL [\"/bin/bash\", \"-uo\", \"pipefail\", \"-c\"]\n\n{{.ExtraCmds}}\n\n# Switch back to strict shell after extra_cmds.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\nCMD [\"/bin/sketch\"]\n\n```\n\nIn particular:\n- Assume it is primarily a Go project.\n- Python env setup is challenging and often no required, so any RUN commands involving python tooling should be written to let docker build continue if there is a failure.\n- Include any tools particular to this repository that can be inferred from the given context.\n- Append || true to any apt-get install commands in case the package does not exist.\n- MINIMIZE the number of extra_cmds generated. Straightforward environments do not need any.\n- Do NOT expose any ports.\n- Do NOT generate any CMD or ENTRYPOINT extra commands.\nHere is the content of several files from the repository that may be relevant:\n\n"
},
{
"type": "text",
@@ -54,24 +54,24 @@
Anthropic-Organization-Id: 3c473a21-7208-450a-a9f8-80aebda45c1b
Anthropic-Ratelimit-Input-Tokens-Limit: 200000
Anthropic-Ratelimit-Input-Tokens-Remaining: 200000
-Anthropic-Ratelimit-Input-Tokens-Reset: 2025-05-05T19:55:29Z
+Anthropic-Ratelimit-Input-Tokens-Reset: 2025-05-06T03:30:56Z
Anthropic-Ratelimit-Output-Tokens-Limit: 80000
Anthropic-Ratelimit-Output-Tokens-Remaining: 80000
-Anthropic-Ratelimit-Output-Tokens-Reset: 2025-05-05T19:55:32Z
+Anthropic-Ratelimit-Output-Tokens-Reset: 2025-05-06T03:30:59Z
Anthropic-Ratelimit-Requests-Limit: 4000
Anthropic-Ratelimit-Requests-Remaining: 3999
-Anthropic-Ratelimit-Requests-Reset: 2025-05-05T19:55:28Z
+Anthropic-Ratelimit-Requests-Reset: 2025-05-06T03:30:55Z
Anthropic-Ratelimit-Tokens-Limit: 280000
Anthropic-Ratelimit-Tokens-Remaining: 280000
-Anthropic-Ratelimit-Tokens-Reset: 2025-05-05T19:55:29Z
+Anthropic-Ratelimit-Tokens-Reset: 2025-05-06T03:30:56Z
Cf-Cache-Status: DYNAMIC
-Cf-Ray: 93b2cbb08ab515f7-SJC
+Cf-Ray: 93b566d6690ace9c-SJC
Content-Type: application/json
-Date: Mon, 05 May 2025 19:55:32 GMT
-Request-Id: req_011CNpyGujGv6eewDja4g5Ee
+Date: Tue, 06 May 2025 03:30:59 GMT
+Request-Id: req_011CNqa1FVnavsQuEVK4FSjx
Server: cloudflare
Strict-Transport-Security: max-age=31536000; includeSubDomains; preload
Via: 1.1 google
X-Robots-Tag: none
-{"id":"msg_01FRKiayPrFbD6HCNFk6RhDS","type":"message","role":"assistant","model":"claude-3-7-sonnet-20250219","content":[{"type":"text","text":"Based on the provided information, I'll help you create a Dockerfile for this Go project using the dockerfile tool.\n\nSince this is a simple test Go project without any specific requirements beyond what's already in the template, I don't need to add many extra commands. The template already includes the essential Go development tools and environment setup."},{"type":"tool_use","id":"toolu_018ADQAYzXuVBBSvfwB3WKV6","name":"dockerfile","input":{"extra_cmds":"# No additional commands needed for this simple Go test project\n# The base Dockerfile already includes all necessary Go development tools"}}],"stop_reason":"tool_use","stop_sequence":null,"usage":{"input_tokens":4,"cache_creation_input_tokens":1326,"cache_read_input_tokens":0,"output_tokens":147}}
\ No newline at end of file
+{"id":"msg_01XEdKoiC5EwZX9pS6uvifeA","type":"message","role":"assistant","model":"claude-3-7-sonnet-20250219","content":[{"type":"text","text":"Based on the provided information, you have a simple Go test project. Since the project seems very basic according to the README, and there's no indication of any Python dependencies or specialized tools needed, I'll create a minimal Dockerfile with just the essential setup."},{"type":"tool_use","id":"toolu_01MiuPNSrwSBCv6Q4s5dyg8n","name":"dockerfile","input":{"extra_cmds":"# No special commands needed for this simple Go test project\n# The base image already provides all necessary Go tools"}}],"stop_reason":"tool_use","stop_sequence":null,"usage":{"input_tokens":4,"cache_creation_input_tokens":1321,"cache_read_input_tokens":0,"output_tokens":130}}
\ No newline at end of file
diff --git a/dockerimg/testdata/testcreatedockerfile_empty_repo.dockerfile b/dockerimg/testdata/testcreatedockerfile_empty_repo.dockerfile
index 55e9245..52d6fc3 100644
--- a/dockerimg/testdata/testcreatedockerfile_empty_repo.dockerfile
+++ b/dockerimg/testdata/testcreatedockerfile_empty_repo.dockerfile
@@ -1,4 +1,4 @@
-FROM ghcr.io/boldsoftware/sketch:f5b4ebd9ca15d3dbd2cd08e6e7ab9548
+FROM ghcr.io/boldsoftware/sketch:99a2e4afe316b3c6cf138830dbfb7796
ARG GIT_USER_EMAIL
ARG GIT_USER_NAME
@@ -7,7 +7,7 @@
git config --global user.name "$GIT_USER_NAME" && \
git config --global http.postBuffer 524288000
-LABEL sketch_context="852a43dfbf76c6272f41ade86ac1b4567acb77141edfec6c1df20b07a4758d1a"
+LABEL sketch_context="731625e8ccb108e34ec80ec82ad2eff3d65cd962c13cc9a33e3456d828b48b65"
COPY . /app
RUN rm -f /app/tmp-sketch-dockerfile
@@ -17,19 +17,14 @@
# Switch to lenient shell so we are more likely to get past failing extra_cmds.
SHELL ["/bin/bash", "-uo", "pipefail", "-c"]
-# Install any Go tools that might be useful for development
-go install github.com/golangci/golangci-lint/cmd/golangci-lint@latest || true
-go install github.com/rakyll/gotest@latest || true
+# Install any Go tools specific to development
+RUN go install github.com/golangci/golangci-lint/cmd/golangci-lint@latest || true
-# Install Python dependencies if needed (with error handling)
-if [ -f requirements.txt ]; then
- pip3 install -r requirements.txt || true
-fi
+# Install any Python dependencies if needed (allow failures)
+RUN if [ -f requirements.txt ]; then pip3 install -r requirements.txt || true; fi
-# If Makefile exists, run make prepare or similar setup target
-if [ -f Makefile ]; then
- grep -q "prepare:" Makefile && make prepare || true
-fi
+# Pre-compile the project if possible
+RUN if [ -f go.mod ]; then go build -v ./... || true; fi
# Switch back to strict shell after extra_cmds.
SHELL ["/bin/bash", "-euxo", "pipefail", "-c"]
diff --git a/dockerimg/testdata/testcreatedockerfile_empty_repo.httprr b/dockerimg/testdata/testcreatedockerfile_empty_repo.httprr
index 6f5ec2d..5a4643f 100644
--- a/dockerimg/testdata/testcreatedockerfile_empty_repo.httprr
+++ b/dockerimg/testdata/testcreatedockerfile_empty_repo.httprr
@@ -1,9 +1,9 @@
httprr trace v1
-3777 2383
+3767 1928
POST https://api.anthropic.com/v1/messages HTTP/1.1
Host: api.anthropic.com
User-Agent: Go-http-client/1.1
-Content-Length: 3580
+Content-Length: 3570
Anthropic-Version: 2023-06-01
Content-Type: application/json
@@ -15,7 +15,7 @@
"content": [
{
"type": "text",
- "text": "\nCall the dockerfile tool to create a Dockerfile.\nThe parameters to dockerfile fill out the From and ExtraCmds\ntemplate variables in the following Go template:\n\n```\nFROM golang:1.24-bookworm\n\n# Switch from dash to bash by default.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\n# attempt to keep package installs lean\nRUN printf '%s\\n' \\\n 'path-exclude=/usr/share/man/*' \\\n 'path-exclude=/usr/share/doc/*' \\\n 'path-exclude=/usr/share/doc-base/*' \\\n 'path-exclude=/usr/share/info/*' \\\n 'path-exclude=/usr/share/locale/*' \\\n 'path-exclude=/usr/share/groff/*' \\\n 'path-exclude=/usr/share/lintian/*' \\\n 'path-exclude=/usr/share/zoneinfo/*' \\\n \u003e /etc/dpkg/dpkg.cfg.d/01_nodoc\n\nRUN apt-get update; \\\n\tapt-get install -y --no-install-recommends \\\n\t\tgit jq sqlite3 npm nodejs gh ripgrep fzf python3 curl vim \u0026\u0026 \\\n\tapt-get clean \u0026\u0026 \\\n\trm -rf /var/lib/apt/lists/*\n\n# Strip out docs from debian.\nRUN rm -rf /usr/share/{doc,doc-base,info,lintian,man,groff,locale,zoneinfo}/*\n\nENV PATH=\"$GOPATH/bin:$PATH\"\n\n# While these binaries install generally useful supporting packages,\n# the specific versions are rarely what a user wants so there is no\n# point polluting the base image module with them.\n\nRUN go install golang.org/x/tools/cmd/goimports@latest; \\\n\tgo install golang.org/x/tools/gopls@latest; \\\n\tgo install mvdan.cc/gofumpt@latest; \\\n\tgo clean -cache -testcache -modcache\n\nENV GOTOOLCHAIN=auto\nENV SKETCH=1\n\nRUN mkdir -p /root/.cache/sketch/webui\n\nARG GIT_USER_EMAIL\nARG GIT_USER_NAME\n\nRUN git config --global user.email \"$GIT_USER_EMAIL\" \u0026\u0026 \\\n git config --global user.name \"$GIT_USER_NAME\" \u0026\u0026 \\\n git config --global http.postBuffer 524288000\n\nLABEL sketch_context=\"{{.InitFilesHash}}\"\nCOPY . /app\nRUN rm -f /app/tmp-sketch-dockerfile\n\nWORKDIR /app{{.SubDir}}\nRUN if [ -f go.mod ]; then go mod download; fi\n\n# Switch to lenient shell so we are more likely to get past failing extra_cmds.\nSHELL [\"/bin/bash\", \"-uo\", \"pipefail\", \"-c\"]\n\n{{.ExtraCmds}}\n\n# Switch back to strict shell after extra_cmds.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\nCMD [\"/bin/sketch\"]\n\n```\n\nIn particular:\n- Assume it is primarily a Go project.\n- Python env setup is challenging and often no required, so any RUN commands involving python tooling should be written to let docker build continue if there is a failure.\n- Include any tools particular to this repository that can be inferred from the given context.\n- Append || true to any apt-get install commands in case the package does not exist.\n- MINIMIZE the number of extra_cmds generated. Straightforward environments do not need any.\n- Do NOT expose any ports.\n- Do NOT generate any CMD or ENTRYPOINT extra commands.\n"
+ "text": "\nCall the dockerfile tool to create a Dockerfile.\nThe parameters to dockerfile fill out the From and ExtraCmds\ntemplate variables in the following Go template:\n\n```\nFROM golang:1.24-bookworm\n\n# Switch from dash to bash by default.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\n# attempt to keep package installs lean\nRUN printf '%s\\n' \\\n 'path-exclude=/usr/share/man/*' \\\n 'path-exclude=/usr/share/doc/*' \\\n 'path-exclude=/usr/share/doc-base/*' \\\n 'path-exclude=/usr/share/info/*' \\\n 'path-exclude=/usr/share/locale/*' \\\n 'path-exclude=/usr/share/groff/*' \\\n 'path-exclude=/usr/share/lintian/*' \\\n 'path-exclude=/usr/share/zoneinfo/*' \\\n \u003e /etc/dpkg/dpkg.cfg.d/01_nodoc\n\nRUN apt-get update; \\\n\tapt-get install -y --no-install-recommends \\\n\t\tgit jq sqlite3 npm nodejs gh ripgrep fzf python3 curl vim chromium \u0026\u0026 \\\n\tapt-get clean \u0026\u0026 \\\n\trm -rf /var/lib/apt/lists/* \u0026\u0026 \\\n\trm -rf /usr/share/{doc,doc-base,info,lintian,man,groff,locale,zoneinfo}/*\n\nENV PATH=\"$GOPATH/bin:$PATH\"\n\n# While these binaries install generally useful supporting packages,\n# the specific versions are rarely what a user wants so there is no\n# point polluting the base image module with them.\n\nRUN go install golang.org/x/tools/cmd/goimports@latest; \\\n\tgo install golang.org/x/tools/gopls@latest; \\\n\tgo install mvdan.cc/gofumpt@latest; \\\n\tgo clean -cache -testcache -modcache\n\nENV GOTOOLCHAIN=auto\nENV SKETCH=1\n\nRUN mkdir -p /root/.cache/sketch/webui\n\nARG GIT_USER_EMAIL\nARG GIT_USER_NAME\n\nRUN git config --global user.email \"$GIT_USER_EMAIL\" \u0026\u0026 \\\n git config --global user.name \"$GIT_USER_NAME\" \u0026\u0026 \\\n git config --global http.postBuffer 524288000\n\nLABEL sketch_context=\"{{.InitFilesHash}}\"\nCOPY . /app\nRUN rm -f /app/tmp-sketch-dockerfile\n\nWORKDIR /app{{.SubDir}}\nRUN if [ -f go.mod ]; then go mod download; fi\n\n# Switch to lenient shell so we are more likely to get past failing extra_cmds.\nSHELL [\"/bin/bash\", \"-uo\", \"pipefail\", \"-c\"]\n\n{{.ExtraCmds}}\n\n# Switch back to strict shell after extra_cmds.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\nCMD [\"/bin/sketch\"]\n\n```\n\nIn particular:\n- Assume it is primarily a Go project.\n- Python env setup is challenging and often no required, so any RUN commands involving python tooling should be written to let docker build continue if there is a failure.\n- Include any tools particular to this repository that can be inferred from the given context.\n- Append || true to any apt-get install commands in case the package does not exist.\n- MINIMIZE the number of extra_cmds generated. Straightforward environments do not need any.\n- Do NOT expose any ports.\n- Do NOT generate any CMD or ENTRYPOINT extra commands.\n"
},
{
"type": "text",
@@ -50,24 +50,24 @@
Anthropic-Organization-Id: 3c473a21-7208-450a-a9f8-80aebda45c1b
Anthropic-Ratelimit-Input-Tokens-Limit: 200000
Anthropic-Ratelimit-Input-Tokens-Remaining: 200000
-Anthropic-Ratelimit-Input-Tokens-Reset: 2025-05-05T19:55:42Z
+Anthropic-Ratelimit-Input-Tokens-Reset: 2025-05-06T03:31:08Z
Anthropic-Ratelimit-Output-Tokens-Limit: 80000
Anthropic-Ratelimit-Output-Tokens-Remaining: 80000
-Anthropic-Ratelimit-Output-Tokens-Reset: 2025-05-05T19:55:46Z
+Anthropic-Ratelimit-Output-Tokens-Reset: 2025-05-06T03:31:10Z
Anthropic-Ratelimit-Requests-Limit: 4000
Anthropic-Ratelimit-Requests-Remaining: 3999
-Anthropic-Ratelimit-Requests-Reset: 2025-05-05T19:55:40Z
+Anthropic-Ratelimit-Requests-Reset: 2025-05-06T03:31:07Z
Anthropic-Ratelimit-Tokens-Limit: 280000
Anthropic-Ratelimit-Tokens-Remaining: 280000
-Anthropic-Ratelimit-Tokens-Reset: 2025-05-05T19:55:42Z
+Anthropic-Ratelimit-Tokens-Reset: 2025-05-06T03:31:08Z
Cf-Cache-Status: DYNAMIC
-Cf-Ray: 93b2cbf9bcab15f7-SJC
+Cf-Ray: 93b56723daa0ce9c-SJC
Content-Type: application/json
-Date: Mon, 05 May 2025 19:55:46 GMT
-Request-Id: req_011CNpyHmZv42gfUEp4BiYvZ
+Date: Tue, 06 May 2025 03:31:11 GMT
+Request-Id: req_011CNqa2AVC9m56dtxX5MqbJ
Server: cloudflare
Strict-Transport-Security: max-age=31536000; includeSubDomains; preload
Via: 1.1 google
X-Robots-Tag: none
-{"id":"msg_01P8BMBGo1uG2pRH27YTQKRw","type":"message","role":"assistant","model":"claude-3-7-sonnet-20250219","content":[{"type":"text","text":"I'll help you create a Dockerfile for this Go project. Based on the template you provided, I need to generate appropriate extra commands for the Dockerfile that will set up a development environment.\n\nSince you mentioned this is primarily a Go project, I'll focus on creating a minimal set of extra commands that might be helpful for a Go development environment. I'll ensure Python commands have error handling, and apt-get install commands have the \"|| true\" suffix as requested."},{"type":"tool_use","id":"toolu_015rV7PbsVvcoTHGnkcYtC78","name":"dockerfile","input":{"extra_cmds":"# Install any Go tools that might be useful for development\ngo install github.com/golangci/golangci-lint/cmd/golangci-lint@latest || true\ngo install github.com/rakyll/gotest@latest || true\n\n# Install Python dependencies if needed (with error handling)\nif [ -f requirements.txt ]; then\n pip3 install -r requirements.txt || true\nfi\n\n# If Makefile exists, run make prepare or similar setup target\nif [ -f Makefile ]; then\n grep -q \"prepare:\" Makefile && make prepare || true\nfi"}}],"stop_reason":"tool_use","stop_sequence":null,"usage":{"input_tokens":4,"cache_creation_input_tokens":1282,"cache_read_input_tokens":0,"output_tokens":289}}
\ No newline at end of file
+{"id":"msg_01UEUtJaKVQygbeUjy9apyfW","type":"message","role":"assistant","model":"claude-3-7-sonnet-20250219","content":[{"type":"text","text":"I'll call the dockerfile tool to create a Dockerfile for your Go project. Based on the template provided, I'll add minimal but useful extra commands."},{"type":"tool_use","id":"toolu_01GSRQTjFTpsavcRqaZCKaRP","name":"dockerfile","input":{"extra_cmds":"# Install any Go tools specific to development\nRUN go install github.com/golangci/golangci-lint/cmd/golangci-lint@latest || true\n\n# Install any Python dependencies if needed (allow failures)\nRUN if [ -f requirements.txt ]; then pip3 install -r requirements.txt || true; fi\n\n# Pre-compile the project if possible\nRUN if [ -f go.mod ]; then go build -v ./... || true; fi"}}],"stop_reason":"tool_use","stop_sequence":null,"usage":{"input_tokens":4,"cache_creation_input_tokens":1277,"cache_read_input_tokens":0,"output_tokens":195}}
\ No newline at end of file
diff --git a/dockerimg/testdata/testcreatedockerfile_mention_a_devtool_in_the_readme.dockerfile b/dockerimg/testdata/testcreatedockerfile_mention_a_devtool_in_the_readme.dockerfile
index 2084803..9fddf21 100644
--- a/dockerimg/testdata/testcreatedockerfile_mention_a_devtool_in_the_readme.dockerfile
+++ b/dockerimg/testdata/testcreatedockerfile_mention_a_devtool_in_the_readme.dockerfile
@@ -1,4 +1,4 @@
-FROM ghcr.io/boldsoftware/sketch:f5b4ebd9ca15d3dbd2cd08e6e7ab9548
+FROM ghcr.io/boldsoftware/sketch:99a2e4afe316b3c6cf138830dbfb7796
ARG GIT_USER_EMAIL
ARG GIT_USER_NAME
@@ -7,7 +7,7 @@
git config --global user.name "$GIT_USER_NAME" && \
git config --global http.postBuffer 524288000
-LABEL sketch_context="32ece3b0a507af8cac1fec473edc43346e765c027651b7a02724dbf70e75c76c"
+LABEL sketch_context="4b57cd5672dffa6afe8495834d5965702be578e00b3ef168060630c7d1889fd9"
COPY . /app
RUN rm -f /app/tmp-sketch-dockerfile
@@ -17,10 +17,15 @@
# Switch to lenient shell so we are more likely to get past failing extra_cmds.
SHELL ["/bin/bash", "-uo", "pipefail", "-c"]
-RUN apt-get update && apt-get install -y --no-install-recommends graphviz || true
+RUN apt-get update && \
+ apt-get install -y --no-install-recommends graphviz || true && \
+ apt-get clean && \
+ rm -rf /var/lib/apt/lists/*
-# Python tooling setup - designed to continue even if there are failures
-RUN pip3 install --upgrade pip || true
+# Python environment setup with error handling
+RUN if [ -f requirements.txt ]; then \
+ pip3 install -r requirements.txt || true; \
+fi
# Switch back to strict shell after extra_cmds.
SHELL ["/bin/bash", "-euxo", "pipefail", "-c"]
diff --git a/dockerimg/testdata/testcreatedockerfile_mention_a_devtool_in_the_readme.httprr b/dockerimg/testdata/testcreatedockerfile_mention_a_devtool_in_the_readme.httprr
index 53ec9b4..42d2c68 100644
--- a/dockerimg/testdata/testcreatedockerfile_mention_a_devtool_in_the_readme.httprr
+++ b/dockerimg/testdata/testcreatedockerfile_mention_a_devtool_in_the_readme.httprr
@@ -1,9 +1,9 @@
httprr trace v1
-4039 1897
+4029 1904
POST https://api.anthropic.com/v1/messages HTTP/1.1
Host: api.anthropic.com
User-Agent: Go-http-client/1.1
-Content-Length: 3842
+Content-Length: 3832
Anthropic-Version: 2023-06-01
Content-Type: application/json
@@ -15,7 +15,7 @@
"content": [
{
"type": "text",
- "text": "\nCall the dockerfile tool to create a Dockerfile.\nThe parameters to dockerfile fill out the From and ExtraCmds\ntemplate variables in the following Go template:\n\n```\nFROM golang:1.24-bookworm\n\n# Switch from dash to bash by default.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\n# attempt to keep package installs lean\nRUN printf '%s\\n' \\\n 'path-exclude=/usr/share/man/*' \\\n 'path-exclude=/usr/share/doc/*' \\\n 'path-exclude=/usr/share/doc-base/*' \\\n 'path-exclude=/usr/share/info/*' \\\n 'path-exclude=/usr/share/locale/*' \\\n 'path-exclude=/usr/share/groff/*' \\\n 'path-exclude=/usr/share/lintian/*' \\\n 'path-exclude=/usr/share/zoneinfo/*' \\\n \u003e /etc/dpkg/dpkg.cfg.d/01_nodoc\n\nRUN apt-get update; \\\n\tapt-get install -y --no-install-recommends \\\n\t\tgit jq sqlite3 npm nodejs gh ripgrep fzf python3 curl vim \u0026\u0026 \\\n\tapt-get clean \u0026\u0026 \\\n\trm -rf /var/lib/apt/lists/*\n\n# Strip out docs from debian.\nRUN rm -rf /usr/share/{doc,doc-base,info,lintian,man,groff,locale,zoneinfo}/*\n\nENV PATH=\"$GOPATH/bin:$PATH\"\n\n# While these binaries install generally useful supporting packages,\n# the specific versions are rarely what a user wants so there is no\n# point polluting the base image module with them.\n\nRUN go install golang.org/x/tools/cmd/goimports@latest; \\\n\tgo install golang.org/x/tools/gopls@latest; \\\n\tgo install mvdan.cc/gofumpt@latest; \\\n\tgo clean -cache -testcache -modcache\n\nENV GOTOOLCHAIN=auto\nENV SKETCH=1\n\nRUN mkdir -p /root/.cache/sketch/webui\n\nARG GIT_USER_EMAIL\nARG GIT_USER_NAME\n\nRUN git config --global user.email \"$GIT_USER_EMAIL\" \u0026\u0026 \\\n git config --global user.name \"$GIT_USER_NAME\" \u0026\u0026 \\\n git config --global http.postBuffer 524288000\n\nLABEL sketch_context=\"{{.InitFilesHash}}\"\nCOPY . /app\nRUN rm -f /app/tmp-sketch-dockerfile\n\nWORKDIR /app{{.SubDir}}\nRUN if [ -f go.mod ]; then go mod download; fi\n\n# Switch to lenient shell so we are more likely to get past failing extra_cmds.\nSHELL [\"/bin/bash\", \"-uo\", \"pipefail\", \"-c\"]\n\n{{.ExtraCmds}}\n\n# Switch back to strict shell after extra_cmds.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\nCMD [\"/bin/sketch\"]\n\n```\n\nIn particular:\n- Assume it is primarily a Go project.\n- Python env setup is challenging and often no required, so any RUN commands involving python tooling should be written to let docker build continue if there is a failure.\n- Include any tools particular to this repository that can be inferred from the given context.\n- Append || true to any apt-get install commands in case the package does not exist.\n- MINIMIZE the number of extra_cmds generated. Straightforward environments do not need any.\n- Do NOT expose any ports.\n- Do NOT generate any CMD or ENTRYPOINT extra commands.\nHere is the content of several files from the repository that may be relevant:\n\n"
+ "text": "\nCall the dockerfile tool to create a Dockerfile.\nThe parameters to dockerfile fill out the From and ExtraCmds\ntemplate variables in the following Go template:\n\n```\nFROM golang:1.24-bookworm\n\n# Switch from dash to bash by default.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\n# attempt to keep package installs lean\nRUN printf '%s\\n' \\\n 'path-exclude=/usr/share/man/*' \\\n 'path-exclude=/usr/share/doc/*' \\\n 'path-exclude=/usr/share/doc-base/*' \\\n 'path-exclude=/usr/share/info/*' \\\n 'path-exclude=/usr/share/locale/*' \\\n 'path-exclude=/usr/share/groff/*' \\\n 'path-exclude=/usr/share/lintian/*' \\\n 'path-exclude=/usr/share/zoneinfo/*' \\\n \u003e /etc/dpkg/dpkg.cfg.d/01_nodoc\n\nRUN apt-get update; \\\n\tapt-get install -y --no-install-recommends \\\n\t\tgit jq sqlite3 npm nodejs gh ripgrep fzf python3 curl vim chromium \u0026\u0026 \\\n\tapt-get clean \u0026\u0026 \\\n\trm -rf /var/lib/apt/lists/* \u0026\u0026 \\\n\trm -rf /usr/share/{doc,doc-base,info,lintian,man,groff,locale,zoneinfo}/*\n\nENV PATH=\"$GOPATH/bin:$PATH\"\n\n# While these binaries install generally useful supporting packages,\n# the specific versions are rarely what a user wants so there is no\n# point polluting the base image module with them.\n\nRUN go install golang.org/x/tools/cmd/goimports@latest; \\\n\tgo install golang.org/x/tools/gopls@latest; \\\n\tgo install mvdan.cc/gofumpt@latest; \\\n\tgo clean -cache -testcache -modcache\n\nENV GOTOOLCHAIN=auto\nENV SKETCH=1\n\nRUN mkdir -p /root/.cache/sketch/webui\n\nARG GIT_USER_EMAIL\nARG GIT_USER_NAME\n\nRUN git config --global user.email \"$GIT_USER_EMAIL\" \u0026\u0026 \\\n git config --global user.name \"$GIT_USER_NAME\" \u0026\u0026 \\\n git config --global http.postBuffer 524288000\n\nLABEL sketch_context=\"{{.InitFilesHash}}\"\nCOPY . /app\nRUN rm -f /app/tmp-sketch-dockerfile\n\nWORKDIR /app{{.SubDir}}\nRUN if [ -f go.mod ]; then go mod download; fi\n\n# Switch to lenient shell so we are more likely to get past failing extra_cmds.\nSHELL [\"/bin/bash\", \"-uo\", \"pipefail\", \"-c\"]\n\n{{.ExtraCmds}}\n\n# Switch back to strict shell after extra_cmds.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\nCMD [\"/bin/sketch\"]\n\n```\n\nIn particular:\n- Assume it is primarily a Go project.\n- Python env setup is challenging and often no required, so any RUN commands involving python tooling should be written to let docker build continue if there is a failure.\n- Include any tools particular to this repository that can be inferred from the given context.\n- Append || true to any apt-get install commands in case the package does not exist.\n- MINIMIZE the number of extra_cmds generated. Straightforward environments do not need any.\n- Do NOT expose any ports.\n- Do NOT generate any CMD or ENTRYPOINT extra commands.\nHere is the content of several files from the repository that may be relevant:\n\n"
},
{
"type": "text",
@@ -54,24 +54,24 @@
Anthropic-Organization-Id: 3c473a21-7208-450a-a9f8-80aebda45c1b
Anthropic-Ratelimit-Input-Tokens-Limit: 200000
Anthropic-Ratelimit-Input-Tokens-Remaining: 200000
-Anthropic-Ratelimit-Input-Tokens-Reset: 2025-05-05T19:55:37Z
+Anthropic-Ratelimit-Input-Tokens-Reset: 2025-05-06T03:31:04Z
Anthropic-Ratelimit-Output-Tokens-Limit: 80000
Anthropic-Ratelimit-Output-Tokens-Remaining: 80000
-Anthropic-Ratelimit-Output-Tokens-Reset: 2025-05-05T19:55:40Z
+Anthropic-Ratelimit-Output-Tokens-Reset: 2025-05-06T03:31:07Z
Anthropic-Ratelimit-Requests-Limit: 4000
Anthropic-Ratelimit-Requests-Remaining: 3999
-Anthropic-Ratelimit-Requests-Reset: 2025-05-05T19:55:36Z
+Anthropic-Ratelimit-Requests-Reset: 2025-05-06T03:31:03Z
Anthropic-Ratelimit-Tokens-Limit: 280000
Anthropic-Ratelimit-Tokens-Remaining: 280000
-Anthropic-Ratelimit-Tokens-Reset: 2025-05-05T19:55:37Z
+Anthropic-Ratelimit-Tokens-Reset: 2025-05-06T03:31:04Z
Cf-Cache-Status: DYNAMIC
-Cf-Ray: 93b2cbe1cf0f15f7-SJC
+Cf-Ray: 93b5670b1ca7ce9c-SJC
Content-Type: application/json
-Date: Mon, 05 May 2025 19:55:40 GMT
-Request-Id: req_011CNpyHVEQN87xrm73oPwzT
+Date: Tue, 06 May 2025 03:31:07 GMT
+Request-Id: req_011CNqa1sZCxEso2UKmHCyjV
Server: cloudflare
Strict-Transport-Security: max-age=31536000; includeSubDomains; preload
Via: 1.1 google
X-Robots-Tag: none
-{"id":"msg_01Mikz4aehYkkuUzVtUjHuV3","type":"message","role":"assistant","model":"claude-3-7-sonnet-20250219","content":[{"type":"text","text":"Thank you for providing the details for creating a Dockerfile. Based on the information given, I'll call the dockerfile tool to generate the appropriate Dockerfile.\n\nFrom the readme.md file, I can see that the project requires the `dot` tool to run tests, which is part of the Graphviz package."},{"type":"tool_use","id":"toolu_013MzpkEN2DJ1Zd8YPtF2tPQ","name":"dockerfile","input":{"extra_cmds":"RUN apt-get update && apt-get install -y --no-install-recommends graphviz || true\n\n# Python tooling setup - designed to continue even if there are failures\nRUN pip3 install --upgrade pip || true"}}],"stop_reason":"tool_use","stop_sequence":null,"usage":{"input_tokens":4,"cache_creation_input_tokens":1331,"cache_read_input_tokens":0,"output_tokens":172}}
\ No newline at end of file
+{"id":"msg_01JY4FYjAcRmUSgk7PdN9nRp","type":"message","role":"assistant","model":"claude-3-7-sonnet-20250219","content":[{"type":"text","text":"Based on the information provided, I'll create a Dockerfile for this Go project. I notice from the readme.md that the project requires the `dot` tool to run tests, which is part of the Graphviz package."},{"type":"tool_use","id":"toolu_01TBHw25aMdP3w1pitKnr1e1","name":"dockerfile","input":{"extra_cmds":"RUN apt-get update && \\\n apt-get install -y --no-install-recommends graphviz || true && \\\n apt-get clean && \\\n rm -rf /var/lib/apt/lists/*\n\n# Python environment setup with error handling\nRUN if [ -f requirements.txt ]; then \\\n pip3 install -r requirements.txt || true; \\\nfi"}}],"stop_reason":"tool_use","stop_sequence":null,"usage":{"input_tokens":4,"cache_creation_input_tokens":1326,"cache_read_input_tokens":0,"output_tokens":193}}
\ No newline at end of file
diff --git a/dockerimg/testdata/testcreatedockerfile_python_misery.dockerfile b/dockerimg/testdata/testcreatedockerfile_python_misery.dockerfile
index 9e6ada1..b98c741 100644
--- a/dockerimg/testdata/testcreatedockerfile_python_misery.dockerfile
+++ b/dockerimg/testdata/testcreatedockerfile_python_misery.dockerfile
@@ -1,4 +1,4 @@
-FROM ghcr.io/boldsoftware/sketch:f5b4ebd9ca15d3dbd2cd08e6e7ab9548
+FROM ghcr.io/boldsoftware/sketch:99a2e4afe316b3c6cf138830dbfb7796
ARG GIT_USER_EMAIL
ARG GIT_USER_NAME
@@ -7,7 +7,7 @@
git config --global user.name "$GIT_USER_NAME" && \
git config --global http.postBuffer 524288000
-LABEL sketch_context="79b4c82f0c892e5f79900afb235c0ab50044626be5d6d43b774f6f5da9537800"
+LABEL sketch_context="7c933e98fc1d5fd35f964b6cf115bcf65b580c378069d078ab66723b2b1073c4"
COPY . /app
RUN rm -f /app/tmp-sketch-dockerfile
@@ -17,16 +17,24 @@
# Switch to lenient shell so we are more likely to get past failing extra_cmds.
SHELL ["/bin/bash", "-uo", "pipefail", "-c"]
-# Install Python 3.11 (if not already the default version) and set it up
-RUN apt-get update && \
- apt-get install -y --no-install-recommends python3.11 python3.11-venv python3-pip || true && \
- update-alternatives --install /usr/bin/python3 python3 /usr/bin/python3.11 1 || true && \
- apt-get clean && \
- rm -rf /var/lib/apt/lists/*
+# Install Python 3.11 (attempt to continue on failure)
+RUN apt-get update && apt-get install -y --no-install-recommends python3.11 python3.11-venv python3.11-dev python3-pip || true
-# Install DVC tool as mentioned in README
+# Set up Python 3.11 as default Python
+RUN if command -v python3.11 &> /dev/null; then \
+ update-alternatives --install /usr/bin/python3 python3 /usr/bin/python3.11 1 || true; \
+ fi
+
+# Install DVC tool
RUN pip3 install dvc || true
+# Create and activate Python virtual environment if needed
+RUN if [ -f requirements.txt ]; then \
+ python3 -m venv .venv || true; \
+ source .venv/bin/activate || true; \
+ pip install -r requirements.txt || true; \
+ fi
+
# Switch back to strict shell after extra_cmds.
SHELL ["/bin/bash", "-euxo", "pipefail", "-c"]
diff --git a/dockerimg/testdata/testcreatedockerfile_python_misery.httprr b/dockerimg/testdata/testcreatedockerfile_python_misery.httprr
index b1ef4e7..7124d60 100644
--- a/dockerimg/testdata/testcreatedockerfile_python_misery.httprr
+++ b/dockerimg/testdata/testcreatedockerfile_python_misery.httprr
@@ -1,9 +1,9 @@
httprr trace v1
-4062 2058
+4052 2258
POST https://api.anthropic.com/v1/messages HTTP/1.1
Host: api.anthropic.com
User-Agent: Go-http-client/1.1
-Content-Length: 3865
+Content-Length: 3855
Anthropic-Version: 2023-06-01
Content-Type: application/json
@@ -15,7 +15,7 @@
"content": [
{
"type": "text",
- "text": "\nCall the dockerfile tool to create a Dockerfile.\nThe parameters to dockerfile fill out the From and ExtraCmds\ntemplate variables in the following Go template:\n\n```\nFROM golang:1.24-bookworm\n\n# Switch from dash to bash by default.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\n# attempt to keep package installs lean\nRUN printf '%s\\n' \\\n 'path-exclude=/usr/share/man/*' \\\n 'path-exclude=/usr/share/doc/*' \\\n 'path-exclude=/usr/share/doc-base/*' \\\n 'path-exclude=/usr/share/info/*' \\\n 'path-exclude=/usr/share/locale/*' \\\n 'path-exclude=/usr/share/groff/*' \\\n 'path-exclude=/usr/share/lintian/*' \\\n 'path-exclude=/usr/share/zoneinfo/*' \\\n \u003e /etc/dpkg/dpkg.cfg.d/01_nodoc\n\nRUN apt-get update; \\\n\tapt-get install -y --no-install-recommends \\\n\t\tgit jq sqlite3 npm nodejs gh ripgrep fzf python3 curl vim \u0026\u0026 \\\n\tapt-get clean \u0026\u0026 \\\n\trm -rf /var/lib/apt/lists/*\n\n# Strip out docs from debian.\nRUN rm -rf /usr/share/{doc,doc-base,info,lintian,man,groff,locale,zoneinfo}/*\n\nENV PATH=\"$GOPATH/bin:$PATH\"\n\n# While these binaries install generally useful supporting packages,\n# the specific versions are rarely what a user wants so there is no\n# point polluting the base image module with them.\n\nRUN go install golang.org/x/tools/cmd/goimports@latest; \\\n\tgo install golang.org/x/tools/gopls@latest; \\\n\tgo install mvdan.cc/gofumpt@latest; \\\n\tgo clean -cache -testcache -modcache\n\nENV GOTOOLCHAIN=auto\nENV SKETCH=1\n\nRUN mkdir -p /root/.cache/sketch/webui\n\nARG GIT_USER_EMAIL\nARG GIT_USER_NAME\n\nRUN git config --global user.email \"$GIT_USER_EMAIL\" \u0026\u0026 \\\n git config --global user.name \"$GIT_USER_NAME\" \u0026\u0026 \\\n git config --global http.postBuffer 524288000\n\nLABEL sketch_context=\"{{.InitFilesHash}}\"\nCOPY . /app\nRUN rm -f /app/tmp-sketch-dockerfile\n\nWORKDIR /app{{.SubDir}}\nRUN if [ -f go.mod ]; then go mod download; fi\n\n# Switch to lenient shell so we are more likely to get past failing extra_cmds.\nSHELL [\"/bin/bash\", \"-uo\", \"pipefail\", \"-c\"]\n\n{{.ExtraCmds}}\n\n# Switch back to strict shell after extra_cmds.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\nCMD [\"/bin/sketch\"]\n\n```\n\nIn particular:\n- Assume it is primarily a Go project.\n- Python env setup is challenging and often no required, so any RUN commands involving python tooling should be written to let docker build continue if there is a failure.\n- Include any tools particular to this repository that can be inferred from the given context.\n- Append || true to any apt-get install commands in case the package does not exist.\n- MINIMIZE the number of extra_cmds generated. Straightforward environments do not need any.\n- Do NOT expose any ports.\n- Do NOT generate any CMD or ENTRYPOINT extra commands.\nHere is the content of several files from the repository that may be relevant:\n\n"
+ "text": "\nCall the dockerfile tool to create a Dockerfile.\nThe parameters to dockerfile fill out the From and ExtraCmds\ntemplate variables in the following Go template:\n\n```\nFROM golang:1.24-bookworm\n\n# Switch from dash to bash by default.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\n# attempt to keep package installs lean\nRUN printf '%s\\n' \\\n 'path-exclude=/usr/share/man/*' \\\n 'path-exclude=/usr/share/doc/*' \\\n 'path-exclude=/usr/share/doc-base/*' \\\n 'path-exclude=/usr/share/info/*' \\\n 'path-exclude=/usr/share/locale/*' \\\n 'path-exclude=/usr/share/groff/*' \\\n 'path-exclude=/usr/share/lintian/*' \\\n 'path-exclude=/usr/share/zoneinfo/*' \\\n \u003e /etc/dpkg/dpkg.cfg.d/01_nodoc\n\nRUN apt-get update; \\\n\tapt-get install -y --no-install-recommends \\\n\t\tgit jq sqlite3 npm nodejs gh ripgrep fzf python3 curl vim chromium \u0026\u0026 \\\n\tapt-get clean \u0026\u0026 \\\n\trm -rf /var/lib/apt/lists/* \u0026\u0026 \\\n\trm -rf /usr/share/{doc,doc-base,info,lintian,man,groff,locale,zoneinfo}/*\n\nENV PATH=\"$GOPATH/bin:$PATH\"\n\n# While these binaries install generally useful supporting packages,\n# the specific versions are rarely what a user wants so there is no\n# point polluting the base image module with them.\n\nRUN go install golang.org/x/tools/cmd/goimports@latest; \\\n\tgo install golang.org/x/tools/gopls@latest; \\\n\tgo install mvdan.cc/gofumpt@latest; \\\n\tgo clean -cache -testcache -modcache\n\nENV GOTOOLCHAIN=auto\nENV SKETCH=1\n\nRUN mkdir -p /root/.cache/sketch/webui\n\nARG GIT_USER_EMAIL\nARG GIT_USER_NAME\n\nRUN git config --global user.email \"$GIT_USER_EMAIL\" \u0026\u0026 \\\n git config --global user.name \"$GIT_USER_NAME\" \u0026\u0026 \\\n git config --global http.postBuffer 524288000\n\nLABEL sketch_context=\"{{.InitFilesHash}}\"\nCOPY . /app\nRUN rm -f /app/tmp-sketch-dockerfile\n\nWORKDIR /app{{.SubDir}}\nRUN if [ -f go.mod ]; then go mod download; fi\n\n# Switch to lenient shell so we are more likely to get past failing extra_cmds.\nSHELL [\"/bin/bash\", \"-uo\", \"pipefail\", \"-c\"]\n\n{{.ExtraCmds}}\n\n# Switch back to strict shell after extra_cmds.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\nCMD [\"/bin/sketch\"]\n\n```\n\nIn particular:\n- Assume it is primarily a Go project.\n- Python env setup is challenging and often no required, so any RUN commands involving python tooling should be written to let docker build continue if there is a failure.\n- Include any tools particular to this repository that can be inferred from the given context.\n- Append || true to any apt-get install commands in case the package does not exist.\n- MINIMIZE the number of extra_cmds generated. Straightforward environments do not need any.\n- Do NOT expose any ports.\n- Do NOT generate any CMD or ENTRYPOINT extra commands.\nHere is the content of several files from the repository that may be relevant:\n\n"
},
{
"type": "text",
@@ -54,24 +54,24 @@
Anthropic-Organization-Id: 3c473a21-7208-450a-a9f8-80aebda45c1b
Anthropic-Ratelimit-Input-Tokens-Limit: 200000
Anthropic-Ratelimit-Input-Tokens-Remaining: 200000
-Anthropic-Ratelimit-Input-Tokens-Reset: 2025-05-05T19:55:47Z
+Anthropic-Ratelimit-Input-Tokens-Reset: 2025-05-06T03:31:12Z
Anthropic-Ratelimit-Output-Tokens-Limit: 80000
Anthropic-Ratelimit-Output-Tokens-Remaining: 80000
-Anthropic-Ratelimit-Output-Tokens-Reset: 2025-05-05T19:55:50Z
+Anthropic-Ratelimit-Output-Tokens-Reset: 2025-05-06T03:31:16Z
Anthropic-Ratelimit-Requests-Limit: 4000
Anthropic-Ratelimit-Requests-Remaining: 3999
-Anthropic-Ratelimit-Requests-Reset: 2025-05-05T19:55:47Z
+Anthropic-Ratelimit-Requests-Reset: 2025-05-06T03:31:11Z
Anthropic-Ratelimit-Tokens-Limit: 280000
Anthropic-Ratelimit-Tokens-Remaining: 280000
-Anthropic-Ratelimit-Tokens-Reset: 2025-05-05T19:55:47Z
+Anthropic-Ratelimit-Tokens-Reset: 2025-05-06T03:31:12Z
Cf-Cache-Status: DYNAMIC
-Cf-Ray: 93b2cc227ed515f7-SJC
+Cf-Ray: 93b5673b6e3bce9c-SJC
Content-Type: application/json
-Date: Mon, 05 May 2025 19:55:51 GMT
-Request-Id: req_011CNpyJFSiFJUtRqgiMPiG3
+Date: Tue, 06 May 2025 03:31:16 GMT
+Request-Id: req_011CNqa2SbZGPRZ3VpTEzQeT
Server: cloudflare
Strict-Transport-Security: max-age=31536000; includeSubDomains; preload
Via: 1.1 google
X-Robots-Tag: none
-{"id":"msg_01G9uUSv5BciWemp442LWMUE","type":"message","role":"assistant","model":"claude-3-7-sonnet-20250219","content":[{"type":"text","text":"Based on the README.md, this project requires Python 3.11 and the DVC (Data Version Control) tool. Since the dockerfile template already includes Python3, I'll add commands to ensure Python 3.11 is installed and to set up DVC."},{"type":"tool_use","id":"toolu_01PWZdG27vVMNfzgzmLV7Hi8","name":"dockerfile","input":{"extra_cmds":"# Install Python 3.11 (if not already the default version) and set it up\nRUN apt-get update && \\\n apt-get install -y --no-install-recommends python3.11 python3.11-venv python3-pip || true && \\\n update-alternatives --install /usr/bin/python3 python3 /usr/bin/python3.11 1 || true && \\\n apt-get clean && \\\n rm -rf /var/lib/apt/lists/*\n\n# Install DVC tool as mentioned in README\nRUN pip3 install dvc || true"}}],"stop_reason":"tool_use","stop_sequence":null,"usage":{"input_tokens":4,"cache_creation_input_tokens":1338,"cache_read_input_tokens":0,"output_tokens":254}}
\ No newline at end of file
+{"id":"msg_01G7Rd33sjrAA319QvFpukeZ","type":"message","role":"assistant","model":"claude-3-7-sonnet-20250219","content":[{"type":"text","text":"Based on the README.md file, I can see that this project requires Python 3.11 and the DVC tool. I'll create a Dockerfile with appropriate extra commands to set up these requirements."},{"type":"tool_use","id":"toolu_01MQ46ddwZ7x3VerhB9uRJiR","name":"dockerfile","input":{"extra_cmds":"# Install Python 3.11 (attempt to continue on failure)\nRUN apt-get update && apt-get install -y --no-install-recommends python3.11 python3.11-venv python3.11-dev python3-pip || true\n\n# Set up Python 3.11 as default Python\nRUN if command -v python3.11 &> /dev/null; then \\\n update-alternatives --install /usr/bin/python3 python3 /usr/bin/python3.11 1 || true; \\\n fi\n\n# Install DVC tool\nRUN pip3 install dvc || true\n\n# Create and activate Python virtual environment if needed\nRUN if [ -f requirements.txt ]; then \\\n python3 -m venv .venv || true; \\\n source .venv/bin/activate || true; \\\n pip install -r requirements.txt || true; \\\n fi"}}],"stop_reason":"tool_use","stop_sequence":null,"usage":{"input_tokens":4,"cache_creation_input_tokens":1333,"cache_read_input_tokens":0,"output_tokens":317}}
\ No newline at end of file
diff --git a/dockerimg/testdata/testcreatedockerfile_repo_with_readme_and_workflow.dockerfile b/dockerimg/testdata/testcreatedockerfile_repo_with_readme_and_workflow.dockerfile
index c9070fc..c76b25c 100644
--- a/dockerimg/testdata/testcreatedockerfile_repo_with_readme_and_workflow.dockerfile
+++ b/dockerimg/testdata/testcreatedockerfile_repo_with_readme_and_workflow.dockerfile
@@ -1,4 +1,4 @@
-FROM ghcr.io/boldsoftware/sketch:f5b4ebd9ca15d3dbd2cd08e6e7ab9548
+FROM ghcr.io/boldsoftware/sketch:99a2e4afe316b3c6cf138830dbfb7796
ARG GIT_USER_EMAIL
ARG GIT_USER_NAME
@@ -7,7 +7,7 @@
git config --global user.name "$GIT_USER_NAME" && \
git config --global http.postBuffer 524288000
-LABEL sketch_context="c0828a2b9bfbd0484300d9e371121aaf027862652780c0b007a154ae6bbaf6bc"
+LABEL sketch_context="9e67057e5e7da2576cff8d8923a4824489eb9e8834ab0834d5bfe92f16e40b0d"
COPY . /app
RUN rm -f /app/tmp-sketch-dockerfile
@@ -17,10 +17,11 @@
# Switch to lenient shell so we are more likely to get past failing extra_cmds.
SHELL ["/bin/bash", "-uo", "pipefail", "-c"]
-RUN npm install -g corepack && corepack enable || true
+# Install specific Node.js dependencies
+RUN npm install -g corepack || true
+RUN corepack enable || true
-# If there are any Python dependencies, install them in a way that doesn't fail build
-RUN if [ -f requirements.txt ]; then pip3 install -r requirements.txt || true; fi
+# Any Python setup would go here, but none seems required for this project
# Switch back to strict shell after extra_cmds.
SHELL ["/bin/bash", "-euxo", "pipefail", "-c"]
diff --git a/dockerimg/testdata/testcreatedockerfile_repo_with_readme_and_workflow.httprr b/dockerimg/testdata/testcreatedockerfile_repo_with_readme_and_workflow.httprr
index 522c801..16b4704 100644
--- a/dockerimg/testdata/testcreatedockerfile_repo_with_readme_and_workflow.httprr
+++ b/dockerimg/testdata/testcreatedockerfile_repo_with_readme_and_workflow.httprr
@@ -1,9 +1,9 @@
httprr trace v1
-4511 1810
+4501 1975
POST https://api.anthropic.com/v1/messages HTTP/1.1
Host: api.anthropic.com
User-Agent: Go-http-client/1.1
-Content-Length: 4314
+Content-Length: 4304
Anthropic-Version: 2023-06-01
Content-Type: application/json
@@ -15,7 +15,7 @@
"content": [
{
"type": "text",
- "text": "\nCall the dockerfile tool to create a Dockerfile.\nThe parameters to dockerfile fill out the From and ExtraCmds\ntemplate variables in the following Go template:\n\n```\nFROM golang:1.24-bookworm\n\n# Switch from dash to bash by default.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\n# attempt to keep package installs lean\nRUN printf '%s\\n' \\\n 'path-exclude=/usr/share/man/*' \\\n 'path-exclude=/usr/share/doc/*' \\\n 'path-exclude=/usr/share/doc-base/*' \\\n 'path-exclude=/usr/share/info/*' \\\n 'path-exclude=/usr/share/locale/*' \\\n 'path-exclude=/usr/share/groff/*' \\\n 'path-exclude=/usr/share/lintian/*' \\\n 'path-exclude=/usr/share/zoneinfo/*' \\\n \u003e /etc/dpkg/dpkg.cfg.d/01_nodoc\n\nRUN apt-get update; \\\n\tapt-get install -y --no-install-recommends \\\n\t\tgit jq sqlite3 npm nodejs gh ripgrep fzf python3 curl vim \u0026\u0026 \\\n\tapt-get clean \u0026\u0026 \\\n\trm -rf /var/lib/apt/lists/*\n\n# Strip out docs from debian.\nRUN rm -rf /usr/share/{doc,doc-base,info,lintian,man,groff,locale,zoneinfo}/*\n\nENV PATH=\"$GOPATH/bin:$PATH\"\n\n# While these binaries install generally useful supporting packages,\n# the specific versions are rarely what a user wants so there is no\n# point polluting the base image module with them.\n\nRUN go install golang.org/x/tools/cmd/goimports@latest; \\\n\tgo install golang.org/x/tools/gopls@latest; \\\n\tgo install mvdan.cc/gofumpt@latest; \\\n\tgo clean -cache -testcache -modcache\n\nENV GOTOOLCHAIN=auto\nENV SKETCH=1\n\nRUN mkdir -p /root/.cache/sketch/webui\n\nARG GIT_USER_EMAIL\nARG GIT_USER_NAME\n\nRUN git config --global user.email \"$GIT_USER_EMAIL\" \u0026\u0026 \\\n git config --global user.name \"$GIT_USER_NAME\" \u0026\u0026 \\\n git config --global http.postBuffer 524288000\n\nLABEL sketch_context=\"{{.InitFilesHash}}\"\nCOPY . /app\nRUN rm -f /app/tmp-sketch-dockerfile\n\nWORKDIR /app{{.SubDir}}\nRUN if [ -f go.mod ]; then go mod download; fi\n\n# Switch to lenient shell so we are more likely to get past failing extra_cmds.\nSHELL [\"/bin/bash\", \"-uo\", \"pipefail\", \"-c\"]\n\n{{.ExtraCmds}}\n\n# Switch back to strict shell after extra_cmds.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\nCMD [\"/bin/sketch\"]\n\n```\n\nIn particular:\n- Assume it is primarily a Go project.\n- Python env setup is challenging and often no required, so any RUN commands involving python tooling should be written to let docker build continue if there is a failure.\n- Include any tools particular to this repository that can be inferred from the given context.\n- Append || true to any apt-get install commands in case the package does not exist.\n- MINIMIZE the number of extra_cmds generated. Straightforward environments do not need any.\n- Do NOT expose any ports.\n- Do NOT generate any CMD or ENTRYPOINT extra commands.\nHere is the content of several files from the repository that may be relevant:\n\n"
+ "text": "\nCall the dockerfile tool to create a Dockerfile.\nThe parameters to dockerfile fill out the From and ExtraCmds\ntemplate variables in the following Go template:\n\n```\nFROM golang:1.24-bookworm\n\n# Switch from dash to bash by default.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\n# attempt to keep package installs lean\nRUN printf '%s\\n' \\\n 'path-exclude=/usr/share/man/*' \\\n 'path-exclude=/usr/share/doc/*' \\\n 'path-exclude=/usr/share/doc-base/*' \\\n 'path-exclude=/usr/share/info/*' \\\n 'path-exclude=/usr/share/locale/*' \\\n 'path-exclude=/usr/share/groff/*' \\\n 'path-exclude=/usr/share/lintian/*' \\\n 'path-exclude=/usr/share/zoneinfo/*' \\\n \u003e /etc/dpkg/dpkg.cfg.d/01_nodoc\n\nRUN apt-get update; \\\n\tapt-get install -y --no-install-recommends \\\n\t\tgit jq sqlite3 npm nodejs gh ripgrep fzf python3 curl vim chromium \u0026\u0026 \\\n\tapt-get clean \u0026\u0026 \\\n\trm -rf /var/lib/apt/lists/* \u0026\u0026 \\\n\trm -rf /usr/share/{doc,doc-base,info,lintian,man,groff,locale,zoneinfo}/*\n\nENV PATH=\"$GOPATH/bin:$PATH\"\n\n# While these binaries install generally useful supporting packages,\n# the specific versions are rarely what a user wants so there is no\n# point polluting the base image module with them.\n\nRUN go install golang.org/x/tools/cmd/goimports@latest; \\\n\tgo install golang.org/x/tools/gopls@latest; \\\n\tgo install mvdan.cc/gofumpt@latest; \\\n\tgo clean -cache -testcache -modcache\n\nENV GOTOOLCHAIN=auto\nENV SKETCH=1\n\nRUN mkdir -p /root/.cache/sketch/webui\n\nARG GIT_USER_EMAIL\nARG GIT_USER_NAME\n\nRUN git config --global user.email \"$GIT_USER_EMAIL\" \u0026\u0026 \\\n git config --global user.name \"$GIT_USER_NAME\" \u0026\u0026 \\\n git config --global http.postBuffer 524288000\n\nLABEL sketch_context=\"{{.InitFilesHash}}\"\nCOPY . /app\nRUN rm -f /app/tmp-sketch-dockerfile\n\nWORKDIR /app{{.SubDir}}\nRUN if [ -f go.mod ]; then go mod download; fi\n\n# Switch to lenient shell so we are more likely to get past failing extra_cmds.\nSHELL [\"/bin/bash\", \"-uo\", \"pipefail\", \"-c\"]\n\n{{.ExtraCmds}}\n\n# Switch back to strict shell after extra_cmds.\nSHELL [\"/bin/bash\", \"-euxo\", \"pipefail\", \"-c\"]\n\nCMD [\"/bin/sketch\"]\n\n```\n\nIn particular:\n- Assume it is primarily a Go project.\n- Python env setup is challenging and often no required, so any RUN commands involving python tooling should be written to let docker build continue if there is a failure.\n- Include any tools particular to this repository that can be inferred from the given context.\n- Append || true to any apt-get install commands in case the package does not exist.\n- MINIMIZE the number of extra_cmds generated. Straightforward environments do not need any.\n- Do NOT expose any ports.\n- Do NOT generate any CMD or ENTRYPOINT extra commands.\nHere is the content of several files from the repository that may be relevant:\n\n"
},
{
"type": "text",
@@ -57,25 +57,25 @@
}HTTP/2.0 200 OK
Anthropic-Organization-Id: 3c473a21-7208-450a-a9f8-80aebda45c1b
Anthropic-Ratelimit-Input-Tokens-Limit: 200000
-Anthropic-Ratelimit-Input-Tokens-Remaining: 184000
-Anthropic-Ratelimit-Input-Tokens-Reset: 2025-05-05T19:55:38Z
+Anthropic-Ratelimit-Input-Tokens-Remaining: 200000
+Anthropic-Ratelimit-Input-Tokens-Reset: 2025-05-06T03:31:00Z
Anthropic-Ratelimit-Output-Tokens-Limit: 80000
Anthropic-Ratelimit-Output-Tokens-Remaining: 80000
-Anthropic-Ratelimit-Output-Tokens-Reset: 2025-05-05T19:55:36Z
+Anthropic-Ratelimit-Output-Tokens-Reset: 2025-05-06T03:31:03Z
Anthropic-Ratelimit-Requests-Limit: 4000
Anthropic-Ratelimit-Requests-Remaining: 3999
-Anthropic-Ratelimit-Requests-Reset: 2025-05-05T19:55:32Z
+Anthropic-Ratelimit-Requests-Reset: 2025-05-06T03:30:59Z
Anthropic-Ratelimit-Tokens-Limit: 280000
-Anthropic-Ratelimit-Tokens-Remaining: 264000
-Anthropic-Ratelimit-Tokens-Reset: 2025-05-05T19:55:36Z
+Anthropic-Ratelimit-Tokens-Remaining: 280000
+Anthropic-Ratelimit-Tokens-Reset: 2025-05-06T03:31:00Z
Cf-Cache-Status: DYNAMIC
-Cf-Ray: 93b2cbc8893815f7-SJC
+Cf-Ray: 93b566f14f06ce9c-SJC
Content-Type: application/json
-Date: Mon, 05 May 2025 19:55:36 GMT
-Request-Id: req_011CNpyHBucL8yrPiyPWPRjU
+Date: Tue, 06 May 2025 03:31:03 GMT
+Request-Id: req_011CNqa1ZvovrWPa7AhZtq1L
Server: cloudflare
Strict-Transport-Security: max-age=31536000; includeSubDomains; preload
Via: 1.1 google
X-Robots-Tag: none
-{"id":"msg_01JW8MofecQCTuEEyrvZ2Moh","type":"message","role":"assistant","model":"claude-3-7-sonnet-20250219","content":[{"type":"text","text":"I'll help you create a Dockerfile using the template you provided. Based on the repository files you've shared, I can see this is a Go project that also uses Node.js with corepack."},{"type":"tool_use","id":"toolu_01SbVxNX7BhtLRT6ByGxa63K","name":"dockerfile","input":{"extra_cmds":"RUN npm install -g corepack && corepack enable || true\n\n# If there are any Python dependencies, install them in a way that doesn't fail build\nRUN if [ -f requirements.txt ]; then pip3 install -r requirements.txt || true; fi"}}],"stop_reason":"tool_use","stop_sequence":null,"usage":{"input_tokens":4,"cache_creation_input_tokens":1455,"cache_read_input_tokens":0,"output_tokens":158}}
\ No newline at end of file
+{"id":"msg_01FEiZ2LTjaMRzcnkr8DUoFA","type":"message","role":"assistant","model":"claude-3-7-sonnet-20250219","content":[{"type":"text","text":"Based on the provided information, I'll call the dockerfile tool to create a Dockerfile for this Go project. \n\nFrom the repository files, I can see:\n1. It's primarily a Go project (confirmed by README.md)\n2. It uses Node.js version 18 for testing (from GitHub workflow)\n3. It requires corepack to be installed and enabled\n\nI'll create appropriate extra commands for the Dockerfile:"},{"type":"tool_use","id":"toolu_01HCU6yG6DdaCmgMvP8xEeyS","name":"dockerfile","input":{"extra_cmds":"# Install specific Node.js dependencies\nRUN npm install -g corepack || true\nRUN corepack enable || true\n\n# Any Python setup would go here, but none seems required for this project"}}],"stop_reason":"tool_use","stop_sequence":null,"usage":{"input_tokens":4,"cache_creation_input_tokens":1450,"cache_read_input_tokens":0,"output_tokens":193}}
\ No newline at end of file
diff --git a/go.mod b/go.mod
index 7af9171..f89d1c0 100644
--- a/go.mod
+++ b/go.mod
@@ -3,12 +3,14 @@
go 1.24.2
require (
+ github.com/chromedp/chromedp v0.13.6
github.com/creack/pty v1.1.24
github.com/dustin/go-humanize v1.0.1
github.com/evanw/esbuild v0.25.2
github.com/fatih/color v1.18.0
github.com/gliderlabs/ssh v0.3.8
github.com/google/go-cmp v0.7.0
+ github.com/google/uuid v1.6.0
github.com/kevinburke/ssh_config v1.2.0
github.com/oklog/ulid/v2 v2.1.0
github.com/pkg/sftp v1.13.9
@@ -25,6 +27,12 @@
require (
github.com/anmitsu/go-shlex v0.0.0-20200514113438-38f4b401e2be // indirect
+ github.com/chromedp/cdproto v0.0.0-20250403032234-65de8f5d025b // indirect
+ github.com/chromedp/sysutil v1.1.0 // indirect
+ github.com/go-json-experiment/json v0.0.0-20250211171154-1ae217ad3535 // indirect
+ github.com/gobwas/httphead v0.1.0 // indirect
+ github.com/gobwas/pool v0.2.1 // indirect
+ github.com/gobwas/ws v1.4.0 // indirect
github.com/kr/fs v0.1.0 // indirect
github.com/mattn/go-colorable v0.1.13 // indirect
github.com/mattn/go-isatty v0.0.20 // indirect
diff --git a/go.sum b/go.sum
index 4fafcf3..65d5385 100644
--- a/go.sum
+++ b/go.sum
@@ -1,5 +1,11 @@
github.com/anmitsu/go-shlex v0.0.0-20200514113438-38f4b401e2be h1:9AeTilPcZAjCFIImctFaOjnTIavg87rW78vTPkQqLI8=
github.com/anmitsu/go-shlex v0.0.0-20200514113438-38f4b401e2be/go.mod h1:ySMOLuWl6zY27l47sB3qLNK6tF2fkHG55UZxx8oIVo4=
+github.com/chromedp/cdproto v0.0.0-20250403032234-65de8f5d025b h1:jJmiCljLNTaq/O1ju9Bzz2MPpFlmiTn0F7LwCoeDZVw=
+github.com/chromedp/cdproto v0.0.0-20250403032234-65de8f5d025b/go.mod h1:NItd7aLkcfOA/dcMXvl8p1u+lQqioRMq/SqDp71Pb/k=
+github.com/chromedp/chromedp v0.13.6 h1:xlNunMyzS5bu3r/QKrb3fzX6ow3WBQ6oao+J65PGZxk=
+github.com/chromedp/chromedp v0.13.6/go.mod h1:h8GPP6ZtLMLsU8zFbTcb7ZDGCvCy8j/vRoFmRltQx9A=
+github.com/chromedp/sysutil v1.1.0 h1:PUFNv5EcprjqXZD9nJb9b/c9ibAbxiYo4exNWZyipwM=
+github.com/chromedp/sysutil v1.1.0/go.mod h1:WiThHUdltqCNKGc4gaU50XgYjwjYIhKWoHGPTUfWTJ8=
github.com/creack/pty v1.1.24 h1:bJrF4RRfyJnbTJqzRLHzcGaZK1NeM5kTC9jGgovnR1s=
github.com/creack/pty v1.1.24/go.mod h1:08sCNb52WyoAwi2QDyzUCTgcvVFhUzewun7wtTfvcwE=
github.com/davecgh/go-spew v1.1.0/go.mod h1:J7Y8YcW2NihsgmVo/mv3lAwl/skON4iLHjSsI+c5H38=
@@ -13,11 +19,21 @@
github.com/fatih/color v1.18.0/go.mod h1:4FelSpRwEGDpQ12mAdzqdOukCy4u8WUtOY6lkT/6HfU=
github.com/gliderlabs/ssh v0.3.8 h1:a4YXD1V7xMF9g5nTkdfnja3Sxy1PVDCj1Zg4Wb8vY6c=
github.com/gliderlabs/ssh v0.3.8/go.mod h1:xYoytBv1sV0aL3CavoDuJIQNURXkkfPA/wxQ1pL1fAU=
+github.com/go-json-experiment/json v0.0.0-20250211171154-1ae217ad3535 h1:yE7argOs92u+sSCRgqqe6eF+cDaVhSPlioy1UkA0p/w=
+github.com/go-json-experiment/json v0.0.0-20250211171154-1ae217ad3535/go.mod h1:BWmvoE1Xia34f3l/ibJweyhrT+aROb/FQ6d+37F0e2s=
github.com/go-quicktest/qt v1.101.0 h1:O1K29Txy5P2OK0dGo59b7b0LR6wKfIhttaAhHUyn7eI=
github.com/go-quicktest/qt v1.101.0/go.mod h1:14Bz/f7NwaXPtdYEgzsx46kqSxVwTbzVZsDC26tQJow=
+github.com/gobwas/httphead v0.1.0 h1:exrUm0f4YX0L7EBwZHuCF4GDp8aJfVeBrlLQrs6NqWU=
+github.com/gobwas/httphead v0.1.0/go.mod h1:O/RXo79gxV8G+RqlR/otEwx4Q36zl9rqC5u12GKvMCM=
+github.com/gobwas/pool v0.2.1 h1:xfeeEhW7pwmX8nuLVlqbzVc7udMDrwetjEv+TZIz1og=
+github.com/gobwas/pool v0.2.1/go.mod h1:q8bcK0KcYlCgd9e7WYLm9LpyS+YeLd8JVDW6WezmKEw=
+github.com/gobwas/ws v1.4.0 h1:CTaoG1tojrh4ucGPcoJFiAQUAsEWekEWvLy7GsVNqGs=
+github.com/gobwas/ws v1.4.0/go.mod h1:G3gNqMNtPppf5XUz7O4shetPpcZ1VJ7zt18dlUeakrc=
github.com/google/go-cmp v0.6.0/go.mod h1:17dUlkBOakJ0+DkrSSNjCkIjxS6bF9zb3elmeNGIjoY=
github.com/google/go-cmp v0.7.0 h1:wk8382ETsv4JYUZwIsn6YpYiWiBsYLSJiTsyBybVuN8=
github.com/google/go-cmp v0.7.0/go.mod h1:pXiqmnSA92OHEEa9HXL2W4E7lf9JzCmGVUdgjX3N/iU=
+github.com/google/uuid v1.6.0 h1:NIvaJDMOsjHA8n1jAhLSgzrAzy1Hgr+hNrb57e+94F0=
+github.com/google/uuid v1.6.0/go.mod h1:TIyPZe4MgqvfeYDBFedMoGGpEw/LqOeaOT+nhxU+yHo=
github.com/kevinburke/ssh_config v1.2.0 h1:x584FjTGwHzMwvHx18PXxbBVzfnxogHaAReU4gf13a4=
github.com/kevinburke/ssh_config v1.2.0/go.mod h1:CT57kijsi8u/K/BOFA39wgDQJ9CxiF4nAY/ojJ6r6mM=
github.com/kr/fs v0.1.0 h1:Jskdu9ieNAYnjxsi0LbQp1ulIKZV1LAFgK1tWhpZgl8=
@@ -26,6 +42,8 @@
github.com/kr/pretty v0.3.1/go.mod h1:hoEshYVHaxMs3cyo3Yncou5ZscifuDolrwPKZanG3xk=
github.com/kr/text v0.2.0 h1:5Nx0Ya0ZqY2ygV366QzturHI13Jq95ApcVaJBhpS+AY=
github.com/kr/text v0.2.0/go.mod h1:eLer722TekiGuMkidMxC/pM04lWEeraHUUmBw8l2grE=
+github.com/ledongthuc/pdf v0.0.0-20220302134840-0c2507a12d80 h1:6Yzfa6GP0rIo/kULo2bwGEkFvCePZ3qHDDTC3/J9Swo=
+github.com/ledongthuc/pdf v0.0.0-20220302134840-0c2507a12d80/go.mod h1:imJHygn/1yfhB7XSJJKlFZKl/J+dCPAknuiaGOshXAs=
github.com/mattn/go-colorable v0.1.13 h1:fFA4WZxdEF4tXPZVKMLwD8oUnCTTo08duU7wxecdEvA=
github.com/mattn/go-colorable v0.1.13/go.mod h1:7S9/ev0klgBDR4GtXTXX8a3vIGJpMovkB8vQcUbaXHg=
github.com/mattn/go-isatty v0.0.16/go.mod h1:kYGgaQfpe5nmfYZH+SKPsOc2e4SrIfOl2e/yFXSvRLM=
@@ -33,6 +51,8 @@
github.com/mattn/go-isatty v0.0.20/go.mod h1:W+V8PltTTMOvKvAeJH7IuucS94S2C6jfK/D7dTCTo3Y=
github.com/oklog/ulid/v2 v2.1.0 h1:+9lhoxAP56we25tyYETBBY1YLA2SaoLvUFgrP2miPJU=
github.com/oklog/ulid/v2 v2.1.0/go.mod h1:rcEKHmBBKfef9DhnvX7y1HZBYxjXb0cP5ExxNsTT1QQ=
+github.com/orisano/pixelmatch v0.0.0-20220722002657-fb0b55479cde h1:x0TT0RDC7UhAVbbWWBzr41ElhJx5tXPWkIHA2HWPRuw=
+github.com/orisano/pixelmatch v0.0.0-20220722002657-fb0b55479cde/go.mod h1:nZgzbfBr3hhjoZnS66nKrHmduYNpc34ny7RK4z5/HM0=
github.com/pborman/getopt v0.0.0-20170112200414-7148bc3a4c30/go.mod h1:85jBQOZwpVEaDAr341tbn15RS4fCAsIst0qp7i8ex1o=
github.com/pkg/sftp v1.13.9 h1:4NGkvGudBL7GteO3m6qnaQ4pC0Kvf0onSVc9gR3EWBw=
github.com/pkg/sftp v1.13.9/go.mod h1:OBN7bVXdstkFFN/gdnHPUb5TE8eb8G1Rp9wCItqjkkA=
diff --git a/loop/agent.go b/loop/agent.go
index 6ce408a..9577c34 100644
--- a/loop/agent.go
+++ b/loop/agent.go
@@ -18,6 +18,7 @@
"text/template"
"time"
+ "sketch.dev/claudetool/browse"
"sketch.dev/browser"
"sketch.dev/claudetool"
"sketch.dev/claudetool/bashkit"
@@ -843,11 +844,27 @@
// Register all tools with the conversation
// When adding, removing, or modifying tools here, double-check that the termui tool display
// template in termui/termui.go has pretty-printing support for all tools.
+
+ var browserTools []*llm.Tool
+ // Add browser tools if enabled
+ // if experiment.Enabled("browser") {
+ if true {
+ bTools, browserCleanup := browse.RegisterBrowserTools(a.config.Context)
+ // Add cleanup function to context cancel
+ go func() {
+ <-a.config.Context.Done()
+ browserCleanup()
+ }()
+ browserTools = bTools
+ }
+
convo.Tools = []*llm.Tool{
bashTool, claudetool.Keyword,
claudetool.Think, a.preCommitTool(), makeDoneTool(a.codereview, a.config.GitUsername, a.config.GitEmail),
a.codereview.Tool(), a.multipleChoiceTool(),
}
+
+ convo.Tools = append(convo.Tools, browserTools...)
if a.config.UseAnthropicEdit {
convo.Tools = append(convo.Tools, claudetool.AnthropicEditTool)
} else {
diff --git a/loop/server/loophttp.go b/loop/server/loophttp.go
index 56fbdec..fa253e0 100644
--- a/loop/server/loophttp.go
+++ b/loop/server/loophttp.go
@@ -23,6 +23,7 @@
"sketch.dev/loop/server/gzhandler"
"github.com/creack/pty"
+ "sketch.dev/claudetool/browse"
"sketch.dev/llm/conversation"
"sketch.dev/loop"
"sketch.dev/webui"
@@ -522,6 +523,43 @@
json.NewEncoder(w).Encode(map[string]string{"prompt": suggestedPrompt})
})
+ // Handler for /screenshot/{id} - serves screenshot images
+ s.mux.HandleFunc("/screenshot/", func(w http.ResponseWriter, r *http.Request) {
+ if r.Method != http.MethodGet {
+ http.Error(w, "Method not allowed", http.StatusMethodNotAllowed)
+ return
+ }
+
+ // Extract the screenshot ID from the path
+ pathParts := strings.Split(r.URL.Path, "/")
+ if len(pathParts) < 3 {
+ http.Error(w, "Invalid screenshot ID", http.StatusBadRequest)
+ return
+ }
+
+ screenshotID := pathParts[2]
+
+ // Validate the ID format (prevent directory traversal)
+ if strings.Contains(screenshotID, "/") || strings.Contains(screenshotID, "\\") {
+ http.Error(w, "Invalid screenshot ID format", http.StatusBadRequest)
+ return
+ }
+
+ // Get the screenshot file path
+ filePath := browse.GetScreenshotPath(screenshotID)
+
+ // Check if the file exists
+ if _, err := os.Stat(filePath); os.IsNotExist(err) {
+ http.Error(w, "Screenshot not found", http.StatusNotFound)
+ return
+ }
+
+ // Serve the file
+ w.Header().Set("Content-Type", "image/png")
+ w.Header().Set("Cache-Control", "max-age=3600") // Cache for an hour
+ http.ServeFile(w, r, filePath)
+ })
+
// Handler for POST /chat
s.mux.HandleFunc("/chat", func(w http.ResponseWriter, r *http.Request) {
if r.Method != http.MethodPost {
diff --git a/loop/testdata/agent_loop.httprr b/loop/testdata/agent_loop.httprr
index 2183c46..ba483b9 100644
--- a/loop/testdata/agent_loop.httprr
+++ b/loop/testdata/agent_loop.httprr
@@ -1,9 +1,9 @@
httprr trace v1
-10862 1877
+14168 2249
POST https://api.anthropic.com/v1/messages HTTP/1.1
Host: api.anthropic.com
User-Agent: Go-http-client/1.1
-Content-Length: 10664
+Content-Length: 13970
Anthropic-Version: 2023-06-01
Content-Type: application/json
@@ -226,6 +226,156 @@
}
},
{
+ "name": "browser_navigate",
+ "description": "Navigate the browser to a specific URL and wait for page to load",
+ "input_schema": {
+ "type": "object",
+ "properties": {
+ "url": {
+ "type": "string",
+ "description": "The URL to navigate to"
+ }
+ },
+ "required": [
+ "url"
+ ]
+ }
+ },
+ {
+ "name": "browser_click",
+ "description": "Click the first element matching a CSS selector",
+ "input_schema": {
+ "type": "object",
+ "properties": {
+ "selector": {
+ "type": "string",
+ "description": "CSS selector for the element to click"
+ },
+ "wait_visible": {
+ "type": "boolean",
+ "description": "Wait for the element to be visible before clicking"
+ }
+ },
+ "required": [
+ "selector"
+ ]
+ }
+ },
+ {
+ "name": "browser_type",
+ "description": "Type text into an input or textarea element",
+ "input_schema": {
+ "type": "object",
+ "properties": {
+ "selector": {
+ "type": "string",
+ "description": "CSS selector for the input element"
+ },
+ "text": {
+ "type": "string",
+ "description": "Text to type into the element"
+ },
+ "clear": {
+ "type": "boolean",
+ "description": "Clear the input field before typing"
+ }
+ },
+ "required": [
+ "selector",
+ "text"
+ ]
+ }
+ },
+ {
+ "name": "browser_wait_for",
+ "description": "Wait for an element to be present in the DOM",
+ "input_schema": {
+ "type": "object",
+ "properties": {
+ "selector": {
+ "type": "string",
+ "description": "CSS selector for the element to wait for"
+ },
+ "timeout_ms": {
+ "type": "integer",
+ "description": "Maximum time to wait in milliseconds (default: 30000)"
+ }
+ },
+ "required": [
+ "selector"
+ ]
+ }
+ },
+ {
+ "name": "browser_get_text",
+ "description": "Get the innerText of an element",
+ "input_schema": {
+ "type": "object",
+ "properties": {
+ "selector": {
+ "type": "string",
+ "description": "CSS selector for the element to get text from"
+ }
+ },
+ "required": [
+ "selector"
+ ]
+ }
+ },
+ {
+ "name": "browser_eval",
+ "description": "Evaluate JavaScript in the browser context",
+ "input_schema": {
+ "type": "object",
+ "properties": {
+ "expression": {
+ "type": "string",
+ "description": "JavaScript expression to evaluate"
+ }
+ },
+ "required": [
+ "expression"
+ ]
+ }
+ },
+ {
+ "name": "browser_screenshot",
+ "description": "Take a screenshot of the page or a specific element",
+ "input_schema": {
+ "type": "object",
+ "properties": {
+ "selector": {
+ "type": "string",
+ "description": "CSS selector for the element to screenshot (optional)"
+ },
+ "format": {
+ "type": "string",
+ "description": "Output format ('base64' or 'png'), defaults to 'base64'",
+ "enum": [
+ "base64",
+ "png"
+ ]
+ }
+ }
+ }
+ },
+ {
+ "name": "browser_scroll_into_view",
+ "description": "Scroll an element into view if it's not visible",
+ "input_schema": {
+ "type": "object",
+ "properties": {
+ "selector": {
+ "type": "string",
+ "description": "CSS selector for the element to scroll into view"
+ }
+ },
+ "required": [
+ "selector"
+ ]
+ }
+ },
+ {
"name": "patch",
"description": "File modification tool for precise text edits.\n\nOperations:\n- replace: Substitute text with new content\n- append_eof: Append new text at the end of the file\n- prepend_bof: Insert new text at the beginning of the file\n- overwrite: Replace the entire file with new content (automatically creates the file)\n\nUsage notes:\n- All inputs are interpreted literally (no automatic newline or whitespace handling)\n- For replace operations, oldText must appear EXACTLY ONCE in the file",
"input_schema": {
@@ -286,25 +436,25 @@
}HTTP/2.0 200 OK
Anthropic-Organization-Id: 3c473a21-7208-450a-a9f8-80aebda45c1b
Anthropic-Ratelimit-Input-Tokens-Limit: 200000
-Anthropic-Ratelimit-Input-Tokens-Remaining: 184000
-Anthropic-Ratelimit-Input-Tokens-Reset: 2025-05-05T20:19:43Z
+Anthropic-Ratelimit-Input-Tokens-Remaining: 199000
+Anthropic-Ratelimit-Input-Tokens-Reset: 2025-05-06T02:52:06Z
Anthropic-Ratelimit-Output-Tokens-Limit: 80000
Anthropic-Ratelimit-Output-Tokens-Remaining: 80000
-Anthropic-Ratelimit-Output-Tokens-Reset: 2025-05-05T20:19:41Z
+Anthropic-Ratelimit-Output-Tokens-Reset: 2025-05-06T02:52:10Z
Anthropic-Ratelimit-Requests-Limit: 4000
Anthropic-Ratelimit-Requests-Remaining: 3999
-Anthropic-Ratelimit-Requests-Reset: 2025-05-05T20:19:37Z
+Anthropic-Ratelimit-Requests-Reset: 2025-05-06T02:52:05Z
Anthropic-Ratelimit-Tokens-Limit: 280000
-Anthropic-Ratelimit-Tokens-Remaining: 264000
-Anthropic-Ratelimit-Tokens-Reset: 2025-05-05T20:19:41Z
+Anthropic-Ratelimit-Tokens-Remaining: 279000
+Anthropic-Ratelimit-Tokens-Reset: 2025-05-06T02:52:06Z
Cf-Cache-Status: DYNAMIC
-Cf-Ray: 93b2ef104988d039-SJC
+Cf-Ray: 93b52df649282523-SJC
Content-Type: application/json
-Date: Mon, 05 May 2025 20:19:41 GMT
-Request-Id: req_011CNq17iEhcyfkeYYQUZ5tz
+Date: Tue, 06 May 2025 02:52:10 GMT
+Request-Id: req_011CNqX3XPUGXJBNMCWBpMaN
Server: cloudflare
Strict-Transport-Security: max-age=31536000; includeSubDomains; preload
Via: 1.1 google
X-Robots-Tag: none
-{"id":"msg_01KueCuaHxNHNG92tja2yhpo","type":"message","role":"assistant","model":"claude-3-7-sonnet-20250219","content":[{"type":"text","text":"I have access to the following tools:\n\n1. bash - Execute shell commands\n2. keyword_search - Search for files based on keywords\n3. think - Record thoughts and planning\n4. title - Set conversation title and create git branch\n5. done - Mark task as complete with a checklist\n6. codereview - Run automated code review\n7. multiplechoice - Present multiple choice questions to the user\n8. patch - Make precise edits to files\n\nThese tools allow me to help you with coding, research, file manipulation, and other development tasks, particularly with Go programming language."}],"stop_reason":"end_turn","stop_sequence":null,"usage":{"input_tokens":4,"cache_creation_input_tokens":2602,"cache_read_input_tokens":0,"output_tokens":130}}
\ No newline at end of file
+{"id":"msg_01De9PhPGpXjkZks75fsrXew","type":"message","role":"assistant","model":"claude-3-7-sonnet-20250219","content":[{"type":"text","text":"I have the following tools available to me:\n\n1. `bash` - Execute shell commands\n2. `keyword_search` - Search for files in a codebase\n3. `think` - Record thoughts and plans\n4. `title` - Set conversation title and create git branch\n5. `done` - Mark task as complete with checklist\n6. `codereview` - Run automated code review\n7. `multiplechoice` - Present multiple choice options to user\n8. `browser_navigate` - Navigate to URL\n9. `browser_click` - Click element using CSS selector\n10. `browser_type` - Type text into input fields\n11. `browser_wait_for` - Wait for element to appear\n12. `browser_get_text` - Get text from element\n13. `browser_eval` - Run JavaScript in browser\n14. `browser_screenshot` - Take screenshot\n15. `browser_scroll_into_view` - Scroll to element\n16. `patch` - Make precise text edits to files\n\nThese tools allow me to help with coding tasks, navigate webpages, make file edits, and manage conversation state."}],"stop_reason":"end_turn","stop_sequence":null,"usage":{"input_tokens":4,"cache_creation_input_tokens":3303,"cache_read_input_tokens":0,"output_tokens":259}}
\ No newline at end of file
diff --git a/webui/src/web-components/sketch-tool-calls.ts b/webui/src/web-components/sketch-tool-calls.ts
index e47e4ea..8842aee 100644
--- a/webui/src/web-components/sketch-tool-calls.ts
+++ b/webui/src/web-components/sketch-tool-calls.ts
@@ -3,6 +3,7 @@
import { repeat } from "lit/directives/repeat.js";
import { ToolCall } from "../types";
import "./sketch-tool-card";
+import "./sketch-tool-card-screenshot";
@customElement("sketch-tool-calls")
export class SketchToolCalls extends LitElement {
@@ -110,6 +111,11 @@
.open=${open}
.toolCall=${toolCall}
></sketch-tool-card-title>`;
+ case "browser_screenshot":
+ return html`<sketch-tool-card-screenshot
+ .open=${open}
+ .toolCall=${toolCall}
+ ></sketch-tool-card-screenshot>`;
}
return html`<sketch-tool-card-generic
.open=${open}
@@ -133,15 +139,19 @@
return html`<div class="tool-calls-container">
<div class="tool-call-cards-container">
${repeat(this.toolCalls, this.toolUseKey, (toolCall, idx) => {
- let lastCall = false;
- if (idx == this.toolCalls?.length - 1) {
- lastCall = true;
+ let shouldOpen = false;
+ // Always expand screenshot tool calls, expand last tool call if this.open is true
+ if (
+ toolCall.name === "browser_screenshot" ||
+ (idx == this.toolCalls?.length - 1 && this.open)
+ ) {
+ shouldOpen = true;
}
return html`<div
id="${toolCall.tool_call_id}"
class="tool-call-card ${toolCall.name}"
>
- ${this.cardForToolCall(toolCall, lastCall && this.open)}
+ ${this.cardForToolCall(toolCall, shouldOpen)}
</div>`;
})}
</div>
diff --git a/webui/src/web-components/sketch-tool-card-screenshot.ts b/webui/src/web-components/sketch-tool-card-screenshot.ts
new file mode 100644
index 0000000..4c34d0c
--- /dev/null
+++ b/webui/src/web-components/sketch-tool-card-screenshot.ts
@@ -0,0 +1,150 @@
+import { css, html, LitElement } from "lit";
+import { customElement, property, state } from "lit/decorators.js";
+import { ToolCall } from "../types";
+
+@customElement("sketch-tool-card-screenshot")
+export class SketchToolCardScreenshot extends LitElement {
+ @property()
+ toolCall: ToolCall;
+
+ @property()
+ open: boolean;
+
+ @state()
+ imageLoaded: boolean = false;
+
+ @state()
+ loadError: boolean = false;
+
+ static styles = css`
+ .summary-text {
+ font-style: italic;
+ padding: 0.5em;
+ }
+
+ .screenshot-container {
+ margin: 10px 0;
+ display: flex;
+ flex-direction: column;
+ align-items: center;
+ }
+
+ .screenshot {
+ max-width: 100%;
+ max-height: 500px;
+ border-radius: 4px;
+ box-shadow: 0 2px 6px rgba(0, 0, 0, 0.2);
+ border: 1px solid #ddd;
+ }
+
+ .loading-indicator {
+ margin: 20px;
+ color: #666;
+ font-style: italic;
+ }
+
+ .error-message {
+ color: #d32f2f;
+ font-style: italic;
+ margin: 10px 0;
+ }
+
+ .screenshot-info {
+ margin-top: 8px;
+ font-size: 12px;
+ color: #666;
+ }
+
+ .selector-info {
+ padding: 4px 8px;
+ background-color: #f5f5f5;
+ border-radius: 4px;
+ font-family: monospace;
+ margin: 5px 0;
+ display: inline-block;
+ }
+ `;
+
+ constructor() {
+ super();
+ }
+
+ connectedCallback() {
+ super.connectedCallback();
+ }
+
+ disconnectedCallback() {
+ super.disconnectedCallback();
+ }
+
+ render() {
+ // Parse the input to get selector
+ let selector = "";
+ try {
+ if (this.toolCall?.input) {
+ const input = JSON.parse(this.toolCall.input);
+ selector = input.selector || "(full page)";
+ }
+ } catch (e) {
+ console.error("Error parsing screenshot input:", e);
+ }
+
+ // Get the screenshot ID from the result
+ let screenshotId = "";
+ let hasResult = false;
+ if (this.toolCall?.result_message?.tool_result) {
+ try {
+ const result = JSON.parse(this.toolCall.result_message.tool_result);
+ screenshotId = result.id;
+ hasResult = true;
+ } catch (e) {
+ console.error("Error parsing screenshot result:", e);
+ }
+ }
+
+ // Construct the URL for the screenshot (using relative URL without leading slash)
+ const screenshotUrl = screenshotId ? `screenshot/${screenshotId}` : "";
+
+ return html`
+ <sketch-tool-card .open=${this.open} .toolCall=${this.toolCall}>
+ <span slot="summary" class="summary-text">
+ Screenshot of ${selector}
+ </span>
+ <div slot="input" class="selector-info">
+ ${selector !== "(full page)" ? `Taking screenshot of element: ${selector}` : `Taking full page screenshot`}
+ </div>
+ <div slot="result">
+ ${hasResult
+ ? html`
+ <div class="screenshot-container">
+ ${!this.imageLoaded && !this.loadError
+ ? html`<div class="loading-indicator">Loading screenshot...</div>`
+ : ""}
+ ${this.loadError
+ ? html`<div class="error-message">Failed to load screenshot</div>`
+ : html`
+ <img
+ class="screenshot"
+ src="${screenshotUrl}"
+ @load=${() => (this.imageLoaded = true)}
+ @error=${() => (this.loadError = true)}
+ ?hidden=${!this.imageLoaded}
+ />
+ ${this.imageLoaded
+ ? html`<div class="screenshot-info">Screenshot ID: ${screenshotId}</div>`
+ : ""}
+ `}
+ </div>
+ `
+ : ""}
+ </div>
+ </sketch-tool-card>
+ `;
+ }
+}
+
+declare global {
+ interface HTMLElementTagNameMap {
+ "sketch-tool-card-screenshot": SketchToolCardScreenshot;
+ }
+}