Skip to content

YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context

2.3 KB
Raw Blame
---
title: "Cline - VS Code agent with screen memory"
sidebarTitle: "Cline"
description: "Connect Screenpipe to Cline via MCP to give this autonomous VS Code coding agent access to your screen history, meetings, and app context."
icon: "code"
---

[Cline](https://github.com/cline/cline) is an autonomous AI coding agent for VS Code with 30k+ GitHub stars. It supports MCP servers, so you can connect Screenpipe to give Cline context about what you've been working on across all your apps.

## Setup

1. Open VS Code with Cline installed
2. Open Cline settings (gear icon in Cline panel)
3. Go to **MCP Servers**
4. Add Screenpipe:

```json
{
  "mcpServers": {
    "screenpipe": {
      "command": "npx",
      "args": ["-y", "screenpipe-mcp"]
    }
  }
}
```

5. Click the refresh icon to reload MCP servers

## Usage

Once configured, Cline can search your screen history while coding:

```
> I was reading documentation about async/await patterns earlier,
> find it and help me apply those patterns here

> what error messages have I seen in my terminal today?

> find the API response format I was looking at in the browser
```

## Plan mode with context

Cline's "Plan" mode works great with Screenpipe:

1. Switch to Plan mode
2. Ask Cline to find relevant context from your screen history
3. Let it create a plan based on what you've been working on
4. Switch to Act mode to execute

```
> [Plan mode] I was researching authentication patterns earlier,
> find what I was looking at and plan how to implement it here
```

## Available tools

Screenpipe provides:

| Tool | Description |
|------|-------------|
| `search-content` | Search screen text (accessibility-first, OCR fallback), audio transcriptions, and input |
| `activity-summary` | Lightweight overview of app usage, speakers, and recent texts for a time range |
| `search-elements` | Search structured UI elements from the accessibility tree |
| `frame-context` | Full accessibility tree, URLs, and text for a specific frame |
| `list-meetings` | List detected meetings with duration, app, and attendees |
| `export-video` | Export screen recordings as MP4 for a time range |

## Requirements

- Screenpipe running on localhost:3030
- VS Code with Cline extension
- Node.js >= 18.0.0

Need help? [join our Discord](https://discord.gg/screenpipe).