AI-Sister

Windows + Linux X11 · no macOS 14+ installer yet

What were you doing yesterday?
Ask her.

AI-Sister quietly watches you work and keeps the details on your screen on this computer. When you need a phone number, an amount, a URL, or the spot where you got stuck yesterday, she answers in seconds, and every sentence opens to its evidence.

v0.1.0-alpha.171 · Windows 10+ · Ubuntu 24.04 X11 · macOS 14+: no public installer yet · Apache-2.0 · Interface in Traditional Chinese, voices in Mandarin

AI-Sister Listening
Full-body art of ChatGPT
ChatGPT

Where did I leave the checkout page yesterday?

She remembers

You got webhook retries working. The last screen shows the tests passing; next up is the refund case.

Yesterday 16:08 · VS Code Yesterday 16:21 · Terminal
Ask something else…

0screenshots sent to the cloud

<100mslocal recall target

17offline characters

544bundled everyday voice lines

Not another chat window

She doesn't make you ask twice.
She remembers for you.

No model rewrites the raw evidence. Her understanding can be corrected and a memory can be closed out; the screen you open is the final word.

01

Evidence first, understanding second

OCR text, phone numbers, amounts, URLs, and times stay in SQLite; answers link to the local screen they came from.

02
Claude CodeCodexGeminiGrok

The brain is a CLI you already have

AI-Sister isn't tied to one model vendor. Every typed question goes first to the CLI you picked last; it decides how to search, and AI-Sister runs the search locally.

03

Silence is a feature

She speaks up only with evidence, when the interruption is worth it, and within budget. The rest of the time she stays in the corner of your desktop.

Look, then look again

Local recording has to be on. She writes what she saw, waits, and looks again.

  1. Wait, then look

    Looks are at least 400 ms apart. With no key or mouse input, she still looks again within 5 seconds.

  2. Read the words

    Windows uses system OCR, Ubuntu uses Tesseract, and macOS uses Vision.

  3. Save the row

    Words go into SQLite, and a changed picture stays only when frame storage is signed.

  • at least 400 ms apart
  • another look within 5 seconds
  • pictures need a signature
This loop never calls a model. Local rules pick phones, amounts, and URLs out of the words on screen.

The search stays here

CLI reading has to be signed first. The CLI you chose plans the search and writes the sentences, and the search itself runs in SQLite on this computer.

  1. You ask

    The question that goes out is capped at 2 KiB.

  2. Plan queries

    The CLI returns 1 to 3 queries in everyday words.

  3. Search here

    SQLite runs them here. At most 18 sources go back, and that packet stays within 24 KiB.

  4. Write sentences

    With nothing here to cite, no sentences are asked for. One bad sentence drops the whole reply of 1 to 6 sentences.

  • 1 to 3 queries
  • 18 sources at most
  • one bad sentence drops them all
A kept sentence cites a fact, chunk, or card from this search. The CLI never gets the database path, the SQL, or a picture.

Last CLI you finished

Four CLIs can be connected. Each question goes to the one you finished setting up last.

  1. Type a question

    It reads the saved CLI again, and nothing in the program chooses a vendor.

  2. Use that CLI

    The highlight is the CLI you finished, and Claude Code is only the example.

  • four CLIs can connect
  • only the last one set up runs
  • the others stay idle
There is no default vendor. The highlight shows a finished setup, not a preference.

Before she speaks

A line she starts on her own has to pass the gatekeeper. The bar shows the points left today.

  1. Needs evidence

    Without an evidence reference, the line stays unsaid.

  2. Clears the floor

    A score under the default 0.25 stays quiet.

  3. Points remain

    A card costs 2, one line costs 1, and a glimmer costs 0.

  4. Then she speaks

    Recording is live, and it is not during the default quiet hours, 22:00 to 08:00.

  • needs evidence
  • floor is 0.25
  • 5 points a day
For 14 days after the first recording, most categories stay quiet. The same category then waits 120 minutes.

Four sisters + 13 friends

Same memory,
pick who shows up.

17 transparent full-body workplace rigs, 17 fallback images, and 32 everyday voice lines per character all install with the app. Switching characters changes neither the facts in an answer nor the evidence.

8 base + 24 expansion × 17 characters

Tap one to preview

ChatGPT · art and fixed voice lines stay on this machine

Boundaries you can see

Memory stays on this computer.
Each door opens on its own and closes anytime.

1

Eyes

Screens, OCR text, times, and window context stay on this machine.

Local data
2

Memory

SQLite stays local; the CLI can only ask for natural-language searches.

Searched locally
3

Brain

Only after you explicitly agree do your question and the matching original text go to the CLI you chose.

Your own CLI
4

Voice

Character voices work offline; Azure read-aloud for new answers has its own separate switch.

No fallback either way

Two doors for text

The screen and the database stay on this computer. Each door needs its own signature.

  1. Screen stays

    Screenshots and the OCR text are written here, and no pixel is uploaded.

  2. Rows stay

    A search never sends the SQLite file.

  3. Check signatures

    CLI reading and Azure read-aloud are separate, and unreadable means unsigned.

  4. CLI text

    Once CLI reading is signed, the question and the hit text may go to that CLI.

  5. Azure voice

    It has to be signed and switched on, and only the new answer body is sent.

  • pixels stay on this computer
  • each door has its own signature
  • unreadable means unsigned
  • Stays here
  • Signature
  • Goes out
Pictures use neither door.

Claude Code + Codex

Ask from your coding agent,
and the sources come back too.

Both entry points call sister query --json on your computer and bring the matching text, time, app, window title, and frame number back into the current conversation.

Anthropic

Claude Code Skill

After installing, type /ai-sister-memory, then say which memory you're looking for.

~/.claude/skills/ai-sister-memory/ Claude Code skill
OpenAI

Codex Skill

After installing, type $ai-sister-memory, then say which memory you're looking for.

~/.agents/skills/ai-sister-memory/ Codex skill

The skill runs only when you explicitly ask it to search your AI-Sister memory. It won't sign consents, start recording, delete anything, or operate your computer. The text and source fields a query returns enter the current agent conversation; screenshot bytes don't.

Ask from the agent

Claude Code and Codex run the same command on this computer. What comes back is text, not a screenshot.

  1. Name the skill

    Claude Code is /ai-sister-memory. Codex is $ai-sister-memory.

  2. Run it here

    It runs sister query on this computer and asks for 10 rows first. It asks again only if the missing rows could change the answer.

  3. Text comes back

    What comes back is the time, app, window title, and a frame or chunk id.

  • first call asks for 10
  • text and ids come back
  • no screenshot bytes
It only searches. It cannot sign consent, start recording, delete memory, or use the computer. With the query log on, the question is also kept on this computer.

Three steps

Install, consent, then ask her.

  1. 01
    Download the installer

    Setup for Windows, the .deb for Ubuntu 24.04 X11. macOS has no public installer yet. The app itself is in Traditional Chinese.

  2. 02
    Choose your consents

    Turn on local recording first; decide on frame storage and CLI reading separately.

  3. 03
    Start asking

    Ask what you were doing yesterday. Every fact comes with its source.

Windows 10+

Available

Setup includes the desktop app, the CLI, and the WebView2 offline installer.

Ubuntu 24.04 X11

Available

The .deb installs the desktop app, the CLI, AT-SPI, and local Tesseract.

macOS 14+

No public installer yet

The native build joins a release only after it passes Developer ID notarization and on-device permission and memory acceptance tests.

Current version0.1.0-alpha.171