Jarvis

Your AI assistant that never forgets and runs 100% privately on your computer. Leave it on 24/7 - it learns your preferences, helps with code, manages your health goals, searches the web, and connects to any tool via MCP servers (e.g. home automation). No subscriptions, no cloud, just say "Jarvis" and talk naturally.

💖 Support Jarvis

Why Jarvis?

🎬 Movie-like AI experience

Always listening, never interrupting - no buttons, no "new chat"
Responds to "stop" or "shush" but ignores background noise
Hot window mode - stays active after responding for natural follow-ups
Unlimited memory across days, weeks, months
Understands context and chains tools together intelligently
Real-time awareness (knows current time, location, etc.)
Switches personalities automatically (developer/business/life coach)

🔒 Your data never leaves your machine

100% offline AI - no OpenAI, no Google, no cloud
Automatic redaction of sensitive info
Free forever - no accounts, no limits

⚡ Just works

Install once, run forever
No conversation management
Can see your screen when needed
Searches the web while staying private

See It In Action

Personalized news search with memory & multi-step planning

[  voice   ] heard: Jarvis, what are some news from today that might interest me?
✨ Working on it: what are some news from today that might interest me?
[  voice   ] dispatching query: 'what are some news from today that might interest me?'
[ profile  ] selected profile: business
[  memory  ] 🧠 searching with keywords=['news', 'interest', 'technology'], time: 2025-01-15T00:00:00Z to 2025-01-15T23:59:59Z
[  memory  ]   ✅ found 3 results for memory enrichment
🧠 Thinking…
📝 Plan created (2 steps)
  • Step 1: tool — Search for current news in user's areas of interest
  • Step 2: finalResponse — Synthesize relevant stories conversationally
[ planning ] ⚙️  [step 1] executing: tool - Search for current news in user's areas of interest...
🧰 Tool: webSearch…
    🌐 webSearch: searching for 'January 15 2025 AI startups climate tech fintech news'
[ planning ] ⚙️  [step 2] executing: finalResponse - Synthesize relevant stories conversationally...
💬 Preparing your answer…

🤖 Jarvis (business)
Perfect timing! Found several stories that match your interests. OpenAI just announced a major partnership with Google for enterprise AI infrastructure - interesting given your previous questions about AI consolidation. Also, that carbon credit startup we discussed last month, Patch, just closed a $55M Series B. And there's breaking news about the EU's new AI regulation enforcement starting today, which could impact the fintech regulatory landscape you've been tracking. The renewable energy markets you asked about last week are also moving - solar futures hit record highs after Germany's new subsidy announcement. Want me to dive deeper into any of these?

Health-aware advice with nutrition tracking

[  voice   ] heard: Jarvis, should I order pizza tonight considering my health goals?
✨ Working on it: should i order pizza tonight considering my health goals
[  voice   ] dispatching query: 'should i order pizza tonight considering my health goals'
[ profile  ] selected profile: life
[  memory  ] 🧠 searching with keywords=['health', 'goals', 'diet', 'food'], time: 2025-01-10T00:00:00Z to 2025-01-15T23:59:59Z
[  memory  ]   ✅ found 5 results for memory enrichment
🧠 Thinking…
📝 Plan created (2 steps)
  • Step 1: tool — Check today's nutrition so far
  • Step 2: finalResponse — Provide personalized advice based on goals and intake
[ planning ] ⚙️  [step 1] executing: tool - Check today's nutrition so far...
🧰 Tool: fetchMeals…
    ✅ fetchMeals returned 892 chars
[ planning ] ⚙️  [step 2] executing: finalResponse - Provide personalized advice based on goals and intake...
💬 Preparing your answer…

🤖 Jarvis (life)
Looking at your week - you mentioned wanting to lose 10 pounds by March and you've been doing really well! Today you've had overnight oats (320 cal), a salad with grilled chicken (380 cal), and some almonds (160 cal) - about 860 calories so far.

Given your 1,800 calorie target and that you hit the gym yesterday, you've got room for pizza! But maybe consider:
- Split a medium pizza instead of ordering a large
- Add a side salad to get some extra nutrients
- Go for thin crust vs deep dish to save ~200 calories per slice

You've been consistent with your goals this week (I see you logged workouts Monday, Tuesday, and yesterday), so don't stress about one pizza night. Balance is key!

Advanced debugging with screen analysis

[  voice   ] heard: Jarvis, I'm getting this weird GraphQL error, can you help debug it?
✨ Working on it: i'm getting this weird graphql error can you help debug it
[  voice   ] dispatching query: 'i'm getting this weird graphql error can you help debug it'
[ profile  ] selected profile: developer
[  memory  ] 🧠 searching with keywords=['graphql', 'error', 'debug', 'api'], time: 2025-01-10T00:00:00Z to 2025-01-15T23:59:59Z
[  memory  ]   ✅ found 4 results for memory enrichment
🧠 Thinking…
📝 Plan created (3 steps)
  • Step 1: tool — Capture current screen to see the error
  • Step 2: tool — Use VSCode extension to examine code context
  • Step 3: finalResponse — Provide debugging analysis and solutions
[ planning ] ⚙️  [step 1] executing: tool - Capture current screen to see the error...
🧰 Tool: screenshot…
    📸 screenshot: captured screen content
    ✅ screenshot returned 2847 chars
[ planning ] ⚙️  [step 2] executing: tool - Use VSCode extension to examine code context...
🧰 MCP: vscode:findReferences…
    🔍 mcpTool: searching for GraphQL schema references
    ✅ vscode:findReferences returned 1203 chars
[ planning ] ⚙️  [step 3] executing: finalResponse - Provide debugging analysis and solutions...
💬 Preparing your answer…

🤖 Jarvis (developer)
I can see the error on your screen - looks like a "Cannot return null for non-nullable field User.email" error. Based on your previous GraphQL work and what I'm seeing:

**The Issue**: Your User type has `email: String!` (non-nullable) but the resolver is returning null, probably from the database.

**Quick fixes to try**:

1. **Check your resolver** - the getUserById function likely has a user record where email is null/undefined
2. **Database query** - run `SELECT email FROM users WHERE email IS NULL` to confirm
3. **Schema fix** - if emails can be null, change your schema to `email: String` (nullable)

I remember you mentioned last week that you were migrating user data - this could be from incomplete migration where some users don't have emails set yet.

**Immediate fix**: Add a null check in your resolver:
`email: user.email || "[email protected]"`

Want me to help you run a database query to check for null emails, or would you prefer to update the schema first?

Quick Install (5 minutes)

1. Install Ollama

Download from ollama.com/download

2. Get the AI models

ollama pull gpt-oss:20b
ollama pull nomic-embed-text

3. Install Jarvis

Mac:

git clone https://github.com/isair/jarvis.git
cd jarvis
bash scripts/run_macos.sh

Windows (Recommended - with Micromamba):

# First install Micromamba (avoids build issues)
Invoke-Expression ((Invoke-WebRequest -Uri https://micro.mamba.pm/install.ps1).Content)

# Then install Jarvis
git clone https://github.com/isair/jarvis.git
cd jarvis
pwsh -ExecutionPolicy Bypass -File scripts\run_windows.ps1

Windows (Alternative - requires build tools):

# Install Visual C++ Build Tools first from:
# https://visualstudio.microsoft.com/visual-cpp-build-tools/
# (Select "Desktop development with C++" workload)

git clone https://github.com/isair/jarvis.git
cd jarvis
pwsh -ExecutionPolicy Bypass -File scripts\run_windows.ps1

Linux:

git clone https://github.com/isair/jarvis.git
cd jarvis
bash scripts/run_linux.sh

Done! Say "Jarvis" and start talking.

System Requirements

Computer: Mac, Windows, or Linux from the last 5 years
Memory: 16GB RAM minimum
Storage: 20GB free space
GPU: Recommended for speed (works without, just slower)

Features at a Glance

🧠 Unlimited Memory

Never forgets conversations
Intelligent search across all history
No token limits or resets

🎯 Smart Personalities

Developer: Debugging, code reviews, technical help
Business: Professional tasks, meeting planning
Life Coach: Health tracking, personal advice

🛠️ Built-in Tools

Screenshot OCR and analysis
Web search (privacy-friendly)
Local file access (read, write, list, delete)
Nutrition tracking
Location awareness (optional)
MCP tool integration

🎙️ Natural Voice Interface

Wake word activation ("Jarvis")
Interruptible responses ("stop", "shush")
Stays active for follow-ups
Multiple TTS options including voice cloning

Configuration

Most users won't need to change anything. For advanced options, see the config example.

High-Quality AI Voice (Chatterbox TTS)

Enable experimental AI-powered text-to-speech with emotion and voice cloning:

{
  "tts_engine": "chatterbox"
}

Voice Cloning:

Record a 3-10 second clear voice sample (save as .wav)
Add to your config:

{
  "tts_engine": "chatterbox",
  "tts_chatterbox_audio_prompt": "/path/to/voice_sample.wav"
}

Fine-tuning voice:

tts_chatterbox_exaggeration: 0.0-1.0+ (emotion intensity, default 0.5)
tts_chatterbox_cfg_weight: 0.0-1.0 (quality vs speed, default 0.5)

External Tool Integration (MCP)

Connect Jarvis to any tool using MCP (Model Context Protocol) servers:

Example - VSCode integration:

{
  "mcps": {
    "vscode": {
      "command": "npx",
      "args": ["-y", "@niwang/mcp-server-vscode"]
    }
  }
}

Example - Multiple tools:

{
  "mcps": {
    "vscode": {
      "command": "npx",
      "args": ["-y", "@niwang/mcp-server-vscode"]
    },
    "github": {
      "command": "npx",
      "args": ["-y", "@modelcontextprotocol/server-github"],
      "env": {
        "GITHUB_TOKEN": "your-token-here"
      }
    }
  }
}

Find more MCP servers at github.com/topics/mcp-server

Popular MCP Integrations

Transform Jarvis into a comprehensive AI assistant that goes far beyond current solutions like ChatGPT or Gemini. These integrations provide deep access to your actual data and workflows:

🏠 Productivity & Cloud Services

Google Workspace (Gmail, Drive, Calendar, Docs, Sheets)

Most comprehensive Google integration - Full access to Gmail, Drive, Calendar, Docs, Sheets, and more.

{
  "mcps": {
    "google_workspace": {
      "command": "npx",
      "args": ["-y", "google-workspace-mcp"],
      "env": {
        "GOOGLE_CLIENT_ID": "your-client-id",
        "GOOGLE_CLIENT_SECRET": "your-client-secret"
      }
    }
  }
}

Setup: Follow OAuth setup guide at taylorwilsdon/google_workspace_mcp

What you can do: "Jarvis, check my calendar for today", "create a spreadsheet with my expenses", "draft an email to the team", "find that document about the project"

Notion - Knowledge Management

Official Notion integration - Read, create, and update pages and databases.

{
  "mcps": {
    "notion": {
      "command": "npx",
      "args": ["-y", "@makenotion/mcp-server-notion"],
      "env": {
        "NOTION_API_KEY": "your-notion-integration-token"
      }
    }
  }
}

Setup: Create integration at notion.so/my-integrations

What you can do: "Jarvis, add this to my reading list", "create a project plan", "search my knowledge base", "update the meeting notes"

Slack - Team Communication

Complete Slack integration - Send messages, read channels, manage workspaces.

{
  "mcps": {
    "slack": {
      "command": "npx",
      "args": ["-y", "slack-mcp-server"],
      "env": {
        "SLACK_BOT_TOKEN": "xoxb-your-bot-token",
        "SLACK_USER_TOKEN": "xoxp-your-user-token"
      }
    }
  }
}

Setup: Create Slack app at api.slack.com/apps

What you can do: "Jarvis, send a status update to the team", "check recent messages in #general", "schedule a reminder for the standup"

🗄️ Database & Data Management

Universal Database Access (MySQL, PostgreSQL, SQLite, MongoDB)

Multi-database support - Query and analyze data across different database systems.

{
  "mcps": {
    "database": {
      "command": "npx",
      "args": ["-y", "mcp-database-server"],
      "env": {
        "DATABASE_URL": "your-connection-string"
      }
    }
  }
}

Popular options:

bytebase/dbhub - Universal SQL databases
mongodb-js/mongodb-mcp-server - MongoDB & Atlas
neondatabase/mcp-server-neon - Neon PostgreSQL

What you can do: "Jarvis, show me this month's sales data", "find users who signed up last week", "analyze the performance metrics"

🤖 Development & Automation

GitHub Integration

Official GitHub MCP server - Manage repositories, issues, PRs, and workflows.

{
  "mcps": {
    "github": {
      "command": "npx",
      "args": ["-y", "@modelcontextprotocol/server-github"],
      "env": {
        "GITHUB_TOKEN": "your-personal-access-token"
      }
    }
  }
}

What you can do: "Jarvis, create an issue for this bug", "review recent commits", "check CI status", "merge that PR"

Discord Integration

Community management - Read messages, send notifications, manage servers.

{
  "mcps": {
    "discord": {
      "command": "npx",
      "args": ["-y", "discord-mcp-server"],
      "env": {
        "DISCORD_BOT_TOKEN": "your-bot-token"
      }
    }
  }
}

What you can do: "Jarvis, check what's happening in the dev channel", "announce the new release", "moderate recent messages"

🏠 Smart Home & IoT

Home Assistant Integration

Control your lights, switches, sensors, scenes, and other exposed Home Assistant entities directly by voice: "Jarvis, turn on the living room lights". This uses the official Home Assistant MCP Server integration.

Quick steps (≈3 min):

In Home Assistant add the MCP Server integration (Settings → Devices & services → Add integration → search "Model Context Protocol Server").
Expose only the entities you want Jarvis to control: Settings → Voice assistants → Exposed entities.
Create a Long‑lived Access Token: Profile (bottom left avatar) → Security → Create token (copy it).
Install the local proxy that bridges stdio ↔ Home Assistant SSE transport (pick one):
- Using uv (recommended): uv tool install git+https://github.com/sparfenyuk/mcp-proxy
- Or with pip: pip install git+https://github.com/sparfenyuk/mcp-proxy
Add the MCP server to your Jarvis config.json:

{
  "mcps": {
    "home_assistant": {
      "command": "mcp-proxy",
      "args": ["http://localhost:8123/mcp_server/sse"],
      "env": {
        "API_ACCESS_TOKEN": "YOUR_LONG_LIVED_TOKEN"
      }
    }
  }
}

Alternative (env-only) form if you prefer not to pass the URL as an arg:

{
  "mcps": {
    "home_assistant": {
      "command": "mcp-proxy",
      "env": {
        "SSE_URL": "http://localhost:8123/mcp_server/sse",
        "API_ACCESS_TOKEN": "YOUR_LONG_LIVED_TOKEN"
      }
    }
  }
}

Restart Jarvis.
Try: "Jarvis, what's the temperature in the bedroom?" or "Jarvis, turn off all the kitchen lights".

Notes & safety:

Jarvis can only see/control entities you explicitly exposed in Home Assistant. Review that list if access seems too broad or too limited.
If you change exposed entities, just restart Jarvis (or wait for the next tool schema refresh).
token scopes: Long‑lived tokens inherit your user's permissions—treat them like a password. Revoke from Profile → Security if compromised.

Troubleshooting (fast):

404 Not Found (URL with /mcp_server/sse): The MCP Server integration isn't installed/enabled. Add it in step 1.
401 Unauthorized: Token invalid/expired. Create a new token and update config.
Command not found mcp-proxy: Re‑install (step 4) and ensure your Python tool install path is on PATH (restart shell if needed).
Jarvis says no tools available: Confirm the entity is exposed and restart Jarvis.

What you can do: "Jarvis, turn on the living room lights", "set bedroom temperature to 72°", "is the front door locked?", "run the good night scene"

🔧 Advanced Integrations

500+ Apps with Composio (Rube)

Ultimate integration hub - Connect to Gmail, Slack, GitHub, Notion, Trello, Jira, and 500+ other apps.

{
  "mcps": {
    "composio": {
      "command": "npx",
      "args": ["-y", "@composiohq/rube"],
      "env": {
        "COMPOSIO_API_KEY": "your-composio-api-key"
      }
    }
  }
}

Setup: Get API key at composio.dev

What you can do: Access virtually any web service through a single integration

Web Scraping & Data Extraction

Advanced web scraping - Extract data from any website with stealth capabilities and Cloudflare bypass.

{
  "mcps": {
    "web_scraper": {
      "command": "scrapling",
      "args": ["mcp"]
    }
  }
}

Setup: Install with pip install "scrapling[ai]" then scrapling install

What you can do: "Jarvis, get the latest prices from this website", "scrape all product URLs from this category", "extract contact info bypassing Cloudflare protection"

🎯 Why These Integrations Matter

Unlike ChatGPT or Gemini, Jarvis with these integrations can:

Actually send emails instead of just drafting them
Read your real calendar and schedule meetings
Access your private documents and knowledge bases
Control your smart home with voice commands
Query your databases and analyze business data
Manage your GitHub repos and development workflow
Monitor team communications in Slack/Discord
Automate complex workflows across multiple services

Troubleshooting

Jarvis doesn't hear me

Check microphone permissions
Speak clearly after saying "Jarvis"

Responses are slow

Switch to smaller model: ollama pull llama3:8b
Add to config: {"ollama_chat_model": "llama3:8b"}

Windows build errors

Use the Micromamba installation method (recommended)
Or install Visual C++ Build Tools

Privacy & Storage

100% offline - No cloud services required
Auto-redaction - Emails, tokens, passwords automatically removed
Local storage - Everything in ~/.local/share/jarvis
Your control - Delete anytime, export anytime

Quick Harden (Stay 100% Offline)

Want the shortest path to “no unexpected traffic”? Set these and avoid calling network tools:

{
  "web_search_enabled": false,      // disable DuckDuckGo queries
  "mcps": {},                       // no external tool integrations
  "location_auto_detect": false,    // skip route probe / UPnP / DNS
  "location_cgnat_resolve_public_ip": false, // never perform CGNAT DNS query
  "location_ip_address": null,      // or set a static public IP if you still want location
  "location_enabled": false         // (leave true + set location_ip_address for manual location)
}

Keep Ollama local (default http://127.0.0.1:11434) and simply don’t invoke webSearch or fetchWebPage. Leave mcps empty to prevent any third‑party service access. That’s it.

Minimal location while still offline:

{ "location_enabled": true, "location_ip_address": "203.0.113.42", "location_auto_detect": false, "location_cgnat_resolve_public_ip": false }

Check yourself:

# macOS
sudo lsof -i -n -P | grep jarvis || echo "(no sockets)"
# Linux
ss -tupan | grep jarvis || echo "(no sockets)"

In hardened mode you should only see 127.0.0.1 connections to Ollama.

License

Personal use: Free forever
Commercial use: Contact us

Name		Name	Last commit message	Last commit date
Latest commit History 68 Commits
.cursor/rules		.cursor/rules
.githooks		.githooks
.github		.github
examples		examples
scripts		scripts
src		src
tests		tests
.editorconfig		.editorconfig
.gitconfig		.gitconfig
.gitignore		.gitignore
.releaserc.json		.releaserc.json
LICENSE		LICENSE
README.md		README.md
pytest.ini		pytest.ini
requirements.txt		requirements.txt

Uh oh!

License

isair/jarvis

Folders and files

Latest commit

History

Repository files navigation

Jarvis

Why Jarvis?

🎬 Movie-like AI experience

🔒 Your data never leaves your machine

⚡ Just works

See It In Action

Quick Install (5 minutes)

1. Install Ollama

2. Get the AI models

3. Install Jarvis

System Requirements

Features at a Glance

🧠 Unlimited Memory

🎯 Smart Personalities

🛠️ Built-in Tools

🎙️ Natural Voice Interface

Configuration

High-Quality AI Voice (Chatterbox TTS)

External Tool Integration (MCP)

Popular MCP Integrations

🏠 Productivity & Cloud Services

🗄️ Database & Data Management

🤖 Development & Automation

🏠 Smart Home & IoT

🔧 Advanced Integrations

🎯 Why These Integrations Matter

Troubleshooting

Privacy & Storage

Quick Harden (Stay 100% Offline)

License

Support

About

Topics

Resources

License

Uh oh!

Stars

Watchers

Forks

Releases 6

Sponsor this project

Uh oh!

Languages