JX Jarvis logoJX Jarvis
Production-ready AI workspace
JX Jarvis logo

JX Jarvis

Autonomous AI Desktop Operating System

An advanced voice-controlled AI workspace capable of desktop automation, browser control, coding assistance, and intelligent workflows.

Created by Jojin John.

Download GitHub Documentation Features
JX Jarvis premium dashboard screenshot
Capabilities

Built for real work, not a mock dashboard.

Jarvis combines voice activation, AI planning, desktop tools, browser automation, local memory, and permission controls into one desktop operating assistant.

01

Wake Word Activation

Hands-free "Hey Jarvis" and manual voice modes for fast commands.

02

Browser Automation

Visible Playwright browser control with typing, clicking, scrolling, and DOM awareness.

03

AI Coding Agent

Creates, analyzes, and runs local code projects inside allowed workspaces.

04

Voice Assistant

English and Malayalam voice flows with configurable speech providers.

05

Multi-AI Providers

Groq, OpenAI, Claude, Gemini, OpenRouter, Ollama, and local models.

06

Memory System

Local persistent brain storage for conversations, projects, workflows, and preferences.

07

Workflow Automation

Record actions, replay workflows, and run multi-step routines.

08

AI Task Planning

Understand, plan, execute, retry, verify, and explain progress in real time.

09

Desktop Control

Launch apps, run safe commands, search files, and manage system tasks.

10

Vision AI

Capture screenshots, analyze UI state, and use visual context for debugging.

Product tour

Workspace screens.

Documentation assets are local and deployment-safe. Replace them with live app screenshots any time without changing the layout.

Browser automation visual workspace
AI provider settings interface

Onboarding, permissions, voice, memory, browser, and provider configuration are designed as product surfaces, not hidden scripts.

Every major user control has a matching backend API and persistent local state.

Workflow

How Jarvis completes tasks.

Every automation request moves through a predictable pipeline so users can see what Jarvis is doing and interrupt when needed.

V
Voice InputWake or manual command
U
UnderstandingIntent and context
P
Task PlanningSteps and risk level
T
Tool ExecutionDesktop and browser tools
C
VerificationSuccess checks and retries
R
Result DeliveryVoice, UI, and logs
Stack

Technology foundation.

Frontend

  • React
  • Vite
  • Tailwind-style CSS
  • Framer Motion-ready architecture

Backend

  • Python
  • Flask API runtime
  • Modular tools
  • SQLite memory

Desktop

  • Electron
  • Tray mode
  • Global shortcuts
  • Native folder picker

Automation and AI

  • Playwright
  • Groq
  • OpenAI and Claude
  • Ollama and local models
Install

Run JX Jarvis locally.

Use the commands below for development. Production packaging is handled by Electron Builder.

git clone https://github.com/jojin1709/Jarvis-assistant.git
cd Jarvis-assistant
npm install
npm --prefix frontend install
cd backend
python -m venv .venv
.\.venv\Scripts\python.exe -m pip install -r requirements.txt
cd ..
copy .env.example .env
npm run install:desktop
npm run dev

Prerequisites

Windows 10/11, Node.js 20+, Python 3.11+, microphone access, and Chrome/Edge for visual browser automation.

Environment

Add provider keys in `.env` or through Settings -> AI Providers. Never commit secrets.

Desktop shortcut

`npm run install:desktop` adds Start JX JARVIS to the current user's Desktop for one-click launching.

Browser

Install Playwright browsers with `python -m playwright install chromium` if Chromium is missing.

Local AI

Run Ollama locally and pull a model such as `llama3.1` for offline mode.

Showcase

Deep feature areas.

Wake word and voice

Configure voice activation, speech recognition, and response output.

Browser automation

See how the visual browser operator navigates real pages.

Memory and brain storage

Understand local persistent memory and backup controls.

AI providers

Route chat, coding, vision, voice, and automation models.

Permissions

Protect folders, require confirmations, and use safe mode.

Workflow automation

Record, replay, plan, pause, cancel, and verify routines.

Plugin system

Add local automation packs and future skills.

Developer guide

Explore architecture, APIs, and extension points.
Roadmap

From assistant to operating agent.

Completed

  • Premium UI shell
  • Wake loop
  • Browser operator
  • Permissions
  • Memory storage
  • Multi-provider settings

In progress

  • Improved wake word engine
  • Streaming provider responses
  • More workflow replay actions
  • Native overlay window

Future

  • Marketplace plugins
  • Vector search memory
  • Team profiles
  • Signed installer

Contribute

Open issues with reproduction steps, keep changes scoped, protect secrets, and test backend and frontend before pull requests.

Creator

Built by Jojin John.

JX Jarvis is created and maintained as a premium autonomous desktop AI assistant project by Jojin John.

Connect with the creator

Follow development updates, product improvements, and AI automation work on LinkedIn.

Jojin John on LinkedIn