You have hundreds of notes scattered across apps and files. You know the information is in there somewhere, but you can never find it when you need it. Obsidian — a free, local-first note-taking app — combined with the right AI plugins changes this entirely. Your notes become a searchable knowledge base that AI can read, connect, and reason over. Here's how to set it up, which plugins to install, and the workflow that makes it stick.
- Obsidian: Free for personal use, $50/year for commercial
- Users: 1.5 million (22% growth year-over-year as of February 2026)
- Why it works with AI: Plain markdown files = any AI tool can read them
- Best AI plugin: Smart Connections (free, uses RAG to chat with your vault)
- Advanced integration: Claude Code + MCP can read/write your vault directly
- Time to set up: 30-60 minutes for basic setup, 2-3 hours for full AI integration
- Last verified: April 2026
Why Obsidian for AI (Not Notion, Not Apple Notes)
The critical difference: Obsidian stores everything as plain markdown files on your device. No proprietary format. No cloud lock-in. Just folders of .md files that any AI tool can read directly.
This matters because you can point Claude Code at your vault and it reads every note without exporting, converting, or uploading. You can run local AI models through Ollama and keep everything entirely on your machine — zero data leaves your device. You can switch AI providers anytime without migrating your notes. And you have over 2,700 community plugins to customize your workflow.
Notion offers better team collaboration and structured databases. If your primary need is team workflows, Notion wins. For solo knowledge workers building a personal knowledge base that AI can deeply integrate with, Obsidian is the clear choice.
Step 1: Set Up Your Vault Structure
Create a new Obsidian vault or open your existing one. The structure that works best for AI retrieval uses consistent folders: an Inbox for quick captures, Projects for active work, Areas for ongoing responsibilities, Resources for reference material, and Archive for completed items. This is the PARA method, and it gives AI clear context about what each note is for.
More important than folders: use tags and links consistently. Tag every note with its topic, status, and type. Link related notes using Obsidian's [[double bracket]] syntax. These connections become the knowledge graph that AI uses to find relationships between your ideas.
Step 2: Install Smart Connections (Your First AI Plugin)
Smart Connections is the most popular Obsidian AI plugin and the best starting point. Install it from Obsidian's community plugins. It uses RAG (Retrieval Augmented Generation) to let you chat with your entire vault. Ask it "What have I written about project management?" and it searches across all your notes, finds relevant passages, and synthesizes an answer.
Configure it with your preferred AI model. It supports Claude, GPT, Gemini, and local models through Ollama. For most users, Claude or GPT through API gives the best results. API costs are minimal — a few cents per conversation.
Getting value from this? We publish weekly guides on AI-powered productivity systems. Join readers who get it in their inbox →
Step 3: The Daily Workflow
Each morning, capture everything into your Inbox — meeting notes, articles you read, ideas, tasks. Don't organize as you capture. Speed matters here.
Each evening, spend 10 minutes processing your Inbox. Move notes to the right folder, add tags, and create links to related notes. This processing step is what turns raw captures into connected knowledge.
When you need to retrieve information, chat with your vault through Smart Connections instead of manually searching. "What did I decide about the marketing budget last month?" pulls the relevant notes and synthesizes the answer. This is faster than folder browsing and more reliable than your memory.
Advanced: Claude Code + MCP Integration
For power users, Claude Code can connect directly to your Obsidian vault through MCP (Model Context Protocol). This turns your vault into a live workspace — Claude can read, search, create, and modify notes programmatically.
The setup: install Claude Code, configure the MCP Obsidian plugin, and point it at your vault directory. Now you can ask Claude Code to "summarize everything I've written about [topic] this month," "create a weekly review note from my daily journals," or "find connections between my project notes and my reading notes that I might have missed."
This integration goes beyond search. Claude Code can auto-link related notes, generate summaries of long documents, extract tasks from meeting notes, and maintain an index of your vault's key themes.
Plugins Worth Adding
Beyond Smart Connections: Copilot offers multi-model support and more flexibility in how you interact with AI. Nova edits text in-place without a chat window — select text, apply a transformation, watch it stream changes. Local-only options through Ollama keep everything offline.
For non-AI essentials: Dataview for querying your notes like a database, Calendar for daily notes, Templater for consistent note formats, and Excalidraw for visual thinking.
Common Mistakes
Not processing your Inbox turns Obsidian into another dumping ground. The value comes from the daily processing habit, not the tool itself.
Over-organizing with too many folders and tags creates friction. Start with five folders maximum and ten tags. Expand only when you feel genuine pain from missing categories.
Expecting AI to organize for you skips the thinking step that makes knowledge useful. AI retrieval works best when you've done the work of creating links and tags. It augments your organization — it doesn't replace it.
For help choosing the right AI model for your second brain workflow, try our AI Model Picker Quiz or compare all models at our State of AI Models page.
This is what we do every week. One deep dive on AI tools, workflows, and honest takes — no hype, no filler. Join us →
Disclosure: Some links in this article are affiliate links. We only recommend tools we've personally tested and use regularly. See our full disclosure policy.