Edge AI that runs
your IoT
An open-source platform that puts a local LLM in charge of your devices — autonomous control, multi-protocol bridges, and a real automation engine. Fully on-premise, fully offline.



See it think, watch it act
The on-device LLM reasons, picks the right tools, and acts on real hardware — no cloud, no config. Try a request below.
One agent, every device, fully on-prem
A local LLM reasons about your IoT fleet, calls tools, and takes real actions — no cloud round-trip, no data leaving your network.
Agent Control
The agent understands intent, executes commands, creates rules, and reports back. Interact via chat, API, or event triggers.
"Turn off all lights in building B after 8pm"Local LLM at the Edge
Run multimodal models locally via Ollama on Jetson, Pi, or any edge hardware. Zero cloud dependency, full data sovereignty, sub-100ms latency.
7 IoT Protocol Bridges
Modbus, BACnet, OPC-UA, ONVIF, LoRaWAN, Home Assistant — unified under one platform with bidirectional data flow.
Process-Isolated Extensions
Runtime Protocol v3 with process isolation. Native, WASM, and React dashboard components — 25 official extensions, sandboxed with crash protection.
JSON Rules Engine
Declarative automations in pure JSON. Describe them in natural language, the LLM generates the rule.
Persistent Memory
Three-tier memory (short / session / knowledge). Vector search across devices, rules, and history.
Multimodal Vision
Send images in chat — analyze equipment, run YOLO detection, read meters via OCR.
Edge-first, everywhere-capable
NeoMind lives on the edge device — your Jetson, Pi, or NG4500 — running the runtime, vision, I/O, and peer sync right there. It reaches cameras and sensors over LAN, Wi-Fi, Wi-Fi HaLow, or LoRaWAN — covering every range from your desk to across town. No cloud round-trip, no protocol bridges.
Connect everything
Devices, protocols, and clouds — all unified under one autonomous agent at the center.


Extend NeoMind, build apps
Capability extensions add new AI, voice, and protocol skills. Dashboard components render your data the way you want. Both are open, shareable, and install in one click.
Extend NeoMind
Process-isolated, sandboxed extensions. Add AI vision, voice, e-paper, weather — or write your own.
YOLO Video V2
YOLO Video V2 extension for NeoMind.
YOLO Device Inference
YOLO Device Inference extension for NeoMind.
Image Analyzer V2
Image Analyzer V2 extension for NeoMind.
Face Recognition
Face Recognition extension for NeoMind.
OCR Device Inference
OCR Device Inference extension for NeoMind.
Locate Anything V2
Locate Anything V2 extension for NeoMind.
Home Assistant Bridge
Home Assistant Bridge extension for NeoMind.
Modbus Bridge
Modbus Bridge extension for NeoMind.
LoRaWAN Bridge
LoRaWAN Bridge extension for NeoMind.
BACnet Bridge
BACnet Bridge extension for NeoMind.
ONVIF Bridge
ONVIF Bridge extension for NeoMind.
OPC-UA Bridge
OPC-UA Bridge extension for NeoMind.
Uink-RMS Bridge
Uink-RMS Bridge extension for NeoMind.
Voice Assistant
Voice Assistant extension for NeoMind.
SenseVoice ASR
SenseVoice ASR extension for NeoMind.
CosyVoice 3
CosyVoice 3 extension for NeoMind.
Moss TTS Nano
Moss TTS Nano extension for NeoMind.
Voice Edge TTS
Voice Edge TTS extension for NeoMind.
Stream Player
Stream Player extension for NeoMind.
Weather Forecast V2
Weather Forecast V2 extension for NeoMind.
YOLO Video V2
YOLO Video V2 extension for NeoMind.
YOLO Device Inference
YOLO Device Inference extension for NeoMind.
Image Analyzer V2
Image Analyzer V2 extension for NeoMind.
Face Recognition
Face Recognition extension for NeoMind.
OCR Device Inference
OCR Device Inference extension for NeoMind.
Locate Anything V2
Locate Anything V2 extension for NeoMind.
Home Assistant Bridge
Home Assistant Bridge extension for NeoMind.
Modbus Bridge
Modbus Bridge extension for NeoMind.
LoRaWAN Bridge
LoRaWAN Bridge extension for NeoMind.
BACnet Bridge
BACnet Bridge extension for NeoMind.
ONVIF Bridge
ONVIF Bridge extension for NeoMind.
OPC-UA Bridge
OPC-UA Bridge extension for NeoMind.
Uink-RMS Bridge
Uink-RMS Bridge extension for NeoMind.
Voice Assistant
Voice Assistant extension for NeoMind.
SenseVoice ASR
SenseVoice ASR extension for NeoMind.
CosyVoice 3
CosyVoice 3 extension for NeoMind.
Moss TTS Nano
Moss TTS Nano extension for NeoMind.
Voice Edge TTS
Voice Edge TTS extension for NeoMind.
Stream Player
Stream Player extension for NeoMind.
Weather Forecast V2
Weather Forecast V2 extension for NeoMind.
Build apps
Built-in React widgets shipped with NeoMind — drag, drop, bind to devices. Build your own and share with the community.
Value Card
Single value with unit, prefix, suffix and trend
LED Indicator
Status light with value-to-state mapping
Sparkline
Mini trend chart of recent metric history
Progress Bar
Linear / circular progress with thresholds
Line Chart
Time-series line chart, multi-source
Bar Chart
Vertical / horizontal / stacked bars
Pie Chart
Donut or pie for part-to-whole
Toggle Switch
On/off control bound to device commands
Image Display
Image from URL or data source, zoomable
Image History
Historical frames with slider navigation
Map Display
Interactive map with device markers
Video Display
RTSP / HLS / WebRTC / camera streams
Web Display
Sandboxed iframe for web content
Markdown
Render markdown with syntax highlighting
Agent Monitor
AI agent status, stats and execution log
AI Analyst
AI analysis of images / metrics in a chat
Clockcommunity
Real-time clock with timezone and 12/24h
NE101 Panelcommunity
CamTalk sensing camera panel
3D Viewercommunity
Interactive GLB / GLTF model viewer
Weather Cardcommunity
Current conditions + 3-day forecast
Gaugecommunity
Analog dial gauge with custom range
Status Gridcommunity
Multi-device status table with sorting
Value Card
Single value with unit, prefix, suffix and trend
LED Indicator
Status light with value-to-state mapping
Sparkline
Mini trend chart of recent metric history
Progress Bar
Linear / circular progress with thresholds
Line Chart
Time-series line chart, multi-source
Bar Chart
Vertical / horizontal / stacked bars
Pie Chart
Donut or pie for part-to-whole
Toggle Switch
On/off control bound to device commands
Image Display
Image from URL or data source, zoomable
Image History
Historical frames with slider navigation
Map Display
Interactive map with device markers
Video Display
RTSP / HLS / WebRTC / camera streams
Web Display
Sandboxed iframe for web content
Markdown
Render markdown with syntax highlighting
Agent Monitor
AI agent status, stats and execution log
AI Analyst
AI analysis of images / metrics in a chat
Clockcommunity
Real-time clock with timezone and 12/24h
NE101 Panelcommunity
CamTalk sensing camera panel
3D Viewercommunity
Interactive GLB / GLTF model viewer
Weather Cardcommunity
Current conditions + 3-day forecast
Gaugecommunity
Analog dial gauge with custom range
Status Gridcommunity
Multi-device status table with sorting
Three angles, one edge-first runtime
NeoMind runs the same local LLM across three complementary patterns — vision with memory, real-time streams, and sensor/control loops. Pick an angle to see how the pieces fit.
Rich Vision AI
On-device models turn every frame into structured data — bounding boxes, OCR readings, classification counts. Detection, text, and recognition running locally, frame by frame.
- YOLO detection & tracking
- OCR (PaddleOCR-VL)
- Classification & counting
Memory-Enabled LLM
The local LLM is not just a text generator — it remembers history, calls tools, compares against past events, and writes structured status reports and operational rules.
- Long-term memory of past events
- Tool calls (memory · shell · devices)
- Learns & updates decision rules


Built in Rust, extensible by design
A process-isolated extension SDK, an event-driven core, and an AI-assisted authoring workflow. Ship a new capability in minutes.
Install & run
One-line server install, or clone and run from source.
Build an extension
Process-isolated SDK — declare metadata, implement the trait, ship.
# 1. Install Ollama + pull a model
curl -fsSL https://ollama.com/install.sh | sh
ollama pull qwen3.5:4b
# 2. Clone & run the server
git clone https://github.com/camthink-ai/NeoMind.git
cd NeoMind && cargo run -p neomind-cli -- serve
# → API on http://localhost:9375use neomind_extension_sdk::prelude::*;
struct WeatherExtension;
declare_extension!(
WeatherExtension,
metadata: ExtensionMetadata {
name: "weather.sensor".into(),
version: "1.0.0".into(),
..
},
);
impl Extension for WeatherExtension {
fn metrics(&self) -> &[MetricDefinition] {
&[MetricDefinition {
name: "temperature".into(),
data_type: MetricDataType::Float,
..Default::default()
}]
}
}Scaffold an extension with Claude Code
Run the /neomind-extension skill inside Claude Code. The agent reads SDK conventions, writes the Rust crate + manifest, builds it, and installs it — your extension is live in minutes, not days.
- Reads SDK metadata and conventions automatically
- Writes Cargo.toml, src/lib.rs, and extension.json
- Builds, installs, and hot-reloads in-process
Read the docs & build your first extension
Full SDK reference, device-type JSON guide, and dashboard component authoring — on the wiki.
Questions, answered
An open-source, edge-deployed LLM agent platform for IoT. You control devices, create automations, and query system status through natural language — running a local LLM, fully offline.
Yes. With Ollama as the LLM backend, NeoMind runs completely offline — perfect for edge deployments, secure environments, or strict data-privacy requirements. All processing happens locally.
Ollama (recommended for edge), llama.cpp, OpenAI, Anthropic Claude, Google Gemini, xAI Grok, DeepSeek, Qwen, GLM, MiniMax, and any OpenAI-compatible endpoint. Switch providers anytime.
MQTT is built in (embedded broker, no external service). Modbus TCP/RTU, LoRaWAN, BACnet/IP, ONVIF, OPC-UA, and Home Assistant are added via open-source bridge extensions.
The Rules Engine defines automations as pure JSON — declarative trigger, condition, and actions, no DSL parser.
Extensions add capabilities as native libraries (.so/.dylib/.dll) or WASM modules, process-isolated with crash protection.
Yes — Apache-2.0. Source on GitHub.
Run AI at the edge,
on your own terms
Download NeoMind, connect your devices, and let the local LLM handle the rest — fully on-premise, fully offline.




