Skip to content

omiGlass.mdx

Latest commit

 

History

History
232 lines (185 loc) · 6.18 KB

omiGlass.mdx

File metadata and controls

232 lines (185 loc) · 6.18 KB
Raw
title Hardware & Assembly
icon glasses
description Open source smart glasses with 6x the battery life of Meta Ray-Bans. Build your own AI-powered glasses with the XIAO ESP32 S3 Sense.
omiGlass Front View

Overview

omiGlass is an open-source smart glasses project that gives you AI capabilities with exceptional battery life.

Longer lasting than Meta Ray-Bans Powerful XIAO microcontroller with camera Hardware, firmware, and software Watch the [announcement video](https://x.com/kodjima33/status/1911852469329727811) to see omiGlass in action.

How to Get It

Order a limited pre-built DevKit from Based Hardware Follow the guide below to build from scratch

Prerequisites

Local AI model hosting For firmware upload For hardware components

Hardware Components

Component Description Link
XIAO ESP32 S3 Sense Main microcontroller with camera Amazon
6x 150mAh batteries Main power supply Option 1 or Option 2
1x 250mAh battery Additional power Amazon
Wires For connections Amazon
Hinges For frame assembly Standard glasses hinges
The current design does not include a switch. See the contribution section for how you can help improve this.

Software Setup

```bash git clone https://github.com/BasedHardware/omi.git cd omi/omiGlass npm install ``` 
Or with yarn:
```bash
yarn install
```
Copy the template and add your keys: 
```bash
cp .env.template .env
```

Edit `.env` and add:
- [Groq API key](https://console.groq.com/keys)
- [OpenAI API key](https://platform.openai.com/api-keys)
- Ollama URL (default: `http://localhost:11434/api/chat`)
```bash ollama pull moondream:1.8b-v2-fp16 ``` ```bash npm start ``` 
Or with yarn:
```bash
yarn start
```

<Tip>
This is an Expo project. Open the localhost link displayed after starting to access the web version.
</Tip>

Hardware Assembly

Print the glasses mount case using the STL files in the `hardware` folder. Wire the batteries and XIAO board according to the assembly diagram. 
<Frame>
  <img src="https://github.com/user-attachments/assets/45ef303b-0f92-43eb-bfad-1b20a86e948c" alt="omiGlass Assembly" style={{ maxWidth: '400px', margin: '0 auto' }} />
</Frame>
Mount all components into the 3D printed case and attach hinges.

Firmware Installation

Open the [firmware folder](https://github.com/BasedHardware/omi/tree/main/omiGlass/firmware) and load the `.ino` file in Arduino IDE. 
<Tip>
Alternatively, follow the [firmware readme](https://github.com/BasedHardware/omi/tree/main/omiGlass/firmware/readme.md) to build using `arduino-cli`.
</Tip>
Add the ESP32 board package: 
1. Go to **File → Preferences**
2. Add to "Additional Boards Manager URLs":
   ```
   https://raw.githubusercontent.com/espressif/arduino-esp32/gh-pages/package_esp32_index.json
   ```
3. Go to **Tools → Board → Boards Manager**
4. Search for `esp32` and install the latest version
1. Select port (likely COM3 or higher) at the top of Arduino IDE 2. Search for `xiao` in the board selector 3. Select **XIAO_ESP32S3** Go to **Tools** dropdown and set **PSRAM** to **OPI PSRAM**. 
<Frame>
  <img src="/images/docs/hardware/images/image.png" alt="PSRAM Settings" />
</Frame>
Click the Upload button to flash the firmware to your XIAO ESP32S3 board.

Contributing

Help improve omiGlass!

Software

Task Status
Connect glasses with Omi AI app ✅ Complete

Hardware

Task Status
Redesign legs/sides for bigger heads ⬜ Open
Add switch to design ✅ Complete
Get help with setup, contribute to the project, and connect with other builders

License

This project is licensed under the MIT License.

Related Documentation

Production Omi wearable Necklace form factor DevKit General assembly instructions Get started with the Omi app