yunzerwebsite/ESP32-xiaozhi-esp32
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
245 Commits 1 Branch 0 Tags 8 MiB
C++ 73.4%
C 16.7%
Python 8.3%
CMake 1.4%
HTML 0.2%
6b2752a498
Go to file
ooxxU 6b2752a498
外接唤醒模组的支持，可以有多种自定义唤醒词，进行唤醒小智，ESP32(非C3，非S3) 面包板上已支持 (#172) 
* 外接唤醒模组的支持，可以有多种自定义唤醒词，进行唤醒小智
ESP32(非C3，非S3) 面包板上已支持

* Update application.cc

外接唤醒模组的支持，好处是可以有多种自定义唤醒词，进行唤醒小智
唤醒模组需要一个GPIO Pin，设置成输出模式+高电平
对该Pin进行唤醒设置，1秒内的低电平脉冲，也就是小智的一个Click
可以参考 ESP32 面包板中的 asr_button_ 按钮的功能函数调用
本人测试采用ASR-ProV1.0版本的唤醒模组，测试内容包括：自定义唤醒词，唤醒词打断，唤醒词回应
此代码兼容其他型号的唤醒模组，并没做限制模组型号，方便大家使用
Modify By MarsBear

* Update esp32_bread_board.cc

---------

Co-authored-by: Xiaoxia <terrence@tenclass.com>
2025-02-17 18:47:21 +08:00
docs 支持 ESP32 系列开发板 (#116) 2025-02-01 11:03:49 +08:00
main 外接唤醒模组的支持，可以有多种自定义唤醒词，进行唤醒小智，ESP32(非C3，非S3) 面包板上已支持 (#172) 2025-02-17 18:47:21 +08:00
scripts edit version upload 2025-02-01 23:09:40 +08:00
.gitignore add versions.py for ota upgrade 2024-10-17 18:34:51 +08:00
CMakeLists.txt Enhance device activation and OTA update process 2025-02-16 06:59:19 +08:00
LICENSE Initial commit 2024-08-31 18:08:16 +08:00
partitions_4M.csv reconstruct application 2024-10-03 06:39:22 +08:00
partitions_8M.csv add more fonts for version 1.0.0 2025-01-23 13:50:22 +08:00
partitions.csv add more fonts for version 1.0.0 2025-01-23 13:50:22 +08:00
README_en.md 支持 ESP32 系列开发板 (#116) 2025-02-01 11:03:49 +08:00
README_ja.md fix:Modify the README and add Moji images (#106) 2025-01-24 12:17:49 +08:00
README.md Update README.md 2025-02-17 01:11:11 +08:00
sdkconfig.defaults fix xmini-c3 toggle state 2025-02-14 05:20:59 +08:00
sdkconfig.defaults.esp32c3 fit the memory usage for esp32c3 2024-11-29 11:06:05 +08:00
sdkconfig.defaults.esp32s3 upgrade to LVGL 9 2025-02-03 23:43:07 +08:00

README_en.md

XiaoZhi AI Chatbot

（中文 | English | 日本語）

This is Terrence's first hardware project.

👉 Build your AI chat companion with ESP32+SenseVoice+Qwen72B! [bilibili]

👉 DIY Your AI Companion - Beginner's Tutorial [bilibili]

Project Purpose

This project is developed based on Espressif's ESP-IDF.

This is an open-source project primarily for educational purposes. Through this project, we aim to help more people get started with AI hardware development and understand how to integrate rapidly evolving large language models into actual hardware devices. Whether you're a student interested in AI or a developer looking to explore new technologies, this project offers valuable learning experiences.

Everyone is welcome to participate in the project's development and improvement. If you have any ideas or suggestions, please feel free to raise an Issue or join our chat group.

Learning & Discussion QQ Group: 946599635

Implemented Features

  • Wi-Fi / ML307 Cat.1 4G
  • BOOT button wake-up and interrupt, supporting both click and long-press triggers
  • Offline voice wake-up ESP-SR
  • Streaming voice dialogue (WebSocket or UDP protocol)
  • Support for 5 languages: Mandarin, Cantonese, English, Japanese, Korean SenseVoice
  • Voice print recognition to identify who's calling AI's name 3D Speaker
  • Large model TTS (Volcengine or CosyVoice)
  • Large Language Model (Qwen2.5 72B or Doubao API)
  • Configurable prompts and voice tones (custom characters)
  • Short-term memory with self-summary after each conversation round
  • OLED / LCD display showing signal strength or conversation content
  • Support for displaying emoji images on LCD

Hardware Section

Breadboard Practice

For detailed tutorial, see the Feishu document:

👉 XiaoZhi AI Chatbot Encyclopedia

Breadboard setup shown below:

Breadboard Setup

Supported Open-Source Hardware

Firmware Section

Flashing Without Development Environment

For beginners, it's recommended to first try flashing the firmware without setting up a development environment. The firmware uses a test server provided by the author, currently available for free use (not for commercial purposes).

👉 Flash Firmware Guide (No IDF Environment Required)

Development Environment

  • Cursor or VSCode
  • Install ESP-IDF plugin, select SDK version 5.3 or above
  • Linux is preferred over Windows for faster compilation and fewer driver issues

AI Character Configuration

If you already have a XiaoZhi AI chatbot, please refer to 👉 Backend Operation Video Tutorial

For detailed usage instructions and test server notes, please refer to 👉 XiaoZhi Test Server Help Guide.

Star History

Star History Chart