【Resource Overview】

4-B Button

】1-click: Wake/Interrupt | Wallpaper/XiaoZhi Switch

   XiaoZhi Standby: Clock Wallpaper

】2-clicks: Wallpaper Switch (Wallpaper Desktop Only)

】3s Long Press: Video playback (SD Card Required)

Quickly Double-Click to switch different videos

【Xiaozhi Usage - General】

Note: This operation is only required for the first time use, and there is no need to repeat it later.

1】Xiaozhi firmware needs to be configured for use

[] After powering on, connect your phone to WIFI: Xiaozhi-xxxx

After the connection is successful, wait for a while and the network configuration page will pop up, automatically searching for hotspots in the current environment

Select your local area network WIFI or mobile hotspot and enter the password (or manually enter the account password above) to complete the network configuration.

(Note: The mobile phone hotspot WIFI frequency band must be 2.4GHz, turn off the mobile phone hotspot for 5G 6G compatibility)

After the network configuration is completed, the screen will obtain the device code.

For devices without a screen: The device code will be announced by voice. Remember the device code announced by voice as it will be used for activation later.

2】Click to enter Xiaozhi backstage

[] Click to enter控制台

3】Register an account

Telephone area codes for some countries :  

+86 Mainland China、+852 Hong Kong China、+853 Macau China、+886 Taiwan China、+1 United States/Canada、+44 United Kingdom、+33 France、+39 Italy、+49 Germany、+48 Poland、+41 Switzerland、+34 Spain、+60 Malaysia、+61 Australia、+62 Indonesia、+63 Philippines、+64 New Zealand、+65 Singapore、+66 Thailand、+81 Japan、+82 South Korea、+84 Vietnam、+91   India、+92 Pakistan、+234 Nigeria、+880 Bangladesh、+966 Saudi Arabia、+971 United Arab Emirates、+55 Brazil、+52 Mexico、+56 Chile、+54 Argentina、+20 Egypt、+27 South Africa、+254 Kenya、+255 Tanzania。。。。

Other countries are being continuously updated. Go to the website -> console -> mobile phone number drop-down box to view the latest list of supported countries.

4】Click Add Device Activation

Enter the device code displayed on the screen (or the voice broadcast device code recorded previously)

Restart the device, wait for the connection, and you can start using it. At this time, you need to press the Boot button to manually wake up and start the conversation. Voice wake-up requires voiceprint recognition[ Speak “Hi ！ E S P” ]

5】wake-up method

】Touch to wake (touch version)

】voice【ni hao！xiao zhi】or【Hi ！ E S P】Or customize the wake word.

】Press the Boot button to wake up.

6】Camera Recognition

】Role Introduction add: You have the right to turn on the camera

】 During the conversation, Speaking [] 【Open the camera, what do you see】 [] 【Turn on the camera and take a photo】 [] 【Open the camera, xxxxx】

7】Custom wake word

8】Cartoon Emote Customization

Redirect Link

9】Selecting characters and AI

Click OK, and then power off and restart to take effect.

10】Unbind device

11】Force unbind the device

1】Download Ai-Thinker Serial Port Tool V2.0.1.exe

2】Insert the AI device and open Ai-Thinker Serial Port Tool V2.0.1.exe

3】Select the corresponding serial port, open it, and then select the operating mode

4】After clicking the operating mode, a string of information will pop up in the receiving area. When you see the line "wifi:mode:sta", remember the MAC address in the parentheses.

5】Use the AI device, configure the network, and enter the conversation mode. Say to it: "What is your device ID?", and it will display the device ID. Remember the device ID (Note: The device ID is a 6-digit number).

6】Access your email and send the email to xiaozhi.ai@tenclass.com

Email subject format: [Unbind Device, Device ID XXX, MAC Address XXX]

【SD video and audio modes】

】SD card video mode usage

To enter SD card video mode: When in standby mode in Xiaozhi mode, press and hold the BOOT button for 3 seconds.

Switching between SD card video modes: Press the BOOT button twice.

To exit SD card video mode: Press the PWR (power on/off) button twice or press and hold the BOOT button for 3 seconds.

】Video file download tool

https://www.4kdownload.com/zh-cn/6

】Video file conversion

】Tool download and installation https://ffmpeg.org/

】Open the ffmpeg directory, for example: E:\XXX\ffmpeg. Hold down Shift + right-click and open the terminal.

】mjpeg command

scale=-1:320==》320 is the pixel height of the screen resolution.

crop=480:in_h:(in_w-480)==》480 is the pixel width of the screen resolution.

】command to convert to MP3

The converted files will be placed in the installation path.

】Place the video files (mjpeg and mp3) in the media folder on your SD card.

【SD card music】

】SD card music usage

The music playing during Xiaozhi's conversation

The state of listening and what it says

Loop playback：“Playing songs from the SD card on a loop”

Single loop：“Playing XXX song on SD card in a loop”

Play once：“Playing XXX song from SD card”

】Put the MP3 files in the music folder on the SD card.

The format is shown in the figure.

Note the format: Song Title - Artist

【Pomodoro Clock】

The state of listening and what it says

Setting a timer: "Set an alarm for XXX" or "Wake me up in XXX minutes."

Pomodoro Technique: "Set a Pomodoro timer for me."z

【Wallpaper - Weather Clock】

】Wallpaper switching: Press the BOOT button twice in standby wallpaper mode.

】Default wallpaper and city information change

】Open serial port tool

】Copy this to the webpage

Note: The computer or mobile phone used to open the webpage must be connected to the same router as the device.

】After opening the webpage, you can change the city information and default wallpaper.

After uploading the wallpaper, simply restart your computer.

【Restore factory firmware】

】Firmware Download

】Download and open the burning software

Burning tool

】How to use

Just burn the factory firmware, as shown in the picture

Burn successfully, power on again

【Xiaozhi Compilation】

Note: Ignore for beginners. Programmers/developers compile tutorial materials

】Compilation environment installation：Download and install ESP-IDF

】Compiled by Xiaozhi

[] Download source code

xiaozhi-esp32-2.0.3

Enter the terminal and open IDF 5.3 or double-click the ESP IDF5.3 Powershell on the desktop

The directory I unzipped is different from yours. Please enter the directory you just unzipped.：

cd F:\project\esp32\ESP32AI\AW1\xiaozhi-esp32-main\xiaozhi-esp32-main

[] Set chip type

Enter the following command again to set the chip to C3

idf.py set-target esp32c3

After Success

[] Change the compiler board type

The default compiled firmware is for breadboard. You need to enter idf.py menuconfig to select the corresponding board model.

Enter 【Xiaozhi Assistant】-》【Spotpear ESP32-S3-3.5-LCD-cam】(press the Enter key on the keyboard to enter the option)

Select the board firmware to be compiled and press the 'S' key on the keyboard to save and then press Esc to exit menuconfig

90° is the rear camera option, and 270° is the front camera option. Turn on the camera.

For a 30MP camera, choose the GC0308; for a 500MP camera, choose the OV5640.Note: Select YUV422 for the camera output format.

[] Change the wake word

(It can be changed or not according to the needs)

(Press Enter to access the options)

Select the board firmware you want to compile, press the 'S' key to save, and then press Esc to exit menuconfig.

[] Start Compiling

Enter idf.py build again to compile

[] Start burning

enter：idf.py build flash monitor

Press the Enter button to burn.

【Hardware documentation】

ESP32S3-3.5inch-AI-1.pdf

ST7796S_Datasheet.pdf

GT911_Datasheet

ESP32S3-3.5inch-AI.DWG

ESP32S3-3.5inch-AI.step

OV5640camera model

GC0308 camera modeli