• sales

    +86-0755-88291180

ESP32-S3-LCD-1.85 User Guide

Overview

Introduction

ESP32-S3-LCD-1.85 is a microcontroller development board that supports 2.4GHz WiFi and BLE 5. It integrates large capacity Flash and PSRAM, has a 1.85inch capacitive touch screen (touch version optional) onboard, can smoothly run GUI interface programs such as LVGL. Combined with various peripheral interfaces, it is suitable for the quick development of the HMI and other ESP32-S3 applications.

Features

  • Equipped with high-performance Xtensa 32-bit LX7 dual-core processor, up to 240 MHz main frequency
  • Supports 2.4GHz Wi-Fi (802.11 b/g/n) and Bluetooth 5 (BLE), with onboard antenna
  • Built in 512KB SRAM and 384KB ROM, 16MB Flash and 8MB PSRAM
  • Onboard 1.85inch LCD display, 360×360 resolution, 262K color
  • Supports I2C interface to control touch, support interrupt (touch version only)
  • Leads out UART, I2C and some IO interfaces
  • Onboard audio decoding chip, MIC, QMI8658 six-axis sensor, RTC clock sensor, TF card slot and battery charging management module, etc.
  • Supports accurate control such as flexible clock and multiple power modes to realize low power consumption in different scenarios

Onboard Resources


1. ESP32-S3R8
   Dual-core processor, up to 240MHz operating frequency

2. 16MB Flash

3. QST attitude sensor
   QMI8658 (six-axis gyro accelerometer)

4. TCA9554PWR
   GPIO expansion chip

5. PCM5101 audio decoding chip

6. Power amplifier chip

7. Battery recharge manager Chip

8. ME6217C33M5G
   Low dropout regulator, 800mA output (Max.)

9. RTC clock chip
   PCF85063 RTC clock

10. Patch ceramic antenna

11. IPEX Gen 1 connector
   Switches to use external antenna via resoldering the resistor

12. TF card slot
   Allowed to connect large capacity TF card

13. Speaker interface
   Equipped with 8Ω 2W 2030 speaker

14. Speaker volume button

15. Microphone

16. UART interface
   Only available when the UART Type-C port is not connected

17. Power indicator

18. USB Type-C interface

19. Connect the rechargeable RTC battery

20. Charge indicator
   When connecting the system battery, lights up when charging, off when fully charged
   (the light status is uncertain when the battery is not connected)

21. I2C interface
   Connecting with internal chip, only supports the I2C peripherals and cannot be mapped to other functions

22. RESET button
   Equipped with 8Ω 2W 2030 speaker

23. BOOT button

24. Battery header
   MX1.25 2PIN connector, for 3.7V Lithium battery, supports charging and discharging

25. Battery power supply control button

Interfaces


  • I2C interface
PinFunctionDescription
GNDGNDGround
3V33V3External output 3.3V
SCLSCL (GPIO10)I2C clock pin, cannot be used as regular GPIO
SDASDA (GPIO11)I2C data pin, cannot be used as regular GPIO
  • UART interface
PinFunctionDescription
GNDGNDGround
3V33V3External output 3.3V
TXDTXD (GPIO43)UART transmit data or as regular GPIO
RXDRXD (GPIO44)UART receive data or as regular GPIO

Dimensions


Specifications

Parameter NameParameter
InterfaceUSB Type-C
Controller chipESP32-S3
LCD typeTFT
LCD controller chipDisplay: ST77916
Onboard devicesAttitude sensor: QMI8658
RTC clock: PCF85063
PCM audio decoding chip: PCM5101
MIC
TF
Battery recharging manager module
Dimensions49.95 (H) x 48.08 (V) (mm)

Internal Hardware Connection

  • LCD
LCD PinESP32S3
LCD_SDA0GPIO46
LCD_SDA1GPIO45
LCD_SDA2GPIO42
LCD_SDA3GPIO41
LCD_SCKGPIO40
LCD_CSGPIO21
LCD_TEGPIO18
LCD_RSTEXIO2
LCD_BLGPIO5
  • TF Card
TF CardESP32S3
SD_D0 / MISOGPIO16
SD_CMD / MOSIGPIO17
SD_SCK / SCLKGPIO14
SD_D3 / CSEXIO3
SD_D1NC
SD_D2NC
  • QMI
QMI8658ESP32S3
IMU_SCLGPIO10
IMU_SDAGPIO11
IMU_INT1EXIO5
IMU_INT2EXIO4
  • RTC
PCF85063ATLESP32S3
RTC_SCLGPIO10
RTC_SDAGPIO11
RTC_INTGPIO9
  • MIC
BuzzerESP32S3
MIC_WSGPIO2
MIC_SCKGPIO15
MIC_SDGPIO39
  • SPEAKER
PCM5101ESP32S3
Speak_DINGPIO47
Speak_LRCKGPIO38
Speak_BCKGPIO48

Version Description

The development board is divided into touch version and non-touch version, please click on the product to view the corresponding instructions.


Usage Instructions

ESP32-S3-LCD-1.85 currently provides two development tools and frameworks, Arduino IDE and ESP-IDF, providing flexible development options, you can choose the right development tool according to your project needs and personal habits.

Development Tools


Arduino IDE

Arduino IDE is an open source electronic prototyping platform, convenient and flexible, easy to get started. After a simple learning, you can start to develop quickly. At the same time, Arduino has a large global user community, providing an abundance of open source code, project examples and tutorials, as well as rich library resources, encapsulating complex functions, allowing developers to quickly implement various functions.


ESP-IDF

ESP-IDF, or full name Espressif IDE, is a professional development framework introduced by Espressif Technology for the ESP series chips. It is developed using the C language, including a compiler, debugger, and flashing tools, etc., and can be developed via the command lines or through an integrated development environment (such as Visual Studio Code with the Espressif IDF plugin). The plugin offers features such as code navigation, project management, and debugging.


Each of these two development approaches has its own advantages, and developers can choose according to their needs and skill levels. Arduino are suitable for beginners and non-professionals because they are easy to learn and quick to get started. ESP-IDF is a better choice for developers with a professional background or high performance requirements, as it provides more advanced development tools and greater control capabilities for the development of complex projects.

Components Preparation

  • ESP32-S3-LCD-1.85 x1
  • TF card with MP3 files x1
  • USB cable (Type-A to Type-C) x 1
  • 2030 speaker 8Ω 2w× 1


Precautions

  • Please note that the computer username must be in English, the username in Chinese will lead to compilation errors
  • If you want to continue using the onboard Bluetooth device when enabling all onboard devices with the example provided, it is recommended to use a different audio library file with a small memory footprint (otherwise it will result in a large SRAM footprint)
  • The development board uses USB to download the demo. If the port cannot be recognized, please enter boot mode (press and hold the boot button, then connect to the computer, and then release the boot button). After downloading the demo, press the RESET button to run the demo.
  • The ESP32 3.0.2 on Arduino is based on ESP-IDF v5.1, which is quite different from the previous version based on ESP-IDF V4.X. After the following operations, the original demo may need to be adjusted for normal operation.
Before operating, it is recommended to browse the table of contents to quickly understand the document structure. For smooth operation, please read the FAQ carefully to understand possible problems in advance. All resources in the document are provided with hyperlinks for easy download.

Working with Arduino

This chapter introduces setting up the Arduino environment, including the Arduino IDE, management of ESP32 boards, installation of related libraries, program compilation and downloading, as well as testing demos. It aims to help users master the development board and facilitate secondary development. 


Environment Setup

Download and install Arduino IDE

  • Click to visit the Arduino official website, select the corresponding system and system bit to download

  • Run the installer and install all by default
The environment setup is carried out on the Windows 10 system, Linux and Mac users can access Arduino-esp32 environment setup for reference. (To use on Mac, you need to install the MAC driver.)

Install ESP32 development board

  • Before using ESP32-related motherboards with the Arduino IDE, you must first install the software package for the esp32 by Espressif Systems development board
  • According to Board installation requirement, it is generally recommended to use Install Online. If online installation fails, use Install Offline.
  • For the installation tutorial, please refer to Arduino board manager tutorial
  • ESP32-S3-LCD-1.85 required development board installation description
Board nameBoard installation requirementVersion number requirement
esp32 by Espressif Systems"Install Offline" / "Install Online"≥3.0.2

Install library

  • When installing Arduino libraries, there are usually two ways to choose from: Install online and Install offline. If the library installation requires offline installation, you must use the provided library file
    For most libraries, users can easily search and install them through the online library manager of the Arduino software. However, some open-source libraries or custom libraries are not synchronized to the Arduino Library Manager, so they cannot be acquired through online searches. In this case, users can only manually install these libraries offline.
  • For library installation tutorial, please refer to Arduino library manager tutorial
  • ESP32-S3-LCD-1.85 library file is stored in the sample program, click here to jump: ESP32-S3-LCD-1.85 Demo
  • ESP32-S3-LCD-1.85 library file installation description
Library NameDescriptionVersionLibrary Installation Requirement
LVGLGraphical libraryv8.3.10"Install Offline"
ESP32-audioI2S-masterAudio decoding libraryv2.0.0"Install Offline"
For more learning and use of LVGL, please refer to LVGL official documentation

Run the First Arduino Demo


If you are just getting started with ESP32 and Arduino, and you don't know how to create, compile, flash, and run Arduino ESP32 programs, then please expand and take a look. Hope it can help you!

New Project

  • Run the Arduino IDE and select File -> New Sketch

  • Enter the code:
void setup() {
  // put your setup code here, to run once:
  Serial.begin(115200);
}

void loop() {
  // put your main code here, to run repeatedly:
  Serial.println("Hello, World!");
  delay(2000);
}
  • Save the project and select File -> Save As.... In the pop-up menu, select the path to save the project, and enter a project name, such as Hello_World, click Save

Compile and Flash Demos

  • Select the corresponding development board, take the ESP32S3 motherboard as an example:

①. Click to select the dropdown menu option Select Other Board and Port;
②. Search for the required development board model esp32s3 dev module and select;
③. Select COM Port;
④. Save the selection.

  • If the ESP32S3 mainboard only has a USB port, you need to enable USB CDC, as shown in the following diagram:


  • Compile and upload the program:

①. Compile the program; ②. Compile and download the program; ③. Download successful.

  • Open the Serial Monitor window, and the demo will print "Hello World!" every 2 seconds, and the operation is as follows:


Demo


  • ESP32-S3-LCD-1.85 demo
DemoBasic DescriptionDependency Library
LVGL_ArduinoTest onboard device functionalityLVGL, ESP32-audioI2S-master

Arduino project parameter setting



LVGL_Arduino

Demo description


  • This example demonstrates the functions of each device on the board, page 1 displays SD Card, Flash Size, Battery Voltage and other parameters, and page 2 shows the music playback interface; In addition, speech recognition is added to this demo.

Hardware connection


  • Insert the TF card into the development board
  • Connect the speaker to the development board
  • Connect the development board to the computer


Code analysis


  • setup(): Initialize hardware, configure peripherals, etc.
    • Hardware initialization: setup() internally executes multiple initialization functions to configure and initialize hardware components connected to Arduino, such as RTC, gyroscope, LCD display, TF card, audio module, microphone, etc. With these initializations, it is ensured that the hardware is working properly
    • Initialize the LVGL graphics library (Lvgl_Init()) and Simulated touch function (Simulated_Touch_Init())
    • Finally, call Lvgl_Example1() and Driver_Loop() to further set the initial state of the system and create tasks
  • loop(): Mainly used for GUI updates and task scheduling
    • LVGL task loop: Lvgl_Loop() is a loop function of the LVGL library that handles graphical interface updates, event responses, and other UI-related operations. In embedded systems, graphics libraries often need to be called frequently in the main loop to keep the interface refreshed and the interaction real-time
    • Task scheduling control: vTaskDelay(pdMS_TO_TICKS(5)) is used to pause the task for 5 milliseconds. vTaskDelay is a delay function in FreeRTOS that aims to reduce CPU usage, avoid taking up too much time slice, and ensure that other tasks of the system, such as peripheral processing, can be performed on time
  • Simulated_Touch_Init(): Responsible for initializing the settings related to simulated touch and preparing for simulated touch operations
    • pinMode(BOOT_KEY_PIN, INPUT): Sets the BOOT_KEY_PIN pin to input mode so that the button input on that pin can be detected
    • Initializes a style style_checked, set properties such as background color, opacity, border color, width, padding, rounded corners, shadow color, width, spread, horizontal and vertical offset, which may be used to highlight the currently selected object
    • xTaskCreatePinnedToCore(TouchTask, "TouchTask", 4096, NULL, 4, NULL, 1): Creates a task named "TouchTask" and pin it to a specific core for execution. This task may be used to continuously button input and simulate touch operations
  • TouchTask(void *parameter): Continuously detects the input status of the two buttons (represented by PWR_KEY_Input_PIN and BOOT_KEY_PIN), and sets the corresponding flags according to the button status to trigger different actions
    • In an infinite loop, first use the digitalRead function to detect the input state of PWR_KEY_Input_PIN. If the pin is pressed down (i.e., read low), set the PWR_Flag flag to 1. If the Boot_Flag has been set at this time, it means that both keys may be pressed at the same time, and the OK_Flag flag is set to 1. If the pin is not pressed and the OK_Flag is false, it means the button has been released and no special operation was triggered. In this case, increase the value of the Switch_count variable
    • Next, check the input status of BOOT_KEY_PIN. If the pin is pressed down, set the PWR_Flag flag to 1. If the PWR_Flag has been set at this time, it means that both buttons may be pressed at the same time, and the OK_Flag flag is set to 1. If the pin is not pressed and the OK_Flag is false, it means the button has been released and no special operation was triggered. In this case, increase the value of the Next_count variable
    • Finally use vTaskDelay(pdMS_TO_TICKS(10)) for a short delay to avoid excessive CPU usage

Result demonstration


  • LCD screen display parameter description
ParameterFunctionDescription
SD CardDisplay TF card sizeConnect the TF card, if the recognition fails, please format the TF card to FAT32 format (please wait for a while to reset and check again if the recognition fails for the first time)
Flash SizeDisplay Flash sizeCurrent onboard 16MB Flash
Battery VoltageBattery voltageThe battery voltage can be detected when the battery is connected
Angular deflectionDisplay the angular deflection of the boardDisplay the offset in three directions
RTC TimeDisplay RTC timeDisplay current RTC time
If the RTC time is not consistent with the current time, because the data cannot be retained in the power-off state, if you need to keep the RTC time normal, you need to connect the RTC battery and update the RTC time
Wireless scanDisplay the number of scanned WiFiWhen it finishes, display Scan Finish at the end
Backlight brightnessBrightness sliderAdjust screen brightness
  • Page 2 is the UI page for playing mp3 audio in the root directory of the TF card
  • This demo can be configured to simulate touch functionality by selecting components using the BOOT button and the PWR button. Pressing both buttons simultaneously indicates a confirm press
  • This program enables speech recognition by default, the wake-up word is "hi esp", after waking up, you can speak the command after the backlight is dimmed (if the backlight is not dimmed, it means that it has not been woken up, the recognition requirements are strict, the pronunciation needs to be standard, and the speech speed is slowed down)
  • The following are available in several formats of MIC test audio (Please note that every time the hi esp wake-up fails, please reset the audio to the playback location of the wake-up word and replay it)
  • Please do not perform speech recognition when using the speaker to play audio
  • The reason the wake-up word plays twice in the test audio is due to the current firmware version's initial wake-up requiring the device to be focused (an analogy), and the current firmware does not permit the disabling of this function
// Commands
Turn on the backlight
Turn off the backlight
Backlight is brightest
Backlight is darkest

Switch to Chinese/English recognition model

The initial environment setting is for English recognition, and you can switch to Chinese recognition model or back to English recognition model by following these steps


Switch to Chinese recognition model


Chinese recognition environment setup

  • Download the provided demo file Demo using Chinese model
  • Enter the path C:\Users\Waveshare\AppData\Local\Arduino15\packages\esp32\hardware\esp32\3.0.2\libraries\ESP_SR\src (Waveshare is the computer username)
  • Replace the esp32-hal-sr.c in this path with the downloaded file
  • Download the Chinese model Chinese model - wake-up word hi 乐鑫
  • Enter the path C:\Users\Waveshare\AppData\Local\Arduino15\packages\esp32\tools\esp32-arduino-libs\idf-release_v5.1-bd2b9390ef\esp32s3\esp_sr (Waveshare is the computer username)
  • Replace the srmodels.bin in this path with the downloaded file
  • Modify the recognition command in the demo to Chinese command (Pinyin)



Switch to English recognition model


   English recognition environment setup

  • The initial state of the environment is the English recognition environment by default, and if it is not converted to Chinese, the following modifications are not made
  • If it has been previously modified to Chinese recognition, download the provided demo file Demo using English model
  • Enter the path C:\Users\Waveshare\AppData\Local\Arduino15\packages\esp32\hardware\esp32\3.0.2\libraries\ESP_SR\src (Waveshare is the computer username)
  • Replace the esp32-hal-sr.c in this path with the downloaded file
  • Download the English model English model - wake-up word hi esp
  • Enter the path C:\Users\Waveshare\AppData\Local\Arduino15\packages\esp32\tools\esp32-arduino-libs\idf-release_v5.1-bd2b9390ef\esp32s3\esp_sr (Waveshare is the computer username)
  • Replace the srmodels.bin in this path with the downloaded file
  • Modify the recognition command in the demo to English command (phonemes)


Working with ESP-IDF

This chapter introduces setting up the ESP-IDF environment setup, including the installation of Visual Studio and the Espressif IDF plugin, program compilation, downloading, and testing of example programs, to assist users in mastering the development board and facilitating secondary development. 


Environment Setup

Download and install Visual Studio

  • Open the download page of VScode official website, choose the corresponding system and system bit to download

  • After running the installation package, the rest can be installed by default, but here for the subsequent experience, it is recommended to check boxes 1, 2, and 3

    • After the first two items are enabled, you can open VSCode directly by right-clicking files or directories, which can improve the subsequent user experience.
    • After the third item is enabled, you can select VSCode directly when you choose how to open it.
The environment setup is carried out on the Windows 10 system, Linux and Mac users can access ESP-IDF environment setup for reference

Install Espressif IDF Plugin

  • It is generally recommended to use Install Online. If online installation fails due to network factor, use Install OIffline
  • For more information about how to install the Espressif IDF plugin, see Install Espressif IDF Plugin
  • ESP32-S3-LCD-1.85 required Espressif IDF version description
Plugin namePlugin installation requirementVersion number requirement
Espressif IDF"Install Offline" / "Install Online"≥5.3.1

Run the First ESP-IDF Demo


If you are just getting started with ESP32 and ESP-IDF, and you don't know how to create, compile, flash, and run ESP-IDF ESP32 programs, then please expand and take a look. Hope it can help you!

New Project



ESP32-S3-AMOLED-1.91-study-02.png

Create Demo

  • Using the shortcut F1, enter esp-idf:show examples projects


  • Select your current IDF version

ESP32-S3-AMOLED-1.91-study-04.png

  • Take the Hello world demo as an example

①Select the corresponding demo
②Its readme will state what chip the demo applies to (how to use the demo and the file structure are described below, omitted here)
③Click to create the demo

  • Select the path to save the demo, and require that the demos cannot use folders with the same name


Modify COM Port

  • The corresponding COM ports are shown here, click to modify them
  • Please select the COM ports according to your device (You can view it from the device manager)
  • In case of a download failure, please press the Reset button for more than 1 second or enter download mode, and wait for the PC to recognize the device again before downloading once more


Modify Driver Object

  • Select the object we need to drive, which is our main chip ESP32S3


  • Choose the openocd path, it doesn't affect us here, so let's just choose one


Other Status Bar Functions

①.ESP-IDF Development Environment Version Manager, when our project requires differentiation of development environment versions, it can be managed by installing different versions of ESP-IDF. When the project uses a specific version, it can be switched to by utilizing it
②.Device flashing COM port, select to flash the compiled program into the chip
③.Select set-target chip model, select the corresponding chip model, for example, ESP32-P4-NANO needs to choose esp32p4 as the target chip
④.menuconfig, click it to Modify sdkconfig configuration file Project configuration details
⑤.fullclean button, when the project compilation error or other operations pollute the compiled content, you can clean up all the compiled content by clicking it
⑥.Build project, when a project satisfies the build, click this button to compile
⑦.Current download mode, the default is UART
⑧.flash button, when a project build is completed, select the COM port of the corresponding development board, and click this button to flash the compiled firmware to the chip
⑨.monitor enable flashing port monitoring, when a project passes through Build --> Flash, click this button to view the log of output from flashing port and debugging port, so as to observe whether the application works normally
⑩.Debug
⑪.Build Flash Monitor one-click button, which is used to continuously execute Build --> Flash --> Monitor, often referred to as "little flame"


Compile, Flash and Serial Port Monitor

  • Click on the all-in-one button we described before to compile, flash and open the serial port monitor


  • It may take a long time to compile especially for the first time


  • During this process, the ESP-IDF may take up a lot of CPU resources, so it may cause the system to lag
  • If it is the first time to flash the program for a new project, you will need to select the download method, and select UART


  • This can also be changed later in the Download methods section (click on it to pop up the options)


  • As it comes with the onboard automatic download circuit, it can be downloaded automatically without manual operation
  • After successful download, it will automatically enter the serial monitor, you can see the chip output the corresponding information and be prompted to restart after 10S


Use the IDF Demos

The following takes ESP32-S3-LCD-1.47-Demo as an example to introduce the two opening methods of the project and the general steps of use, and the detailed explanation of the ESP-IDF project. If you use other projects, the operation steps can be applied similarly.

Open In the Software

  • Open VScode software and select the folder to open the demo


  • Select the provided ESP-IDF example and click to select the file (located in the /Demo/ESP-IDF path under demo)


Open from Outside the Software

  • Select the project directory correctly and open the project, otherwise it will affect the compilation and flashing of subsequent programs


  • After connecting the device, select the COM port and model, click below to compile and flash to achieve program control


ESP-IDF Project Details

  • Component: The components in ESP-IDF are the basic modules for building applications, each component is usually a relatively independent code base or library, which can implement specific functions or services, and can be reused by applications or other components, similar to the definition of libraries in Python development.
    • Component reference: The import of libraries in the Python development environment only requires to "import library name or path", while ESP-IDF is based on the C language, and the importing of libraries is configured and defined through CMakeLists.txt.
    • The purpose of CmakeLists.txt: When compiling ESP-IDF, the build tool CMake first reads the content of the top-level CMakeLists.txt in the project directory to read the build rules and identify the content to be compiled. When the required components and demos are imported into the CMakeLists.txt, the compilation tool CMake will import each content that needs to be compiled according to the index. The compilation process is as follows:


Demo


  • ESP32-S3-LCD-1.85 demo
DemoBasic Description
ESP32-S3-LCD-1.85-TestTest onboard device functionality

ESP32-S3-LCD-1.85-Test

Demo description


  • This example demonstrates the functions of each device on the board, page 1 displays SD Card, Flash Size, Battery Voltage and other parameters, and page 2 shows the music playback interface; In addition, speech recognition is added to this demo.

Hardware connection


  • Insert the TF card into the development board
  • Connect the speaker to the development board
  • Connect the development board to the computer


Code analysis


  • MIC_Speech_init()
    • This function is mainly used to initialize the speech recognition module. First set the initial state, then initialize the I2S interface to receive microphone audio data. Then configure the AFE (Audio Frontend Processing) module parameters and create an AFE data instance. Finally, create two tasks, one responsible for audio data reading and processing (feed_handler), another for speech command detection and recognition (detect_hander)
  • detect_hander()
    • This function runs in a standalone task and processes the AFE module output to detect speech commands. It determines a multi-network model based on the configuration and prints the active speech commands. In the loop, the results are continuously obtained from the AFE module, which are processed according to different wake-up states and multi-network detection states, such as performing corresponding actions when wake-up words are detected, setting command states and adjusting LCD backlights when speech commands are detected. At the end of the task, the multi-network model instance is destroyed to release resources

Result demonstration


  • LCD screen display parameter description
ParameterFunctionDescription
SD CardDisplay TF card sizeConnect the TF card, if the recognition fails, please format the TF card to FAT32 format (please wait for a while to reset and check again if the recognition fails for the first time)
Flash SizeDisplay Flash sizeCurrent onboard 16MB Flash
Battery VoltageBattery voltageThe battery voltage can be detected when the battery is connected
Angular deflectionDisplay the angular deflection of the boardDisplay the offset in three directions
RTC TimeDisplay RTC timeDisplay current RTC time
If the RTC time is not consistent with the current time, because the data cannot be retained in the power-off state, if you need to keep the RTC time normal, you need to connect the RTC battery and update the RTC time
Wireless scanDisplay the number of scanned WiFiWhen it finishes, display Scan Finish at the end
Backlight brightnessBrightness sliderAdjust screen brightness
  • Page 2 is the UI page for playing mp3 audio in the root directory of the TF card
  • This demo can be configured to simulate touch functionality by selecting components using the BOOT button and the PWR button. Pressing both buttons simultaneously indicates a confirm press
  • This program enables speech recognition by default, the wake-up word is "hi esp", after waking up, you can speak the command after the backlight is dimmed (if the backlight is not dimmed, it means that it has not been woken up, the recognition requirements are strict, the pronunciation needs to be standard, and the speech speed is slowed down)
  • The following are available in several formats of MIC test audio (Please note that every time the hi esp wake-up fails, please reset the audio to the playback location of the wake-up word and replay it)
  • Please do not perform speech recognition when using the speaker to play audio
  • The reason the wake-up word plays twice in the test audio is due to the current firmware version's initial wake-up requiring the device to be focused (an analogy), and the current firmware does not permit the disabling of this function
// Commands
Turn on the backlight
Turn off the backlight
Backlight is brightest
Backlight is darkest

Switch to Chinese/English recognition model

The initial environment setting is for English recognition, and you can switch to Chinese recognition model or back to English recognition model by following these steps


Switch to Chinese/English recognition model


  • Delete two files in the project


  • Enter the file sdkconfig.defaults, find here.

Comment  to switch to the English recognition model
Comment  to switch to the Chinese recognition model

Generate Speech Control Command


Environment preparation

  • Check if your computer has a Python environment
  • Open the command line: win+r -> enter cmd

①.Enter python --version and the python version number appears, which means that it is installed
②.Type where python to see where python is installed

The Python environment under the C drive is the Python environment that is automatically installed when VS Code is installed;
The disk E contains the Python environment used in the following steps;

If you do not have installed environment, please refer to Python Environment Installation Tutorial, please continue if it is installed
  • On the command line, enter pip install g2p_en to install the g2p_en package
  • Install the resource package in the corresponding user's C:\Users\username\AppData\Roaming directory, and double-click to extract the file
  • On the command line, enter pip install pypinyin to install the pypinyin library

Generate Chinese Pinyin

  • Download the Chinese command generation file
  • Command line switch path to Chinese command generation folder (the path varies from person to person, the following is only for reference)
cd /d E:\download\Generate_Chinese_command
  • Execute the command line multinet_pinyin.py to generate Chinese pinyin
python multinet_pinyin.py "Chinese to be converted to Pinyin"
Example: Python multinet_pinyin.py "你好微雪电子"


Generate English phonemes

  • Download the English command generation file
  • Command line switch path to English command generation folder (the path varies from person to person, the following is only for reference)
cd /d E:\download\Generate_English_command
  • Execute the command line gen_sr_commands.py to generate English phonemes
python gen_sr_commands.py "English to be converted to phonemes"
Example: python gen_sr_commands.py "hello waveshare"


Command modification

In Arduino


In ESP-IDF

  • Chinese commands


  • English commands


Flash Firmware Flashing and Erasing


  • The current demo provides test firmware, which can be used to test whether the onboard device functions properly by directly flashing the test firmware
  • bin file path:
    ...\ESP32-S3-LCD-1.85-Demo\Firmware

Resources

Schematic diagram

Project diagram

Demo

Datasheets

ESP32-S3

Other components

Software tools

Arduino

VScode

Firmware flashing tool

FAQ

Question: After the module downloads the demo and re-downloads it, why sometimes it can't connect to the serial port or the flashing fails?

 Answer:
  • Click the Reset button for more than 1 second, wait for the PC to re-recognize the device and then download again
  • Long press the BOOT button, press RESET at the same time, then release RESET, then release the BOOT button, at this time the module can enter the download mode, which can solve most of the problems that can not be downloaded.
  • Press and hold the BOOT button to reconnect the USB cable, and then release the BOOT button after the USB cable is connected, at this time the module can enter the download mode, which can solve most of the problems that can not be downloaded.


Question: Why does the module keep resetting and flicker when viewed the recognition status from the device manager?

 Answer:

It may be due to Flash blank and the USB port is not stable, you can long-press the BOOT button, press RESET at the same time, and then release RESET, and then release the BOOT button, at this time the module can enter the download mode to flash the firmware (demo) to solve the situation.


Question: How to deal with the first compilation of the program being extremely slow?

 Answer:
  • It's normal for the first compilation to be slow, just be patient


Question: What should I do if I can't find the AppData folder?

 Answer:
  • Some AppData folders are hidden by default and can be set to show.
  • English system: Explorer->View->Check "Hidden items"
  • Chinese system: File Explorer -> View -> Display -> Check "Hidden Items”


Question: How do I check the COM port I use?

 Answer:
  • Windows system:

①View through Device Manager: Press the Windows + R keys to open the "Run" dialog box; input devmgmt.msc and press Enter to open the Device Manager; expand the "Ports (COM and LPT)" section, where all COM ports and their current statuses will be listed.
②Use the command prompt to view: Open the Command Prompt (CMD), enter the "mode" command, which will display status information for all COM ports.
③Check hardware connections: If you have already connected external devices to the COM port, the device usually occupies a port number, which can be determined by checking the connected hardware.

  • Linux system:

①Use the dmesg command to view: Open the terminal.
①Use the ls command to view: Enter ls /dev/ttyS* or ls /dev/ttyUSB* to list all serial port devices.
③Use the setserial command to view: Enter setserial -g /dev/ttyS* to view the configuration information of all serial port devices.


 Answer:
  • This situation is that the TF card is not installed or the TF card cannot be recognized. If this situation occurs, please wait for a period of time to reset the device. If it still cannot be resolved, please format the TF card to FAT32 format. If it still fails, please try a different TF card


Question: Why does the program flashing fail when using a MAC device?

 Answer:


Question: What is the screen refresh rate? (Frame rate)

 Answer:

Depending on the demo you run, different demos have different refresh frame rates.


Question: Can this be extended to connect a camera?

 Answer:

No


Question: When I run a program (Serial.println()) that uses a serial port, the Serial Monitor in my Arduino IDE does not show any data?

 Answer:

Whether you use the USB to UART tool to connect the UART pins, or enable USB CDC in Tools


Question: Can Wi-Fi and Bluetooth be used simultaneously?

 Answer:

Yes, it can be used simultaneously, but due to the larger memory usage of audio, the audio function cannot be turned on at the same time


Question: Which battery can be used?

 Answer:

3.7V lithium rechargeable battery with PH1.25 2P connector.


Question: What capacity lithium battery is recommended?

 Answer:

Use the one that corresponds to our interface and output voltage, the capacity depending on customer needs


Question: What addresses does the I2C onboard device occupy?

 Answer:

0x15, 0x20, 0x51


Question: Why is there no output after successfully burning the code with no issues?

 Answer:
  • Check the schematic diagram for different development boards with Type-C interfaces, and handle the output accordingly:
    • For development boards with direct USB output, printf function is supported for printing output. If you want to support output via the Serial function, you will need to enable the USB CDC On Boot feature or declare HWCDC.
    • For development boards with UART to USB conversion, both printf and Serial functions are supported for printing output, and there is no need to enable USB CDC On Boot.

Support

Monday-Friday (9:30-6:30) Saturday (9:30-5:30)

Email: services01@spotpear.com


TAG: Raspberry Pi Prism ESP32 Mini TV SpotPear UGV Beast PT AI 4G 5G OpenCV Robot Car MediaPipe For Raspberry Pi4B/5 Raspberry Pi 5 Camera 0.85inch Display Industrial USB TO 8CH TTL Converter USB to UART Multi Protection Circuits Multi Systems Raspberry Pi Pico 2 RP2350 1.28 inch Round LCD Development Board 240x240 Display Screen QMI8658 6-Axis Raspberry Pi 13.3 inch FHD Monitor LCD 1080P Capacitive TouchScreen Display Type-C/HDMI For Computer PC Step Recording and Reproduction Multi Protection Milk V Duo Computer USB Monitor Screen 2.8inch Capacitive TouchScreen LCD Display ST7789 CST328 240x320 For Arduino/Raspberry Pi/ESP32/Pico Raspberry Pi CM5 IO BASE A Mini Board a Base Development Platform Compute Module 5 IO Board Raspberry Pi Pico 2 RP2350-One Mini Board Type-A RP2350A Pi5 Heatsink Raspberry Pi screen Development Board PC Monitor Screen

[Tutorial Navigation]