Skip to main content

Introduction

Head Module​

  • GR3 head uses RK3588 main chip, supports Android12
  • Monocular RGB camera, supports hardware frame synchronization function
  • Lapel microphone, supports noise reduction. Can connect to sound source localization microphone
  • Speaker system, plays audio
  • SPI screen, displays eyes, supports eye expression control

Reference Functions​

  • Microphone, speaker, camera协同 work together to support connection to language large models and vision large models
  • Cooperate with the robot motion control system and SPI screen,可以实现 large model dialogue while performing action and expression interaction functions

Environment Deployment​

  1. Download the development tool Android studio, then install it. For installation and configuration, you can search for tutorials online https://developer.android.google.cn/studio?hl=zh-cn
  1. Configure environment variables

Configure the corresponding Java version JDK11, adb command. Search online for configuration tutorials based on your computer system.

  1. Install screen mirroring tool, install scrcpy. Search online for installation tutorials based on your computer system.

Debugging Methods​

  1. The robot head RK3588 IP address is 192.168.137.200. After connecting to the robot's internal network via wired or wifi, you can access it through this IP.
  • Wired connection method: Connect one end of the network cable to the network port on the back of the robot, and the other end to your computer's network port.
  • Wireless connection method: Turn on the computer's wifi and search for the network named with the robot number, e.g., wifi name GR301AA0001_5G
  1. After connecting via wired or wireless, you can access the head's RK3588 system via adb. Prerequisite: configure the adb command first so it can be executed in the terminal or cmd command line. Then execute the following adb connect command in the terminal.
adb connect 192.168.137.200:5555

After successful connection, the command line returns:

connected to 192.168.137.200:5555
  1. Mirror the computer screen to display the Android running screen. Prerequisite: the scrcpy screen mirroring tool is installed. Execute in the terminal:
scrcpy --no-audio

After execution, the mirrored screen is as follows. This interface is the main interface of the demo application provided below.

  1. Open Android studio to start writing code. You can import the demo source code provided below and run it directly to get it working.