Arc AI agent 1.0

Overview

AI agent 1.0 minimized the closed loop for creating virtual characters and their interactions through voice and expressions. Four preset virtual characters and a voice library, along with a visual representation of conversation history functions are provided.

• Create avatars
  Users can customize and create their own avatars. To help achieve this, our project provides four preset characters with different personalities and speaking styles.
  • In-car assistant: An assistant focused on providing information and solving problems.
  • Emotional companion: An emotionally supportive presence that engages users in comforting conversations.
  • Guide: A character that provides insights and suggestions about places of interest during the trip.
  • Language teacher: An educational character that helps users learn and practice new languages.
• UI expression mapping
  We introduced a set of UI expressions corresponding to the content of the conversation, enhancing visual interaction and providing users with a more expressive interface.
• Voice switching
  A voice library is provided, and users can choose different voice tones for the avatar to enhance the personality and charm of the avatar.
• Visual interface for conversation history
  A user-friendly interface displays conversation records, allowing users to easily review their interactions.
• Local music playback
  Users can play local music files to add entertainment to the overall experience.

Installation

Clone Project

• Open the terminal or command line tool.
• Run the following command to clone the repository.
  https://github.com/pixmoving-auto/AI-Agent.git
• Navigate to the cloned project folder and open it in Android Studio.

Import Project

• Open Android Studio.
• Select File > New > Import Project.
• Navigate to the directory containing the project, select the project folder, and click OK.
• Wait for Android Studio to configure and sync the project.

Software Environment Requirements

• Android Studio version: 2022.3.1
• Gradle version: 7.4
• API level: 33
• JBR (JetBrains Runtime): 17

User Mannual

Initial Setup

• Ensure Internet Connection: Confirm that your device is connected to the internet.
• Access RoboEV App: On your smartphone's home screen, find and open the RoboEV app.

Interface Overview

• Upon opening the app, you’ll see the robot’s buttons and status indicators (see Figure 1-1). Clicking on any blank area hides the buttons; click again to make them reappear.
  

Starting and Stopping the Robot

• Start the Robot: Click [Start Robot]. If the network is stable, the button changes to [Stop Robot] and a "Connected" prompt appears, indicating readiness for voice interaction.
• Stop the Robot: Tap [Stop Robot] to disconnect. A prompt "Connection disconnected, please retry" appears, and the robot will not respond to voice commands.
  

Expression Display Settings

• Disable Expressions: Click [Disable Expressions] for a text-only interface (see Figure 1-4). Robot responses appear as text, with resp for the answer and emo indicating emotion. Click [Show Expressions] to revert to the original mode.
• Exit App: Click [Close Software] to exit.
  

Changing Robot Roles and Voice

• Switch Roles: Tap [Role] to select a character profile (see Figure 1-5).
• Change Voice: Click [Voice] to browse and select a preferred voice tone (see Figure 1-6).
  
  

Role Editing

• Click [Role Edit] to access character customization options (see Figure 1-7). Users can edit character introductions, names, traits, and hobbies. For additional customization, please contact PIX technical support.
  

Music Playback

• Tap [Music] to access controls: Play, Pause, and Stop.
• Browse and select from the playlist, then press Play to begin music.
  

Language Settings

• Select Language: Tap [Language Settings] to choose from Chinese, Japanese, or English (see Figure 1-9 to Figure 1-11).
  
  
  

Robot Status Indicators

• Thinking Mode: The robot pauses while processing, indicated by a "thinking" icon (see Figure 1-12).
• Listening Mode: While awaiting input, the robot blinks every 2 seconds if no voice is detected (see Figure 1-13).
  
  

Emotion Display

The robot displays five emotions:

• 0: Neutral
• 2: Excited
• 3: Surprised
• 6: Sad
• 9: Confused

How to Update the App

1. Open Firefox or a bookmarked browser and enter the URL: https://pixmoving.oss-cn-shenzhen.aliyuncs.com/app/RoboEV.apk.
2. Download and open the app file. If RoboEV is already installed, select Update; otherwise, click Install and complete the setup.

Permissions (First-Time Installation)

Grant necessary permissions upon first launch by following the prompts. Afterward, return to the dialogue screen by clicking the top-left arrow.

How to Uninstall

1. Locate RoboEV on your phone’s home screen.
2. Long-press the app icon and select App Info.
3. Click Uninstall. Confirm and wait for the uninstallation to complete.