Repository files navigation

• Technical Report: [coming soon]
• Demonstration: [coming soon]
• Detailed Control Flow: [coming soon]

1. Create conda environment

   conda create -n kinovaAi python=3.10.14

2. Download the LM and move it tollm_models

3. Install packages:

   pip install -r requirements.txt

1. Activate conda environment.

   conda activate kinovaAi

2. Set the IP address of host server (i.e. running ROS, Kortex API & connected to arm) ininference2_clipseg.py.

   Example:HOST_IP = '192.168.1.100'

3. Start the server first by following theRemote AI Inference instructions onrishiktiwari/rishik_ros_kortex

4. Run the following command to connect to server and begin inference script:

   python3 embodied_ai/inference2_clipseg.py

   inference1_gdino is incomplete and not recommended.

   Only actions translating to pick or pick_place are supported.English prompt works the best!