ME 449 Assignment Draft 2021

Introduction

In Chapter 4, we will study the forward kinematics problem for open-chain robots: finding the configuration of the robot's end-effector $T_{sb}(\theta )\in SE(3)$ given the vector of joint positions $\theta$. The forward kinematics problem is easy to solve using a formula called the "product of exponentials," which uses the matrix exponential of this chapter. In this project, CoppeliaSim will solve the forward kinematics for you.

The goal of this project is to test your understanding of the matrix log for rotations, to give you a little practice using the MR library of functions, and to familiarize you with CoppeliaSim.

You will submit a single zip file that includes a single pdf file and one video (make sure we can play it) to Canvas. The file name should be FamilyName_GivenName_asst1.zip (for me, it would be Lynch_Kevin_asst1.zip). You will have to concatenate all your responses and screenshots into a single pdf file.

All assignments will be graded based on correctness, how clearly you organize your homework (the grader should easily find all of your solutions), and how well you follow the instructions. You will lose points if you don't follow the instructions or if the assignment is difficult for the grader to grade.

Part 1: CoppeliaSim Simulation and Exploration In part 1, you will explore some of the functionality and built-in models for CoppeliaSim. Go to this page for a refresher on getting started with CoppeliaSim.

A CoppeliaSim scene may include objects (like shapes, joints, or sensors) and one or more models. A model consists of a number of objects connected to each other.

Models can have sensing and motion capabilities as defined by their attached child scripts. A child script can be threaded (which creates a new computation thread; this is generally discouraged) or non-threaded. A non-threaded script defines the "actuation" and "sensing" functions for an object or model, and these functions are invoked by the main script at each simulation step. More information can be found at Coppelia's webpage on main and child scripts, the CoppeliaSim User Manual, and the CoppeliaSim forum.

Default models can be found in the model browser (left pane, or open with robot icon in the left toolbar).

A scene also includes a main script, which handles the simulation loop. At each simulation step, the main script calls (a) "actuation" functions that simulate the motion of the system and (b) "sensing" functions that simulate the sensors. Generally this main script should not be edited.

Part 1A: Building a world for a mobile robot

In this part, you will explore the CoppeliaSim model browser and learn how to create your own scene using the default models. Anything in the model browser can be dragged and dropped into the checkerboard floor of the scene. They can then be moved or reoriented using the Object/item shift and the Object/item rotate buttons in the top toolbar. Also try using the controls at the top of the window to zoom the camera in and out, pan the camera, etc. First, add the Pioneer_p3dx, a mobile 2-wheeled differential drive robot with front SONAR sensing to the scene (find in model browser). Clicking the Start/resume simulation button will cause the robot to move forward at a set velocity (in the child script defined by v0). The sensor detection distance is set in the attached child script. The robot will move forward until the SONAR sensor detects an obstacle, after which it will turn to avoid it using the Braitenberg algorithm.

Next, add a terrain bump (find terrain_bump.ttm in model browser). Single click Bump in the scene hierarchy to bring up the customization UI. Use the sliders to modify the geometry of the bump such that the Pioneer_p3dx can drive over it. NOTE: None of the sliders should be at the minimum settings.

Add at least 5 80cm high walls to the scene (find in model browser). Arrange and orientate the walls such that when the simulation is started, the Pioneer_p3dx interacts with at least 3 of the walls and drives over the bump at least once. To interact with a wall means to drive towards it and avoid bumping into it.

Your Task:

• Add the Pioneer_p3dx robot and the abovementioned objects to the scene.
• Take a screenshot of your scene with the Bump customization UI showing your custom settings.
• Take a screen recording of the robot moving through your world and interacting with at least 3 walls and driving over the bump at least once. (See CoppeliaSim Introduction for how to take a screen recording if needed)

Part 1B: Exploring the UR5 Scene 1

Open Scene 1 for interactive manipulation of the Universal Robots UR5 robot, a popular 6R robot (You can go to the CoppeliaSim Introduction to download Scene 1). In this scene, there is a model of a UR5 robot, which consists of a collection of joints connecting shapes (links), from the base out to the end-effector.

When you run this scene you will see a window with two tabs: "Enter Config and SE(3) Value" and "Joint Angle Sliders". Go to the "Joint Angle Sliders" tab, move the sliders corresponding to the six joints, and watch how the robot moves.

Make sure your scene 1 simulation is stopped so you can open up a script. Click the "Scripts" button on the toolbar on the left side of the screen (shown below) to see the scripts being run by the scene.

Double-click the "Non-threaded child script (UI_Script)" to open it. You will see a script written in the Lua programming language. Early in the file, you might notice that some functions look similar to functions written in the Modern Robotics Library. For example, so3andp2se3(R,p) in this script resembles RpToTrans(R,p) in the Modern Robotics Library.

Scroll down to line 242. From here to the end of the file, this code examines the type of "call" to the child script by the main script and performs the appropriate functions. For example, if the sim_call_type is sim.syscb_init, the simulation has started and the user interface should be generated. (There is a lot of XML code here defining the user interface.) If the sim_call_type is sim.syscb_actuation, then the joint angles entered by the user in the UI are applied to the UR5 model, the UI is updated, and the transformation matrix for the end-effector is calculated. If the sim_call_type is sim.syscb_sensing, nothing happens, and if it is sim.syscb_cleanup, the UI is destroyed as the simulation ends.

The XML code for the UI starts on line 251. This XML code controls the appearance of the Custom UI, including the layout and content of text boxes, sliders, tab titles, and font size. The XML syntax can be found at Custom UI Plugin XML Syntax. For this specific scene, the different text boxes and sliders are arranged in different groups. Each group has a layout which determines how the objects inside the group will be displayed and label text which determines what text will be displayed and how it will be displayed. If you'd like, you can consult the XML syntax for the attributes each element can have.

Your task: Modify the non-threaded child script (UI_Script) to change an aspect of the scene. For example, you can choose to change the Custom UI layout, change the titles and words of the Custom UI, or change font sizes in the Custom UI. Some example changes include:

• Changing the layout: consult the XML syntax and change <group layout="vbox"> to another type (hbox,form, grid, none). Using line 257, changing <group layout="vbox"> to <group layout="hbox"> changes the orientation of the items in the group containing "Configuration Entry", "Current configuration", and "Messages" on the "Enter Config and SE(3) Value" tab of the Custom UI from vertically arranged to horizontal.

• Changing the words: Find the text you want to change in the XML code. The text will be surrounded by quotation marks and have <big> and </big> on its sides. For example, line 258 "label text="<big> Configuration Entry:</big>" controls the text "Configuration Entry" on the "Enter Config and SE(3) Value" tab of the Custom UI. Change the words "Configuration Entry" to change the text displayed in that specific section.

• Changing the font: Using line 258 label text="<big>Configuration Entry:</big>"
  • The font can be changed to small using: label text="<small>Configuration Entry:</small>"
  • The font can be changed to a specific size using: label text="<font size=20>Configuration Entry:</font>", where 20 is the desired font size.

Part 2: Joint Angle Calculations

The 6R UR5 robot is shown below at its home configuration. Eight frames are defined: the fixed frame {s} at the base, frames {1} through {6} attached to links 1 through 6, and the end-effector frame {b} which is fixed relative to link 6. (The frame {b} is not shown in the image.) The red arrow is the x-axis, the green arrow is the y-axis, and the blue arrow is the z-axis. Frames {s} and {1}-{6} are aligned when the robot is at its home configuration, i.e., each rotation matrix $R_{ij}$ (where $i,j$ could be $s$ or any number 1 through 6) is the identity matrix.

The rotation axes for joint $i$, defined in frame {$i$}, are ${\hat {\omega }}_{1}=(0,0,1),{\hat {\omega }}_{2}={\hat {\omega }}_{3}={\hat {\omega }}_{4}={\hat {\omega }}_{6}=(0,1,0),{\hat {\omega }}_{5}=(0,0,-1)$.

For some set of joint angles $\theta$, we have the following relations between the orientations of the joint frames:

• R₁₃ = [[-0.5, 0, 0.866]; [0, 1, 0]; [-0.866, 0, -0.5]]
• R_s2 = [[-0.6124, -0.7071, -0.3536]; [-0.6124, 0.7071, -0.3536]; [0.5, 0, -0.866]]
• R₁₅ = [[-0.866, -0.5, 0]; [-0.5, 0.866, 0]; [0, 0, -1]]
• R₁₂ = [[-0.866, 0, -0.5]; [0, 1, 0]; [0.5, 0, -0.866]]
• R₃₄ = [[0.5, 0, 0.866]; [0, 1, 0]; [-0.866, 0, 0.5]]
• R_s6 = [[-0.183, -0.9659, 0.183]; [-0.683, 0.2588, 0.683]; [-0.7071, 0, -0.7071]]
• R_6b = [[-1, 0, 0]; [0, 0, 1]; [0, 1, 0]]

where {b} is the end-effector frame not shown in the figure.

Your task:

• Find the six-vector of joint angles $\theta$ given the $R_{ij}$ above. (You will likely want to calculate the rotation matrices $R_{i,i+1}$ and use the MR code library, e.g., MatrixLog3.)
• Enter the joint angles you found into Scene1_UR5 in CoppeliaSim to see the configuration of the robot.
• Calculate R_sb using the information given, and verify that your joint angle vector $\theta$ is correct by entering the joint angles into the scene and comparing your R_sb to the rotation matrix portion of the T_sb calculated by the scene under the "Enter Config and SE(3) Value" tab.

What to turn in to Canvas: A single zip file. The file name should be FamilyName_GivenName_asst1.zip (for me, it would be Lynch_Kevin_asst1.zip). This file should have:

• A single pdf file including:
  • 1A: A screenshot of your custom scene and bump UI showing your custom settings
  • 1B: A screenshot of your changed code in the child script. Explain what you changed about the scene/UI. (A small change suffices.)
  • 1B & 2: A screenshot of the scene, clearly showing the modified UI, the SE(3) calculation, and the robot at the correct configuration.
  • 2: The list of the six joint angles you calculated and a brief explanation of the method (including the MR code) you used to calculate them.
• A single video file showing a screen recording of your Pioneer_p3dx robot moving through your custom scene. NOTE: make sure we can play your video

If you do not know how to take a screenshot, you can use one of the following:

• Mac: Cmd-Shift-3 and look for the screenshot on your desktop.
• Windows: Use the PrtScn button (or Windows Key + PrtScn or Alt _ PrtScn, etc.). You can also search for the Snipping Tool.
• Linux: you can use Screenshot or PrtScrn.