So the basis of this project is a medium-sized, motor-jointed robotic arm. I aim to use machine learning to look at a person's arm through a camera, and then map the arm's movement to that robotic arm. I am planning on hooking it up to a esp32 and a raspberry pi (for moving the arm and for getting camera input, respectively). As extra touches I will add electromagnets to a 3d printed claw at the end of the arm that can be enabled and disabled, as well as an e-paper display (for aesthetic purposes.)

I actually came up with this idea a few weeks ago when I had heard of inverse kinematics. Inverse kinematics is a way of moving a multi-jointed structure into a certain formation. I wanted to use FABRIK, or forward and backward reaching inverse kinematics, to make some sort of arm in real life, rather than a video game or simulation.

I would use this to learn more about FABRIK and how I could use it; I think its a really cool concept and I want to delve deeper into it. Also, I would get more practice with esp32s, computer vision, and more. Also, it would be pretty cool to be able to control a robotic arm. :)

I am first going to design the arm and the stand for the arm; I aim for the arm to be like a simple multijointed robotic arm or industrial arm, and for most of the material of the arm and hub to be made of 3d printed filament. When I am done designing the project's overall prototype, I will print the required pieces.

I will then set up the esp32 microcontroller. I will connect it to the stepper motors, aesthetic e-paper display, and electromagnets controlling the joints through dupont wires and breadboards. The raspberry pi will also be used, and I will hook it up to the camera and set up computer vision with tflite; I can easily interop between the esp32 and the rasbpi due to the esp32's ability to handle bluetooth and wifi.

Overall, I aim to make a working prototype with a working, moveable arm (through inverse kinematics).

What materials will you need for your project? Where will you get them? How much does it cost? Please include all materials, including components you already own. Make sure to factor in shipping costs and sales tax.

Everything is in USD