Kortexino Bot: 3D printed emotion sensing robot

Tell us the story of your project: 

The Kortexino Bot is a smart robot that turns around to follow your face and moves back and forth to keep an exact distance from you. Kortexino Bot also reacts to your facial expressions and can read your emotions.

The iPhone together with the Kortexino app is the brain of Kortexino Bot. The advanced 3D sensors of iPhone X or higher are used to measure facial expressions, 3D face position and orientation and the built in compass and gyroscope are used to measure the Kortexino Bot orientation. This information is transmitted to the Arduino microcontroller to control the two wheels.

The project was developed with a high degree of customizability in mind. The Kortexino app is doing all the heavy lifting via the augmented reality based 3D awareness and neural networks built into iPhone, and it simply transmitts the most important sensor data via bluetooth to the Arduino board. The navigation algorithms are directly programmed via the Arduino IDE and therefore offer a very high level of flexibility. This flexibility is exemplified in coding challenges, in which a variety behaviors are programmed, which are dependent on the 3D face position or facial expressions. Just a few lines of code are sufficient to program interesting behaviors.

Due to the high level of flexibility of the Kortexino app, any project, which can receive bluetooth signals, can easily be controlled by the advanced sensor data that iPhone X offers.

Look here if you want to learn more about this project in general:

https://www.borderlineinteractive.info/kortexino/index.html

Difficulty: 
Duration: 
Collaborators: 
leif.dehmelt
Number of Forks: 
0
Tools: 
Name: 
3D printer
Quantity: 
1
Materials: 
Name: 
M2.5 countersunk screws 11mm length or shorter
Quantity or amount: 
8
Name: 
M2.5 nuts
Quantity or amount: 
3
Name: 
M2 buttoned screws 8-10mm length
Quantity or amount: 
2
Name: 
M2 nuts
Quantity or amount: 
2
Name: 
silicone O-ring 45mmx38mmx3.5mm (for wheels)
Quantity or amount: 
2
Name: 
N30 motor 300rpm DC 6V
Quantity or amount: 
2
Name: 
SS-12F15G6 SPDT panel switc
Quantity or amount: 
1
Name: 
9V battery snap connector with plain wire ends
Quantity or amount: 
1
Name: 
9V battery
Quantity or amount: 
1
Name: 
Wires and soldering equipment
Quantity or amount: 
1
Name: 
iPhone X or later
Quantity or amount: 
1
Boards & Kits: 
Name: 
Romeo BLE mini
Quantity: 
1
Team Members: 
Team member name: 
leif.dehmelt
What role did this person play on the project?: 
Project Lead
Public
Sort Order: 
0
Teaser: 
3D print your own emotion-controlled smart robot that is powered by the neural networks built into iPhone X.
Aha! moment: 
The idea to separate the complex augmented reality based 3D awareness and neural networks within the fixed program on iPhone from the simple but most interesting coding of robot behavior, which can be done by anyone via the Arduino IDE.
Uh-oh! moment: 
Making a small robot that can smoothly move an iPhone.
Show & Tell video as default: 
Creation Date: 
Friday, September 13, 2019 - 22:51