The Kortexino Bot is a smart robot that turns around to follow your face and moves back and forth to keep an exact distance from you. Kortexino Bot also reacts to your facial expressions and can read your emotions.
The iPhone together with the Kortexino app is the brain of Kortexino Bot. The advanced 3D sensors of iPhone X or higher are used to measure facial expressions, 3D face position and orientation and the built in compass and gyroscope are used to measure the Kortexino Bot orientation. This information is transmitted to the Arduino microcontroller to control the two wheels.
The project was developed with a high degree of customizability in mind. The Kortexino app is doing all the heavy lifting via the augmented reality based 3D awareness and neural networks built into iPhone, and it simply transmitts the most important sensor data via bluetooth to the Arduino board. The navigation algorithms are directly programmed via the Arduino IDE and therefore offer a very high level of flexibility. This flexibility is exemplified in coding challenges, in which a variety behaviors are programmed, which are dependent on the 3D face position or facial expressions. Just a few lines of code are sufficient to program interesting behaviors.
Due to the high level of flexibility of the Kortexino app, any project, which can receive bluetooth signals, can easily be controlled by the advanced sensor data that iPhone X offers.
Look here if you want to learn more about this project in general:
Files for 3D printing:
Assembly instructions and programming manual: