EQ // Interactive web-experience // P5.js, FaceAPI, GPT2, RunwayML

EQ is a web experience that combines facial-landmark tracking and a text-generation AI, in an attempt to have machine-learning algorithms cooperate to ‘understand’ emotion.

FaceAPI reads your facial landmark positions and estimates what emotion you are displaying. GPT-2 is a text generation algorithm that has been trained to read and write ‘coherent’ English, by analysing 8 million webpages. The website uses your webcam to give you live feedback from the two algorithms, in the form of generated text deemed appropriate to the emotion you’re displaying.

These ‘intelligent’ algorithms working together produce some interesting, surprising, funny, and weird outcomes, that highlight how emotional understanding is still a distinctly human skill.

Try EQ for yourself here!

Made with: P5.js, FaceAPI, GPT-2, RunwayML