This is an experiment built with machine learning that lets you make music with the computer just by taking a picture. It uses image recognition to label what it sees, then it turns those labels into lyrics of a song. About 200,000 views. Important Note Content Editors rate, curate and regularly update what we believe … Read More » “Best of experiments with Google: Giorgio Cam”

Move Mirror lets you explore pictures in a fun new way. You turn on your webcam and move around, and the computer pulls up pictures of poses that match yours in realtime. The image database is made of more than 80,000 pictures we pulled together – of people dancing, doing karate, cooking, walking, skiing and … Read More » “Best of experiments with Google: Move Mirror”

Language and images are closely intertwined: We think in pictures and we explain facts as spatial constellations. What if the spoken word could be transformed into dynamic visual worlds in real time? Speech input, machine learning and recurrent neural networks for image generation allow to computer generate complex imaginary worlds that follow the narrator and … Read More » “Best of experiments with Google: Scribbling Speech”

Semi-Conductor is an experiment that lets you conduct your own orchestra through your browser. You can move your arms to change the tempo, volume, and instrumentation of a piece of music. It uses PoseNet, a machine learning library that works in the browser, to map out your movements through your webcam. An algorithm plays along to … Read More » “Best of experiments with Google: Music: Semi-Conductor”