6.111

Final Project!

FPGuitAr Hero combines camera-based motion tracking with a graphical interface and audio output to create a game that gets people moving through music. In FPGuitAr Hero, players hold up to four colored lights, which are tracked separately by a camera using chroma-keying and mapped onto the graphical interface as paddles. On this interface, users must “hit” the notes of a song as they stream down the screen. Notes are represented by rectangles, whose pitch is encoded by the x position along the screen (61 possible pitches), every octave has a different color (5 possible octaves + A6), and length is encoded by height of the rectangles. The player earns more points the longer they are able to “hold” the note during its potential duration, and holding a note produces the corresponding audio output via speakers. The 6.111 website is here

Tools: PSoC, Breadboard, Coding in C and Assembly
Date: Spring 2019

This is the final setup of our project complete with a monitor, FPGA, camera and led lights.



Abstract PDF
Proposal PDF
Presentation PDF
Checklist PDF
Final Report PDF