What

Holofunk is an open-source, audiovisual, gestural live looper. With no buttons, no remotes, nothing in your hands at all, you can create and conduct a whole ensemble made entirely of yourself.

Holofunk lets you spontaneously and improvisationally create music, that you can directly see and manipulate as you create it. It feels something like fingerpainting with sound.  It also supports two players, two-handed fully ambidextrous control, and two different viewpoints (performer and audience).

Here I am presenting it at the Seattle Mini Maker Faire in 2015.  If you watch only one Holofunk video, this should be it:

And here is a bit of my friend Dane and I using it together, two-player style, at the Jigsaw Renaissance makerspace in Seattle in early July 2014:

ALPHA TESTERS WANTED.  If you think this looks interesting, are in the Seattle area, and have the minimum necessary hardware, drop me a line via Facebook or email.

How

Holofunk is an x64 C# application, built with the following software stack:

The source is on GitHub:

I am running the following hardware, in its current incarnation:

Also a Dell touchscreen monitor, a tripod monitor mount, and a clamp to stick the Kinect on top of the monitor.

Much of this hardware is not necessary to run it; the decent Win8 PC (or laptop), new Kinect, and USB interface are the only must-have items.  It works fine with a wired microphone, also.

Who

My name is Rob Jellinghaus. By day I work for Microsoft. Holofunk is my moonlighting project; Microsoft has an explicit moonlighting policy allowing personal projects such as this, for which I’m genuinely grateful. (All Microsoft software components in Holofunk are publicly available.)

Why

I have done a fair amount of a cappella singing, which I’ve always loved, especially harmony. And I’ve also been involved in the rave scene for decades now. But live singing and techno all too seldom came together; my two loves were disunited.

Then I encountered a brilliant UK musician, Beardyman. He recorded himself live, then played himself back, over and over, chopping up the sound in a million ways. This video in particular blew me away when I first saw it four years ago:

There, his entire performance is live, but all the video is (very artfully and painstakingly) cut up and edited after the fact. The concept is so immediately understandable, I started wondering whether it could be done entirely live.

I’ve heard Beardyman say while performing that it’s hard for people to believe he’s doing it all live, because — unlike that video — in his live sets, one can’t see the multiple overlapping loops, but only hear them.

Holofunk tries to fix that, by making each sound into something you can both see and touch.  I wanted to make complex music using something that had no buttons, nothing that you had to hold still over and peer down at.  Holofunk comes closer to this vision than anything else in the world that I presently know of.

When

At this writing it is September 2015.  I started working on Holofunk over four years ago.  In fact, in September 2011, I demonstrated the very first working version — which at the time used the first Kinect, a Wiimote over Bluetooth, and a wired microphone — to Beardyman himself in Vancouver:

Since that time I have added support for multiple players and multiple monitors / viewpoints, increased the resolution, added sound effect support, ditched the Wiimote in favor of the new Kinect’s awesome hand pose detection, moved from hand-held microphones to wireless headsets, built the current performance rig, upgraded to x64 support, and shaken the bugs out of VST plugin support.

I now consider Holofunk fully ready for alpha testing.  I would like to find a small group of alpha testers (no more than five or so); each will need a new Kinect for Windows sensor,  a Windows 8 computer able to drive the new Kinect, and a good USB audio interface with solid ASIO drivers.

Where

I live and work with my family in the Seattle area, near Microsoft’s Redmond campus. Testers who live nearby are much easier for me to work with.

I demo and/or perform with Holofunk occasionally, especially near Seattle; see the Events page for details.

What Next

If you are intrigued by this project, please enjoy the rest of this web site.  Also please consider liking Holofunk on Facebook, and following updates on this site.

Note that subscribing to site updates through WordPress is almost certainly the best way to reliably follow what’s up with Holofunk; Facebook will often not show you updates to a group, unless you request notifications from that group explicitly. Of course, if you subscribe via WordPress, you have to make sure your spam filter doesn’t eat emails from WordPress….

In any case, new Holofunk versions / demos / features / performances will all get posted both to Facebook and as updates here.

I also have blogged quite a bit while building Holofunk over the last three years, over on my personal software blog’s Holofunk category.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s