7/07/2011

Silhouetris: Silhouette + Tetris



Silhouetris is back! This time using Microsoft Kinect Technology.
A tetris based game in which your silhouette is the key.
6/18/2011

Making the Mona Lisa dance "like a Virgin"



Mona Lisa (also known as La Gioconda or La Joconde) is a painted in oil by the Florentine artist Leonardo da Vinci in the 16th century... and in the 21th it dances "like a Virgin".
6/17/2011

Official Microsoft Kinect SDK Released


Immediately after its public release the Microsoft Kinect was hacked apart and open sourced. That, is the open driver has been around for some time now. However, now the official beta SDK by Microsoft has been released. It includes drivers, API's for raw sensor streams and human motion tracking (similar to open-NI framework)...

Features included in the SDK:

  • Raw sensor streams
  • Skeletal tracking
  • Advanced audio capabilities
  • Sample code and documentation
  • Easy installation

More info: Microsoft research
6/13/2011

Kinect-based interactive picture frame in PUPP‘ART exhibition



With this Kinect Hack the visitor becomes the main character of the painting. This piece of art becomes alive to give birth to an interaction between image and reality.
6/13/2011

Augmented reality with Kinect: realtime virtual character control



The classical realtime control (OpenNI-based) of a virtual character using Kinect. The novelty here is that the character has been inserted in the webcam video stream using augmented reality techniques. Great idea!
6/06/2011

Wild street performance in Indonesia using Kinect Hacks



6 projectors, 3 Kinects, 3 PCs, OpenNI for interaction, all stitched together with a specially made 16 point correction program. It looks original... and fun!
6/04/2011

Kinect based teleconferencing with real-time 3D capture and auto-stereo display



This Kinect hack introduces a proof-of-concept telepresence system that uses several Kinect devices in order to fully reconstruct a scene. This 3D data can then be used in a teleconference system which implements an auto-stereo display using head tracking.

Now, when a commercial product?

More information: here
6/04/2011

SwimBrowser, a Kinect Hack to swim the web naturally



This Kinect Hack aims to control a web browser naturally through gestures. In fact, gestures used look quite intuitive (like swimming) and the interface is very fluid. Maybe for checking some news from the sofa?
6/04/2011

Experimental performance with Kinect and Adaptive Learning Algorithms



A performative experiment that explores boundaries and possibilities of the interactions between indivual and the virtual, man and machine. Nice to see that Kinect also opens new ways of art...
6/01/2011

Realtime facial animation using a Kinect Hack



This hack uses a novel face tracking algorithm that can deal with the noisy output given by the Kinect sensor. The obtained data is then mapped in real time to a 3D mesh. Nice hack!
3/10/2011

Zombie massacre using Unity3D and Kinect (amazing new video)



Kinect as a control device. This simple proof of concept shows some of its possibilities... and it is available for download!

"Obviously this is only a tech demo which would require fleshing out in nearly every direction for a full release -- from art through to gameplay there is a lot of room for improvement. We figured some people might be interested in giving this a crack however -- which is why we've made a download available at www.pixelninjagames.com"
3/08/2011

Using a teleoperated robot to cut a banana with Kinect



A robot holding a weapon may look dangerous. In this video a teleoperated robot uses a knife to cut a banana!
3/07/2011

Full body reconstruction using Kinect device + additional webcams



While Kinect gives depth information it makes it from a frontal point of view. Here, additional webcams are used to reconstruct what is happening on the back of the model. The information is fused together using proprietary software.
1/26/2011

Starwars like demo of synthetic holographic video generated from Kinect depth information



Kinect depth information is used here to generate a 3D mesh that can be used as input to an algorithm of real-time hologram generation. The holographic images that can be generated nowadays in real-time offer poor quality, but this Kinect hack opens the doors to Star Wars like holograms!
1/26/2011

Real time 2D puppet animation using Kinect and Animata



Low cost virtual marionette animation is almost there. From the project webpage:

The workflow for this project is based on the OpenNI driver frame work, using SensorKinect, the AVIN hacked PrimeSense driver for kinetic supporting OSX.

The OSCELETON from Sense Bloom routes the skeleton information through open sound control messages. This information reaches the real-time animation software ANIMATA giving life to the Silhouette.
1/23/2011

First person shooter using Kinect, Wii remote and 3D head mounted display... this is the future of the FPS.



An explosive combination: head mounted display for visualization and head tracking, wiimote control for weapon movement tracking / firing and Kinect for body tracking. All merged offers an amazing immersive gaming experience in which you can use natural movements to move through the environment.

Really amazing! Enjoy the video!
1/18/2011

Flying like an iron man in a 2D environment with Kinect



Kinect body tracking and interaction in a 2D environment with physics. Become a flying iron man!
1/18/2011

Body tracking using Kinect: simultaneous tracking of 3 people with OpenNI



We have already seen different videos of virtual avatar puppeting. However, here we can see the simultaneous tracking of three people using a single Kinect. Enjoy the video!
1/17/2011

Humanoid Robot mimicking human movements using Kinect... amazing video



That's impressive!

A robot with an auto balance correction system mimicks human movements seen using the Kinect system... including pretty awesome positions. Enjoy the video!
1/17/2011

Be god using Kinect with the game "Black and White"



It is surprising how old games seem to be thought to be played using gestures with Kinect. This is the case of "Black and White". This game was designed to be controled with the mouse, and however, it seems more natural to control a game like that using gestures. I wonder how would be if the game was developed with Kinect in mind!
1/13/2011

Amazingly fluid Tetris experience using Kinect



Two students at the University of Twente have made a Tetris game contolled by a Kinect using Unity 3D / Kinect wrapper OpenNI. I love tetris!
1/13/2011

Video scratching using Kinect's depth information



Simple though spectacular application of a Kinect device. Enjoy the video!
1/12/2011

Controlling Max Payne with Kinect (or how to activate bullet time)



From the author:
As you can see, the leaning left and right stuff is all there - and moving your body forward and backs moves you back and forwards. The reload and interact gestures are becoming pretty standard for me now, and pain killers are popped with an upward motion of the left hand. What makes this special though is the leg movements that activate bullet time. The result is bullet time diving for real! When this game hit just after the Matrix film came out it caused a big stir - with kinect augmentation it gets even better.
1/10/2011

Humanoid robot control with both mimic and gesture commands using this Kinect Hack



In this video Nao humanoid robot is controlled using gestures. This is a natural way to control and teach a robot how something can be done. The idea is that the robot can learn it and do it for itself: Learning from Demonstration.

Amazing!
1/10/2011

Become a Predator using Kinect (and a carton-paper costume)



Again the invisibility effect... now to emulate the Predator with a carton-paper costume. Enjoy the video!
1/10/2011

Playing Call of Duty with Kinect and a Wiimote



In order to play FPS with Kinect you need a trigger since it is not realistic to make a gesture everytime you want to shoot. One possibility is to use the Wii controller (Wiimote) as a virtual weapon (and to control some of the movements).

Awesome!
1/06/2011

Body tracking and interaction with a virtual environment using Kinect



This Kinect Hack allows to control a virtual character in a 3D environment with physics. Amazing!
1/05/2011

Some useless amazing Kinect applications: become a superhero



Amazing video of a Kinect Hack that combines multiple features in a quite useless application: become a superhero. It combines augmented reality, skeleton tracking, environment interaction, special effects and more. Enjoy!
1/05/2011

Text input using gestures with this Kinect based interface



This Kinect hack includes mouse control on Windows 7 and, here is the new part, a fast text input capability just using gestures... of course this capability is dictionary based and seems to work properly. However, as it is cannot challenge the actual keyboard based input.
1/04/2011

Playing virtual drums with Kinect



This Kinect Hack is used to track the movements of your arms and simulate a complete set of drums... amazing!
1/03/2011

Augmented reality in the interior of your body using Kinect



From the project page:

The Microsoft Kinect provides a color and a depth image. Using OpenNI and PrimeSense NITE we can get the skeleton of a person standing in front of the Kinect in real-time.

We register a CT dataset to this skeleton and do an Augmented Reality overlay of the CT and the person. Using context and focus visualization we only show the CT through a virtual window, while still showing the person.
1/03/2011

Interactive special effects on a christmas party using the Kinect



Using the Kinect depth information it is possible to create awesome special effects. Specially for parties due to the capability of Kinect to "see" in the dark. In this video the screen doesn't get cleared anymore at a certain depth so that you can paint with your motion.
1/03/2011

Strategy game RUSE controlled with gestures using Kinect



Strategy games can also be controlled using Kinect and body gestures... pretty smoothly.