12/30/2010

Interact with falling snow flakes... Christmas game



Kinect camera with the OpenNi framework are used to idetify and separate players. Since each player plays its own sound when touching the snow-flakes, more people means more complex sounds...
12/30/2010

Boobie jiggling: Motion capture with body physics using Kinect



This video brings the motion capture one step further and adds body physics to different parts, such as the boobs of the virtual character. Next step, real time realistic clothes and hair?
12/26/2010

Playing World of Warcraft using gestures with Kinect



This video shows the first efforts to use Kinect to control mainstream games, in this case WoW. The interface is quite complete though it seems that you need to learn a lot of movements in order to properly control the character using this Kinect Hack.
12/21/2010

Interacting in a virtual reality world with Kinect



This Kinect Hack is an interface which allows to connect your movements to a virtual character in a virtual world. Even better, with a head-mounted display (HMD) tracking your point of view...
12/21/2010

Interacting with a virtual piece of cloth...



Using a Kinect Hack to interact with a virtual object... in this case just a piece of cloth (however, it looks to me more like a rubber sheet).
12/20/2010

Star Wars world animation using Kinect



Star Wars world animation using Kinect. Real people interacting in a virtual world.
12/19/2010

Amazing Miku's (and her friends) choreography using Kinect



Try your own choreography with the character Miku in MikuMikuDance using your body and this Kinect Hack (available for download).
12/19/2010

Really useful Kinect hack: Controlling your XBMC media player with Kinect



After years without real evolution in the way TV is controlled, it looks amazing that the change will be due to a gaming device. Just moving your hand to change a channel, choose or play a movie... looks like a more intuitive way to control a media center while sitting on the coach than one of these 1000 button controllers.

Amazing!
12/17/2010

Be the character you want with Kinect



The middleware OpenNI and Kinect allow to easily extract 3D skeleton information from an scene. This is used here to control your favorite 3D character... awesome!
12/17/2010

Control your quadrotor using gestures with this Kinect Hack



This Kinect Hack allows you to control the AR Droid helicopter using gestures... the movement of the helicopter looks pretty stable and consistent with the movements.... Amazing!
12/17/2010

A Kinect based robotic pet following you everywhere you go



The new OpenNI middleware is opening a lot of new possibilities to the programmers. This robotic Kinect Hack tracks your movements and follows you... while this could be done without Kinect there existed always a robustness issue which has now been solved.

Amazing!
12/15/2010

A new great-looking invisibility effect using Kinect



Some time ago a video showed a similar effect of transparency and refraction using Kinect. However, this remake of the hollow man effect looks even greater!

Amazing!
12/13/2010

Special effect that creates a real-time temporally shifted echo



In this Kinect Hack IR video stream and depth information are used to buffer and create a temporally shifted copy of the world. The result is impressive!

12/12/2010

Using skeleton tracking to make your manga character dance



This video uses the recently released openNI interface to control a virtual manga character... it seems that the skeleton tracking engine of the device works pretty well.

Amazing!
12/11/2010

Robot car navigation and obstacle avoidance using Kinect



What can you do with a laptop, a Kinect sensor and a mini car? Yeah, an autonomous robot. Here we can see how this wheeled robot is capable of determining the best route using the depth information provided by the Kinect device.
12/10/2010

Skeletal tracking working fluently with Kinect in a PC



Skeletal tracking working fluently! The developed software requires a step of calibration, but the tracking of the body, arms and legs seems to work great!
12/10/2010

An Air Guitar prototype using the Kinect



In this video we can see the first steps toward a virtual guitar implementation... impressive!.
12/09/2010

Head tracking for panorama picture navigation using Kinect



Here Kinect is used to track the position and angle of your head. This information is then mapped into the point of view of a panorama photography...
12/08/2010

Minority report's interface using Kinect. MIT experiment.



Using Kinect and a hand/finger tracking software this group emulates the interface seen in Minority Report... amazingly fluid!
12/08/2010

Controlling your monster with Kinect



In this video we can see how Kinect can be used to control digital puppets. In this case a monster...

Awesome!
12/07/2010

Rendering your room with Kinect



This video shows a 3D scanner prototype. The algorithm takes as input the mesh scream generated by the Kinect device and searches and tracks key points used to match the topology between two consecutive frames. This can be used for example to scan large environments that cannot be fitted into a single shot of the device.
12/07/2010

Special effect using a 3D Vector Field adquired with Kinect



Depth information from the Kinect sensor is transformed into a 3D vector field... This can be used later on for different special effects. In this video the author interacts with snow particles creating a spectacular visual effect.
12/07/2010

Navigate through complex molecular systems using Kinect



Kinect shows all its power when it is used to interact with 3D environments. In this video it is shown how Kinect can be used to rotate and navigate through complex molecular systems. Besides rotation it allows different kinds of gestures...

amazing!
12/06/2010

Quadrotor autonomous navigation with Kinect sensor



In this video the Kinect sensor is attached to a Quadrotor helicopter... which recognizes the closest obstacle and uses this information for indoors navigation.

Amazing!
12/05/2010

DJing in a party with Kinect



This video show Kinect being used to generate al the visual effects projected on the screen in a party ... first real application of a Kinect Hack?

Amazing!
12/04/2010

Creating ghost furniture with a Kinect Hack



With Kinect you can record a given 3D scene and navigate it afterwards... this is done in this video with ghost furniture. Once the furniture is recorded, it is taken out... but it is still there!
12/04/2010

My stuffed hands! Real time depth dependent morphing



This Kinect Hack presents a depth dependent real time morphing exercise. It looks great... even without a cat.
12/03/2010

Control a flying helicopter moving your arm



In this video the kinect device it is used to control a RC helicopter, like if you had the Force. It looks just awesome!
12/03/2010

Real time invisibility effect using Kinect



The background is refracted using depth information. Awesome!
12/02/2010

Human-computer interface using Kinect... zooming, sliding, rotating.



The group &some is also trying to emulate the interface seen in Minority Report ;-)
12/01/2010

Kinect recognizes the opening and closing of your hand to grab virtual dots



In this video we can see a possible interface using a Kinect Hack. The device recognizes the opening and closing of your hand to grab virtual objects.

Awesome possibilities!
12/01/2010

Playing basketball with a Kinect Hack



This hack proposes to use the Kinect in a basketball game. You have to grab the ball and throw it to the basket!
12/01/2010

Drawing with your hand... and making it move. Kinect



Drawing of different shapes in an environment with realistic gravity. Nice!
11/30/2010

My skull is on fire



Special effects using Kinect, a Mac mini and a Mac pro. Kinect video streams captured by a Mac mini and processed by a Mac Pro. Impressive combination to obtain the burning effect, Matrix effect and more...
11/29/2010

Web browsing with the force...

Two new tries of using your gestures and voice to surf the web...



11/29/2010

Kinect sensor attached to an autonomous quadrotor



What about to use a kinect device as input sensor to an autonomous quadrotor helicopter? This video shows this idea. The only problem is the relative reduced range of the 3D sensor which will limit the flying altitude with 3D information. In this case it should change to an video based navigation.
11/29/2010

Kinect based 3D interface to manipulate 3D objects



Another try to construct a human-computer interface using a Kinect Hack. Here we can see how we can control 3D objects as if we were touching them...
11/29/2010

Banana Slapping with a Kinect Hack



This video shows a homemade game emulating the official "stopping ball" game... the only difference is that here you have to slap bananas! Nice Kinect Hack!
11/28/2010

First images of two aligned Kinect devices recording a 3D scene



After several people commenting that this was not possible here the first images of two Kinects recording the same scene. We can see that the result is not perfect, and a checker board is required for calibration purposes... but it works!
11/28/2010

Visual effect transforming the screen into an elastic rubber band



This is a visual effect (as its author says, a silly special effect) making your screen look elastic. Then you can touch it with your hand and make it vibrate. Nice!
11/27/2010

Using Kinect to track your point of view



In this video is used to track your head in front of a monitor. This information can then be used to change the perspective of what you are seeing... like if you were looking out of a window...

amazing!
11/27/2010

Interface and 3D video rendered together



In this video we can see how to merge a 3D scene with an interactive panel in real time. Gorgeous KinectHack!
11/27/2010

Musical video effects created with Kinect



Kinect depth information is used with a filter on a woman dancing to obtain this spectacular video. New possibilities to the "home video industry".

Awesome!
11/27/2010

Particle system that looks like being underwater



Another particle system. If recently we had fire. Now we have water. Amazing!
11/27/2010

3d scanner prototype using a Kinect device



First tries to make a 3d scanner prototype using a Kinect device. The idea is to reconstruct the whole 3D mesh and not only the frontal view. However, the prototype is still in its early stages since it just merges different snapshots without correcting the angle.
11/26/2010

Surf the web like if you were in the world of Minority Report



In my opinion in, let's say two years, the human-computer interface will be completely different... and this is beginning right now. In this video we can see how gestures captured using the Kinect hack can be mapped to common actions, such as surfing the web. And the interactions look pretty fluid and intuitive...

awesome!
11/26/2010

Hand tracking: some special effects



This video may look like another hand tracking experiment using a Kinect hack. It is. However, the responsiveness of the system is very fluid and in the video appear some nice fluid effects on the screen...
11/26/2010

Kinect pin-board



This Kinect hack emulates one of the pinboards you could use to make 3D sculptures (which in my case were always an sculpture of either my hand or my face). Now with this hack it is like having a huge pinboard to play with your whole body...

amazing!
11/26/2010

Using Kinect to play Super Mario Bros... jump!




Body gestures are recognized and used to control Super Mario Bros running in a PC. As the author says:

Celebrating 25 years of Mario. I programmed it to recognize my motions and passed the virtual button presses to the NES emulator. I could have placed a simulated keypad right in front of me that I can press with my hands, but I thought full body gestures were more in the spirit.

And they are. The chosen gestures are more than adecuate to the game. However I cannot see me playing the difficult levels with this run, jump, run, jump, jump pattern.
11/26/2010

Real time fire effect using 3D particle systems and Kinect



This is an awesome example of the real time possibilities of Kinect in creating special effects. Depth information is used to control a particle system simulating fire. The effect is spectacular!
11/25/2010

First tries to control FPS with Kinect



Several gamers insist taht Kinect cannot be used to control certain types of games. However the author of this video does not think that way. Here we can see a primitive way of controlling Quake III using a kinect hack. Of course it needs to be polished, but maybe it is not such a bad idea after all.

Amazing!
11/24/2010

Using Kinect to apply a real time dynamic focus



In this hack Kinect depth information is used to apply a selective blurring filter to the video stream. The result is similar to the depth of field effect of professional cameras. This opens the doors to all kind of new video filters which use not only the image as input, but also the depth of each pixel.
11/24/2010

Robot teleoperation with Kinect Hack



This video shows another amazing possibility of the Kinect device. The video shows in its final part how Kinect can track the operator movements and translate them into a robotic arm. This is still in an early stage of development, but it is already amazing!
11/23/2010

Combining Kinect and Wiimote in an interactive 3D construction environment



This video is quite interesting because it integrates several different tools. In one hand it uses the Wii controller as a pointer to draw / construct 3D objects using a set of predefined pieces. It also integrates your image in the 3D environment and allows to rotate the view point in real time.

Amazing Kinect Hack!
11/23/2010

Playing with gravity



This is an interactive Kinect Hack. In this case Kinect is used to obtain the silhouette of the users and then this shape is used to interact with a virtual world, in this case just falling 2D blocks. It seems to be just an artistic experiment, but one wonders what can be done using a more elaborated 3d world.

Amazing!
11/23/2010

Depth in black and white



The kinect hack is also a new tool for artists. Depth information can be used to achieve all kind of interesting effects. Here we can see a black and white video generated from the depth information obtained from a hacked kinect device.

Amazing!
11/23/2010

Two Kinects at the same time



Many people said that I won't be possible to have two Kinect devices working on the same subject at the same time. This conclusion was reasonable since Kinect works projecting a matrix o infrared dots over the surfaces to scan, and if two of them did it at the same time they would mess up with each other.

However, the best way to see it is to try it! And it seems to work. In this video the inputs from the two Kinect devices are superimposed to obtain an impressive animation. Like a mutant!

Amazing!
11/22/2010

LedWall controlled by Kinect



In this video we can see how Kinect can be used to control a led wall creating a nice effect. Completely useless but really nice!
11/22/2010

With Kinect your body can be a musical instrument



Kinect devices opens the doors to multiple creative possibilities. In this video we can see how the hacked Kinect device can be used as a MIDI controller, transforming your body into a musical instrument!

Amazing!
11/22/2010

Interactive Puppet Prototype with Kinect Hack



This is a try to create high-tech Chinese shadows with the Kinect Hack. The Kinect device track the movement of the hands and reproduces it in a colorful 2D projection creating the effect of an interactive puppet.

Amazing!
11/22/2010

Hacked iRobot is controlled by a Kinect system



This are the first experiments with the Kinect Sensor in Mobile Robotics. We can see how the sensor is attached to a iRobot so that the robot has access to depth information. In fact it can recognize a human shape and be controlled by gestures.

Amazing!
11/22/2010

Kinect Hack makes any surface Multi-Touch



Do you want to have a $150 huge Multi-Touch surface? You only need to have access to this Kinect Hack. It tracks points moving on a given plane, i.e. the surface being monitored, and hence it allows to process these points by any multi-touch software.

Note the huge number possibilities of this Kinect Hack!
11/22/2010

Kinect Augmented Reality hack with Doom 3 character



What happens if we take a 3D scene reconstructed with Kinect and insert additional characters? We obtain an amazing Augmented Reality system. In the video you can see how this can be done using one of the characters of the game Doom 3. Nice pet.

Amazing!
11/22/2010

Real time lightsaber using Kinect



This is one of the Kinect hacks I like most, up to now. You can see how just using a stick it is possible to emulate Luke Skywalker with your own lightsaber. We have seen things like that before but never so accurate and realistic!

Amazing!
11/22/2010

3d boxed reconstruction using Kinect depth information



This Kinect Hack shows another possibility on how reconstructing the 3D scene. In this case the hack uses Kinect depth information a colorful boxed reconstruction with colors mapping the depth of the different blocks.

Amazing Kinect Hack!
11/22/2010

Real time morphing using Kinect

Fat Cat from flight404 on Vimeo.



In this Kinect hack the depth information of Kinect is used to first reconstruct the 3D scene which is then processed to obtain a real time morphing. You can transform yourself to look bigger, thiner... note the cat!

Amazing!
11/22/2010

Drawing in 3D with Kinect

ofxKinect 3D draw 001 from Memo Akten on Vimeo.



In this hack, Kinect is used to track one of the user's hands which is used as 3D pencil. If the two hands are brought to the foreground, the interface rotates the drawing.

Amazing!
11/22/2010

Teaching Kinect to recognize objects



This hack also shows some hiden power of Kinect. In this case Kinect hardware is used to take pictures of objects, including depth information. With depth information it is easy to crop and recognize the object in front of the camera.

Amazing!
11/22/2010

Laser tracking projection with Kinect and OpenCV



In this hack Kinect is used to create a laser projection over a surface being tracked with Kinect. Once a surface is found every kind of nice laser images can be projected there.

Amazing!
11/22/2010

Kinect 3D environment reconstruction



This kinect kack just maps both the image and depth data captured by the Kinect device into a 3d environment. I can envisage applications for this such as next generation video conference services. You can also have a 3D scanner ad home for $150 dollars. Even the game characters can be reconstruction of your own body. Great Kinect Hack!

Amazing!
11/22/2010

Kinect Windows 7 Interface



There have been many hacks from Kinect's release. I will be publishing the most amazing of them here, starting with this Kinect hack by Evoluce which maps gestures into the multitouch driver of Windows 7. That is, with this Kinect's hack you can steer most of Windows 7 applications supporting the multitouch interface.

As I said, amazing!
11/21/2010

Kinect driver hacked a couple of hours after its release



It all started when electronic company Adafruit Industries offered a $1,000 reward to the first person to build an open-source driver for Kinect. The reward was raised to $3,000 and awarded to Hector, a spanish guy who not even had an xBox.

It took just a couple of hours to have the Kinect hardware hacked. Now the specifications are publicly available and the community has an open driver to play around. Let's see what they can do.

Driver and more info: OpenKinect

Amazing!