Experiments & Research in Interactive Technology
Touch Screens, Augmented Reality, Facial Recognition, Emerging Technologies
Designing Experiences For Generation Z
I’ve been developing the digital portion of an interactive environment for young children. The project has several components, many of which are analog, as in craft paper rolls with crayons, chalk board walls, etc. The digital portion is probably the most challenging in terms of relevance. Traditional creative tools like paper and crayons or clay, always resonate with kids regardless of the generation. However, what can be done digitally that isn’t already available on the mobile entertainment devices that parents buy their kids? To provide more context, this is an in-store experience that needs to keep children engaged. The digital portion is displayed on (3) 32-inch multitouch displays. Simply creating a multitouch game just isn’t innovative enough for this generation. It would essentially be like attaching an iPad to the wall. One solution is to consider multilevel interactions that incorporate a variety of technologies. Combining multitouch screens with spacial detection technology like the the Kinect for example, can provide an experience that relates to the environment around it. Even though the experience may be centered around multitouch screens, projectors can be added to break the experience out of the screens and onto the surrounding space and even the users. The addition of these elements can help provide a unique and spatially relevant experience.
Twitter Interactive Window for Nordstrom’s Anniversary Sale
This weekend my development team at Nordstrom launched a new interactive window. We focused on Twitter, displaying tweets from customers who use the hashtag #NSale. This window also utilizes the Kinect again as well as a technology called Arduino. The experience is comprised of an animated display featuring users’ tweets, which is projected on the back wall of the window. A Kinect is mounted in the ceiling and transmits data to a string of LED lights when a user approaches the window. The LED lights illuminate and follow the user as they move. Our goal with this project was to bring the conversation that occurs within the digital public space of Twitter, between Nordstrom and its customers, to a physical public space in the store. It will be up until the end of Nordstrom’s Anniversary Sale. So if you’re in Seattle, check it out and send the window a tweet.
Interactive light writing experience at Nordstrom’s flagship store, downtown Seattle
In my development team at work, we built an interactive light writing display. It uses an IR camera to detect objects in 3D space. Users just need to walk up, touch the window, and gesture across the window.
Use your Kinect with AS3 and Flash
I started experimenting with Microsoft’s Kinect today, for a project at work, and needed an easy way to get my Mac Pro to recognize and read from it. I tried an Xcode based solution that used OpenFrameworks, which is described here, and works great. However I was hoping for an Actionscript solution, which would be better for us at work given the skill set of the team. We came across a Japanese website that has a really easy solution for Flash Developers called flKinect, which uses a Cocoa based app in conjunction with Flash. So for anyone who was looking for a solution like that, you can check it out here: Kinect with AS3 and Flash
The NEXT Flash Builder Release
I’m a big fan of Flash Builder 4. I think Adobe got it right and improved upon Flex Builder 3 in ways that bring a lot of value to the platform. That said there is always room for growth, and Adobe is addressing that with a preview you can download now, of the next version of Flash Builder. This new version is in my opinion a step toward addressing the future of the Flash Development Platform, which I believe is in mobile applications. We’ve all been witness to the battle over Flash Player’s relevance within web pages, especially on iDevices, much of the controversy focused on the HTML5 standard. While HTML5 in reality will not become a standard for many years, it is safe to say that some of Flash’s traditional placements online, such as video, will begin to transition to that new standard. The Flash Platform has been around for a long time, and has a massive global development community. Just because HTML5 exists doesn’t mean all of those Actionscript developers are going to suddenly fall over themselves for Javascript or Objective C. Even Apple knows this, and recently back peddled on their stance regarding iPhone application development using third party technologies. Adobe announced that it would continue development on Flash support for iPhone app creation, also bringing it to Flash Builder. With this preview, Adobe has added the ability to produce a Google Android application, and has committed to adding support for iOS and Blackberry Tablet OS for the actual release. I think that touchscreen mobile devices are a perfect venue for the skill-set that most Actionscript developers possess. I certainly will not be surprised if Flash Builder 5 becomes the most popular mobile app development tool, regardless of what happens with HTML5 and Flash Player.
Facebook, Michael Buble, Nordstrom, Flash Builder 4
My team at work finished development last month on a Flash based photo mash-up tool. The user can assemble a photo from using their own content, or the Michael Bublé provided imagery (it was a product tie-in between Nordstrom and Michael Bublé). The results can be posted to your Facebook wall or saved to your desktop, all from within the tool. Upon its launch the experience was very successful and generated a lot of fun and positive responses from users. You can check it out here.
