Friday, November 20, 2009

Microsoft Gives Away Touch Screen Laptops at PDC

Last year at PDC 2008, Microsoft gave all the attendies an external read-only harddrive with all of the software and presentations from PDC. It was nice, but this year was much better.

At PDC 2009 Microsoft gave away 11 inch Acer touch screen tablets to all "paying" attendees. With a custom BIOs its a one of a kind machine. That's pretty cool! Now I really wish I had gone.

By-the-way, I did receive my new ASUS Eee T91MT multi-touch tablet the other day from Amazon.com. It's much smaller than I imagined - the hand model in the Amazon.com picture must be one of Santa's thinner, smaller elves. I'm still playing around with it. I like the size but the multi-touch sensing accuracy could be a lot better.

This Blows

Natural User Interfaces can be really interesting when they leverage interactions that people use in every day life, but sometimes research in this area goes a little bit far afield. Here is one example, BAMB the "blow" user interface. I can't think of a single reasonable application for this.

A kind of Magic

I've written a lot about Magic as a metaphor for designing NUI applications. It started out with a series of blog posts:

Magic as a Metaphor for NUI Design: Part 1
Magic as a Metaphor for NUI Design: Part 2, Casting Spells
Magic as a Metaphor for NUI Design: Part 3, Enchanted Artifacts

Which is probably where I should have stopped since I pretty much said everything I wanted to say in those posts. But a couple months later I created a web site "dedicated" to the discussion of Magic as a metaphor for designing NUI applications called Magic.IO.

What I have discovered since creating that web site is that I don't really have much more to say on the subject. In addition, I've come to realize that unless you are creating a Harry Potter theme park designing computing devices to resemble magic artifacts is pretty pointless not to mention limiting.

The important point about magic and NUI is that NUI should feel like "A kind of magic". It should be invisible in terms of the mechanics but provide real value in terms of the results. The best example of a magical NUI experience, in my opinion, is Google's Voice Search application for the iPhone which I wrote about here. I love that application. My 4 year old son asked me a couple weeks ago, "how many teeth does an Elephant have?" I said, "I'll ask my phone". I repeated the question into the Google Voice Search application and abracadabra I had the answer (elephants have 4 teeth). Now that's magic.

What has been interesting, and this is surely due to the popular interest in the supernatural including everything from Harry Potter to Twilight series, is that the word magic is creeping up everywhere - I'm pretty sure that my own interest in magic as a metaphor is driven by the same popular culture. Western society has magic on the brain.

Anyway, my own conclusions is that a NUI experience has to be sort of magical in that it delights and provides value in some unique and unconventional manner. That's about as specific on the subject as I can get right now.

Other people are taking a stab at describing the relationship between magic - as in the magic of an illusionist - and NUI design including this thoughtful post by David Sherwin which was followed up by another interesting post by Josh Blake. While I was mainly concerned with the form factor of magic - how devices are designed and how you interact with them - David and Josh are more interested in the emotions evoked by magic tricks or illusions.

I suspect we have more in common than you can see on the surface, but I can't exactly put my finger on it. At any rate, NUI, as Queen said in the sound track of Highlander (one of my favorite movies), is "a kind of magic". I'm just not sure what kind it is. Is it magic in the fictional sense like Harry Potter or magic in sense of an illusionist? Perhaps its a little of both or something entirely new.

The Winner of the Microsoft Surface Design Contest

Microsoft announced User Interface Design GmbH (UID) is the winner of its "Touch First Developer Challenge", a Microsoft Surface design contest announced a while back and judged at the PDC 2009.

The UID application is an example of more display-ware which showcases UID's services as well as their design prowess. They have some really nice interactions and the aesthetics are excellent. Nice work guys.



In terms of showcasing their core competencies, multi-touch design, its an excellent application. In terms for providing anything other than a showcase of their work there's not much to see. While I really like their design I wish an application with more utility was chosen as a winner, but that's simply a reflection of my own person preference for applications that have real-world utility as apposed to display-ware.

It seems to me that there are very few real-world scenarios in which the Microsoft Surface makes a lot of sense. A variety of factors contribute to this: First and foremost, the form factor. A coffee table form factor is only appropriate for display-ware and home entertainment. Home entertainment is an interesting area, but given the Surface's high price its not going to see much traction in that market.

To make large horizontal multi-touch surfaces really useful they need to be higher and provide leg room so people can sit in a chair or on a stool and use them comfortably. There is only so much bending over from the couch a person is willing to endure. In addition, the price point needs to come down a lot. I've been pretty disappointed so far in the market for these devices both in terms of form factor and price points. Not just Surface, but all of the multi-touch tables available today.

Tuesday, November 17, 2009

Adobe Air 2.0 Beta Now Available

Today Adobe released the beta version of Adobe Air 2.0 and Flash 10.1 which support multi-touch. I discussed the beta in an earlier post.

As I said before (here and here), Adobe's entry into the multi-touch space in desktop, web and mobile is extremely important to the future of multi-touch in general.

You can access the Adobe Air 2.0 beta here.

HP Releases TouchSmart SDK

Yesterday, according to InformationWeek, HP announced the new HP TouchSmart SDK 3.0 which allows anyone to develop multi-touch applications for the TouchSmart shell - the shell currently holds specialized applications developed by HP.

What's nice is that the SDK integrates with VisualStudio so you can write your code in C# - a bit nicer than C/C++. What's not so nice is that you have buy the regular version of Microsoft VisualStudio 2008, sp1 in order to use - it won't work with the free Express version.

You can learn more about the new TouchSmart SDK at HP's TouchSmart Dev Zone.

Friday, November 13, 2009

SilverPac Multi-Touch Web Site is Cool

I'm a little late to the party on this one, but ciplex has created what is probably one of the first multi-touch web sites for devices larger than an iPhone. It was created for SilverPac and its interaction is pretty cool. The best thing to do, if you have a multi-touch computer is to first watch the video below to learn all the gestures and then try out the web site. It works flawlessly on my HP TouchSmart tx2.

According to one of the readers of this blog, ciplex used MIRIA SDK in combination with Silverlight 3 to achieve the multi-touch support. I like the design over all and I think its a wonderful start to a multi-touch web. Great work, ciplex!

MIRIA SDK adds Gesture Support to Silverlight 3

One of the things I love about writing this blog is the feedback I get from readers - especially when a reader can make me aware of some SDK, tool, device, or demo that I haven't seen. It's really great to share information in this way.

Earlier this week I posted a blog entry entitled "DIY: Multi-touch Gesture Recognition in Silverlight 3" where I explained that Silverlight 3 doesn't come with a gesture recognition engine, so you have to build one yourself. I also pointed to a couple of good articles on how to do this. Maxence Dislaire (gotactile) commented on that post providing a link to an open source project on CodePlex that provides a gesture recognition engine for Silverlight 3 on Windows 7 and even a TUIO bridge if you need one. The project is called MIRIA SDK and while I haven't tried it out myself, it looks like its worth looking into if you are doing multi-touch Silverlight 3 applications.

Thursday, November 12, 2009

Apple Applies for Pen-based Input Patent

I've been playing around with the Windows 7 pen-based input on my new HP TouchSmart tx2. Over all I've been pretty disappointed. I tried pen-based input a few years ago and it doesn't seem to have improved a whole lot since then. Although I submitted myself to the tedious task of "training" Windows 7 to my handwriting (I had to write 50 sentences verbatim into the system which took about 50 minutes) the handwriting recognition is still very unreliable. I have even attempted to write as clearly as possible and still have too many errors.

As I've said before, user interfaces for productivity applications should require some user training. Sadly, pen-based handwriting recognition on Windows 7 seems to be resistant my continuous efforts to train the machine and myself.

This is a disappointment to me not just because it doesn't work, but because it appears that pen-based handwriting recognition is still not ready for prime time. I've said many times on this blog that virtual keyboards will not work; that text input to devices should be through pen or speech or a standard keyboard. What I found, in reality, was that when I was in tablet mode, with the keyboard folded away, I frequently had to use the soft keyboard on the screen because the handwriting recognition with the pen was so bad.

I'm still convinced that multi-touch tablets and slates will not be successful for productivity applications if they don't support pen-based handwriting recognition. Using a soft keyboard is just too inconvenient. However, given what appears to the state of the art, I have less confidence than ever that the slates and tablets today will receive wide spread adoption outside the home entertainment market.

I had been thinking about the upcoming Apple Slate which is rumored to be announced, if not released, in Q1 2010. I believe that Apple will need to include pen-based input in their slate if they want it to be used for productivity applications. If they can raise the bar on handwriting recognition in the same way they have set the bar on multi-touch input, they'll have the slate market locked up for at least a couple of years.

So, you can imagine how pleased I was to learn from AppleInsider that Apple has submitted a new patent for pen-based input, called, "Method and Apparatus for Acquiring and Organizing Ink Information in Pen-Aware Computing Systems." I won't pretend to understand the patent in full, but it appears Apple has a new algorithm for interpreting handwriting that is based on whole phrases rather than pen strokes. Whether or not this will be superior to the current method used by, for example, Windows 7 I don't know, but I hope so.

Touch Screens for Drivers Not A Good Idea

While it's great to see so much enthusiasm around touch screens in everything from phones, to computers, to cameras - there are some place where at touch screen is just a bad idea (see this post).

The one I'm particularly worried about (OK, it doesn't keep me up at night but it's something I think about ) are touch screen devices for automobiles like this Tesla.

While a touch screen for the passengers could be cool - especially the kids in the back seat - the driver should be keeping his eye on the road. This is a case when physical knobs and dials, which can be manipulated by feel, are a much better option. We already know that texting and using mobile phones in cars is a bad idea, its not that much of a stretch to see the problem with dashboard touch screens.

One product which just came out seems to be an accident waiting to happen. It's a touch screen GPS navigation system built into a rear-view mirror (see this link). Talk about a really bad idea! First of all you have to look up at the mirror to see the GPS visuals. Second you have to reach up to input information. Third you can't interact with the GPS without looking at it. A GPS should be on the dashboard right within your field of view while driving and its should be voice activated - the slew of touch screen GPS devices is concerning. Lets focus on voice input, not touch screens for automobiles.

Wednesday, November 11, 2009

NUI meets Opera

I've never seen an Opera in my life - the opportunity just never presented itself - but I might fly to N.Y. just to see Metropolitan Opera's production of The Damnation of Faust. Why? Because it uses a huge interactive screen as a background.

The screen, which measures 60ft wide and 40ft tall relies on inferred emitters and cameras to track the movement of the singers. As singers move to certain locations the images on the huge screen change providing a digital set that looks - from the pictures - to be really beautiful. The giant screen not only reacts to the location and movement of performers, but also the music itself. No two performance will ever be the same because the interactions between the screen and the preformance is generated dynamically. Thanks to Pocket Lint for the story.

DIY: Multi-touch Gesture Recognition in Silverlight 3

Jesse Bishop has an interesting blog entry showing how to implement basic mult-touch gestures into your Silverlight 3 applications. Jesse's DIY (Do-it-Yourself) solution looks pretty solid but I haven't tried it myself so take that recommendation with a grain of salt.

Silverlight 3 comes with mutli-touch capabilities but none of the predefined gestures you would expect (pinch, rotate, move, etc.). I gave the folks at Adobe a hard time for their inability to support simultaneous gestures and touch input in the beta of Air - something I learned, with the help of Chris Cantrell, can be done with some custom development.

I would be remiss to give Silverlight 3 a pardon on the same topic. Why they could not build in simple support for basic gestures is beyond me - I suspect its a case of get-it-out-the-door as soon as possible.

Anyway, I'm very interested in developing multi-touch web interfaces which I plan to use on a site I've been developing, so being able to work on this now with Silverlight 3 is great. I haven't tried Jesse's custom gesture code, but it looks solid on the surface so I figured it was worth linking too. You can also learn about Silverlight 3's basic multi-touch contact support in a blog entry by Tim Heuer. It's also a good read and a nice primer for Jesse's blog.

Asus Eee PC T91MT: A $500 Multi-Touch Tablet

I've been playing around with my new HP TouchSmart tx2 for a couple of days now and while I'm generally satisfied I'm not not stoked. It works fairly well with touch and pen input, but the screen is really hazy due, I suspect, to the multi-touch screen layer. Also, the touch is not as responsive as I would like and the touch feedback could be better - its hard to tell if you touched the button or not.

My kids, who got a taste of it the day I received the TouchSmart, can't get enough of it. My son was knocking on my office door at 8 am yesterday asking if he could play with "Papa's new computer".

So, being stratified but not stoked, I decide to try my luck on another multi-touch PC, the Asus Eee PC T91MT which is a bit under powered but is dirt cheap. At $532.00 total (on Amazon.com) its a great deal. A couple of things I really like about the Asus Eee PC T91MT:

  • Price: at a little over $500.00 its a steal.
  • Screen Size: It has a small 8.9 inch screen, bigger than an iPhone, smaller than a notebook
  • It's under-powered: It's good to test your development projects on an underpowered unit.
If I prefer the Asus, I'll probably return the TouchSmart. If I prefer the TouchSmart I'll keep them both. If my wife finds out I just purchased another computer, I'll be in big trouble.

Tuesday, November 10, 2009

Kindle for the PC, Beta

Amazon today announced the release of Kindle for PC, Beta. I downloaded it and installed it on my HP TouchSmart tx2 and it worked great (see picture left). Placing the tablet in portrait mode works the best for me - I'm not sure how enjoyable this will be on a traditional PC or notebook.

A lot of the features that are really interesting are not enabled yet - it is a beta after all - such as taking notes and highlighting. I'm really looking forward to those things being added.

The reader displays pages nicely although my TouchSmart screen is less than crystal clear - it's manufactured with a hazy display which is probably the results of the pen and touch input layers.

A couple things became very apparent when using Kindle for PC. ePaper with its crisp text display is really a must for long term reading. Besides the TouchSmart's inherently poor display I find reading on any standard monitor a bit tiring after a while. The ability to take notes, bookmark, and highlight are pretty much a must have. I read a lot of technical books (e.g. "HCI Beyond the GUI" pictured here) and having those note taking abilities is critical to my work. For reading novels, bookmarks will probably be enough.

Just for fun I took another photo, using my iPhone, of my HP TouchSmart tx2 running Kindle for PC sitting on top of my Microsoft Surface. A set up only a multi-touch nerd can really appreciate. ;-)

Monday, November 9, 2009

Using Keyboards and Mice in Conjunction with Multi-Touch Tables

A reader pointed me to a video (see below) referenced by Johnny Chung Lee (a wonderful democratizer of NUI) showing how keyboards and mice might be combined with multi-touch tables in productivity applications.

The concept and video was created by Bjoern Hartman for UIST '09 (ACM Symposium on User Interface Software and Technology).

I've said a number of times (1, 2, 3, 4) that keyboard entry on a multi-touch surface just doesn't work. I've wondered how we can combine keyboards with large multi-touch surfaces for productivity applications but never really had any good ideas.

What this demo shows is that the keyboard and even a mouse can be made a tangible aspect of the multi-touch surface. By Tangible I means that the table recognizes the keyboard and mouse and based on how its manipulated, allows those devices to provide input. The way its used in this video is just awesome.

The keyboard sits on the table and can be assigned for data entry to any content by proximity. Dragging content so that it's adjacent to the keyboard allows the keyboard to provide data entry to that specific piece of content. The mouse interaction was also interesting. Place the mouse next to the keyboard and they can work together on that same piece of content. Better yet, use the mouse to manipulate objects on the multi-touch surface that are out of reach using a guide-line.

In terms of increasing the potential for productivity applications, I see this video and the work of Bjoern Hartman is extremely important; it will certainty influence my thinking about NUI productivity applications. Nice work, Bjoern!

Friday, November 6, 2009

Make Me Think! Emphasizing Efficiency over Discoverability

Today it is accepted as fact that the more intuitive a user interface, the better the user interface. Perhaps the most poinant realization of this is the popular book, "Don't Make Me Think!" in which the author emphasizes design of user interface that stress simplicity over complexity, the obvious over the obtuse, and discoverability over efficiency.

In a meeting with some Human Factors people a couple years ago I suggested that a particular feature for a productivity application would be more effective if users had just a little training in how to use it. The reaction from the Human Factors folks was warm, but condescending. "No", they explained speaking very slowly for my benefit, "if its not totally obvious than its not going to work." This is the kind of dogma I encounter on a regular basis and to be perfectly honest its placing sever limits on the potential of human-computer interaction.

To be clear, I agree that any application or web site that will be used infrequently by end users should be extremely simple to operate. You shouldn't have to be a rocket scientist to understand how to shop at the Gap.com. I also agree that the features used the most by beginners should be discoverable and obvious. You don't want people buying software or a device and having to study a manual to do the most common things. For example, if you buy a cell phone but can't figure out how to dial a phone number, the device is poorly designed.

Where I don't agree with the "Don't Make Me Think!" dogma is with productivity applications. Applications that are used every day by users to accomplish a task. In this case, its better to aim for efficiency than discoverability. Discoverability should be reserved for a very few features which are used most frequently by people new to the interface. Everything else in a productivity application should be designed for efficiency.

About a year and a half ago I wrote an article hosted on SYS-CON media entitled, "Engelbart's Usability Dilemma: Efficiency vs. Ease-of-Use" in which I talk about Douglas Engelbart - who invented the mouse, windows, word processing, and hyperlinks - and how his theory of human-computer interaction actually ran counter to the dogma of "Don't Make Me Think!". Engelbart invented the mouse through human-factors studies and chose it as the best pointing device not because it was the easiest to learn or the most discoverable, but because it was the most efficient. The same is true for word processing, hyperlinks, and windows which he and his research associates also invented. In my April 2008 article on Enelbart I wrote:

"According to Engelbart, in order to achieve the best human-computer symbiosis – an objective that is central to his Augmenting Intellect philosophy – users need to be trained to use the most efficient computer artifacts (e.g. pointing devices, keyboards, etc.). Engelbart did not believe that computers should be easy for novices to use; he believed that people would require lengthy training in order to be truly effective. Specifically, he wanted computer interactions to be based on systems that, with considerable training, were the most efficient – not the easiest to use."
This philosophy is the core of Engelbart's Dilemma. I explained this in that same article:

"Engelbart’s dilemma is that his philosophy produced some of the best computer technologies of our age (e.g. mouse, windows, word processing, etc.), but the full realization of his vision is completely counter to way interaction designers think of computers systems today. In fact, Engelbart's belief in efficiency over ease-of-use places him in the fringe of computer interaction design today. That’s sad considering he’s done more for interaction design than any else I can think of."

Today, Engelbart while revered is also regarded as somewhat of a "Crazy Professor" because although the rest of us have decided that discoverability is the most important aspect of UI design, he still believes that efficiency matters more than discoverability.

Although I'm not an extremist, I have to say that as I develop and design user interfaces I'm becoming more and more convinced that, at least for productivity applications, efficiency is far more important than discoverability. Call me an Engelbartean.

As an Engelbartean I'm very concerned that the designers of Natural User Interfaces are focused far too much on discoverability and not enough on efficiency. While it makes sense to design multi-touch tables and walls used in public venues so that they are as intuative as possible, that same design philosophy should not be applied to multi-touch productivity applications. While I agree that the tasks most commonly preformed by beginning users should be easily discoverable, I don't think that all tasks should be easily discoverable. For example, in the development of multi-touch applications the emphasis is on designing gestures that are as closely aligned with real-world gestures as possible. While this works well for some gestures, such as moving items on screen or scrolling by moving the page up with your finger, it doesn't apply to one of the most praised interactions, pinching and stretching. Pinching a photo to make it smaller or stretching to make it larger is not intuitive despite what people say. It's a very learned behavior. People don't expect to be able to resize things on screen with their fingers. Other than playdouh what do people pinch to make smaller in the real-world? This is not a discoverable gesture, its a learned gesture.

Now, just because a gesture or interaction method is learned doesn't mean it has to be difficult to preform. In fact, it should be easy to preform and it should provide the most efficient method for preform a specific kind of task. But learned interactions fly directly in the face of discoverability and that's what so interesting. Learned interactions, if designed properly, enable an extremely efficient and engaging human-computer interaction.

The proper way to design a human-computer interaction is to make a few things discoverable and totally intuitive, but only a few things. Only those things that user new to a productivity application would need to do right out of the box. Everything else should be emphasize the most efficient method of interaction in order to expose the greatest number of features and capabilities. If you can only use those features which are discoverable, than you are not going to be very productive in the long-term. Every tacit task requires a certain level of mastery in order to deal with the nuances of the real-world. Nothing is cut and dried.

Today, however, the idea that interactions should be learned; that we should emphasize efficiency over discoverability is heresy. If the method of interaction for a specific feature cannot be intuitive and discoverable, than the feature should not be included. The result of this kind of thinking is that the human-computer interface is becoming more discoverable and intuitive at the risk of also becoming less effective. Rather than trying to make people more powerful through software and devices, we are just catering to the lowest common denominator. We are designing tools for monkeys, not humans. In that April 2008 article I wrote in my conclusion:
I once heard or read (I can’t remember which) that Engelbart compared his interaction system to that of the violin. In essence, he said that the violin is an awkward instrument for novices but that, with training, a good musician can create incredibly beautiful music. My son trained in the violin for a couple of years, and I can attest to the amount of practice it took to master even simple melodies, but I’ve also seen good students play music that moved me more than any other instrument I have ever heard. Perhaps, like the violin, people could reach a new level of synergy with computers if they followed Engelbart’s philosophy and focused on efficiency over ease-of-use.

The truth is we may never know if Engelbart is right, because the computer is the province of the masses and not just expert users. If we were designing a musical instrument today, our focus on ease-of-use and learning would probably lead us to the kazoo rather than the violin.
A year and a half later I still believe what I wrote, but I think the situation is more dire than expressed in the quote above. I think if we were following the dogma of "Don't Make Me Think!" in the development of musical interments we would have stopped innovating after developing the hollow log drum.

Thursday, November 5, 2009

More on Microsoft's Courier

Gizmodo, a news source that is one of the best for gadget lovers, has a great scoop on the super-secret Microsoft tablet computer called Courier. I blogged about this before when it story first broke, and as excited as I was about the concept then I'm even more excited now. This thing, assuming its real, is extremely cool.

One of the best parts of it, in addition to supporting multi-touch, is that the "booklet" supports multi-modal pen input. I can't stress enough how important pen input is going to be in combination with multi-touch for tablets, slates, and booklets. It's critical. The combination of pen and touch is also critical to the success of larger productivity devices such as the drafting board which I've posted about a number of times.

Check out the new Gizmodo story and and watch a couple of videos (video, video) demonstrating the Microsoft Courier. If Courier is real and will become a product in 2010, than Apple had better out do this if it wants its forthcoming slate to succeed.

Is it just me or is Microsoft the epicenter of innovation in NUI?

Muscle Sensing NUI Input

Microsoft Research and the University of Washington teamed up to create a new input devices for Natural User Interfaces, the armband. The armband is an Electromyography (EMG) device which detects electrical signals from your forearm muscles as you move your fingers and press against objects. The video below provides a good explanation.

The band pictured left isn't the one developed by the researchers, its the Nike iPod Armband, but future versions of the research project could have applications in controlling devices like the iPod. In the video a jogger changes tracks on his iPod by simply touching his index finger and thumb together. Boy would I love to have that when running.

A while back I wrote about the power of combining control gloves with augmented reality glasses. I like this combination because it gives you the ability to interact with personal devices and your environment without having to be in a controlled environment, as is the case with Project Natal.

The thing I didn't like about the combination was the gloves and to a lesser extent the glasses. Who wants to walk around wearing a pair of gloves all the time? The armband developed by Microsoft and University of Washington can be worn under your cloths just below the elbow, so it can be hidden under cloths. It could also be decorative like jewelry. Imagine your iPod encased in decorative armbands: you could look like Space Ghost, a Roman gladiator or an Egyptian goddess.

In their research paper they talk about using EMG with a Microsoft Surface, which is mildly interesting but the bigger application is the ability to control devices with free-form gestures. The research paper makes it clear that there is a lot more work to be done, but this technology is only about five years away from having real commercial applications which makes it exciting.

Wednesday, November 4, 2009

Droid Does Support Multi-Touch

Rob Jackson editor at Phandroid, a Android news and fan site, says that Motorola's U.S. Droid phone does support multi-touch and he has the video to prove it.

Apparently, Droid's web browser doesn't support multi-touch but other applications created by third-party developers can provide multi-touch interactions. As proof Rob Jackson downloads, installs, and then proceeds to pinch and stretch images in the application called Picsay on the U.S. version of the Motorola's Android 2.0 phone, Droid. Nice work, Rob.

All I can say is two things: First, I'm relieved because I really wanted android phones to be multi-touch. I don't mind eating crow for blogging that it doesn't. Second, what is wrong with Motorola's PR department? This is the completely useless statement they gave to GearLog when asked yesterday if Droid supported multi-touch. Why didn't Motorola just say that the phone is multi-touch but the browser isn't?

Tuesday, November 3, 2009

Did Barnes & Nobel Steal Nook's Design from Spring Design?

Last month I wrote a blog post about the Barnes & Nobel much anticipated Nook eReader. As I said in the blog I think the idea of combining a color multi-touch screen with a ePaper was pretty smart stop-gap solution until ePaper can support multi-touch. I like innovative ideas like that, don't you?

So I was disappointed when I learned that Barnes & Noble may have stolen the design for a smaller company, Spring Design. Spring Design, according to this article had been working on the device since 2006. The resemblance between their design (shown left) and the Nook is beyond uncanny.

Barnes & Nobel was in talks with Spring Design and had a non-disclosure agreement on Spring Design's design well before introducing the Nook. Apparently, Spring Design has plenty of documentation to back that up.

If this is true, if B&N did steal the design, and only the courts or out-of-court settlements will tell us that, than I'm deeply disappointed in Barnes & Nobel. That was not very Noble of Barnes and Nobel. I shop there a lot and I was seriously considering buying a Nook myself. But when a big company takes advantage of a smaller innovator it really pisses me off.

If Barnes & Nobel did steal the design of the Nook from Spring Design, than I wish Spring Design all the luck in the world with regard to their lawsuit.

Monday, November 2, 2009

The Massive 100" Ideum Multi-Touch Table

Ideum has made good on a promise they made in June (see this post) to create a massive 100" multi-touch table. I covered one of Ideum's first multi-touch tables, mt2, back in February. At that time they were using the NUI Snowflake gesture engine and programming in Flash.

Assuming this new 100" table is also using Snowflake, it shows that if Adobe doesn't properly support mutli-touch (see this post) we can turn to the NUI Snowflake Suite to get what we want. The graphics are excellent and there is plenty of multi-touch and gesture operations taking place at the same time. Nice work, guys!

Some interesting details about the device can be found in this Engadget article.

Update

I sent Ideum an email asking if they used Snowflake again and this is the reply I got from Jim Spadaccini of Ideum.

"Yes. We used NUI Snowflake for tracking. The slight improvement in blob tracking comes from the fact that ...The computers are a bit better: Intel I7s whith 6 gigs of triple channel DDR RAM.

"Also, the table has two computers split the load for processing. One processes the 4 cameras and does the tracking. It spits out TUIO events--that the other computer consumes. This second computer then runs the program and powers the two projectors. The 50 points as opposed to around 40, comes from the fact that camera and tracking processing are separated from running the actual application."


European version of Droid is Multi-touch

Update 11/4/2009

Ignore this post and proceed to this blog post. I was wrong when I said below that Droid doesn't support multi-touch. At least I wasn't alone.




My brother-in-law was swooning over the new Droid phone, which is based on Android 2.0 (see blog post). He was going to get one and wanted to know how it stacked up to the iPhone. I lied. I said it was just as good. Sorry, Joe.

The fact is, that while the Droid is a pretty cool phone it doesn't support multi-touch. That's despite the fact that Android 2.0 supports up to three simultaneous contacts. That's not a huge deal on a mobile phone - as I've said before I'm not even sure multi-touch is necessary on a mobile phone. However, to me if you don't support multi-touch on your device than its simply doesn't stack up to a similar device that does.

OK. So, Droid doesn't support multi-touch. Big deal. It must be some technical-price issue right. Wrong. There are several articles (e.g. here and here) on the web today saying that the European version of the Droid will support multi-touch.

Why does the Europe version support multiple points of contact while the US version does not? The situation gives weight to some of the conspiracy theories around the US versions lack of multi-touch support (i.e. collusion between Google and Apple, fear of Apple multi-touch patent). Anyway, good to be a European if you are a fan of android, not so good if you are a US fan of android.

Update 11/3/2009

Here is a pretty good blog entry that explains the ins-and-outs of the multi-touch patent mess which is stifling the development of multi-touch devices. It contains a number links to equally interesting blog posts by others.

Adobe AIR 2.0 Support for Multi-touch Appears Broken

Adobe AIR 2.0 developer and evangelist, Christian Cantrell, reciently provided some insight into Adobe AIR 2.0's forthcoming support for multi-touch. I've been saying for months that Adobe needs to incorporate multi-touch support into Flash and Air - I can't think of many platforms I would rather work with than Flash and Multi-touch.

Sadly, it appears that Adobe will be providing a broken implemenation of multi-touch rather than something that is fully fushed out.

According to Christian Cantrell Adobe AIR 2.0 will support basic multi-touch events and Gestures, but not both at the same time. That means, for example, that you cannot pinch or rotate two different images at the same time. Adobe AIR 2.0 will only support either multiple touch points (touches interpreted as mouse click events) or a single gesture (e.g. pinching, rotating, stretching) at any moment in time. That's just weird in my opinion and very limiting. It makes me wonder what OS or hardware constraint prevents Adobe from supporting multiple simultaneous gestures?

It's my sincere hope that this is wrong; that Adobe AIR 2.0 will support multiple contacts and gestures simultaneously. If they don't, its going to be hard to recommend Adobe AIR 2.0 as a multi-touch development platform.