app vs web sketch circles on index card with clock in between the apps loop

Developing sites and online applications (for example, Google Docs) is different in many ways to developing applications for desktop machines. Technological differences aside, there is the speed of iteration.

What drives this innovation:

    Usage data: Websites/web applications give developers continuos feedback on the parts of their UI used the most and how 

    Fast incremental updates: Updates can roll out many times a day with their impact measured empirically

    Mutation: Amazon.com randomly switches in slightly different sites to different people; this lets amazon.com practice Darwinian style evolution

    Survival of the Fittest: The hassle of switching to a competitors app is very low

Imagine if desktop apps had these advantages! I would love to know what parts of an application are used more than others, how people are using the application and how multiple UI designs compare. If webapps ever replace the majority of desktop applications, then this closed feedback loop and iterative improvement could be why.

On the flip-side, development tools for desktop applications have been a lot better in the past. But in the last 2 years we’ve seen an explosion of solutions; Microsoft’s Silverlight, Adobe’s Flash and Air platform, Objective-J (really impressive), Sproutcore.

 

In the middle of these two approaches is the iPhone:

    All applications auto-update 

    There is a low cost of entry and exit to applications, not as simple as typing in a new URL, but much easier than installing new software on your PC. Purchase effort is minimal

    iPhone apps are a smaller ‘canvas’ making it easier and faster for developers to improve and experiment

Perhaps iPhone will forecast the relative success of webapps/ ‘cloud computing’ as compared to desktop apps? Or perhaps all applications will grow to fit in between.

I don’t know about you, but I’d be happy to everyday wake up to a slightly improved desktop application for the sake of ongoing improvement. 

T-shirts on a shelf on a store

Once apon a time, I used to have a blog called Songcarver.com with a post titled ‘Search and Save are the same thing’ (or something like that). Some months ago, a spanner fell in the interwebatron works and the domain was rudely turned into an ad. But sometimes a lemon turns into lemonade — as I rewrite some of the better older posts, I get a chance to re-think them, and complete the picture. But first..

A True Story.

The details have been changed to protect the innocent. The computer, it turns out, is not one of them.

A few days ago, my wonderful girlfriend recounted an episode at work. See, she works at a large government organization which regulates governmental quality standards. I would say her workplace approximates the ‘average’ workplace; cubicles, slightly dated PC on every desk and a strict IT department. On this day, a colleague of hers, we’ll call her “Sally”, wanted to achieve a specific task. She wanted to issue a fine to the Bendy Paperclip Company Inc. for not including the regulated minimum number of bends in their paperclips. They were simply putting straight pieces of wire in a box and selling them as paperclips. Clearly an infringement form needed to be sent.

Sally knew there would probably be a standard form for this. She looked everywhere on the shared network drive, poking into all the places she would expect to find it; nothing. She tried some searches for ‘bends’, ‘bent’, ‘bending’ and found nothing relevant. She sighed. And commenced the epic task of creating a new infringement document from scratch.

“Hey, there’s already a form for that on the network” said co-worker Bob, peering over her cubicle.

“Oh, You suprised me!” uttered Sally. “So where is it?”

“It’s in the ‘Quality Infringement Notifications’ Folder”
“No it’s not.. I looked there” retorted Sally.
“Yes it is — look in inside the ‘Minor infringments’ folder inside that one’
“Ahh…”
“I called it ‘Insufficient Stationary Item Curvature Infringement’” he added

So, an hour of Sally’s time was wasted searching for, then commencing a fresh Infringement Document. An hour later Sally recounted the story to my girlfriend.

“And I looked everywhere, but it turned out Bob had called it ‘Insufficient Stationary Item Curvature’”
“.. and he put it here. Wait.. now it’s not in the Quality Infringement Notifications’ Folder…”

When recounting the event out loud, she forgot that the file in question was in a sub-folder of the one she was peering into. With some more frustrated searching, and wasted time, she eventually re-found the file.

This story makes me both mad and embarrassed to be a part of the community that has built the systems which give good, intelligent people such a hard time.

SIDENOTE: I’m not the only one who wondered that there must be a better way. Dr William Jones, of the Keeping Found Things Found research project wrote an in-depth book on the topic. I interviewed Dr Jones a while ago and hope to have that video interview up sometime soon on his research.

How Come Computer File Systems make it so hard to…well… file?

How did we get to this stage? The work done at Xerox Parc around 1973 started the trend towards the real-world metaphor of the desktop and filing system. And the people at Apple built heavily on these ideas to take them to the masses with the original Mac. And these systems in general worked well, as people dealt with dozens of files every day on their virtual desk.

Then as personal computers got bigger, and people got more connected, the number of files exploded. People now work daily with hundreds of files, not dozens. And the response I’ve seen to dealing with all these files has been Search, Scan and Preview. Today, in 2008, a Mac (or most PCs) will let you find a document containing any word in seconds. It will also let you preview almost any document instantly with a keystroke. Or, scroll through 1000’s of images on a single search screen, drawing from image files collated from hundreds of different folders.

It seems reasonable, given all this power that anybody should be able to find anything. But they can’t.

“I’m Looking for Something but I Don’t Know What it Looks Like”

We have only a handful of ways to help make a file findable. One is to put it somewhere where we will find it. Another is to name it so a search will find it, or we will recognize it when we see it. We can tag a file with certain words (this is rarely done) and we can color the file label (also rare).

label
Uploaded with plasq’s Skitch!

So lets look where the problem often starts. The save dialogue box:
Save Dialogue box

No longer are we in our comfortable desktop and multiple window filing view. We’ve been constrained into a tiny window, optimized for a 3-column view. Here we instantly lose the ability to place a file within a folder in a position of our choosing. We cannot tag or color label a file. The default size and view means we need to work harder if we want to see all the other files which will surround our brand new one; this means we lose much of the context of our file.

More importantly, here is where we see the first problem: If I name the file ‘Paperclips’, what happens if I already have a file called ‘Paperclips’? If it’s already in the same folder, I’ll get a warning, sure. But what if it’s not? Remember, our über-search capacity now transcends all folders to find us files everywhere and anywhere. We’ll now have two files which are named similarly, or potentially identically. The job of re-finding the file much more difficult.

How does this differ to the real world? Imagine you own a jewelry box, stuffed full of trinkets.
Jewerly box showing with hand putting hairclip into crowded box
In your hand is a special hair-clip you need for a big night out tomorrow. If you want to find it again quickly, this cluttered jewelery box may not be the place. You would want to put it to the side, or somewhere else. On a computer you simply don’t know how cluttered the box is. You just name a file something and hope it’s unique enough to stand out.

Every Save should Search.

Logically, Search and Save should be part of the same interaction. Whenever you Save, a matching search should run at the same time, to give you a sense of the ’space’. Are there already 100’s of files called “Business Spreadsheet” or similar? Perhaps you should add a few more words to the name. And if Save gave us back the ability to position files within folders, to tag, and to choose the color label, then we need to be made aware of these ’spaces’ too. The information space is defined and understood everytime you do something in it.

As often the case, the inverse is true.

Every Search should Save.

The idea that every search for something actually *creates* information is not new. The Google tech talks include a great video describing the work that Belgian information architect Paul Otlet did prior to WWII. He realized the value in capturing and categorizing the links between sources of information. Google of course has made it’s fortunes from this concept. Yet no such record exists on your desktop or laptop computer. Potentially, these paths can help us find what we seek, faster. These virtual goat-tracks might be created through time, pre-intsalled by the manufacturer or shared with others.

Search and Share.

Del.icio.us has become hugely successful by leveraging people’s experiences through ’social bookmarking’, which means you share and intersect your branches to information with others. The result is a powerful people-driven set of connections and paths between websites. In our real-world story, perhaps Sally could have found the file she was looking for, by simply following the footsteps in the sand? Perhaps she could have even *discovered* that the file existed, when her curiosity was aroused by a cacophony of footsteps leading off into another folder. There’s also a wealth of information in those paths. Who went where and when?

Footprints in the sand

How many of the files we have on our machines actually came from someone else? Perhaps someone emailed you some photos, or you downloaded a song from a your guitar playing friend’s website. Perhaps your sister sent a file transfer of a document of the family tree, or perhaps you have downloaded lots of shareware and it’s sitting in your Applications folder. All of these items posses a secret past, like most characters in an Agatha Christie murder-mystery. If we knew the past and the connections between them, we could better find what we’re looking for and also name and manage our own files in a way that helps us, and others navigate.

It’s said our social nature has been one of the reasons why we have got this far in evolution. In many ways we are cogs in a larger, cultural mind. Sometimes the ‘thought’ process is not within your head, but within the group of people you associate with. Your clan has it’s own thought process, which is independent of, and may be contradictory to, and of the individuals own thoughts. The ability to broadcast our everyday actions not only fulfills some basic need to express, but offers unexpected benefits. Keeping the concept of Share in the Save process means Bob can lean over the cubicle wall and help out pro-actively, if socially acceptable.

Suggest.

Sometimes we don’t know what we’re looking for. Maybe your computer could auto-suggest things to you?Of course, you may be dry-retching as Microsoft Clippy comes to mind. An annoying “cute” animated character which seemed to appear at the most unwelcome moments, with the most banal questions. But ‘Suggest’ doesn’t have to be that. Take two successful examples; the iTunes mini-store that sits at the bottom of the iTunes music player, and Amazon.com’s “Customers Who Bought This Item Also Bought..”
Amazon book store main view with discussed text highlighted.

This idea of a passive view which gently hints new directions has proven very successful. In our real-world example, once Sally had started typing up a new document, perhaps she could see that others had also written similar documents, saving her some effort.

What would a system that showed you your files without *any* cue be like? Well, you may already know, if you’ve ever set your screensaver to show photos. Ever remembered a fond moment when some sweet photo unexpectedly appeared? It’s logical to think the same approach could inspire and motivate in day-to-day work as well. (Hats off to my good friend Cris for this insight)

Combining Search•Save•Share•Suggest

Putting this all together, we can imagine a system where Search and Save are no longer two long-lost cousins.. but part of the one cohesive UI that is Search, Save, Share and Suggest. One would never be without the others:

When Searching: Save where you’ve been, leave trails. Suggest other related items on your computer or elsewhere. Share what you are looking for, other people can benefit or chime in with help. Content creators can see a need and fill it.

When Saving: Auto Search for similiar documents at time. Offer side suggestions with somewhat related content. Share your footsteps between folders and information places with others

When Sharing: Save your footprints and meta-information. Search for anything else relevant. Suggest similar shared ideas or files

When Suggesting: Save the paths you *don’t* take. Add Search to be able narrow your focus. Share the areas where you like hang out.

Any my questions to you are;

What else could this approach achieve? What is beyond Search•Save•Share•Suggest?

Theocacao: Odds and Ends for Aug 17 2008
Uploaded with plasq’s Skitch!

W00t. The wonderful blog by Scott Stevenson, Theocacao, has kindly mentioned UI and us. Scott is not only a respected pomaceeous developer, but also an entertaining blogger. One of these days I’ll get around to interviewing him.

FX on mouse

Yes! People play games. Computer+Video Games. Why aren’t they studied more in ’serious’ interaction design? The menu systems, sound and graphics and responsiveness of good games are often a world above anything on a desktop.

Microsoft’s Shane Morris has a nice short post on Gamer-influenced Design.

If you’re not a ‘gamer’, and I’m certainly not, then like me you’ll surely find some seriously good insight in the Play Value podcast series. Each show is personal, quick, well-produced and well researched. Skip some TV and watch this.

Games like the Nintendo Wii are finally pushing alternate controllers and contexts, whereas games like Grand Theft Audio IV are pushing consumer graphics and simulation technologies harder and harder.

I’ve recently started to seriously research (ie play) games with the intent to find fresh, brilliant UI designs and would love to hear from you if you have ideas.

Footprint
A recent post on the excellent A List Apart usability blog focussed on designing for the deaf, the *Deaf or the hearing impaired. There are some excellent writings on how to design for deaf and visually impaired people out there, so I’ll not go over that, except to say maybe they’re getting ignored.

A comment that caught my attention:

0.38% of America’s population is deaf. That’s 38 people in a stadium of 10,000, yet 50% of our time is spent blogging about them. I think if they spent as much time as we assume they do on the internet, they’d be insulted by all the wasted efforts. People already code sites with pure text/css now, and if there is Flash, it’s SIFR. I think this holy deaf talk is just trendy.

posted at 02:57 pm on August 12, 2008 by Michael Angeletti

There is something the poster is not realizing — we are all impaired to some amount. I realized this a few years ago as a musician, moving heavy amplifiers to gigs. Those little ramps that had been required by law (at least here in Australia) for wheelchairs were my saving grace.. instead of lifting the hefty equipment I could roll it into the building. It probably saved me more than once from back injury. And yet, there would be no way the institutions would have put in those ramps for my convenience.

And we are all time-impaired. If you compare iPhone’s interface to traditional PDA you’ll see that the iPhone usually has much larger, and easier to tap, targets and virtual buttons. Even with a stylus, most PDAs take a some very finite control. Fitts’ law of course tells us that the smaller the target is, the longer it will take to aquire, so the cost to the some of us who have full control over our finger dexterity is still TIME. And time is the one thing we cannot get back.

A final aspect, and I do mean final, is that we all lose some of our sensory capacity and dexterity as we age. The device that was once small and nifty becomes ‘fiddly’ and then ‘darling can you help me with this, I can’t do it anymore’. So any design that gracefully lets the sensory-impaired will also be helping you in future as you slowly decline!

Arg.. time for a positive note! What about those wheelchair ramps? What would be the design equivalent? I would *love* to offer captioning on the video interviews I post. That would mean I no longer discriminate against hearing impaired. But think of the side benefits:

    Scannable text — just read the bits if you don’t have time
    Searchable text. You, and Google can find any word spoken on a video. Think of all the great content locked up in YouTube because it’s not easily searchable
    Note-taking and quoting copy and paste
    Contexts. In the office and can’t make noise? You can watch with the sound down

I’ve looked around at possible services, for example everyzing.com but have found them cumbersome to use, and only partially accurate. Of course, machine translation of video audio is bad at this stage but I would happily make my own fixes to the text, and be happy for the community at large to make corrections.

But there are a host of improvements possible to current computer interaction. Grab any old person from your local retirement home and plonk them down in front of a computer, and watch them squint and possibly, curse the machine in front of them.

*Deaf, with a capital ‘D’ is how some hearing impaired people choose to define themselves, as a cultural group. They have a certain language (sign) speak cultural norms, and so forth