Evaluation of Questionnaire and Testing

The main problems with the testing that we carried out was that we did not have a particularly large number of users (we had 7 respondants to the questionnaire) and these respondants were all from a similar background – 20-30 age range, mostly students who are “tech-savvy”. On the other hand, this group is likely to be an early adopter of the product. After reviewing and improving the design of the product, it would be a good idea to test it on a wider range of potential users to identify further problems; e.g. issues for users with visual impairments, elderly users or users with fat fingers.

 There was also some confusion from the test users who didn’t quite understand that this would be a touch-screen interface on a fridge – there were concerns that on small monitors the interface would take up too much of the screen, this wouldn’t be an issue as the prototype illustrates a piece of bespoke hardware running the software. It would have been beneficial if we had given a more in-depth introduction to the project and the exact nature of the prototype – it had been assumed that these test users would remember what we were talking about from a previous questionnaire.

Another issue was that we were unable to physically time people carrying out tasks. This was because the test users were not in the same physical location as us, as the prototype and questionnaire are both web-based. Also, the nature of our questions led to some respondants neglecting to give quantative or full answers. This made analysis more difficult and could be remedied by wording questions more carefully, adding addition questions specifically asking for certain data or only testing the prototype on users in the same physical location as us, so that we can resolve any confusion.

An additional effect of being in the same physical location as the testers, would be that the questionnaire could receive a different response when completed in the presence of human questioners, rather than a computer. Users are less likely to respond to “interviewer bias” when answering questions as all users will be asked the same questions in the same way. Additionally, users could be more honest when answering to a computer rather than a human, whose might respond negatively to a user’s opinion or disclose private information (http://www.surveysystem.com/sdesign.htm).

 Unfortunately, more detailed statistical analysis could not be carried out on our result set as the sample user group was too small for the results to be meaningful.

Prototype Analysis

Having created a prototype, we then polled a selection of potential users for the interactive fridge using this questionnaire. We assigned two tasks for the users to do, these were to find a recipe for pancakes from the computers internal database and to find out what produce the fridge was running low on. The results of these tasks will be used to help evaluate the interface design of the system. In addition to these two tasks, we asked the users to evaluate the functionality and design of the system.
Results:
1) “On a scale of 1 to 10, where 1 is “Not clear at all” and 10 is “Very Clear”, how clear is the main menu page?”

All of the test users found that the main page was clear & easy to understand. Some of the suggestions were:

  • As this is a touch-screen system, the buttons should be as large and as clear as possible to make use as easy as possible.
  • It would be beneficial to put a clock on the main menu.
  • The main page is under-used, it would be helpful for the system to give additional information on/next to the buttons, for example “a shepherds pie recipe suggestion” next to the recipe button.

All of the test users found that the main page was clear & easy to understand. Some of the suggestions were:
100% of the results rated the page as 8 out of 10 or above on clearness.
The mean result was 8.86, median 9, mode 8 (with a sample of 7 people).
The standard deviation was 0.83
From these results, we can conclude the main menu page has been well designed, however there is some further functionality that several users would have liked to have seen implemented.

All of the test users found that the main page was clear & easy to understand. Some of the suggestions were:100% of the results rated the page as 8 out of 10 or above on clearness.The mean result was 8.86, median 9, mode 8 (with a sample of 7 people).The standard deviation was 0.83From these results, we can conclude the main menu page has been well designed, however there is some further functionality that several users would have liked to have seen implemented.
2) “On a scale of 1 to 10, where 1 is “Very difficult” and 10 is “Very easy”, how easy was it to find a recipe for pancakes?”

Every user found this task extremely easy to achieve without prior knowledge of the system. It took a maximum of three clicks to locate the correct page.Every user found this task extremely easy to achieve without prior knowledge of the system. It took a maximum of three clicks to locate the correct page.
100% of the users rated the task as 10 our of 10 for ease of use.
The mean, median and modal results were 10 (with a sample of 7 people).
The standard deviation was 0
From these results, we can conclude the process used to find recopies was well designed.

Every user found this task extremely easy to achieve without prior knowledge of the system. It took a maximum of three clicks to locate the correct page.100% of the users rated the task as 10 our of 10 for ease of use.The mean, median and modal results were 10 (with a sample of 7 people).The standard deviation was 0From these results, we can conclude the process used to find recopies was well designed.
3) “On a scale of 1 to 10, where 1 is “Very difficult” and 10 is “Very easy”, how easy was it to find out what items you were running low on?”

There was a greater spread of results for this task, most of the users found the information in the end; several could not find it at all.

The mean was 5.14, the median was 6, and the mode was 1 (with a sample of 7 people).
The standard deviation was 2.90
A number of users believed the required page would be located in a different category, either the ‘inventory’ or ‘status’ pages. From these results, we can conclude that this information should be available in both places. According to the users, it should be located in the inventory as it is the most intuitive places to look. It should also be available on the shopping page so users can order what they are running low on.
4) The rest of the questions required qualitative answers, here are the general conclusions we have made from the results (available on the questionnaire results page):

  • As the design is to be implemented as a touch-screen system, the on-screen buttons should be as large as possible. The data-input interface should be made as easy as possible to use.
  • The need for the status page in its present format was often questioned as it ‘didn’t seem to really do anything’. To one user, its existence seemed only to provide a gimmick with the thermal imaging camera. (however this may provide a useful marketing strategy). To another user, it should have been easier to understand more explicit information regarding the temperature of individual compartments, rather than a colored image. One user suggested an overview of the information displayed on this page could be used as a ‘screen saver’ giving important information (such as the day, date & time, as well as current temperatures, meal suggestions and warning notices), rather than as a specific page the user has to manually navigate to. Fahrenheit and Celsius should be available as units for displaying the temperature to the user.
  • Several users found the recipe feature pointless as they either already have a range of recipes at their disposal in books, or were experimental cooks and don’t like using them. Another user would only want it if it only gave you suggestions based on the ingredients available to them from in the fridge. It would be helpful if these ingredients could be purchased in a job-lot if required. Users would like the ability to download more recipes from the internet and arrange them using their own categories.
    “What might be nifty, […], is the ability to get it to read the recipe to you, and set timers for stuff on it (eg, sauté the onions for x minutes. Press the button when you have started.” “The onions are sautéed. Take them off the heat now.”)
  •  The most popular feature was to sort via use-by date, as users liked to know what items should be used up first. This ties in with our original questionnaires results indicating people wish to reduce the amount of food they waste.
  • Several users raised the concern that manually removing items from the fridge’s database as they are used would require an excessive amount of work on a day to day level to be feasible. They would only use this feature if an automated system were implemented to keep track of food usage for them.
    This problem was not addressed in the prototype as the problem is related to the mechanical functionality of the fridge, rather than the management software designed. Previous ideas suggested for the fridge dealt with this problem by using pressure sensors and RFID tags to keep track of what was used. RFID’s were discounted as a number of people raised concerns over the potential invasion of privacy, abuse and other security problems.
  • A large number of users expressed the desire of remote access to the fridges database. This would be beneficial for users at the supermarket, or to help them plan what they are going to eat that evening. This functionality could be provided via the mobile phone network or an internet connection using an authentication system.
    A more accurate system for tracking exact quantities of the amount of produce stored within the fridge would be beneficial (e.g., the fridge may say you still have butter (enough for 1 sandwich, but not enough to bake a cake).

Web enabled fridge

But technology had run amok at the LG Electronics booth, where its $10,000 Web-enabled refrigerator lets you watch TV, download music from the Internet, leave messages, send and read e-mail, keep track of food supplies, order groceries online, conduct videoconferences, make two-way video phone calls and take still photographs (that’s me, smiling and waving in the photo at left). Aiieee! Stop!

Frigidaire is refining its prototype Electrolux “screen fridge,” which provides Internet access, a place to leave family messages, a way to order groceries online and a built-in video camera for personal messaging, among other things.

“The refrigerator is the center of the kitchen, and we want it to be the center of the home,” Mitchell said, a one-stop control center for the household. And there is something to be said for making maximum use of the one family appliance that is always on.

Being able to conduct video conferences and make two way video phone calls from your fridge seems a bit over the top, as does turning it into a giant camera. On the other hand, integrating tv, music and email as well as keeping track of food and being able to order it all seem fairly useful – many kitchens have radios and televisions in them already.

http://www.sptimes.com/News/051901/Homeandgarden/Gourmet_gear__Look_wh.shtml

Most commonly suggested features from our questionnaire:

  • As peoples food keeps freezing, the fridge should monitor the temperature of the food, Not the actual air temperature. (Idea: use a temperature-sensitive infa-red camera to monitor food temperature. Have several independantly controlled cooling elements distributed throughout the fridge. This would allow the contents of the fridge to be cooled evenly. Alternatively,install a fan inside the fridge to constantly circulate the air to avoid cool air pooling at the bottom and freezing things [in a simular way to how a fan oven creates a more even heat distribution in an oven].)
  • People want bigger fridges with more organised compartments. (Idea: Have seperate compartments within your fridge, which can be independantly temperature-controlled to refelct whats in it [eg: meat should be colder than cheese.] Making bigger fridges fit in the same space is just not feasable, so a more organised internal structure can increase the effective capacity without increasing overall size. Each shelf could be replaced with a slide-out draw. This would make it easier to get to the back of the fridge and would also mean the user would be less likely to forget that ‘thing’ at the back of the fridge as it was hidden by the cheese! As bottles of juice & milk, etc always take up more of the precious vertical fridge-door space, a series of vertical dispencers could be put in the door panel. These would be filled with your juice or milk and would more efficiently store the liquids. They would have to be removable to make them easy to refill or clean.
  • People accidentally leave the door open/the door does not shut properly. (Idea: if the fridge door is left open for more than 30 seconds/1 minute, an auidable alarm should sound to inform the owner that the fridge is still open. It could be annoying if it immediately sounds a loud noise after 1 mnute if the owner is still using it, so a gradually increasing alarm could be used or an alarm could sound only if the door is slightly open as opposed to fully open.)
  • Food keeps going off / running out. (Idea: Implement an RFID (or barcode) based inventory control system. This would keep track of the food in the fridge, along with its repsective use-by dates. This would only work on pre-purchased food in its original container. If food is decanted into another container or home-made food is stored in the fridge, RFID-programamble tuppaware containers could be used.) An RFID inventory could be used to automatically order food that is running out or going off. It would also allow the owner to view the contents of the fridge on a screen on the outside of the fridge door. This would save energy as you would have to open the fridge door as often.
  • Fridge should be easier to clean. (Idea: The shelves/draws should be removable. There should be a series of drainage channels in the sides/bottom of the fridge. These would collect any spillages or melted ice in the fridge and channel it to a removable drainage container. This would help reduce destroying food as ‘the milk accidentally leaked’ and make an integrated fridge/freezer easier to defrost.)
  • People want an un-interruptable power supply (UPS). This would help keep food fresh in a power cut, or if the house is on a coin-operated power supply/meter. (Ideas: A UPS could be very useful in tackeling those problems, however large PC UPS’s can usually only sustain a computer for 10 minutes so it is doubtful a fridge could be kept operating for a useful period of time without giving a substantial volume of the internal capacity over to a battery. It would be possible for the firdge to go into a ‘low power’ mode, keeping track of how long it had been without power. This would allow the owner to make a more educated decision on whether or not to throw away the contents of the fridge after a power cut. The fridge could have an integrated mobile phone circuit that could text the owner it its power supply is interrupted.)
  • Better fridge lighting. (Ideas: Have a greater selection of lights inside the fridge. Alternatively have the entire internal back panel of the firdge light up. An ultra-violet light could be installed in the fridge to light it up and would also prove to be an extremely effective anti-bacterial protection system.)

Intels Vision of an Intelligent Fridge as part of a house network

Article from 1998 about what the hitec home of last year (2005) would be like. intresting, and certainly all the technology is possible. leads me to wonder why it has not happened. perhaps people do not like to be overly reliant on technology. perhaps it is just no one has decided to develop it as a product.
http://www.theregister.co.uk/1998/09/15/intel_thinks_intelligent_fridge/

From reading this it gives some user stories, important factors to consider is that any technology must not artificially limit what the user can do. I also think users want items on demand without a wait, or they may prefer to go without.

From my personal experience i will rarely use my laptop (even if i have it on me) for a quick piece of information as it takes so long to boot it up. However i will use my pda for such purposes even thougth it has a small screen and fiddly interface because it is quicker and therefore more practicle.

However it is clear we could go so far as to produce a complete network solution for every aspect of a users life. This is possible using current technology (althougth cost is a factor). However i feel that for the aspects of this project trying such i thing might be too wide rangeing.

Maybe the problem with the view of the then future, it requires at lot of investment in technology and different pieces of technology within that. maybe users are only prepared to buy if they see a definite benefit from one product, and they would want such a system to be proven before investing. Who would want to invest £1000’s in a network the’re not even sure they’d use.
let me know any comments on what you think – Al

Tech Banzai – Expensive Ovens, Cheap Meals

Tech Banzai – Expensive Ovens, Cheap Meals

I’m not sure what use an internet controllable oven would be, though the idea of being able to see inside your fridge (rather than oven as jokingly mentioned at the end of the entry) while not in your house could be useful if you intend to pop to the shops after work or lectures and have internet access. Or at least have some link from the fridge to a mobile device that could provide you with a shopping list when you’re at the supermarket.

Of course, this only works if you’re not the kind of person who leaves their shopping lists/mobiles at home by mistake when going shopping.

Initial questionnaire

We conducted an initial survey to see what people thought about the idea of an intelligent fridge and what kind of features they would like to see in it.

So far, the main complaints that those who responded to the questionnaire had were that their fridge was not big enough (or had space for a certain shape of product) and that their food tended to freeze. These two points can sometimes be related – if the fridge is overstocked with food, items can freeze because there is not enough empty space to allow cold air in the fridge to circulate. Another complaint was that it was sometimes difficult to tell what was in the fridge – especially a problem for very full fridges, and things that were forgotten about because they were not easy to see often went “off”.

More on this questionnaire later.

Scenarios

Student house – Student takes other persons milk out of the fridge. Audible message warns that its not their milk, also tells the milks owner that the other person took their milk.

Ordering – Person takes juice out of the fridge, pours some and puts the juice back. The fridge keeps track of what is removed using RFID tags and keeps track of consumption by monitoring its weight. When the juice is running out, the fridge adds juice to the shopping list.

Cooking – Parent comes home from work. The fridge will present them with a choice of meals based on what is in the fridge in order of cooking time.

Special Occasions – For a Christmas meal, the fridge will present a range of choices. The owner selects a choice, the fridge orders the food. When required, the fridge will then show the user how to prepare and cook the food. Can be presented as a video, or just audio if the cook does not want to keep looking at the fridge.

Safety – If their is a food safety scare, the fridge will update this information off the internet and inform the household that the dangerous food should be thrown out.

Ordering – When ordering the weekly shop, the fridge presents you with current offers that you may be interested in based on your previous orders.