Written by Justin Mifsud

由賈斯汀·米夫蘇德 ( Justin Mifsud)撰寫

The mobile market is huge and growing at a very fast rate. With an estimated 4.5 billion subscribers worldwide, it is forecasted that the number of mobile phones will surpass the world population.

移動市場巨大，并且以非常快的速度增長。 據估計， 全球有45億用戶 ，移動電話的數量將超過世界人口 。

開始之前……關于本指南的幾句話 (Before Begin … A Couple of Words About This Guide)

As the title of this article says, this is a step-by-step guide. The reason why I went for such a structure is to provide you with completeness. You can often find articles that describe in detail a particular phase of mobile application usability testing. While these articles are great (so great that I have cited several of them in this guide), they’re often confusing for someone who is new in the area of mobile usability testing. This is where this article comes in.

就像本文的標題所說，這是一個循序漸進的指南 。 我之所以選擇這樣的結構，是為了為您提供完整的信息 。 您經常可以找到詳細描述移動應用程序可用性測試特定階段的文章。 盡管這些文章很棒(太好了，以至于我在本指南中引用了其中的幾篇文章)，但它們對于那些經常在移動可用性測試領域中嶄露頭角的人感到困惑。 這是本文的來龍去脈。

One note of caution: Before you start doing usability testing on mobiles, you should know how to design mobile interfaces based on best practices of mobile usability. If you don’t, I recommend you take the course Mobile User Experience (UX) Design (which also comes with an industry-recognized Course Certificate). Or you can buy a book on the topic.

注意事項之一 ：開始在移動設備上進行可用性測試之前，您應該知道如何基于移動設備可用性的最佳實踐來設計移動接口。 如果您不這樣做，我建議您參加“ 移動用戶體驗(UX)設計 ”課程(該課程還附帶行業認可的課程證書)。 或者，您可以購買有關該主題的書。

Alright. Let’s get started. First, let’s start with a question:

好的。 讓我們開始吧。 首先，讓我們從一個問題開始：

Question no. 1 — Do you need to read each step? No. If you feel confident about any section, feel free to skip it. Here is an index of the main sections of this guide:

問題編號 1-您需要閱讀每個步驟嗎？ 不。如果您對任何部分有信心，請隨時跳過。 以下是本指南主要部分的索引：

本指南的關鍵部分(TL; DR) (Key sections of this guide (TL;DR))

1. What is mobile application usability testing?

   什么是移動應用程序可用性測試？

2. Setting the objectives of the usability test

   設定可用性測試的目標

3. Creating the tasks that will be performed

   創建將要執行的任務

4. Creating the test documents

   創建測試文件

5. Finding and recruiting test participants

   尋找和招募測試參與者

6. Implementing the usability testing method

   實施可用性測試方法

7. Reporting usability test findings

   報告可用性測試結果

Question no. 2 — Can this guide be followed for testing the usability of mobile websites? Yes. The testing methodology is for mobile testing. It can be used for both mobile website testing and mobile application testing. I focused on mobile application usability testing because mobile applications are extremely popular (as will be explained in the next section) and also because it seems that the majority of articles, or at least those that I came across tend to focus more on mobile website testing.

問題編號 2-是否可以遵循此指南來測試移動網站的可用性？ 是。 測試方法適用于移動測試。 它可以用于移動網站測試和移動應用程序測試。 我之所以專注于移動應用程序可用性測試，是因為移動應用程序非常流行(將在下一部分中進行說明)，并且因為似乎大多數文章，或者至少我所遇到的文章傾向于將重點更多地放在移動網站測試上。

移動應用可用性 (Mobile Application Usability)

So let me kick off this guide with a question. What do phone users spend most of their time on? Interacting with mobile applications (or apps as most of us refer to them). Yes, you read that correctly. A recent study shows that phone users in the US spend 86% of their mobile usage time solely on apps. Another study actually calculated this figure to be as high as 89%. And taking this further, it has also been found that mobile users spend 80% of their mobile app usage time using just five apps (out of the total of 24 apps they typically use in a month).

因此，我先提出一個問題。 電話用戶大部分時間都花在什么上面？ 與移動應用程序 (或我們大多數人所指的應用程序)進行交互。 是的，你沒看錯。 最近的一項研究表明，美國的手機用戶將其手機使用時間的86％僅用于應用程序。 另一項研究實際上計算出該數字高達89％ 。 更進一步，還發現移動用戶僅使用五個應用程序 (他們通常一個月使用的24個應用程序中的80個)就花費了其移動應用程序使用時間的80％。

Thus it comes as no surprise that there has been an explosive increase in the number of phone applications especially those for games and social media. Forbes actually estimates that by next year, there will be almost 270 billion apps downloaded.

因此，不足為奇的是，電話應用程序的數量呈爆炸性增長，尤其是用于游戲和社交媒體的應用程序。 福布斯》實際上估計，到明年，將下載近2700億個應用程序 。

That being said, mobile phone applications are still restrained by the relatively small screen size and limited performance capabilities of the devices on which they run. It is true that phones have come a long way with larger screen sizes and increased processing capabilities. It is also true that mobile app design has evolved considerably. However, they lack the screen sizes and processing capabilities of larger devices such as laptops or desktop computers.

話雖如此，移動電話應用程序仍然受到屏幕尺寸相對較小以及運行它們的設備性能有限的限制。 的確，電話已經取得了長足的發展，它具有更大的屏幕尺寸和增強的處理能力。 確實， 移動應用程序設計已經發生了很大的變化。 但是，它們缺少大型設備(如筆記本電腦或臺式機)的屏幕尺寸和處理能力。

Research shows that usability is key for the success of mobile apps. In fact, a common trend among successful mobile phone applications is that they are perceive by users as being easy to learn, user-friendly and less time-consuming when completing tasks. Other researchers have actually identified a direct link between mobile application usability and user acceptance.

研究表明， 可用性是移動應用程序成功的關鍵 。 實際上， 成功的移動電話應用程序中的一個普遍趨勢是，用戶將其視為易于學習，用戶友好并且在完成任務時耗時更少。 其他研究人員實際上已經確定了移動應用程序可用性和用戶接受度之間的直接聯系 。

Despite the importance of mobile application usability, there is a lack of an agreed-upon list of guidelines. In this regard, the best way to evaluate the usability of mobile applications is through usability testing.

盡管移動應用程序可用性很重要，但是缺少一致同意的準則列表。 在這方面，評估移動應用程序可用性的最佳方法是通過可用性測試 。

移動應用程序可用性測試 (Mobile Application Usability Testing)

Way before you start thinking about what you will test and how, you need to devise a usability test plan. This serves as a blueprint for the actual test and although there is no specifically-set structure, it typically contains the following sections (Rubin et al. 2008):

在開始考慮要測試什么以及如何進行測試之前，您需要制定一個可用性測試計劃 。 這是實際測試的藍圖，盡管沒有專門設置的結構，但通常包含以下部分( Rubin等，2008 )：

1. Purpose, goals and objectives of the test
   測試的目的，目的和目的
2. Research questions
   研究問題
3. Participant characteristics
   參加者特征
4. Method (test design)
   方法(測試設計)
5. Task list
   任務列表
6. Test environment, equipment and logistics
   測試環境，設備和物流
7. Test facilitator role
   測試主持人角色
8. Data to be collected and evaluation measures
   收集數據和評估措施
9. Report content and presentation
   報告內容和演示

An interesting variant that can be very handy when testing mobile applications (due to the smaller teams involved) is the 1-page usability test plan proposed by David Travis from UserFocus.

測試移動應用程序時(由于涉及的團隊較小)，一個有趣的變體可能非常方便，它是UserFocus的David Travis提出的1頁可用性測試計劃 。

Based on the usability test plan, it can be stated that in order to test the usability of a mobile application, (apart from the application itself) you need the:

根據可用性測試計劃，可以說，為了測試移動應用程序的可用性，(除了應用程序本身)，您需要：

1. Objectives of the test
   測試目的
2. Tasks that will be performed
   將要執行的任務
3. Test Documents (content form, orientation script, pre & post-test questionnaires)
   測試文件(內容表，定向腳本，測試前和測試后的問卷)
4. Test Participants
   測試參加者
5. Test Method
   測試方法

1.可用性測試的目標 (1. The Objectives of the Usability Test)

The first step of any usability testing session is to set the goals straight. What questions do you want to answer with the usability test? What hypothesis do you want to test with the usability test?

任何可用性測試會議的第一步都是確定目標。 您想用可用性測試回答哪些問題？ 您想用可用性測試檢??驗什么假設？

So how does one set the goals? There are various ways one can do this. One handy technique that I use is a variaton of the methodology outlined by Michael Margolis from Google Ventures. This basically involves asking a number of questions (interviewing) to the app’s stakeholders (and that includes the development team behind it) to explore important areas:

那么如何設定目標呢？ 有多種方法可以做到這一點。 我使用的一種便捷技術是Google Ventures的Michael Margolis概述的方法的變體 。 這基本上涉及向應用程序的涉眾(包括其背后的開發團隊)詢問一些問題(采訪)，以探索重要領域：

• The app’s roadmap
  該應用程序的路線圖
• Users and markets for whom the app is targeted
  應用程序針對的用戶和市場
• The app’s competitors
  該應用程序的競爭對手
• Research that has already been done and other that the team requires
  研究已經完成，團隊需要進行其他研究
• The potential impact of the above research
  上述研究的潛在影響
• Timing and scope
  時間和范圍

The answers obtained from these interviews will give you two very important things:

從這些采訪中獲得的答案將為您提供兩件非常重要的事情：

1. What the stakeholders already know
   利益相關者已經知道了什么
2. What they would like to know
   他們想知道什么

Based on the answers given to the above questions, it is now easier to start identifying the goals and what usability metrics one should use to measure them.

根據對上述問題的答案，現在可以輕松地開始確定目標以及用于衡量目標的可用性指標 。

It is also very important that the identified goals are:

確定的目標也很重要：

• Specific
  具體
• Measurable
  可測的
• Prioritized
  優先

2.將要執行的任務 (2. The Tasks that will be Performed)

Once the objectives have been set, it is time to move to the next step — setting tasks. Tasks are typically just one sentence long and should consist of the interactions that need to be performed by the test users, example:

設定目標之后，就該進行下一步了- 設定 任務 。 任務通常只有一句話長，應該包括測試用戶需要執行的交互，例如：

• Register an account
  注冊帳號
• Sign into your account
  登錄到您的帳戶
• Upload a photo
  上傳一張照片
• Accept a friend request
  接受朋友的要求

Instead of asking the test user to perform a task and hence make them feel that they are being tested, tasks should be converted to task scenarios. These provide more context for why the participant is doing the task and hence look more like natural interations that a typical user will perform with your application. In this regard, the task scenarios that are set should be:

應將任務轉換為任務方案 ，而不是要求測試用戶執行任務，從而使他們感到自己正在接受測試。 這些為參與者為什么要執行任務提供了更多上下文，因此看起來更像是典型用戶將對您的應用程序執行的自然交互。 在這方面，設置的任務方案應為：

• Realistic, actionable and without any clues on how to perform the steps (Source)

  現實，可行且對如何執行這些步驟沒有任何線索( 來源 )

• Ordered in a sequence that ensures a smooth flow of the test session
  按順序訂購，以確保測試會話順利進行

• Tied to one or more objectives (Source)

  綁在一個或多個目標上( 來源 )

As with any form of testing, it is very important to perform a dry run of the usability test to ensure that the performance of the tasks will ultimately achieve the objectives that have been set.

與任何形式的測試一樣， 進行可用性測試的空運行非常重要，以確保任務的執行最終將實現已設定的目標。

3.可用性測試文件 (3. The Usability Test Documents)

There are a number of documents that you would need when conducting usability testing. While the number of documents and their content may vary, you would typically need the following:

進行可用性測試時，需要一些文檔。 盡管文檔的數量及其內容可能有所不同，但是您通常需要以下內容：

• Consent form: (for minors or adults)

  同意書 ：( 未成年人或成年人 )

• Post-test questionnaire: This content of this questionnaire can range from the two simple post-test questions recommended by Uxpert Jared Spool to standard questionnaires such as the Post-Study Usability Questionnaire (PSSUQ) or the System Usability Scale (SUS)

  測試后 問卷 ：此問卷的內容可以從Uxpert Jared Spool建議的兩個簡單的測試后問題到標準問卷，例如研究后可用性問卷(PSSUQ)或系統可用性量表(SUS)

For additional usability testing documents that you might find useful, please head over to the Usability.gov site.

有關其他有用的可用性測試文檔，請轉到Usability.gov網站 。

4.考試參加者 (4. The Test Participants)

The mobile application usability testing method that will be discussed in the next section is a user-oriented testing technique, meaning it involves real users undertaking realistic tasks that the app is intended to achieve. Although testing with real users is more resource-consuming, this realistic scenario tends to yield more accurate results.

下一節將討論的移動應用程序可用性測試方法是一種面向用戶的測試技術，這意味著它涉及實際用戶承擔應用程序要實現的現實任務。 盡管使用真實用戶進行測試會消耗更多資源，但是這種實際情況往往會產生更準確的結果。

Raluca Buidu from the Nielsen Norman Group recommends recruiting test participants who have been using their devices for at least 3 months. This would overcome any difficulties resulting from the usage of the device rather than the app itself. In addition to this, using the test participants’ own devices tends to reveal more issues since they will be using real devices rather than top-of-the-range devices and fast internet connections that are usually available in development environments.

尼爾森·諾曼集團(Nielsen Norman Group)的Raluca Buidu建議招募使用了至少3個月設備的測試參與者。 這樣可以克服由于使用設備而不是應用程序本身而引起的任何困難。 除此之外，使用測試參與者自己的設備往往會發現更多問題，因為他們將使用真實設備，而不是開發環境中通常使用的頂級設備和快速Internet連接。

There are several considerations that need to be taken when choosing the participants for a usability test. Participants must:

選擇可用性測試的參與者時，需要考慮幾個因素。 參加者必須：

• Be representative of the users for whom the app is intended (i.e. the target users)
  代表該應用程序所針對的用戶(即目標用戶)
• Own a device whose Operating System is the one on which the app is intended to run (including the appropriate version/s)
  擁有一臺設備，該設備的操作系統是應在其上運行該應用程序的操作系統(包括適當的版本)
• Be considered in terms of the stage at which the application is currently in. This may range from an app that is in its initial phases to one that has been already on the market for some time. In this regard factors such as confidentiality and the expertise that the test participants have with mobile applications could be crucial
  根據應用程序當前所處的階段來考慮。范圍可能從初始階段的應用程序到已經上市了一段時間的應用程序。 在這方面，測試參與者對移動應用程序的機密性和專業知識等因素可能至關重要。
• Be available at the time, place, frequency of the intended usability tests
  在預期的可用性測試的時間，地點，頻率上可用
• Agree to the compensation terms that you are offering (if any)
  同意您提供的補償條款(如果有)
• Be ready to sign a usability test participation consent form
  準備簽署可用性測試參與同意書

An effective technique to ensure that the right test participants are recruited is to build user personas and then use them to screen potential test participants in order to find the right candidates. This is applicable of course if you already have a pool of potential test participants at hand (e.g. your registered users) or if you want to perform the recruitment process yourself.

確保招募合適的測試參與者的有效技術是建立用戶角色 ，然后使用他們篩選潛在的測試參與者以找到合適的候選人。 如果您已經有一批潛在的測試參與者(例如您的注冊用戶)，或者您想自己執行招聘過程，那么這當然適用。

If you would like to outsource this process, there are several recruiting agencies that can do that for you. Which one to choose is entirely up to you as both methods are fine and both have their pros and cons. An interesting survey conducted by the Nielsen Norman Group) shows the following interesting findings:

如果您想將這一過程外包，那么有幾家招聘機構可以為您做到這一點。 選擇哪種方法完全取決于您，因為這兩種方法都不錯，而且各有利弊。 Nielsen Norman Group進行的一項有趣的調查顯示以下有趣的發現 ：

• Most companies recruit their own test participants
  大多數公司招募自己的測試參與者
• Recruiting agencies are quite expensive (approximately $84 per person if recruiting average consumers or students and approximately $161 per participant if recruiting high-end professionals)
  招聘機構非常昂貴(如果招聘普通消費者或學生，則大約為每人84美元；如果招聘高端專業人士，則大約為每位參與者161美元)
• Companies recruiting their own participants spend an average of 1.15hrs of staff time per participant recruited
  招募自己參與者的公司平均每位參與者花費1.15小時的員工時間

For additional detail on how to recruit participants for usability studies, please head over to these articles:

有關如何招募參與者進行可用性研究的更多詳細信息，請轉到以下文章：

• How to Recruit Participants for Usability Studies by Jakob Nielsen & Hinderer Sova

  Jakob Nielsen和Hinderer Sova 如何招募參加可用性研究的參與者

• Recruiting Usability Test Participants by Usability.gov

  通過Usability.gov 招募可用性測試參與者

• 6 Ways To Recruit Participants for Remote Usability Testing by Natalia Bruzi

  Natalia Bruzi 招募參加遠程可用性測試的6種方法

• 7 Ways To Find Users for Usability Testing by Jeff Sauro

  杰夫·薩羅(Jeff Sauro) 尋找可用性測試的7種方法

5.移動應用程序可用性測試方法 (5. The Mobile Application Usability Testing Methodology)

There are two main methods for conducting usability testing of mobile applications. Needless to say, each comes with its own set of advantages and disadvantages. These are:

進行移動應用程序可用性測試的主要方法有兩種。 不用說，每種方法都有其自己的優點和缺點。 這些是：

1. Laboratory-based usability testing
   基于實驗室的可用性測試
2. Remote usability testing
   遠程可用性測試

In this article, we will be using laboratory-based (or lab-based) usability testing. This testing method enables the testing of mobile applications by involving real users using real devices. In it, the evaluator (whose role will be explained below) has full control over the test and can easily set the tasks — thus enabling him/her to test all usability aspects. It has also been found to yield results that are more accurate and easier to understand. In fact, several usability experts such as Raluca Budiu from the Nielsen Norman Group and Jeff Sauro from MeasuringU recommend it as the preferred usability testing method for mobile.

在本文中，我們將使用基于實驗室的(或基于實驗室的)可用性測試。 這種測試方法通過讓使用真實設備的真實用戶參與，從而能夠測試移動應用程序。 在其中，評估者(其角色將在下面進行說明)可以完全控制測試，并且可以輕松設置任務-從而使他/她可以測試所有可用性方面。 還發現它可以產生更準確，更易于理解的結果。 實際上，諸如Nielsen Norman Group的Raluca Budiu和MeasurementU的 Jeff Sauro等幾位可用性專家將其推薦為移動設備的首選可用性測試方法。

基于實驗室的可用性測試的“組件” (The ‘Components’ of a Lab-based usability test)

Lab-based usability testing involves the observation of test participants performing assigned tasks using a mobile device in a setup similar to the one shown below:

基于實驗室的可用性測試涉及觀察測試參與者使用移動設備以類似于以下所示設置的方式執行分配的任務：

The above setup can be split into the following ‘components’:

上面的設置可以分為以下“組件”：

相機 (A) Camera)

There are two distinct camera setups. Luckily, both will help capture the users’ gestures.

有兩種不同的相機設置。 幸運的是，兩者都將有助于捕獲用戶的手勢。

1. Document / fixed-position cameras: The camera lies on a fixed point. (e.g. IPEVO’s Ziggi HD Plus)

   文檔/固定位置攝像機 ：攝像機位于固定點上。 (例如IPEVO的Ziggi HD Plus )

2. Cradle-based cameras / Mobile testing sleds: The camera is fixed to a cradle on which the mobile device is placed. The user then holds the cradle in his / her hand when performing the assigned tasks. There are a number of cameras that one can choose from such as Mr. Tappy and MOD 1000 to name a few. One can also find a number of DIY setups such as this one from Rik Williams who assembled a testing camera sled in just 15 minutes, using materials that are readily available in any office and Harry Brignull who built a testing sled for less than $8. Although DIY setups are relatively cheap and fast to build, they do have their own limitations that can affect the testing procedure such as unnecessary additional weight and less durability and portability than a professional testing sled. The advantage of using a cradle-based camera is that it allows users to operate their mobile device using natural movement — just like they would be using the app in real-life, unlike the fixed-position camera which confines the device to remain on a flat surface. Conversely, cradle-based testing sleds are sometimes criticised for the additional size and weight that they add to the device being used for testing, although the increased usage of lightweight material has minimized this.

   基于通訊座的相機/移動測試底座：相機固定在放置移動設備的通訊座上。 然后，用戶在執行分配的任務時將支架握在他/她的手中。 有許多攝像機可供選擇，例如Tappy先生和MOD 1000等 。 人們還可以找到許多DIY裝置， 例如 Rik Williams的裝置，它在短短15分鐘內組裝了一個測試相機底座，使用的材料在任何辦公室都可以買到； Harry Brignull則用不到8美元的價格制造了一個測試底座。 盡管DIY設置相對便宜且易于構建，但它們確實有其自身的局限性，可能會影響測試過程，例如不必要的額外重量以及比專業測試底座更少的耐用性和便攜性。 使用基于支架的攝像頭的優勢在于，它允許用戶自然移動來操作其移動設備-就像他們在現實生活中使用該應用程序一樣，不像固定位置攝像頭那樣將設備限制在手機上。平坦的表面。 相反，基于托架的測試底座有時會因其增加的尺寸和重量而被批評為用于測試的設備，盡管越來越多的輕質材料使這種情況最小化。

Wireless testing?: In a recent article on Smashing Magazine, Colman Walsh describe an interesting and cost-effective setup that makes use of Apple’s AirPlay technology. The reasoning behind it is that unlike document and cradle-based system, the testing equipment is entirely invisible to the test participant. Although it is not an ‘official’ testing methodology, the article is definitely worth a read.

無線測試？ ：在最近的Smashing Magazine文章中 ，科爾曼·沃爾什(Colman Walsh)描述了一種有趣且具有成本效益的設置，該設置利用了Apple的AirPlay技術。 其背后的原因是，與基于文檔和通訊座的系統不同，測試設備對于測試參與者而言是完全不可見的。 盡管這不是“官方”測試方法，但該文章絕對值得一讀。

B)網絡攝像頭(可選) (B) Webcam (Optional))

A webcam can be pointed towards the user’s face so as to provide an alternative view that can assist the interviewer in understanding the user’s interaction by capturing his/her facial expressions.

網絡攝像頭可以指向用戶的臉部，以便提供一種替代視圖，該視圖可以幫助采訪者通過捕獲他/她的面部表情來理解用戶的交互。

C)錄音軟件 (C) Recording software)

The recording software is needed to project the session onto the facilitator’s screen and ideally record it too in the process. Some software also allow the session to be projected in real-time on multiple screens via a network. This can be particularly useful when involving a number of stakeholders. Very often, both document cameras and cradle-based cameras come with their own software. If that is not the case, then there are some very good tools that one can use so it is entirely up to you which one to use. For instance Jeff Sauro from MeasuringU uses GoTo Meeting to save the audio and video as a compressed, shareable .wmv file and Camtasia to save the webcam video. One can also use WebEx or Morae although the price for the license is a bit on the high end.

需要使用錄制軟件將會話投射到主持人的屏幕上，并在過程中也理想地進行錄制。 一些軟件還允許通過網絡將會話實時投影到多個屏幕上。 當涉及多個利益相關者時，這尤其有用。 通常，文檔相機和基于支架的相機都隨附有自己的軟件。 如果不是這種情況，那么可以使用一些非常好的工具，因此完全由您決定使用哪種工具。 例如， MeasurementU的Jeff Sauro使用GoTo Meeting將音頻和視頻保存為壓縮的可共享.wmv文件，并使用Camtasia保存網絡攝像頭視頻。 盡管許可證的價格偏高，但也可以使用WebEx或Morae 。

D)考場 (D) Test venue)

Although it has traditionally been carried out in specialized usability testing labs, the availability of sophisticated technology at a reasonable price, means that one can now conduct this type of testing without the need for hiring specialized labs. If you are going to set up your own testing room, it is very important to ensure that there is adequate lighting that is ideally not right above the mobile device being used by the user since it can cause a glare on the screen.

盡管傳統上是在專門的可用性測試實驗室中進行的，但以合理的價格提供了先進的技術，這意味著人們現在可以進行這種類型的測試，而無需雇用專門的實驗室。 如果您要建立自己的測試室，確保有足夠的照明是非常重要的，理想情況下，照明不能恰好位于用戶正在使用的移動設備上方，因為這可能會在屏幕上造成眩光。

E)主持人 (E) Facilitator)

As the title implies, the role of the facilitator is to facilitate the testing process, that is, to ensure that the test runs smoothly by addressing any issues that the test participant may have with the task being assigned or device they are using. Other than that, the role of the facilitator, who should ideally be a usability specialist, is to observe the test on their screen and ensure that the test participants perform the assigned tasks.

顧名思義，協調人的作用是簡化測試過程，即通過解決測試參與者分配的任務或他們使用的設備可能遇到的任何問題，確保測試順利進行。 除此之外，輔導員的角色(最好是可用性專家)應在屏幕上觀察測試并確保測試參與者執行指定的任務。

測試程序 (The Testing Procedure)

The testing procedure can be structured into 6 steps as shown below. The time next to each step is based on the typical time that each step takes as recommended by David Travis from UserFocus. If one adheres to these suggested times, then each session would take approximately an hour to conduct.

測試過程可以分為6個步驟，如下所示。 緊接每個步驟的時間取決于UserFocus 的David Travis推薦的每個步驟的典型時間。 如果遵守這些建議的時間，那么每節課大約需要一個小時來進行。

All of the above steps have been described earlier on. However, little has been said about step 6 — debriefing. Debriefing is a process that is undertaken at the end of each test session and it involves going through and analyzing the actions performed by the participant. Since the debriefing session is conducted with the participant, this provides additional insight on why that participant performed such actions. Thus, while the test session indicates the problems, it is the debriefing session that provides the insight on why those problems occured.

上面已經描述了所有上述步驟。 但是，關于步驟6的匯報很少。 匯報是在每個測試會話結束時進行的過程，它涉及檢查并分析參與者執行的操作。 由于匯報會話是與參與者進行的，因此可以進一步了解參與者為何執行此類操作。 因此，雖然測試會話指出了問題，但是匯報會話提供了有關為什么出現這些問題的見解。

報告可用性測試的結果 (Reporting the Results of the Usability Test)

After all the usability test sessions have been completed, you need to go through all the data, compile it, analyze it and present it in a way that it contains actionable recommendations.

在完成所有可用性測試會話之后，您需要遍歷所有數據，對其進行編譯，分析并以包含可操作建議的方式進行呈現。

First of all, the data needs to be split between quantitative and quantitative data.

首先，需要將數據分為定量數據和定量數據。

• Quantitative data from the testing session may be used to compute usability metrics such as completion rates, success rates, task times, satisfaction ratings and error rates.

  來自測試會話的定量數據可以用于計算可用性指標，例如完成率，成功率，任務時間，滿意度和錯誤率。

• Qualitative data can be compiled to provide insights about the paths taken by participants, problems experienced and answers that they provided in the questionnaire, post-test interview and debriefing sessions.

  可以匯編定性數據，以提供有關參與者采取的途徑，經歷的問題以及他們在問卷，測試后訪談和匯報會議中提供的答案的見解。

While there is no fixed structure for reporting, it is generally recommended to include the following sections:

雖然沒有固定的報告結構， 但通常建議包括以下部分：

1. Background summary: The application that was tested, where it was tested, what equipment was used, what was tested and who was the testing team.

   背景摘要 ：經過測試的應用程序，在哪里進行測試，使用了什么設備，經過了什么測試以及誰是測試團隊。

2. Methodology: How the test was conducted, task scenarios, metrics that were collected. Also include information about the test participants (brief summaries of demographic data — do not release any confidential data such as participant names).

   方法 ：測試的進行方式，任務場景，收集的指標。 還包括有關測試參與者的信息(人口統計數據摘要-請勿發布任何機密數據，例如參與者名稱)。

3. Test Results: The compiled qualitative and quantitative data together with an analysis of this data.

   測試結果 ：匯編的定性和定量數據以及對此數據的分析。

4. Findings and Recommendations: Based on the observations from point 3 (i.e. substantiated by data), provide a set of recommendations that one needs to implement in order to fix any usability issues that have been identified. However, do not just report the problems here. Be sure to highlight any findings that showed good usability.

   調查結果和建議 ：基于對第3點的觀察(即由數據證實)，提供了一組需要解決的建議，以解決已發現的任何可用性問題。 但是，不要僅在此處報告問題。 確保突出顯示任何顯示出良好可用性的發現。

結語 (Wrapping it Up)

As you can see, there is indeed a structured approach to mobile application usability testing. Better still, this approach can be tweaked to meet the needs of any application that is being tested and any stakeholder who is interested in the outcome of such tests. Moreover, the importance of usability testing, especially for mobile — with the large array of devices and their respective specs has long-been documented. This is why there is absolutely no excuse as to why, at this day and age, one should not conduct usability testing.

如您所見，確實存在一種用于移動應用程序可用性測試的結構化方法。 更好的是，可以對這種方法進行調整，以滿足正在測試的任何應用程序以及對此類測試的結果感興趣的任何利益相關者的需求。 此外，可用性測試的重要性，尤其是對于移動設備而言，具有大量的設備及其各自的規格，早已被證明。 這就是為什么絕對沒有借口在當今這個時代不應該進行可用性測試的原因。

想了解更多？ (Want to learn more?)

If you’re interested in mobile UX, then consider to take the course on Mobile User Experience, which includes templates you can use in your own projects. If, on the other hand, you’d like to…

如果您對移動UX感興趣，可以考慮參加“ 移動用戶體驗 ” 課程 ，其中包括您可以在自己的項目中使用的模板。 另一方面，如果您想...

1. learn all the details of Usability Testing
   了解可用性測試的所有詳細信息
2. get easy-to-use templates
   獲得易于使用的模板
3. learn how to properly quantify the usability of a system/service/product/app/etc
   了解如何正確量化系統/服務/產品/應用/等的可用性
4. learn how to communicate the result to your management
   了解如何將結果傳達給您的管理層

… then consider to take the online course Conducting Usability Testing.

…然后考慮參加在線課程“ 進行可用性測試” 。

Lastly, if you want to brush up on the basics of UX and Usability, then consider to take the online course on User Experience. Good luck on your learning journey!

最后，如果您想了解UX和可用性的基礎知識，請考慮參加“ 用戶體驗 ” 在線課程 。 祝您學習愉快！

(Lead image: Depositphotos)

(領導形象： Depositphotos )

Originally published at UsabilityGeek by Justin Mifsud, who is the founder of UsabilityGeek and has extensive experience with creating usable and memorable online experiences. Justin is also a visiting lecturer with the University of Hertfordshire and an expert reviewer at Smashing Magazine.

最初由Justin Mifsud在UsabilityGeek上發表，他是UsabilityGeek的創始人，在創建有用和令人難忘的在線體驗方面擁有豐富的經驗。 賈斯汀還是赫特福德郡大學的客座講師，也是《粉碎雜志》的專家審稿人。