Blame
|
1 | <!-- Generated from applied-computing-au vic/unit3-4/sat/C09-2026 by port-reference-godot-to-wiki.py โ do not hand-edit; re-run the port. --> |
||||||
| 2 | # 9-1 Beta Testing Plan โ Worked Example (Godot Tetris) |
|||||||
| 3 | ||||||||
| 4 | > **How to use this:** this is a *completed* plan at the scale your SAT expects โ 3 testers, 3+ collection methods, a testing window of half a week plus a weekend. Read it beside `C091-Beta-Testing-Plan-Template.md` (same sections, filled in), then write the same kind of plan for **your** solution against **your** SRS. The ๐ก boxes explain what each section is doing for the score โ leave them out of your own plan. |
|||||||
| 5 | ||||||||
| 6 | --- |
|||||||
| 7 | ||||||||
| 8 | ## Beta Testing Plan For: |
|||||||
| 9 | ||||||||
| 10 | **Software Solution Name:** Godot Tetris โ a modern falling-blocks game (solo + two-player LAN versus), built in Godot 4.7 |
|||||||
| 11 | ||||||||
| 12 | **Target Users:** students aged 12โ18 who play casual games on school laptops; two players sharing a LAN for versus mode |
|||||||
| 13 | ||||||||
| 14 | --- |
|||||||
| 15 | ||||||||
| 16 | ## 1. Objective |
|||||||
| 17 | ||||||||
| 18 | **Primary Goal:** Confirm that the finished game is playable, understandable and stable in the hands of real players โ the interface reads clearly, the modern mechanics (hold, ghost piece, hard drop, wall kicks) behave as players expect, and a two-player LAN match runs start-to-finish without failure. |
|||||||
| 19 | ||||||||
| 20 | **Testing Focus:** |
|||||||
| 21 | ||||||||
| 22 | - [x] **Appearance** (interface design, visual consistency) |
|||||||
| 23 | - [x] **Functionality** (core features working correctly) |
|||||||
| 24 | - [x] **User Experience** (ease of use, workflow efficiency) |
|||||||
| 25 | - [x] **Performance** (speed, reliability, compatibility) |
|||||||
| 26 | ||||||||
| 27 | > ๐ก *The objective names the actual solution and what "working" means for it โ not "test the game to find bugs". It targets appearance AND functionality AND requirements: that's the 3โ4, 5โ6 and 7โ8 band behaviours in one sentence each.* |
|||||||
| 28 | ||||||||
| 29 | --- |
|||||||
| 30 | ||||||||
| 31 | ## 2. Test Scenarios |
|||||||
| 32 | ||||||||
| 33 | ### Scenario 1 โ Appearance Testing: "Can you read the board?" |
|||||||
| 34 | ||||||||
| 35 | *Targets SRS non-functional requirements: usability (visual clarity), consistency of the interface.* |
|||||||
| 36 | ||||||||
| 37 | Testers judge whether the play field, next-piece preview, hold slot, ghost piece, score and level display communicate without explanation. |
|||||||
| 38 | ||||||||
| 39 | **Detailed User Steps:** |
|||||||
| 40 | ||||||||
| 41 | - **Step 1 โ Preparation:** open the game on a school laptop; do not explain anything. |
|||||||
| 42 | - **Step 2 โ Starting Activity:** tester starts a solo game from the menu unaided. |
|||||||
| 43 | - **Step 3 โ During Activity:** after two minutes, tester points at each on-screen element and says what they think it shows (score, level, next piece, hold slot, ghost outline). |
|||||||
| 44 | - **Step 4 โ Ending Activity:** tester plays until game over and describes what the game-over screen tells them. |
|||||||
| 45 | - **Step 5 โ Post-Activity Review:** short survey items on visual clarity (1โ5 scales). |
|||||||
| 46 | ||||||||
| 47 | **Specific Feedback Points:** Was the ghost piece understood without being told? Is the hold slot's "once per piece" state visible? Does the score/level area draw attention when a level-up happens? |
|||||||
| 48 | ||||||||
| 49 | ### Scenario 2 โ Functionality Testing: "Do the mechanics do what players expect?" |
|||||||
| 50 | ||||||||
| 51 | *Targets SRS functional requirements: rotation with wall kicks (FR-3), hold (FR-5), hard/soft drop and scoring (FR-7), line clears and levelling (FR-8).* |
|||||||
| 52 | ||||||||
| 53 | **Detailed User Steps:** |
|||||||
| 54 | ||||||||
| 55 | - **Step 1 โ Preparation:** hand the tester the one-page controls card (โ/โ move, โ soft drop, โ/X and Z rotate, Space hard drop, C/Shift hold). |
|||||||
| 56 | - **Step 2 โ Starting Activity:** tester attempts each control once in their first game. |
|||||||
| 57 | - **Step 3 โ During Activity:** set tasks โ rotate a piece flush against the wall (wall kick), hold a piece and retrieve it, clear two lines with one drop, reach level 2. |
|||||||
| 58 | - **Step 4 โ Ending Activity:** observer checks the final score against the scoring table (100/300/500/800 ร level, +1 per soft-drop cell, +2 per hard-drop cell). |
|||||||
| 59 | - **Step 5 โ Post-Activity Review:** tester reports anything that "felt wrong" (a rotation that refused, a piece that locked too early, a hold that didn't respond). |
|||||||
| 60 | ||||||||
| 61 | **Specific Feedback Points:** Did any rotation near the wall surprise the tester? Did the 0.5 s lock delay feel fair or frustrating at speed? Did the displayed score match the events observed? |
|||||||
| 62 | ||||||||
| 63 | ### Scenario 3 โ User Experience Testing: "A full versus match, cold" |
|||||||
| 64 | ||||||||
| 65 | *Targets UX characteristics: learnability, efficiency, error tolerance. Targets SRS reliability requirement: a LAN session survives a complete match.* |
|||||||
| 66 | ||||||||
| 67 | **Detailed User Steps:** |
|||||||
| 68 | ||||||||
| 69 | - **Step 1 โ Preparation:** two testers, two laptops, same LAN; neither has played versus mode. |
|||||||
| 70 | - **Step 2 โ Starting Activity:** testers follow the lobby screen to connect to each other unaided (host + join). |
|||||||
| 71 | - **Step 3 โ During Activity:** play one full match; observer logs any confusion, disconnection, or garbage-row event the players don't understand. |
|||||||
| 72 | - **Step 4 โ Ending Activity:** the match ends; testers state who won and how they know. |
|||||||
| 73 | - **Step 5 โ Post-Activity Review:** paired interview โ what nearly stopped you, what would you change? |
|||||||
| 74 | ||||||||
| 75 | **Specific Feedback Points:** Time from "open game" to "match running" without help; whether incoming garbage rows read as an attack; whether the win/lose screen is unambiguous. |
|||||||
| 76 | ||||||||
| 77 | > ๐ก *Scenarios are real tasks with steps a stranger could run, not "click each button". Each names the FR/NFRs it exercises โ that's the 7โ8 band โ and Scenario 3 targets UX characteristics by name, which is the 9โ10 band behaviour.* |
|||||||
| 78 | ||||||||
| 79 | --- |
|||||||
| 80 | ||||||||
| 81 | ## 3. Potential Users |
|||||||
| 82 | ||||||||
| 83 | | User | Who are they? | Why selected? | Available when? | |
|||||||
| 84 | |------|---------------|---------------|-----------------| |
|||||||
| 85 | | **User 1** | Year 8 student, plays mobile puzzle games, has never played Tetris | Reads the interface with fresh eyes โ the learnability test can't be faked with an experienced player | Lunchtimes this week | |
|||||||
| 86 | | **User 2** | Year 11 student, experienced Tetris player (plays online guideline Tetris) | Knows how hold, ghost and wall kicks *should* behave, so deviations from expectations surface immediately | After school Thu/Fri | |
|||||||
| 87 | | **User 3** | Parent, plays no games, uses a laptop daily for work | Extreme-novice check on menus, controls card and game-over flow; also my weekend tester | Saturday | |
|||||||
| 88 | ||||||||
| 89 | **Why these users represent your target audience:** the target users are casual players on school laptops โ Users 1 and 2 bracket that range (novice โ expert), and User 3 tests whether the interface survives someone outside it. Users 1+2 together also form the LAN pair for Scenario 3. |
|||||||
| 90 | ||||||||
| 91 | > ๐ก *Each tester has a reason tied to what they reveal โ that's "explains why potential users have been selected" (5โ6 band). Role descriptions are fine; full names are not required.* |
|||||||
| 92 | ||||||||
| 93 | --- |
|||||||
| 94 | ||||||||
| 95 | ## 4. Methodology |
|||||||
| 96 | ||||||||
| 97 | ### User Recruitment: |
|||||||
| 98 | ||||||||
| 99 | Ask in person this week; confirm each session time by message the day before. Consent forms handed out and **signed before any session is recorded** โ no consent form, no session video. |
|||||||
| 100 | ||||||||
| 101 | ### Data Collection Methods: |
|||||||
| 102 | ||||||||
| 103 | - [x] **Direct observation** (watch users during testing) |
|||||||
| 104 | - [x] **Interviews** (verbal feedback sessions) |
|||||||
| 105 | - [x] **Surveys/questionnaires** (structured feedback forms) |
|||||||
| 106 | - [x] **Error logging** (track problems encountered) |
|||||||
| 107 | ||||||||
| 108 | ### How Results Will Be Collected: |
|||||||
| 109 | ||||||||
| 110 | **Method 1:** Observation sheet (printed, one per session) โ one row per event: time, what happened, tester reaction. |
|||||||
| 111 | ||||||||
| 112 | **Method 2:** Post-session survey (Google Form, 10 items: 1โ5 scales on clarity/controls/fun + two open questions) โ link sent as the session ends. |
|||||||
| 113 | ||||||||
| 114 | **Method 3:** Recorded interview (audio) using the six-question interview sheet; ~5 minutes per tester. |
|||||||
| 115 | ||||||||
| 116 | **Method 4:** Error log (spreadsheet) โ every crash, disconnect, or "that's wrong" moment with steps to reproduce. |
|||||||
| 117 | ||||||||
| 118 | ### Data Validation Methods: |
|||||||
| 119 | ||||||||
| 120 | **Comparison Method:** survey answers cross-checked against what the observation sheet actually recorded โ a tester who rates controls 5/5 but fumbled hold for three pieces gets a follow-up question in the interview. |
|||||||
| 121 | ||||||||
| 122 | **Known Benchmarks:** final scores checked against the scoring table; gravity/level progression checked against the level formula (level = 1 + lines รท 10). |
|||||||
| 123 | ||||||||
| 124 | **External Validation:** User 2's expectations from mainstream guideline Tetris act as the reference for "standard" mechanic behaviour. |
|||||||
| 125 | ||||||||
| 126 | > ๐ก *Four methods, and every method names its instrument โ a survey that exists beats a "survey" that doesn't. Instruments must be ready before the first session: that's what the simulation checks.* |
|||||||
| 127 | ||||||||
| 128 | --- |
|||||||
| 129 | ||||||||
| 130 | ## 5. Timeline |
|||||||
| 131 | ||||||||
| 132 | | Phase | Duration | Activities | |
|||||||
| 133 | |-------|----------|------------| |
|||||||
| 134 | | **Setup** | ยฝ day | Print observation sheets + controls cards, build the survey form, collect signed consent forms, test the LAN pairing on two school laptops | |
|||||||
| 135 | | **Active Testing** | 3 days (two weekdays + Saturday) | Users 1 & 2 individually (Scenarios 1โ2), Users 1+2 paired (Scenario 3), User 3 on Saturday (Scenarios 1โ2) | |
|||||||
| 136 | | **Results & Feedback** | 1 day | File raw data into the evidence folder, complete the error log, write the deviation note | |
|||||||
| 137 | ||||||||
| 138 | > ๐ก *Total: half a week plus a weekend โ the scale the assessment expects. Three testers, four sessions. A 6-week 12-tester plan (like the EasyRetail commercial exemplar) would fail the "realistic for the window" check.* |
|||||||
| 139 | ||||||||
| 140 | --- |
|||||||
| 141 | ||||||||
| 142 | ## 6. Resources |
|||||||
| 143 | ||||||||
| 144 | ### Hardware/Software Requirements: |
|||||||
| 145 | ||||||||
| 146 | Two school laptops on the same LAN (versus needs both); the exported game build installed on each; any keyboard works โ controls use physical key positions, not letters. |
|||||||
| 147 | ||||||||
| 148 | ### Support Materials for Users: |
|||||||
| 149 | ||||||||
| 150 | One-page controls card; consent form; the tester never sees the code or the plan. |
|||||||
| 151 | ||||||||
| 152 | --- |
|||||||
| 153 | ||||||||
| 154 | ## 7. Success Criteria |
|||||||
| 155 | ||||||||
| 156 | ### Primary Success Measures: |
|||||||
| 157 | ||||||||
| 158 | - Every tester starts a solo game unaided in under 1 minute (learnability). |
|||||||
| 159 | - All set mechanic tasks (wall-kick rotation, hold, double line clear, reach level 2) completed by Users 1 and 2. |
|||||||
| 160 | - One full LAN versus match completes with no disconnection and an unambiguous result. |
|||||||
| 161 | - Displayed scores match the scoring table in every observed session. |
|||||||
| 162 | ||||||||
| 163 | ### User Satisfaction Targets: |
|||||||
| 164 | ||||||||
| 165 | - Visual clarity and controls both average โฅ 4/5 on the survey. |
|||||||
| 166 | - No tester abandons a session. |
|||||||
| 167 | ||||||||
| 168 | ### Decision Framework: |
|||||||
| 169 | ||||||||
| 170 | **What results would indicate success?** All primary measures met and the error log holds only minor items โ proceed to recommendations with priorities from the survey's open questions. |
|||||||
| 171 | ||||||||
| 172 | **What results would require major changes?** Any crash or LAN failure, a mechanic that confused both novice testers, or scores that don't match the table โ these become the top recommended modifications in the C9-3/C9-4 report. |
|||||||
| 173 | ||||||||
| 174 | > ๐ก *Success criteria are countable afterwards โ "โฅ 4/5", "under 1 minute", "no disconnection" โ so the report can say* whether *the test passed, not just how it felt.* |
|||||||
| 175 | ||||||||
| 176 | --- |
|||||||
| 177 | ||||||||
| 178 | ## Quality Checklist |
|||||||
| 179 | ||||||||
| 180 | **C9-1 Assessment Criteria:** |
|||||||
| 181 | ||||||||
| 182 | - [x] **C9-1-1:** Components clearly identified for testing |
|||||||
| 183 | - [x] **C9-1-3:** Plan targets software appearance AND outlines potential users |
|||||||
| 184 | - [x] **C9-1-5:** Plan targets functionality AND explains why users were selected |
|||||||
| 185 | - [x] **C9-1-7:** Plan targets functional AND non-functional requirements AND documents how results will be collected |
|||||||
| 186 | - [x] **C9-1-9:** Test scenarios target user experience characteristics AND documentation is clear and concise |
|||||||
| 187 | ||||||||
| 188 | **Professional Standards:** |
|||||||
| 189 | ||||||||
| 190 | - [x] All user selections include clear rationale (**"why selected"**) |
|||||||
| 191 | - [x] Multiple data collection methods documented (**"how collected"**) |
|||||||
| 192 | - [x] Test scenarios focus on relevant characteristics of your software solution |
|||||||
| 193 | - [x] Timeline is realistic for user coordination and testing |
|||||||
| 194 | - [x] All sections completed with clear, professional information |
|||||||
