← Selected work
Work
Enterprise Customer Success

User Acceptance Testing Program

Getting useful feedback from a sandbox build starts with telling people what a sandbox is.

UATRelease ReadinessClient Testing

Sanitized for publication. Company names, customer identities, and proprietary figures have been removed.

01

Purpose

Before a release reached hundreds of thousands of users, the client's own team needed to try it. Most of them had never installed a pre-release build. This work existed to make that possible without a support engineer on the phone for every tester.

02

The problem

The build under test was a pre-release version of a mobile application. Testers were installing it over old builds, hitting known environment limitations, and reporting them as defects. Real issues were getting buried under noise from the testing setup itself. Feedback arrived in whatever form each tester preferred, which made triage slow and inconsistent.

03

The thinking

  • Set expectations before instructions. If someone knows a feature may be inoperable in a test environment, they stop reporting it as a bug.
  • Housekeeping first. Removing the previous build prevents the single most common false failure.
  • Write per platform, in full, rather than one merged document with platform notes.
  • Include the awkward device steps that people get stuck on and quietly abandon.
  • Finish with a verified success state so a tester knows they are actually in the build being tested.
04

What was created

  1. 01

    A housekeeping and expectations section

    A short preamble explaining what a sandbox build is, what may not work in it, and what to do before installing.

  2. 02

    Platform-specific install paths

    Complete, separate walkthroughs per platform, including the trust and permission steps that are unfamiliar to most testers.

  3. 03

    A verified entry point

    A defined way for testers to reach the same starting state, so results were comparable rather than anecdotal.

  4. 04

    A defect-versus-environment filter

    Guidance on distinguishing an actual defect from a known limitation of the test environment before submitting it.

05

Selected artifacts

Figure 01 — Install path
ONE SCREEN, ONE STEP, ONE INSTRUCTION01Entry02Sign up03Set up04Verify05DoneWRITTEN FOR SOMEONE HOLDING A PHONE IN FRONT OF A WAITING CUSTOMER.
The same step-per-screen grammar used for staff enablement, applied to a technical audience that is not technical.

Shared framework · The same structure also supports Staff & Member Enablement Guides and Product & Dashboard Training.

06

What it informed

  • Made client testing cycles usable by shrinking the volume of false defects.
  • Gave release conversations a shared, verifiable starting point.
  • Reinforced a habit I have kept: define what counts as a real problem before asking people to look for problems.
07

Reflection

The instructions were the easy part. The part that mattered was writing down what the environment could not do, up front. Every hour spent setting expectations saved several hours of triage. What I would add now is a single structured way to submit findings, because free-form feedback is where good testing goes to die.

08

Related work