How do you know an automation is working?
Record a baseline before the pilot, then compare the same kind of work during testing. Assess quality and exceptions alongside time saved. These are suggested measures for a pilot, not claims about results achieved by RaySolutions clients.
Suggested pilot measures by workflow| Workflow | Measure the handling | Check the quality |
|---|
| Student enquiries | Staff handling time and time to a useful response | Answers supported by approved information; correct escalation of unanswered questions |
|---|
| Admissions documents | Time to prepare an application for staff review; follow-up effort | Extraction errors, missed documents and corrections requested by reviewers |
|---|
| Student requests | Time to reach the responsible team; number of handovers | Incorrect routing, duplicate tasks and requests returned for more information |
|---|
Include incomplete documents, questions outside the approved knowledge and requests that do not fit the usual categories. Agree with staff what a successful pilot must demonstrate before connecting it to a wider process.
See how to plan a focused pilot