Qpercom Administrator Quickstart Guide

Getting started

Logging in

Navigate to your organisation’s Qpercom URL — this generally follows the format example.qpercom.com. Enter your Identifier or registered email address along with your password and click Log in.

Changing your password or account details

Click your initials in the top right of the screen or navigate to Main >>> Manage Account. Specify your current password, enter a new password twice, and click Save. You can also use the Forgot password option on the login screen to reset via email, provided your user role is authorised to do so.

Usage tracking

View usage tracking on the homepage to monitor submitted scoresheets, video minutes, SMS messages, composition minutes, and portfolio uploads.

Organisation setup

Manage assessment periods

Navigate to Main >>> Manage Assessment Periods. Edit existing period names or date ranges, or click Add to create a new assessment period.

Manage organisation structure (fields and branches)

Navigate to Fields from the top menu to view existing fields and add new ones. Each field requires a unique identifier and name. Navigate to Fields >>> Branches to manage branches within each field — each branch also requires a unique identifier and name.

Manage competency frameworks

Navigate to Main >>> Admin Tools >>> Manage Competency Frameworks. Click Add Framework, give it a name and description, and save. Within each framework you can add competencies and sub-competencies and reorder them as required.

To make a competency framework available for blueprinting, navigate to Fields >>> Manage Branches and add the framework to the relevant branches. Once added, it will be available within scoresheet and question options.

Managing users

Administrators

Navigate to Users >>> Administrators to view, add, and update administrator accounts. You can specify a user’s role as Field Administrator and choose which fields that user will have access to manage.

Assessment team

Navigate to Users >>> Manage Assessment Team to manage team members. Use the search filters to find users quickly. Roles you can assign include Assessor, Assessment Administrator, Station Manager, and Actor.

To import a large number of assessment team members in bulk, navigate to Users >>> Import Assessment Team, download the CSV template, populate it with user information, and follow the on-screen steps to import. User records will be created or updated on completion.

Candidates

Navigate to Candidates >>> Manage Candidates to filter, view, and update existing candidate records. Manage levels and cohorts via Candidates >>> Manage Candidate Levels and Cohorts.

To import candidates, choose either the Custom Group Name CSV template for small groups or the Levels and Cohorts CSV template for larger cohorts. Import candidate profile images via Candidates >>> Import Candidate Images — images uploaded as a ZIP file will link automatically to candidate records and display during assessments.

Authoring assessment content

Scoresheet bank

Navigate to Assessments >>> Scoresheet Bank to add, edit, delete, and preview scoresheets. When clicking Add, choose from three scoresheet types:

Within any scoresheet, you can Clone existing sections or items to reuse scoring values and descriptors. You can also add instructions, media, content tags, and link competency frameworks via the scoresheet options page. Click Update for all changes to take effect.

Question bank

Navigate to Assessments >>> Question Bank to add, edit, delete, and preview individual questions for use in knowledge assessments. Search by keyword, scoresheet type, question type, competency framework, branch, period, or assessment event.

Options available per question include Duplicate, Manage, Preview, and View Performance. To view performance across multiple questions at once, select them and choose Questions Performance from the dropdown.

Managing assessments

Creating an assessment event

Navigate to Assessments >>> Management & Analysis and click Add. Specify a name and description and configure the following key settings:

• Type: OSCE, Interview, Self Assessment, or Knowledge Assessment
• Default Assessors: the number of assessor slots per station
• Is Remote or Controlled Assessment: set to Yes for remote delivery
• Is Accessible: set to Yes to allow participants to access the assessment
• Is Live Proctoring: enable to allow administrator monitoring of live sessions
• Second Camera Proctoring: enable to present candidates with a QR code for a second camera device
• Candidate Safe Exam Browser: enable to require candidates to access the assessment via Safe Exam Browser
• Show Countdown: displays a countdown timer to candidates during states
• Auto Configuration: ensure this is set to No for live remote assessments

Session and group setup

When setting up a live remote assessment, ensure the number of stations is balanced with the number of candidates in each group. You have two options for balancing:

• If you have more candidates than stations, add Rest Stations at appropriate positions on the circuit
• If you have more stations than candidates, add BLANK candidates to groups to balance the numbers

For assessments with multiple sessions, only the sessions being actively run need to be set to Accessible: Yes.

Adding media

Click the Upload icon, navigate to Media Centre from the main menu, or click Media Management within any scoresheet. Organise media within clearly labelled folders to make it easy to attach the correct file to each scenario.

Media can be linked in one of two ways:

• Attach to Station — available within that station for one assessment event only
• Attach to Scoresheet — available in all assessment events using that scoresheet

To make media shareable (i.e. available for the assessor to share with candidates on demand during a station), tick the Shareable checkbox when attaching.

Conduct assessment (updating scoresheets on behalf of an assessor)

Navigate to Conduct Assessment on the top menu. Select the Assessment Period, Branch, Assessment, Session, and Group. Choose the assessor name from the Assess as dropdown and select the submitted scoresheet to update marks or feedback comments.

Running a live assessment

Starting a session

1. 1Click Monitor Assessment Sessions and select Configuration to set timings, state names, and participant name visibility options.
2. 2From the session list, select the session you want to control.
3. 3The Monitor, Circuit Prompts, Candidate List, and Active Rooms tabs will load for the chosen session.
4. 4Use the State bar at the top to track the current group and state. Use the Change to next state control to progress participants through the circuit.
5. 5A clock is available on the left panel at all times. Use Reset Session if the session needs to be started over.

Monitor tab — scoresheet progress

The Monitor tab gives an overview of all station activity. Progress bars update in real time — check this at every checkpoint state to confirm scores are being submitted. Scoresheet states are colour coded:

Circuit tab — candidate overview

Each group and all candidates within are listed showing which station each candidate is in during each rotation. Click any candidate for more detail on assessors and candidate information. Toggle candidate IDs and names on or off using the Display checkboxes on the left panel. A green arrow in the Rotation column marks the current active rotation.

Circuit prompts

Use the Circuit Prompts tab to send messages to participants during a session. Create custom prompts, specify which participant roles receive them, and set prompts to send automatically at specified intervals within states.

Active rooms and recording

The Active Rooms tab shows all live video rooms. Click Record on any room to begin recording — a red recording icon will appear on that room’s tile. Click Stop Recording when appropriate. All recordings are stored in the Media Centre for post-event download and review. If second camera proctoring is enabled and recording is active, both camera feeds will be recorded.

Post-assessment: results and analysis

Accessing results

The results and analysis page becomes available as soon as an assessment event begins. The histogram icon will appear on the assessment list as soon as the first assessor starts entering scores. Click it to open the results page.

Standard setting — Angoff method

Prior to running advanced analysis, your assessment team may use the Angoff method to set expected pass marks. Enter cut score values per station on the Manage Stations page or on the Rules tab after the event has begun. Qpercom supports decimal precision of up to 3 decimal places for cut scores.

Advanced analysis — borderline regression

Click Advanced Analysis, enter an analysis name, and choose one of four borderline regression methods:

• Borderline group method — average of only those marked as Borderline
• Borderline regression method 1 — incorporates all marks assuming GRS values of 0=Fail, 1=Borderline, 2=Pass, 3=Good, 4=Excellent. Pair with a Fail / Borderline / Pass global rating scale.
• Borderline regression method 2 — uses the midpoint between Borderline Fail and Borderline Pass. Pair with a Fail / Borderline Fail / Borderline Pass / Pass global rating scale.
• Contrasting groups method — cut score is the median between the average of those who passed and those who failed

Cronbach’s Alpha and Standard Error of Measurement (SEM)

Include Cronbach’s Alpha values for your stations and choose an SEM option:

• SEM 1 — 68% confidence interval = SD × √(1 − Alpha)
• SEM 2 — 95% confidence interval = SD × √(1 − Alpha) × 1.96

The lower bound of the chosen SEM is used as an adjustment of the initial score or percentage.

Exam rules

Adjust the following five exam rules within your advanced analysis setup as appropriate:

• Calculate everything in: Percentages or Actual Scores
• Minimum number of stations to pass: disabled or a specified number
• Decimal precision: None, 1, 2, or 3 decimal places
• Multi-examiner scores per station: Aggregated or Averaged
• Overall cut score: default is the average of current station cut scores

Click Calculate — the system will fetch your analysis via R and return adjusted cut scores per station.

Exporting results

After completing the checklist and clicking Confirm & Publish, select the sheets you want to include and click Export to File to download results in MS Excel format. Raw results per station are available for immediate export. Note that data will export in the same order you have sorted it on screen, so sort before exporting if a specific order is required.

Deleting results

If you have sufficient administrator privileges, you can delete all results for an assessment:

1. 1Click the histogram icon for the assessment.
2. 2Check the Unlock Delete checkbox.
3. 3Click Delete, complete the confirmation prompts, enter your password, and click Delete again.

Candidate feedback

Generating and publishing feedback

Navigate to Assessments >>> Send Feedback. Choose an email template, select the assessment, and configure which feedback elements to include. Click Generate Feedback to produce personalised PDF reports for each selected candidate.

Preview any PDF to check the content, then either:

• Click Download Feedback (.ZIP) to save all reports to your device in bulk
• Click Publish to Candidate Portfolio to push reports to candidates’ Qpercom dashboards and email them directly

Feedback can also be downloaded for use in one-to-one discussions where you do not want candidates to retain a copy.

Viewing scoresheets as PDFs

Navigate to Manage Stations within your assessment and click Get Print Marking Sheets at the top of the screen. Select individual or all station scoresheets and click Generate PDF to download. Use this to print a small number of backup scoresheets in case of a network outage.

Appeals management

Candidates can now lodge appeals directly from their Qpercom dashboard, streamlining the process for both candidates and assessment teams. [Placeholder — add administrator steps for viewing, managing, and responding to candidate appeals once available from Qpercom.]

Audit trail

Navigating to the audit trail

1. 1Click Main >>> Admin Tools from the top menu.
2. 2Click View Audit Trail.

Searching the audit trail

The audit trail is most commonly used to check whether a candidate has requested a bypass or made it into their waiting area. Set the following filters before clicking Fetch Logs:

• Date Range — the more precise your window, the faster results will load. For a bypass check, set this to 30 minutes in the past to the present.
• Search keyword / user ID — enter the candidate’s user ID (UID).
• Results per page — default is 20. Increase if you need more entries returned.
• Categories — select both User and Application. Note that only User is selected by default — ensure Application is also checked.

Admin tools