A learner scores poorly on an online skills quiz. Was it the skills, or the test? A digital literacy assessment measures the ability to find, evaluate, create and communicate information, and it only counts if the test itself is usable with assistive technology.
For the wider setup of courses and platforms around a test, see our guide to accessible online learning tools.
What a digital literacy assessment measures
A digital literacy assessment measures applied ability, not familiarity with one brand of software. The American Library Association definition, quoted by TAO, describes the ability to use information and communication technologies to find, evaluate, create and communicate information. A state library guide words it as the ability to navigate, evaluate, create and share information effectively and critically. Good items test those verbs: judging a source, organising files, composing a message. They do not test where a menu sits.
Basic operating skills still matter, but as a readiness check rather than the thing being scored. TAO notes that missing basic technology skills can significantly hinder a student’s ability to participate in online testing. That is why many designers screen for keyboard navigation and toolbar familiarity before the scored items begin.
Common misreadings, corrected
| Misconception | What holds up | Planning use |
|---|---|---|
| It is a typing and mouse test | The definition centres on finding, evaluating, creating and communicating information. Keyboard and toolbar skills are prerequisites for taking an online test. | Check basic operation separately so a low score is not mistaken for weak judgement or content skills. |
| One score tells the whole story | The Skills Generation diagnostic evaluates candidates against 21 DigComp 2.2 competencies and groups questions into areas. Area 1 has six questions on everyday tasks such as locating trusted information. | Ask for results by area, so a weakness in one area is not hidden by strength in another. |
| A pass mark measures progress | The same diagnostic is a pass/fail design that requires a 100% score to show sufficient competence. Students who miss it may be asked to complete further support activities. | Use a gate like this for entry decisions. Pair it with a graded self-assessment when you want to show growth. |
Definitions and test design details come from TAO’s overview of digital literacy assessment and the Skills Generation diagnostic page.
The pass/fail pattern is the most misunderstood. A perfect-score threshold is a sensible gate for a course that assumes a baseline, but it says little about how far a candidate is from that baseline. Treat it as a screen, then use a finer tool to plan learning.
Choosing a framework to score results
DigComp is the most useful scoring frame when you need results broken into named competences. The European framework is described as an EU-wide tool that helps policy-makers formulate initiatives and supports the design of training. According to the Arqus Alliance summary of DigComp, version 2.2 is the latest release and updates the examples of knowledge, skills and attitudes. The framework identifies the key components of digital competence in 5 areas.
A different frame can suit a different job. The library self-assessment described below is based on a Digital Literacy Skills Framework and is organised around everyday computer tasks. Choose DigComp when results must feed into training design or sit alongside other frameworks. Choose the task-based library frame when the audience is new to computers and needs a plain starting point.
DigComp competences that matter most for assessment design
| Competence | What it covers | Planning use |
|---|---|---|
| 1.1 (Area 1, information and data literacy) | Articulating information needs | Search tasks where the learner must frame what they are looking for. |
| 1.2 Evaluating data, information and digital content | Analysing, comparing and critically evaluating the credibility and reliability of sources | Source-ranking items with a written justification. |
| 1.3 Managing data, information and digital content | Organising, storing and retrieving data, information and content in digital environments | File and folder tasks in a realistic workspace. |
| 4.3 Protecting health and well-being | Awareness of digital technologies for social well-being and social inclusion | Scenario questions on inclusive use of technology. |
| 5.2 | Adjusting and customising digital environments to personal needs, for example accessibility | Tasks that let a learner use their own settings and tools. |
| 5.4 Identifying digital competence gaps | Understanding where one’s own digital competence needs to be improved or updated | Self-reflection prompts that feed a learning plan. |
Competence wording is summarised from the Arqus Alliance DigComp page.
Whichever frame you pick, turn each competence into a rubric. A rubric lists observable behaviours at each performance level, so two scorers reading the same response reach the same judgement. Platforms such as TAO advertise rubric management and routing of responses to human graders, which matters for open tasks that a machine cannot mark.
Free and low-barrier tests compared
Two different kinds of test are worth comparing: a diagnostic that issues a verdict, and a self-assessment that places you on a scale. They answer different questions, so choose by purpose.
| Tool | Format and scope | Framework | Planning use |
|---|---|---|---|
| Skills Generation digital literacy diagnostic | Selectable-answer questions; the sample page shows a 25-question counter, with Area 1 mapped to DigComp 1.1, 1.2 and 1.3 | 21 DigComp 2.2 competencies | Entry screening where a clear pass or not-yet verdict is needed. |
| Library self-assessment based on Northstar | Modules in six areas: Basic Computer Use, Internet, Windows Operating System, Mac OS, Email and Word Processing | Digital Literacy Skills Framework (2020) | A personal check of current skill level, useful before choosing what to practise. |
Details come from the Skills Generation diagnostic page and the library guide to self-assessment tools.
How to take a test and get something useful from it
- Decide the purpose. Choose the diagnostic if you need a verdict for enrolment. Choose the self-assessment if you want a starting point for practice.
- Try your own setup first. Open the test with the browser, device and assistive tools you will really use, and confirm you can reach every control.
- Answer in the order given. The diagnostic asks you to select the correct answers to the questions in each section, so read each section’s instructions before starting.
- Record results by area. A total alone cannot tell you where to practise.
Organisations that want to build their own assessments can look at TAO’s Community Edition, a free open-source platform whose code you can install and customise.
Checking that the test works for assistive technology users
A test is accessible when a person using assistive technology can reach every question and every control, so that the score reflects skill rather than barriers. Treat this as a design check you run before scoring anyone.
- Test the test. Complete a sample item yourself with the screen reader, magnifier, switch device or voice control your candidates use. If you cannot finish it, a low score from them will mean little.
- Ask for specifics on vendor claims. TAO says its platform has WCAG-native accessibility embedded throughout. That is a vendor statement with no conformance level given, so ask which level applies and request evidence before relying on it.
- Let learners use their own settings. DigComp competence 5.2 treats adjusting digital environments to personal needs, accessibility included, as part of digital competence. A test that blocks personal adjustments penalises a skill the framework values.
- Keep access and skill apart. When basic technology skills are missing, participation in online testing suffers. Where a result looks surprisingly low, look at whether the interface got in the way before you conclude the skill is absent.
- Include inclusion in the content. DigComp 4.3 covers awareness of digital technologies for social well-being and inclusion, so items on this theme should not assume one way of using a device.
Where access is the problem, fix the delivery first and retest. A rescore on an accessible version is a fairer basis for any decision than a score you suspect was depressed by the interface.
Turning results into a learning plan
Results are most useful when they point to the next practice step. DigComp competence 5.4, understanding where one’s own competence needs improving or updating, is the model: use area-level results to choose a small number of gaps rather than trying to fix everything.
Match each gap to a concrete resource. If the gap is keyboard speed and accuracy, the sibling guide Typing Practice For Adults: A Practical 4-Week Plan To Boost Speed And Accuracy In 2026 – Internetbuttons gives a structured routine. If screen size or contrast was the barrier, set up a screen magnifier for online classes before retaking, so the next score reflects skill.
For candidates who miss a pass/fail threshold, the Skills Generation page says further support activities may be required. Plan those activities around the areas where answers were weakest, then retest in the same format so the comparison is like for like.
Frequently asked questions
| Question | Answer |
|---|---|
| What should a test-taker prepare before an online assessment? | Practise keyboard navigation and toolbar use, and learn how to activate audio or video controls, accessibility tools and dialogue boxes. TAO lists these as the basic skills that online testing assumes. |
| Does failing a diagnostic exclude someone? | Not necessarily. Skills Generation says students who do not meet its standard may be required to complete further support activities, which implies a route to retry rather than a final bar. |
| How is platform pricing usually structured? | TAO describes pricing tiers based on user volume, with a free open-source Community Edition for those who install and customise the code themselves. Check the vendor’s pricing page for current amounts. |