🚀 SATA Formats Gallery

15 Next-Generation Assessment Formats for Adaptive Learning

15
Formats
100%
LLM-Powered
IRT
Compatible
∞
Possibilities

Transforming SBCAT Assessment

Welcome to the SATA Formats Gallery – a showcase of 15 innovative "Select All That Apply" question formats that transform traditional multiple-choice assessments into engaging, diagnostic, and authentic evaluation experiences. Each format maintains psychometric rigor while dramatically improving engagement, diagnostic value, and alignment with real-world professional competencies. Explore fully interactive examples (1-5) and discover specifications for advanced formats (6-15) ready for implementation in UALS.

📖 Comprehensive SATA Guide

Deep dive into assessment theories, domain specificity, research foundations, and best practices for each format

Explore Assessment Theory & Research Guide

🎯 Formats by Category

Choose formats based on assessment goals and cognitive complexity

🏗️ Foundational Assessment

3 Formats
#1 Classic SATA #2 Weighted SATA #10 Minimum Threshold SATA

🧠 Advanced Cognition

3 Formats
#5 Confidence-Weighted SATA #6 Evidence-Based SATA #15 Meta-Cognitive SATA

📊 Organizational & Classification

3 Formats
#3 Categorization SATA #4 Priority Ranking SATA #11 Elimination SATA

🪜 Scaffolded & Progressive

2 Formats
#7 Tiered Progressive SATA #9 Scenario-Progressive SATA

🌐 Context & Adaptation

2 Formats
#13 Context-Dependent SATA #14 Temporal SATA

🔷 Multi-Dimensional

2 Formats
#8 Matrix SATA #12 Collaborative Consensus SATA

📚 All 15 SATA Formats

Format 01
Classic SATA
Standard "select all that apply" with unlimited options and multiple correct answers. Foundation format with flexible correct answer count (2-5 from 5-10 options).
✅ Interactive Demo Easy Partial Credit
Format 02
Weighted SATA
Correct answers have different point values based on importance (Critical: 3pts, Important: 2pts, Relevant: 1pt). Reflects real-world priority setting.
✅ Interactive Demo Medium Priority Setting
Format 03
Categorization SATA
Drag-and-drop matrix where options must be categorized into 2-5 groups. Assesses understanding of relationships and classification.
✅ Interactive Demo Medium Multi-Concept
Format 04
Priority Ranking SATA
Two-phase assessment: First select all correct options, then rank them by priority/sequence/importance. Tests both knowledge and judgment.
✅ Interactive Demo Hard Ranking
Format 05
Confidence-Weighted SATA
Select correct options AND indicate confidence level (Very/Confident/Somewhat/Guessing). Assesses metacognition and calibration.
✅ Interactive Demo Medium Metacognitive
Format 06
Evidence-Based SATA
Must select options AND provide brief evidence/rationale (20-100 words) for each selection. AI-graded justifications prevent lucky guessing.
🔄 Specification Ready Hard Deep Reasoning
Format 07
Tiered Progressive SATA
Must correctly identify first tier to unlock second tier. Progressive revelation with 2-4 tiers tests scaffolded understanding.
🔄 Specification Ready Hard Scaffolded
Format 08
Matrix SATA
2D grid where rows and columns represent different dimensions. Select all applicable cells (e.g., reaction types × conditions).
🔄 Specification Ready Hard 2D Assessment
Format 09
Scenario-Progressive SATA
Scenario evolves based on previous selections (3-5 phases). Dynamic branching logic creates personalized assessment paths.
🔄 Specification Ready Very Hard Branching
Format 10
Minimum Threshold SATA
Must select at least N correct options (e.g., 4 of 6) to demonstrate proficiency. Performance levels: Mastery/Proficient/Developing/Novice.
✅ Interactive Demo Medium Competency-Based
Format 11
Elimination SATA
Reverse selection: Identify all INCORRECT options to eliminate. Shifts cognitive mode to finding flaws rather than confirming correctness.
🔄 Specification Ready Medium Reverse Logic
Format 12
Collaborative Consensus SATA
Team members individually select, then discuss and reach consensus. Scores: individual (30%) + group (50%) + collaboration quality (20%).
🔄 Specification Ready Very Hard Team Assessment
Format 13
Context-Dependent SATA
Same options appear across 3-5 scenarios, but correct answers change based on context. Tests nuanced, context-aware reasoning.
🔄 Specification Ready Hard Contextual
Format 14
Temporal SATA
Correct answers change as virtual time progresses (Hour 1, Day 2, Week 1, Month 3). Assesses adaptive strategy evolution.
🔄 Specification Ready Very Hard Time-Based
Format 15
Meta-Cognitive SATA
Must select correct answers AND explain the reasoning chain connecting them (3+ steps). AI-assessed reasoning quality prevents lucky guessing.
🔄 Specification Ready Very Hard Reasoning Chains

🗺️ Implementation Roadmap

Phase 1: Foundation (Months 1-3)

Formats 1, 2, 10 - Classic SATA, Weighted SATA, Minimum Threshold SATA. Immediate improvement with minimal complexity.

Phase 2: Intermediate (Months 4-6)

Formats 3, 5, 11 - Add diagnostic power with Categorization, Confidence-Weighted, and Elimination SATA.

Phase 3: Advanced (Months 7-12)

Formats 4, 6, 8, 13 - Deploy Priority Ranking, Evidence-Based, Matrix, and Context-Dependent SATA.

Phase 4: Research (Year 2+)

Formats 7, 9, 12, 14, 15 - Cutting-edge Tiered Progressive, Scenario-Progressive, Collaborative, Temporal, Meta-Cognitive.

🎯 Why SATA Formats Matter

Psychometric Rigor: Each item assesses k concepts (one per correct option), reducing guessing and increasing discrimination.
Engagement: More interesting than repetitive MCQ – 15 varied formats prevent monotony.
Authenticity: Real-world problems rarely have single answers – SATA reflects professional complexity.
Efficiency: One SATA item ≈ 2-3 MCQ items in information value → 30% shorter tests.
Diagnostics: Incorrect selections reveal specific misconceptions for targeted remediation.

📖 Complete Documentation: See SBCAT_Variety_Form.md for full specifications, scoring algorithms, IRT models, and implementation guides.

Created with 🚀 by UALS Team | Next-Generation Adaptive Learning