Requirement
Counselors may view only assigned student records.
Lesson A11.3
Threat modeling helps a software team understand what matters, where trust changes, what undesirable outcomes should be considered, which safeguards reduce those concerns, and where evidence or ownership is still missing.
This lesson is entirely defensive. You will analyze fictional architecture, requirements, trust boundaries, data flows, dependencies, assumptions, and supplied evidence. You will not scan, probe, exploit, or test a real application.
Lesson Progress
High School Advanced • A11: Secure Software Architecture • Lesson 3 of 10
Readiness Check
0/4 ready
Professional Hook
A fictional product team is preparing to add a scheduling integration to the Northbridge Student Services Portal. The team already has secure design requirements, but the new integration introduces an external service, a new data flow, a new dependency, and a new set of assumptions.
A weak review might ask, “Is the vendor secure?†A stronger threat model asks: What exact data leaves the application? Why is each field needed? Which system decides authorization? What happens if the vendor is unavailable? What should be logged? Who owns the dependency? What evidence supports those assumptions? Which future changes require renewed review?
A useful threat model does not predict everything. It helps the team make better security decisions before uncertainty becomes hidden risk.
Learning Objectives
Explain how software threat modeling supports secure design without becoming a vulnerability scan, exploit exercise, or prediction of every possible future event.
Identify assets, actors, trust boundaries, data flows, privileged actions, dependencies, assumptions, and important failure conditions in a fictional software design.
Write bounded threat statements that connect a condition, affected security property, possible impact, existing safeguards, evidence, and uncertainty.
Use secure design requirements from A11.2 as inputs to threat-model questions and mitigation decisions.
Build a professional software threat model that becomes the third artifact in the A11 Secure Software Design Assessment.
Why It Matters
A11.2 defined expected behavior. Threat modeling adds another layer: it asks where the design could fail to meet that expectation, whether safeguards are strong enough, and which assumptions deserve evidence.
Requirement
Counselors may view only assigned student records.
Threat question
What if the assignment source is stale, incorrect, unavailable, or interpreted differently by two services?
Design decision
Define the authoritative assignment source, failure behavior, logging, validation, and change triggers.
Core Framework
There are many professional threat-modeling methods. CyberShield uses a simple evidence-first workflow that emphasizes architecture, requirements, ownership, uncertainty, and defensive decision-making.
What architecture, release, change, or risk decision is this model supposed to support?
A threat model should have a purpose. Examples include reviewing a new privileged feature, a new external integration, a changed data flow, or a release design.
Who uses the software, what does it do, which data and actions matter, and which components participate?
Map users, services, identities, data stores, APIs, external services, administrative functions, queues, logs, and important operational dependencies.
Where does data, identity, or control cross between different trust assumptions?
Trust boundaries can exist between browser and service, service and database, application and vendor, normal and privileged workflow, or production and external systems.
What harmful or incorrect outcomes should the design prevent, detect, contain, or recover from?
Use outcome-focused questions such as unauthorized record access, incorrect privilege assignment, excess data sharing, missing audit evidence, unsafe dependency changes, or failure to recover.
Which current safeguards address the concern, and what evidence supports that claim?
Record existing controls, planned controls, validation evidence, monitoring, ownership, and limitations. Do not assume a control works simply because it appears on a diagram.
Which concerns deserve action first, and what should happen next?
Prioritize using business impact, exposure, privilege, sensitivity, control strength, evidence quality, dependency, and recovery difficulty—not dramatic wording alone.
What future changes should reopen the model?
New roles, data uses, dependencies, suppliers, deployment models, privileged actions, incidents, and recovery lessons can invalidate old assumptions.
System Model
A threat model becomes stronger when it is connected to a concrete software design instead of a generic list of threat categories.
Examples: Students, counselors, approved administrators, service accounts, support staff, external scheduling service.
Review question: Which actors should be able to perform which actions, and under what conditions?
Examples: Student-support records, appointment data, account state, authorization decisions, audit history, configuration, dependency metadata.
Review question: What information or capability would matter if exposed, changed, unavailable, or untraceable?
Examples: Browser client, application service, identity provider, authorization service, API layer, database, logging service, notification service.
Review question: Which component owns each security decision?
Examples: Identity claims to application, record requests to API, approved fields to scheduling integration, audit events to monitoring.
Review question: What data crosses each boundary and why is it needed?
Examples: User device to application, application to external vendor, standard user workflow to privileged administrative action.
Review question: Where do assumptions about identity, authorization, environment, or ownership change?
Examples: Account recovery, role changes, data export approval, configuration changes, access reassignment.
Review question: Which actions need stronger control, approval, evidence, and monitoring?
Examples: Identity provider, messaging library, scheduling vendor, build system, logging platform.
Review question: Which external or third-party components affect software security and lifecycle decisions?
Examples: Assignment source is accurate, disabled identities stop receiving sessions, vendor receives only approved fields.
Review question: Which beliefs are relied on but still need evidence or periodic review?
Vocabulary
A structured way to understand a system, ask what could go wrong, identify safeguards, prioritize concerns, and document uncertainty and ownership.
Information, capability, service, workflow, evidence, or trust relationship that matters to the organization or users.
A user, service, role, or external party that interacts with the software.
A point where identity, data, control, ownership, or environment moves between different trust assumptions.
The movement of information between actors, components, services, or storage locations.
An action with greater impact or authority, such as changing roles, recovering accounts, modifying configuration, or exporting broad data.
A bounded description connecting a condition, affected asset or action, possible security impact, safeguards, evidence, and uncertainty.
A safeguard or design change intended to reduce the likelihood or impact of a threat concern.
The risk remaining after existing and planned controls are considered.
A belief the design relies on that may need evidence, ownership, or future re-review.
A fact that is not established by the supplied evidence and should not be guessed.
A future change that should cause the threat model or a specific concern to be revisited.
Trust Boundaries
A trust boundary is not automatically dangerous. It simply marks a place where the design should make assumptions explicit. When data, identity, control, or ownership crosses the boundary, the software should know what it is trusting and why.
| Boundary | What crosses | Questions |
|---|---|---|
| Browser → Application | User session, requests, record references, submitted data | How is identity established? Which actions require authorization? What input is accepted? What errors are returned? |
| Application → Authorization Service | User identity, role, assignment, requested action, target reference | Which source is authoritative? What happens if the service is unavailable or data is stale? |
| Application → Database | Approved record queries and updates | Which data should be returned? Which service identity is used? How are privileged changes audited? |
| Application → Scheduling Vendor | Approved appointment fields | Why is each field needed? Who approved the purpose? What if the vendor requests additional data? |
| Application → Logging Platform | Audit events and operational telemetry | Which fields are required? Which secrets or private values are forbidden? Who can access the logs? |
| Standard Workflow → Privileged Workflow | Account recovery, role changes, broad exports, configuration actions | Which additional approval, authorization, logging, or separation-of-duty controls apply? |
Threat Statements
A safe threat statement describes an undesirable outcome and the conditions that make it worth reviewing. It does not teach someone how to cause that outcome.
What situation or design weakness creates the concern?
Example: If a counselor assignment is stale or incorrect...
What protected information, workflow, or capability could be affected?
Example: ...student-support records linked to assignment-based access...
Which property matters: confidentiality, integrity, availability, least privilege, privacy, auditability, resilience?
Example: ...could be exposed to a user without the intended assignment...
What business or user outcome could result?
Example: ...causing inappropriate access to private records and weakening trust in the authorization model.
What current requirement or design feature reduces the concern?
Example: REQ-AUTHZ-03 checks the approved assignment source through the central authorization service.
What evidence supports the safeguard and what remains Unknown?
Example: Current tests cover ordinary assignments, but no evidence is supplied for delayed assignment updates.
Combined example
If counselor assignments become stale, student-support records could be exposed to a user who no longer has the intended assignment, affecting privacy and least privilege. REQ-AUTHZ-03 and the central authorization service reduce this concern, but the supplied evidence does not show delayed-assignment behavior, so that part remains Unknown.
Fake Dashboard
Fictional design-review data only
Modeled concerns
16
7 Confirmed, 5 Conditional, 4 Unknown or design-stage
Trust boundaries
6
Browser, identity, API, data, logging, external scheduling
Requirements linked
11 / 16
Five concerns need stronger requirement traceability
Open model triggers
3
New role, new vendor field, dependency-owner assignment
Fake SOC Alert
Source: Fictional Architecture Review • Time: 11:20
Fictional Threat Register
The register below shows how a professional model separates condition, affected asset, possible impact, controls, evidence, ownership, and next action.
Condition
The counselor assignment source becomes stale or contains an incorrect assignment.
Asset
Student-support records and assignment-based authorization decisions.
Possible impact
A counselor could receive access inconsistent with the intended assignment policy.
Controls
REQ-AUTHZ-03, central authorization service, assignment source, denial logging.
Evidence
Positive and negative tests exist for normal assignments; delayed-update behavior is not supplied.
Owner / next action
Application Owner + Assignment Data Owner
Define stale-assignment behavior and validate update timing in the authorized test environment.
Condition
A future feature adds additional student data fields to the scheduling vendor flow.
Asset
Student privacy and approved data-minimization boundary.
Possible impact
The integration could receive more information than the approved business purpose requires.
Controls
REQ-DATA-02, approved field list, integration contract, data-owner review.
Evidence
Three fields are currently approved; no approval exists for future added fields.
Owner / next action
Data Owner + Integration Owner
Treat new field requests as a change trigger requiring data-purpose and minimization review.
Condition
A business-critical dependency remains without an assigned owner.
Asset
Software maintenance, update decisions, provenance review, and release confidence.
Possible impact
Support, update, or replacement decisions may be delayed or unowned.
Controls
REQ-DEP-01 requires ownership, source, version, support status, and review trigger.
Evidence
Source, version, and support status exist; owner field is blank.
Owner / next action
Engineering Lead
Assign an accountable dependency owner before marking the requirement Confirmed.
Condition
A future recovery workflow permits one staff role to approve and complete the same high-impact account recovery.
Asset
Account integrity and privileged access governance.
Possible impact
A single role could gain excessive control over high-impact recovery decisions.
Controls
Planned separation-of-duty requirement, privileged audit logging, approval record.
Evidence
The proposed workflow is not yet implemented; only design notes are supplied.
Owner / next action
Identity Owner + Product Owner
Define the approval model before implementation and include it in A11.2 requirements.
Condition
A developer adds full request objects to privileged-action logs for easier troubleshooting.
Asset
Privacy, secret protection, log usability, and audit evidence.
Possible impact
Sensitive or unnecessary data could be recorded in telemetry.
Controls
REQ-LOG-04 defines required fields and forbids secret values.
Evidence
Current supplied events comply; future logging changes are not yet reviewed.
Owner / next action
Application Owner + Monitoring Owner
Require logging-schema review before expanding privileged-action event content.
Condition
The external notification provider becomes unavailable.
Asset
Student-record workflow availability and user communication.
Possible impact
Users could lose notifications, but the core workflow should remain available.
Controls
REQ-RES-02, queue behavior, retry design, failure logging.
Evidence
Partial failure-mode evidence exists; recovery evidence is incomplete.
Owner / next action
Service Owner + Reliability Owner
Complete safe failure-mode validation and recovery evidence before release.
Fake Log Panel
[08:50] MODEL decision=review scheduling integration + privileged recovery design [09:05] ASSET student-support records classified as privacy-sensitive [09:18] BOUNDARY application -> scheduling vendor marked external trust boundary [09:41] CONCERN TM-02 new vendor field could exceed approved data purpose [10:07] CONCERN TM-03 critical dependency owner remains UNKNOWN [10:26] CONTROL REQ-AUTHZ-03 linked to TM-01 assignment-access concern [10:52] EVIDENCE TM-06 failure-mode validation partial -> CONDITIONAL [11:20] TRIGGER temporary counselor role requires model re-review before release
Training note: this is fake data for defensive analysis practice only.
Threat Review Matrix
Useful evidence: Requirements register, data classification, workflow notes, business-impact statements.
Useful evidence: Role list, identity design, service-account inventory, external integration notes.
Useful evidence: Architecture diagram, data-flow map, integration contract, environment map.
Useful evidence: Requirements, workflows, assumptions, stakeholder concerns, prior review findings.
Useful evidence: Requirements, controls, review notes, validation results, monitoring design.
Useful evidence: Missing or stale evidence, unresolved assumptions, incomplete ownership.
Analyze the Evidence
Prioritization
A threat model should help a team decide what deserves attention first. Avoid dramatic labels with no explanation. Use consistent factors and record the rationale.
What user, mission, privacy, integrity, availability, or operational consequence could result?
Does the concern involve ordinary use or high-impact administrative capability?
Would the concern affect sensitive records, private data, configuration, secrets, or audit evidence?
How broadly is the affected workflow used or reachable within the intended architecture?
Are safeguards layered, clearly owned, validated, monitored, and recoverable?
Is the conclusion supported by current evidence or dependent on assumptions and Unknowns?
Does the concern rely on a vendor, package, identity source, data source, or external service?
If the design fails, how difficult would it be to contain, restore, or safely reverse the impact?
Control Mapping
A threat model should not stop at “we have a control.†Ask what the control is supposed to do, who owns it, how it is validated, what its limitations are, and what residual risk remains.
| Concern | Requirement / control | Evidence | Residual question |
|---|---|---|---|
| Incorrect counselor assignment | REQ-AUTHZ-03 + central authorization service | Normal positive/negative tests | Delayed assignment update behavior remains Unknown |
| Excess vendor data | REQ-DATA-02 + approved field list | Integration contract + supplied field evidence | Future field requests must trigger review |
| Missing privileged audit evidence | REQ-LOG-04 + audit logging | Sample events + source-health summary | Logging-schema changes require re-review |
| Notification provider outage | REQ-RES-02 + queue/retry design | Partial failure-mode evidence | Recovery validation incomplete |
Common Mistakes
Why it fails: Without understanding the software, users, data, workflows, requirements, and trust boundaries, the model becomes generic and disconnected from design decisions.
Better approach: Begin with the fictional system and the decision the model must support.
Why it fails: Threat modeling is architecture reasoning. It does not require probing, scanning, exploitation, or access to real systems.
Better approach: Use supplied diagrams, requirements, data flows, assumptions, and review evidence.
Why it fails: A defensive school threat model should describe outcomes and safeguards, not teach harmful procedures.
Better approach: Use safe language such as unauthorized access, excess data sharing, missing authorization, or untraceable privileged change.
Why it fails: Teams lose focus when every item is labeled critical without considering business impact, exposure, privilege, control strength, and evidence.
Better approach: Rank concerns using consistent rationale.
Why it fails: A threat statement identifies what could go wrong; it does not prove that the harmful outcome happened.
Better approach: Keep hypothetical concern, observed evidence, and confirmed impact separate.
Why it fails: Missing evidence can create false confidence if the reviewer silently assumes the safest answer.
Better approach: Record Unknown, identify the owner, and request the evidence needed to resolve it.
Why it fails: New roles, vendors, dependencies, data uses, deployment changes, and incidents can invalidate earlier assumptions.
Better approach: Define change triggers and review dates.
Scenario Decision Lab
The fictional Northbridge team plans a temporary counselor role with a shorter assignment period and a different approval owner. The existing threat model covers only the standard counselor role.
Scenario Decision Lab
A threat-model concern says an external integration should share only approved fields. The design claims a field filter exists, but the current evidence package does not contain validation results.
Safe Fictional Lab
Use the fictional Northbridge Student Services Portal and the supplied requirements from A11.2. Do not inspect or test any real application, repository, API, account, device, or network.
Write the decision the threat model must support.
List the fictional users, services, external parties, and privileged roles.
List the important data, capabilities, workflows, evidence sources, and dependencies.
Describe the main data flows.
Mark the trust boundaries.
Link at least six A11.2 security requirements.
Write at least eight safe, outcome-focused threat statements.
For each concern, record existing controls and supplied evidence.
Mark Unknowns and assumptions explicitly.
Prioritize concerns with written rationale.
Assign owner and next action.
Define at least four change triggers.
Safety rule
Keep threat statements focused on defensive outcomes. Do not write step-by-step exploitation procedures, payloads, bypass methods, credential attacks, scanning instructions, or real-system test steps.
Analyze the Evidence
Advanced Challenge
Create a safe fictional threat-model section for an account-recovery workflow. Focus on architecture questions, not operational attack procedures.
Business purpose of recovery
Actors and approval roles
Identity evidence used
Privileged actions
Trust boundaries
Separation-of-duty expectations
Audit evidence
Failure behavior
User notification
Recovery rollback or reversal
Dependencies
Assumptions and Unknowns
Threat concerns
Existing controls
Validation needs
Change triggers
A strong submission should explain what the workflow must protect, where trust changes, what could go wrong at a high level, which safeguards reduce those concerns, and what evidence is still needed.
Defender Habits
Skill Check
Check Your Understanding
Choose your answers first. Explanations appear only after submission.
Portfolio Prompt
Create the third artifact for your A11 Secure Software Design Assessment: a threat model for the fictional Northbridge portal. Include decision, scope, actors, assets, components, data flows, trust boundaries, privileged actions, dependencies, assumptions, at least eight outcome-focused threat concerns, linked requirements, controls, evidence, uncertainty, owners, priorities, next actions, and change triggers.
Confidence / Readiness Reflection
A11.4 will focus on secrets management. Before moving on, check whether your threat model clearly separates design concerns, controls, evidence, and uncertainty.
I can identify actors, assets, components, data flows, trust boundaries, dependencies, and privileged actions.
I can write safe, outcome-focused threat statements without harmful operational detail.
I can link threat concerns to secure design requirements.
I can separate control presence from evidence of control effectiveness.
I can keep assumptions and Unknowns visible and define change triggers.
Portfolio Build Guide
State what architecture, release, or design question the model is meant to support.
Show fictional actors, services, data stores, external systems, data flows, and trust boundaries without real internal details.
Label concerns TM-01, TM-02, and so on so requirements, evidence, mitigation, and validation can reference them consistently.
Describe conditions and undesirable outcomes at a defensive level without operational attack instructions.
Show which A11.2 requirements address or are affected by each concern.
A design may claim a safeguard exists; evidence is what supports whether the safeguard behaves as intended.
Use Unknown, Conditional, assumption, or evidence gap rather than forcing false certainty.
Summarize priorities, owners, next actions, residual risk, and the changes that should reopen the model.
Key Takeaways
Lesson Safety Boundary
This lesson does not authorize scanning, probing, exploitation, credential attacks, bypass testing, fuzzing, payload development, destructive testing, or access to real applications, APIs, repositories, devices, accounts, or networks. Use fictional or explicitly authorized evidence only.
Lesson Complete
You now have a software threat-model framework that connects architecture, requirements, controls, evidence, priorities, and uncertainty. Next, A11.4 focuses on Secrets Management Concepts and how software teams govern sensitive credentials and configuration throughout the lifecycle.