Dept of Defense | Chief Digital and AI Office (CDAO)

Building Trustworthy AI

Role & Responsibility

Design Lead
Product Strategist

Problem Solved

Launched one of the first military-wide responsible AI evaluation platform for the Department of Defense, enabling consistent assessment and compliance of AI regulations.

The image featured at the top of the about us page #1
The image featured at the top of the about us page #1
The image featured at the top of the about us page #1

Platform overview showing updates, leaderboard, and aggregated project scores.

Situation

Military leaders overseeing AI adoption lacked a clear, consistent way to evaluate the risk and track progress of their AI portfolios.

Constraints

  • 3 months timeline

  • New agency and leadership

  • Policies under development

Task

Design an enterprise platform for senior leaders across the military to track and understand the performance of their AI projects in accordance with the DoD's Responsible AI guidance

Goals

Equip non-technical decision-makers with a high-level overview of project health

Provide context for leaders to have informed, meaningful discussions with operators.

Role & Responsibilities

Low and high fidelity wireframes of home page

Contributions

Design Lead
Product Strategist

Contributions

Design Lead
Product Strategist

As the design lead on a cross-functional team of 12, I directly managed UX research and UI design while partnering closely with project manager, data scientists, a tech vendor, and stakeholders.

01 Discovery & Research

  • Planned qualitative research

  • Conducted interviews with 18 military executives

02 Design Leadership

  • Led design through iterative versions (low, mid, and high fidelity)

  • Developed a visual design system

  • Structured content architecture

  • Consulted with data scientist and created data visualization standards

  • Mentored junior designer

03 Product Management

  • Drove product development cycle

  • Strategized milestones and releases

  • Facilitated product alignment between clients, business stakeholders, and tech partner

Research Insights & Design Application

Research Insight

Need to adopt responsible AI usage and grow AI literacy

Design Application

  • Combine policy, workforce training, and evaluation tool.

  • Prioritize user friendly interface

  • Logical information architecture flow

Project summary cards showing project name, last updated, type, and overall project score. Includes link to project detail page.

Research Insight

Distrust due to lack of transparency into project performance

Distrust due to lack of transparency into project performance

Distrust due to lack of transparency into project performance

Design Application

  • Performance history chart

  • Show timestamp of last update

Waterfall chart and record log showing performance history and time of last project updates

Research Insight

AI should support decisions but not make them

AI should support decisions but not make them

AI should support decisions but not make them

Design Application

  • Quick glance pass/fail results supported by detailed explanation

  • Contact information for accountability

Table view of test results with side panel of details.

Outcome

The project team successfully delivered an interactive prototype and was awarded a contract extension for product development.

Our team received an enterprise award of excellence for AI innovation.

Our work earned a $2.25M next-phase contract extension, allowing the team to double in size and begin full implementation.