[Maturity] Minutes from Maturity TPAC Breakout

Minutes from the Silver Maturity Model TPAC Breakout teleconference of
Friday 22 October 2021 are provided here.
===========================================================
SUMMARY:
Introduced current state of work on a possible model:
* Applies to any size organization from sole proprietor to
 mega-corporation; NGO, or governmental entity;
* Intended to help measure and document improvement over time
* Provides mechanisms to measure and document nontechnical aspects of
 maintaining a11y over time, e.g. procurement
===========================================================
Hypertext minutes available at:
https://www.w3.org/2021/10/22-silver-maturity-minutes.html
===========================================================
 W3C
 - DRAFT -
 Silver Maturity Model Breakout
22 Oct 2021
Attendees
 Present
 atai, Ben, bkardell_, cel, Fazio, JakeAbma, jasonjgw, Jaunita_George, JF, Joshue108, KimD, kirkwood, maryjom, MichaelC, MURATA, plh, Raph_, rickj, Roy, sajkaj, SamKanta, shadi, Sheri_B-H, stevelee,
 SuzanneTaylor, ToddLibby, tzviya, Wilco
 Regrets
 -
 Chair
 Fazio, SBH
 Scribe
 sajkaj
Contents
Meeting minutes
 <Fazio> Maturity Model Slide Deck https://docs.google.com/presentation/d/1ATkbsN04HZE_L-PGH8ZKtWWiGl-stTze/edit#slide=id.p1
 df: Introduces concept of adding a maturity model to Silver, and its potential value in WCAG3 documenting, and next step decisioning
 df: Very much like ISO9000 series of specs: "Say what you mean, and do what you say"
 <jeanne> slides
 df: What to do, when, and how--how to hold feet to the fire
 df: Introduces subgroup participants ...
 Sheri_B-H: these are tools for assessing effectiveness
 Sheri_B-H: a continuous improvement loop
 Sheri_B-H: phps quickly, phps annually, but keep looping
 Sheri_B-H: idea is that it's an addon, not a replacement
 <jeff_> Present
 Sheri_B-H: written so as to not depend on a particular WCAG version
 Sheri_B-H: covering anything that could impact a11y
 Sheri_B-H: set a goal for maturity level, then figure out what needs to change to achieve that level
 Sheri_B-H: model intended to scale from 1 person shop through mega-corporate; commercial, ngo, or governmental
 Sheri_B-H: allows localization, e.g. no presence in California, can keep that part out
 Sheri_B-H: i.e. not every proof point applies to everyone
 raph: shows example of current best practice
 Raph_: shows deviations to wcag; but also nontechnical barriers
 Raph_: what is suggested is a slightly different approach
 df: Provides audio description of the slide ...
 Sheri_B-H: notes it's the standard reactive response; find challenges through testing, fix, test again
 <Raph_> Figure containing a model view of the currently usual ict accessibility approach, based on the outcome of WCAG conformance testing The starting point is (a policy containing) an accessibility goal. The goal
 applies to an ICT object. The accessibility of the ICT object is compromised by two types of barriers: technical and non technical. The technical barriers can be found and dealt with by testing the ICT object for
 conformance, using WCAG.[CUT]
 <Raph_> Figure containing a model view of the currently usual ict accessibility approach, based on the outcome of WCAG conformance testing
 <Raph_> The starting point is (a policy containing) an accessibility goal. The goal applies to an ICT object.
 <Raph_> The accessibility of the ICT object is compromised by two types of barriers: technical and non technical.
 <Raph_> The technical barriers can be found and dealt with by testing the ICT object for conformance, using WCAG.
 <Raph_> The WCAG test results provide input for evaluating goal achievement (= plan-do-check-act cycle #1).
 df: Again describes ...
 <Raph_> In this model, non technical barriers remain out of scope.
 <Raph_> Examples of non technical barriers are: procurement, path dependence, knowledge, skills, tools, prioritization, budget, the cost of change, organizational complexity, 3rd party dependence, contracts, the
 organization's culture etc.
 Raph_: idea is that nontech barriers can affect a11y level--even so as to keep the challenge from being recognized
 Raph_: Derived from a 1970s study ...
 Raph_: notes it includes the organizationan component
 Raph_: Responding to q for nontech example--Procurement
 Raph_: another is organizational complexity
 <Raph_> Figure containing a model view of a more comprehensive ict accessibility approach, based on taking organizational improvement measures
 Raph_: these have nothing to do with wcag, but influence ability to conform
 <Raph_> The starting point is (a policy containing) an accessibility goal.
 <Raph_> The goal leads to organizational improvement measures, utilizing a maturity model. The improvement measures apply to an ICT object.
 <Raph_> The accessibility of the ICT object is compromised by two types of barriers: technical and non technical.
 <Raph_> The technical barriers can be found and dealt with by testing the ICT object for conformance, using WCAG.
 <Raph_> The WCAG test results provide input for new improvement measures (= plan-do-check-act cycle #1).
 <Raph_> Examples of non technical barriers are: procurement, path dependence, knowledge, skills, tools, prioritization, budget, the cost of change, organizational complexity, 3rd party dependence, contracts, the
 organization's culture etc.
 <Raph_> The non technical barriers provide input for new improvement measures (= plan-do-check-act cycle #2).
 <Raph_> The improvement measures provide input for evaluating goal achievement (= plan-do-check-act cycle #3).
 <Raph_> Note: The primary indicator for an organization's maturity regarding ICT accessibility should not be the level of conformance to WCAG of its ICT, but the performance of the organization in making its ICT
 (more) accessible.
 <Raph_> PS: All elements of the previous figure (on slide 6) are present in this figure
 Sheri_B-H: have defined 4 different maturity stages
 Sheri_B-H: most models have a fixed number; we decided on 4
 Sheri_B-H: first is completely inactive
 Sheri_B-H: next is start
 Sheri_B-H: third is more integration
 Sheri_B-H: top is release to release integrated--a model for others to copy
 Sheri_B-H: in these we have 7 different dimensions
 sajkaj: Wow, for the first time ever, Zoom is reading slide content via Zoom!
 Sheri_B-H: Notes she used modeling at several positions starting with role at SSB
 Sheri_B-H: has been helpful in several corporate implementations
 Raph_: one of the bigger problems in governmental was partial/incomplete a11y, therefore could not meet wcag
 Raph_: so, improvement--but we needed better measurement to account for progress than wcag 2.x binary
 Raph_: model gives us a better view than available previously
 Raph_: we don't yet have a formal model, which is why I'm in the group
 Raph_: we're getting there
 Sheri_B-H: notes that vpat or audit does not help with indicators for maintainability
 Sheri_B-H: you get to a point, but can you keep it up?
 Sheri_B-H: Notes value in her corporate environment for maintanance
 Jeff_Kline: notes value add over vpat
 Fazio: will companies do this?
 Fazio: actually, yes. notes adoption of iso9000 series; it's cost effective to do this
 Fazio: moving now to outcomes in the model ----
 Sheri_B-H: using many of the same definitions currently modeled in silver
 Sheri_B-H: e.g. outcomes
 Fazio: notes outcomes is in this model thanks to work on functional needs
 Sheri_B-H: notes the need to show and evaluate every level and each dimension -- proof points which are customizable based on business need
 Sheri_B-H: goes through an example
 Fazio: notes names of elements in the model are provisional, may change!
 Sheri_B-H: e.g. the U.S. Trusted Tester may not require same training as another testor in another org
 Jeff_Kline: now an example in procurement
 Jeff_Kline: notes standard phases of procurement and where/how a11y is factored into those
 Jeff_Kline: continuing into life-cycle management
 Jeff_Kline: a11y reqs are communicated to vendors because identified as a todo in this model
 sajkaj: as your scribe, not sure how to disambiguate--do we have two "Jeff" nics on channel?
 Jeff_Kline: notes some needed expertise that may be needed; a11y capable procurement officer; eval, etc
 Fazio: purposefully set this apart from numerical scoring
 Jeff_Kline: no definitive lines between stages, things may be fluid
 Jeff_Kline: it's a guage
 <jcraig> sajkaj the substitution works.. we can fix it in the minutes at the end, unless the real Jeff has something to say this meeting
 <Zakim> sajkaj, you wanted to ask about defect rates
 <Joshue108> JS: You were talking about metrics
 <Joshue108> One jumped out, related to defect rates and how to quantify
 <Joshue108> Using the principle that all software has bugs..
 <Joshue108> Any related study, that aims to define this would be useful in the Silver process
 <Joshue108> I understand how a radical change is radical
 <Joshue108> Just to flag this..
 sajkaj: notes "acceptable defect level" is a concept we weren't able to define when we tried to address
 Jeff_Kline: notes defects is a difficult area; in procurement might be a contractual term to show continuous improvement
 Jeff_Kline: or phps error rates of X% in Y years
 Jeff_Kline: point of proof points is that they need to be demonstrable--so three subheadings under procurement
 Jeff_Kline: includes communicating expectations to vendors and use of consistent contract language
 Jeff_Kline: consistent forms
 Jeff_Kline: regular documented eval that is retained
 Jeff_Kline: /ginotes example of how organized--a template spread sheet
 Fazio: describes slide
 <cel> WCAG Maturity Model Procurement Dimension Worksheet https://docs.google.com/spreadsheets/d/1fzPlHjHIaSQn9GvpJd86SDpV49U8Beg_iXj6K5aeyGg/edit
 OK: I'll switch to using jk
 Fazio: opens to questions
 jk: Notes some on call more familiar with maturity, but others more on technical side
 jk: think of maturity as an eabler by putting required pieces in place to make the organization more effective overall
 Fazio: notes involving pwd in process in order to know; testing with pwd is important
 Jeff_Kline: /ginotes a range of staffing skills where a11y knowledge needs integration; not just technical devs
 Richard_Morton: slide 6 seems skype example
 Sheri_B-H: that's a before and after slide
 <Zakim> Richard_Morton, you wanted to jeff_k, why does slide 6 says non-technical barriers remain out of scope? It appears that everything is in scope.
 jk: intended to show nontechnical dimensions that matter
 jf: voices concern that scope of applicability
 jf: wants to emphasize wide applicability
 Sheri_B-H: not all proof points are applicable; but the model can be applied across organizational size
 Sheri_B-H: we don't want to force small organizations to measure and respond on reqs that don't apply to them
 jk: idea is to facilitate scaling
 jk: 2 person small business; some items may not apply
 jf: who makes the decision? and how does that integrate and standardize into reporting?
 jf: who defines?
 jk: we can certainly come up with general guidance
 Sheri_B-H: report produced would include what was, and what wasn't measured
 Sheri_B-H: the model is as good as the people doing the measurement and disclosure
 Jeff_Kline: /ginotes this isn't a conformance model; more a workplan
 Sheri_B-H: Invites people to participate
 Sheri_B-H: Wednesday 8:00 AM Pacific meeting time
 Sheri_B-H: invites participants
 stevelee: stevelee: notes these are measurements for the organization; and not a conformance model
 <Fazio> dfazio@helixopp.com sbyrnehaber@vmware.com
 <Zakim> JF, you wanted to respond
 jf: fully on board with the concept; but doesn't understand how to integrate into the model
 Sheri_B-H: we're not to that point yet
 Sheri_B-H: we've not gotten to integration; and integration isn't even necessarily required
 Sheri_B-H: reminds she noted up top the model is intentionally wcag version agnostic
 bkardell_: asks who's the audience for this model?
 jk: any private or public sector org of any size
 Fazio: notes common question following presentation is: "how do i start?"
 Fazio: this model provides a path
 Raph_: notes NL published booklet on that and will share
 <Raph_> Web accessibility in your organisation: roles and responsibilities
 <Fazio> https://www.digitoegankelijk.nl/sites/default/files/2021-03/Web%20accessibility%20in%20your%20organisation.pdf
 Minutes manually created (not a transcript), formatted by scribe.perl version 136 (Thu May 27 13:50:24 2021 UTC).
 Maybe present: df, Jeff_Kline, jk, OK, raph, Richard_Morton
----------------------------------
Janina Sajka
Accessibility Standards Consultant
sajkaj@amazon.com<mailto:sajkaj@amazon.com>