MFA Success Rate
The proportion of second-factor attempts at sign-in that succeeded over a selected reporting period.
This metric is useful for monitoring how often users clear the second factor when they sign in. A falling rate can point to user friction with a particular factor, SMS delivery problems, or attack traffic.
It covers the factors the public can sign in with: sms_otp, voice_otp, and fido2 (passkeys). email_otp is not a second factor: it checks an email address at sign-up, and its rate is Sign-up Email Verification Rate. kq, totp, qr, and ibm_verify_push are internal factors. For one rate per factor, including those, see MFA Success Rate by Factor.
Calculation
Restrict to the sign-in factors. Divide the sum of count where result = 'success' by the sum of count where result is 'success' or 'failure'. OTP factor types also produce a 'sent' event per challenge, which must be excluded from both the numerator and the denominator, because sent rows do not represent outcomes.
To track the metric over time, bin the same calculation by week. Truncating from_date to the week groups each day into its Monday-anchored bin, so the result is one success rate per Monday-to-Sunday week.
Overall:
SELECT
CAST(SUM(count) FILTER (WHERE result = 'success') AS DOUBLE)
/ NULLIF(SUM(count), 0) AS mfa_success_rate
FROM ibm_verify_events_transformed.events_mfa_activity
-- set the reporting window; see the timespans note in cookbook/notes.qmd
WHERE CAST(from_date AS DATE) BETWEEN DATE '2026-01-01' AND DATE '2026-05-28'
-- the factors the public can sign in with; email_otp is a sign-up check
AND mfa_type IN ('sms_otp', 'voice_otp', 'fido2')
-- exclude "sent" rows; success rate is calculated from outcome events only.
-- including "sent" would inflate the denominator and deflate the rate.
AND result IN ('success', 'failure');By week:
SELECT
date_trunc('week', CAST(from_date AS DATE)) AS week_start,
CAST(SUM(count) FILTER (WHERE result = 'success') AS DOUBLE)
/ NULLIF(SUM(count), 0) AS mfa_success_rate
FROM ibm_verify_events_transformed.events_mfa_activity
-- set the reporting window; see the timespans note in cookbook/notes.qmd
WHERE CAST(from_date AS DATE) BETWEEN DATE '2026-01-01' AND DATE '2026-05-28'
-- the factors the public can sign in with; email_otp is a sign-up check
AND mfa_type IN ('sms_otp', 'voice_otp', 'fido2')
-- exclude "sent" rows; success rate is calculated from outcome events only.
-- including "sent" would inflate the denominator and deflate the rate.
AND result IN ('success', 'failure')
-- date_trunc('week', ...) anchors each bin to its Monday
GROUP BY date_trunc('week', CAST(from_date AS DATE))
ORDER BY week_start;Overall:
tbl(con, in_schema("ibm_verify_events_transformed", "events_mfa_activity")) |>
# set the reporting window; see the timespans note in cookbook/notes.qmd
filter(
as.Date(from_date) >= as.Date("2026-01-01"),
as.Date(from_date) <= as.Date("2026-05-28"),
# the factors the public can sign in with; email_otp is a sign-up check
mfa_type %in% c("sms_otp", "voice_otp", "fido2"),
# exclude "sent" rows; success rate is calculated from outcome events only.
# including "sent" would inflate the denominator and deflate the rate.
result %in% c("success", "failure")
) |>
summarise(
mfa_success_rate =
sum(if_else(result == "success", as.double(count), 0), na.rm = TRUE) /
sum(count, na.rm = TRUE)
)By week:
tbl(con, in_schema("ibm_verify_events_transformed", "events_mfa_activity")) |>
# set the reporting window; see the timespans note in cookbook/notes.qmd
filter(
as.Date(from_date) >= as.Date("2026-01-01"),
as.Date(from_date) <= as.Date("2026-05-28"),
# the factors the public can sign in with; email_otp is a sign-up check
mfa_type %in% c("sms_otp", "voice_otp", "fido2"),
# exclude "sent" rows; success rate is calculated from outcome events only.
# including "sent" would inflate the denominator and deflate the rate.
result %in% c("success", "failure")
) |>
# floor_date(..., "week") translates to Athena's date_trunc('week', ...),
# which anchors each bin to its Monday
mutate(week_start = floor_date(as.Date(from_date), "week")) |>
group_by(week_start) |>
summarise(
mfa_success_rate =
sum(if_else(result == "success", as.double(count), 0), na.rm = TRUE) /
sum(count, na.rm = TRUE)
) |>
arrange(week_start)Interpretation notes
The rate is a proportion between 0 and 1. Interpret per factor where possible: a low overall rate may be driven by a single struggling factor rather than a system-wide problem. In the weekly view, the first and last weeks of the reporting window are usually partial (the window rarely starts or ends on a Monday), so treat boundary weeks with caution when comparing trends.
Alternative names
- MFA pass rate
- second-factor success rate
- sign-in MFA success rate
- MFA completion rate