"I tend to view ads almost like a pestilence": On the Accessibility Implications of Mobile Ads for Blind Users

How they used Delve

Accessibility researchers at UC Irvine used Delve to code 15 interviews with blind Android users for a CHI 2024 paper, with two authors coding concurrently in the shared project and comparing codes afterwards, running line-by-line open coding interleaved with axial coding to saturation.

“We conducted qualitative coding to analyze the transcripts, following the coding guidelines from Saldaña [58]. We utilized the online coding software Delve [24], which facilitated the two authors to code concurrently and compare codes after completion. We employed the line-by-line open coding method [65] and interleaved it with axial coding [66] to establish connections and hierarchies between labels generated during the open coding phase.”

Field

Accessibility and human-computer interaction; how mobile advertising in Android apps breaks screen-reader navigation for blind users

Data

15 qualitative user interviews with blind Android users about how they encounter, recognise and escape advertisements while navigating apps with a screen reader, alongside an empirical analysis of 500 ad screens in Android apps

Approach

Qualitative coding following Saldaña's guidelines: line-by-line open coding interleaved with axial coding to establish connections and hierarchies among the labels generated in the open phase. Two authors coded concurrently in Delve and compared codes afterwards, resolving disagreements through collaborative discussion. Theoretical saturation was tested by comparing each new codebook against prior versions - transcripts drawn round-robin from all three study phases, an initial codebook built from six user studies, and a stopping criterion of 95% code similarity after two further transcripts. Credibility rested on triangulation, prolonged engagement and peer debriefing per Creswell.

Data types

Interviews