DIARY STUDY OF THE USER EXPERIENCE OF THE ATTENTION BIASTEST
Keywords:
Attention Bias, diary study, psychometrics, anxiety, depression
Abstract
This study evaluates a webcam-based eye-tracking test of Attention Bias (AB) conducted on the Anima platform using diary study methodology. The AB paradigm measures variations in attentional response to emotional stimuli of different valence, providing a methodological framework for evaluating psychological states. We developed the ASMQ questionnaire to complement the eye-tracking data. Linear mixed models explored the relationships between diary data and eye-tracking measures, clarifying the alignment between AB test metrics and subjective feelings. Correlation analysis affirmed the AB test’s concurrent validity. Psychometric evaluations using EFA, CFA, and reliability metrics demonstrated a two- factor structure for the ASMQ, explaining 49.7% of the variance and confirming its internal consistency.
References
1. Anima. (2024a, April 19). Animahelp. Neironaukovyi treker psykhichnoho stanu. [Neuroscientific Mental Wellness Tracker] https://ua.anima.help/ [in Ukrainian].
2. Anima. (2024b, April 21). Umovy Anima. [Terms and Conditions] https://ua.anima. help/terms-and-conditions#legal_tc [in Ukrainian].
3. Anima Blog. (2023a, June 13). Yak Chytaty Dani Anima u Testi Na Depresiiu: Poiasnennia Ta Rekomendatsii. [Understanding Your Anima Depression Results: A Brief Overview] https://shorturl.at/gkBQ6 [in Ukrainian].
4. Anima Blog. (2023b, August 16). Yak Chytaty Dani Anima u Testi Na Tryvohu: Poiasnennia Ta Rekomendatsii. [Interpreting Your Anima Anxiety Results: A Brief Overview] https://shorturl.at/ciBFQ [in Ukrainian].
5. Anderson, A.R., & Fowers, B.J. (2020). Lifestyle behaviors, psychological distress, and well-being: A daily diary study. Social Science & Medicine, 263, 113263. https://doi. org/10.1016/j.socscimed.2020.113263
6. Armstrong, T., & Olatunji, B.O. (2012). Eye tracking of attention in the affective disorders: A meta-analytic review and synthesis. Clinical Psychology Review, 32(8), 704–723. https://doi.org/10.1016/j.cpr.2012.09.004
7. Clauss, K., Gorday, J.Y., & Bardeen, J. R. (2022). Eye tracking evidence of threat- related attentional bias in anxiety- and fear-related disorders: A systematic review and meta-analysis. Clinical Psychology Review, 93, 102142. https://doi.org/10.1016/j. cpr.2022.102142
8. Conner, T.S., & Silvia, P.J. (2015). Creative days: A daily diary study of emotion, personality, and everyday creativity. Psychology of Aesthetics, Creativity, and the Arts, 9(4), 463–470. https://doi.org/10.1037/aca0000022
9. De Beurs, E., Den Hollander-Gijsman, M.E., Helmich, S., & Zitman, F.G. (2007). The tripartite model for assessing symptoms of anxiety and depression: Psychometrics of the Dutch version of the mood and anxiety symptoms questionnaire. Behaviour Research and Therapy, 45(7), 1609–1617. https://doi.org/10.1016/j.brat.2006.07.004
10. Disner, S.G., Beevers, C.G., Haigh, E.A.P., & Beck, A.T. (2011). Neural mechanisms of the cognitive model of depression. Nature Reviews Neuroscience, 12(8), 467–477. https://doi.org/10.1038/nrn3027
11. Epskamp, S. (2022). semPlot: Path Diagrams and Visual Analysis of Various SEM Packages’ Output. https://CRAN.R-project.org/package=semPlot
12. Everaert, J., & Koster, E.H.W. (2020). The interplay among attention, interpretation, and memory biases in depression: Revisiting the combined cognitive bias hypothesis. В Cognitive Biases in Health and Psychiatric Disorders (с. 193–213). Elsevier. https://doi. org/10.1016/B978-0-12-816660-4.00009-X
13. Experience, W.L. in R.-B.U. (2016, June 5). Diary Studies: Understanding Long- Term User Behavior and Experiences. Nielsen Norman Group. https://www.nngroup. com/articles/diary-studies/
14. Gallucci, M. (2019). GAMLj: General analyses for linear models. [jamovi module]. Retrieved from https://gamlj.github.io/
15. Gallucci, M. (2020). Model goodness of fit in GAMLj Retrieved from https://gamlj.github.io/details_goodness.html
16. Goldberg, S.B., Hanley, A.W., Baldwin, S.A., Bernstein, A., & Garland, E.L. (2020). Does mindfulness practice promote psychological functioning or is it the other way around? A daily diary study. Psychotherapy, 57(3), 310–322. https://doi.org/10.1037/ pst0000286
17. Grahek, I., Everaert, J., Krebs, R.M., & Koster, E.H.W. (2018). Cognitive Control in Depression: Toward Clinical Models Informed by Cognitive Neuroscience. Clinical Psychological Science, 6(4), 464–480. https://doi.org/10.1177/2167702618758969
18. Grupe, D.W., & Nitschke, J.B. (2013). Uncertainty and anticipation in anxiety: An integrated neurobiological and psychological perspective. Nature Reviews Neuroscience, 14(7), 488–501. https://doi.org/10.1038/nrn3524
19. Higgins-Chen, A.T., Abdallah, S.B., Dwyer, J.B., Kaye, A. P., Angarita, G.A., & Bloch, M.H. (2019). Severe Illness Anxiety Treated by Integrating Inpatient Psychotherapy With Medical Care and Minimizing Reassurance. Frontiers in Psychiatry, 10, 150. https://doi.org/10.3389/fpsyt.2019.00150
20. Iida, M., Shrout, P.E., Laurenceau, J.-P., & Bolger, N. (2012). Using diary methods in psychological research. In H. Cooper, P.M. Camic, D.L. Long, A.T. Panter, D. Rindskopf, & K.J. Sher (Eds.), APA handbook of research methods in psychology, Vol 1: Foundations, planning, measures, and psychometrics. (с. 277–305). American Psychological Association. https://doi.org/10.1037/13619-016
21. iMotions. (2023). iMotionsWebET 3.0 Webcam Based Eye Tracking—Whitepaper v3. https://go.imotions.com/WebET3Whitepaper
22. Insel, T., Cuthbert, B., Garvey, M., Heinssen, R., Pine, D.S., Quinn, K., Sanislow, C., & Wang, P. (2010). Research Domain Criteria (RDoC): Toward a New Classification Framework for Research on Mental Disorders. American Journal of Psychiatry, 167(7), 748–751. https://doi.org/10.1176/appi.ajp.2010.09091379
23. Kellough, J.L., Beevers, C.G., Ellis, A.J., & Wells, T.T. (2008). Time course of selective attention in clinically depressed young adults: An eye tracking study. Behaviour Research and Therapy, 46(11), 1238–1243. https://doi.org/10.1016/j.brat.2008.07.004
24. Kline, R.B., & Little, T.D. (2023). Principles and practice of structural equation modeling (5th ed.). The Guilford Press.
25. LeMoult, J., &Gotlib, I.H. (2019). Depression: A cognitive perspective. Clinical Psychology Review, 69, 51–66. https://doi.org/10.1016/j.cpr.2018.06.008
26. Lüdecke, Ben-Shachar, Patil & Makowski (2020). Extracting, Computing and Exploring the Parameters of Statistical Models using R. CRAN.
27. Nezlek, J. (2020). Diary studies in social and personality psychology: An introduction with some recommendations and suggestions. Social Psychological Bulletin, 15(2), e2679. https://doi.org/10.32872/spb.2679
28. Open AI. (2024). Chat GPT 4 Turbo (Version 4) [Software]. Open AI. https://chat. openai.com/chat
29. Overgaard, M. (2006). Introspection in Science. Consciousness and Cognition, 15(4), 629–633. https://doi.org/10.1016/j.concog.2006.10.004
30. Pergamin-Hight, L., Naim, R., Bakermans-Kranenburg, M.J., van IJzendoorn, M.H., & Bar-Haim, Y. (2015). Content specificity of attention bias to threat in anxiety disorders: A meta-analysis. Clinical Psychology Review, 35, 10–18. https://doi.org/10.1016/j. cpr.2014.10.005
31. Plummer, F., Manea, L., Trepel, D., & McMillan, D. (2016). Screening for anxiety disorders with the GAD-7 and GAD-2: A systematic review and diagnostic metaanalysis. General Hospital Psychiatry, 39, 24–31. https://doi.org/10.1016/j.genhosppsych.2015.11.005
32. R Core Team (2022). R: A Language and environment for statistical computing. (Version 4.1) [Computer software]. Retrieved from https://cran.r-project.org. (R packages retrieved from CRAN snapshot 2023-04-07).
33. Revelle, W. (2023). psych: Proceduresfor Psychological, Psychometric, and Personality Research. [R package]. Retrieved from https://cran.r-project.org/package=psych
34. Rosas, H.J., Sussman, A., Sekely, A.C., & Lavdas, A.A. (2023). Using Eye Tracking to Reveal Responses to the Built Environment and Its Constituents. Applied Sciences, 13(21), 12071. https://doi.org/10.3390/app132112071
35. Rosseel, Y., et al. (2023). lavaan: Latent Variable Analysis. [R package]. Retrieved from https://cran.r-project.org/package=lavaan.
36. Schroder, H.S., Devendorf, A., & Zikmund-Fisher, B.J. (2023). Framing depression as a functional signal, not a disease: Rationale and initial randomized controlled trial. Social Science & Medicine, 328, 115995. https://doi.org/10.1016/j.socscimed.2023.115995
37. Solonskyi, A. (2024). Attention Bias Diary study. https://doi.org/10.17605/OSF.IO/RYMNC
38. Taber, K.S. (2018). The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education. Research in Science Education, 48(6), 1273–1296. https://doi.org/10.1007/s11165-016-9602-2
39. The jamovi project (2023). jamovi. (Version 2.4) [Computer Software]. Retrieved from https://www.jamovi.org
40. Van Rooijen, R., Ploeger, A., & Kret, M.E. (2017). The dot-probe task to measure emotional attention: A suitable measure in comparative studies? Psychonomic Bulletin & Review, 24(6), 1686–1717. https://doi.org/10.3758/s13423-016-1224-1
41. Waechter, S., Nelson, A.L., Wright, C., Hyatt, A., & Oakman, J. (2014). Measuring Attentional Bias to Threat: Reliability of Dot Probe and Eye Movement Indices. Cognitive Therapy and Research, 38(3), 313–333. https://doi.org/10.1007/s10608-013- 9588-2
42. Weeks, J.W., Howell, A.N., Srivastav, A., & Goldin, P.R. (2019). “Fear guides the eyes of the beholder”: Assessing gaze avoidance in social anxiety disorder via covert eye tracking of dynamic social stimuli. Journal of Anxiety Disorders, 65, 56–63. https://doi.org/10.1016/j.janxdis.2019.05.005
43. Yang, X., & Krajbich, I. (2021). Webcam-based online eye-tracking for behavioral research. Judgment and Decision Making, 16(6), 1485–1505. https://doi.org/10.1017/S1930297500008512
2. Anima. (2024b, April 21). Umovy Anima. [Terms and Conditions] https://ua.anima. help/terms-and-conditions#legal_tc [in Ukrainian].
3. Anima Blog. (2023a, June 13). Yak Chytaty Dani Anima u Testi Na Depresiiu: Poiasnennia Ta Rekomendatsii. [Understanding Your Anima Depression Results: A Brief Overview] https://shorturl.at/gkBQ6 [in Ukrainian].
4. Anima Blog. (2023b, August 16). Yak Chytaty Dani Anima u Testi Na Tryvohu: Poiasnennia Ta Rekomendatsii. [Interpreting Your Anima Anxiety Results: A Brief Overview] https://shorturl.at/ciBFQ [in Ukrainian].
5. Anderson, A.R., & Fowers, B.J. (2020). Lifestyle behaviors, psychological distress, and well-being: A daily diary study. Social Science & Medicine, 263, 113263. https://doi. org/10.1016/j.socscimed.2020.113263
6. Armstrong, T., & Olatunji, B.O. (2012). Eye tracking of attention in the affective disorders: A meta-analytic review and synthesis. Clinical Psychology Review, 32(8), 704–723. https://doi.org/10.1016/j.cpr.2012.09.004
7. Clauss, K., Gorday, J.Y., & Bardeen, J. R. (2022). Eye tracking evidence of threat- related attentional bias in anxiety- and fear-related disorders: A systematic review and meta-analysis. Clinical Psychology Review, 93, 102142. https://doi.org/10.1016/j. cpr.2022.102142
8. Conner, T.S., & Silvia, P.J. (2015). Creative days: A daily diary study of emotion, personality, and everyday creativity. Psychology of Aesthetics, Creativity, and the Arts, 9(4), 463–470. https://doi.org/10.1037/aca0000022
9. De Beurs, E., Den Hollander-Gijsman, M.E., Helmich, S., & Zitman, F.G. (2007). The tripartite model for assessing symptoms of anxiety and depression: Psychometrics of the Dutch version of the mood and anxiety symptoms questionnaire. Behaviour Research and Therapy, 45(7), 1609–1617. https://doi.org/10.1016/j.brat.2006.07.004
10. Disner, S.G., Beevers, C.G., Haigh, E.A.P., & Beck, A.T. (2011). Neural mechanisms of the cognitive model of depression. Nature Reviews Neuroscience, 12(8), 467–477. https://doi.org/10.1038/nrn3027
11. Epskamp, S. (2022). semPlot: Path Diagrams and Visual Analysis of Various SEM Packages’ Output. https://CRAN.R-project.org/package=semPlot
12. Everaert, J., & Koster, E.H.W. (2020). The interplay among attention, interpretation, and memory biases in depression: Revisiting the combined cognitive bias hypothesis. В Cognitive Biases in Health and Psychiatric Disorders (с. 193–213). Elsevier. https://doi. org/10.1016/B978-0-12-816660-4.00009-X
13. Experience, W.L. in R.-B.U. (2016, June 5). Diary Studies: Understanding Long- Term User Behavior and Experiences. Nielsen Norman Group. https://www.nngroup. com/articles/diary-studies/
14. Gallucci, M. (2019). GAMLj: General analyses for linear models. [jamovi module]. Retrieved from https://gamlj.github.io/
15. Gallucci, M. (2020). Model goodness of fit in GAMLj Retrieved from https://gamlj.github.io/details_goodness.html
16. Goldberg, S.B., Hanley, A.W., Baldwin, S.A., Bernstein, A., & Garland, E.L. (2020). Does mindfulness practice promote psychological functioning or is it the other way around? A daily diary study. Psychotherapy, 57(3), 310–322. https://doi.org/10.1037/ pst0000286
17. Grahek, I., Everaert, J., Krebs, R.M., & Koster, E.H.W. (2018). Cognitive Control in Depression: Toward Clinical Models Informed by Cognitive Neuroscience. Clinical Psychological Science, 6(4), 464–480. https://doi.org/10.1177/2167702618758969
18. Grupe, D.W., & Nitschke, J.B. (2013). Uncertainty and anticipation in anxiety: An integrated neurobiological and psychological perspective. Nature Reviews Neuroscience, 14(7), 488–501. https://doi.org/10.1038/nrn3524
19. Higgins-Chen, A.T., Abdallah, S.B., Dwyer, J.B., Kaye, A. P., Angarita, G.A., & Bloch, M.H. (2019). Severe Illness Anxiety Treated by Integrating Inpatient Psychotherapy With Medical Care and Minimizing Reassurance. Frontiers in Psychiatry, 10, 150. https://doi.org/10.3389/fpsyt.2019.00150
20. Iida, M., Shrout, P.E., Laurenceau, J.-P., & Bolger, N. (2012). Using diary methods in psychological research. In H. Cooper, P.M. Camic, D.L. Long, A.T. Panter, D. Rindskopf, & K.J. Sher (Eds.), APA handbook of research methods in psychology, Vol 1: Foundations, planning, measures, and psychometrics. (с. 277–305). American Psychological Association. https://doi.org/10.1037/13619-016
21. iMotions. (2023). iMotionsWebET 3.0 Webcam Based Eye Tracking—Whitepaper v3. https://go.imotions.com/WebET3Whitepaper
22. Insel, T., Cuthbert, B., Garvey, M., Heinssen, R., Pine, D.S., Quinn, K., Sanislow, C., & Wang, P. (2010). Research Domain Criteria (RDoC): Toward a New Classification Framework for Research on Mental Disorders. American Journal of Psychiatry, 167(7), 748–751. https://doi.org/10.1176/appi.ajp.2010.09091379
23. Kellough, J.L., Beevers, C.G., Ellis, A.J., & Wells, T.T. (2008). Time course of selective attention in clinically depressed young adults: An eye tracking study. Behaviour Research and Therapy, 46(11), 1238–1243. https://doi.org/10.1016/j.brat.2008.07.004
24. Kline, R.B., & Little, T.D. (2023). Principles and practice of structural equation modeling (5th ed.). The Guilford Press.
25. LeMoult, J., &Gotlib, I.H. (2019). Depression: A cognitive perspective. Clinical Psychology Review, 69, 51–66. https://doi.org/10.1016/j.cpr.2018.06.008
26. Lüdecke, Ben-Shachar, Patil & Makowski (2020). Extracting, Computing and Exploring the Parameters of Statistical Models using R. CRAN.
27. Nezlek, J. (2020). Diary studies in social and personality psychology: An introduction with some recommendations and suggestions. Social Psychological Bulletin, 15(2), e2679. https://doi.org/10.32872/spb.2679
28. Open AI. (2024). Chat GPT 4 Turbo (Version 4) [Software]. Open AI. https://chat. openai.com/chat
29. Overgaard, M. (2006). Introspection in Science. Consciousness and Cognition, 15(4), 629–633. https://doi.org/10.1016/j.concog.2006.10.004
30. Pergamin-Hight, L., Naim, R., Bakermans-Kranenburg, M.J., van IJzendoorn, M.H., & Bar-Haim, Y. (2015). Content specificity of attention bias to threat in anxiety disorders: A meta-analysis. Clinical Psychology Review, 35, 10–18. https://doi.org/10.1016/j. cpr.2014.10.005
31. Plummer, F., Manea, L., Trepel, D., & McMillan, D. (2016). Screening for anxiety disorders with the GAD-7 and GAD-2: A systematic review and diagnostic metaanalysis. General Hospital Psychiatry, 39, 24–31. https://doi.org/10.1016/j.genhosppsych.2015.11.005
32. R Core Team (2022). R: A Language and environment for statistical computing. (Version 4.1) [Computer software]. Retrieved from https://cran.r-project.org. (R packages retrieved from CRAN snapshot 2023-04-07).
33. Revelle, W. (2023). psych: Proceduresfor Psychological, Psychometric, and Personality Research. [R package]. Retrieved from https://cran.r-project.org/package=psych
34. Rosas, H.J., Sussman, A., Sekely, A.C., & Lavdas, A.A. (2023). Using Eye Tracking to Reveal Responses to the Built Environment and Its Constituents. Applied Sciences, 13(21), 12071. https://doi.org/10.3390/app132112071
35. Rosseel, Y., et al. (2023). lavaan: Latent Variable Analysis. [R package]. Retrieved from https://cran.r-project.org/package=lavaan.
36. Schroder, H.S., Devendorf, A., & Zikmund-Fisher, B.J. (2023). Framing depression as a functional signal, not a disease: Rationale and initial randomized controlled trial. Social Science & Medicine, 328, 115995. https://doi.org/10.1016/j.socscimed.2023.115995
37. Solonskyi, A. (2024). Attention Bias Diary study. https://doi.org/10.17605/OSF.IO/RYMNC
38. Taber, K.S. (2018). The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education. Research in Science Education, 48(6), 1273–1296. https://doi.org/10.1007/s11165-016-9602-2
39. The jamovi project (2023). jamovi. (Version 2.4) [Computer Software]. Retrieved from https://www.jamovi.org
40. Van Rooijen, R., Ploeger, A., & Kret, M.E. (2017). The dot-probe task to measure emotional attention: A suitable measure in comparative studies? Psychonomic Bulletin & Review, 24(6), 1686–1717. https://doi.org/10.3758/s13423-016-1224-1
41. Waechter, S., Nelson, A.L., Wright, C., Hyatt, A., & Oakman, J. (2014). Measuring Attentional Bias to Threat: Reliability of Dot Probe and Eye Movement Indices. Cognitive Therapy and Research, 38(3), 313–333. https://doi.org/10.1007/s10608-013- 9588-2
42. Weeks, J.W., Howell, A.N., Srivastav, A., & Goldin, P.R. (2019). “Fear guides the eyes of the beholder”: Assessing gaze avoidance in social anxiety disorder via covert eye tracking of dynamic social stimuli. Journal of Anxiety Disorders, 65, 56–63. https://doi.org/10.1016/j.janxdis.2019.05.005
43. Yang, X., & Krajbich, I. (2021). Webcam-based online eye-tracking for behavioral research. Judgment and Decision Making, 16(6), 1485–1505. https://doi.org/10.1017/S1930297500008512
Published
2024-03-31
How to Cite
Solonskyi, A. (2024). DIARY STUDY OF THE USER EXPERIENCE OF THE ATTENTION BIASTEST. Kyiv Journal of Modern Psychology and Psychotherapy, 7, 67-88. https://doi.org/10.48020/mppj.2024.01.05
Section
Articles
This work is licensed under a Creative Commons Attribution 4.0 International License.
