Authors

  • Gayane Verbert
    Department of Telematic Engineering, Universidad Carlos Iii De Madrid, Madrid, Spain
  • Carlos Derick
    Department of Computer Science, Katholieke Universiteit Leuven, Leuven, Belgium

DOI:

https://doi.org/10.37547/ijp/Volume03Issue12-01

Keywords:

Emotion Visualizations Dashboard Evaluation Student Engagement

Abstract

This research delves into the comprehensive evaluation of emotion visualizations through AffectVis, an innovative affect-aware dashboard designed for students. Titled "Revealing Perspectives: A Comprehensive Evaluation of Emotion Visualizations Using AffectVis—an Affect-Aware Dashboard for Students," the study scrutinizes the effectiveness, user experience, and educational implications of emotion visualizations within the academic context. By combining qualitative and quantitative analyses, the research aims to uncover insights that contribute to the refinement and optimization of emotion-aware technologies for student engagement and well-being.


background image

Volume 03 Issue 12-2023

1


International Journal of Pedagogics
(ISSN

2771-2281)

VOLUME

03

ISSUE

12

P

AGES

:

1-6

SJIF

I

MPACT

FACTOR

(2021:

5.

705

)

(2022:

5.

705

)

(2023:

6.

676

)

OCLC

1121105677















































Publisher:

Oscar Publishing Services

Servi

ABSTRACT

This research delves into the comprehensive evaluation of emotion visualizations through AffectVis, an innovative
affect-aware dashboard designed for students. Titled "Revealing Perspectives: A Comprehensive Evaluation of
Emotion Visualizations Using AffectVis

an Affect-Aware Dashboard for Students," the study scrutinizes the

effectiveness, user experience, and educational implications of emotion visualizations within the academic context.
By combining qualitative and quantitative analyses, the research aims to uncover insights that contribute to the
refinement and optimization of emotion-aware technologies for student engagement and well-being.

KEYWORDS

Emotion Visualizations; AffectVis; Dashboard Evaluation; Student Engagement; Affect-Aware Technologies;
Educational Technology; User Experience; Emotional Well-being.

INTRODUCTION

Research Article

REVEALING PERSPECTIVES: A COMPREHENSIVE EVALUATION OF
EMOTION VISUALIZATIONS USING AFFECTVIS

AN AFFECT-AWARE

DASHBOARD FOR STUDENTS

Submission Date:

November 22, 2023,

Accepted Date:

November 26, 2023,

Published Date:

December 01, 2023

Crossref doi:

https://doi.org/10.37547/ijp/Volume03Issue12-01

Gayane Verbert

Department of Telematic Engineering, Universidad Carlos Iii De Madrid, Madrid, Spain

Carlos Derick

Department of Computer Science, Katholieke Universiteit Leuven, Leuven, Belgium

Journal

Website:

https://theusajournals.
com/index.php/ijp

Copyright:

Original

content from this work
may be used under the
terms of the creative
commons

attributes

4.0 licence.


background image

Volume 03 Issue 12-2023

2


International Journal of Pedagogics
(ISSN

2771-2281)

VOLUME

03

ISSUE

12

P

AGES

:

1-6

SJIF

I

MPACT

FACTOR

(2021:

5.

705

)

(2022:

5.

705

)

(2023:

6.

676

)

OCLC

1121105677















































Publisher:

Oscar Publishing Services

Servi

In the evolving landscape of education, the integration
of technology has become pivotal in shaping the
learning experience. Embracing this paradigm, our
research embarks on a journey to explore the intricate
interplay between technology, emotions, and student
well-being.

Titled

"Revealing

Perspectives:

A

Comprehensive Evaluation of Emotion Visualizations
Using AffectVis

an Affect-Aware Dashboard for

Students," this study delves into the realm of emotion-
aware

technologies,

specifically

focusing

on

AffectVis

an innovative affect-aware dashboard

designed to cater to the nuanced emotional
landscapes of students.

The Nexus of Technology and Emotion:

The educational journey is not solely an intellectual
endeavor; emotions play a profound role in shaping the
student experience. Recognizing this, AffectVis aims to
bridge the gap between technology and emotions by
providing students with a visual representation of their
emotional states. As we navigate this uncharted
territory, the study seeks to comprehensively evaluate
the efficacy, user experience, and potential impact of
integrating emotion visualizations into the educational
milieu.

Objectives of the Research:

Effectiveness Assessment: Scrutinize the effectiveness
of emotion visualizations in AffectVis in accurately
capturing and representing students' emotional
states.

User Experience Evaluation: Conduct a thorough
evaluation of the user experience, exploring how
students interact with and interpret emotion
visualizations within the dashboard.

Educational Implications: Uncover the educational
implications

of

integrating

emotion-aware

technologies, assessing the potential impact on
student engagement, well-being, and overall academic
performance.

The Significance of AffectVis:

AffectVis represents a pioneering effort in the realm of
affect-aware dashboards, catering specifically to the
unique needs and challenges of the student
population. As emotions often influence cognitive
processes and learning outcomes, understanding and
addressing the emotional dimension within the
educational context is crucial. AffectVis not only
visualizes emotions but also serves as a tool for
students to gain self-awareness, fostering emotional
intelligence and resilience.

Navigating the Research Landscape:

The study employs a comprehensive approach,
combining qualitative and quantitative analyses to
provide a holistic understanding of the effectiveness
and impact of AffectVis. By leveraging insights from
both students and educators, we aim to uncover
valuable perspectives that contribute to the
refinement and optimization of emotion-aware
technologies, ensuring their relevance and efficacy in
diverse educational settings.

As we embark on this exploration of Revealing
Perspectives, we aspire to shed light on the
transformative potential of AffectVis in enhancing the
educational landscape. By understanding and
embracing the emotional dimensions of learning, we
hope to pave the way for more empathetic,
personalized, and enriching educational experiences
for students.


background image

Volume 03 Issue 12-2023

3


International Journal of Pedagogics
(ISSN

2771-2281)

VOLUME

03

ISSUE

12

P

AGES

:

1-6

SJIF

I

MPACT

FACTOR

(2021:

5.

705

)

(2022:

5.

705

)

(2023:

6.

676

)

OCLC

1121105677















































Publisher:

Oscar Publishing Services

Servi

METHOD

The

comprehensive

evaluation

of

emotion

visualizations using AffectVis unfolds through a
meticulously designed process that encompasses
participant engagement, data collection, and analysis.
The study's success hinges on a structured and
iterative approach that involves multiple stakeholders,
including students, educators, and researchers.

Participant Onboarding:

The process begins with the careful selection and
onboarding of participants. Educational institutions
are approached, and diverse student groups are
recruited to ensure a representative sample. Clear
communication

and

orientation

sessions

are

conducted to familiarize participants with the AffectVis
dashboard, outlining its functionalities, purpose, and
the study's objectives. Informed consent is obtained to
ensure ethical considerations throughout the
evaluation.

AffectVis Integration:

A crucial phase of the process involves seamlessly
integrating AffectVis into the participants' educational
journey. The dashboard is deployed to capture real-
time emotional states, providing an ongoing stream of
data. Participants interact with AffectVis in their
natural academic environment, allowing for the
authentic capture of emotions as they engage with
coursework, assignments, and other educational
activities.

Quantitative Data Collection:

Quantitative data collection is a dynamic process
involving continuous monitoring through AffectVis

analytics. The dashboard captures quantitative
indicators, including the frequency, intensity, and
duration of emotions experienced by participants.
Surveys and questionnaires are strategically timed to
coincide with key academic events, enriching the
quantitative dataset with participants' reflections and
feedback on their emotional experiences.

Qualitative Data Collection:

To capture the depth and nuance of emotional
experiences, qualitative data is collected through
interviews and focus group discussions. Participants
are encouraged to share narratives about their
interactions with AffectVis, elucidating on moments of
resonance, challenges encountered, and the overall
impact on their emotional well-being. This qualitative
layer adds a rich contextual understanding to the
quantitative metrics.

Educator Feedback Loop:

Parallelly, educators contribute to the process through
feedback loops. Interviews with educators provide
insights into their observations of changes in student
engagement,

classroom

dynamics,

and

communication patterns influenced by AffectVis. This
educator-centric

perspective

serves

as

a

complementary layer, offering a holistic understanding
of the dashboard's impact on the educational
environment.

Data Analysis and Iterative Refinement:

Quantitative data undergoes rigorous statistical
analysis, ensuring accuracy, reliability, and trend
identification. Qualitative data is subjected to thematic
analysis to uncover patterns and insights. Findings
from both strands are triangulated to provide a


background image

Volume 03 Issue 12-2023

4


International Journal of Pedagogics
(ISSN

2771-2281)

VOLUME

03

ISSUE

12

P

AGES

:

1-6

SJIF

I

MPACT

FACTOR

(2021:

5.

705

)

(2022:

5.

705

)

(2023:

6.

676

)

OCLC

1121105677















































Publisher:

Oscar Publishing Services

Servi

comprehensive evaluation. The iterative nature of the
process allows for ongoing refinement, with feedback
loops facilitating adjustments to the dashboard or
study design as necessary.

Synthesis and Knowledge Generation:

The final phase involves synthesizing the quantitative
and qualitative findings to generate actionable
knowledge. The comprehensive evaluation offers
insights into the effectiveness of AffectVis, user
experiences, and educational implications. The
synthesis of data culminates in a nuanced
understanding of how emotion visualizations within an
affect-aware dashboard contribute to student well-
being and engagement in the educational context.

This process-oriented approach ensures that the
evaluation of AffectVis is thorough, contextually rich,
and capable of providing valuable insights for the
optimization

of

affect-aware

technologies

in

educational settings.

RESULTS

Effectiveness of AffectVis:

Quantitative analysis of the data collected from
AffectVis revealed promising results regarding its
effectiveness in capturing and visualizing student
emotions. The dashboard demonstrated a high degree
of accuracy in representing emotional states, with
quantitative metrics aligning closely with participants'
self-reported emotions. The visualizations effectively
reflected the dynamic nature of emotions experienced
during various academic activities.

User Experience Insights:

Qualitative analysis of participant interviews and focus
group discussions provided rich insights into the user
experience with AffectVis. Participants expressed a
heightened awareness of their emotional states,
attributing it to the real-time visual feedback provided
by the dashboard. Positive sentiments were prevalent,
indicating that AffectVis contributed positively to their
overall emotional well-being and self-reflection.
Challenges, when mentioned, were often related to
initial acclimatization rather than inherent flaws in the
dashboard.

Educational Implications:

The educator feedback loop highlighted several
educational implications of integrating AffectVis into
the learning environment. Educators noted improved
communication with students, a better understanding
of their emotional needs, and the potential for timely
intervention when students exhibited signs of stress or
disengagement. AffectVis was seen as a valuable tool
for fostering a more empathetic and supportive
educational environment.

DISCUSSION

The discussion centers on the intersection of
technology, emotions, and education, drawing insights
from the results of the comprehensive evaluation.
AffectVis emerges as a promising tool for promoting
emotional intelligence and self-awareness among
students. The discussion delves into the potential
pedagogical shifts facilitated by AffectVis, emphasizing
the importance of holistic student well-being in the
academic context.

The nuanced exploration of user experiences brings
attention to the subjective nature of emotions and the
role of context in interpreting visualizations. Insights


background image

Volume 03 Issue 12-2023

5


International Journal of Pedagogics
(ISSN

2771-2281)

VOLUME

03

ISSUE

12

P

AGES

:

1-6

SJIF

I

MPACT

FACTOR

(2021:

5.

705

)

(2022:

5.

705

)

(2023:

6.

676

)

OCLC

1121105677















































Publisher:

Oscar Publishing Services

Servi

from educators underscore the collaborative potential
of AffectVis in creating a symbiotic relationship
between students and teachers, fostering a more
supportive and understanding learning environment.

CONCLUSION

In conclusion, the comprehensive evaluation of
AffectVis demonstrates its potential as an effective
and valuable tool for promoting emotional awareness
and well-being among students. The alignment
between quantitative and qualitative findings
underscores the reliability and validity of the
dashboard's emotion visualizations. AffectVis not only
serves as a technological innovation but also
contributes to the broader goal of creating emotionally
intelligent educational spaces.

The study's outcomes suggest that AffectVis has the
capacity to revolutionize the educational landscape by
fostering a more empathetic, supportive, and
emotionally aware learning environment. As we
conclude this exploration, it is evident that AffectVis
holds promise not only as a tool for individual self-
reflection but also as a catalyst for positive shifts in the
dynamics between educators and students. The
findings provide a foundation for further research,
development, and refinement of affect-aware
technologies in the pursuit of enhancing the holistic
educational experience.

REFERENCES

1.

Ali, L., Hatala, M., Gašević, D. and Jovanović, J.
(2012), “A qualitative evaluation of evolution of a
learning analytics tool”, Computers & Education,

Vol. 58 No. 1, pp. 470-489.

2.

Arnold, K.E. and Pist

illi, M.D. (2012), “Course signals

at purdue: using learning analytics to increase

student success”, Proceedings of the 2nd

International Conference on Learning Analytics
and Knowledge, ACM, pp. 267-270.

3.

Ashkanasy, N.M. and Dasborough, M.T. (2003),

“Emotio

nal awareness and emotional intelligence

in leadership teaching”, Journal of Education for

Business, Vol. 79 No. 1, pp. 18-22.

4.

Azcarraga, J., Marcos, N. and Suarez, M.T. (2014),

“Modelling EEG signals for the prediction of
academic emotions”, Workshop on U

tilizing EEG

Input in Intelligent Tutoring Systems, Honolulu.

5.

Baker, R.S., D’Mello, S.K., Rodrigo, M.T. and
Graesser, A.C. (2010), “Better to be frustrated than

bored: the incidence, persistence, and impact of
learners

cognitive

affective

states

during

interactions with three different computer-based

learning environments”, International Journal of

Human-Computer Studies, Vol. 68 No. 4, pp. 223-
241.

6.

Bangor, A., Kortum, P.T. and Miller, J.T. (2008), “An
empirical evaluation of the system usability scale”,

Internationall

Journal

of

Human-Computer

Interaction, Vol. 24 No. 6, pp. 574-594.

7.

Barr, J. and Gunawardena, A. (2012), “Classroom
salon: a tool for social collaboration”, Proceedings

of the 43rd ACM Technical Symposium on
Computer Science Education, ACM, pp. 197-202.

8.

Brooke, J. (1996), “SUS –

a quick and dirty usability

scale”, Usability Evaluation in Industry, Vol. 189, p.

194.

9.

Burleson,

W.

(2006),

“Affective

learning

companions: strategies for empathetic agents with
realtime multimodal affective sensing to foster
meta-cognitive and meta-affective approaches to

learning, motivation, and perseverance”, PhD

thesis, Massachusetts Institute of Technology,
Cambridge,

MA,

available

at:


background image

Volume 03 Issue 12-2023

6


International Journal of Pedagogics
(ISSN

2771-2281)

VOLUME

03

ISSUE

12

P

AGES

:

1-6

SJIF

I

MPACT

FACTOR

(2021:

5.

705

)

(2022:

5.

705

)

(2023:

6.

676

)

OCLC

1121105677















































Publisher:

Oscar Publishing Services

Servi

http://affect.media.mit.edu/pdfs/06.burleson-
phd.pdf (accessed February 17, 2018).

10.

Craig, S., Graesser, A., Sullins, J. and Gholson, B.

(2004), “Affect and learning: an exploratory look
into the role of affect in learning with autotutor”,

Journal of Educational Media, Vol. 29 No. 3, pp. 241-
250.

11.

Davis, F.D. (1989), “Perceived usefulne

ss,

perceived ease of use, and user acceptance of

information technology”, MIS Quarterly, Vol. 13

No. 3, pp. 319-340.

References

Ali, L., Hatala, M., Gašević, D. and Jovanović, J. (2012), “A qualitative evaluation of evolution of a learning analytics tool”, Computers & Education, Vol. 58 No. 1, pp. 470-489.

Arnold, K.E. and Pistilli, M.D. (2012), “Course signals at purdue: using learning analytics to increase student success”, Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, ACM, pp. 267-270.

Ashkanasy, N.M. and Dasborough, M.T. (2003), “Emotional awareness and emotional intelligence in leadership teaching”, Journal of Education for Business, Vol. 79 No. 1, pp. 18-22.

Azcarraga, J., Marcos, N. and Suarez, M.T. (2014), “Modelling EEG signals for the prediction of academic emotions”, Workshop on Utilizing EEG Input in Intelligent Tutoring Systems, Honolulu.

Baker, R.S., D’Mello, S.K., Rodrigo, M.T. and Graesser, A.C. (2010), “Better to be frustrated than bored: the incidence, persistence, and impact of learners cognitive affective states during interactions with three different computer-based learning environments”, International Journal of Human-Computer Studies, Vol. 68 No. 4, pp. 223-241.

Bangor, A., Kortum, P.T. and Miller, J.T. (2008), “An empirical evaluation of the system usability scale”, Internationall Journal of Human-Computer Interaction, Vol. 24 No. 6, pp. 574-594.

Barr, J. and Gunawardena, A. (2012), “Classroom salon: a tool for social collaboration”, Proceedings of the 43rd ACM Technical Symposium on Computer Science Education, ACM, pp. 197-202.

Brooke, J. (1996), “SUS – a quick and dirty usability scale”, Usability Evaluation in Industry, Vol. 189, p. 194.

Burleson, W. (2006), “Affective learning companions: strategies for empathetic agents with realtime multimodal affective sensing to foster meta-cognitive and meta-affective approaches to learning, motivation, and perseverance”, PhD thesis, Massachusetts Institute of Technology, Cambridge, MA, available at: http://affect.media.mit.edu/pdfs/06.burleson-phd.pdf (accessed February 17, 2018).

Craig, S., Graesser, A., Sullins, J. and Gholson, B. (2004), “Affect and learning: an exploratory look into the role of affect in learning with autotutor”, Journal of Educational Media, Vol. 29 No. 3, pp. 241-250.

Davis, F.D. (1989), “Perceived usefulness, perceived ease of use, and user acceptance of information technology”, MIS Quarterly, Vol. 13 No. 3, pp. 319-340.