AI & Fairness - Case Study on a Grouping Feature

The development of a Grouping Feature aimed to address diverse knowledge levels while ensuring a sense of belonging to a class community. This project was part of a bigger research on "The missing teacher in AI" within the Applied IT Department at the University of Gothenburg.

Background

AI-based personalized learning has been viewed as a disruptive potential in education. The possibility to provide each student with individual learning activities adapted to their own needs and interests, seems to be a solution to the teacher shortage and other educational dilemmas. Nonetheless, schools have not only an educational but also a social responsibility, such as working with others, and discussing ideas while learning social norms and behavior, which can be considered a part of schools as well.

While teachers welcome the chance of individually fitted learning activities for each student, simultaneously they worry about missing opportunities to experience social belonging to a class community. This dilemma becomes especially evident when thinking about group activities within the classroom. Therefore the project aims to develop a function that supports teachers in grouping their students.

Objectives

• Develop a feature that is used on a co-creation basis between the teacher & AI.

  • Give the teacher the last hand, for decisions.

  • Let AI suggest groups, but allow changes by the teacher.

• Ensure fairness in grouping by giving multiple bases to group students.

My Role

I took on the role of the project and product manager of the project team, which consisted of 4 study colleagues of mine and me. This included structuring the overall work processes, documenting, facilitating work processes, and time management.

In my role as user researcher & tester, I was responsible for communicating with other stakeholders, finding and facilitating user research processes, and user tests, as well as evaluating and documenting insights.

Used Methodologies

Human-centered design

We used a human-centered iterative circle within the concept of a double-diamond-shaped design process (as seen in Norman, 2013).

Observations: Personal reflections, interviews, research

Idea Generation: Brainstorming & mind mapping

Prototyping: Pen & paper sketches, Figma

User Testing: open discussions & narrative walkthroughs

Design & Planning

Design Situation

The design situation is set in a Swedish compulsory school classroom where students work individually on tablets, and teachers aim to balance individualized learning with group activities to foster collaboration, motivation, and social belonging. The changing role of teachers from active instructors to learning facilitators poses a challenge in understanding students' progress and grouping them effectively.

Challenges & Solutions

All challenges were based on the research & specifics of the design situation.

Aspect of Grouping

• Teachers' Need for Versatility

  • Teachers want an adjustable grouping tool for various activities, including strengthening knowledge on specific topics or fostering social skills.

    • Functions: Choose Group Size, Add New Group, Pick Whom to Group

Grouping Options

Transparency & Avoiding

Decision-making & Flexibility

Prototypes

These mockups were built on the assumption of a functioning personalized learning system, that features each student with individual learning paths, small quizzes as well as questions on how hard the exercises were for them.

The feature is not specified to a subject, because this tool is a stand-alone feature. Using it in different situations would make it even better because the groups might look different then.

The teacher can pick a topic, the kind of exercise, and a specific task that has been suggested by AI. The workflow of picking the topic first and the groups afterward was chosen, because teachers said that this would reflect their procedure when they want students to learn something specific. However, if the product would be developed further it would make sense to add a reversed workflow that would start with grouping students, before picking a specific topic.

Grouping features 

There are three possibilities for grouping students:

Knowledge-based

• Grouping based on the same level or mixed level of knowledge

• Addressing teachers' concerns about learning from each other

Interest-based

• Grouping based on students shared interests

• Motivating them with topics they find intrinsically interesting

Random

• Random grouping, favored by teachers for equality and speed

• Teachers can adapt and make changes to the randomly generated groups

Adaptions by the Teacher

Three possible adaptions by teachers were defined and prototyped in detail:

Picking students

• Teachers can manually select students for group activities, syncing with the attendance record to streamline the process.

Adding no-gos

• Teachers can specify dependencies to avoid pairing certain students, reflecting real-world considerations
  

Editing AI-based group suggestions

• AI suggests groups based on entered and retrieved data, allowing manual changes

• Teachers can save adaptations temporarily or long-term to train the AI

User - Testing

The user testing showed valuable insights for further refinement (see more here).

• Interface Improvements 

  • Suggestions for clearer wording

  • A home button

  • Drag-and-drop options for quick changes

• Enhanced Functionality

  • Considerations for additional features like social groups, empowerment buttons, and a mix of random and knowledge-based grouping

• Tool Efficiency

  • Emphasis on the tool being faster than manual grouping

  • Facilitating last-minute changes.

Conclusion

The project successfully navigated through iterative design cycles, addressing the complex challenges of grouping students in a personalized learning environment. The prototype presented features that catered to teachers' needs, fostering a sense of transparency, flexibility, and control. While recognizing open questions for future research, the design solution aimed to contribute to ongoing efforts in enhancing classroom dynamics through AI-powered tools.

Main Learnings & Competences

Competences developed within this project:

• Creating mock-ups in Figma

• Facilitating User interviews & tests

• Developing an innovative product from scratch

• Working with an intercultural team from China, Lebanon, Sweden & India

• Managing a team in person & online

• Presenting prototypes to experts and possible users