Memory Matching Game

A multi-sensory learning experience for young children

Educational AR Unity

Overview

Memory Matching Game is intended for young children to learn about their favourite farm animals! It is a multi-sensory learning experience that aims to improve spatial thinking skills and the motoric development of young children.

Two players play the game asymmetrically, each having different capabilities and roles within the game. One plays using headphones and audio cues, while the other has a tablet and follows visual cues.

Each player plays with a randomized set of memory cards (featuring tracking markers) and tries to match their cards with the other player.

Asymmetric Gameplay

Each player has a different role in the game:

Audio Player

  • Uses headphones for audio cues
  • Hears farm animal sounds
  • Must communicate what they hear
  • Experiences purely auditory information

Visual Player

  • Uses tablet for visual cues
  • Sees farm animal images
  • Must describe what they see
  • Experiences purely visual information

Game Loop

After a playing field is set up, the game consists of 3 main stages:

1. Lock

Players turn around their respective game cards to choose which they want to compare and lock these choices in. The Audio player gets a cue on their headphones while the Visual Player gets to see their animal on the tablet. Neither knows about the information of the other player.

2. Discuss

The players are now encouraged to discuss their respective (auditory or visual) information. This promotes communication and collaborative problem-solving between the children.

3. Compare

Players push their cards together to compare if it's a match or not. This creates a physical interaction and reveals whether their communication was successful.

Educational Goals

  • Spatial Thinking: Understanding relationships between objects and positions
  • Motoric Development: Physical interaction with cards and devices
  • Communication: Describing and discussing sensory information
  • Multi-Sensory Learning: Connecting visual and auditory information

Technical Implementation

The game is built in Unity with AR Foundation. Physical memory cards carry tracking markers that are recognized by the tablet, and audio and visual cues are synchronized across the two devices. Card sets are randomized each round.

Development & Research

This project was developed as a practical project for 3D User Interfaces at TUM (Technical University of Munich). It represents a research-oriented approach to educational game design and AR interaction.

Evaluation

The project was evaluated with parents of the target audience. The evaluation informed the game mechanics, in particular around child interaction patterns and the need for clear communication prompts in asymmetric gameplay.