Interaction Geography Slicer (IGS)
The IGS is an open-source, dynamic visualization tool that provides novel ways to visualize movement, conversation, and audio/video data over space and time. This tool is designed to work with movement data collected automatically through location-based technologies or manually through Mondrian Transcription Software. This page will get you started with how to use the interface, read space-time visualizations produced by this tool, and format your own data to upload and explore with the IGS. We are rapidly developing and expanding IGS features and collaborators in this effort are welcome, please reach out to us or contribute to the GitHub repo.
Interface
The image above shows a teachers movement as a purple path (thicker parts of the path is where the teacher is not moving) and all classroom conversation turns as rectangles (color indicates speaker) during a classroom science lesson from the TIMSS 1999 Video Study (see credits below). This 3D view is one of many possible views within the IGS. In this view movement and conversation are shown over a floor plan and also over a timeline that extends upwards providing a way to see how movement and conversation unfold over both space and time. The IGS’s interface consists of 4 components as marked in the figure:
Load Data & Sample Data Menu: where you can explore different sample datasets and import your own data
Canvas: where all data is visualized in 2D or 3D views over a floor plan and a timeline
Interactive Timeline: displays the time range of all imported data and can be dynamically rescaled to selectively study data
Interaction Tabs: where you can selectively study and dynamically interact with data in different ways
How To Use
This demonstration video provides a brief overview of how to read and use the IGS to visually explore different datasets and load your own data. This video uses example data from Michael Jordan’s last shot and from a classroom science lesson to illustrate IGS features and concludes by showing how to load your own data.
Additional Views
The IGS can display data in 2D and 3D views and supports animation and interaction with data in different ways. The first image below shows the IGS 3D view from a family museum gallery visit as the family’s movement, conversation and video data are being animated over space and time.The second image shows the IGS 2D view of a classroom science lesson where the vertical dimension of the timeline corresponds to the vertical dimension of the floor plan. This “flattened” version of the 3D view allows for more detailed analysis of data and more interactive capabilities not possible in 3D such as hovering over and reading individual conversation turns.
How To Format Data
To use your own data in the IGS, you need at least a floor plan/image file and one movement file formatted in the ways described below. You can also include conversation, video and code files formatted in the ways described below.
Required Data
Floor plan/Image File (PNG/JPG)
You will need a floor plan image file in PNG or JPG format. A floor plan is a type of drawing that shows you the layout of a space from above. You can create a floor plan image file by hand and take a picture or use software such as Adobe Illustrator or AutoCAD to create a higher quality image file. Figure 1 shows an example floor plan image.
Movement File(s) (CSV)
Creating movement file(s): If you do not have positioning data collected by location-based technology that can be formatted in the file format below, you can use Mondrian Transcription Software to transcribe and create movement files from video in the exact format described below. Make sure the floor plan image file you use to record your data is the same file you import into the IGS.
Movement File Format: Your movement files must be formatted as a CSV file as shown below with columns labeled: “time” with whole number or decimal values corresponding to seconds elapsed from 0 seconds and “x” and “y” with whole number or decimal values corresponding to a pixel position on your floor plan image file. Your file should be sorted in ascending order by time (smallest to largest time values).
Note: the filename of your movement file will become its label in the IGS interface.
Optional Data
Video File (MP4)
Your video must be in a MP4 format. This is the only video format that currently works across all modern web browsers. If you need to convert your video from a different format: For small videos a few minutes in length you can use the free, secure and web-based CloudConvert. For larger videos, use either a video editor or the free, secure and safe 4K Video Downloader. The length of your video in seconds should be roughly the same as the largest time value of your movement file(s).
Conversation File (CSV)
Your single conversation file must be formatted as a CSV file as shown below and can be created using software such as Microsoft Excel. Each row is a single conversation turn spoken by a single speaker with columns labeled: time with whole number or decimal values corresponding to seconds elapsed from 0 seconds indicating when a conversation turn is spoken (you do not need to start at 0 seconds); speaker with text of any length indicating who speaks a conversation turn (you can have as many speakers you like); talk with text of any length indicating the conversation turn spoken. Your file should be sorted in ascending order by time (smallest to largest time values).
Note: To match individual speakers with individual movement paths in the IGS, the FILENAME of your movement CSV file should match the corresponding speaker listed in your conversation table. Conversation file time ranges should be between the starting and ending values of your largest movement file.
Code File(s) (CSV)
Code files allow you to highlight movement and conversation data over space and time in the IGS that occur during periods of time marked in the code file. For example, you can use code files to mark changes in a lesson plan or when someone is holding an artifact. There are two ways to format code files depending on your needs and what approach works best for your data:
Single Code File: Each file is a set of time periods that relate to the same code. The name of your file indicates the name of your code in the IGS. Code files must be formatted as a CSV file as shown below with columns labeled: “start” and “end” with whole number or decimal values corresponding to seconds elapsed from 0. Code files must be sorted in ascending order (from smallest to largest start times). You can have as many single code files as you like allowing you to selectively study single and simultaneously occurring codes in the IGS.
Multi-Code File: This format allows you to create a single file with many different codes. Code files must be formatted as a CSV file as shown below with columns labeled: “code” with text indicating the name of a code that appears in the IGS and “start” and “end” with whole number or decimal values corresponding to seconds elapsed from 0. The file must be sorted in ascending order (from smallest to largest start times). You can only have one multi-code file.
Credits/License
This software is written in JavaScript and p5.js and uses YouTube and Kaltura Video Player APIs and the PapaParse library by Matt Holt for CSV file processing. This software is licensed under the GNU General Public License Version 2.0. See the GNU General Public License included with this software for more details. Classroom discussion example data is used with special permission from Mathematics Teaching and Learning to Teach (MTLT), University of Michigan. (2010). Sean Numbers-Ofala. Classroom science lesson data is made possible by the researchers and teachers who created The Third International Mathematics and Science Study (TIMSS) 1999 Video Study. IGS software was originally developed by Ben Rydal Shapiro at Vanderbilt University as part of his dissertation titled Interaction Geography & the Learning Sciences. Copyright (C) 2018 Ben Rydal Shapiro, and contributors. To reference or read more about this work visit HERE