Project Ideas

Not an exhaustive list, and likely somewhat out of date, but at least represents the kinds of projects we will do, depending on needs, lab research goals, and fit to 8803 students' skills and interests.

Additional and New project ideas for Spring 2019:

Project name: SPAM program development and evaluation
Brief description: Using the server that Rohan has developed, build a GUI that allows for easy input of and response to SPAM questions for use during driving experiments. This should also collect the following data:
* timestamp for:
* ready prompt presented, ready prompt accepted, question presented, answer chosen
* content for:
* question presented
* choices presented
* answer chosen
* answer accuracy
* participant number
The program should be able to run on a windows computer and participant input should be able to be given via the Panasonic touch screen in the driving simulator.
The program should multiple question options for each question point throughout the experiment with randomized presentation of each question.
Project name: Influence of musical skills/practice on learning complex sonification mappings
Brief description: Lots of experiments have proposed that musical training may influence the ability to learn sonification mappings. But does it really have an effect?
* Milestone 1: explore musical sophistication scales (e.g., jonathan and grace's work) and see if any other studies have tried to do this (Lit review type thing)
* Milestone 2: build out a study design looking at complex sonifications + measuring musical skills (could use the audio from jonathan's study) + IRB
* Milestone 3: pilot the study and then collect data
Project name: School Bus Information System - Mobile app, and web-app
Brief description: We are developing a comprehensive system to provide information to parents, teachers, and drivers about the location and status of school buses. There are 4 components: the parents' app; the school transportation coordinators' tablet app; the bus service's web portal; and the drivers' app. Most of these have been researched. This project is about implementing functional prototypes and actual working versions, services.
* Milestone 1: Wireframes based on design research (much of which has already been done)
* Milestone 2: Built apps using prototyping tools or full-scale development tools (e.g., sketch, React Native, etc.)
* Milestone 3: Evaluate and refine
Project name: Super SID Space Weather Monitor
Brief description: Using a SuperSID and sonifying/audifying the data from it. This is a small radio-weather telescope. Could additionally explore radio jove, and other Society of Radio Astronomers (SARA) projects to find an interesting dataset to work with! Most of this will be a design project (maybe with some evaluation Exploring the possibility of doing a sonification project with this. (details TBD)
* Milestone 1: Get all the materials set up for this: after making the choice, buy the thing, or get the data set from the group
* Milestone 2: First set of mappings/sonification process done
* Milestone 3: Updated round of sonification/mappings done
Project name: OpenStreetMaps Database Population App
Brief description: This project would be to develop and app to interface with openstreetmaps, which is what Microsoft Soundscape pulls objects from. The app would be tailored toward allowing a lay person to easily locate and appropriately tag permanent-ish objects, either indoors or outdoors. Such a database could also be used by another SWAN offshoot (see below).
* Milestone 1: App wireframes and selection of appropriate tags
* Milestone 2: Vertical slice of app functionality including backend
* Milestone 3: Completed app
Project name: SWAN Mobile Building Preview App
Brief description: This project would be conducted in concert or as a followup to the openstreetmaps project. Many participants in the SWAN study asked for a "virtual preview" version of the system. What this app would do is allow a user to virtually explore a building, just before entering, via a Unity soundscape on their iPhone. To achieve this, you would provide a UI where the user could select from a list of nearby building entrances or other reference/sync points (¥J.S. Coon, Ferst and Cherry entrance¥). Then, they could use the iPhone as a ¥joystick¥ to walk through a soundscape representation of the building, which would be populated using crowdsourced objects (with appropriate metadata tags) placed in openstreetmaps. You could also have an experimental MR mode for the system, that would utilize ARKit to provide situated exploration relative to the sync points (but that wouldn¥t be the focus). These types of virtual previews are extremely effective when done in VR, but it¥s never been deployed like this, where a person could just pull it up while riding the bus over to a building, or right outside. This project would need substantial programming and Unity expertise.
* Milestone 1: App wireframes and technical feasibility assessment/ implementation plan
* Milestone 2: Vertical slice of app functionality including backend
* Milestone 3: Completed app
Project name: Spearcons learning/transfer work
Brief description: Can learning/training on a subset of spearcons help people transfer knowledge of one set to another leading to faster recognition of new ones, or better accuracy for a really large set. Does domain matter/bias the ability for these to work now?
* Milestone 1: Choose spearcon set and decide on methodology
* Milestone 2: build out experiment and do the IRB
* Milestone 3: data collection
Project name: Accessible Amazon echo
Brief description: teaching amazon echo to recognize different pitches instead of speech to help people who have trouble speaking
* Milestone 1: test feasibility of this with the Amazon Echo API, storyboard the interaction
* Milestone 2: build out the recognizer for it (v1)
* Milestone 3: iterate and update to v2 + some early testing
Project name: SWAN 2.0++
Brief description: Does shifting sounds slightly from a more real-time mapping to fit a more musical beat/structure/soundscape make it easier for people to learn and have a better aesthetic response when navigating an indoor space?
* Milestone 1: design examples of sound shifts using the programing from SWAN 2.0/the audio for the courses
* Milestone 2: build out full set for evaluation
* Milestone 3: IRB/test!
Project name: Musical Piece Analysis Visualizer
Brief description: At the Atlanta Botanical Gardens, they have an interesting area where the music and RGB LEDs are used to make an audio+visual show. There might be something interesting here about building a way to recognize patterns from music or data and to visualize those patterns from a huge dataset. Note: not sure exactly how this would go, was mostly a random idea.
* Milestone 1:
* Milestone 2:
* Milestone 3:
Project name: Effect of audio/the multimedia effect on germane and extrinsic cognitive load for PhET simulations
Brief description: Mayer's multimedia principle has found (numerous times) that audio from narration or text description, in addition to visuals, can help students have better germane load when learning concepts. Exploration of this for one of the latter sims, such as GFL:B or FL may find whether or not there are effects to cognitive load during learning for students when using visuals + sonifications.
* Milestone 1: design study for measuring the cognitive load, following Mayer's multimedia studies
* Milestone 2: irb + pilot testing
* Milestone 3: data collection + analysis
Project name: Personalized Driving Displays for Automated Vehicles
Brief description: This goal of this project is to design HUDs for highly automated vehicles that correspond with specific driving styles (thrill-seeking, transit, and defensive). HUDs have already been designed for the transit and defensive driving style. Focus groups need to be conducted to determine what driving behavior users associate with thrill-seeking drivers. Following the focus groups, a HUD will be designed.
* Milestone 1: Design focus group and recruit partipcants
* Milestone 2: Data collection + analysis
* Milestone 3: Design HUD for thrill-seeking driving
Project name: Designing Interactions for Auditory Reactions on Facebook
Brief description: Sonifications show great promise in improving the usability of Facebook Reactions for sighted and visually-impaired Facebook users. Our studies have found that certain types of sounds are highly effective at conveying specific emotions. However, we have yet to explore the design of an interface that accommodate this new mode of interaction. Students working on this project will dive in the literature of auditory interfaces, affective computing, and accessible computing, develop low and high fidelity prototypes of user interfaces, and evaluate these interfaces with real world users.
* Milestone 1: Survey of the literature: What has been done? What works, What doesn't?
* Milestone 2: Develop low fidelity prototypes of multiple interfaces for Auditory Reactions on Facebook
* Milestone 3: Down-select to 1-3 prototypes that will be mocked-up for usability testing
* Milestone 4: Run usability tests with real world users
Project name: Presenting Auditory Facebook Reactions in Facebook Posts
Brief description: Auditory displays have been successful at effectively conveying information to individuals living with visual-impairments. However, sighted people frequently encounter situational visual impairments. For example, one cannot focus visual attention on a phone while driving a vehicle. In scenarios such as this, an auditory interface would be ideal for delivering information to the user. Students working on this project will explore the literature of auditory interfaces and communications research, develop prototypes of different presentations of Auditory Facebook posts, and evaluate their designs with real world users.
* Milestone 1: Survey of the literature: What¥s been done? What works, What doesn¥t?
* Milestone 2: Develop low fidelity prototypes of multiple interfaces for Auditory Reactions on Facebook
* Milestone 3: Down-select to 1-3 prototypes that will be mocked-up for usability testing
* Milestone 4: Run usability tests with real world users

Ongoing topic areas under consideration:

* Integrate sensors, cameras, LEAP, Kinect, etc.
* Eye tracking in simulator
* IVAT applications
* Driving research
* Simulator maps, models, scripting, tools
Sonification Projects:
* Weather data sonification
* Gorilla movement/tracking data
* Accessible Fantasy Football sonification
* Aquarium/fish/critter data
* Aquarium fugue interactive exhibit
* Brainwave sonification
* Discus tracking/sonification of track and field movements
* Rowing sonification 2.0
* Other sports/human movement sonification (javelin, dance, walking)
* Sonification of GAIT with artificial limb/leg
* Sonification of prosthesis movement/alignment/error/grip/etc.
* Sonification of star birth/life/death cycle
Weather Station
* Set up weather station equipment, connect to it to get data, and log, graph, and sonify data
SWAN 2.0
* Indoor localization using UWB
* VR/AR-based wayfinding system
Accessible MOOCs
Accessible ILEs (Aquarium, Zoo, Science Museum)
Accessible Stats
* develop software (SAS, r, SPSS?)
* evaluate, iterate
* deploy in the field (schools?)
Math for the Blind
* GNIE extensions-line drawing and curves
* GNIE extensions-bar graph
* GNIE extensions-other graph families (pie?)
* GNIE extensions-support for figures, 3D shapes, 3D graphs?
* GNIE extensions-support for word problems
* GNIE extensions-export student answers to 'hand in' version
* GNIE extensions-question generation or/and bulk import of questions by teacher (not one-by-one in GNIE, itself)
Sonification Sandbox - Web version
Electronic White Cane Handle
Accessible Games
* Navy-ish (Navy 2.0)
* Battleship (coordinate plane)
* Other math/numeric games
* Lemonade Stand
* Fantasy Football, Baseball, Hockey, etc.
* Ergonometer/stationary bike to generate power for video games and cell phone charging in Africa
Symmetry and Usability
* Eye tracking of symmetrical/asymmetrical interfaces
* Food and music - Behavior reinforcement of proper eating habits via gamification (a sequencer game w/ fruit icons vs fatty foods- fruit icons are predictable and pleasant, fatty foods and chaotic and dissonant; promotes affective response to healthier foods)
* Music practice tool - promoting proper practice habits with auditory feedback
* Passive environmental sonification (sonifying current traffic conditions, weather, etc, in an always-on manner; aesthetic enough to not be turned off, effective enough to be kept on)
* Use LEAP as a conductor training tool