Mobility for All:
architecture and technology demo
• approach
• architecture
• technology demo
• future work
Jim Sullivan
Co-Director, Cognitive Levers Project
Center for LifeLong Learning and Design
james.sullivan@colorado.edu
Alexander Repenning
CEO and President
AgentSheets, Inc.
alexander@agentsheets.com
1
Old approach: “fit the user into the system”
“Here is your map ….
You live here …
Your destination is here …
Your bus will have this label…
When you see this landmark,
remember to pull the cable on
the bus so the driver knows you
will get off at the next stop.
This is where you will get off…
Don’t forget your backpack!
OK, now let’s talk about the
schedule …. do you know how to
read a clock? … “
2
New approach: design a system to “fit the user”
my drawing
of my house
my bus
my mom
works here
things I have to
remember
other things I can do
3
Mobile architecture
data servers
wireless networks
mobile
internet
internet
backbone
mobility agents
transportation systems
mobile users
support communities
4
Technology demonstration components
constructive
distance to
person/stop
agent mediated
attention & memory
prompts
virtual
GPS
vehicle
locations
real
5
“Constructive” solution for mobile users
Proof-of-concept of a location-aware, mobile
device that:
• gives personalized, logical choices
(based on location, time of day and week, abilities,
etc.)
• provides multi-modal information and
feedback in response to user choices and
actions.
• communicates with a “virtual”
transportation system (and potentially other
sources of information) to:
 locate the “right bus”
 prepare for boarding
 get on the “right bus”
 prepare to get off at the “right” location
 reward good performance
 provide “cognitive post-its” to remember items
easily forgotten in a complex itinerary
6
Virtual 3D/real-time display
For caregivers:
Supports preparation and training:
• to better visualize/understand/interact with a complex and dynamic
system
• to design see how personalized user prompts (prompting content &
sequence, preparation time, prompting frequency, etc.) will interact with
real-time vehicles.
Support real-time monitoring and assessment:
• use a 3D real-time display to make “confederate observations” of
MULTIPLE users
• determine real-time errors, and offer contextualized, real-time help
• review performance errors, and create training/intervention strategies
7
Real-time tracked busses
Simulated person
Speech recognition
8
Research hypotheses
• independence: mobile architecture will afford an ability to
learn more routes, leading to increased independence.
• learning: instantiates an “errorless learning” strategy;
supports learning and using “individually relevant” routes.
• efficiencies: less time to learn a route; more time to learn
different routes; allows overworked therapists to identify and
focus on users with greatest needs.
• personalization: memory and attention prompts can be
contextualized and dynamically tailored to suit user needs.
• safety: dynamic error detection and recovery strategies can
incorporate both automated and human intervention.
• assessment: can collect real-time data for development,
user training and personalization, while avoiding abandonment.
• scale: can be used in other transportation systems with bus
GPS infrastructure technologies (see nextbus.com).
many potential “space program” applications!
9
Mobility for All - future work
• architecture integration (goal: seamless “look and
feel” for user communities)
• error detection and recovery (“panic button”)
• caregiver feedback (identify training and technology
needs, script creation and modification)
• personalization technologies (customizable by
caregivers; adaptable to users; engaging to use; supportive of
learning and growth)
• test and evaluation on a mobile, wireless
platform
10
Cognitive Levers Project
sponsored by the Coleman Institute
11