Designing For Multimodality

Course News

  • The deadline for the final report has been extended to Tuesday 4th January at 4.30pm These should be submitted to either Murray (murray.crease@nrc-cnrc.gc.ca) or Jo (jo.lumsden@nrc-cnrc.gc.ca) or handed in at the front desk of the NRC building. This differs from the original handout which stipulated a deadline of Monday 3rd January.

Course Outline – Fall Term 2004

 

Course Objective: At the end of this course students should have a good understanding of the many different issues that are related to the design of multimodal systems. A multimodal system is an interactive system that allows a user to interact using different input and/or output techniques (or modalities). Examples of such modalities are gesture input and haptic feedback. Topics covered include the fundamental concepts behind multimodal interaction; context and its impact on multimodal systems; user interface architectures; knowledge elicitation and modelling; multimodal design and experimental design.

 

Time                                       M, W 10:00 – 12:00

Room                                      NRC Training Room, 46 Dineen Drive

Instructor                             Dr. Murray Crease & Dr. Jo Lumsden

Office                                     NRC 257 & NRC 229

Office Hours                        By appointment via email.

E-mail                                    murray.crease@nrc-cnrc.gc.ca, jo.lumsden@nrc-cnrc.gc.ca

Course Web Site                 http://www.humanweb.ca/teaching/cs6905

Prerequisites                       Instructor discretion. Student numbers limited to 12.

Textbook(s)                           No prescribed course text. Course materials will be made available on the course website.

Marking Scheme                Team Assessments             20%

                                                Student Presentations         20%

                                                Practical                                 30%

                                                Final Report                          30%

Project(s)                              The course will require the submission of 4 team assignments on different stages in the construction of a multimodal system. The mark achieved for each assignment will not, however, depend upon the quality of any previous assignment. A final, individual report will also have to be submitted. This report should summarise the work undertaken on the four assignments and, in particular, should describe what improvements could be made based – in  part -  on the feedback given by the instructors regarding the team assignments and the course material.

                                                Each student will also be required to make a short presentation – with associated written material – to the class. These presentations will be in the form of mini-lectures with time set aside for questions. Marks will be awarded for the quality of presentation, quality of written report, knowledge of topic and interaction during other student’s presentations.

                                                A practical session will take place on the week of 25th October. This session will enable students to undertake a heuristic evaluation of a system provided by the instructors. Students will be expected to fill in a log with their findings and generate a short report summarising these findings.

Lab(s)                                     There are no scheduled labs.            

Tutorial                                 N/A

Participation                        Although attendance is not monitored, poor attendance may impact negatively on your final grade. If you need to miss class for medical or other significant reasons, please let one of the instructors know.

Schedule                               An ongoing, in-depth schedule for the course is available at the course website.

                                                Please Note: This schedule will be revised and updated as the term progresses. All information contained therein is subject to change. Students are advised to check the schedule at frequent intervals.

Teaching Schedule

Week Beg. (#)

Monday 10:00am – 12:00pm

Wednesday 10:00am – 12:00pm

Assignment :
Hand Out Date,
Hand In Date
Return Date

27th Sept (1)

General Introduction (MC)

PowerPoint Slides
PDF [colour | printable | handouts]

Definitions/Scenarios (MC)

PowerPoint Slides
PDF [colour | printable | handouts]

Assignment [doc | html]

Scenario:
29th Sep,
13th Oct,
18th Oct.

4th Oct (2)

User Interface Architectures (MC)

PowerPoint Slides
PDF [colour | printable | handouts]

Low Level Context (MC)

PowerPoint Slides
PDF [colour | printable | handouts]

 

11th Oct (3)

Interaction Paradigms  (JL)

PowerPoint Slides
PDF [colour | printable | handouts]

High-Level User-Focused Context of Use (JL)

PowerPoint Slides
PDF [colour | printable | handouts]

 

18th Oct (4)

Knowledge Elicitation & Evaluation Techniques  (JL)

PowerPoint Slides
PDF [colour | printable | handouts]

Assignment [doc | html]

Modelling and Architectures for Context Sensitivity and Multimodality (MC)

PowerPoint Slides
PDF [colour | printable | handouts]

Architecture Design:
18th Oct,
1st Nov
8th Nov

25th Oct (5)

Practical [doc | html]

No Class

 

1st Nov (6)

Designing the Front End – A Concrete Example (JL)

PowerPoint Slides
PDF [colour | printable | handouts]

Assignment [doc | html]

Design Guidelines (MC)

PowerPoint Slides
PDF [colour | printable | handouts]

Front End Design:
1st Nov,
10th Nov,
15th Nov.

8th Nov (7)

Experimental Design (JL)

PowerPoint Slides
PDF [colour | printable | handouts]

Toolkit Design (MC)

PowerPoint Slides
PDF [colour | printable | handouts]

Presentation Topics [doc | html]

Presentation Topics

15th Nov (8)

Multimodality Guidelines (JL)

PowerPoint Slides
PDF [colour | printable | handouts]

Assignment [doc | html]

Toolkit Design II – Input (MC)

PowerPoint Slides
PDF [colour | printable | handouts]

Evaluation Design:
15th Nov,
24th Nov,
29th Nov.

22nd Nov (9)

Student Presentations

10.00 - Audio Interaction (Zheng )

10.30 - Context Acquisition (Bernard)

Student Presentations

10.00 - Gestural Interaction (Weiwei)

10.30 - High Level Context (Megan)

11.00 - Transfer of Displays (Danny)

 Full Schedule

29th Nov (10)

Student Presentations

10.00 - Large, Public Displays (Beika)

10.30 - Evaluation Techniques (Aaron)

Question & Answer Session

PowerPoint Slides
PDF [colour | printable | handouts]

Final Report [doc | html]

Final Report:
1st Dec,
4th Jan
17th Jan