66-135: Grand Challenge First Year Seminar - Designing Better Human-AI Futures
Spring 2022: Tues & Thurs, 11:50am-1:10pm (GHC 4102)
Important
- All content will be here on github including schedule
- All assignments will be on and submitted through canvas
- Class communication and announcements will be primarily through email and Slack
Instructors
Rayid Ghani | Conrad Tucker |
---|---|
GHC 8023 Office Hours: Tue 3-4pm, Wed 4-5pm |
Wean 4202 Office Hours: TBD |
Thank you to Molly Steenson for helping create this class and providing valuable advice and content in designing it.
Course Description
How do we design AI systems that work for everyone and help create a more equitable society? Who needs to be involved in desgining these systems? Designers? Engineers? Social Scientists? Computer Scientists? Statisticians? Policymakers? The Public? What should the AI systems be designed to do and achieve? How do they affect society? How should they affect society? What role can all of us play in creating a future where AI can help us become a more equitable society?
In this class, through creating, sharing, watching, debating, playing, discussing, engaging, observing, and reading, we will go over these types of questions, exploring and discussing what AI is, how it affects society, how it’s designed today, and how it could and shoud be designed.
Buzzwords we will use in this class: Artificial Intelligence, Design (Human-Centered Design, Iterative Design, Participatory Design, Value-Sensitive Design), Values (Social, Ethical, Policy, Business), Stakeholders
What we want you (the students) to learn
- Develop critical and analytical skills on issues related to AI and how it impacts people, the public, and society
- Familiarize yourself with how AI systems are affecting different aspects of society
- Understand how these AI systems are being designed, developed, and evaluated today
- Experience collaborating with diverse and representative stakeholders that should be involved in the design of AI systems
- Explore how these AI systems could (and should) be designed, developed, and evaluated
- Develop and communicate your perspectives on AI systems to a broad audience
Class Structure and Topics
This class introduces students to the opportunities and challenges in building human-AI collaborative decision-making systems for societal domains such as health, education, criminal justice, transportation, education, and employment. We take a design approach to issues around the development of AI systems, including working with communities and stakeholders to identify what the AI system is being designed to achieve, designing the system to attempt to achieve those values, and evaluating it on how it impacts humans and society. We approach the design of AI as a system that needs continual improvement and redesign in order to reduce the risk of biases that may be inherent not only in the data acquired to develop the AI system, but also the biases of the teams that design the AI algorithms, the biases in the design of the AI algorithms themselves, as well as biases in how actions are taken using the outputs of the AI system.
Module 1: Intro and Primer on AI and Design Thinking
- Intro to AI
- AI Use cases
- AI and Business Case Studies
- AI and Society Case Studies
- What is AI?
- What can it do?
- How does it do what it does?
- How is it designed?
- AI Use cases
- Intro to Design Thinking, Value-Sensitive and Human-Centered Design, and Participatory Research Methods
- Human-Centered Design
- Value-Sensitive Design
- Participatory Research Methods
Module 2: What values should an AI system have?
- Intro to ethics and value systems
- Examples
- How to infer the values of an existing system?
- How to collaboratively and inclusively determine the values a system should have?
Module 3: How do you design an AI system to achieve its intended values?
- What components should you include?
- How should each component be designed?
- What data should the system use?
- What goals should it have?
- How should it be instructed/programmed to achieve those goals?
Module 4: How do you validate that the AI system achieved those values?
- What should the evaluation methodology be?
- What role do qualitative methods play?
- What role do quantitative methods play?
- Examples and Case Studies
Module 5: How do you detect biases and what can you do to mitigate its equity impacts?
- What does it mean for an AI system to be biased?
- Sources of bias in AI systems
- How to detect the different types of biases
- How to reduce them?
- How to mitigate their equity impact?
Grading
You will be fine if you engage with the content, with your fellow students, with the guest speakers, and with us (the instructors). We want you to participate nd contribute to the class - through being there, and through discussion, debate, and writing.
- Team Project (60%):
- Project Proposal (5%)
- Project Assignments (15%)
- Project Presentations (20%)
- Project Reports (20%)
- Reflections and quizzes on readings and concepts (10%)
- Class attendance, discussion, and participation (20%)
- Submitting weekly reflections (10%)
Team Projects
Students will form teams and propose an area where AI is affecting society to focus on for the semester. These areas may include issues such as healthcare, hiring, entertainment, criminal justice, social networks, education, etc. The project will have the following components:
- Background research: What types of AI systems have been developed in this areas? What do they do? Who has designed them? Who is using them? How well are they working? What are some benefits of it? What are some criticisms? How much information is available about them?
- Existing Values: What ethical, social, and business values have been encoded in the current systems? How (and by whom) are the tradeoffs determined?
- Desired Values: What values should it have? Who needs to be involved in determining these values? How should those values be disclosed and verified?
- AI System Design and Development: What AI components are needed to build a system that achieves the desired values? How should they be put together? What should they
- AI System Validation: How will you validate that the AI system is doing what it was designed to do? How will you validate that it is having the impact it was designed to have?
- Dealing with Bias and Equity: What could be some of the biases that could be embedded in the AI system? How could it impact equity for specific groups affected by the AI system?
Propject Assignments
Each team will submit short assignments, do presentations, and lead as well as participate in discussions around these components for the issue you propose to work on through the semester.
- Project Proposal (Due Feb 7th)
- Peer Reviews of the Project Proposal (due Feb14th)
- Project Proposal Presentation (Feb 10th) (5 minute presentation in class)
- Writing and presentation assignments throughout the semester
- Final Project Report (due the week of finals)
- Final Project Presentation (last week of classes)
Schedule (subject to change)
Jan 18: Intro and Class Overview
Jan 20: How is AI being used today in the business world?
Before Class: Read or watch at least one of the articles and videos below (and at least skim the others) and come to class prepared to discuss them.
Readings and Videos:
- 27 Examples of Artificial Intelligence Shaking Up Business as Usual
- The Algorithms that make Instacart Roll
- Self Driving Cars: CNN tests a ‘full self-driving’ Tesla,Self Driving Trucks
- 50 AI Examples from thje World’s biggest Companies
- Robots abd Retail A BBC Video
Jan 25: How is AI being used to tackle societal issues?
Before Class: Read or watch at 2-3 of the articles and videos below (and at least skim the others) and come to class prepared to discuss them. Readings and Videos:
- AI for Social Good - Overview Paper
- Matching people in need to social services to benefits
- Reducing Jail Recidivism
- Prioritizing EPA inspections to Reduce Hazardous Waste Disposal Violations
- Early Screenings to Reduce Type II Diabetes
- Proactive Lead Inspections to Reduce Lead Poisoning in Children
- How Science Could Help Prevent Police Shootings, Additional article
Assignment: Submit the topics (on canvas) you’re interested in for your class project in order for us to make teams.
Jan 27: What is AI, what can it do, and how does it work
Before Class: Read the articles linked below and come to class prepared to discuss them.
Readings:
- You look like a thing and I love you, by Jannelle Shane Chapters 1 and 2 - canvas link
- Machine Learning (Book Chapter from Big Data and Social Science). Read sections 7.1 through 7.5
Feb 1: What is AI, what can it do, and how does it work
Before Class: Watch the video linked below and come to class prepared to discuss it. Readings and Videos:
- Lecture Video from 10301 Class at CMU (Taught by Matt Gormley) (Watch the first hour)
Feb 3: What is AI, what can it do, and how does it work
Before Class: Read the articles linked below and come to class prepared to discuss them.
Readings and Videos:
Feb 8: Design Thinking and AI
- Useless AI workshop (with Molly Steenson)
Assignment: Project Proposal due Feb 7th
Feb 10: Project Proposal Presentations
Assignment: Project Proposal Presentation (in class)
- Each team will have 5 minutes for their presentation and 3 minutes for questions from the class. We will need to be strict on the timing to make sure everyone has enough time to present.
- Please upload your slides on canvas as an assignment as a PDF, PowerPoint file, or link to google slides prior to your group presentation.
Feb 15: How do we figure out what AI we should build
- Intro to Ethics and Value Systems: Guest Lecture by Alex London
Assignment: Project Proposal Reviews due Feb 14th
Before Class: Please read the first paper and at least skim the second reading and come to class prepared to discuss it. We know these readings are a little more intense than others we’ve done this semester but this is an important topic and one we want to make sure we cover as we get in to project work. We’ll come back to these concepts around values throughout the semester so don’t feel as if you have to understand everything the first time. Readings:
- AI4People - An Ethical Framework for a Good AI Society: Opportunities, Risks, Principles, and Recommendations
- A Theory of Justice by Rawls, J. 1971. Chapter 1: Justice as Fairness, pp. 1-19. Available Online
Feb 17: Recap of Module 1: Intro to AI, Design Thinking, and Ethics
Readings:
Feb 22: How do we figure out what AI we should build
Feb 24: How do we figure out what AI we should build
- Value Sensitive Design (with Molly Steenson) Lecture Slides
Readings:
- Human values matter: why value-sensitive design should be part of every UX designer’s toolkit
- Value Sensitive Design and Information Systems(Skim this reading)
Mar 1: How do we figure out what AI we should build
Mar 3: How do we figure out how to tell AI what it needs to do
Readings:
- Gitelman and Jackson, Raw Data is an Oxymoron (Introduction)
- Optional: O’Neil, On Being a Data Skeptic
Mar 8: Spring Break (No Class)
Mar 10: Spring Break (No Class)
Mar 15: How do we figure out how to tell AI what it needs to do
Mar 17: How do we figure out how to tell AI what it needs to do
Mar 22: How do we figure out how to tell AI what it needs to do
- Slides
- Project Discussion: We’ll break up into groups an discuss AI design choices covered in the last two classes for the projects
Mar 24: How do we figure out how to tell AI what it needs to do
- Tech Demo
Mar 29: How do we evaluate and monitor what has been built
Assignment: Developing an AI System assignment due March 28
Mar 31: How do we evaluate and monitor what has been built
Apr 5: How do we evaluate and monitor what has been built
Assignment: Developing an AI System assignment due April 4
Apr 7: No Class
Apr 12: Project Update Presentations: Focus on how you would train the models and what evaluation metric you would use
Assignment: 5-minute Project Update Presentations
Apr 14: Bias and AI deeper dive
- Focus on Sources of bias when designing AI systems Slides
Readings:
Apr 19 Bias and AI deeper dive
- Guest Lecture by Mike Skirpan
Readings:
Apr 21: Bias and AI deeper dive
- Detecting and Mitigating Bias in AI systems
Apr 26: Final Presentations
Apr 28: Final Presentations
May 5: Finals Week (No final for this class) Final Report Due
Class attendance and participation
Class attendance and participation are critical in this course. To account for this, a portion of the final grade is based on your regular attendance and active participation (see grading section). That said, we also recognize that students may need to miss class for a variety of reasons, especially with the situation we are in currently. When you must miss class, please notify us (at least 24 hours in advance except for illness/emergency), so that we can discuss alternative arrangements for catching up on class and associated work. If you encounter extenuating circumstances and must miss more than two classes, please come and discuss with us; we would like to find a way to support you.
Take Care of Yourself
This not just something we’re writing and saying but we sincerely mean. Take care of yourself - mentally, physically, and in any other way you can think of.
But also, use this class as an opportunity to get to know your classmates and have conversations you might not have otherwise had. Seek out connections with each other and with us, and catch up with each other in all the online modes you use until we can (physically) be in class.
Do your best to maintain a healthy lifestyle this semester by eating well, exercising, avoiding drugs and alcohol, getting enough sleep and taking some time to relax. This will help you achieve your goals and cope with stress. All of us benefit from support during times of struggle. You are not alone. There are many helpful resources available on campus and an important part of the college experience is learning how to ask for help. Asking for support sooner rather than later is often helpful. If you or anyone you know experiences any academic stress, difficult life events, or feelings like anxiety or depression, we strongly encourage you to seek support. Counseling and Psychological Services (CaPS) is here to help: call 412-268-2922 and visit their website at http://www.cmu.edu/counseling/. Consider reaching out to a friend, faculty or family member you trust for help getting connected to the support that can help.
Accommodations for Students with Disabilities:
If you have a disability and have an accommodations letter from the Disability Resources office, I encourage you to discuss your accommodations and needs with us as early in the semester as possible. We will work with you to ensure that accommodations are provided as appropriate. If you suspect that you may have a disability and would benefit from accommodations but are not yet registered with the Office of Disability Resources, I encourage you to contact them at access@andrew.cmu.edu.
Diversity Statement: We must treat every individual with respect. We are diverse in many ways, and this diversity is fundamental to building and maintaining an equitable and inclusive campus community. Diversity can refer to multiple ways that we identify ourselves, including but not limited to race, color, national origin, language, sex, disability, age, sexual orientation, gender identity, religion, creed, ancestry, belief, veteran status, or genetic information. Each of these diverse identities, along with many others not mentioned here, shape the perspectives our students, faculty, and staff bring to our campus. We, at CMU, will work to promote diversity, equity and inclusion not only because diversity fuels excellence and innovation, but because we want to pursue justice. We acknowledge our imperfections while we also fully commit to the work, inside and outside of our classrooms, of building and sustaining a campus community that increasingly embraces these core values.
Each of us is responsible for creating a safer, more inclusive environment. Unfortunately, incidents of bias or discrimination do occur, whether intentional or unintentional. They contribute to creating an unwelcoming environment for individuals and groups at the university. Therefore, the university encourages anyone who experiences or observes unfair or hostile treatment on the basis of identity to speak out for justice and support, within the moment of the incident or after the incident has passed. Anyone can share these experiences using the following resources:
- Center for Student Diversity and Inclusion: csdi@andrew.cmu.edu, (412) 268-2150
- Report-It online anonymous reporting platform: reportit.net username: tartans password: plaid
All reports will be documented and deliberated to determine if there should be any following actions. Regardless of incident type, the university will use all shared experiences to transform our campus climate to be more equitable and just.
Stopping the Spread of All Contagious Illnesses**
Please do not come to class if you feel sick or have symptoms of a potentially contagious illness. Following CMU policy, students that have symptoms of COVID-19 should contact University Health Services (UHS) at 412-268-2157. Even if you know you do not have COVID-19 but have symptoms that may be a sign of other contagious illnesses, such as a cold or flu, please do not come to class. In the past, some students have thought that coming to class even though they were sick would make them seem like a hard worker. However, this culture has changed. The pandemic has underscored that being around other people when you are sick risks spreading the illness to them, and staying home stops transmission throughout the community. Staying home when you are sick shows that you are responsible and that you care about your classmates and the campus community.