[go: up one dir, main page]
Skip to content

bwang514/awesome-HAI

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

168 Commits
Human-AI Interaction.png
Human-AI Interaction.png
 
 
README.md
README.md
 
 

Repository files navigation

Awesome Human-AI Interaction Awesome

image

Awesome HAI is a collection of academic materials related to the topic of Human-AI interaction.

  • We include both research papers that discuss challenges and opportunities in interaction design with general AI from the Human-Computer Interaction (HCI) perspective and that specifically discuss how advances in Deep Learning can address interactive challenges from the AI perspective. We also include Human-AI Interaction courses from universities worldwide.
  • The collection is maintained by a community of volunteered students, make a pull request if you want to contribute :)

Table of Contents

Research Papers

ACM Conference on Human Factors in Computing Systems (CHI)

 Year Paper
2020 Co-Designing Checklists to Understand Organizational Challenges and Opportunities around Fairness in AI
2020 Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to Design
2020 What is AI Literacy? Competencies and Design Considerations
2020 Questioning the AI: Informing Design Practices for Explainable AI User Experiences
2020 Mental Models of AI Agents in a Cooperative Game Setting
2020 Reinforcement Learning for the Adaptive Scheduling of Educational Activities
2020 Predicting Mid-Air Interaction Movements and Fatigue Using Deep Reinforcement Learning
2020 Enemy Within: Long-term Motivation Effects of Deep Player Behavior Models for Dynamic Difficulty Adjustment
2020 OralCam: Enabling Self-Examination and Awareness of Oral Health Using a Smartphone Camera
2020 A Human-Centered Evaluation of a Deep Learning System Deployed in Clinics for the Detection of Diabetic Retinopathy
2020 Modeling Human Visual Search Performance on Realistic Webpages Using Analytical and Deep Learning Methods
2020 EarBuddy: Enabling On-Face Interaction via Wireless Earbuds
2020 "Why is 'Chicago' deceptive?" Towards Building Model-Driven Tutorials for Humans
2020 Novice-AI Music Co-Creation via AI-Steering Tools for Deep Generative Models
2020 EmoG: Supporting the Sketching of Emotional Expressions for Storyboarding
2020 Affective State Prediction Based on Semi-Supervised Learning from Smartphone Touch Data
2020 Automated Class Discovery and One-Shot Interactions for Acoustic Activity Recognition
2020 Optimizing User Interface Layouts via Gradient Descent
2020 AL: An Adaptive Learning Support System for Argumentation Skills
2020 Studying the Effects of Cognitive Biases in Evaluation of Conversational Agents
2019 Guidelines for Human-AI Interaction
2019 Caring for Vincent: A Chatbot for Self-compassion
2019 Unremarkable AI: Fitting Intelligent Decision Support into Critical, Clinical Decision-Making Processes
2019 What Makes a Good Conversation? Challenges in Designing Truly Conversational Agents
2019 Metaphoria: An Algorithmic Companion for Metaphor Creation
2019 Implicit Communication of Actionable Information in Human-AI teams
2019 AI-Mediated Communication: How the Perception that Profile Text was Written by AI Affects Trustworthiness
2019 Designing Theory-Driven User-Centric Explainable AI
2019 Will You Accept an Imperfect AI? Exploring Designs for Adjusting End-user Expectations of AI Systems
2019 ATMSeer: Increasing Transparency and Controllability in Automated Machine Learning
2019 Resilient Chatbots: Repair Strategy Preferences for Conversational Breakdowns
2019 In a Silent Way: Communication Between AI and Improvising Musicians Beyond Sound
2019 Beyond Dyadic Interactions: Considering Chatbots as Community Members
2019 An Exploration of Speech-Based Productivity Support in the Car
2019 Exploring Factors that Influence Connected Drivers to (Not) Use or Follow Recommended Optimal Routes
2019 SmartEye: Assisting Instant Photo Taking via Integrating User Preference with Deep View Proposal Network
2019 Hands Holding Clues for Object Recognition in Teachable Machines
2019 QuizBot: A Dialogue-based Adaptive Learning System for Factual Knowledge
2019 Gamut: A Design Probe to Understand How Data Scientists Understand Machine Learning Models
2019 Automation Accuracy Is Good, but High Controllability May Be Better
2018 All Work and No Play? Conversations with a Question-and-Answer Chatbot in the Wild
2018 Cognitive Load Estimation in the Wild
2018 Emotional Dialogue Generation using Image-Grounded Language Models
2018 DeepWriting: Making Digital Ink Editable via Deep Generative Modeling
2018 Evorus: A Crowd-powered Conversational Assistant Built to Automate Itself Over Time
2018 RecipeScape: An Interactive Tool for Analyzing Cooking Instructions at Scale
2018 ExtVision: Augmentation of Visual Experiences with Generation of Context Images for a Peripheral Vision Using Deep Neural Network
2018 HindSight: Enhancing Spatial Awareness by Sonifying Detected Objects in Real-Time 360-Degree Video
2018 Deep Thermal Imaging: Proximate Material Type Recognition in the Wild through Deep Learning of Spatial Surface Temperature Patterns
2018 Predicting Human Performance in Vertical Menu Selection Using Deep Learning
2018 Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda
2018 Touch Your Heart: A Tone-aware Chatbot for Customer Care on Social Media
2018 Mapping Machine Learning Advances from HCI Research to Reveal Starting Places for Design Innovation
2018 Analysis and Modeling of Grid Performance on Touchscreen Mobile Devices
2018 “Trust Us”: Mobile Phone Use Patterns Can Predict Individual Trust Propensity
2018 Norms Matter: Contrasting Social Support Around Behavior Change in Online Weight Loss Communities
2017 UX Design Innovation: Challenges for Working with Machine Learning as a Design Material
2017 A New Chatbot for Customer Service on Social Media
2017 Multimodal Classification of Moderated Online Pro-Eating Disorder Content
2017 People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges
2016 Augur: Mining Human Behaviors from Fiction to Power Interactive Systems
2016 “Like Having a Really bad PA”: The Gulf between User Expectation and Experience of Conversational Agents

ACM User Interface and Software Technology Symposium (UIST)

 Year Paper
2020 Decoding Surface Touch Typing from Hand-Tracking
2020 MonoEye: Multimodal Human Motion Capture System Using A Single Ultra-Wide Fisheye Camera
2020 DeepFisheye: Near-Surface Multi-Finger Tracking Technology Using Fisheye Camera
2020 Rescribe: Authoring and Automatically Editing Audio Descriptions
2020 C-Face: Continuously Reconstructing Facial Expressions by Deep Learning Contours of the Face with Ear-mounted Miniature Cameras
2020 Interactive Exploration and Refinement of Facial Expression using Manifold Learning
2020 Brain Relevance Feedback for Interactive Image Generation
2020 Predicting Visual Importance Across Graphic Design Types
2020 Back-Hand-Pose: 3D Hand Pose Estimation for a Wrist-worn Camera via Dorsum Deformation Network
2020 Skyline: Interactive In-Editor Computational Performance Profiling for Deep Neural Network Training
2019 Mallard: Turn the Web into a Contextualized Prototyping nvironment for Machine Learning
2019 Type, Then Correct: Intelligent Text Correction Techniques for Mobile Text Entry Using Neural Networks
2019 Learning Cooperative Personalized Policies from Gaze Data
2018 Ubicoustics: Plug-and-Play Acoustic Activity Recognition
2018 Lip-Interact: Improving Mobile Device Interaction with Silent Speech Commands
2018 The Exploratory Labeling Assistant: Mixed-Initiative Label Curation with Large Document Collections
2018 Adasa: A Conversational In-Vehicle Digital Assistant for Advanced Driver Assistance Features
2017 Everyday Eye Contact Detection Using Unsupervised Gaze Target Discovery
2017 Learning Visual Importance for Graphic Designs and Data Visualizations
2017 Rico: A Mobile App Dataset for Building Data-Driven Design Applications
2016 Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum

ACM Annual Meeting of the Intelligent User Interfaces Community (IUI)

 Year Paper
2019 When People and Algorithms Meet: Assessing User-reported Problems to Inform Support in Intelligent Everyday Applications
2019 What AI can do for me: Evaluating Machine Learning Interpretations in Cooperative Play
2019 SearchLens: Composing and Capturing Complex User Interests for Exploratory Search
2019 Proactive Information Retrieval by Capturing Search Intent from Primary Task Context
2019 A Review of User Interface Design for Interactive Machine Learning
2019 BigBlueBot: Teaching Strategies for Successful Human-Agent Interactions
2019 The Effect of Explanations and Algorithmic Accuracy on Visual Recommender Systems of Artistic Images
2019 To Explain or not to Explain: the Effects of Personal Characteristics when Explaining Music Recommendations
2018 AlterEgo: A Personalized Wearable Silent Speech Interface
2018 Creative Writing with a Machine in the Loop: Case Studies on Slogans and Stories
2018 Detecting Memory-Based Interaction Obstacles with a Recurrent Neural Model of User Behavior
2018 User Modelling for Avoiding Overfitting in Interactive Knowledge Elicitation for Prediction
2018 Every Little Movement Has a Meaning of Its Own: Using Past Mouse Movements to Predict the Next Interaction
2018 An Active Tangible User Interface Framework for Teaching and Learning Artificial Intelligence

ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW)

 Year Paper
2018 Fact or Fiction
2018 Data-Driven Proactive Policy Assurance of Post Quality in Community q&a Sites
2018 By the Community & For the Community: A Deep Learning Approach to Assist Collaborative Editing in Q&A Sites

ACM Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT/UbiComp)

 Year Paper
2019 TurnsMap: Enhancing Driving Safety at Intersections with Mobile Crowdsensing and Deep Learning
2019 AdaRF: Adaptive RFID-based Indoor Localization Using Deep Learning Enhanced Holography
2019 Deep Multi-Task Learning Based Urban Air Quality Index Modelling
2018 What Will You Do for the Rest of the Day? An Approach to Continuous Trajectory Prediction
2018 GymCam: Detecting, Recognizing and Tracking Simultaneous Exercises in Unconstrained Scenes
2018 Crowd-AI Camera Sensing in the Real World
2018 DeepType: On-Device Deep Learning for Input Personalization Service with Minimal Privacy Concern
2018 Performance Characterization of Deep Learning Models for Breathing-based Authentication on Resource-Constrained Devices
2018 Online Deep Ensemble Learning for Predicting Citywide Human Mobility
2018 Deep Room Recognition Using Inaudible Echos
2018 SenseGAN: Enabling Deep Learning for Internet of Things with a Semi-Supervised Framework
2018 DeActive: Scaling Activity Recognition with Active Deep Learning
2018 Deep ROI-Based Modeling for Urban Human Mobility Prediction
2017 Multimodal Deep Learning for Activity and Context Recognition
2017 RDeepSense: Reliable Deep Mobile Computing Models with Uncertainty Estimations
2017 Mitigating Bystander Privacy Concerns in Egocentric Activity Recognition with Deep Learning and Intentional Image Degradation
2017 Low-resource Multi-task Audio Sensing for Mobile and Embedded Devices via Shared Deep Neural Network Representations
2017 Ensembles of Deep LSTM Learners for Activity Recognition using Wearables
2016 A weakly supervised activity recognition framework for real-time synthetic biology laboratory assistance
2016 SpotGarbage: smartphone app to detect garbage using deep learning

ACM International Symposium on Wearable Computers (ISWC)

 Year Paper
2018 Understanding and improving recurrent networks for human activity recognition by continuous attention
2018 On attention models for human activity recognition
2018 Deepauth: in-situ authentication for smartwatches via deeply learned behavioural biometrics
2017 CNN-based sensor fusion techniques for multimodal human activity recognition
2016 Deep convolutional feature transfer across mobile activity recognition domains, sensor modalities and locations

IEEE Transactions on Visualization and Computer Graphics (Proceedings of IEEE InfoVis, VAST, SciVis)

 Year Paper
2020 CNN Explainer: Learning Convolutional Neural Networks with Interactive Visualization
2020 explAIner: A Visual Analytics Framework for Interactive and Explainable Machine Learning
2019 DeepVID: Deep Visual Interpretation and Diagnosis for Image Classifiers via Knowledge Distillation
2019 SANVis: Visual Analytics for Understanding Self-Attention Networks
2019 Seq2seq-Vis: A Visual Debugging Tool for Sequence-to-Sequence Models
2019 Evaluating 'Graphical Perception' with CNNs
2019 InkPlanner: Supporting Prewriting via Intelligent Visual Diagramming
2019 Summit: Scaling Deep Learning Interpretability by Visualizing Activation and Attribution Summarizations
2018 DQNViz: A Visual Analytics Approach to Understand Deep Q-Networks
2018 Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontiers
2018 LSTMVis: A Tool for Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks
2018 GAN Lab: Understanding Complex Deep Generative Models using Interactive Visual Experimentation
2017 ActiVis: Visual Exploration of Industry-Scale Deep Neural Network Models

Computer Graphics Forum (Proceedings of EuroVis and EuroGraphics)

 Year Paper
2020 Peax: Interactive Visual Pattern Search in Sequential Data Using Unsupervised Deep Representation Learning
2020 DRLViz: Understanding Decisions and Memory in Deep Reinforcement Learning

Fairness, Accountability, and Transparency in Machine Learning (FAT/ML)

 Year Paper
2018 Achieving Fairness through Adversarial Learning: an Application toRecidivism Prediction

Association for the Advancement of Artificial Intelligence (AAAI)

 Year Paper
2019 Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
2019 Zero Shot Learning for Code Education:Rubric Sampling with Deep Learning Inference

Neural Information Processing Systems (NeurIPS)

 Year Paper
2019 On the Utility of Learning about Humans for Human-AI Coordination
2015 Deep Knowledge Tracing

International Conference on Machine Learning (ICML)

 Year Paper
2015 Learning Program Embeddings to Propagate Feedback

Educational Data Mining (EDM)

 Year Paper
2015 Tuning Peer Grading

Proceedings of the National Academy of Sciences (PNAS)

Year Paper
2019 Agency plus automation: Designing artificial intelligence into interactive systems
2019 Scaling up analogical innovation with crowds and AI
2019 Citizen science frontiers: Efficiency, engagement, and serendipitous discovery with human–machine systems

Communications of the ACM (CACM)

Year Paper
2018 The Challenge of Crafting Intelligible Intelligence

Distill

Year Paper
2019 AI Safety Needs Social Scientists
2017 Using Artificial Intelligence to Augment Human Intelligence

arXiv

Year Paper
2020 GNNVis: A Visual Analytics Approach for Prediction Error Diagnosis of Graph Neural Networks
2017 Machine Teaching: A New Paradigm for Building Machine Learning Systems

Courses

There are also some awesome course resources discussing Intelligent User Interface/ Human-AI interaction

School Course Lecturer
Carnegie Mellon University Human-AI Interaction Jeff Bigham and Joseph Seering
Carnegie Mellon University Software Engineering for AI-Enabled Systems (SE4AI) Christian Kaestner
Aalto University Intelligent User Interfaces Studio Kashyap Todi and Sunjun Kim
Penn State University Crowdsourcing & Crowd-AI Systems Kenneth Huang
University of Colorado Boulder Human-centered Machine Learning Chenhao Tan
Stanford University Designing AI to Cultivate Human Well-Being Jennifer Aaker and Fei-Fei Li
Georgia Tech Data and Visual Analytics
Columbia University Intelligent Decision Support: History, Paradigms, Applications Lena Mamykina

Curators

The repo is jointly contributed by researchers from different institutions, please refer to the contributor page.

License

CC0

About

A curated list of awesome Human-AI Interaction

Resources

Readme
Activity

Stars

293 stars

Watchers

28 watching

Forks

40 forks
Report repository

Releases

No releases published

Packages

No packages published

Contributors 11