Although smart tools are increasingly becoming a part of the makerspace culture, their intended goal of supporting human creativity through technology is complicated by the diversity of user abilities, tools, and practices. The modern makerspace is a live environment, ever changing and evolving. If we construct systems using models of activity based on such an environment, it is difficult to maintain those systems over a period of time. I am focusing on understanding methods of augmenting the modern makerspace with smart tools, which aid the user in their work without obstructing in their process. We aim to normalize the use of digitally augmented tools in the creative spaces to enhance the user experience. We explore our design principles by focusing on the data collection process within the makerspace, using machine learning (ML) models to create interactions, and integrating the user in the workflow by making the system adaptable to changes. This is intended to solve the issue of maintainability and repairability of the system. In this WIP talk, I will present our work on two such systems - (1) an audio-based classifier for building and refining models of activity; (2) a tangible avatar to facilitate programming and debugging actions through capacitive touch sensing. Through this talk, I am looking to refine my PhD thesis proposal on how to evaluate the integration of ML models into intelligent systems. Specifically, I am looking to improve the motivation behind my design principles of smart tool maintainability and repairability and tie these into the larger research areas around makerspaces and human-AI interaction.

Hand-weaving is a beloved craft in history, holding promise for many opportunities in making from fat sheet fabrics to smart textiles. To afford new weaving experiences, we explore how 3D printed custom weaving tools interplay with different materiality, augmenting the design space of weaving. We propose novel weaving techniques enabled by 3D printed custom tools: (1) water-soluble draft to synchronize design intention and practice, (2) flexible warps to guide complex patterns and to shape resulting object, and (3) rigid global geometry for woven artifacts in 3D. EscapeLoom as a computational design tool enables users to employ various parameters in their computational design, and showcases many creative possibilities that move away from the traditional definition of a loom to dive into what more it can be.

For the automated tuning of user interfaces, it can be helpful to have data on the places where users have difficulty. Detecting this is, in general, hard. For spoken dialog, with human agents or with dialog systems, this is usually done by soliciting explicit judgments, for example, with “on a scale from 1 to 5, how was I today?” However, this is intrusive and does not identify the specific places where dissatisfaction was felt. We propose instead to exploit the tendencies for speakers to continuously indicate their satisfaction/dissatisfaction level by changing the way they speak, either intentionally or unintentionally. To investigate, we collected a corpus of 147 mock merchant-customer conversations, each 1 to 3 minutes in length, including some in a scenario that prevented the speakers from reaching a mutually satisfactory outcome. We will report the results of applying machine learning models to prosodic features computed over this data. By late March, we expect to find better-than-baseline ability to classify a dialog as containing or not containing dissatisfaction and to have identified specific prosodic configurations that are generally useful as markers of dissatisfaction.

Open science is the convergence of several interrelated trends in academia that push for accessible, inclusive, and transparent research practices and technology. Advocates of open science often present the movement as leveraging modern technology to do better research—research that embodies the values and norms open science advocates take as fundamental to good science (i.e. Mertonian norms). Funders, journals, and institutions pursue policies that necessitate the use of open science technologies, but these top-down efforts are sometimes met with resistance from researchers who perceive open science values to be at odds with their own. Some open science technologies encourage users to behave openly by design, employing nudges or persuasion tactics to promote openness. However, the introduction of new technology often leads to conflicts between developers’ and users’ expectations for the system. By studying technology-led advocacy for open science and researchers’ responses to it, we can explore the role of values in shaping the future of science practice and we can understand how technology undermines or supports stakeholders’ agency to enact their own values. To that end, I propose the qualitative study of an open science platform designed to change users’ behavior: the Open Science Framework. In this WIP talk, I will present the background and motivation for this study and outline a plan for collecting trace data that logs developers’ and users’ interactions with the Open Science Framework. I look forward to discussing the value and difficulties of trace data collection and analysis; I further welcome feedback on the study design.

The data I plan to present was collected in support of the NSF CAREER grant mentioned above. The goal of this area of the grant is to study how self-trackers communicate about the gathering and analysis of data for health and productivity, and to make recommendations that will be beneficial for refining personal health interventions and for healthcare writ large. This study is part of NSF’s 21st century focus to better understand how our country can prepare for the future of work at the human-technology frontier (https://www.nsf.gov/eng/futureofwork.jsp). I just concluded the first round of data collection, consisting of 30 interviews with personal data practitioners of varying levels of commitment and technological prowess at approximately 45 minutes each, and 10 hours of observational data collected attending Zoom calls for an online personal analytics support community. I will present preliminary themes emerging from the data, including: (1) participants' frustration with and attempts to resist the influence of Big Tech on how meaning is created from their data; (2) how personal data may be used in a clinical interaction, and how a providers' response to it determines its possibilities for supporting patient empowered care; (3) the perceived value of manual vs. automated tracking; and (4) how the communication practice of "show and tell" with other self-trackers supports individuals in their personal data projects.   

Thingiverse hosts over 1.9 million 3D designs shared across the fabrication community, many of which are designed to interact with real-world objects and are customizable upon personal needs. However, it is challenging for novice users to discover relevant designs using textual information, comprehend what customizable parameters mean, where they are located on target objects, and how to measure them correctly. To solve these problems, we present an interactive system that uses a graph-based structure to represent adaptation designs to improve the search and exploration process, then guides end-users through the measurement process using a set of modular measurement methods for primitive shapes. Our system assists users without expert skills to conveniently discover, adjust, and reuse adaptive designs.

A challenge to meet the demand on higher education and professional development is to scale these educational opportunities while maintaining their quality. My work tackles this challenge by harnessing examples from existing resources to enable the creation of scalable and quality educational experiences.  In this talk, I will describe my work that contributes insights about developing effective learning at scale systems by leveraging the complementary strengths from peers, experts, and machine intelligence, differentiating it from existing systems that solely rely on machine or crowds of peers. Specifically, I’ll focus on a technique UpGrade, which uses student solution examples to semi-automatically generate multiple-choice questions for deliberate practice of higher order thinking in varying contexts. From experiments in authentic college classrooms, I show that UpGrade helps students gain conceptual understanding more efficiently and helps improve students' authentic task performance. Through an iterative design process with instructors, I demonstrate the generalizability of this approach and offer suggestions to improve the quality and efficiency of college instruction.

Will aging individuals accept the convenience and safety features of Smart Home technology? According to the U.S. Census Bureau, Population Projections, there are currently 52 million people over 65 and almost a third do not have internet connection. A majority of these individuals would undoubtedly prefer to maintain their independence, but many will likely encounter health issues that limit their abilities to continue to live on their own without supporters who may not be able to be there full time. However, something as simple as voice command lights, phone calls, and entertainment could assist these individuals in staying safe and convenient with limited mobility requirements. This is where the problem arises, there many seniors that do not accept life changing smart home technology for fear of insecurity or lack of internet. My project has created a offline system that can be used to control a house and pair with alexa if internet access is achieved.

Advancing technology has increasingly automated the hiring process, resulting in computer algorithms mechanically processing application materials and evaluating applicants’ interview responses. Recently, artificial intelligence (AI) algorithms have been used to analyze applicants’ communication during online, asynchronous interviews to predict job-related qualities, including communication skills and personality traits. Many people claim that using AI decreases hiring bias citing algorithms as less biased than humans. However, research must address the perspective of potential applicants as interviewee perceptions are connected to interview performance and organizational attractiveness. This presentation will share pilot data from focus group interviews that explored college student job seekers' perceptions of AI interview technology. The discussion will focus on exploring perceptions from people with varying levels of understanding about artificial intelligence.

The Migrant Steps Project draws inspiration from the popularity of step tracker applications and the overabundance of migrant narratives in mainstream and social media. The project mobilizes step tracking applications as the point where users come into contact with re-contextualized narratives and popular archives in order to counter alarmist, xenophobic media rhetoric about “hordes” of migrants that “flow” across borders. We aim to draw attention and incite critical reflection on the user’s practice of walking as the entry point to re-engaging with narratives about migration. By relying on the user’s walking as the point of interaction with digital narratives about migration, the project will draw attention to the physical dimension of migration and to the importance of words and concepts to making sense of social phenomena.

The emergence of affordable digital fabrication technologies like 3D printing may drastically change how physical goods can be created anywhere, shifting the focus of fabrication from the distribution of physical goods towards the distribution of digital designs. However, there are many challenges toward fabricating, modifying, and creating digital designs that inhibit many from utilizing 3D Printing. Observations of university printing services and results from a more-controlled lab study reveal how anyone can print by learning how to specify 3D printing ideas (What to Print) without requiring learning printing as a practice through the direct operation of machinery (How to Print). This analysis of printing services reveal that while anyone can print by collaboratively specifying ideas with printing practitioners, there are many barriers and challenges 3D printing newcomers face before they plan to print. Creation and Utilization of the Big Multimedia 3D Printing Dataset ThingiPano helped inform and facilitate the development of HowDIY, a website to introduce anyone to 3D printing. An evaluation of newcomers utilizing HowDIY revealed future directions for supporting newcomers to 3D Print anywhere online.

The synthesis of new ideas, or ideation, is fundamental to the product design process, particularly in its early phase. Early design ideation helps designers understand the design problem and the design space. This exploratory nature of ideation demands an uninhibited flow between what a designer is thinking and how the designer is communicating the thought. The challenge in enabling computer-supported ideation is to create a digital environment that augments one’s cognitive capability to search, organize, and synthesize ideas. In this talk, I will tell three short stories each of which attempts to address this challenge in a different manner. My first story will begin with a gesture-based interfaces for creating, modifying, and manipulating 3D shapes. Using insights from an observational study, my second story will then explore how the tacit human understanding of a real-world interactions can be embedded within the virtual interactions for shape deformation. For this, I will describe a geometric algorithm for extracting the grasp and motion from a dynamic point-cloud of the hand interacting with a virtual shape. By applying this algorithm to a virtual pottery scenario, I will demonstrate how users can determine their own strategy for reaching, grasping and deforming a 3D shape without learning a prescribed set of gestures. Finally, in my third story, I will discuss mobile devices as creative media to enable direct creation of 3D shape compositions comprised of swept surfaces.

As artificial intelligence (AI) is transforming work and society, it is ever more important to ensure AI systems are fair and responsible and can gain societal trust. In this talk, I argue that building procedurally-fair and participatory AI is critical to achieving this vision. I will first present empirical findings on people’s experiences with and fairness perceptions of resource allocation algorithms, and considerations for enabling procedural fairness in AI. Then, I will present WeBuildAI, a participatory framework that enables people to build algorithmic policy for their communities. In our case study with a nonprofit, 412 Food Rescue, we applied the framework to a matching algorithm that operates an on-demand food donation transportation service in order to adjudicate equity and efficiency trade-offs.

Robots have become part of our everyday lives and have several roles, such as helping workers in their work duties, assisting people with impairment in activities of daily living, entertaining and keeping company to children and the elderly, and assisting rehabilitation procedures. In industrial environments, such as assembly lines, a strong level of interaction and cooperation is reached where humans and robots are required to work synergistically on a specific task and have different roles and complementary abilities. However, there is a need on understanding the psychological influence on the human who cooperates with a robot on a daily basis. This talk introduces a real-time framework that assesses the cognitive load of a human while cooperating with a robot to complete a collaborative assembly task. The framework uses multi-modal sensory data from Electrocardiography (ECG) and Electrodermal Activity (EDA) sensors, extracts novel features from the data and utilizes machine learning methodologies to detect high or low cognitive load. The developed framework was evaluated on a collaborative assembly scenario with a user study.

Silicone is a transformative design material found within various emerging HCI practices, including shape-changing interfaces, soft robotics, and wearables. However, workflows for designing and fabricating silicone forms require a time-intensive mold-cast-cure pipeline that limits the experiential knowledge gained from working directly with silicone. In this talk, I conduct a material-centric exploration of silicone and develop designerly workflows for creating inflatable silicone bladders. I will describe Siloseam, a creative framework that streamlines a bladder design and fabrication process, collects tacit knowledge involved in recovering from errors and introduces new workflows that reuse existing molds. A set of exemplar artifacts demonstrates an expanded repertoire of silicone forms that leverage various airtight seams' configurations to create playful, haptic interactions. I will discuss the remaining challenges in integrating silicone with a broader range of materials and opportunities for developing designerly workflows for other mold-and-cast processes.

While most user content posted on social media is benign, other content, such as violent or adult imagery, must be detected and blocked. Unfortunately, such detection is difficult to automate, due to high accuracy requirements, costs of errors, and nuanced rules for acceptable content. Consequently, social media platforms today rely on a vast workforce of human moderators. However, mounting evidence suggests that exposure to disturbing content can cause lasting psychological and emotional damage to some moderators. To mitigate such harm, we investigate a set of blur-based moderation interfaces for reducing exposure to disturbing content whilst preserving moderator ability to quickly and accurately flag it. We report experiments with Mechanical Turk workers to measure moderator accuracy, speed, and emotional well-being across six alternative designs. Our key findings show interactive blurring designs can reduce emotional impact without sacrificing moderation accuracy and speed.