DIY Assistant: A Multi-modal End-User Programmable Virtual Assistant
Thu 24 Jun 2021 02:00 - 02:05 at PLDI-B - Talks 2B: Language Design and Programming Models
While Alexa can perform over 100,000 skills, its capability covers only a fraction of what is possible on the web. Individuals need and want to automate a long tail of web-based tasks which often involve visiting different websites and require programming concepts such as function composition, conditional, and iterative evaluation. This paper presents DIYA (Do-It-Yourself Assistant), a new system that empowers users to create personalized web-based virtual assistant skills that require the full generality of composable control constructs, without having to learn a formal programming language.
With DIYA, the user demonstrates their task of interest in the browser and issues a few simple voice commands, such as naming the skills and adding conditions on the action. DIYA turns these multi-modal specifications into voice-invocable skills written in the ThingTalk 2.0 programming language we designed for this purpose. DIYA is a prototype that works in the Chrome browser.
Our user studies show that 81% of the proposed routines can be expressed using DIYA. DIYA is easy to learn, and 80% of users surveyed find DIYA useful.
Wed 23 JunDisplayed time zone: Eastern Time (US & Canada) change
13:30 - 14:05 | |||
13:30 5mTalk | Wire Sorts: A Language Abstraction for Safe Hardware Composition PLDI Michael Christensen University of California at Santa Barbara, Timothy Sherwood University of California at Santa Barbara, Jonathan Balkind University of California at Santa Barbara, Ben Hardekopf University of California at Santa Barbara DOI | ||
13:35 5mTalk | Scooter & Sidecar: A Domain-Specific Approach to Writing Secure Database Migrations PLDI John Renner University of California at San Diego, Alex Sanchez-Stern University of California at San Diego, Fraser Brown Stanford University, Sorin Lerner University of California at San Diego, Deian Stefan University of California at San Diego DOI | ||
13:40 5mTalk | Unqomp: Synthesizing Uncomputation in Quantum Circuits PLDI Anouk Paradis ETH Zurich, Benjamin Bichsel ETH Zurich, Samuel Steffen ETH Zurich, Martin Vechev ETH Zurich DOI | ||
13:45 5mTalk | Gleipnir: Toward Practical Error Analysis for Quantum Programs PLDI Runzhou Tao Columbia University, Yunong Shi University of Chicago, Jianan Yao Columbia University, John Hui Columbia University, Frederic T. Chong University of Chicago, Ronghui Gu Columbia University DOI | ||
13:50 5mTalk | Quantum Abstract Interpretation PLDI DOI | ||
13:55 5mTalk | Task Parallel Assembly Language for Uncompromising Parallelism PLDI Mike Rainey Carnegie Mellon University, Ryan R. Newton Facebook, Kyle Hale Illinois Institute of Technology, Nikos Hardavellas Northwestern University, Simone Campanoni Northwestern University, Peter Dinda Northwestern University, Umut A. Acar Carnegie Mellon University DOI | ||
14:00 5mTalk | DIY Assistant: A Multi-modal End-User Programmable Virtual Assistant PLDI Michael Fischer Stanford University, Giovanni Campagna Stanford University, Euirim Choi Stanford University, Monica S. Lam Stanford University DOI Media Attached | ||
Thu 24 JunDisplayed time zone: Eastern Time (US & Canada) change
01:30 - 02:05 | |||
01:30 5mTalk | Wire Sorts: A Language Abstraction for Safe Hardware Composition PLDI Michael Christensen University of California at Santa Barbara, Timothy Sherwood University of California at Santa Barbara, Jonathan Balkind University of California at Santa Barbara, Ben Hardekopf University of California at Santa Barbara DOI | ||
01:35 5mTalk | Scooter & Sidecar: A Domain-Specific Approach to Writing Secure Database Migrations PLDI John Renner University of California at San Diego, Alex Sanchez-Stern University of California at San Diego, Fraser Brown Stanford University, Sorin Lerner University of California at San Diego, Deian Stefan University of California at San Diego DOI | ||
01:40 5mTalk | Unqomp: Synthesizing Uncomputation in Quantum Circuits PLDI Anouk Paradis ETH Zurich, Benjamin Bichsel ETH Zurich, Samuel Steffen ETH Zurich, Martin Vechev ETH Zurich DOI | ||
01:45 5mTalk | Gleipnir: Toward Practical Error Analysis for Quantum Programs PLDI Runzhou Tao Columbia University, Yunong Shi University of Chicago, Jianan Yao Columbia University, John Hui Columbia University, Frederic T. Chong University of Chicago, Ronghui Gu Columbia University DOI | ||
01:50 5mTalk | Quantum Abstract Interpretation PLDI DOI | ||
01:55 5mTalk | Task Parallel Assembly Language for Uncompromising Parallelism PLDI Mike Rainey Carnegie Mellon University, Ryan R. Newton Facebook, Kyle Hale Illinois Institute of Technology, Nikos Hardavellas Northwestern University, Simone Campanoni Northwestern University, Peter Dinda Northwestern University, Umut A. Acar Carnegie Mellon University DOI | ||
02:00 5mTalk | DIY Assistant: A Multi-modal End-User Programmable Virtual Assistant PLDI Michael Fischer Stanford University, Giovanni Campagna Stanford University, Euirim Choi Stanford University, Monica S. Lam Stanford University DOI Media Attached | ||