Home

About

Advanced Search

Browse by Discipline

Scientific Societies

E-print Alerts

Add E-prints

E-print Network
FAQHELPSITE MAPCONTACT US


  Advanced Search  

 
Generating Photo Manipulation Tutorials by Demonstration Floraine Grabler1 Maneesh Agrawala1 Wilmot Li2 Mira Dontcheva2 Takeo Igarashi3,4
 

Summary: Generating Photo Manipulation Tutorials by Demonstration
Floraine Grabler1 Maneesh Agrawala1 Wilmot Li2 Mira Dontcheva2 Takeo Igarashi3,4
1University of California, Berkeley 2Adobe Systems 3University of Tokyo 4JST ERATO
Figure 1: As a user demonstrates an eye recoloring portrait manipulation technique, our system records his actions in the interface and the
corresponding image processing operations in the application. It then combines information from the recordings with image recognition to
automatically generate a succinct, step-by-step visual tutorial that others can use to learn the technique (left). Our system can also generate
content-dependent macros that automatically transfer selection operations from the example to new target images. In this case our system
uses face recognition to identify the eyes and then transfers the recoloring procedure to the new target images (right).
Abstract
We present a demonstration-based system for automatically gen-
erating succinct step-by-step visual tutorials of photo manipula-
tions. An author first demonstrates the manipulation using an in-
strumented version of GIMP that records all changes in interface
and application state. From the example recording, our system au-
tomatically generates tutorials that illustrate the manipulation using
images, text, and annotations. It leverages automated image label-
ing (recognition of facial features and outdoor scene structures in
our implementation) to generate more precise text descriptions of
many of the steps in the tutorials. A user study comparing our auto-
matically generated tutorials to hand-designed tutorials and screen-

  

Source: Agrawala, Maneesh - Department of Electrical Engineering and Computer Sciences, University of California at Berkeley
O'Brien, James F. - Department of Electrical Engineering and Computer Sciences, University of California at Berkeley

 

Collections: Computer Technologies and Information Sciences