STIVi: Turning Perspective Sketching Videos into Interactive Tutorials

Capucine Nghiem, Adrien Bousseau, Msc. Mark Sypesteyn, Jan Willem Hoftijzer, Maneesh Agrawala, Theophanis Tsandilas

Letter Of Changes:

Dear reviewers,
Thank you for your detailed comments and suggestions. Please find attached our revision of the paper, along with our accompanying video and supplemental material.

We stress that many details about the system design, implementation and evaluation were provided in the supplemental material, we are sorry that RvvQ9 could not access it during the review process.

Our changes include:
- Clarify in the abstract and introduction that our contribution includes both an interactive system to help students follow drawing instructions (STIVi), as well as a processing pipeline to help instructors create content for this interactive system.
- Clarify that our user study focuses on how our interactive system benefits students (abstract, intro, user evaluation section), but didn’t assess how our processing pipeline benefits instructors (limitation section).
- Shorten the usage scenario in Sec. 5 to avoid redundancy.
- Move some implementation details from the supplemental material back to the main paper (Sec. 5.4).

Keywords: Drawing, Sketching, Instructional Videos, Pen-based UIs, Image and Video Processing

Abstract:

For design and art enthusiasts who seek to enhance their skills through instructional videos, following drawing instructions while practicing can be challenging.

STIVi presents perspective drawing demonstrations and commentary of prerecorded instructional videos as interactive drawing tutorials that students can navigate and explore at their own pace.

Our approach involves a semi-automatic pipeline to assist instructors in creating STIVi content by extracting pen strokes from video frames and aligning them with the accompanying audio commentary. Thanks to this structured data, students can navigate through transcript and in-video drawing, refer to provided highlights in both modalities to guide their navigation, and explore variations of the drawing demonstration to understand fundamental principles. We evaluated STIVi's interactive tutorials against a regular video player. We observed that our interface supports non-linear learning styles by providing students alternative paths for following and understanding drawing instructions.

Submission Number: 13