Sketch-based Interfaces and Modeling

• Main Authors: Jorge, Joaquim, Samavati, Faramarz Famil
• Format: eBook Book
• Language: English
• Published: London Springer Verlag London Limited 2011; Springer; Springer London, Limited; Springer London
• Edition: 1. Aufl.
• Subjects: Computer Imaging, Vision, Pattern Recognition and Graphics; Computer Science; Computer simulation; Graphical user interfaces (Computer systems); Model-integrated computing; User interfaces (Computer systems); User Interfaces and Human Computer Interaction; Computer Informatik

The field of sketch-based interfaces and modeling (SBIM) is concerned with developing methods and techniques to enable users to interact with a computer through sketching - a simple, yet highly expressive medium. SBIM blends concepts from computer graphics, human-computer interaction, artificial int...

Table of Contents:

• Intro -- Sketch-based Interfaces and Modeling -- Foreword -- Preface -- Contents -- Introduction -- Sketch-based Interfaces -- Sketching Issues and Research Topics in HCI -- Recognition -- Modes -- Sketch-based Applications -- Creation and Modification of 3D Models -- Suggestive Systems -- Constructive Systems -- Augmentation -- Deformation -- Modeling Applications -- References -- Sketch-based Interfaces -- Multi-domain Hierarchical Free-Sketch Recognition Using Graphical Models -- Introduction -- The Challenges of Free-Sketch Recognition -- Knowledge Representation -- Hierarchical Shape Descriptions -- Handling Noise in the Drawing -- Signal-Level Noise: Objective vs. Subjective Measures -- Description-Level Variation: Optional Components and Constraints -- Strengths and Limitations -- Recognition Overview -- Hypothesis Evaluation -- Dynamically Constructed Graphical Models -- Shape Fragments: Evaluating a Single Hypothesis -- Network Structure -- Conditional Probability Distributions -- Observing Evidence from Stroke Data -- Recognizing a Complete Sketch -- Linking Shape Fragments -- Missing Nodes -- Implementation and Bayesian Inference -- Hypothesis Generation -- Selecting an Interpretation -- Application and Results -- Remaining Challenges and Extensions -- Using Single-Stroke Classification to Improve Grouping -- Conclusion -- References -- Minimizing Modes for Smart Selection in Sketching/Drawing Interfaces -- Introduction -- The Cost of Modes -- The Temporal Cost of Modes -- Mode Errors: The Mode Problem -- Overloaded Loop Selection: UI Design to Infer Selection Mode -- The Inferred Mode Protocol for Stylus Drawing and Selection with a Pen -- The Mode Problem in Electronic Whiteboard Programs -- Analytical Tool: The Interaction Flow Diagram -- Interaction Flow Analysis of Mode-Based Selection and Drawing
• Measuring Similarity -- Primitive Count Error: -- Primitive Type Error: -- Relative Length Error: -- Number of Intersections Error: -- Intersection Angle Error: -- Intersection Location Error: -- Graph Matching -- Stochastic Matching -- Greedy Matching -- Hybrid Matching -- Training -- Feature-based Recognizer -- Image-based Recognizer -- Representation -- Template Matching with Multiple Classifiers -- Hausdorff Distance: -- Modified Hausdorff Distance: -- Tanimoto Coefficient: -- Yule Coefficient: -- Combining Classifiers: -- Handling Rotations -- Educational Applications -- Conclusion -- References -- Flexible Parts-based Sketch Recognition -- Introduction -- Algorithm Design Issues -- Image-based vs. Stroke-based -- Use of Timing Information -- Top-Down vs. Bottom-Up -- Object Template Representation -- Degree of Supported Variation -- Search Algorithm -- Recognition as Search -- Related Work -- Hierarchy-of-Parts Models -- Recognition Algorithm -- Template Construction -- Template Matching -- Curve Matching -- Template Hierarchy -- Application to 3D Model Construction -- Results and Discussion -- Failure Modes -- Comparison with Template Editing -- Scalability -- Constellation of Parts Models -- Learning the Model -- Labeling Likelihood -- Recognition Algorithm -- Results and Discussion -- Conclusions -- References -- Sketch-based Retrieval of Vector Drawings -- Introduction -- Feature Extraction from Sketches and Drawings -- Topology -- Topological Relationships -- Topology Graph -- From Topology Graphs to Descriptors -- Multilevel Description -- Spatial Proximity -- Geometry -- Application Examples for 2D Drawings -- Toward 3D Modeling Using Implicit Retrieval -- Modeling 3D Technical Objects -- Overview of the Modeling Tool -- 3D Object Description -- Query Formulation and Execution -- Modeling Lego Scenes -- Part Library
• Cutting -- Blending -- Surface Drawing -- Selection and Transformation -- Technical Details -- Hierarchical Implicit Volume Modeling -- BlobTree Visualization -- Sketchable Implicit Sweep Primitives -- Hierarchical Spatial Caching -- The ShapeShop System -- Discussion -- References -- Inferring 3D Free-Form Shapes from Complex Contour Drawings -- Introduction -- Overview and Background -- Related Work -- Shape from Drawings. -- Contour Completion. -- Sketching Interfaces. -- Notation and Problem Formulation -- Figural Completion for Smooth Surfaces -- Preprocessing an Input Stroke and Guessing T-points and Cusps -- Pairwise Completion -- Computing the Completion for a Tee/Cusp Pairing -- Greedy Search for the Best Configuration -- Checking the Consistency of the Pairing -- Gluing Segments and Assigning Huffman's Labels -- Results and Limitations of the Figural Completion Algorithm -- From Drawing to Williams' Abstract Topological Manifold -- Triangulating the Panels -- The Issue of Two Distinct Points Having the Same 2D Location -- Paneling Construction -- Creating Multiple Copies of Each Panel -- Establishing Correspondences Between Edges of the Panels -- Ordering the Clusters. -- Extra Vertices. -- Constructing a Topological Embedding -- Embedding Vertices. -- Embedding edges. -- Embedding faces. -- Smoothing the Embedding Using the Mass-Spring System -- Editing Gestures -- Limitations and Conclusions -- References -- The Creation and Modification of 3D Models Using Sketches and Curves -- Introduction -- Sketch-based Creation and Modification of 3D Shapes -- Constructing the 3D Wireframe -- Modifying the Wireframe -- Curve Modification in the Image Plane -- Unprojection to 3D -- Surface Creation and Modification -- Initial Surface Creation -- Surface Modification -- Surface Modification Using Pressure Force
• Surface Modification Using V-Spring Method
• Retrieval Mechanism -- Results Presentation -- Conclusions -- References -- Sketch-based Modeling -- A Sketching Interface for Freeform 3D Modeling -- Introduction -- Related Work -- User Interface -- Modeling Operations -- Overview -- Creating a New Object -- Painting and Erasing on the Surface -- Extrusion -- Cutting -- Smoothing -- Transformation -- Algorithm -- Creating a New Object -- Painting on the Surface -- Extrusion -- Cutting -- Smoothing -- Implementation -- User Experience -- Conclusions -- References -- The Creation and Modification of 3D Models Using Sketches and Curves -- Introduction -- FiberMesh: Designing Freeform Surfaces with 3D Curves -- User Interface -- Sketching Tool -- Deformation Tool -- Rubbing Tool -- Erasing Tool and Type Change Tool -- Algorithm -- Curve Deformation -- Surface Optimization -- Meshing Implementations -- Results -- Discussion -- SilSketch: Automated Sketch-based Editing of Surface Meshes -- Interface -- Image-Space Silhouettes -- Silhouette Detection -- Silhouette Extraction -- Handle Estimation -- Finding Handle/Target Correspondences -- ROI Estimation -- Results -- Discussion -- Conclusion -- References -- Sketch-based Modeling and Assembling with Few Strokes -- Introduction -- Related Work -- Stroke Capture -- Creation Phase -- Rotational Blending Surface -- Cross-Sectional Blending Surfaces -- Editing Phase -- Orthogonal Deformation Stroke -- Cross-Sectional Oversketch -- Transformation Stroke -- Stroke Interpretation -- Translation -- Active Model -- Rotation -- Scaling -- Results and Discussion -- Gestural Modeling -- Transformation Stroke -- Conclusions -- References -- ShapeShop: Free-Form 3D Design with Implicit Solid Modeling -- Introduction -- The ShapeShop Interface -- Pencil-based Interaction -- Sketching Assistance -- Sketch-based Modeling Operations -- Blobby Inflation -- Sweep Surfaces
• Inferred Mode Protocol: Inferring Draw/Select Mode -- Sloppy Selection: Inferring Intended Content of an Ambiguous Selection -- Cycle Tap Selection: Exploiting Structure Recognition -- Conclusion -- References -- Mathematical Sketching: An Approach to Making Dynamic Illustrations -- Introduction -- Mathematical Sketching -- Philosophical Considerations -- Generalizing Mathematical Sketching as a Paradigm -- Observations on Mathematical Sketching -- The MathPad2 Prototype -- MathPad2 Architecture -- The Gestural UI -- Writing, Recognizing, and Correcting Mathematics -- Making Drawings -- Nailing Diagram Components -- Grouping Diagram Components -- Associations -- Implicit Associations -- Explicit Associations -- Supporting Mathematical Toolset -- Graphing Equations -- Solving Equations -- Evaluating Expressions -- Mathematical Expression Recognition -- Mathematical Symbol Recognition -- Mathematical Expression Parsing -- Preparing Mathematical Sketches -- Association Inferencing -- Drawing Dimension Analysis -- Drawing Rectification -- Angle Rectification -- Location Rectification -- Size Rectification -- Translating and Visualizing Mathematical Sketches -- Moving Forward with Mathematical Sketching -- The Computational and Symbolic Toolset -- Functions and Macros -- Moving to 3D -- Interactivity -- Generating Mathematics from Drawings -- Adding Specific Underlying Mathematical Engines -- Alternate Forms of Dynamic Illustration -- Evaluation -- Conclusion -- References -- Pen-based Interfaces for Engineering and Education -- Introduction -- Sketch Parsing -- Mark-Group-Recognize -- Enumerate-Recognize-Prune -- Parsing Step 1: Enumerating Candidate Symbols -- Ink Density Locator: -- Segment Difference Locator: -- Parsing Step 2: Pruning Using Domain Knowledge -- Automated Error Correction -- Recognition -- Graph-based Recognizer -- Representation