Image Filtering for Interactive Level-of-Abstraction Visualization of 3D Scenes
Inhaltsverzeichnis
Reference
Amir Semmo and Jürgen Döllner: Image Filtering for Interactive Level-of-Abstraction Visualization of 3D Scenes. In: Computational Aesthetics 2014.
DOI
http://dx.doi.org/10.1145/2630099.2630101
Abstract
Texture mapping is a key technology in computer graphics for visual design of rendered 3D scenes. An effective information transfer of surface properties, encoded by textures, however, depends significantly on how important information is highlighted and cognitively processed by the user in an application context. Edge-preserving image filtering is a promising approach to address this concern while preserving global salient structures. Much research has focused on applying image filters in a post-process stage to foster an artistically stylized rendering, but these approaches are generally not able to preserve depth cues important for 3D visualization (e.g., texture gradient). To this end, filtering that processes texture data coherently with respect to linear perspective and spatial relationships is required. In this work, we present a system that enables to process textured 3D scenes with perspective coherence by arbitrary image filters. We propose decoupled deferred texturing with (1) caching strategies to interactively perform image filtering prior to texture mapping, and (2) for each mipmap level separately to enable a progressive level of abstraction. We demonstrate the potentials of our methods on several applications, including illustrative visualization, focus+context visualization, geometric detail removal, and depth of field. Our system supports frame-to-frame coherence, order-independent transparency, multitexturing, and content-based filtering.
Extended Abstract
Bibtex
@inproceedings{Semmo:2014:IFI:2630099.2630101,
author = {Semmo, Amir and D\"{o}llner, J\"{u}rgen},
title = {Image Filtering for Interactive Level-of-abstraction Visualization of 3D Scenes},
booktitle = {Proceedings of the Workshop on Computational Aesthetics},
series = {CAe '14},
year = {2014},
isbn = {978-1-4503-3019-0},
location = {Vancouver, British Columbia, Canada},
pages = {5--14},
numpages = {10},
url = {http://doi.acm.org/10.1145/2630099.2630101 http://de.evo-art.org/index.php?title=Image_Filtering_for_Interactive_Level-of-Abstraction_Visualization_of_3D_Scenes },
doi = {10.1145/2630099.2630101},
acmid = {2630101},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {image filtering, level of abstraction, visualization},
}
Used References
Pascal Barla , Joëlle Thollot , Lee Markosian, X-toon: an extended toon shader, Proceedings of the 4th international symposium on Non-photorealistic animation and rendering, June 05-07, 2006, Annecy, France http://doi.acm.org/10.1145/1124728.1124749
Pierre Bénard , Adrien Bousseau , Joëlle Thollot, Dynamic solid textures for real-time coherent stylization, Proceedings of the 2009 symposium on Interactive 3D graphics and games, February 27-March 01, 2009, Boston, Massachusetts http://doi.acm.org/10.1145/1507149.1507169
Bénard, P., Bousseau, A., and Thollot, J. 2011. State-of-the-Art Report on Temporal Coherence for Stylized Animations. Computer Graphics Forum 30, 8, 2367--2386.
Pravin Bhat , C. Lawrence Zitnick , Michael Cohen , Brian Curless, GradientShop: A gradient-domain optimization framework for image and video filtering, ACM Transactions on Graphics (TOG), v.29 n.2, p.1-14, March 2010 http://doi.acm.org/10.1145/1731047.1731048
Adrien Bousseau , Matt Kaplan , Joëlle Thollot , François X. Sillion, Interactive watercolor rendering with temporal coherence and abstraction, Proceedings of the 4th international symposium on Non-photorealistic animation and rendering, June 05-07, 2006, Annecy, France http://doi.acm.org/10.1145/1124728.1124751
F. Cole , D. DeCarlo , A. Finkelstein , K. Kin , K. Morley , A. Santella, Directing gaze in 3D models with stylized focus, Proceedings of the 17th Eurographics conference on Rendering Techniques, June 26-28, 2006, Nicosia, Cyprus http://dx.doi.org/10.2312/EGWR/EGSR06/377-387
Lin Cong , Ruofeng Tong , Jinxiang Dong, Selective image abstraction, The Visual Computer: International Journal of Computer Graphics, v.27 n.3, p.187-198, March 2011 http://dx.doi.org/10.1007/s00371-010-0522-2
Antonio Criminisi , Toby Sharp , Carsten Rother , Patrick P'erez, Geodesic image and video editing, ACM Transactions on Graphics (TOG), v.29 n.5, p.1-15, October 2010 http://doi.acm.org/10.1145/1857907.1857910
Doug DeCarlo , Anthony Santella, Stylization and abstraction of photographs, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002 [doi>10.1145/566654.566650]
Christopher DeCoro , Forrester Cole , Adam Finkelstein , Szymon Rusinkiewicz, Stylized shadows, Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, August 04-05, 2007, San Diego, California http://doi.acm.org/10.1145/1274871.1274884
Döllner, J., and Kyprianidis, J. E. 2010. Approaches to Image Abstraction for Photorealistic Depictions of Virtual 3D Models. In Cartography in Central and Eastern Europe. Springer, 263--277.
William Donnelly , Andrew Lauritzen, Variance shadow maps, Proceedings of the 2006 symposium on Interactive 3D graphics and games, March 14-17, 2006, Redwood City, California http://doi.acm.org/10.1145/1111411.1111440
Engel, J., Semmo, A., Trapp, M., and Döllner, J. 2013. Evaluating the Perceptual Impact of Rendering Techniques on Thematic Color Mappings in 3D Virtual Environments. In Proc. Vision, Modeling & Visualization, 25--32.
Zeev Farbman , Raanan Fattal , Dani Lischinski , Richard Szeliski, Edge-preserving decompositions for multi-scale tone and detail manipulation, ACM Transactions on Graphics (TOG), v.27 n.3, August 2008 http://doi.acm.org/10.1145/1360612.1360666
Eduardo S. L. Gastal , Manuel M. Oliveira, Domain transform for edge-aware image and video processing, ACM Transactions on Graphics (TOG), v.30 n.4, July 2011 http://doi.acm.org/10.1145/2010324.1964964
Gibson, J. J. 1986. The ecological approach to visual perception. Routledge.
Goldstein, E. B. 2010. Sensation and perception. Wadsworth Publishing Company.
Bruce Gooch , Erik Reinhard , Amy Gooch, Human facial illustrations: Creation and psychophysical evaluation, ACM Transactions on Graphics (TOG), v.23 n.1, p.27-44, January 2004 http://doi.acm.org/10.1145/966131.966133
Amy A. Gooch , Jeremy Long , Li Ji , Anthony Estey , Bruce S. Gooch, Viewing progress in non-photorealistic rendering through Heinlein's lens, Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering, June 07-10, 2010, Annecy, France http://doi.acm.org/10.1145/1809939.1809959
Kaiming He , Jian Sun , Xiaoou Tang, Guided Image Filtering, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.35 n.6, p.1397-1409, June 2013 http://dx.doi.org/10.1109/TPAMI.2012.213
Howard, I. P., and Rogers, B. J. 2012. Perceiving in Depth, Volume 3: Other Mechanisms of Depth Perception. No. 29. Oxford University Press.
Henry Kang , Seungyong Lee , Charles K. Chui, Coherent line drawing, Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, August 04-05, 2007, San Diego, California http://doi.acm.org/10.1145/1274871.1274878
Henry Kang , Seungyong Lee , Charles K. Chui, Flow-Based Image Abstraction, IEEE Transactions on Visualization and Computer Graphics, v.15 n.1, p.62-76, January 2009 http://dx.doi.org/10.1109/TVCG.2008.81
Michael Kass , Justin Solomon, Smoothed local histogram filters, ACM Transactions on Graphics (TOG), v.29 n.4, July 2010 http://doi.acm.org/10.1145/1778765.1778837
Allison W. Klein , Wilmot Li , Michael M. Kazhdan , Wagner T. Corrêa , Adam Finkelstein , Thomas A. Funkhouser, Non-photorealistic virtual environments, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.527-534, July 2000 http://doi.acm.org/10.1145/344779.345075
Robert Kosara , Silvia Miksch , Helwig Hauser, Semantic Depth of Field, Proceedings of the IEEE Symposium on Information Visualization 2001 (INFOVIS'01), p.97, October 22-23, 2001
Kyprianidis, J. E., and Döllner, J. 2008. Image Abstraction by Structure Adaptive Filtering. In Proc. EG UK TPCG, 51--58.
Kyprianidis, J. E., and Kang, H. 2011. Image and Video Abstraction by Coherence-Enhancing Filtering. Comput. Graph. Forum 30, 2, 593--602.
Jan Eric Kyprianidis , John Collomosse , Tinghuai Wang , Tobias Isenberg, State of the "Art”: A Taxonomy of Artistic Stylization Techniques for Images and Video, IEEE Transactions on Visualization and Computer Graphics, v.19 n.5, p.866-885, May 2013 http://dx.doi.org/10.1109/TVCG.2012.160
Jan Eric Kyprianidis, Image and video abstraction by multi-scale anisotropic Kuwahara filtering, Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering, August 05-07, 2011, Vancouver, British Columbia, Canada http://doi.acm.org/10.1145/2024676.2024686
Adam Lake , Carl Marshall , Mark Harris , Marc Blackstein, Stylized rendering techniques for scalable real-time 3D animation, Proceedings of the 1st international symposium on Non-photorealistic animation and rendering, p.13-20, June 05-07, 2000, Annecy, France http://doi.acm.org/10.1145/340916.340918
Thomas Luft , Carsten Colditz , Oliver Deussen, Image enhancement by unsharp masking the depth buffer, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006 http://doi.acm.org/10.1145/1141911.1142016
Milán Magdics , Catherine Sauvaget , Rubén J. García , Mateu Sbert, Post-processing NPR effects for video games, Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry, November 17-19, 2013, Hong Kong, Hong Kong http://doi.acm.org/10.1145/2534329.2534348
David Mould, Texture-preserving abstraction, Proceedings of the Symposium on Non-Photorealistic Animation and Rendering, June 04-06, 2012, Annecy, France http://dl.acm.org/citation.cfm?id=2330162&CFID=588525319&CFTOKEN=29804931
Kevin Myers , Louis Bavoil, Stencil routed A-Buffer, ACM SIGGRAPH 2007 sketches, August 05-09, 2007, San Diego, California http://doi.acm.org/10.1145/1278780.1278806
Nienhaus, M., and Döllner, J. 2003. Edge-enhancement - An algorithm for real-time non-photorealistic rendering. Journal of WSCG 11, 2, 346--353.
Marc Nienhaus , Jürgen Döllner, Blueprints: illustrating architecture and technical parts using hardware-accelerated non-photorealistic rendering, Proceedings of Graphics Interface 2004, p.49-56, May 17-19, 2004, London, Ontario, Canada http://dl.acm.org/citation.cfm?id=1006065&CFID=588525319&CFTOKEN=29804931
Pfautz, J. D. 2000. Depth perception in computer graphics. PhD thesis, University of Cambridge.
Emil Praun , Hugues Hoppe , Matthew Webb , Adam Finkelstein, Real-time hatching, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.581, August 2001 http://doi.acm.org/10.1145/383259.383328
Redmond, N., and Dingliana, J. 2007. Adaptive Abstraction of 3D Scenes in Real-Time. In Eurographics Short Papers, 77--80.
Niall Redmond , John Dingliana, Investigating the effect of real-time stylisation techniques on user task performance, Proceedings of the 6th Symposium on Applied Perception in Graphics and Visualization, September 30-October 02, 2009, Chania, Crete, Greece http://doi.acm.org/10.1145/1620993.1621017
Takafumi Saito , Tokiichiro Takahashi, Comprehensible rendering of 3-D shapes, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.197-206, September 1990, Dallas, TX, USA http://doi.acm.org/10.1145/97879.97901
Anthony Santella , Doug DeCarlo, Visual interest and NPR: an evaluation and manifesto, Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering, June 07-09, 2004, Annecy, France http://doi.acm.org/10.1145/987657.987669
Amir Semmo , Matthias Trapp , Jan Eric Kyprianidis , Jürgen Döllner, Interactive Visualization of Generalized Virtual 3D City Models using Level-of-Abstraction Transitions, Computer Graphics Forum, v.31 n.3pt1, p.885-894, June 2012 http://dx.doi.org/10.1111/j.1467-8659.2012.03081.x
Kartic Subr , Cyril Soler , Frédo Durand, Edge-preserving multiscale image decomposition based on local extrema, ACM Transactions on Graphics (TOG), v.28 n.5, December 2009 http://doi.acm.org/10.1145/1618452.1618493
Surdick, R. T., Davis, E. T., King, R. A., Corso, G. M., Shapiro, A., Hodges, L., and Elliot, K. 1994. Relevant cues for the visual perception of depth: is where you see it where it is? In Proc. Hum. Fact. Ergon. Soc. Annu. Meet., vol. 38, 1305--1309.
C. Tomasi , R. Manduchi, Bilateral Filtering for Gray and Color Images, Proceedings of the Sixth International Conference on Computer Vision, p.839, January 04-07, 1998 http://dl.acm.org/citation.cfm?id=939190&CFID=588525319&CFTOKEN=29804931
Leonard C. Wanger , James A. Ferwerda , Donald P. Greenberg, Perceiving Spatial Relationships in Computer-Generated Images, IEEE Computer Graphics and Applications, v.12 n.3, p.44-51, 54-58, May 1992 http://dx.doi.org/10.1109/38.135913
Colin Ware, Information Visualization: Perception for Design, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2004 http://dl.acm.org/citation.cfm?id=983611&CFID=588525319&CFTOKEN=29804931
Weickert, J. 1998. Anisotropic diffusion in image processing, vol. 1. Teubner Stuttgart.
Lance Williams, Pyramidal parametrics, Proceedings of the 10th annual conference on Computer graphics and interactive techniques, p.1-11, July 25-29, 1983, Detroit, Michigan, USA http://doi.acm.org/10.1145/800059.801126
Holger Winnemöller , Sven C. Olsen , Bruce Gooch, Real-time video abstraction, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006 http://doi.acm.org/10.1145/1141911.1142018
Holger Winnemöller , David Feng , Bruce Gooch , Satoru Suzuki, Using NPR to evaluate perceptual shape cues in dynamic environments, Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, August 04-05, 2007, San Diego, California http://doi.acm.org/10.1145/1274871.1274885
Holger WinnemöLler , Jan Eric Kyprianidis , Sven C. Olsen, Special Section on CANS: XDoG: An eXtended difference-of-Gaussians compendium including advanced image stylization, Computers and Graphics, v.36 n.6, p.740-753, October, 2012 http://dx.doi.org/10.1016/j.cag.2012.03.004
Li Xu , Cewu Lu , Yi Xu , Jiaya Jia, Image smoothing via L0 gradient minimization, ACM Transactions on Graphics (TOG), v.30 n.6, December 2011 http://doi.acm.org/10.1145/2070781.2024208
Links
Full Text
Sonstige Links
http://hpi.de/doellner/people/current/semmo/year/2014/102393/SD14.html
