Generating sub-resolution detail in images and volumes using constrained texture synthesis
Inhaltsverzeichnis
Reference
L. Wang and K. Mueller: Generating sub-resolution detail in images and volumes using constrained texture synthesis. IEEE Visualization 2004, Austin, Texas, October 2004 pp. 75-82
DOI
Abstract
A common deficiency of discretized datasets is that detail beyond the resolution of the dataset has been irrecoverably lost. This lack of detail becomes immediately apparent once one attempts to zoom into the dataset and only recovers blur. Here, we describe a method that generates the missing detail from any available and plausible high-resolution data, using texture synthesis. Since the detail generation process is guided by the underlying image or volume data and is designed to fill in plausible detail in accordance with the coarse structure and properties of the zoomed-in neighborhood, we refer to our method as constrained texture synthesis. Regular zooms become "semantic zooms", where each level of detail stems from a data source attuned to that resolution. We demonstrate our approach by a medical application ¿ the visualization of a human liver ¿ but its principles readily apply to any scenario, as long as data at all resolutions are available. We will first present a 2D viewing application, called the "virtual microscope", and then extend our technique to 3D volumetric viewing.
Extended Abstract
Bibtex
Used References
Michael Ashikhmin, Synthesizing natural textures, Proceedings of the 2001 symposium on Interactive 3D graphics, p.217-226, March 2001 http://doi.acm.org/10.1145/364338.364405
Michael Ashikhmin, Fast Texture Transfer, IEEE Computer Graphics and Applications, v.23 n.4, p.38-43, July 2003 http://dx.doi.org/10.1109/MCG.2003.1210863
{3} Dischler, J. M., Maritaud, K., Ievy, B., and Ghazanfarpour, D. 2002. Texture particles. Computer Graphics Forum 21, 3, 401-410.
Iddo Drori , Daniel Cohen-Or , Hezy Yeshurun, Fragment-based image completion, ACM SIGGRAPH 2003 Papers, July 27-31, 2003, San Diego, California http://doi.acm.org/10.1145/1201775.882267
Alexei A. Efros , William T. Freeman, Image quilting for texture synthesis and transfer, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.341-346, August 2001 http://doi.acm.org/10.1145/383259.383296
Alexei A. Efros , Thomas K. Leung, Texture Synthesis by Non-Parametric Sampling, Proceedings of the International Conference on Computer Vision-Volume 2, p.1033, September 20-25, 1999 http://dl.acm.org/citation.cfm?id=851569&CFID=588525319&CFTOKEN=29804931
George W. Furnas , Benjamin B. Bederson, Space-scale diagrams: understanding multiscale interfaces, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, p.234-241, May 07-11, 1995, Denver, Colorado, USA http://doi.acm.org/10.1145/223904.223934
William T. Freeman , Thouis R. Jones , Egon C Pasztor, Example-Based Super-Resolution, IEEE Computer Graphics and Applications, v.22 n.2, p.56-65, March 2002 http://doi.acm.org/10.1145/223904.223934
Rafael C. Gonzalez , Richard E. Woods, Digital Image Processing, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1992 http://dl.acm.org/citation.cfm?id=573607&CFID=588525319&CFTOKEN=29804931
Aaron Hertzmann , Charles E. Jacobs , Nuria Oliver , Brian Curless , David H. Salesin, Image analogies, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.327-340, August 2001 http://doi.acm.org/10.1145/383259.383295
Jiaya Jia , Chi-Keung Tang, Inference of Segmented Color and Texture Description by Tensor Voting, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.26 n.6, p.771-786, June 2004 http://dx.doi.org/10.1109/TPAMI.2004.10
Vivek Kwatra , Arno Schödl , Irfan Essa , Greg Turk , Aaron Bobick, Graphcut textures: image and video synthesis using graph cuts, ACM SIGGRAPH 2003 Papers, July 27-31, 2003, San Diego, California http://doi.acm.org/10.1145/1201775.882264
Lin Liang , Ce Liu , Ying-Qing Xu , Baining Guo , Heung-Yeung Shum, Real-time texture synthesis by patch-based sampling, ACM Transactions on Graphics (TOG), v.20 n.3, p.127-150, July 2001 http://doi.acm.org/10.1145/501786.501787
Ken Perlin , David Fox, Pad: an alternative approach to the computer interface, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.57-64, August 02-06, 1993, Anaheim, CA http://doi.acm.org/10.1145/166117.166125
Andrew Nealen , Marc Alexa, Hybrid texture synthesis, Proceedings of the 14th Eurographics workshop on Rendering, June 25-27, 2003, Leuven, Belgium http://dl.acm.org/citation.cfm?id=882419&CFID=588525319&CFTOKEN=29804931
Fabrice Neyret , Marie-Paule Cani, Pattern-based texturing revisited, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.235-242, July 1999 http://doi.acm.org/10.1145/311535.311561
Arno Schödl , Richard Szeliski , David H. Salesin , Irfan Essa, Video textures, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.489-498, July 2000 http://doi.acm.org/10.1145/344779.345012
Xin Tong , Jingdan Zhang , Ligang Liu , Xi Wang , Baining Guo , Heung-Yeung Shum, Synthesis of bidirectional texture functions on arbitrary surfaces, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002 http://doi.acm.org/10.1145/566654.566634
Greg Turk, Texture synthesis on surfaces, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.347-354, August 2001 http://doi.acm.org/10.1145/383259.383297
George Wolberg, Digital Image Warping, IEEE Computer Society Press, Los Alamitos, CA, 1994 http://dl.acm.org/citation.cfm?id=528718&CFID=588525319&CFTOKEN=29804931
Li-Yi Wei , Marc Levoy, Fast texture synthesis using tree-structured vector quantization, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.479-488, July 2000 http://doi.acm.org/10.1145/344779.345009
Li-Yi Wei , Marc Levoy, Texture synthesis by fixed neighborhood searching, Stanford University, Stanford, CA, 2002 http://dl.acm.org/citation.cfm?id=935082&CFID=588525319&CFTOKEN=29804931
{23} Xu, Y. Q., Guo, B., and Shum, H. Y. 2000. Chaos mosaic: fast and memory efficient texture synthesis. Technical Report MSR-TR-2000- 32, Microsoft Research.
{24} Yamauchi, H., Haber, J., and Seidel, H.-P. 2003. Image restoration using mutli-resolution image synthesis and image inpainting. Proc. Computer Graphics International 2003, 120-125.
{25} Yuri, B., and Kolmogorov, V. 2001. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. In Third International Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition, 359-374.
{26} Yuri, B., Veksler, O., and Zabih, R. 1999. Fast approximate energy minimization via graph cuts. International Conference on Computer Vision, 1, 377-384.
Steve Zelinka , Michael Garland, Towards real-time texture synthesis with the jump map, Proceedings of the 13th Eurographics workshop on Rendering, June 26-28, 2002, Pisa, Italy http://dl.acm.org/citation.cfm?id=581910&CFID=588525319&CFTOKEN=29804931
Links
Full Text
http://www.cs.sunysb.edu/%7Emueller/papers/vis04_synthesis.pdf
Sonstige Links
http://dl.acm.org/citation.cfm?id=1032664.1034433&coll=DL&dl=GUIDE&CFID=588525319&CFTOKEN=29804931
Link to: Klaus Müller: Sub-Resolution Detail Generation for Illustrative Rendering Using Constrained Texture Synthesis. In: Computational Aesthetics 2006.
