Paint by relaxation
Hertzmann, A. (2001). Paint by relaxation. In: Proc. Computer Graphics Intl. (CGI), 47–54.
We use relaxation to produce painted imagery from images and video. An energy function is first specified; we then search for a painting with minimal energy. The appeal of this strategy is that, ideally, we need only specify what we want, not how to directly compute it. Because the energy function is very difficult to optimize, we use a relaxation algorithm combined with search heuristics. This formulation allows us to specify painting style by varying the relative weights of energy terms. The basic energy function yields an economical style that conveys an image with few strokes. This style produces greater temporal coherence for video than previous techniques. The system allows as fine user control as desired: the user may interactively change the painting style, specify variations of style over an image, and/or add specific strokes to the painting
Adobe Systems. Adobe Photoshop. Software package.
A. A. Amini, T. E. Weymouth, and R. C. Jain. Using Dynamic Programming for Solving Variational Prob- lems in Vision. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(9):855–867, Sept. 1990.
L. Carpenter. The A-buffer, an Antialiased Hidden Surface Method. Computer Graphics (SIGGRAPH ’84 Proceedings), 18(3):103–108, July 1984.
C. Curtis, A. Gooch, B. Gooch, S. Green, A. Hertz- mann, P. Litwinowicz, D. Salesin, and S. Schofield. Non-Photorealistic Rendering. SIGGRAPH 99 Course Notes, 1999.
E. Daniels. Deep Canvas in Disney’s Tarzan. In SIG- GRAPH 99: Conference Abstracts and Applications, page 200, 1999.
P. E. Haeberli. Paint By Numbers: Abstract Im- age Representations. In F. Baskett, editor, Computer Graphics (SIGGRAPH ’90 Proceedings), volume 24, pages 207–214, Aug. 1990.
A. Hertzmann. Painterly Rendering with Curved Brush Strokes of Multiple Sizes. In SIGGRAPH 98 Conference Proceedings, pages 453–460, July 1998.
A. Hertzmann. Paint by Relaxation. Technical Report TR2000-801, NYU Computer Science, May 2000.
A. Hertzmann and K. Perlin. Painterly Rendering for Video and Interaction. In Proceedings of the First An- nual Symposium on Non-Photorealistic Animation and Rendering, June 2000.
M. Kass, A. Witkin, and D. Terzopoulos. Snakes: Ac- tive Contour Models. International Journal of Com- puter Vision, 1(4), 1987.
A. W. Klein, W. W. Li, M. M. Kazhdan, W. T. Cor- rea, A. Finkelstein, and T. A. Funkhouser. Non- photorealistic virtual environments. Proceedings of SIGGRAPH 2000, July 2000.
P. Litwinowicz. Processing Images and Video for an Impressionist Effect. In SIGGRAPH 97 Conference Proceedings, pages 407–414, Aug. 1997.
P. Litwinowicz. Image-Based Rendering and Non- Photorealistic Rendering. In S. Green, editor, Non- Photorealistic Rendering, SIGGRAPH Course Notes. 1999.
B. J. Meier. Painterly Rendering for Animation. In SIGGRAPH 96 Conference Proceedings, pages 477– 484, Aug. 1996. M. P. Salisbury, M. T. Wong, J. F. Hughes, and D. H. Salesin. Orientable Textures for Image-Based Pen- and-Ink Illustration. In SIGGRAPH 97 Conference Proceedings, pages 401–406, Aug. 1997.
M. Shiraishi and Y. Yamaguchi. An algorithm for automatic painterly rendering based on local source image approximation. NPAR 2000 : First Interna- tional Symposium on Non Photorealistic Animation and Rendering, pages 53–58, June 2000.
E. P. Simoncelli, E. H. Adelson, and D. J. Heeger. Probability Distributions of Optical Flow. In Proc. IEEE Conference of Computer Vision and Pattern Recognition, June 1991.
G. Turk and D. Banks. Image-Guided Streamline Placement. In SIGGRAPH 96 Conference Proceed- ings, pages 453–460, Aug. 1996.