Stroke surfaces: Temporally coherent non-photorealistic animations from video
Inhaltsverzeichnis
Reference
John Collomosse, Rowntree, D., Peter M. Hall (2005). Stroke surfaces: Temporally coherent non-photorealistic animations from video. IEEE Trans. Visualization and Comp. Graphics, 11(5): 540–549.
DOI
http://dx.doi.org/10.1109/TVCG.2005.85
Abstract
The contribution of this paper is a novel framework for synthesizing nonphotorealistic animations from real video sequences. We demonstrate that, through automated mid-level analysis of the video sequence as a spatiotemporal volume - a block of frames with time as the third dimension - we are able to generate animations in a wide variety of artistic styles, exhibiting a uniquely high degree of temporal coherence. In addition to rotoscoping, matting, and novel temporal effects unique to our method, we demonstrate the extension of static nonphotorealistic rendering (NPR) styles to video, including painterly, sketchy, and cartoon shading. We demonstrate how this novel coherent shading framework may be combined with our earlier motion emphasis work to produce a comprehensive "video paintbox" capable of rendering complete cartoon-styled animations from video clips.
Extended Abstract
Bibtex
Used References
J.P. Collomosse, D. Rowntree and P.M. Hall, "Cartoon-Style Rendering of Motion from Video," Proc. First Int',l Conf. Vision, Video, and Graphics (VVG), pp. 117-124, July 2003.
J.P. Collomosse, D. Rowntree and P.M. Hall, "Video Analysis for Cartoon-Like Special Effects," Proc. 14th British Machine Vision Conf., vol. 2, pp. 749-758, Sept. 2003. http://dx.doi.org/10.5244/C.17.74
D. Comanicu and P. Meer, "Mean Shift: A Robust Approach Toward Feature Space Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, May 2002. http://dx.doi.org/10.1109/34.1000236
G. Gooch and A. Gooch, Non-Photorealistic Rendering. A.K. Peters, July 2001.
A. Hertzmann, "Painterly Rendering with Curved Strokes of Multiple Sizes," Proc. ACM SIGGRAPH, pp. 453-460, 1998.
D. DeCarlo and A. Santella, "Abstracted Painterly Renderings Using Eye-Tracking Data," Proc. ACM SIGGRAPH, pp. 769-776, 2002.
A. Agarwala, A. Hertzmann, D. Salesin and S. Seitz, "Keyframe-Based Tracking for Rotoscoping and Animation," Proc. ACM SIGGRAPH, pp. 584-591, 2004. http://dx.doi.org/10.1145/1186562.1015764
J. Fekete, E. Bizouarn, T. Galas and F. Taillefer, "Tictactoon: A Paperless System for Professional 2D Animation," Proc. ACM SIGGRAPH, pp. 79-90, 1995. http://dx.doi.org/10.1145/218380.218417
P. Litwinowicz, "Processing Images and Video for an Impressionist Effect," Proc. ACM SIGGRAPH, pp. 407-414, 1997.
L. Kovacs and T. Sziranyi, "Creating Video Animations Combining Stochastic Paintbrush Transformation and Motion Detection," Proc. 16th Int',l Conf. Pattern Recognition, vol. II, pp. 1090-1093, 2002. http://dx.doi.org/10.1109/ICPR.2002.1048495
A. Hertzmann and K. Perlin, "Painterly Rendering for Video and Interaction," Proc. ACM Non-Photorealistic Animation and Rendering (NPAR), pp. 7-12, 2000. http://dx.doi.org/10.1145/340916.340917
S. Green, D. Salesin, S. Schofield, A. Hertzmann and P. Litwinowicz, "Non-Photorealistic Rendering," ACM SIGGRAPH, NPR Course Notes, 1999.
M. Kass, A. Witkin and D. Terzopoulos, "Active Contour Models," Int',l J. Computer Vision, vol. 1, no. 4, pp. 321-331, 1987. http://dx.doi.org/10.1007/BF00133570
A. Agarwala, "Snaketoonz: A Semi-Automatic Approach to Creating Cel Animation from Video," Proc. ACM Non-Photorealistic Animation and Rendering Conf. (NPAR), pp. 139-147, June 2002.
D. Terzopolous, A. Witkin and M. Kass, "Constraints on Deformable Models: Recovering 3D Shape and Nonrigid Motion," Artificial Intelligence, vol. 36, no. 1, pp. 91-123, 1988. http://dx.doi.org/10.1016/0004-3702(88)90080-X
D. DeMenthon, "Spatio-Temporal Segmentation of Video by Hierarchical Mean Shift Analysis," Proc. Statistical Methods in Video Processing (SMVP) Workshop at ECCV, 2002.
A.W. Klein, P.J. Sloan, R.A. Colburn, A. Finkelstein and M.F. Cohen, "Video Cubism," Technical Report MSR-TR-2001-45, Microsoft Research, May 2001.
J. Wang, Y. Xu, H-Y. Shum and M. Cohen, "Video Tooning," Proc. ACM SIGGRAPH, pp. 574-583, 2004. http://dx.doi.org/10.1145/1186562.1015763
J.P. Collomosse, "Higher Level Techniques for the Artistic Rendering of Images and Video," PhD thesis, Univ. of Bath, U.K., May 2004.
C. Christoudias, B. Georgescu and P. Meer, "Synergism in Low Level Vision," Proc. 16th Int',l Conf. Pattern Recognition, vol. 4, pp. 150-155, Aug. 2002. http://dx.doi.org/10.1109/ICPR.2002.1047421
R.L. Cosgriff, "Identification of Shape," Technical Report 820-11, ASTIA AD 254792, Ohio State Univ., 1960.
G. Hamarneh and T. Gustavsson, "Deformable Spatio-Temporal Shape Models: Extending asm to 2d+time," J. Image and Vision Computing, vol. 22, no. 6, pp. 461-470, 2004. http://dx.doi.org/10.1016/j.imavis.2003.11.009
D. Williams and M. Shah, "A Fast Algorithm for Active Contours and Curvature Estimation," Graphical Models and Image Processing, vol. 55, no. 1, pp. 14-26, 1992. http://dx.doi.org/10.1016/1049-9660(92)90003-L
B. Baumgart, "A Polyhedral Representation for Computer Vision," Proc. Nat',l Computer Conf., pp. 589-596, 1975.
P. Hall, "Non-Photorealistic Rendering by Q-Mapping," Computer Graphics Forum, vol. 1, no. 18, pp. 27-39, 1999. http://dx.doi.org/10.1111/1467-8659.00300
S. Strassmann, "Hairy Brushes," Proc. ACM SIGGRAPH, vol. 20, pp. 225-232, 1986.
T. Gautama and M.M. VanHulle, "A Phase-Based Approach to the Estimation of the Optical Flow Field Using Spatial Filtering," IEEE Trans. Neural Networks, vol. 5, no. 13, pp. 1127-1136, 2002. http://dx.doi.org/10.1109/TNN.2002.1031944
Links
Full Text
http://www.ee.surrey.ac.uk/CVSSP/Publications/papers/Collomosse-TVCG-2005.pdf
