Video Granular Synthesis
Inhaltsverzeichnis
Reference
Angus Graeme Forbes and Javier Villegas: Video Granular Synthesis. In: Computational Aesthetics 2015 CAE'15, 195-201.
DOI
http://dx.doi.org/10.2312/exp.20151192
Abstract
This paper introduces a technique that enables the creative reshaping of one or more video signals based on granular synthesis techniques, normally applied only to audio signals. We demonstrate that a wide range of novel video processing effects can be generated through conceptualizing a video signal as being composed of a large number of video grains. These grains can be manipulated and maneuvered in a variety of ways, and a new video signal can then be created through the resynthesis of these altered grains; effects include cloning, rotating, and resizing the video grains, as well as repositioning them in space and time. These effects have been used successfully in a series of interactive multimedia performances, leading us to believe that our approach has significant artistic potential.
Extended Abstract
Bibtex
@inproceedings{Forbes:2015:VGS:2811239.2811252,
author = {Forbes, Angus Graeme and Villegas, Javier},
title = {Video Granular Synthesis},
booktitle = {Proceedings of the Workshop on Computational Aesthetics},
series = {CAE '15},
year = {2015},
location = {Istanbul, Turkey},
pages = {195--201},
numpages = {7},
url = {http://dl.acm.org/citation.cfm?id=2811239.2811252 http://de.evo-art.org/index.php?title=Video_Granular_Synthesis },
acmid = {2811252},
publisher = {Eurographics Association},
address = {Aire-la-Ville, Switzerland, Switzerland},
}
Used References
1 R. Borgo , M. Chen , B. Daubney , E. Grundy , G. Heidemann , B. Höferlin , M. Höferlin , H. Leitte , D. Weiskopf , X. Xie, State of the Art Report on Video-Based Graphics and Video Visualization, Computer Graphics Forum, v.31 n.8, p.2450-2477, December 2012 [doi>10.1111/j.1467-8659.2012.03158.x]
2 {BDA* 14} Bach B., Dragicevic P., Archambault D., Hurter C., Carpendale S.: A review of temporal data visualizations based on space-time cube operations. In Eurographics Conference on Visualization (2014), Borgo R., Maciejewski R., Viola I., (Eds.), The Eurographics Association. 3
3 Moshe Blank , Lena Gorelick , Eli Shechtman , Michal Irani , Ronen Basri, Actions as Space-Time Shapes, Proceedings of the Tenth IEEE International Conference on Computer Vision, p.1395-1402, October 17-20, 2005 [doi>10.1109/ICCV.2005.28]
4 Alvaro Cassinelli , Masatoshi Ishikawa, Khronos projector, ACM SIGGRAPH 2005 Emerging technologies, July 31-August 04, 2005, Los Angeles, California [doi>10.1145/1187297.1187308]
5 Angus Graeme Forbes , Tobias Höllerer , George Legrady, Generative fluid profiles for interactive media arts projects, Proceedings of the Symposium on Computational Aesthetics, July 19-21, 2013, Anaheim, California [doi>10.1145/2487276.2487287]
6 {FJP14} Forbes A. G., Jette C., Predoehl A.: Analyzing intrinsic motion textures created from naturalistic video captures. In Proceedings of the International Conference on Information Visualization Theory and Applications (IVAPP) (Lisbon, Portugal, January 2014). 3
7 Sidney Fels , Eric Lee , Kenji Mase, Techniques for interactive video cubism (poster session), Proceedings of the eighth ACM international conference on Multimedia, p.368-370, October 2000, Marina del Rey, California, USA [doi>10.1145/354384.354535]
8 {FO12} Forbes A. G., Odai K.: Iterative synaesthetic composing with multimedia signals. In Proceedings of the International Computer Music Conference (ICMC) (Ljubjiana, Slovenia, September 2012), pp. 573--578. 3
9 {FV14} Forbes A. G., Villegas J.: Creative applications of microvideos. In Proceedings of the the Sixth International Conferences on Advances in Multimedia (MMEDIA) (Nice, France, February 2014), pp. 108--111. 3
10 {GP05} Guigon E., Pierre A.: L'oeil moteur: Art optique et cinétique, 1950--1976. Musées de Strasbourg, Strasbourg, Germany, 2005. 4
11 {HL96} Hentschlaeger K., Langheinrich U.: Granular-synthesis, modell5. http://www.granularsynthesis.info/ns, 1996. Retrieved March 25, 2015. 2
12 {HRS02} Heinzel G., Rudiger A., Schilling R.: Spectrum and spectral density estimation by the Discrete Fourier transform (DFT), including a comprehensive list of window functions and some new at-top windows. Tech. Rep. 395068.0, Max-Planck-Institut fur Gravitationsphysik, February 2002. 2
13 {HS81} Horn B. K., Schunck B. G.: Determining optical flow. In 1981 Technical Symposium East (1981), International Society for Optics and Photonics, pp. 319--331. 5
14 {JTVF14} Jette C., Thomas K., Villegas J., Forbes A. G.: Translation as technique: Collaboratively creating an electroacoustic composition for saxophone and live video projection. In Joint Proceedings of the of the 40th International Computer Music Conference (ICMC) and the 11th Sound and Music Computing Conference (SMC) (Athens, Greece, September 2014), pp. 463--468. 5
15 {Kes13} Keston J.: Machine Machine. http://johnkeston.com, 2013. Retrieved March 25, 2015. 2
16 Allison W. Klein , Peter-Pike J. Sloan , Adam Finkelstein , Michael F. Cohen, Stylized video cubes, Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 21-22, 2002, San Antonio, Texas [doi>10.1145/545261.545264]
17 {Lev10} Levin G.: An informal catalogue of slit-scan video artworks and research. http://www.flong.com/texts/lists/slit_scan, 2010. Retrieved March 25, 2015. 3
18 {Mag09} Magyar A.: Urban Flow: New York. http://www.magyaradam.com, 2009. Retrieved March 25, 2015. 3
19 {Opi13} Opie T.: Granular synthesis: A granular synthesis resource website. http://granularsynthesis.com/software.php, 2013. Retrieved April 11, 2015. 2
20 {Rij13} Rijpers A.: Revive. https://vimeo.com/82177087, 2013. Retrieved March 25, 2015. 2
21 Curtis Roads , John Strawn , Curtis Abbott , John Gordon , Philip Greenspun, The computer music tutorial, MIT Press, Cambridge, MA, 1996
22 Curtis Roads, Microsound, The MIT Press, 2004
23 {Roa04b} Roads C.: Point Line Cloud. Asphodel, 2004. 2
24 Eli Shechtman , Michal Irani, Space-Time Behavior-Based Correlation—OR—How to Tell If Two Underlying Motion Fields Are Similar Without Computing Them?, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.29 n.11, p.2045-2056, November 2007 [doi>10.1109/TPAMI.2007.1119]
25 {Tru68} Trumbull D.: Creating special effects for 2001. American Cinematographer 49, 6 (June 1968), 416--420, 451--453. 3
26 {Utt02} Utterback C.: Liquid Time Series. http://camilleutterback.com/projects, 2002. Retrieved March 25, 2015. 3
27 {VEF15} Villegas J., Etemadpour R., Forbes A. G.: Evaluating the perception of different matching strategies for time-coherent animations. In Human Vision and Electronic Imaging XX (HVEI), vol. 9394 of Proceedings of SPIE-IS&T Electronic Imaging. San Francisco, California, February 2015, pp. 939434--1--13. 3
28 Javier Villegas , Angus Graeme Forbes, Analysis/synthesis approaches for creatively processing video signals, Proceedings of the ACM International Conference on Multimedia, November 03-07, 2014, Orlando, Florida, USA [doi>10.1145/2647868.2654944]
29 {VF14b} Villegas J., Forbes A. G.: Interactive non-photorealistic video synthesis for artistic user experience on mobile devices. In Proceedings of the International Workshop on Video Processing and Quality Metrics for Consumer Electronics (VPQM) (Chandler, Arizona, January 2014). 3
30 Hao-Yu Wu , Michael Rubinstein , Eugene Shih , John Guttag , Frédo Durand , William Freeman, Eulerian video magnification for revealing subtle changes in the world, ACM Transactions on Graphics (TOG), v.31 n.4, p.1-8, July 2012 [doi>10.1145/2185520.2185561]
31 Yonatan Wexler , Eli Shechtman , Michal Irani, Space-Time Completion of Video, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.29 n.3, p.463-476, March 2007 [doi>10.1109/TPAMI.2007.60]
32 Udo Zoelzer, Dafx: Digital Audio Effects, John Wiley & Sons, Inc., New York, NY, 2002
Links
Full Text
https://www.evl.uic.edu/documents/forbes_videogranularsynthesis_cae2015.pdf
Sonstige Links
http://dl.acm.org/citation.cfm?id=2811252&CFID=724111209&CFTOKEN=48939661
