Common Spaces: Multi-Modal-Media Ecosystem for Live Performances

  • Luis Leite
  • Rui Torres
  • Luis Aly

Abstract

Common Spaces is an interface for real-time media convergence and live performance combining media, applications and devices. A multimodal media ecosystem was designed to respond to the requirement of a specific performance — how to mix multiple applications into a single environment. This collaborative environment provides a flexible interface for performers to negotiate, share, and mix media, applications, and devices. Common Spaces is a framework based on interoperability and data flow, a network of virtual wires connecting applications that “talk” to each other sharing resources through technologies such as OSC or Syphon. With this approach, media designers have the freedom to choose a set of applications and devices that best suit their needs and are not restricted to a unique environment. We have implemented and performed with this ecosystem in live events, demonstrating its feasibility. In our paper we describe the project's concept and methodology. In the proposed performance we will use the Digital Archive of Portuguese Experimental Literature (www.po-ex.net) as a framework, appropriating its database assets, remixing its contents, as well as the techniques and methods they imply, stimulating the understanding of the archive as variable and adaptable. These digital re-readings and re-codings of experimental poems further highlight the importance of the materialities of experimental writing, integrating self-awareness in the modes of exchanges between literature, music, animation, performance, and technology.

Keywords

multimodality, live performance, media ecosystem, interoperability

  • Abstract viewed = 31 times
  • PDF viewed = 32 times
  • HTML viewed = 9 times

Downloads

Download data is not yet available.

References

AKA (2015). 30 Jun. 2017. CHDH Egregore. http://wwwchdhnet/egregore_sourcephp.

BURDICK, Anne, Johanna Drucker, Peter Lunenfeld, Todd Presner, and Jeffrey Schnapp (2012). Digital Humanities. MIT Press, Cambridge, MA.

BUTTERWORTH, Tom, and Anton Marini (2010). Syphon. Simplified BSD software license. 30 Jun. 2017. http://syphon.v002.info

CLARK, Herbert H and Susan E Brennan (1991). “Grounding in communication.” Perspectives on socially shared cognition. Eds. L B Resnick, J M Levine and S D Teasley. American Psychological Association, Washington, DC, US, 127-149. 30 Jun. 2017. https://doi.org/doi:10.1037/10096-006

DAVIS, Paul and Stéphane Letz (s.d.) JACK – Audio Connection Kit. BSD license. 30 Jun. 2017. http://www.jackaudio.org

INGALLS, Matt and Tim Place (s.d.). Soundflower. The MIT License. 30 Jun. 2017. https://github.com/RogueAmoeba/Soundflower-Original

JARVIS, Lynn (2014). Spout. Simplified BSD licence. 30 Jun. 2017. http://spout.zeal.co

LAUREL, Brenda (1991). Computers as Theatre. Boston, MA: Addison-Wesley Longman.

LEITE, Luís (2016a). Stringless – Remote Control for Unity3D. 30 Jun. 2017. https://github.com/grifu/StringlessUnity

LEITE, Luís (2016b). Pull The Strings. 30 Jun. 2017. https://githubcom/grifu/Pull-The-Strings.

LUGMAYR, Artur and Marko Teras (2015). “Immersive Interactive Technologies in Digital Humanities: A Review and Basic Concepts.” ImmersiveME '15 Proceedings of the 3rd International Workshop on Im-mersive Media Experiences. 31-36. 30 Jun. 2017. https://doi.org/10.1145/2814347.2814354

LUGMAYR, Artur. (2012). “Connecting the Real World with the Digital Overlay with Smart Ambient Media--applying Peirce's Categories in the Context of Ambient Media.” Multimedia Tools Appl. 58.2: 385-398. 30 Jun. 2017. https://doi.org/10.1007/s11042-010-0671-3

M, Adrien and Claire B (2013). eMotion. 30 Jun. 2017. http://wwwam-cbnet.

MARINI, Anton and Tom Butterworth (2008). v002 Rutt Etra. 30 Jun. 2017. http://v002.info/plugins/v002-rutt-etra/

MCLUHAN, Marshall (1994). Understanding Media: The extensions of man. Cambridge, MA: The MIT Press.

MESIÀ, Oriol Ferrer (2013). ofxRemoteUI. 30 Jun. 2017. https://githubcom/armadillu/ofxRemoteUI.

SCHEMEDER, Andrew, Adrian Freed, and David Wesser (2010). Best Practices for Open Sound Control. 1-10.

TORRES, Rui, Manuel Portela, and Maria do Carmo Castelo Branco Sequeira (2004). “Methodological Rationale for the Taxonomy of the PO.EX Digital Archive.” New Literary Hybrids in the Age of Mul-timedia Expression: Crossing borders, crossing genres. Ed. Marcel Cornis-Pope. Amsterdam and New York: John Benjamins Publishing Company. 42-55.
Published
2018-08-10
How to Cite
LEITE, Luis; TORRES, Rui; ALY, Luis. Common Spaces: Multi-Modal-Media Ecosystem for Live Performances. MATLIT: Materialities of Literature, [S.l.], v. 6, n. 1, p. 187-198, aug. 2018. ISSN 2182-8830. Available at: <http://impactum-journals.uc.pt/matlit/article/view/5691>. Date accessed: 19 dec. 2018.