A Koan

The disciple went to Minsky.

The disciple told him of his project, to develop a story generator with different components, a collaborative system that collaborated.

Minsky asked if a specific author was to be imitated.

No, the disciple said, the project seeks to do what only computers can do, to use computational power in new ways. And yet, the disciple admitted, the system models human creativity, techniques and processes that people use. Hesitantly, the disciple said, “it does seem contradictory…”

“You can do both,” said Minsky.

At that moment, the disciple was enlightened.

“Driverless” or “Self-Driving” Cars

So, I’m not saying they’re a bad idea, but why do these things get called “driverless” or “self-driving”? They are being driven by an immense corporation with the most massive store of data on Earth. They can’t function without this corporation or this store of data. They can’t drive themselves.

I dunno, maybe we should at least notice this sort of — hey! These cars are programmed to go up to 10 mph above the speed limit! Shiny!

(Prompted by Erik Stayton‘s great presentation of his thesis work on this topic yesterday. Erik works as my research assisstant in the Trope Tank.)

The Mutable Stanzas

Yesterday first-person-shooter Borges, intimate, infinite, and based on prose; today cut-up Spenser, mutable and poetic.

The Mutable Stanzas

This dynamic digital poetry piece, by Stephen Pentecost, is quite compelling. The author writes:

The Mutable Stanzas is a digital poetry installation and deformance experiment inspired by Raymond Queneau’s Cent Mille Milliards de Poèmes, by the work by Jerome McGann et al on “Deformance and Interpretation,” and by the work of my collegues in the Humanities Digital Workshop.

The Mutable Stanzas disassembles Edmund Spenser’s The Faerie Queene into its constituent lines, groups lines according to terminal rhyme, then randomly reassembles lines into new stanzas.

While the stanzas are structured by end rhyme, and each line is not independent of others, I wonder, as a reader, whether it’s best to avail myself of the pause button or whether I should simply continue reading down the page.

Computational Narrative and Games (Special Issue)

A special issue of IEEE Transactions on Computational Intelligence and AI in Games (TCIAIG) is now out — I mention it because I was one of the editors, and the issue deals with computational narrative and games.

Here’s the link to the computational narrative and games issue. It was edited by Ian Horswill, Nick Montfort and Michael Young. And here’s what is in it:

Guest Editorial
Horswill, I.D; Montfort, N; Young, R.M
p 92-96

Social Story Worlds With Comme il Faut
McCoy, J. ; Treanor, M. ; Samuel, B. ; Reed, A.A. ; Mateas, M. ; Wardrip-Fruin, N.

p 97-112

Versu—A Simulationist Storytelling System
Evans, R. ; Short, E.
p 113-130

A Computational Model of Narrative Generation for Surprise Arousal
Bae, B.-C. ; Young, R.M.
p 131-143

Automated Story Selection for Color Commentary in Sports
Lee, G. ; Bulitko, V. ; Ludvig, E.A.
p 144-155

Skald: Minstrel Reconstructed
Tearse, B. ; Mawhorter, P. ; Mateas, M. ; Wardrip-Fruin, N.
p 156-165

Designing User-Character Dialog in Interactive Narratives: An Exploratory Experiment
Endrass, B. ; Klimmt, C. ; Mehlmann, G. ; Andre, E. ; Roth, C.
p 166-173

Personalized Interactive Narratives via Sequential Recommendation of Plot Points
Yu, H. ; Riedl, M.O.
p 174-187

Lessons on Using Computationally Generated Influence for Shaping Narrative Experiences
Roberts, D.L. ; Isbell, C.L.
p 188-202

A Supervised Learning Framework for Modeling Director Agent Strategies in Educational Interactive Narrative
Lee, S.Y. ; Rowe, J.P. ; Mott, B.W. ; Lester, J.C.
p 203-214

Shall I Compare Thee to Another Story?—An Empirical Study of Analogy-Based Story Generation
Zhu, J. ; Ontanon, S.
p 216-227

Analysis of ReGEN as a Graph-Rewriting System for Quest Generation
Kybartas, B. ; Verbrugge, C.
p 228 – 241

“Envisioning the Future of Computational Media”

The final report of the Media Systems workshop has just been released:

“Envisioning the Future of Computational Media.”

You can download either the executive summary alone or the whole report.

I took part in the Media Systems workshop in 2012 with about 40 others from across the country. The workshop was sponsored by the National Science Foundation, National Endowment for the Humanities, National Endowment for the Arts, Microsoft Studios, and Microsoft Research. As Noah Wardrip-Fruin, co-author and co-organizer of the workshop, writes on the HASTAC site:

>Our report, “Envisioning the Future of Computational Media,” starts with the fact that the future of media is increasingly computational — video games, smartphone apps, ebooks, social media, and more.
>
>As media evolve and change, the stakes are high, on many fronts — from culture and the economy to education and health.
>
>To create media capable of continuing the expansion of computational media’s impact, we need to combine technical research that develops media possibilities with innovations in the creation and interpretation of media projects and forms.
>
>Instead, today, we generally separate these activities. Technology research organizations generally don’t have disciplinary, funding, or organizational support for making or interpreting media. Media making and interpretation organizations generally lack support for long-term technology research.
>
>Our report is focused on recommendations for how to fix this.

Although I see the success of people who have integrated technical and humanistic viewpoints all the time – in my colleagues and collaborators, to be sure, but also in MIT students who bring together technical depth and with humanistic inquiry and artistic creation – I realize that there is still a gap between computation and media. I hope this report, which offers a dozen recommendations to address this disconnect, will be helpful as we try to improve our own skills and those of our students.

World Clock in Print & for Sale

World Clock, Nick Montfort

My novel World Clock, generated by 165 lines of Python code that I wrote in a few hours on November 27, 2013, is now available in print.

>_World Clock_ tells of 1440 incidents that take place around the world at each minute of a day. The novel was inspired by Stanislaw Lem’s “One Human Minute” and Harry Mathews’s “The Chronogram for 1998.” It celebrates the industrial concept of time and certain types of vigorous banality which are shared by all people throughout the world.

The code has been online, along with a PDF of the book’s text, since late November. The Python program that generated this novel is available under a free software license. Anyone may make whatever use of it; generate your own novel with the unchanged code, if you like, or modify it to produce something different, for instance.

The book _World Clock_ is for sale to local and remote customers from my local independent bookstore, the Harvard Book Store. (No direct relationship to the university of the same name; they both happen to be located in Harvard Square.) The book is printed on the Espresso Book Machine in the store – to the amazement of onlookers. The apparatus has been dubbed “Paige M. Gutenborg.”

The 239-page paperback can be purchased for only $14.40, which is the low, low price of only one cent per minute.

World Clock's title page

No Code: Null Programs

Just posted: **TROPE-13-03 – No Code: Null Programs** by Nick Montfort, in the Trope Report series (technical reports from my lab the Trope Tank at MIT).

>To continue the productive discussion of uninscribed artworks in Craig Dworkin’s _No Medium,_ this report discusses, in detail, those computer programs that have no code, and are thus empty or null. Several specific examples that have been offered in different contexts (the demoscene, obfuscated coding, a programming challenge, etc.) are analyzed. The concept of a null program is discussed with reference to null strings and files. This limit case of computing shows that both technical and cultural means of analysis are important to a complete understanding of programs – even in the unusual case that they lack code.

Please share and enjoy. And do feel free to leave a comment here if anything to add on this topic, or if you have a question about this report. I’d be glad to continue the discussion of these unusual programs.

Talks from Media Systems

Noah Wardrip-Fruin was an organizer the Media Systems workshop at UCSC just over a year ago, August 26-29, 2012. It was an extraordinary gathering about computational media and its potential, with famous participants from a variety of disciplines and practices. The workshop’s sponsors were also remarkable: the National Science Foundation, National Endowment for the Humanities, National Endowment for the Arts, Microsoft Research, and Microsoft Studios. Now, Noah is working to put high-quality videos of talks from this event online, and to offer some very useful framing discussion of those talks.

This month, three have been posted. The first of these is a talk by Ian Horswill: “Interdisciplinarity is Hard.” I’m collaborating with Ian now to edit a special issue on computational narrative and am looking forward to seeing him at AIIDE. In addition to his talk, I recommend (and assign) his short but rich article “What is Computation?,” which discusses some of the fundamentals of computation as a science along with its intellectual and cultural importance. Those with access to ACM content can also get the later version of the article that was published in Crossroads.

The second talk posted is from the inestimable production designer Alex McDowell: “World Building.” McDowell (The Crow, Fear and Loathing in Las Vegas, Fight Club, Minority Report, Watchmen, etc., etc. ) describes how the development of movies is no longer a storytelling process driven by a single person or idea, but is becoming a process of world building in which a variety of concepts, including design and in some cases engagement with urban planning and spaces, influence each other. McDowell made his points with some of the most beautiful and byzantine diagrammatic slides since David Byrne was doing work in PowerPoint.

The most recent talk is mine – Nick Montfort: “The Art of Operationalization.” I spoke about my experience implementing humanistic ideas (in my case, about narrative) in computational systems, ones that not only can produce narrative results, but which can advance our understanding of the humanities and arts. Prof. Janet Kolodner (now serving the National Science Foundation) seemed to be uncertain about the value of this work, and questioned me about that during my talk – in a way that surprised me a bit! But looking back, I see that our discussion was one of the benefits of having a diverse yet fairly small in-person gathering. I seldom have these discussions either on this blog or in larger, multi-track conferences.

I think of Curveship and even the development of small-scale programs such as Through the Park as research activities (in the humanities, but potentially also in computation) that as connected to narrative and poetic practice. While some people (such as Ken Perlin, who was also at workshop and whose video will be up next week) work in this sort of mode and see the value in it, the benefits are not obvious. The result may not a direct educational outcome, an incremental advance that can be directly measured and evaluated, or a work of art or literature that is recognizable in a traditional way. So, whether I was able to answer well at the time or not, I appreciate the questions, and hope to get more of those sort in other workshops such as these.

Is that a Computer in Your Browser?

Two online emulator initiatives I found out about at the Library of Congress recently, at the Preserving.exe Summit:

The Olive Executable Archive, which originated at CMU and which is not open to the public yet, provides Linux VMs running emulators via one’s browser. When I saw it demonstrated, I was told it worked only on Linux, but that the team planned to have it working on other platforms soon.

JavaScript MESS, a port of the famous multi-emulator to allow it to run in a browser window. It’s not complete, but some of it is working and the code’s on GitHub. This one is an initiative of Jason Scott’s, with a great deal of work contributed by others.

Digging beyond Data

Noah Wardrip-Fruin, a friend and collaborator, has a great editorial in Inside Higher Ed today. It’s called “The Prison-House of Data” and addresses a prevalent (if not all-inclusive) view of the digital humanities that focuses on the analysis of data and that overlooks how we can understand computation, too.

Today’s CMS Masters Presentations

Today we heard final thesis presentations from the 2010 masters students in MIT’s Comparative Media Studies Program.

I’ve taught in CMS, which has an undergraduate and masters program, since I came to MIT three years ago. It’s a diverse program that has included digital media research and has brought contemporary computational work, among other types of media production and reception, into juxtaposition and under consideration. Here are the titles of this semester’s masters presentations:

  • M. Flourish Klink: “Laugh Out Loud in Real Life: Twilight, Women’s Humor, and Fan Identity”
  • Sheila Seles: “Audience Research for Fun and Profit: Rediscovering the value of television audiences”
  • Florence Gallez: “Open Park Online News Production: A Proposal for a Code of Ethics for Collaborative Journalism in the Digital Age”
  • Audubon Dougherty: “New Medium, New Practice: Civic production in live-streaming mobile video”
  • Nick Seaver: “A Brief History of Re-performance”
  • Madeleine Elish: “The Evolution of the Companion Species: Creating Realms of Possibility for the Personal Computer”
  • Jason Begy “Interpreting Abstract Games: The Metaphorical Potential of Formal Game Elements”
  • Elliot Pinkus: “The Physicality of Floating Numbers”
  • Hillary Kolos: “Not in it just to win it: Inclusive gaming in an MIT dorm”
  • Michelle Moon Lee: “Designing Game Ethics: A Pervasive Game Adaptation of The Count of Monte Cristo”

I’m not advising any CMS masters students this year, but this program does allow for research into my area of interest (computational art and media) and should accommodate more research in these areas in the future. (The program has had some great thesis on computational media in the past, too: Brett Camper’s work on the Game Boy Advance homebrew programming community is an example.) In 2010-2011, because the program is in transition to new co-directors, we won’t have any graduate students around, but we will be running admissions for a class of masters students that will join us in 2011. If you’re interested in working with me or my colleagues here at MIT on a masters degree, let me know.