Monday, September 12, 2011

Narrative Science

by Steve Lohr

“Wisconsin appears to be in the driver’s seat en route to a win, as it leads 51-10 after the third quarter. Wisconsin added to its lead when Russell Wilson found Jacob Pedersen for an eight-yard touchdown to make the score 44-3 ... . ”

Those words began a news brief written within 60 seconds of the end of the third quarter of the Wisconsin-U.N.L.V. football game earlier this month. They may not seem like much — but they were written by a computer.

The clever code is the handiwork of Narrative Science, a start-up in Evanston, Ill., that offers proof of the progress of artificial intelligence — the ability of computers to mimic human reasoning.

The company’s software takes data, like that from sports statistics, company financial reports and housing starts and sales, and turns it into articles. For years, programmers have experimented with software that wrote such articles, typically for sports events, but these efforts had a formulaic, fill-in-the-blank style. They read as if a machine wrote them.

But Narrative Science is based on more than a decade of research, led by two of the company’s founders, Kris Hammond and Larry Birnbaum, co-directors of the Intelligent Information Laboratory at Northwestern University, which holds a stake in the company. And the articles produced by Narrative Science are different.

“I thought it was magic,” says Roger Lee, a general partner of Battery Ventures, which led a $6 million investment in the company earlier this year. “It’s as if a human wrote it.”

Experts in artificial intelligence and language are also impressed, if less enthralled. Oren Etzioni, a computer scientist at the University of Washington, says, “The quality of the narrative produced was quite good,” as if written by a human, if not an accomplished wordsmith. Narrative Science, Mr. Etzioni says, points to a larger trend in computing of “the increasing sophistication in automatic language understanding and, now, language generation.”

The innovative work at Narrative Science raises the broader issue of whether such applications of artificial intelligence will mainly assist human workers or replace them. Technology is already undermining the economics of traditional journalism. Online advertising, while on the rise, has not offset the decline in print advertising. But will “robot journalists” replace flesh-and-blood journalists in newsrooms?

-----
The Narrative Science software can make inferences based on the historical data it collects and the sequence and outcomes of past games. To generate story “angles,” explains Mr. Hammond of Narrative Science, the software learns concepts for articles like “individual effort,” “team effort,” “come from behind,” “back and forth,” “season high,” “player’s streak” and “rankings for team.” Then the software decides what element is most important for that game, and it becomes the lead of the article, he said. The data also determines vocabulary selection. A lopsided score may well be termed a “rout” rather than a “win.”

“Composition is the key concept,” Mr. Hammond says. “This is not just taking data and spilling it over into text.”

Read more: