View source for Multi-document summarization

{{Short description|Procedure extracting information from similar documents}}
'''Multi-document summarization''' is an automatic procedure aimed at [[Information extraction|extraction of information]] from multiple texts written about the same topic. The resulting summary report allows individual users, such as professional information consumers, to quickly familiarize themselves with information contained in a large cluster of documents. In such a way, multi-document summarization systems are complementing the news aggregators performing the next step down the road of coping with information overload.

==Key benefits and difficulties==
Multi-document summarization creates information reports that are both concise and comprehensive.
With different opinions being put together & outlined, every topic is described from multiple perspectives within a single document.
While the goal of a brief summary is to simplify information search and cut the time by pointing to the most relevant source documents, comprehensive multi-document summary should in theory contain the required information, hence limiting the need for accessing original files to cases when refinement is required. In practice, it is hard to summarize multiple documents with conflicting views and biases. In fact, it is almost impossible to achieve clear [[Automatic summarization|extractive summarization]] of documents with conflicting views.  [[Automatic summarization|Abstractive summarization]] is the preferred venue in this case.

Automatic summaries present information extracted from multiple sources algorithmically, without any editorial touch or subjective human intervention, thus making it completely unbiased. The difficulties remain, if doing automatic extractive summaries of documents with conflicting views.

==Technological challenges==
The multi-document summarization task is more complex than [[Automatic summarization|summarizing a single document]], even a long one. The difficulty arises from thematic diversity within a large set of documents. A good summarization technology aims to combine the main themes with completeness, readability, and concision. The Document Understanding Conferences,<ref>{{cite web|url=http://www-nlpir.nist.gov/projects/duc/index.html |title=Document Understanding Conferences |website=Nlpir.nist.gov |date=2014-09-09 |accessdate=2016-01-10}}</ref> conducted annually by NIST, have developed sophisticated evaluation criteria for techniques accepting the multi-document summarization challenge.

An ideal multi-document summarization system not only shortens the source texts, but also presents information organized around the key aspects to represent diverse views. Success produces an overview of a given topic. Such text compilations should also basic requirements for an overview text compiled by a human. The multi-document summary quality criteria are as follows:

*clear structure, including an outline of the main content, from which it is easy to navigate to the full text sections
*text within sections is divided into meaningful paragraphs
*gradual transition from more general to more specific thematic aspects
*good readability.

The latter point deserves an additional note. Care is taken to ensure that the automatic overview shows:

*no paper-unrelated "[[Social:Communication noise|information noise]]" from the respective documents (e.g., web pages)
*no dangling references to what is not mentioned or explained in the overview
*no text breaks across a sentence
*no semantic [[Redundancy (information theory)|redundancy]].

==Real-life systems==
The multi-document summarization technology is now coming of age - a view supported by a choice of advanced web-based systems that are currently available.
* [https://www.reviewchomp.com ReviewChomp] presents summaries of customer reviews for any given product or service. Some products have thousands of online reviews which renders the reviews unreadable by humans in real time. Search for the product or service is performed by the website.
* Ultimate Research Assistant<ref>{{cite web|url=http://ultimate-research-assistant.com/ |title=Generate Research Report |publisher=Ultimate Research Assistant |date= |accessdate=2016-01-10}}</ref> - performs text mining on Internet search results to help summarize and organize them and make it easier for the user to perform online research. Specific text mining techniques used by the tool include concept extraction, text summarization, hierarchical concept clustering (e.g., automated taxonomy generation), and various visualization techniques, including tag clouds and mind maps. 
* iResearch Reporter<ref>{{cite web |url=http://www.iresearch-reporter.com/ |title=iResearch Reporter service |website=Iresearch-reporter.com |date= |accessdate=2016-01-10 |archive-url=https://web.archive.org/web/20130609095500/http://iresearch-reporter.com/ |archive-date=2013-06-09 |url-status=dead }}</ref> - Commercial Text Extraction and Text Summarization system, free demo site accepts user-entered query, passes it on to Google search engine, retrieves multiple relevant documents, produces categorized, easily  readable natural language summary reports covering multiple documents in retrieved set, all extracts linked to original documents on the Web, post-processing, entity extraction, event and [[Relationship extraction|relationship extraction]], text extraction, extract clustering, linguistic analysis, multi-document, full text, natural language processing, categorization rules, clustering, linguistic analysis, text summary construction tool set.
* Newsblaster<ref>[http://newsblaster.cs.columbia.edu]   {{webarchive|url=https://web.archive.org/web/20130416065538/http://newsblaster.cs.columbia.edu/ |date=April 16, 2013 }}</ref> is a system that helps users find news that is of the most interest to them. The system automatically collects, clusters, categorizes, and summarizes news from several sites on the web (CNN, {{wipe|Reuters}}, Fox News, etc.) on a daily basis, and it provides users an interface to browse the results.
* NewsInEssence<ref>[http://www.newsinessence.com]   {{webarchive|url=https://web.archive.org/web/20110411005726/http://www.newsinessence.com/ |date=April 11, 2011 }}</ref> may be used to retrieve and summarize a cluster of articles from the web. It can start from a URL and retrieve documents that are similar, or it can retrieve documents that match a given set of keywords. NewsInEssence also downloads news articles daily and produces news clusters from them.
* NewsFeed Researcher<ref>{{cite web|url=http://newsfeedresearcher.com |title=News Feed Researcher &#124; General Stuff |website=Newsfeedresearcher.com |date= |accessdate=2016-01-10}}</ref> is a news portal performing continuous [[Automatic summarization|automatic summarization]] of documents initially clustered by the news aggregators (e.g., [[Software:Google News|Google News]]). NewsFeed Researcher is backed by a free online engine covering major events related to business, technology, U.S. and international news. This tool is also available in on-demand mode allowing a user to build a summaries on selected topics.
* Scrape This<ref>[http://www.scrapethis.com]   {{webarchive|url=https://web.archive.org/web/20090919054723/http://www.scrapethis.com/ |date=September 19, 2009 }}</ref> is like a search engine, but instead of providing links to the most relevant websites based on a query, it scrapes the pertinent information off of the relevant websites and provides the user with a consolidated multi-document summary, along with dictionary definitions, images, and videos.
* JistWeb<ref>[http://www.jastatechnologies.com/productList.html]  {{webarchive |url=https://web.archive.org/web/20130529112318/http://www.jastatechnologies.com/productList.html |date=May 29, 2013 }}</ref> is a query specific multiple document summariser.

As auto-generated multi-document summaries increasingly resemble the overviews written by a human, their use of extracted text snippets may one day face [[Copyright|copyright]] issues in relation to the [[Social:Fair use|fair use]] copyright concept.

==Bibliography==
* {{Cite Q | Q81312697 }} <!-- * Günes Erkan and Dragomir R. Radev. Lexrank: Graph-based centrality as salience in text summarization. Journal of Artificial Intelligence Research (JAIR), 2004. [http://clair.si.umich.edu/~radev/papers/lprj.pdf] -->
* Dragomir R. Radev, Hongyan Jing, Malgorzata Styś, and Daniel Tam. Centroid-based summarization of multiple documents. Information Processing and Management, 40:919–938, December 2004. [https://web.archive.org/web/20110501161029/http://clair.si.umich.edu/~radev/papers/centroid.pdf]
* Kathleen R. McKeown and Dragomir R. Radev. Generating summaries of multiple news articles. In Proceedings, ACM Conference on Research and Development in Information Retrieval SIGIR'95, pages 74–82, Seattle, Washington, July 1995. [https://web.archive.org/web/20110501170519/http://clair.si.umich.edu/~radev/papers/sigir95.pdf]
* C.-Y. Lin, E. Hovy, "[https://aclanthology.org/P02-1058.pdf From single to multi-document summarization: A prototype system and its evaluation]", In "Proceedings of the ACL", pp.&nbsp;457–464, 2002
*Kathleen McKeown, Rebecca J. Passonneau, David K. Elson, Ani Nenkova, Julia Hirschberg, "Do Summaries Help? A Task-Based Evaluation of Multi-Document Summarization", SIGIR’05, Salvador, Brazil, August 15–19, 2005 [https://www.cs.columbia.edu/~ani/papers/f98-mckeown.pdf]
*R. Barzilay, N. Elhadad, K. R. McKeown, "Inferring strategies for sentence ordering in multidocument news summarization", Journal of Artificial Intelligence Research, v. 17, pp.&nbsp;35–55, 2002
*M. Soubbotin, S. Soubbotin, "Trade-Off Between Factors Influencing Quality of the Summary", Document Understanding Workshop (DUC), Vancouver, B.C., Canada, October 9–10, 2005 [http://duc.nist.gov/pubs/2005papers/freetext.sergei.pdf]
* C Ravindranath Chowdary, and P. Sreenivasa Kumar. "[https://www.researchgate.net/profile/Ravindranath-Chowdary-2/publication/221397392_ESUM_An_Efficient_System_for_Query-Specific_Multi-document_Summarization/links/55adc9bc08ae98e661a43e03/ESUM-An-Efficient-System-for-Query-Specific-Multi-document-Summarization.pdf Esum: an efficient system for query-specific multi-document summarization]." In ECIR (Advances in Information Retrieval), pp.&nbsp;724–728. Springer Berlin Heidelberg, 2009.

==See also==
* [[Automatic summarization]]
* [[Text mining]]
* News aggregators

==References==
{{reflist}}

==External links==
*[http://www-nlpir.nist.gov/projects/duc/index.html Document Understanding Conferences]
*[http://www1.cs.columbia.edu/nlp/projects.html Columbia NLP Projects]
*[https://web.archive.org/web/20070122041819/http://lada.si.umich.edu:8080/clair/nie1/nie.cgi NewsInEssence: Web-based News Summarization]
*[https://www.reviewchomp.com ReviewChomp]
{{Natural Language Processing}}

{{DEFAULTSORT:Multi-Document Summarization}}
[[Category:Natural language processing]]

{{Sourceattribution|Multi-document summarization}}