Showing posts with label Web Search. Show all posts
Showing posts with label Web Search. Show all posts

Saturday, February 13, 2016

Has a National Wind Farm Commission Been Established?

News reports indicate that the public is having difficulty finding the website for the Australian Government's National Wind Farm Commission. Perhaps the "National Wind Farm Commission" can't be found because it does not exist. The Department of Environment does not use that term. They instead refer to the "Office of the National Wind Farm Commissioner".

A Google search for "National Wind Farm Commission" brought up as the first hit "Appointment of National Wind Farm Commissioner". This includes "For current information on the National Wind Farm Commissioner, see www.environment.gov.au/nwfc" which that redirects to "National Wind Farm Commissioner".

If the Department of Environment want web searches to find the "National Wind Farm Commission", then they just need to use that term on a web page. Environment has competent information professionals who I am sure know this, as does the Digital Transformation Office (DTO). It may be that someone in government forgot to do the paperwork to create the Commission and it does not exist.

Wednesday, December 09, 2015

Search Engines for Low-literacy Users

Professor Douglas Oard, University of Maryland, will speak on 'Building Search Engines for the “Bottom Billion”', in the famous room N101 at the Australian National University in Canberra, 11am, 11 December 2015.

This is an event in the CSIRO IR & Friends series, in conjunction with RSCS HCC & Friends.
About three quarters of a billion people are functionally illiterate, meaning that they have no more than a very basic ability to read or write.  Modern search engines are powerful tools for much of the world’s population, but if we are to build search engines for illiterate and low-literacy users we will need to come at the problem differently.  I’ll begin by describing two lines of work on this problem in the broad area known as Information and Communication Technology for Development (variously, ICTD or ICT4D), one that seeks to leverage visual interfaces, numeracy, and limited literacy, and a second that seeks to leverage speech.  I’ll then focus the rest of the talk on the work that we have been doing on speech-to-speech retrieval.
The key challenge that we have sought to address is that most illiterate and low-literacy users don’t speak any language for which we have the sorts of highly engineered Large-Vocabulary Continuous Speech Recognition (LVCSR) systems on which much of the recent work on speech retrieval depends.  A shared-task evaluation in MediaEval started to tackle that challenge in 2011 using a Spoken Term Detection (STD) evaluation.  The results there were promising, showing that systems could often recognize single terms in continuous speech based on examples, without any foreknowledge of the language.  In our work, we have sought to build on one of these MediaEval systems to apply this STD capability to perform ad hoc ranked retrieval (i.e., finding recorded content that is most likely to satisfy a user’s information need).
I’ll describe the “Query by Babbling” interaction paradigm that we have been exploring, in which we are exploring what would happen if instead of short queries and long result sets, as is appropriate for text, we had long queries and short result sets, perhaps a better approach for speech.
I’ll then describe a test collection we have built using spoken content from a voice forum site used by farmers in Gujarat, India (speaking in Gujarati), some ranked retrieval systems that we have evaluated using that collection, and the results that we have obtained.
I’ll finish up with a few thoughts on where the remaining hard spots are with this technology, and what I see as next steps to address those challenges.  This is joint work with Jerome White (NYU Abu Dhabi), Nintendra Rajput (IBM India Research Lab) and Aren Jansen (at the time at the Johns Hopkins HLTCOE).

Doug Oard

Biography

Douglas Oard is a Professor at the University of Maryland, College Park, with joint appointments in the College of Information Studies (Maryland’s iSchool) and the University of Maryland Institute for Advanced Computer Studies (UMIACS).  Dr. Oard earned his Ph.D. in Electrical Engineering from the University of Maryland.  His research interests center around the use of emerging technologies to support information seeking by end users.  Additional information is available at http://terpconnect.umd.edu/~oard/.

Thursday, August 13, 2015

What People Look at in a Web Search

Ying-Hsang Liu, Lecturer. Charles Sturt University, will speak on "Individual differences, user perceptions and eye gaze in biomedical search interfaces" at the CSIRO ICT Seminar Room, Computer Science and IT Building, Australian National University, Canberra, 4pm, 17 August 2015.
"User search behaviour studies suggest that individual differences, such as domain knowledge, search experience and cognitive styles, are important factors affecting people’s interactions with search systems. However, very few studies have investigated the effect of individual differences on eye gaze for the design of natural search user interface. In this seminar, I will present findings from an eye-tracking study of the biomedical domain experts’ interactions with novel search interfaces. Thirty-two participants searched eight complex questions on four different search interfaces, which are distinguished by whether the Medical Subject Headings (MeSH) terms are presented and how the displayed MeSH terms are generated. Our findings reveal that domain knowledge and search experience significantly affect the users’ areas of interest (AOI) of different interface elements. There is a significant interaction effect between search interfaces and cognitive styles. The implications for search user interface design will be discussed."

Thursday, July 03, 2014

Your Son's Search Engine

Greetings from the Australian National University in Canberra, where Grant Ingersoll from LucidWorks is speaking on "This ain't your father's search engine". He argues that the era where customers type in some text and are presented with a text list of possible matches is over. Instead the search results can be presented as charts and maps. It may be that you do not have to enter any search terms at all as systems such as Google Now, anticipate your needs. He gave the example of LinkedIn's people recommendation system, which uses the open source Lucene search engine and which I find frighteningly effective. Grant will be speaking Monday 7 July at SIRIP 2014 on the Gold Coast and the Melbourne Search User Group, in Melbourne, 10 July 2014. Also there is a recent video "Hacking Lucene and Solr for Fun and Profit".

Friday, August 16, 2013

Finding Videos on Mobile Devices

Lexing Xie will speak on "Scalable mobile video retrieval with sparse projection learning and pseudo label mining" at the CSIRO on the Australian National University campus in Canberra, 4pm, 19 August 2013.

IR and friends

Scalable mobile video retrieval with sparse projection learning and pseudo label mining 

Lexing Xie (ANU)

Monday 19 August 2013

Retrieving relevant videos from a large corpus on mobile devices is a vital challenge. We address two key issues for mobile search on user-generated videos. The first is the lack of good relevance measurement, due to the unconstrained nature of online videos, for learning semantic-rich representations. The second is due to the limited resource on mobile devices, stringent bandwidth, and delay requirement between the device and the video server.

We propose a knowledge-embedded sparse projection learning approach. To alleviate the need for expensive annotation for hash learning, we investigate varying approaches for pseudo label mining, where explicit semantic analysis leverages Wikipedia and performs the best. In addition, we propose a novel sparse projection method to address the efficiency challenge. It learns a discriminative compact representation that drastically reduces transmission cost. With less than 10% non-zero element in the projection matrix, it also reduces computational and storage cost.

The experimental results on 100K videos show that our proposed algorithm is competitive in the performance to the prior state-of-the-art hashing methods which are not applicable for mobiles and solely rely on costly manual annotations. The average query time on 100K videos consumes only 0.592 seconds. This is joint work with Guan-Long Wu, Winston Hsu and others in National Taiwan University....

Thursday, May 23, 2013

Making the best of poor user queries

Award winning web search engine developer, David Hawking, will speak on "Making the best of poor user queries" at CSIRO's ANU seminar room in Canberra, 4pm 27 May 2013.

IR and friends

David Hawking (Funnelback)

Making the best of poor user queries

A common cause of user disappointment with search arises from difficulty in posing an effective query. Choosing a good query is particularly critical behind the firewall where SEO is virtually non-existent and where many useful ranking features are typically missing.
Over the decades, many techniques have been developed which can assist, either in guiding users to choose better queries or in improving the queries which are submitted: Query suggestion, query completion, query correction, query substitution, query expansion, query shortening, query segmentation, query translation and query blending.
In this talk I will review the state of the art in automatic query guidance and query improvement methods which are most useful in the context of enterprise search and demonstrate their operation.
CSIRO seminar room, 4-5

Sunday, April 14, 2013

Five to Seven Search Results Per Page Please

Most web search engines return a minimum of ten search results. Following Miller's Law, I suggest the default number of search results be reduced from ten to seven for desktop screens and five for mobiles.

Google's web search has an "I'm Feeling Lucky" button to request just one result, but you can't change the default setting to less than 10 results. Miller's Law suggests people are comfortable with five to seven items. So I suggest reducing the default number of web pages displayed to seven for desktop display and five for mobile devices. The user should in addition be able to set the number of results to three,  five and seven, as well as ten, or more.

Apart from making it easier for people to read, fewer items would use fewer network and server resources.

Monday, March 18, 2013

Automated Analysis of Corruption Commission Transcripts in Canberra Today

Simon Kravis
Simon Kravis will discuss automated analysis the transcripts from the Independent Commission Against Corruption (ICAC), in Canberra today, 4pm, 18 March 2013. Each fortnight those interested in Information Retrieval (IR) and web searching meet to discuss the latest research at "IR and Friends", in the CSIRO seminar room, 2nd Floor, Computer Science and Information Technology Building, Australian National University, North Road, Canberra.

Monday, March 04, 2013

Facebook Graph Search Points Me in the Wrong Direction

My first experience of the new Facebook Graph Search was disappointing. I asked for restaurants and was given a list of interesting looks restaurants (presumably recommended by my friends). Unfortunately these were all in Perth, several thousand kilometers away from where I was and so of no interest.

Monday, November 26, 2012

Relevance Versus Diversity for Web Search Results

Greetings from the CSIRO ICT Centre at the Australian National University in Canberra, where I am attending a presentation on web search research by Kar Wai Lim of ANU & NICTA. The object of the exercise is to come up with web documents as the result of a search which are relevant but not all too much the same (diverse). For example, if you get ten copies of essentially the same document, that is not much use. It turns out that there is a mathematical equation which shows the trade-off between relevance and diversity. The details are published in a short paper, which I don't pretend to understand:
Kar Wai Lim, Scott Sanner, and Shengbo Guo. 2012. On the mathematical relationship between expected n-call@k and the relevance vs. diversity trade-off. In Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval (SIGIR '12). ACM, New York, NY, USA, 1117-1118. DOI=10.1145/2348283.2348497 http://doi.acm.org/10.1145/2348283.2348497

Saturday, August 25, 2012

Yahoo Web Researcher Speaking in Canberra

Professor Ricardo Baeza-Yates, Yahoo! Research, will speak on "The web: Wisdom of crowds and a long tail", 2pm, 5 September 2012, in the famous Room N101, CSIT Building, Australian National University, Canberra.
The web: Wisdom of crowds and a long tail

The Web continues to grow and evolve very fast, changing our daily lives.

This activity represents the collaborative work of the millions of institutions and people that contribute content to the Web as well as more than one billion people that use it. In this ocean of hyperlinked data there is explicit and implicit information and knowledge. But how is the Web? Web data mining is the main task to answer this question.

Web data comes in three main flavors: content (text, images, etc.), structure (hyperlinks) and usage (navigation, queries, etc.), implying different techniques such as text, grap other publications or log mining. Each case reflects the wisdom of some group of people that can be used to make the Web better. For example, user generated tags in Web 2.0 sites. One important phenomenon of this wisdom is the long tail of the special interests of people.

In this talk we cover all these concepts and give specific examples.

Ricardo Baeza-Yates is VP of Yahoo! Research for Europe, Middle East and Latin America, leading the labs at Barcelona, Spain and Santiago, Chile, as well as supervising the newer lab in Haifa, Israel. Until 2005 he was the director of the Center for Web Research at the Department of Computer Science of the Engineering School of the University of Chile; and ICREA Professor at the Department of Technology of the University Pompeu Fabra in Barcelona, Spain.

He is co-author of the best-seller book Modern Information Retrieval, published in 1999 by Addison-Wesley with a second edition in 2011, as well as co-author of the 2nd edition of the Handbook of Algorithms and Data Structures in Pascal and C, Addison-Wesley, 1991; and co-editor of Information Retrieval: Data Structures and Algorithms, Prentice-Hall, 1992, among more than 200 other publications.

He has received the Organization of American States award for young researchers in exact sciences (1993) and several national awards in Chile. In 2003 he was the first computer scientist to be elected to the Chilean Academy of Sciences. During 2007 he was awarded the Graham Medal for innovation in computing, given by the University of Waterloo to distinguished ex-alumni. In 2009 he was awarded the Latin American distinction for contributions to CS in the region and became an ACM Fellow, followed in 2011 by an IEEE Fellowship.

Monday, August 22, 2011

Rootza Information Indexing and Search Service

Victoria Redfern demonstrated her RootZa "... online tool to assist researchers, students, professionals and the general public to search the internet or www". There is a paper in the ACM digital library by Victoria: "World wide web: online core concept thesaucratic database development to improve information seeking". Also her patent application "ENHANCED SEARCHING USING A THESAURUS" (WIPO Patent Application WO/2007/012120). The tool has a visualization of the results as a diagram but the claims for invention appear to be about how the thesaurus is generated. This may be of use for Defence classification systems.

Thursday, June 30, 2011

Google Identifying Authors in Web Searches

Google have a new service to identify authors in web searches. The idea is that you create a page about yourself, either a Google Profile, or your own web page. You then include links to that page, with special authorship markup ( rel=”author” ) in the HTML, to indicate who the author is. A Google search will then display your details in the search results. You can have more than one author page, cross-linking them with a link containing rel="me" . There is also more metadata you can include in a web page using markup from schema.org. As an example, see my Google Profile:
Tom Worthington

Introduction

Tom Worthington is an IT consultant and has been an expert witness in several court cases involving international patent, computer, web and Internet issues, as well as advising governments and companies on computer problems. He is a Adjunct Senior Lecturer in the Department of Computer Science, Faculty of Engineering and Information Technology at the Australian National University, where he teaches the design of web sites, e-commerce and professional ethics. In 1999 he was elected a Fellow of the Australian Computer Society for his contribution to the development of public Internet policy.

Bragging rights

Certified Professional, past president, Fellow and Honorary Life Member of the Australian Computer Society, a voting member of the Association for Computing Machinery and a member of the Institute of Electrical and Electronics Engineers.

Occupation

IT Consultant, Expert Witness and Educator

Employment

  • Australian National University
    Adjunct Senior Lecturer, 2008 - present
  • TomW Communications Pty Ltd
    Senior Consultant, 1999 - present

Places lived

Map of the places this user has lived
  • Canberra

Search visibility

Visible in search

Tuesday, June 28, 2011

IR and Friends

One of the delights of being associated with a university are the small informal meetings which explore topics in depth. One such event is the fortnightly "IR and Friends" at the CSIRO ICT Center, located on the ANU Campus in Canberra. This brings together people working on Information Retrieval (IR), including web text search and image searching. The next meeting is Monday 11 July 2011, 4pm with Peter Christen on "Privacy-preserving record linkage", in the CSIRO seminar room, ANU CS&IT building.

Much of the discussion I don't understand as the presentations are from advanced computer scientists and mathematicians. But every now and then there is an insight from someone who has just spent a year on analysis of Google's latest search technique, or who works in Microsoft's research labs. Staff from Australia's own FunnelBack web search company also frequently attend (FunnelBack was formed out of CSIRO research).

Thursday, May 26, 2011

Asking the right question

Greetings from the famous room N101 at the ANU in Canberra, where Dr Ying-Hsang Liu from Charles Sturt University is talking about "Query reformulation, individual difference and search performance over query sessions", or in other words, what do people ask web search engines? People with different backgrounds and different levels of expertise will ask different questions. Also they will ask a different question if their first search does not give the results they wanted. researchers are looking at how to evaluate the search algorithms and optimise them.
Query reformulation is the useras articulation of information needs after the initial search. In this talk I will report on findings from a larger study that was designed to assess the effectiveness of MeSH (Medical Subject Headings) terms when used by different types of searchers in an interactive search environment. I will examine the characteristics of queries formulated by different types of searchers, exemplified by different levels of domain knowledge and search training. Using several effectiveness measures, such as MAP and nsDCG (normalised session DCG), I will discuss the relationship between individual difference and search performance over query sessions.

Friday, October 22, 2010

Fixing a washing machine online

After my success of using the web to help fix a toilet flush, I am attempting to diagnose a problem with the washing machine. A search on "Fisher and Paykel Fisher Paykel Intuitive Eco Washer not draining" found useful items in FixYa.com. That gave me the confidence to tile up the washing machine and look underneath. But the problem was not quite the same as described so I looked for "pump hot" and found the Fisher Paykel Washer Diagnostic Fault Codes. This said:
The pump is fitted with a thermal cut out device. Check if this device has been activated. If it has wait until the pump cools down before restarting. Check for any pump blockage and condition of pump before attempting to restart. i.e. pump seizure ...

Thursday, April 15, 2010

Turning text into information

Alex Krumpholz is talking about how to apply insights from the way web search engines work to the analysis of scientific papers. Current web search engines were derived from previous work on text search systems. It is interesting to see the web search techniques now being applied to text. One example is that the anchor text is used by search engines; that is the text highlighted in a web link on a web page is assumed to describe the document linked. The equivalent for a research paper is the text near a citation. One interesting part of this is that in essence the algorithms are creating useful information from what is just text.

Structural aspects of medical literature retrieval

Alex Krumpholz (SoCS CECS)

CS HDR MONITORING Info & Human Centred Computing Research Group

DATE: 2010-04-15
TIME: 13:30:00 - 14:00:00
LOCATION: Ian Ross Seminar Room
CONTACT: Michelle.Moravec@anu.edu.au

ABSTRACT:
This work discusses the retrieval of medical publications in a clinical setting. It aims to help busy doctors finding literature that are likely to be relevant in the current patient's case. IR related aspects of such a program are investigated.

Thursday, April 01, 2010

Mobile Web at CeBIT Sydney

I will be speaking on "Optimising Sites for Mobile Devices and Search Engines" at the WebForward Conference, 26 May 2010. Suggestions as to what to say and examples to use would be welcome. This is part of CeBIT Australia in Sydney. I may also attend the eGovernment Forum: Delivering open government on 25 May 2010.

Optimising Sites for Mobile Devices and Search Engines

by: Tom Worthington FACS HLM, Adjunct Senior Lecturer, Australian National University

Some simple tools and techniques can be used to allow any web site to be usable on a mobile phone and improve its rating with web search engines. These techniques can also help make your web site easier to understand for people using an ordinary web browser and particularly for use by older people.

Covered:
  • Web Content Accessibility Guidelines
  • Validation Tests
  • W3C mobileOK Checker
  • TAW Web Accessibility Test
Background

A set of tools and techniques have been developed to make the content of web pages more accessible. The best known of these are the W3C Web Content Accessibility Guidelines, with automated testing in the TAW Accessibility Tool. The use of such techniques is required by Australian anti-discrimination legislation, including by schools, TAFEs and universities in delivering education online. What is not well understood is that while these techniques are mandated for access by people with a disability, they can also be used to help with slow Internet connections, for limited devices such as mobile phones and for people with limited literacy.

There are additional guidelines and tools to help develop content for mobile devices, such as the W3C Mobile Web Best Practices and . Previously this required development of a second version of the content, specifically for mobile devices. However, as smart phones become more affordable, with larger screens and better software, it is possible to author the same content for education and service delivery to both desktop and mobile devices.

Providing accessible content and to mobile devices requires the web designer and the content author to make difficult decisions. Compromises must be made over what can be delivered and in what form. This can help make better content and better learning, by eliminating material which is entertaining, but not educational.

Bio:

Tom Worthington is an IT consultant and an Adjunct Senior Lecturer at the Australian National University, where he teaches the design of mobile web sites, e-commerce and green ICT. In 1999 he was elected a Fellow of the Australian Computer Society for his contribution to the development of public Internet policy.

Tom was an expert witness in the Human Rights Commission for the Sydney Olympics web case and was invited to Beging to adivse on the design od the web site for the 2008 Olympics. He is a past president, Fellow and Honorary Life Member of the Australian Computer Society, a voting member of the Association for Computing Machinery and a member of the Institute of Electrical and Electronics Engineers.
This stuff from my talk looks relevant. I could have to change the examples from government to business:


Run a business on your phone, or a war

* Technology which was in Australian and US DoD is now in your phone
* Use tools (W3C Mobile OK)

Exercise KANGAROO 95 took place in an area of over 4 million km square, across the Top End of Australia from July to the end of August 1995 and involved over 17,000 Australian Defence Force troops, and visiting units from the USA, Malaysia, Singapore, Papua New Guinea, the UK and Indonesia.

Reports and photographs were transmitted from the exercise area using stand-alone portable satellite communications terminals, capable of 64kbps.

As manager of the Defence home page, I received the reports at Defence headquarters in Canberra and up-loaded, them to a publicly accessible Internet server at the Australian Defence Force Academy.

For the first week of the exercise I was officially on holiday, but maintained the K95 home page remotely using a pocket 2400 pbs modem and lap top PC from Mallacoota, Victoria.

In later exercises, such as Tandem Thrust 97 made more use of the Internet for the operations. However, the level of technology used in these exercises is similar to that now available in a 3G smart phone for about $1,000.

E-mail, the web and instant messaging can be used for business and government from a smart phone with a little forethought. Check your business web pages are mobile compatible. Make sure you put the important business information in a simple, clear, easy to read format. Don't use software and technology you don't really need.

Web 2.0 Thinking Needed

* Early simple web pages are compatible with mobile phones
* Later web design lost mobile compatibility
* New CSS features allow for desktop/mobile compatibility
* Need web 2.0 thinking by organisations

The processing power and network bandwidth of the laptop and desktop computers used for exercise KANGAROO 95 in 1995 is comparable with what is available from 3G smart phones in 2009. However, the use of these devices is being held up by poor web design.

Web pages design in 1995 were text rich, with small images and limited layouts. These designs are compatible with today's smart phones. Later more complex web page designs lost this compatibility, due to their complex designs and increased file sizes.

Also web based services need to be designed as services, not as marketing brochures. CSS features supported in modern web browsers allow for web 2.0 features, but organisations need to accept that their staff and their clients will want to be involved in decision making. Effort therefore need to be put into clear, detailed, information rich web sites.

Mobile Thinking

* What not to do: Big hard to read e-documents. (Consulting with Government online)
* What to do: accessible and mobile friendly (Online Consultation Guidelines)
* Don't intimidate with legalese: Government copyright notice
* Use open access: outdated, use Creative Commons
* Example: Public Sphere #2 – Government 2.0: Policy and Practice

Thinking about interaction with via a mobile device can help you think about how and what to communicate. The limitations in screen size and keyboard access force you to focus on the most important information first.

Some impediments to the use of the technology can be easily removed. As an example, in 2008 the Department of Finance and Deregulation issued a report on "Consulting with Government – online". This was a well reasoned exploration of the issues. However, the report was only issued as large, hard to read online PDF and RTF files.

The Online Consultation Guidelines from the Australian Government Information Management Office (AGIMO) are reasonably accessible and mobile friendly. The home page achieves a 80/100 score on the W3C mobileOK Checker. However, discussion of the document is still hampered by a Commonwealth Copyright Notice.

The Commonwealth Copyright notice used for web pages is essentially unchanged from the Department of Defence web copyright notice developed in 1995. The Australian Government should adopt the Australian Creative Commons Licence, or similar, to allow the free discussion of issues. Similarly, companies should check the licences they impose on information distributed. If you want your product details out there being discussed, don't make it hard.

Thursday, March 04, 2010

Information Retrieval for Real-world Tasks

Paul Thomas (CSIRO and ANU) presented a seminar on "Information Retrieval for Real-world Tasks" at the ANU CSIT Seminar Room, N101 today. He argued that web search engines are historically related to document search systems which were sponsored by the US DARPA (TREC). The original task typically was to find a ranked list of documents relevant to a question, such as ones on smuggling plutonium out of the Soviet Union. There was an unintended pun in this as Paul talked about these being "atomic" documents. He argued that returning a list of documents does not suit real world tasks, such as choosing an espresso machine to buy. I was not convinced by the examples he gave which showed Google products listing web pages about espresso machines. The Google products search returns a list of espresso machines, with the assumption that the first in the list is best (Paul missed another pun here by not bringing up the details of the Atomic Coffee Machine). He then changed tacks to show examples of searches for biomedical data, which identified specific items in documents.

It seemed to me that there were two distinct topics Paul was confusing: information retrieval and task support. Information retrieval can be used to support some task, such as selecting a coffee machine. But retrieving information about coffee machines is not the same as purchasing a coffee machine. Real world search engines, such as Google, use heuristics to short cut this process. If people searching for coffee machines are really looking to buy one, then the search is modified to answer the question the user meant to ask, not what they actually asked. This process has proved lucrative for Google, as it results in people buying products and Google being paid for helping with that process.

Returning to the original example Paul used, of identifying plutonium smuggling, the real task is to detect and stop it, not just find documents. What the user of Web2 War systems, such US Army Knowledge Online (AKO) , US intelligence Intellipedia and the Tactical Ground Reporting System (TIGR) would ideally be directed to are not just historical documents, but live systems such as General Dynamics Mediaware's JPEG2000 for Wide Area Airborne Surveillance, with data from Predator UAVs. The system could then offer to issue the relevant tasking order to produce kinetic response, in real time.

ps: One of the side tracks this seminar took was the origin of the 10 documents goal of the TREC information retrieval tasks. One theory was this was as many as could be displayed on an old green screen. My thory was that if more than that many were dislayed, the user would have to take their socks off to count them. ;-)

Monday, February 02, 2009

Google Detecting influenza epidemics

Staff of Google in collaboration with the Centers for Disease Control and Prevention, have published a letter in Letter in the prestigious scientific journal Nature on "Detecting influenza epidemics using search engine query data". The idea is that people with the flu will do web searches about it, thus alerting authorities to an outbreak. This is a cleaver idea, but not the one I had in mind when I proposed using the web for an combating avian influenza epidemic.

Seasonal influenza epidemics are a major public health concern, causing tens of millions of respiratory illnesses and 250,000 to 500,000 deaths worldwide each year1. In addition to seasonal influenza, a new strain of influenza virus against which no previous immunity exists and that demonstrates human-to-human transmission could result in a pandemic with millions of fatalities2. Early detection of disease activity, when followed by a rapid response, can reduce the impact of both seasonal and pandemic influenza3, 4. One way to improve early detection is to monitor health-seeking behaviour in the form of queries to online search engines, which are submitted by millions of users around the world each day. Here we present a method of analysing large numbers of Google search queries to track influenza-like illness in a population. Because the relative frequency of certain queries is highly correlated with the percentage of physician visits in which a patient presents with influenza-like symptoms, we can accurately estimate the current level of weekly influenza activity in each region of the United States, with a reporting lag of about one day. This approach may make it possible to use search queries to detect influenza epidemics in areas with a large population of web search users. ...

From: Detecting influenza epidemics using search engine query data, Jeremy Ginsberg, Matthew H. Mohebbi, Rajan S. Patel, Lynnette Brammer, Mark S. Smolinski & Larry Brilliant, Nature , doi:10.1038/nature07634; Received 14 August 2008; Accepted 13 November 2008; Published online 19 November 2008