CFP: EVIA 2010

***** CALL FOR PAPERS *****

The Third International Workshop on Evaluating Information Access
(EVIA 2010), a Satellite Workshop of NTCIR-8
http://research.nii.ac.jp/ntcir/ntcir-ws8/EVIA-2010/

June 15, 2010 at NII, Tokyo, Japan.
***************************************

Information Access technologies provide the interface between
human information needs and digital information resources. The
reliable evaluation of these technologies has long been
recognized as central to technological development in the field.
As information retrieval becomes more pervasive, the forms of
retrieval more diverse, and retrieval tools richer, the
importance of effective, efficient, and innovative evaluation
grows as well.

In recognition of the need for a forum dedicated to the intensive
discussion of evaluation issues, we have held two successful
International Workshops on Evaluating Information Access (EVIA
2007 and 2008). Proceedings and reports can be found below:

EVIA 2007 online proceedings:
http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings6/EVIA/
EVIA 2008 online proceedings:
http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings7/toc_evia.html

SIGIR Forum Report on EVIA 2007:
http://sigir.org/forum/2007D/2007d_sigirforum_sanderson.pdf
SIGIR Forum Report on EVIA 2008:
http://sigir.org/forum/2009J/2009j-sigirforum-sakai.pdf

Following these successes, we are happy to announce the Third
International Workshop on Evaluating Information Access (EVIA
2010), to be held on June 15, 2010 (coinciding with Day 1 of the
NTCIR-8 Workshop Meeting) at the National Institute of
Informatics (NII), Tokyo, Japan. We invite papers addressing one
or more of the following topics:

- Test collection formation, evaluation metrics, and evaluation
environments
- Statistical issues in retrieval evaluation
- User studies and the evaluation of human-computer interaction
in information retrieval (HCIR)
- Evaluation methods for multilingual, multimedia, or mobile
information access
- Novel information access tasks and their evaluation
- Evaluation and assessment using implicit user feedback,
crowdsourcing, living labs, or inferential methods
- Evaluation issues in industrial and enterprise retrieval
systems

*** SUBMISSION INSTRUCTIONS ***

Submissions will be subject to double-blind reviewing. Accepted
papers will be included in the EVIA 2010 online proceedings, and
summarized in a report to SIGIR Forum.

We invite submissions of regular papers (up to 9 pages) and
short papers (up to 5 pages).
Submitted papers should be in the ACM Conference style
(for LaTeX, use the "Option 2" style) and must be submitted
as pdf files. Templates are available at:
http://www.acm.org/sigs/publications/proceedings-templates
Papers exceeding the page limits will be rejected without review.

The pdf files must be submitted via our START submission webpage.
A link to the submission page will be available at the EVIA
website in early March:
http://research.nii.ac.jp/ntcir/ntcir-ws8/EVIA-2010/

*** IMPORTANT DATES ***

- March 31, 2010 *submissions due*
- April 18, 2010 notification of acceptance
- May 10, 2010 final manuscripts due
- June 15, 2010 EVIA 2010@NII, Tokyo, Japan
- June 15-18, 2010 NTCIR-8@NII, Tokyo, Japan

*** EVIA 2010 PROGRAM COMMITTEE ***

Akiko Aizawa NII Japan
Javed Aslam Northeastern University USA
Nicholas Belkin Rutgers University USA
Ben Carterette University of Delaware USA
Charlie Clarke University of Waterloo Canada
Georges Dupret Yahoo! Research Chile
Norbert Fuhr Universitaet Duisburg-Essen Germany
Atsushi Fujii Tokyo Institute of Technology Japan
Donna Harman NIST USA
Hideo Joho University of Tsukuba Japan
Gareth Jones Dublin City University Ireland
Noriko Kando NII Japan
Evangelos Kanoulas University of Sheffield UK
Jaana Kekalainen University of Tampere Finland
Mounia Lalmas University of Glasgow UK
Gary Geunbae Lee POSTECH Korea
Mun-Kew Leong National Library Board Singapore
Jimmy Lin University of Maryland USA
Chin-Yew Lin Microsoft Research Asia China
Iadh Ounis University of Glasgow UK
Carol Peters IEI-CNR Italy
Ian Ruthven University of Strathclyde UK
Tetsuya Sakai Microsoft Research Asia China
Mark Sanderson University of Sheffield UK
Falk Scholer RMIT University Australia
Ian Soboroff NIST USA
Paul Thomas CSIRO Australia
William Webber University of Melbourne Australia
Emine Yilmaz Microsoft Research Cambridge UK

*** EVIA 2010 CO-CHAIRS ***

Tetsuya Sakai (Microsoft Research Asia, China)
tetsuyasakai
at acm.org
Mark Sanderson (University of Sheffield, UK)
m.sanderson
at sheffield.ac.uk
William Webber (University of Melbourne, Australia)
wew
at csse.unimelb.edu.au