Preliminary CFP: EVIA 2010

***** Preliminary CALL FOR PAPERS *****

The Third International Workshop on Evaluating Information Access
(EVIA 2010), a Satellite Workshop of NTCIR-8
http://research.nii.ac.jp/ntcir/ntcir-ws8/EVIA-2010/

June 15, 2010 at NII, Tokyo, Japan.
***************************************

Information Access technologies provide the interface between
human information needs and digital information resources. The
reliable evaluation of these technologies has been recognized for
decades as central to the advancement of the field. As information
retrieval becomes more pervasive, the forms of retrieval
more diverse, and retrieval tools richer, the importance of
effective, efficient, and innovative evaluation grows as well.
In recognition of the need for a forum dedicated to the intensive
discussion of evaluation issues, we have held two successful
International Workshops on Evaluating Information Access (EVIA
2007 and 2008). Proceedings and reports can be found below:

EVIA 2007 online proceedings:
http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings6/EVIA/
EVIA 2008 online proceedings:
http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings7/toc_evia.html

SIGIR Forum Report on EVIA 2007:
http://sigir.org/forum/2007D/2007d_sigirforum_sanderson.pdf
SIGIR Forum Report on EVIA 2008:
http://sigir.org/forum/2009J/2009j-sigirforum-sakai.pdf

Following these successes, we are happy to announce the Third
International Workshop on Evaluating Information Access (EVIA
2010) on June 15, 2010 (coinciding with Day 1 of the NTCIR-8
Workshop Meeting) at the National Institute of Informatics (NII),
Tokyo, Japan. We invite papers addressing one or more of the
following topics:

- Test collection formation, evaluation metrics, and evaluation
environments
- Statistical issues in retrieval evaluation
- User studies and the evaluation of human-computer interaction
in information retrieval (HCIR)
- Evaluation methods for multilingual, multimedia, or mobile
information access
- Novel information access tasks and their evaluation
- Evaluation and assessment using implicit user feedback,
crowdsourcing, living labs, or inferential methods
- Evaluation issues in industrial and enterprise retrieval
systems

*** SUBMISSION INSTRUCTIONS ***

Submissions will be subject to double-blind reviewing. Accepted
papers will be included in the EVIA 2010 online proceedings, and
summarized in a report to SIGIR Forum.

We invite submissions of regular papers (up to 9 pages) and
short papers (up to 5 pages).
Details will soon be announced on the EVIA 2010 website:
http://research.nii.ac.jp/ntcir/ntcir-ws8/EVIA-2010/

*** IMPORTANT DATES ***

- March 31, 2010 *submissions due*
- April 18, 2010 notification of acceptance
- May 10, 2010 final manuscripts due
- June 15, 2010 EVIA 2010@NII, Tokyo, Japan
- June 15-18, 2010 NTCIR-8@NII, Tokyo, Japan

*** EVIA 2010 PROGRAM COMMITTEE ***

Akiko Aizawa NII Japan
Javed Aslam Northeastern University USA
Nicholas Belkin Rutgers University USA
Ben Carterette University of Delaware USA
Charlie Clarke University of Waterloo Canada
Georges Dupret Yahoo! Research Chile
Norbert Fuhr Universitaet Duisburg-Essen Germany
Atsushi Fujii Tokyo Institute of Technology Japan
Donna Harman NIST USA
Hideo Joho University of Tsukuba Japan
Gareth Jones Dublin City University Ireland
Noriko Kando NII Japan
Evangelos Kanoulas University of Sheffield UK
Jaana Kekalainen University of Tampere Finland
Mounia Lalmas University of Glasgow UK
Gary Geunbae Lee POSTECH Korea
Mun-Kew Leong National Library Board Singapore
Jimmy Lin University of Maryland USA
Chin-Yew Lin Microsoft Research Asia China
Iadh Ounis University of Glasgow UK
Carol Peters IEI-CNR Italy
Ian Ruthven University of Strathclyde UK
Tetsuya Sakai Microsoft Research Asia China
Mark Sanderson University of Sheffield UK
Falk Scholer RMIT University Australia
Ian Soboroff NIST USA
Paul Thomas CSIRO Australia
William Webber University of Melbourne Australia
Emine Yilmaz Microsoft Research Cambridge UK

*** EVIA 2010 CO-CHAIRS ***

William Webber (University of Melbourne, Australia)
wew at csse.unimelb.edu.au
Mark Sanderson (University of Sheffield, UK)
m.sanderson at sheffield.ac.uk
Tetsuya Sakai (Microsoft Research Asia, China)
tetsuyasakai at acm.org