PROMISE - List of all Publications
PROMISE - Books and Books chapters
2013
Agosti, M., Ferro, N., Forner, P., Müller, H., and Santucci, G., editors (2013). Information Retrieval Meets Information Visualization - PROMISE Winter School 2012, Revised Tutorial Lectures. Lecture Notes in Computer Science (LNCS) 7757, Springer, Heidelberg, Germany.
[Paper] [BibTeX]
Lupu M. and Hanbury A., Patent Retrieval, Foundations and Trends in Information Retrieval, Foundations and Trends in Information Retrieval, Vol. 7, No. 1, pages 1–97, 2013
[BibTeX]
Müller H. Medical (visual) Information Retrieval. Information Retrieval Meets Information Visualization, Winter School book, pages 155-166
[Paper] [BibTeX]
2012
Agosti, M., Esposito, F., Ferilli, S., and Ferro, N., editors (2013). Digital Libraries and Archives - Proc. 8th Italian Research Conference (IRCDL 2012). Communications in Computer and Information Science (CCIS) 354, Springer, Heidelberg, Germany
[Paper] [BibTeX]
Agosti M., Esposito F., Ferilli S., Ferro N., editors (2012). Taking Care of Legacy and Cultural Heritage Documents - Proceedings. 8th Italian Research Conference (IRCDL 2012). Communications in Computer and Information Science (CCIS) 354, Springer, Heidelberg, Germany.
[Paper] [BibTeX]
Agosti M., Ferro N., Forner P., Müller H., Santucci G. (2013) Information Retrieval Meets Information Visualization. PROMISE Winter School 2012, Zinal, Switzerland, January 23-27, 2012, Revised Tutorial Lectures Springer, LNCS 7757
[BibTeX]
Catarci, T., Forner, P., Hiemstra, D., Peñas, A., Santucci, G., (Eds.), Proceedings of Information Access Evaluation meets Multilinguality, Multimodality, and Visual Analytics - Third International Conference of the CLEF Initiative (CLEF 2012). Rome, Italy, September 17-20, 2012, Lecture Notes in Computer Science (LNCS 7488). Springer.
Ferro, N. and Tanca, L. (2012) Proceedings of the Twentieth Italian Symposium on Advanced Database Systems, SEBD 2012, Venice, Italy, June 24-27, 2012. Edizioni Libreria Progetto, Padova, Italy, ISBN: 978-88- 96477-23-6, pp. 283-288.
Forner, P., Karlgren, J., Womser-Hacker, C. CLEF 2012 Evaluation Labs and Workshop - Abstracts of the Working Notes, Rome, Italy, 17-20 September, 2012. ISBN 978-88-905389-6-4 ISSN 2038-4726
Peters, C., Braschler, M., and Clough, P. Multilingual Information Retrieval: from Research to Practice. Springer-Verlag, 2012. ISBN 978-3-642-23007-3
2011
Agosti, M.: Digital Libraries. In: M. Melucci, R. Baeza-Yates (Eds). Advanced Topics in Information Retrieval. Springer, New York, 2011, pp. 1-26.
Agosti, M., Ferro, N., and Silvello, G. Handling Hierarchically Structured Resources Addressing Interoperability Issues in Digital Libraries. In Biba, M. and Xhafa, F.(Eds.), Learning Structure and Schemas from Documents, pages 17–49. Springer-Verlag. ISBN: 978-3-642-22912-1. doi: 10.1007/978-3-642-22913-8_2
Forner, P., Gonzalo, J., Kekäläinen, J., Lalmas, M., and de Rijke, M., (Eds). Multilingual and Multimodal Information Access Evaluation. Proceedings of the Second International Conference of the Cross- Language Evaluation Forum (CLEF 2011), Amsterdam, The Netherlands, 19-22 September, 2011. Lecture Notes in Computer Science (LNCS) 6941. (2011)
Miksch, S. and Santucci, G. (Eds). Proceedings of the 2nd International Workshop on Visual Analytics (EuroVA 2011). Eurographics Association, Geneve, Switzerland. ISBN: 978-3-905673-82-1; S. 17 - 20.
[BibTeX]
Petras, V., Forner, P., and Clough, P., (Eds). CLEF 2011 Labs and Workshops, Abstracts of the Notebook Papers. ISBN 978-88- 904810-1-7.
Piroi, F. and Zenz, V. : Evaluating Information Retrieval ibìn the Intellectual Property Domain: The CLEF-IP Campaign. In: Lupu, M.; Mayer, K.; Tait, J.; Trippe, A.J. (Eds.) Current Challenges in Patent Information Retrieval, The Information Retrieval Series, 2011, 29( 2),Springer Verlag. 87-108. DOI: 10.1007/978-3-642-19231-9_4.
[BibTeX]
2010
Agosti, M., Ferro, N., Peters, C., de Rijke, M., Smeaton, A.: Multilingual and Multimodal Information Access Evaluation, International Conference of the Cross-Language Evaluation Forum, CLEF 2010. Padua, Italy, September 20-23, 2010. Proceedings Springer Vol. LNCS 6360 (2010).
Braschler, M., Harman, D., Pianta, E: CLEF 2010 LABs and Workshops Notebook Papers
22-23 September, Padua, Italy. Online Proceedings (2010).
Müller, H., Clough, P., Deselaers, T., Caputo, B.: ImageCLEF - Experimental Evaluation of Visual Information Retrieval. Springer: Heidelberg, Germany. 495 pages. (2010)
PROMISE - Journal Papers
2013
Foncubierta-Rodríguez A. and Müller H. (2013) Crowdsourcing Opportunities in Medical Imaging. IEEE Communication Society letter
[Paper] [BibTeX]
Zhou X., Stern R. and Müller H. (2012) Case-based fracture retrieval. International Journal on Computer assisted Radiology and Surgery, 7:3(401-411)
[Paper] [BibTeX]
2012
Agosti, M., Crivellari, F., and Di Nunzio, G.M. Web log analysis: A Review of a Decade of Studies about Information Acquisition, Inspection and Interpretation of User Interaction. In Data Mining and Knowledge Discovery. Volume 24(3): 663-696 (2012). DOI: 10.1007/s10618-011-0228-8, pages 1-34.
Agosti M., Berendsen R., Bogers T., Braschler M., Buitelaar P., Choukri K., Di Nunzio, G. M., Ferro N., Forner P., Hanbury A., Friberg Heppin K., Hansen P., Järvelin A., Larsen B., Lupu M., Masiero I., Müller H., Peruzzo S., Petras V., Piroi F., de Rijke M., Santucci G., Silvello G., and Toms E. (2012). PROMISE Retreat Report - Prospects and Opportunities for Information Access. SIGIR Forum, 46(2).
[Paper] [BibTeX]
Catarci T., Ferro N., Forner P., Hiemstra D., Karlgren J., Peñas A., Santucci G., Womser-Hacker C. (2012). CLEF 2012: Information Access Evaluation meets Multilinguality, Multimodality, and Visual Analytics. SIGIR Forum 46(2): 29-33 (2012)
[BibTeX]
Depeursinge, A., Vargas, A., Platon, A., Geissbuhler, A., Poletti, P. A., Müller, H. : Building a Reference Multimedia Database for Interstitial Lung Diseases, Computerized Medical Imaging and Graphics. ELSEVIER (2012)
Depeursinge, A., Duc, S., Eggel, I., and Müller, H. : Mobile Medical Visual Information Retrieval. IEEE Transactions on Information Technology in BioMedicine, 16:1(53-61) (2012)
Ferro, N.: The CLEF Initiative: Conference and Labs of the Evaluation Forum. ERCIM News, 88:63-64. (2012)
[Paper] [BibTeX]
Ferro N. (2012). CLEF 2012 and beyond: Perspectives for the Conference and Labs of the Evaluation forum. ERCIM News, 91:36-37
[Paper] [BibTeX]
Ferro, N. (2012). La gestione e conservazione dei dati scientifici prodotti dalla valutazione sperimentale dei motori di ricerca. Atti e Memorie dell'Accademia Galileana di Scienze Lettere ed Arti in Padova, già Dei Ricoverati e Patavina. Parte II: Memorie della Classe di Scienze Matematiche, Fisiche e Naturali, CXXIV:41-52
[Paper] [BibTeX]
Peñas, A., Magnini, B., Forner, P., Sutcliffe, R., Rodrigo, A., and Giampiccolo, D. Question Answering at the Cross-Language Evaluation Forum 2003-2010, Language Resources and Evaluation, Volume 46, Issue 2, Pages 177-217, Springer.
2011
Agosti, M., Crivellari, F., Di Nunzio, G.M., and Gabrielli, S. Understanding User Requirements and Preferences for a Digital Library Web Portal. International Journal on Digital Libraries. Springer Berlin/Heidelberg, 2011, DOI: 10.1007/s00799-011-0075-7, pages 1-14.
Ferro, N., Hanbury, A., Müller, H., Santucci, G.: Harnessing the Scientific Data Produced by the Experimental Evaluation of Search Engines and Information Access Systems. Procedia CS 4: 740-749 (2011) ISSN: 1877-0509. doi:10.1016/j.procs.2011.04.078.
Ferro, N. DIRECT: the First Prototype of the PROMISE Evaluation Infrastructure for Information Retrieval Experimental Evaluation. ERCIM News, 86:54–55 (2011) ISSN: 0926-4981.
Ferro, N.: PROMISE: Advancing the Evaluation of Multilingual and Multimedia Information Systems
In : ERCIM News, 84, p.49 (2011) ISSN: 0926-4981
Ferro, N. La gestione e conservazione dei dati scientifici prodotti dalla valutazione sperimentale dei motori di ricerca. Atti e Memorie dell'Accademia Galileana di Scienze Lettere ed Arti in Padova, già Dei Ricoverati e Patavina. (2011)
[Paper]
Ferro, N. La rete di eccellenza europea PROMISE. DigItalia, Rivista del digitale nei beni culturali, 6(1).(2011) ISSN: 1972-6201
[Paper]
He, J., Meij, E., de Rijke, M.: Result Diversification Based on Query-Specific Cluster Ranking. Journal of the American Society for Information Science and Technology (JASIST). Vol.62(3): 550-571 (2011)
2010
Agosti, M., Ferro, N.: CLEF 2010: Conference on Multilingual and Multimodal Information Access Evaluation. DigItalia, Rivista del Digitale nei Beni Culturali. 5(1):95-112 (2010)
He, J., Sevenster, M., de Rijke, M.: Automatically Generating Explanatory Links for Narrative Radiology Reports. Journal of Biomedical Informatics. (2010)
PROMISE - Conference Papers
2013
Chhatkuli A., Markonis D., Foncubierta-Rodríguez A., Meriaudeau F., Müller H. (2013) Separating Compound Figures in Journal Articles to Allow for Subfigure Classification. SPIE, Medical Imaging, Orlando, FL, USA
[Paper] [BibTeX]
Chuklin, A., Serdyukov, P., de Rijke, M. (2013). Using Intent Information to Model User Behavior in Diversified Search, 34th European Conference on Information Retrieval (ECIR'13): Springer, March, 2013
[Paper] [BibTeX]
Ferro, N. and Silvello, G. (2013). Empowering Archives Through Annotations. In Agosti, M., Esposito, F., Ferilli, S., and Ferro, N., editors, Digital Libraries and Archives - Proc. 8th Italian Research Conference (IRCDL 2012), pages 57-68. Communications in Computer and Information Science (CCIS) 354, Springer, Heidelberg, Germany
[Paper] [BibTeX]
Hanbury A. and Lupu M. Toward a Model of Domain-Specific Search, Proceedings of OAIR 2013
[Paper] [BibTeX]
Hofmann K., Schuth A., Whiteson S., & de Rijke M. (2013, February). Reusing historical interaction data for faster online learning to rank for IR. In Proceedings of the sixth ACM international conference on Web search and data mining (pp. 183-192). ACM
[Paper] [BibTeX]
Hooper C.J., Bordea G., Buitelaar P. (2013) Web Science and the Two (Hundred) Cultures: Representation of Disciplines Publishing in Web Science. ACM Web Science 2013, Paris, France.
[Paper] [BibTeX]
Müller H., Foncubierta-Rodríguez A., Lin C. and Eggel I. (2013) Determining the Importance of Figures in Journal Articles to Find Representative Images. SPIE Medical Imaging, Orlando, FL, USA
[Paper] [BibTeX]
Odijk D., Meij E J., de Rijke M., Feeding the Second Screen: Semantic Linking based on Subtitles, Open research Areas in Information Retrieval (OAIR 2013), Lisbon, Portugal, May, 2013
[Paper] [BibTeX]
Polajnar Tamara, Aggarwal Nitish, Asooja Kartik, Buitelaar Paul (2013) Improving ESA with Document Similarity. European Conference on Information Retrieval (ECIR), Moscow, Russia.
[Paper] [BibTeX]
2012
Agosti, M., Di Buccio, E., Ferro, N., Masiero, I., Peruzzo, S., and Silvello, G. DIRECTions: Design and Specification of an IR Evaluation Infrastructure. In: T. Catarci, P. Forner, D. Hiemstra, A. Peñas, G. Santucci (Eds.), Proceedings of Information Access Evaluation meets Multilinguality, Multimodality, and Visual Analytics - Third International Conference of the CLEF Initiative (CLEF 2012). Rome, Italy, September 17-20, 2012, Lecture Notes in Computer Science (LNCS) n. 7488. Springer Berlin-Heidelberg, Germany.
Agosti, M., Catarci, T., Ferro, N., Müller, H., and Santucci, G. PROMISE Winter School 2012 Information Retrieval meets Information Visualization ACM SIGIR Forum, vol. 46, No. 1, June 2012, pp. 65-70
Agosti, M., Alber, B., Di Nunzio, G. M., Dussin, M., Rabanus, S., and Tomaselli, A. A Curated Database for Linguistic Research: The Test Case of Cimbrian Varieties. In Online Proceedings of LREC Workshop 2012, 21-27 May 2012, Istanbul, Turkey.
Ali, S., Foncubierta-Rodríguez, A., Depeursinge, A., Meriaudeau, F., Ratib, O. and Müller, H. "Synchronized slice viewing of similar image series", SPIE Medical Imaging 2012
[Paper] [BibTeX]
Angelini, M., Ferro, N., Granato, G. L., Santucci, G., and Silvello, G. (2012). Information Retrieval Failure Analysis: Visual analytics as a Support for Interactive What-If Investigation. In Santucci, G. and Ward, M., editors, Proc. IEEE Conference on Visual Analytics Science and Technology (VAST 2012), pages 204-206. IEEE Computer Society, Los Alamitos, CA, USA
[Paper] [BibTeX]
Angelini, M., Ferro, N. Järvelin, K., Keskustalo, H., Pirkola, A., Santucci, G. and Silvello, G. (2012). Cumulated Relative Position: A Metric for Ranking Evaluation. In: T. Catarci, P. Forner, D. Hiemstra, A. Peñas, G. Santucci (Eds.), Proceedings of Information Access Evaluation meets Multilinguality, Multimodality, and Visual Analytics - Third International Conference of the CLEF Initiative (CLEF 2012). Rome, Italy, September 17-20, 2012, Lecture Notes in Computer Science (LNCS) n. 7488. Springer Berlin-Heidelberg, Germany.
Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2012). Visual Interactive Failure Analysis. In: N. Fuhr, J. Kamps, and S. Kraaij (Eds.), Proceedings of the Fourth Information Interaction in Context Symposium (IIiX 2012). Nijmegen, the Netherlands, August 21-24, 2012. ACM Press, New York, USA, ISBN 978-1-4503-1282-0.
[Paper] [BibTeX]
Berendsen, R., Kovachev, B., Nastou, E., de Rijke, M., Weerkamp, W.: Result Disambiguation in Web People Search, ECIR 2012: 34th European Conference on Information Retrieval, Barcelona, April, 2012
Berendsen R., Tsagkias E., de Rijke M., Meij E. (2012). Generating Pseudo Test Collections for Learning to Rank Scientific Articles. CLEF 2012: Conference and Labs of the Evaluation Forum, Rome, Italy, Springer, September, 2012
[Paper] [BibTeX]
Damljanovic, D., Kruschwitz, U., Albakour, M-D., Petrak, J. and Lupu, M. (2012) Applying Random Indexing to Structured Data to Find Contextually Similar Words. In Proc. Of LREC. 2012.
Di Buccio, E., Di Nunzio, G. M., and Silvello G. (2012). A System for Exposing Linguistic Linked Open Data. In: G. Buchanan, E. Rasmussen, and P. Zaphiris (Eds.), Proceedings of Research and Advanced Technology for Digital Libraries - International Conference on Theory and Practice of Digital Libraries (TPDL 2012). Paphos, Cyprus, September 23-27, 2012. Springer Berlin-Heidelberg, Germany.
Foncubierta-Rodríguez, A., Depeursinge A. and Müller, H. (2012) "Cerebellum detection using 3D wavelet texture classification", SPIE Medical Imaging 2012
[Paper] [BibTeX]
Hanbury, A., Müller, H., Langs, G., Weber, M.A., Menze, B. H., and Salas Fernandez, T. (2012). Bringing the algorithms to the data: cloud-based benchmarking for medical image analysis. In Proc. of CLEF Conference.
Hanbury A., Müller H., Searching Text and Images in the Medical Domain, Medical Informatics Europe, Pisa, Italy, 2012.
[Paper] [BibTeX]
Huurnink B., Berendsen R., Hofmann K., Meij E., de Rijke M. (2012) "The University of Amsterdam at the TREC 2011 Session Track", TREC 2011: NIST, February, 2012
Jurgens, J., Hansen, P. & Womser-Hacker, Christa. (2012). Going beyond CLEF_IP: The 'Reality' for Patent Searchers? In Catarci, T. et al. (Eds): Proceedings of the Third International Conference of the CLEF Initiative, CLEF 2012, Rome, Italay, Sept. 2012. pp. 30-35.
[Paper] [BibTeX]
Lupu, M., Mörzinger, R., Schleser, T., Schuster, R., Piroi , F., and Hanbury, A. (2012). Patent Images - a Glass encased Tool / Opening the case. In Proc. of iKnow Conference.
Markonis, D., Garcia Seco de Herrera, A, Eggel I. and Müller H. (2012). Multi-Scale Visual Words for Hierarchical Medical Image Categorization. SPIE Medical Imaging 2012
[Paper] [BibTeX]
Müller, H., Kalpathy-Cramer, J., Demner-Fushman, D., and Antani, S.: Creating a Classification of Image Types in the Medical Literature for Visual Categorization. SPIE Medical Imaging (2012)
[Paper] [BibTeX]
Orio, N., C. S. Liem, C., Peeters, G., and Schedl, M. (2012). MusiClef: Multimodal Music Tagging Task. Proceedings of Information Access Evaluation meets Multilinguality, Multimodality, and Visual Analytics - Third International Conference of the CLEF Initiative (CLEF 2012). Rome, Italy, September 17-20, 2012, Lecture Notes in Computer Science (LNCS) n. 7488. Springer Berlin-Heidelberg, Germany.
Peñas, A., Hovy, E., Forner, P., Rodrigo, Á., Sutcliffe, R., Forascu, C., and Sporleder, C. : Evaluating Machine Reading Systems through Comprehension Tests. In Proceedings of 8th international conference on Language Resources and Evaluation (LREC 2012), Istanbul
Piesch Tim-Christian, Müller Henning, Kuhl Christiane K., Deserno Thomas M., IRMA Code II: A New Concept for Classification of Medical Images, Medical Informatics Europe, Pisa, Italy, 2012.
[Paper] [BibTeX]
Piroi, F., Lupu, M., and Hanbury, A. (2012). Effects of Language and Topic Size in Patent IR: An Empirical Study. In Proc. of CLEF Conference. 2012.
Shah, C, Hansen, P. and Capra, R. (2012). Report on the Second Workshop on Collaborative Information Seeking (CIS). At the Annual Conference of American Society of Information science & Technology (ASIST). October 12, 2011, New Orleans, Louisiana.
[Paper] [BibTeX]
Silvello, G. (2012) Structural and Content Queries on the Nested Sets Model, Proceedings of the Twentieth Italian Symposium on Advanced Database Systems, SEBD 2012, Venice, Italy, June 24-27, 2012. Edizioni Libreria Progetto, Padova, Italy, ISBN: 978-88-96477-23-6, pp. 283-288.
[Paper] [BibTeX]
Tsikrika, T., Müller, H., and Kahn Jr., C.E. (2012). Log Analysis to Understand Medical Professionals' Image Searching Behaviour.Proceedings of the 24th European Medical Informatics Conference (MIE2012)
[Paper] [BibTeX]
2011
Agosti, M., Ferro, N., Rigon, A., Silvello, G., Terenzoni, E., and Tommasi, C. : SIAR: A User-Centric Digital Archive System. In: Digital Libraries and Archives - 7th Italian Research Conference, IRCDL 2011 Revised Papers. (vol. 249, pp. 87-99). ISBN: 978-3-642-27301-8. Springer-Verlag.
Bekkenkamp, J., Meij, E., de Rijke, M. : Online Religious Studies: A Pilot. In: WebSci '11: 3rd International Conference on Web Science, Koblenz, ACM, June, 2011.
[Paper] [BibTeX]
Berendsen, R., Kovachev, B., Meij, E., de Rijke, M., Weerkamp, W. : Classifying Queries Submitted to a Vertical Search Engine. In: Proceedings of the ACM Web Science 201: 1-6.
[Paper] [BibTeX]
Clough, P., Ferro, N., Forner, P., Gonzalo, J., Huurnink, B., Kekäläinen, J., Lalmas, M., Petras, V., and de Rijke, M. (2011). CLEF 2011 Conference on Multilingual and Multimodal Information Access Evaluation. SIGIR FORUM. vol. 45, pp. 32-37 ISSN: 0163-5840. doi:10.1145/2093346.2093349
Di Buccio, E., Melucci, M., Song, D.: Combining Interaction and Content for Feedback-Based Ranking. In Proceedings 2nd Information Retrieval Facility Conference. IRFC 2011: 46-61, Vienna. (2011)
Di Buccio, E., Dussin, M., Ferro, N., Masiero, I., Santucci, G., and Tino, G. (2011). To Re-rank or to Re-query: Can Visual Analytics Solve This Dilemma? In Forner, P., Gonzalo, J., Kekäläinen, J., Lalmas, M., and de Rijke, M. (Eds) Multilingual and Multimodal Information Access Evaluation. Proceedings of the Second International Conference of the Cross- Language Evaluation Forum (CLEF 2011). Lecture Notes in Computer Science (LNCS) 6941, Springer, pp 119–130.
Di Buccio, E., Dussin, M., Ferro, N., Masiero, I., and Silvello, G.: PROMISE - Participative Research labOratory for Multimedia and Multilingual Information Systems Evaluation. In: Digital Libraries and Archives - Proc. 7th Italian Research Conference (IRCDL 2011). (vol.246, pp. 140-143). ISBN/ISSN: 9783642273018. doi:10.1007/978-3-642-27302-5_20
[Paper] [BibTeX]
di Nunzio, G.M., Leveling, J., Mandl, T. : Multilingual Log Analysis: LogCLEF. In: Advances in Information Retrieval - 33rd European Conference on IR Research, ECIR 2011. Lecture Notes in Computer science, 2011, Volume 6611/2011, pp. 675-678. ISBN/ISSN: 9783642201608. doi:10.1007/978-3-642-20161-5_68
Duc, S., Depeursinge, A., Eggel, I., Müller, H. : Mobile Medical Image Retrieval, in: SPIE Medical Imaging, Proc. SPIE 7967, 79670G (2011); doi:10.1117/12.877054
[Paper] [BibTeX]
He, J., de Rijke, M., Sevenster, M., van Ommering, R. and Qian, Y. Automatic Link Generation with Wikipedia: A Case Study in Annotating Radiology Reports, 20th ACM Conference on Information and Knowledge Management (CIKM 2011), Glasgow, ACM, October, 2011.
[Paper] [BibTeX]
Hofmann, K., Whiteson, S., de Rijke, M. : Adapting Rankers Online. In: Information Retrieval Facility Conference IRFC 2011: 1-2 (2011)
Hofmann, K., Whiteson, S., de Rijke, M. A Probabilistic Method for Inferring Preferences from Clicks, 20th ACM Conference on Information and Knowledge Management (CIKM 2011), Glasgow, ACM, October, 2011.
[Paper] [BibTeX]
Hofmann, K., Whiteson, S., de Rijke M.: Balancing Exploration and Exploitation in Learning to Rank Online. In Proceedings of 33rd European Conference on Information Retrieval ECIR 2011: 251-263. Dublin, Ireland (2011)
Jijkoun, V., de Rijke, M. : Bootstrapping Subjectivity Detection. 34th international ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011: 1125-1126 (2011)
Kalpathy-Cramer, J., Müller, H., Bedrick, S., Eggel, I., Garcia Seco de Herrera, A., and Tsikrika, T. Overview of the CLEF 2011 Medical Image Classification and Retrieval Tasks, CLEF 2011 Working Notes, Amsterdam, the Netherlands, 2011
Massoudi, K., Tsagkias, M., de Rijke, M., Weerkamp, W. : Incorporating Query Expansion and Quality Indicators in Searching Microblog Posts, In: ECIR 2011, 33rd European Conference on Information Retrieval, April 2011.: 362-367.
Orio, N., Rizo, D., Miotto, R., Schedl, M., Montecchio, N., and Lartillot, O.: MusiCLEF: a Benchmark Activity in Multimodal Music Information Retrieval. In: Proceedings of the International Society for Music Information Retrieval. ISMIR 2011. October 24-28. (pp.603-608). ISBN/ISSN: 9780615548654. Miami, Florida, USA
[Paper] [BibTeX]
Tsagkias, M., Weerkamp, W., de Rijke, M. : Hypergeometric Language Models for Republished Article Finding. 34th international ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011: 485-494 (2011).
Tsikrika, T., Garcia Seco de Herrera A., and Müller, H. Assessing the Scholarly Impact of ImageCLEF. In Proceedings of the Conference on Multilingual and Multimodal Information Access Evaluation (CLEF 2011), 19-22 September, Amsterdam, The Netherlands, 2011.
Weerkamp, W., Kovachev, B., Berendsen, R., Meij, E., Balog, K., de Rijke, M. : People Searching for People: Analysis of a People Search Engine Log. 34th Annual International ACM SIGIR Conference SIGIR 2011 : 45-54 (2011)
2010
Agosti, M., Braschler, M., Choukri, K., Ferro, N., Harman, D., Peters, C., Pianta, E., de Rijke, M., Smeaton, A.F.: CLEF 2010 Conference on Multilingual and Multimodal Information Access Evaluation. SIGIR Forum 44(2): 8-12 (2010)
Braschler, M., Choukri, K., Ferro, N., Hanbury, A., Karlgren, J., Müller, H., Petras, P., Pianta, E., de Rijke, M., Santucci, G. : A PROMISE for the Experimental Evaluation. Proceedings of the CLEF 2010 International Conference on Multilingual and Multimodal Information Access Evaluation. CLEF 2010 Springer LNCS 6360: 140-144. (2010)
Bron, M., Balog, K., de Rijke, M. : Ranking related Entities: Components and Analyses. Proceedings of the 19th ACM International conference on Information and Knowledge Management (CIKM 10): 1079-1088. (2010)
Eggel, I., Müller, H. : Indexing the Medical Open Access Literature for Textual and Content-based Visual Retrieval. MEDINFO 2010 -- Proceedings of the 13th World Congress on Medical Informatics. Vol.160(2): 1277-1281 (2010)
Gäde, M., Petras, V., Stiller, J. : Which Log for Which Information? Gathering Multilingual Data from Different Log File Types. Proceedings of the CLEF 2010 International Conference on Multilingual and Multimodal Information Access Evaluation. CLEF 2010 Springer LNCS 6360: 70-81 (2010).
[Paper] [BibTex]
Hanbury, A, Müller, H. : Automated Component-Level Evaluation: Present and Future. Proceedings of the CLEF 2010 International Conference on Multilingual and Multimodal Information Access Evaluation. CLEF 2010 Springer LNCS 6360: 124-135 (2010).
Hofmann,K., Huurnink, B., Bron, M., de Rijke, M. : Comparing click-through Data to Purchase Decisions for Retrieval Evaluation. In Proceeding of the 33rd international ACM SIGIR conference on Research and Development in Information Retrieval. SIGIR 2010: 761-762 (2010)
Huurnink, B., Hofmann, K., de Rijke, M., Bron, M. : Validating Query Simulators: An Experiment Using Commercial Searches and Purchases. Proceedings of the CLEF 2010 International Conference on Multilingual and Multimodal Information Access Evaluation. CLEF 2010 Springer LNCS 6360: 40-51(2010).
de Rijke, M., Balog, K., Bogers, T., van den Bosch, A.: On the Evaluation of Entity Profiles. Proceedings of the CLEF 2010 International Conference on Multilingual and Multimodal Information Access Evaluation. CLEF 2010 Springer LNCS 6360: 94-99 (2010).
PROMISE - Workshop Papers
2013
Angelini, M., Ferro, N., Järvelin, K., Keskustalo, H., Pirkola, A., Santucci, G., and Silvello, G. (2013). Cumulated Relative Position: A Metric for Ranking Evaluation. In Basili, R., Sebastiani, F., and Semeraro, G., editors, Proc. 4th Italian Information Retrieval Workshop (IIR 2013), pages 57-60.
[Paper] [BibTeX]
Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2013). Visual Interactive Failure Analysis: Supporting Users in Information Retrieval Evaluation. In Basili, R., Sebastiani, F., and Semeraro, G., editors, Proc. 4th Italian Information Retrieval Workshop (IIR 2013), pages 61-64
[Paper] [BibTeX]
Hansen, P. (2013). Initial Design of CIS and Making Sense in an Ad-Hoc Team-Based Crisis Situation. Workshop on Collaborative Information Seeking: Consolidating the Past, Creating the Future. Workshop in conjuntion to the CSCW 2013 Conference, February, 2013, San Antonio, USA
[Paper] [BibTeX]
2012
Agosti M., Alber B., Di Nunzio G. M., Dussin M., Rabanus S., Tomaselli A. (2012) A Curated Database for Linguistic Research: The Test Case of Cimbrian Varieties. In Online Proceedings of LREC Workshop 2012, 21-27 May 2012, Istanbul, Turkey.
[Paper] [BibTeX]
Agosti, M., Ferro, N., and Thanos, C. (2012). DESIRE 2011 Workshop on Data infrastructurEs for Supporting Information Retrieval Evaluation. ACM SIGIR Forum, vol. 46, No. 1, June 2012, pp. 51-55
Allan, J., Aslam, J., Azzopardi, L., Belkin, N., Borlund, P., Bruza, P., Callan, J., Carman, M. Clarke, C., Craswell, N., Croft, W. B., Culpepper, J. S., Diaz, F., Dumais, S., Ferro, N., Geva, S., Gonzalo, J., Hawking, D., Järvelin, K., Jones, G., Jones, R., Kamps, J., Kando, N., Kanoulos, E., Karlgren, J., Kelly, D., Lease, M., Lin, J., Mizzaro, S., Moffat, A., Murdock, V., Oard, D. W., de Rijke, M., Sakai, T., Sanderson, M., Scholer, F., Si, L., Thom, J., Thomas, P., Trotman, A., Turpin, A., de Vries, A. P., Webber, W., Zhang, X., and Zhang, Y. (2012). Frontiers, Challenges, and Opportunities for Information Retrieval – Report from SWIRL 2012, The Second Strategic Workshop on Information Retrieval in Lorne, February 2012. SIGIR Forum, 46(1):2–32.
[Paper] [BibTeX]
Depeursinge A., Greenspan H., Syeda Mahmood T. and Müller H. (2012) Overview of the Second Workshop on Medical Content-Based Retrieval for Clinical Decision Support. Medical Content--based Retrieval for Clinical Decision Support, Toronto, Canada, pages 1—11
[Paper] [BibTeX]
Ferro, N., Granato, G. and Santucci, G. (2012). The PROMISE Network of Excellence. In Matkovic, K. and Santucci, G. (Editors). Proc. 3rd International Workshop on Visual Analytics (EuroVA 2012). Eurographics Association, Goslar, Germany.
[Paper] [BibTeX]
Hanbury, A., and Müller, H. (2012). A cloud based approach for benchmarking on private data, SIGIR workshop on Community IR Evaluation using Private Data Collections, Portland, OR, USA, 2012.
[Paper] [BibTeX]
Hanbury A., Müller H., A cloud based Approach for Benchmarking on Private Data, SIGIR workshop on Community IR Evaluation using Private Data Collections, Portland, OR, USA, 2012
[Paper] [BibTeX]
Lupu, M. (2012) Bootstraping a Comparable Corpus from Patent Family Members. In Proc. of Text Information Retrieval Workshop.
Peñas, A., Hovy, E., Forner, P., Rodrigo, A., Sutcliffe, R., Sporleder, C., Forascu, C., Benajiba, Y., and Osenova P. Overview of QA4MRE at CLEF 2012: Question Answering for Machine Reading Evaluation. In Forner, P., Karlgren, J., Womser-Hacker, C. CLEF 2012 Evaluation Labs and Workshop - Online Working Notes, Rome, Italy, 17-20 September, 2012. ISBN 978-88-904810-3-1 ISSN 2038-4963
Petras V., Ferro N., Gäde M., Isaac A., Kleineberg M., Masiero I., Nicchio M. and Stiller J. (2012). Cultural Heritage in CLEF (CHiC) Overview 2012. In Forner, P.,Karlgren, J., and Womser-Hacker, C. (Editors). CLEF 2011 Labs and Workshops, Notebook Papers.
[Paper] [BibTeX]
Piesch, T.C., Müller, H., Kuhl, C.K., and Deserno, T.M. : IRMA-Code II: A new concept for classification of medical images, in: Bildverarbeitung in der Medizin (BVM2012), Berlin, Germany, Springer, 2012
Piroi F., Lupu M., Hanbury A., Sexton A., Magdy W., Filippov I. (2012). CLEF-IP 2012: Retrieval Experiments in the Intellectual Property Domain. CLEF-IP Workshop Notes
[Paper] [BibTeX]
Seco de Herrera A.G., Markonis D., Eggel I. and Müller H. (2012) The medGIFT Group in ImageCLEFmed 2012, Proceedings of the CLEF Working Notes, 2012
[Paper] [BibTeX]
Seco de Herrera A.G. , Markonis D and Müller H. (2012) Bag-of-Colors for Biomedical Document Image Classification. Proceedings of the MICCAI workshop (MCBR-CDS 2012) Nice, France, pages 110-111, 2013
[Paper] [BibTeX]
2011
Hansen, P., Granato, G. L. and Santucci, G. (2011). Collecting and Assessing collaborative requirements. Collaborative Information Seeking (CIS 2011) workshop. ASIST Conference, New Orleans, USA, September, 2011.
[Paper] [BibTeX]
Hansen, P. (2011). Classification of collaborative group activities. Position paper. Collaborative Information Seeking (CIS 2011) workshop. ASIST Conference, New Orleans, USA, September, 2011.
[Paper] [BibTeX]
Agosti, M., Ferro, N., and Thanos, C.: DESIRE: first International Workshop on Data infrastructures for Supporting Information Retrieval Evaluation. In: Proceedings of the 20th International Conference on Information and Knowledge Management (CIKM 2011). (pp. 2631-2632). New York, ACM Press doi:10.1145/2063576.2064048
Boscarino, C., Hofmann, K., Jijkoun, V., Meij, E., de Rijke, M., Weerkamp, W. : DIR 2011: the Eleventh Dutch-Belgian Information Retrieval Workshop. SIGIR Forum 45(1): 42-44 (2011)
Bron, M., van Gorp, J., Nack, F., de Rijke, M. : Exploratory Search in an Audio-Visual Archive: Evaluating a Professional Search Tool for Non-Professional Users. In Kalbach, J., Larsen, B., Russell-Rose, T., and Wilson, M. L., (Eds). 1st European Workshop on Human-Computer Interaction and Information Retrieval (EuroHCIR 2011).
[Paper] [BibTeX]
Choukri, K., Park, J., Hamon, O., and Arranz, V. Proposal for the International Standard Language Resource Number. In Proceedings of IJCNLP2011 Workshop on Language Resources, Technology and Services in the Sharing Paradigm. Chiang Mai, Thailand. November 8-13, 2011
Di Buccio, E., Dussin, M., Ferro, N., Masiero, I., Santucci, G., and Tino, G. : Interactive Analysis and Exploration of Experimental Evaluation Results. In Kalbach, J., Larsen, B., Russell-Rose, T., and Wilson, M. L., (Eds). 1st European Workshop on Human-Computer Interaction and Information Retrieval EuroHCIR 2011. ISBN/ISSN: 1613-0073.
[Paper] [BibTeX]
Di Buccio, E., Montecchio, N., and Orio N.: University of Padua at MusiCLEF 2011: Music Identification Task. In: CLEF 2011 Labs and Workshop, Notebook Papers. CLEF 2011. 19-22 September. ISBN: 9788890481017.
Di Buccio, E., Di Nunzio, G.M. : Envisioning Dynamic Quantum Clustering in Information Retrieval. In Proceedings of Quantum Interaction, Fifth International Symposium, QI 2011, Revised Selected Papers. Lecture Notes in Computer Science, Springer vol. LNCS 7052, pp. 211-216. ISBN/ISSN: 9783642249709. doi:10.1007/978-3-642-24971-6_22.
Ferro, N., Sabetta, A., Santucci, G., Tino, G., Veltri F. : Visual Comparison of Ranked Result Cumulated Gains. In Miksch, S. and Santucci, G., (Eds), 2nd International Workshop on Visual Analytics (EuroVA 2011).
Ferro, N., Silvello, G. : The NESTOR Model: Properties and Applications in the Context of Digital Archives. In Mecca, G. and Greco, S., editors, Proc. 19th Italian Symposium on Advanced Database Systems (SEBD 2011), 274–285. Universita` della Basilicata, Italy.
[Paper] [BibTeX]
Gäde, M., Ferro, N., and Lestari Paramita, M. (2011). ChiC 2011 – Cultural Heritage in CLEF: From Use Cases to Evaluation in Practice for Multilingual Information Access to Cultural Heritage. In Petras, V., Forner, P., and Clough, P., editors, CLEF 2011 Labs and Workshops, Notebook Papers. Italy. ISBN: 978-88-904810-1
Gäde, M., Stiller, J., Berendsen, R., Petras, V. : Interface Language, User Language and Success Rates in the European Library. In Petras, V., Forner, P., and Clough, P., editors, CLEF 2011 Labs and Workshops, Notebook Papers. Italy. ISBN: 978-88-904810-1
Hanbury, A., Bhatti, N., Lupu, M., and Mörzinger, R. : Patent Image Retrieval: a Survey. In Proceedings of the Patent Information Retrieval Workshop (PaIR), Glasgow, 2011
[Paper] [BibTeX]
Karlgren, J., Järvelin, A., Hansen, P., and Eriksson, G.: "Use Cases as a Component of Information Access Evaluation" Proceedings of the 2011 workshop on Data infrastructurEs for Supporting Information Retrieval Evaluation - DESIRE 2011 Workshop, CIKM, Glasgow.
[Paper] [BibTeX]
Karlgren, J.: The Use Case Perspective for Single Query Information Access. Keynote address at SIGIR 2011 Workshop on "entertain me": Supporting Complex Search Tasks, 28 July 2011, Beijing, China.
[Paper] [BibTeX]
Lupu, M. The Status of Retrieval Evaluation in the Patent Domain, Proceedings of the Patent Information Retrieval Workshop (PaIR) 2011.
[Paper] [BibTeX]
Lupu, M. PatOlympics - An Infrastructure for Interactive Evaluation of Patent Retrieval Tools, In Proceedings Of DESIRE 2011 Workshop.
[Paper] [BibTeX]
Markonis, D., Garcia Seco de Herrera, A., Eggel, I. and Müller, H.: The MedGIFT group at ImageCLEFmed 2011, CLEF working notes, Amsterdam, The Netherlands, 2011.
Orio, N., and Rizo., D.: Overview of MusiCLEF 2011. In: CLEF 2011 Labs and Workshop, Notebook Papers. CLEF2011. 19-22 September. ISBN: 9788890481017.
Peñas, A., Hovy, E., Forner, P., Rodrigo, Á., Sutcliffe, R., Forascu, C., and Sporleder, C. Overview of QA4MRE at CLEF 2011: Question Answering for Machine Reading Evaluation. CLEF 2011 Labs and Workshop Notebook Papers, Amsterdam, September, 2011. ISBN 978-88-904810-1-7, ISSN 2038-4726.
Piroi, F., Lupu, M., Hanbury A., and Zenz V.: CLEFIP 2011: Retrieval in the Intellectual Property Domain. In CLEF 2011 Labs and Workshop Notebook Papers, Amsterdam, September, 2011. ISBN 978-88-904810-1-7, ISSN 2038-4726.
van Dijk, D., Henseler, H., de Rijke, M. : Semantic Search in E-Discovery. Workshop on Setting Standards for Searching Electronically Stored Information in Discovery Proceedings DESI IV Workshop (2011)
[Paper] [BibTeX]
2010
Ferro, N.: CLEF, CLEF 2010, and PROMISEs: Perspectives for the Cross-Language Evaluation Forum
8th NTCIR Workshop Meeting on Evaluation of Information Access Technologies. Online Proceedings (2010)
[Paper] [BibTeX]
Martzoukos, S., Monz, C. : The UvA System Description for IWSLT 2010. In Proceedings of the 7th International Workshop on Spoken Language Translation (IWSLT 2010)
[Paper] [BibTeX]
Stiller, J.; Gäde, M.; Petras, V. : Ambiguity of Queries and the Challenges for Query Language Detection In: CLEF 2010 LABs and Workshops, Notebook Papers (2010).
Yahyaei, S., Monz, C. : Dynamic Distortion in a Discriminative Reordering Model for Statistical Machine Translation. In Proceedings of the 7th International Workshop on Spoken Language Translation (IWSLT 2010)
[Paper] [BibTeX]
Yahyaei, S., Monz, C. : The QMUL System Description for IWSLT 2010. In Proceedings of the 7th International Workshop on Spoken Language Translation (IWSLT 2010)
[Paper] [BibTeX]