NIST Special Publication 500-251: The Eleventh Text
REtrieval Conference (TREC 2002)
This report constitutes the proceedings of the Eleventh Text REtrieval Conference (TREC 2002) held in Gaithersburg, Maryland, November 19-22, 2002. The conference was co-sponsored by the National Institute of Standards and Technology (NIST) the Defense Advanced Research Projects Agency (DARPA) and the Advanced Research and Development Activity (ARDA).
Publisher: Department of Commerce, National Institute of Standards and Technology
Editors: E. M. Voorhees and Lori P. Buckland
NIST Special Publication 500-250: The Tenth Text
REtrieval Conference (TREC 2001)
This report constitutes the proceedings of the Tenth Text REtrieval Conference (TREC-2001) held in Gaithersburg, Maryland, November 13-16, 2001. The conference was co-sponsored by the National Institute of Standards and Technology (NIST) the Defense Advanced Research Projects Agency (DARPA) and the Advanced Research and Development Activity (ARDA). This publication is available in hardcopy format from the Government Printing Office (GPO), stock number SN003-003-03750-8, price not yet available. Call 202-512-1800 to order from the GPO Order Desk.
Publisher: Department of Commerce, National Institute of Standards and Technology
Editors: E. M. Voorhees and D. K. Harman
NIST Special Publication 500-249: The Ninth Text
REtrieval Conference (TREC-9)
This report constitutes the proceedings of the Ninth Text REtrieval Conference (TREC-9 ) held in Gaithersburg, Maryland, November 13-16, 2000. The conference was co-sponsored by the National Institute of Standards and Technology (NIST) the Defense Advanced Research Projects Agency(DARPA) and the Advanced Research and Development Activity (ARDA). This publication is available from NTIS. The identification number, PB2002-100919, must be used when ordering this publication. The price is $124 for a paper copy, foreign and domestic; and $52 for a copy on microfiche.
Publisher: Department of Commerce, National Institute of Standards and Technology
Editors: E. M. Voorhees and D. K. Harman
1.
Overview of the Ninth Text
REtrieval Conference (TREC-9), page 1
E. Voorhees, D. Harman, National Institute of Standards and Technology
2.
TREC-9 Cross-Language
Information Retrieval (English-Chinese) Overview, page 15
F. Gey, A. Chen, University of California, Berkeley
3.
The TREC-9 Filtering Track
Final Report, page 25
S. Robertson, Microsoft Research
D.A. Hull, WhizzBang Labs
4.
The TREC-9 Interactive Track
Report, page 41
W. Hersh, Oregon Health Sciences University
Paul Over, National Institute of Standards and Technology
5.
Overview of the TREC-9
Question Answering Track, page 71
E. Voorhees, NIST
6.
The TREC-9 Query Track, page 81
Chris Buckley, Sabir Research, Inc.
7.
Overview of the TREC-9 Web
Track, page 87
D. Hawking, CSIRO Mathematical and Information Sciences
8. Structuring
and Expanding Queries in the
Probabilistic Model, page 427
Y. Ogawa, H. Mano, M. Narita, S. Honma, RICOH Co., Ltd.
9. IIT
TREC-9 - Entity Based Feedback with Fusion,
page 241
A. Chowdhury, S. Beitzel, E. Jensen, M. Sai-lee, D. Grossman,
O. Frieder, Illinois Institute of Technology
M.C. McCabe, U.S. Government
D. Holmes, NCR Corporation
10. IBM's
Statistical Question Answering System,
page 229
A. Ittycheriah, M. Franz, W-J Zhu,
A. Ratnaparkhi, IBM T.J. Watson Research Center
R.J. Mammone, Rutgers University
11. Question Answering
by Passage Selection
(MultiText Experiments for TREC-9), page 673
C.L.A. Clarke, G.V. Cormack, D.I.E. Kisman, T.R. Lynam,
University of Waterloo
12. Question
Answering in Webclopedia,
page 655
E. Hovy, L. Gerber, U. Hermjakob, M. Junk, C-Y Lin, University of Southern
California
13. Spoken Document
Retrieval for TREC-9 at
Cambridge University, page 117
S.E. Johnson, P. Jourlin, K. Spärck Jones, P.C. Woodland,
Cambridge University
14. TREC-9 CLIR at
CUHK: Disambiguation by Similarity Values Between Adjacent Words, page
151
H. Jin, K-F Wong, The Chinese University of Hong Kong
15. Dublin City
University Experiments in Connectivity Analysis for TREC-9, page 179
C. Gurrin, A.F. Smeaton, Dublin City University
16. Training
Context-Sensitive Neural Networks with Few Relevant Examples for the TREC-9
Routing, page 257
M. Stricker, Informatique-CDC and ESPCI
F. Vichot, F. Wolinski, Informatique-CDC
G. Dreyfus, ESPCI
17. The HAIRCUT
System at TREC-9, page 273
P. McNamee, J. Mayfield, C. Piatko, The Johns Hopkins University, APL
18. Question
Answering Considering Semantic Categories and Co-Occurrence Density, page
317
S-M Kim, D-H Baek, S-B Kim, H-C Rim, Korea University
19. TNO-UT at
TREC-9: How Different are Web Documents?, page 665
W. Kraaij, TNO-TPD
T. Westerveld, University of Twente, CTIT
20. Report on the
TREC-9 Experiment: Link-based Retrieval and Distributed Collections, page
579
J. Savoy, Y. Rasolofo, Université de Neuchâtel
21. Information
Space Based on HTML Structure, page 601
G. Newby, University of North Carolina, Chapel Hill
22. Web Document Retrieval
Using Passage Retrieval, Connectivity Information, and Automatic Link
Weighting--TREC-9 Report, page 611
F. Crivellari, M. Melucci, University of Padova (Italy)
23. Reflections on
"Aboutness" TREC-9 Evaluation Experiments at Justsystem, page
281
S. Fujita, Justsystem Corporation
24. Incrementality,
Half-life, and Threshold Optimization for Adaptive Document Filtering, page
589
A. Arampatzis, J. Beney, C.H.A. Koster, T.P. van der Weide, University of
Nijmegen
1.
Overview of TREC 2001, page 1
E. Voorhees, NIST
2.
The TREC-2001 Cross-Language
Information Retrieval Track: Searching Arabic Using English, French or Arabic
Queries, page 16
F.C. Gey, University of California, Berkeley
D.W. Oard, University of Maryland, College Park
3.
The TREC 2001 Filtering
Track Report, page 26
S. Robertson, Microsoft Research
I. Soboroff, NIST
4.
The TREC 2001 Interactive
Track Report, page 38
W. Hersh, Oregon Health Sciences Univ.
P. Over, NIST
5.
Overview of the TREC 2001
Question Answering Track, page 42
E. Voorhees, NIST
6.
The TREC-2001 Video Track
Report, page 52 A.F. Smeaton, Dublin
City Univ.
P. Over, R. Taban, NIST
7. Overview of the TREC-2001 Web Track, page 61 D. Hawking, N. Craswell, CSIRO
8. Video
Retrieval with the Informedia Digital Video Library System, page 94
A. Hauptmann, R. Jin, N. Papernick, D. Ng, Y. Qi, Carnegie Mellon Univ.
R. Houghton, S. Thornton, Sonic Foundry-MediaSite Systems
9. TREC-10
Shot Boundary Detection Task: CLIPS System Description and Evaluation, page
142
G.M. Quenot, CLIPS-IMAG
10. Lazy Users and
Automatic Video Retrieval Tools in (the) Lowlands, page 159
The Lowlands Team: CWI, TNO, Univ. of Amsterdam, Univ. of Twente
11. Juru at TREC
10--Experiments with Index Pruning, page 228
D. Carmel, E. Amitay, M. Herscovici, Y. Maarek, Y. Petruschka, A. Soffer, IBM
Labs, Haifa
12. Integrating
Features, Models, and Semantics for TREC Video Retrieval, page 240
J.R. Smith, S. Basu, G. Iyengar, C-Y Lin, M. Naphade, B. Tseng, IBM T.J. Watson
Research Center
S. Srinivasan, A. Amir, D. Ponceleon, IBM Almaden Research Center
13. Use of WordNet
Hypernyms for Answering What-Is Questions, page 250
J. Prager, J. Chu-Carroll, IBM T.J. Watson Research Center
K. Czuba, Carnegie-Mellon University
14. Patterns of
Potential Answer Expressions as Clues to the Right Answers, page 293
M.M. Soubbotin, InsightSoft-M
15. Finding An
Answer Based on the Recognition of the Question Focus, page 362
O. Ferret, B. Grau, M. Hurault-Plantet, G. Illouz, L. Monceaux, I. Robba, A.
Vilnat, LIMSI-CNRS
16. Observations of
Searchers: OHSU TREC 2001 Interactive Track, page 434
W. Hersh, L. Sacherek, D. Olson, Oregon Health and Sciences University
17. Aggressive
Morphology and Lexical Relations for Query Expansion, page 479
W.A. Woods, S. Green, P. Martin, A. Houston, Sun Microsystems Labs
18. Using
Grammatical Relations, Answer Frequencies and the World Wide Web for TREC
Question Answering, page 502
S. Buchholz, Tilburg Univ.
19. Translation
Term Weighting and Combining Translation Resources in Cross-Language Retrieval,
page 529
A. Chen, F. Gey, Univ. of California at Berkeley
20. Comparing
Explicit and Implicit Feedback Techniques for Web Retrieval: TREC-10
Interactive Track Report, page 534
R.W. White, J.M. Jose, Univ. of Glasgow
I. Ruthven, Univ. of Strathclyde
21. Learning
Components for A Question-Answering System, page 539
D. Roth, G. Kao Kao, X. Li, R. Nagarajan, V. Punyakanok, N. Rizzolo, W-t Yih,
C. Ovesdotter Alm, L. Gerard Moran, Univ. of Illinois at Urbana-Champaign
22. Arabic
Information Retrieval at UMass in TREC-10, page 562
L. S. Larkey, M.E. Connell, Univ. of Massachusetts
23. Keep It Simple
Sheffield--A KISS Approach to the Arabic Track, page 642
M. Sanderson, A. Alberair, Univ. of Sheffield
24. The Use of
External Knowledge of Factoid QA, page 644
E. Hovy, U. Hermjakob, C-Y Lin, Univ. of Southern California
25. Machine
Learning Approach for Homepage Finding Task, page 686
W. Xi, E.A. Fox, Virginia Polytechnic Institute and State Univ.
26. Yonsei/ETRI at
TREC-10: Utilizing Web Document Properties, page 698
D-Y Ra, E-K Park, J-S Jang, Yonsei Univ.
1.
Overview of TREC 2002, page
E.M. Voorhees, National Institute of Standards and Technology
2.
The TREC 2002 Arabic/English
CLIR Track, page
D.W. Oard, University of Maryland, College Park
F.C. Gey, University of California, Berkeley
3.
The TREC 2002 Filtering
Track Report, page
S. Robertson, Microsoft Research
I. Soboroff, National Institute of Standards and Technology
4.
TREC 2002 Interactive Track
Report, page
W. Hersh, Oregon Health and Science University
5.
Overview of the TREC 2002
Novelty Track, page
D. Harman, National Institute of Standards and Technology
6.
Overview of the TREC 2002
Question Answering Track, page
E.M. Voorhees, National Institute of Standards and Technology
7.
The TREC-2002 Video Track
Report, page
A.F. Smeaton, Dublin City University
P. Over, National Institute of Standards and Technology
8.
Overview of the TREC-2002
Web Track, page
N. Craswell and D. Hawking
CSIRO
9. TREC
2002 QA at BBN: Answer Selection and Confidence Estimation, page
J. Xu, A. Licuanan, J. May, S. Miller, R. Weischedel, BBN Technologies
10. Question
Answering Using XML-Tagged Documents,
K.C. Litkowski, CL Research
11. Information
Filtering, Novelty Detection, and Named-Page Finding, page
K. Collins-Thompson, P. Ogilvie, Y Zhang, J. Callan, Carnegie Mellon University
12. Experiments in
Novelty Detection at Columbia University, page
B. Schiffman, Columbia University
13. Semantic
Feature Extraction using Mpeg Macro-block Classification, page
F. Souvannavong, B. Merialdo, B. Huet, Institut Eurécom
14. Topic
Distillation with Knowledge Agents, page
E. Amitay, D. Carmel, A. Darlow, R. Lempel, A. Soffer, IBM Research Labs Haifa
R. Lempel, Technion
15. A
Multi-Strategy and Multi-Source Approach to Question Answering, page
J. Chu-Carroll, J. Prager, C. Welty, K. Czuba, D. Ferrucci,
IBM T.J. Watson Research Center
16. Mining
Knowledge from Repeated Co-Occurrences: DIOGENE at TREC 2002, page
B. Magnini, M. Negri, R. Prevete, H. Tanev, ITC-Irst
17. TREC Feature
Extraction by Active Learning, page
J. Vendrig, I. Patras, C. Snoek, M. Worring, Mediamill/ISIS University of
Amsterdam
J. den Hartog, S. Raaijmakers, J. van Rest, Mediamill TNO-TPD
D. van Leeuwen, TNO-Human Factors
18. Extracting
Answers from the Web Using Data Annotation and Knowledge Mining Techniques,
page
J. Lin, A. Fernandes, B. Katz, G. Marton, S. Tellex, MIT
19. A Machine
Learning Approach for QA and Novelty Tracks: NTT System Description, page
H. Kazawa, T. Hirao, H. Isozaki, E. Maeda, NTT Communication Science
Laboratories
20. Some Similarity
Computation Methods in Novelty Detection, page
M.-F. Tsai, H.-H. Chen, National Taiwan University
21. The Integration
of Lexical Knowledge and External Resources for Question Answering, page
H. Yang, T.-S. Chua, National University of Singapore
22. Example Based
Text Matching Methodology for Routing Tasks, page
A. Visa, J. Toivonen, T. Vesanen, J. Mäkinen, Tampere University of Technology
B. Brack, Åbo Akademi University
H. Vanharanta, Pori School of Technology and Economics
23. Incremental
Learning for Profile Training in Adaptive Document Filtering, page
L. Ma, Q. Chen, S. Ma, M. Zhang, L. Cai, Tsinghua University
24. Using
Hierarchical Clustering and Summarisation Approaches
for Web Retrieval: Glasgow at the TREC 2002 Interactive Track, page
R. Osdin, I. Ounis, R.W. White, University of Glasgow
25. Homepage
Finding and Topic Distillation Using a Common Retrieval Strategy, page
V. Ngoc Anh, A. Moffat, University of Melbourne
26. Classifier
Stacking and Voting for Text Filtering page
R. Mihalcea, University of North Texas
27. Augmenting and
Limiting Search Queries, page
E.G. Toms, L. Freund, C. Li, University of Toronto
28. Statistical
Selection of Exact Answers (MultiText Experiments for TREC 2002), page
C.L.A. Clarke, G.V. Cormack, G. Kemkes, M. Laszlo, T.R. Lynam,
E.L. Terra, P.L. Tilker, University of Waterloo
29. Web Document
Retrieval Using Sentence-Query Similarity, page
E.-K. Park, S.-I. Moon, D.-Y. Ra, Yonsei University
M.-G. Jang, Electronics and Telecommunications Research Institute