Introduction to Information Retrieval

Wintersemester 2011/12
Hinrich Schütze, Alok Kothari, Thomas Müller
Tu 14:00-15:30, M12.21
Fr 14:00-15:30, M12.21

Textbook

IIR: Introduction to Information Retrieval. Christopher D. Manning, Prabhakar Raghavan and Hinrich Schütze. Cambridge University Press, 2008. Web publication at http://informationretrieval.org

Slides

You will need these style files to compile the latex sources.

IIR 01 Boolean retrieval: slide presentation, slides for printing, slide source

IIR 02 The term vocabulary & postings lists: slide presentation, slides for printing, slide source

IIR 03 Dictionaries and tolerant retrieval: slide presentation, slides for printing, slide source

IIR 04 Index construction: slide presentation, slides for printing, slide source

IIR 05 Index compression: slide presentation, slides for printing, slide source

IIR 06 Scoring, weighting, vector spaces: slide presentation, slides for printing, slide source

IIR 07 Computing scores in a complete search system: slide presentation, slides for printing, slide source

IIR 08 Evaluation & result summaries: slide presentation, slides for printing, slide source

IIR 09 Relevance feedback & query expansion: slide presentation, slides for printing, slide source

IIR 10 XML retrieval: slide presentation, slides for printing, slide source

IIR 11 Probabilistic IR: slide presentation, slides for printing, slide source

IIR 12 Language models: slide presentation, slides for printing, slide source

IIR 13 Text classification & Naive Bayes: slide presentation, slides for printing, slide source

IIR 14 Vector space classification: slide presentation, slides for printing, slide source

IIR 15-1 Support vector machines: slide presentation, slides for printing, slide source

IIR 15-2 Learning to rank: slide presentation, slides for printing, slide source

IIR 16 Flat clustering: slide presentation, slides for printing, slide source

IIR 17 Hierarchical clustering: slide presentation, slides for printing, slide source

IIR 18 Latent semantic indexing: slide presentation, slides for printing, slide source

IIR 19 Web search: slide presentation, slides for printing, slide source

IIR 20 Crawling: slide presentation, slides for printing, slide source

IIR 21 Link analysis: slide presentation, slides for printing, slide source

2011 Assignments (Winter)

1: assignment data solution
2: assignment solution
3: students assignment
4: assignment
5: assignment TFIDFSystem.py new wiki small corpus
6: assignment NaiveBayes solution
7: assignment Kmeans
8: assignment Retrieval in Galago lm4ir

2011 Assignments (Summer)

assignment 1   solution 1
assignment 2   solution 2
assignment 3   solution 3
assignment 4   solution 4
assignment 5   solution 5
assignment 6   solution 6

2010 Assignments

assignment 1   solutions
assignment 2 solutions
assignment 3 solutions
assignment 4 solutions
assignment 5 solutions
assignment 6 solutions

2009 Assignments

assignment 1   solutions
assignment 2 solutions
assignment 3 solutions
assignment 4 solutions
assignment 5 solutions

2011/12 Schedule

 
             date   topic chapter      slides for ... resources
IIR 01 10/18 Boolean retrieval pdf html students instructors
information retrieval links
search Shakespeare
 
             date   topic chapter      slides for ... resources
IIR 0210/21Term vocabulary&postings lists   pdf html instructors
Porter stemmer
credit card number searches disabled
 
             date   topic chapter      slides for ... resources
IIR 0310/25 Dictionaries & tolerant retrieval pdf html students instructors
trie vs hash vs ternary tree
soundex demo
edit distance demo
P. Norvig's spell corrector
wild card search on Google
spelling correction gone wrong
freq(misspelling)>freq(correct)
 
             date   topic chapter      slides for ... resources
IIR 0611/4Scores, weights, vector spaces pdf html students instructors
vector space for dummies
exploring the similarity space
Okapi BM25
 
             date   topic chapter      slides for ... resources
IIR 0711/8Computing scores pdf html students instructors
how Google tweaks ranking
interview with Google's Udi Manber
Amit Singhal on Google ranking
SEO perspective: ranking factors
Yahoo BOSS: opening up search
compare Google/Yahoo rankings
eye tracking at Google
 
             date   topic chapter      slides for ... resources
IIR 0811/11Evaluation & result summaries pdf html students instructors
TREC at NIST
v. Rijsbergen's definition of F
A/B testing
too much A/B testing?
early paper on dynamic summaries
search quality evaluation at Google
 
             date   topic chapter      slides for ... resources
IIR 0911/15Rel. feedback, query expansion   pdf html students instructors
original relevance feedback paper
relevance feedback at Excite
Justin Bieber: related searches fail
WordSpace
automatic word sense discrimination
 
11/18Practical exercise assignment, data solution
11/22Practical exercise assignment solution
11/25Practical exercise students assignment
12/2Practical exercise assignment
 
             date   topic chapter      slides for ... resources
IIR 1312/6Text classification, Naive Bayes pdf html students instructors
Weka (includes Naive Bayes)
Reuters-21578
vulgarity text classifier fail
 
             date   topic chapter      slides for ... resources
IIR 1212/9Language models for IR pdf html students instructors
Ponte & Croft paper on LMs in IR
Zhai & Lafferty
Lemur Toolkit
 
             date   topic chapter      slides for ... resources
IIR 15-112/13Support vector machines pdf html students instructors
 
             date   topic chapter      slides for ... resources
IIR 1612/16Flat clustering pdf html students instructors
van Rijsbergen: Cluster Hypothesis
search result clustering: Yippy
search result clustering: Carrot2
search result clustering: Bing
# clusterings: Stirling number
 
             date   topic chapter      slides for ... resources
IIR 1712/16Hierarchical clustering pdf html students instructors
GoogleNews precursor: Newsblaster
Bisecting K-means
PDDP algorithm
 
             date   topic chapter      slides for ... resources
IIR 2112/20Link analysis pdf html students instructors
more on PageRank math
Jon Kleinberg (inventor of HITS)
PageRank according to Google
Google bomb (January 2008)
defused Google bomb (June 2009)
 
1/10Practical exercise assignment TFIDFSystem.py new wiki small corpus
1/13Practical exercise assignment NaiveBayes solution
1/17Practical exercise assignment Kmeans
1/20Practical exercise assignment Retrieval in Galago lm4ir
1/22Final dryrun test problems
 
             date   topic chapter      slides for ... resources
IIR 191/24Web information retrieval pdf html students instructors
how ads are priced
Geico search ca. 2004
Louis Vuitton counterfeiting case
geo-targeted ad
size of the web in 2007
size of the web in 2008
ad monitoring at Google
fighting webspam
1/27 Practice problems solutions
1/31Probeklausur solutions
2/7Klausur

Prior Semesters

 
             date   topic chapter      slides for ... resources
IIR 112011/05/23Probabilistic information retrieval pdf html students instructors
solution to in-class problem
 
             date   topic chapter      slides for ... resources
IIR 15-22011/06/28Learning to rank (LTR) pdf html students instructors
Learning to rank references
Microsoft LTR datasets
 
             date   topic chapter      slides for ... resources
IIR 182011/07/12Latent semantic indexing pdf html students instructors
Original LSI paper
Probabilistic LSI
Dimensions of meaning: LSI for words
 
             date   topic chapter      slides for ... resources
IIR 042010/05/04Index construction pdf html students instructors
MapReduce paper
SPIMI paper
Google data center tour
 
             date   topic chapter      slides for ... resources
IIR 052010/05/10Index compression pdf html students instructors
variable byte codes
word-aligned binary codes
pos/freq compression
 
             date   topic chapter      slides for ... resources
2010/07/05Cross-Language IR students instructors latex source
 
             date   topic chapter      slides for ... resources
IIR 102010/07/12XML retrieval pdf html students instructors
 
             date   topic chapter      slides for ... resources
IIR 142010/06/28Vector space classification pdf html students instructors
perceptron example
TC overview by Sebastiani
FSNLP (decision trees, perceptrons)
The elements of statistical learning
 
             date   topic chapter      slides for ... resources
IIR 202009/07/14Crawling pdf html students instructors
Mercator web crawler
robots.txt standard
Google data centers

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
dr mr