204553 Information Storage and Retrieval

Thursday evening, 18-21h

NEW: Reading and writing assignment.

Course Objective

This course intends to give students a strong background concerning the automated storage and retrieval of information. Since text is the primary way that human knowledge is stored, and after speech, the primary way it is transmitted to one and another, we will mainly focus on the techniques for storing and searching for textual documents. During this course, we intend to cover both the theoretical aspects of information retrieval design and evaluation and the practical aspects of how these theories have been implemented in actual systems.

Important Note: This is an interactive course. Students taking this course are expected to propose, investigate and report on possible solutions in IR problems. Note that each instructer will give a talk of approximately one to one and a half hour, then students have to fill the second and the third hour with prepared talk.

Course Syllabus

04-jun Introduction to Information Storage and Retrieval [1] (Ar)

Faceted classification of IR systems
IR and other types of information systems
IR system evaluation

11-jun Retrieval Models I [2,3] (Ar)

Boolean retrieval
Inverted file index

18-jun Retrieval Models II [2,3] (Ar)

Vector space retrieval
SMART system demonstration
Talking about reading and writing assignment.

25-jun Invited Speaker from Simon Fraser U. (Prof. Paul McFETRIDGE)

NLP role in IR research

02-jul Retrieval Model III [11] (Ar)

Latent Semantic Indexing
Search Engine Watch, presented by Kun Montri, Thank you so much :)

16-jul NLP and IR system [3] (As)

Lexical analysis and stoplists
Stemming algorithm
Term phase formation
Thesaurus group generation

23-jul Text Analysis and Language Processing I [3] (As)

Linguistic approach
Dictionary operations
Syantactic analysis

30-jul ----- Mid-term Break----

06-aug Text Analysis and Language Processing II [3] (As)

Knowledge-based processing
Specialized language processing

13-aug Theory of Term Importance [5,2,3,12] (Ar)

Ziff's law
Term frequency
Invert-document frequency

20-aug Automatic Text Transformation [3] (As)

Automatic writing aids
Automatic abstracting systems
Automatic text generation
Automatic translation

27-aug Performance Evaluation in IR [2,10] (Ar)

Recall-precision graphs
Average precision at k document cutoff values

03-sep Selected readings (As)

10-sep Selected readings (Ar)

17-sep Selected readings (As)

Grading policy

participation, in & out of class, and his/her talk 40%
an assignment will be given by the mid-June, and must be sent by the end of July 30%
final exam 30%

References

Recommended text:

[1] William B. Frakes and Ricardo Baeza-Yates. Information retrieval: data structures & algorithms. Englewood Cliffs, N.J. : Prentice Hall, 1992. Gerarld

[2] Salton and McGrill. Introduction to Modern Information Retrieval. McGraw-Hill, 1983.

[3] Gerald Salton. Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer. Addison-Wesley, 1989.