Linguistics 696 Syllabus

Course Outline

Linguistics 696

• Jurafsky and Martin, 12.0-12.3, for gentle syntax.
• Jurafsky and Martin, 12.4, for gentle treebanks.
• Jurafsky and Martin, 13.0-13.3 for parsing as search

• Eugene Charniak. 1997. Statistical techniques for natural language parsing. AI Magazine. Probability and Statistics in Computational Linguistics, a Brief Review"
• NLTK Penn tree reading function demo

• Jurafsky and Martin, sections 13.4.0-13.4.1 CKY parsing
• Jurafsky and Martin, sections 14.0-14.2, PCFGs and probabilistic CKY parsing

• Demo of CNF grammar converter in THIS tarfile.
• Demo of tree_reader.py, the wrapper around the NLTK bracket corpus reader, provided in THIS tarfile.
• Docs for both packages provided in docs subdirectory available after untarring.

• Dan Klein and Christopher D. Manning. 2001. Empirical Bounds, Theoretical Models.
• Dan Klein and Christopher D. Manning. 2003. Unlexicalized Parsing.
• Dan Klein and Christopher D. Manning. 2003. Fast exact inference with a factored model.

• Unaries and empties. Parser evaluation.
• Notes on PCFG Binarization.

• Parsing evaluation script

• Dan Klein and Christopher D. Manning. 2001. Parsing and Hypergraphs. Proceedings of the 7th International Workshop on Parsing Technologies (IWPT-2001), pp. 123-134.
• Dan Klein and Christopher D. Manning. 2003. A* Parsing: Fast Exact Viterbi Parse Selection. HLT-NAACL 2003.

• Lecture on dependency issues
• Collins head rules
• Parser running script
• Evaluator running script
• Batch script for parsing WSJ section

• Sharon A. Caraballo and Eugene Charniak. 1998. New Figures of Merit for Best-First Probabilistic Chart Parsing. Computational Linguistics 24: 275-298.
• Slav Petrov et al. 2006. Learning Accurate, Compact, and Interpretable Tree Annotation. COLING-ACL 2006.
• Eugene Charniak. 1997. Statistical parsing with a context-free grammar and word statistics. Proceedings of the Fourteenth National Conference on Artificial Intelligence (AAAI 1997).

• Eugene Charniak. 1997. Statistical parsing with a context-free grammar and word statistics. Proceedings of the Fourteenth National Conference on Artificial Intelligence (AAAI 1997).
• Eugene Charniak. 2000. Statistical parsing with a context-free grammar and word statistics. Proceedings of the Fourteenth National Conference on Artificial Intelligence (AAAI 1997).

• Michael Collins. 1997. Three Generative, Lexicalised Models for Statistical Parsing. Proceedings of the 35th Annual Meeting of the ACL, Madrid.
• Michael Collins. 2003. Head-Driven Statistical Models for Natural Language Parsing

• public_head_extractor.py: Specs for head extractor code plus head-driven tree binarizer
• Demo of actual head extraction, head binarizing, and head debinarizing.

• Daniel M. Bikel. 2004. A Distributional Analysis of a Lexicalized Statistical Parsing Model. EMNLP 2004.

• Roger Levy and Christopher D. Manning. 2003. Is it harder to parse Chinese, or the Chinese Treebank?. ACL 2003, pp. 439-446.
• Eisner, Jason and Giorgio Satta (1999). Efficient parsing for bilexical context-free grammars and head automaton grammars. Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics, pages 457-464.

• Steven Abney. 1997. Stochastic Attribute-Value Grammars Computational Linguistics 23.4 597--618.

• Michael Collins. 2004. Parameter Estimation for Statistical Parsing Models: Theory and Practice of Distribution-Free Methods., (ps). In Harry Bunt, John Carroll and Giorgio Satta, editors, New Developments in Parsing Technology, Kluwer.

• Ryan McDonald, Koby Crammer and Fernando Pereira. 2005. Online Large-Margin Training of Dependency Parsers. 43rd Annual Meeting of the Association for Computational Linguistics.
• Eugene Charniak and Mark Johnson. 2005. Coarse-to-Fine n-Best Parsing and MaxEnt Discriminative Reranking 43rd Annual Meeting of the Association for Computational Linguistics.

• Christopher Manning. Probabilistic Syntax.
• Abney (1996).