Stanford Parser - Factored model and PCFG

581 views Asked by At

What is the difference between the factored and PCFG models of stanford parser? (In terms of theoretical working and mathematical perspective)

1

There are 1 answers

1
Jon Gauthier On BEST ANSWER

This FAQ answer explains the difference in a long paragraph. Relevant parts are quoted below:

Can you explain the different parsers?

This answer is specific to English. It mostly applies to other languages although some components are missing in some languages. The file englishPCFG.ser.gz comprises just an unlexicalized PCFG grammar. It is basically the parser described in the ACL 2003 Accurate Unlexicalized Parsing paper.

… The file englishFactored.ser.gz contains two grammars and leads the system to run three parsers. It first runs a (simpler) PCFG parser and then an untyped dependency parser, and then runs a third parser which finds the parse with the best joint score across the two other parsers via a product model. This is described in the NIPS Fast Exact Inference paper.

… For English, although the grammars and parsing methods differ, the average quality of englishPCFG.ser.gz and englishFactored.ser.gz is similar, and so many people opt for the faster englishPCFG.ser.gz, though englishFactored.ser.gz sometimes does better because it does include lexicalization. For other languages, the factored models are considerably better than the PCFG models, and are what people generally use.

There are links to the papers referenced on the main parser page.