[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: paragraphs.el: do forward-sentence and friends not work?
From: |
Stefan Monnier |
Subject: |
Re: paragraphs.el: do forward-sentence and friends not work? |
Date: |
Thu, 14 Feb 2008 09:43:58 -0500 |
User-agent: |
Gnus/5.13 (Gnus v5.13) Emacs/23.0.50 (gnu/linux) |
>> Using two spaces after end of sentence enables Emacs to distinguish
>> between periods that end sentences and periods for abbreviations.
>> That is why it should be the default.
> We can improve this to make it work without depending on the double-
> space.
> Sentence tokenization is a known problem. You can throw machine learning
> algorithms at it, but that's not a viable option in our case. However,
> Grefenstette&Tapanainen (1994) examined this in detail for English, using
> the Brown corpus. They basically say that using a small lexicon of common
> abbreviations, they can classify 99.1% of all periods correctly. Even
> without the lexicon, you can achieve 97.7% accuracy (on English) using the
> right regular expressions, and I think this will be similar for other
> languages as well. I think that's good enough for M-e and M-a.
But the period-single-space vs period-double-space distinction allows us
to get it right 100% in many more languages than just English.
Stefan "Who switched to non-French spacing even when writing French"
- paragraphs.el: do forward-sentence and friends not work?, David Reitter, 2008/02/13
- Re: paragraphs.el: do forward-sentence and friends not work?, Andreas Schwab, 2008/02/13
- Re: paragraphs.el: do forward-sentence and friends not work?, David Reitter, 2008/02/13
- Re: paragraphs.el: do forward-sentence and friends not work?, Stephen J. Turnbull, 2008/02/13
- Re: paragraphs.el: do forward-sentence and friends not work?, Richard Stallman, 2008/02/13
- Re: paragraphs.el: do forward-sentence and friends not work?, David Reitter, 2008/02/14
- Re: paragraphs.el: do forward-sentence and friends not work?, Robert J. Chassell, 2008/02/14
- Re: paragraphs.el: do forward-sentence and friends not work?,
Stefan Monnier <=
- Re: paragraphs.el: do forward-sentence and friends not work?, David Reitter, 2008/02/14
- Re: paragraphs.el: do forward-sentence and friends not work?, Miles Bader, 2008/02/14
- Re: paragraphs.el: do forward-sentence and friends not work?, Jonathan Rockway, 2008/02/15
- Re: paragraphs.el: do forward-sentence and friends not work?, Richard Stallman, 2008/02/14
- Re: paragraphs.el: do forward-sentence and friends not work?, David Reitter, 2008/02/14
- Re: paragraphs.el: do forward-sentence and friends not work?, Miles Bader, 2008/02/14
- Re: paragraphs.el: do forward-sentence and friends not work?, David Reitter, 2008/02/14
- Re: paragraphs.el: do forward-sentence and friends not work?, Miles Bader, 2008/02/14
- Re: paragraphs.el: do forward-sentence and friends not work?, Stephen J. Turnbull, 2008/02/14
- Re: paragraphs.el: do forward-sentence and friends not work?, David Reitter, 2008/02/14