Offline, privacy-first grammar checker. Fast, open-source, Rust-powered
Dictionary curation 2026-09-12 (#4365)
Andrew Dunbar45399b83aba9
diff --git a/harper-core/dictionary.dict b/harper-core/dictionary.dictindex 4f45ee6eb..b1ab79868 100644--- a/harper-core/dictionary.dict+++ b/harper-core/dictionary.dict@@ -1,4 +1,4 @@-54800+54900# Start of original dictionary import# combined with dialect spelling dictionary import.@@ -4997,7 +4997,7 @@ Issachar/OgIstanbul/OgIstanbulite/NgSJIsuzu/ONg # car brand-It/ON+It/ON # abbreviation for Italy/Italian. "biological force", "Id", and "desirable quality" senses too marginalItaipu/OgItal/NItalian/JNwSg@@ -7612,6 +7612,7 @@ OK/NOSg4VdGJ # US state (Oklahoma)OLED/Ng # organic light-emitting diodeOMB/OgOMG # exclamation+OP/Ng # internet slang: original posterOPEC/Og # organizationOR/CNO4 # OregonOR gate/NgS@@ -7936,6 +7937,7 @@ Pansy/OgPantagruel/gPantaloon/gPantheon/Og+Pantone/Og # colour standardPanza/OgParacelsus/OgParaclete/Og@@ -10399,6 +10401,7 @@ UAE/Og # United Arab EmiratesUAR/OUART/NgS # electronicsUAW/O+UBI/Nmg # universal basic incomeUBS/OgUCLA/Og # universityUFC/Og # combat sport promotion@@ -12967,7 +12970,7 @@ application/~NgSrapplicator/NSgapplier/NgSapplique/NSgVd-appliqueing/V+appliqueing/V6apply/~VGdSJrnXappoint/~VSGdrELvappointee/~NSg@@ -13215,7 +13218,7 @@ arsed/VJarsehole/NSg!@₹x_arsenal/~NgSarsenic/~NmgJ-arsing/V+arsing/V6arson/~NmgVarsonist/NSgart/~NwSgV@@ -13821,6 +13824,7 @@ bacillary/Jbacilli/N9bacillus/~N0gback/~J>NSgVGdzZ+backdoor/J # Closed adj. is in MWback door/NgSVGdback off/V/back to back/R@@ -15011,7 +15015,7 @@ blackthorn/NSgblacktop/NSgVblacktopped/VtTblacktopping/V6-bladder/~NgSV+bladder/~NgSblade/~NgSVdblag/NSVJblagged/VtT@@ -15104,7 +15108,7 @@ bliss/~Ngblissful/JYpblissfulness/Ngblister/~NgSVGd-blistering/VJYN+blistering/VJYN6blistery/Jblithe/JY^>pblitheness/Ng@@ -17812,12 +17816,12 @@ civil/~JYUcivilian/~NgSJcivilisation/NSg!_₹civilise/VGdS!_₹-civilised/VJU!_₹+civilised/VJU!_₹tTcivility/~Nmgicivilization/~NOwSgcivilizational/Jcivilize/VGdS-civilized/~JVU+civilized/~JVUtTcivvies/Ngck/~cl/~@@ -19807,6 +19811,8 @@ cpd/~Ncpl/~Ncps/~Ncrab/~NgSV+crab apple/NgS+crabapple/NgScrabbed/JVtTcrabber/NSgcrabbily/Ry@@ -20583,6 +20589,7 @@ dastard/NgSJYVdastardliness/Ngdata/~Nw9gdata center/NgS!@_₹+datacenter/NgS # closed -er spelling is in Collins. 'datacentre' is notdata centre/NgS<data point/NgSdatabase/~NSgV@@ -21545,7 +21552,7 @@ diffusivity/Ndig/~VSNgdigerati/Ngdigest/~VdGSNgv-digested/VU+digested/VtTUdigestibility/Ngdigestible/Jidigestion/~Nw0gi@@ -25957,6 +25964,7 @@ frailness/Nmgfrailty/NSgframe/~Vd>GSNgZframe rate/NgS+framerate/NgS # listed as an 'also' in Cambridge but no other dictionaryframed/~VUframer/Ngframework/~NSg@@ -26576,7 +26584,7 @@ gatepost/NgSgateway/~NgSVgather/~VGd>SNgzZgatherer/~Ng-gathering/~NgV6J+gathering/~NwgSV6Jgator/~NSggauche/J>Y^pgaucheness/Nmg@@ -26694,6 +26702,8 @@ genocidal/~Jgenocide/~NwgSVgenome/~NgSgenomic/~NS+genotype/NgS+genotyping/Nwggenre/~NSgVgent/~NgSJrgenteel/JYp@@ -27535,6 +27545,8 @@ gross/~J^Y>pNgSVGdgrossness/Nmggrotesque/~JYpNSggrotesqueness/Ng+grotesquerie/NgS+grotesquery/NgSgrotto/~N0ggrottoes/N9grotty/J^>@@ -29214,7 +29226,7 @@ hull/~NgSVd>GZhullabaloo/NSgVhuller/Nghum/~NSgV-human/~JY^>pNSgV+human/~JY^>pNSghumane/~JYphumaneness/Nmghumanhood/Nmg@@ -30264,7 +30276,7 @@ infectious/~JYpinfectiousness/Nmginfelicitous/Jinfer/VdSG-inference/~NSg+inference/~NwSginferencing/Nmginferential/Jinferior/~JNgS@@ -34753,10 +34765,13 @@ misogynist/NSgJmisogynistic/Jmisogynous/Jmisogyny/Nmg+misophonia/Nmg+misophonic/Jmisperceive/VGdSmisplace/VGdSLmisplacement/Nmgmisplay/VGdSNg+misprice/VGdSmisprint/NgSVGdmisprision/Ngmispronounce/VdSG@@ -35943,6 +35958,7 @@ neoliberal/JNSgneoliberalism/Nmgneolithic/~Jneologism/~NwSg+neologistic/Jneon/~NmgJneonatal/~Jneonate/NgS@@ -36702,7 +36718,7 @@ nucleoli/N9nucleolus/Ngnucleon/NSgnucleoside/N-nucleotide/~N+nucleotide/~NgSnucleus/~N0gnude/~J^>NgSnudge/NSgVGd@@ -37324,6 +37340,7 @@ orbital/~JNSgorbiter/~NgSorc/NSgorchard/~NSg+orchardist/NSgorchestra/~NgSorchestral/~JNorchestrate/VdSGXn@@ -37782,7 +37799,7 @@ overindulgent/Joverinflate/VSdGoverinvest/VGdSLoverjoy/VGdSN-overkill/~NgV+overkill/~NmgVoverladen/JVoverlaid/~Voverlain/V@@ -39735,6 +39752,8 @@ playpen/NSgplayroom/NSgplayschool/NSplaything/NSgJ+playthrough/gN0+playthroughs/N9playtime/Ngplaywright/~NSgplaza/~NgS@@ -40016,7 +40035,7 @@ polymerise/VGdS!_₹polymerization/~Nmgpolymerize/VGdSpolymorphic/J-polymorphism/Nmg+polymorphism/NmgSpolymorphous/Jpolynomial/~NgSJpolyp/NgS@@ -40044,6 +40063,8 @@ pommel/~NSgVGdpommelled/VtTJ!@_₹pommelling/V6!@_₹pommy/NSJ+pomological/J+pomology/Ngwpomp/NgVpompadour/NSgVdpompano/NgS@@ -41119,6 +41140,7 @@ proven/~JVTUEprovenance/~NSgVprovender/NgVprovenience/Ng+prover/NgSproverbial/JYNprovide/~Vd>SGZprovided/~CVtTU@@ -42421,7 +42443,7 @@ regicidal/Jregicide/~NwgSregime/~NSgregimen/~NSg-regiment/~NgSVdG+regiment/~NgSVdGQregimental/~Jregimentation/Nmgregion/~NSg@@ -42474,6 +42496,8 @@ rehearsed/~VtTJUrehi/rehome/VdSGrehung/V+reidentify/VdSG+reidentification/Nmgreify/VdSGnreign/~NgSVdGreimagine/VSdG@@ -43585,6 +43609,7 @@ rusher/Ngrushy/Jrusk/~NgSrusset/NSgJV+russeting/Nwgrust/~NmgSVdGrustic/~JNSgQrusticate/VGdS@@ -48276,11 +48301,13 @@ surrey/~NgSsurrogacy/Ngsurrogate/~NSgJVsurround/~VGdSNz-surrounding/~VNg-surroundings/~Ng+surrounding/~VNg6+surroundings/~N9gsurtax/NgSVdGsurtitle/NSV-surveil/VGdS+surveil/VS+surveilled/VtT+surveilling/V6surveillance/~Ngsurvey/~NSVdGrsurvey's@@ -50385,8 +50412,8 @@ triad/~NSgtriage/NmgVdtriager/NSgtrial/~NSgJVr-trialed/V-trialing/VN+trialed/VtT+trialing/VN6trialled/VtT!@_₹trialling/V6N!@_₹triangle/~NSg@@ -50446,6 +50473,7 @@ trigonometry/~Ngtrike/NSgVtrilateral/~JStrilby/NSg+trilemma/NSgtrill/NSgVGdJtrillion/~NSgHtrillionaire/NSg@@ -50597,6 +50625,7 @@ truncheon/NSgVtrundle/NgSVGd>Ztrundler/Ngtrunk/~NSgVG+trunked/Jtruss/~NgSVGdtrust/~Nw☁SgVGdJEtrustee/~NgSV@@ -51304,6 +51333,7 @@ unicameral/~Junicellular/JNunicorn/~NSgVJunicycle/NSgV+unicyclist/NgSunidirectional/JNunification/~NwSgrunifier/NgS@@ -51436,6 +51466,7 @@ unread/JVNBunready/Junreal/~Junreasoning/J+unreciprocated/Junreflectively/Ryunregenerate/Junrelated/~J@@ -52583,7 +52614,7 @@ warmheartedness/Ngwarmish/Jwarmness/Nmgwarmonger/NSgVG-warmongering/VNg+warmongering/VNg6warmth/~Nmgwarn/~VdGSzwarning/~V6SNwg@@ -54542,6 +54573,7 @@ Zuckerberg/OgS # surname, Facebook foundera11n/Na12s/9a8c/Sg+abliterate/VSdGn # AI: remove safety refusalsaftertouch/Nmg # MIDI featureambitransitive/J # verb which is both transitive and intransitiveanalyte/NgS@@ -54575,6 +54607,7 @@ corpo/NgScronjob/NgSdatagram/NgSdatetime/NgS+debloat/VSdGdecomp/NgSVdG # decompile/decompilationdedup/Ng # not well covered by dictionaries. wiktionary has only singular noun. cf. dedupededupe/NSgVdG # not well covered by dictionaries. wiktionary has noun and verb. cf. dedup@@ -54613,6 +54646,7 @@ gzipping/V6hardcode/VGdS # dictionaries prefer: hard codehashmap/NgS # data structureheapsort+here're/hoster/NgShostname/NSghotwire/VGB # dictionaries prefer: hot-wire@@ -54662,6 +54696,7 @@ pdfTeX/Og # Program, extension for TeX enginepentest/VSdGpentester/NSg # penetration testerpentesting/NmgV6+permalink/NgSplist/NgS # Apple property listpolysyntheses/N9 # linguisticspolysynthesis/Nw0g # linguistics@@ -54709,6 +54744,7 @@ synchronic/JQ # linguisticssystemd/Og # Linux softwaretagset/NgSterraform/VGdS+there're/timespan/NgStmux/Og # terminal multiplexer, uncapitalized proper nountrie/NgS # data structure@@ -54793,5 +54829,4 @@ vicontiel/J # As above, alternative versionviscomital/J # As above, alternative versionWordCamp/Ogworldbuild/V>G-playthrough/gNScutscene/gNSdiff --git a/harper-core/src/linting/pronoun_verb_agreement.rs b/harper-core/src/linting/pronoun_verb_agreement.rsindex b6c6931d2..8bb8f50a3 100644--- a/harper-core/src/linting/pronoun_verb_agreement.rs+++ b/harper-core/src/linting/pronoun_verb_agreement.rs@@ -545,4 +545,9 @@ mod lints {test_linter(),);}++ #[test]+ fn dont_flag_4388() {+ assert_no_lints("We humans are naturally curious.", test_linter());+ }}diff --git a/harper-core/tests/text/linters/The Great Gatsby.snap.yml b/harper-core/tests/text/linters/The Great Gatsby.snap.ymlindex 129ae7e70..c2c3f4f5d 100644--- a/harper-core/tests/text/linters/The Great Gatsby.snap.yml+++ b/harper-core/tests/text/linters/The Great Gatsby.snap.yml@@ -5391,17 +5391,6 @@ Suggest:-Lint: Spelling (63 priority)-Message: |- 4265 | Why—there’re things between Daisy and me that you’ll never know, things that- | ^~~~~~~~ Did you mean to spell `there’re` this way?-Suggest:- - Replace with: “there's”- - Replace with: “there'd”- - Replace with: “there'll”---Lint: Spelling (63 priority)Message: |4300 | “Who are you, anyhow?” broke out Tom. “You’re one of that bunch that hangsdiff --git a/harper-core/tests/text/tagged/Computer science.md b/harper-core/tests/text/tagged/Computer science.mdindex 34a641ffa..c5d140cda 100644--- a/harper-core/tests/text/tagged/Computer science.md+++ b/harper-core/tests/text/tagged/Computer science.md@@ -34,10 +34,10 @@# D NSg P NPl/V3+ . Nᴹ/Vg/J+ N🅪Sg+ N🅪Sg+ V3 NSg/J NPl+> to describe computational processes , and database theory concerns the management# P VB J+ NPl/V3+ . VB/C NSg/VB+ N🅪Sg+ NPl/V3+ D N🅪Sg-> of repositories of data . Human – computer interaction investigates the interfaces-# P NPl P N🅪Pl+ . NSg/VB/J . NSg+ N🅪Sg+ V3 D+ NPl/V3++> of repositories of data . Human – computer interaction investigates the interfaces+# P NPl P N🅪Pl+ . NSg/J . NSg+ N🅪Sg+ V3 D+ NPl/V3+> through which humans and computers interact , and software engineering focuses on-# J/P I/C+ NPl/V3 VB/C NPl+ NSg/VB . VB/C Nᴹ+ Nᴹ/Vg/J+ NPl/V3 J/P+# J/P I/C+ NPl VB/C NPl+ NSg/VB . VB/C Nᴹ+ Nᴹ/Vg/J+ NPl/V3 J/P> the design and principles behind developing software . Areas such as operating# D N🅪Sg/VB+ VB/C NPl/V3+ NSg/J/P Nᴹ/Vg/J Nᴹ+ . NPl+ NSg/I R/C/P Nᴹ/Vg/J> systems , networks and embedded systems investigate the principles and design@@ -51,7 +51,7 @@> problem - solving , decision - making , environmental adaptation , planning and# NSg/J+ . Nᴹ/Vg/J . NSg/VB+ . Nᴹ/Vg/J . NSg/J NSg+ . NSg/Vg VB/C> learning found in humans and animals . Within artificial intelligence , computer-# Nᴹ/Vg/J+ NSg/VP NPr/J/R/P NPl/V3 VB/C NPl+ . NSg/J/P J+ N🅪Sg+ . NSg++# Nᴹ/Vg/J+ NSg/VP NPr/J/R/P NPl VB/C NPl+ . NSg/J/P J+ N🅪Sg+ . NSg+> vision aims to understand and process image and video data , while natural# N🅪Sg/VB+ NPl/V3 P VB VB/C NSg/VB+ N🅪Sg/VB VB/C N🅪Sg/VB+ N🅪Pl+ . NSg/VB/C/P NSg/J+> language processing aims to understand and process textual and linguistic data .@@ -162,8 +162,8 @@# VB/P D+ #d . P D N🅪Sg P NSg/J VB/C NPr/I/J/R/Dq J Nᴹ/Vg/J+> machines such as the Atanasoff – Berry computer and ENIAC , the term computer came# NPl/V3 NSg/I R/C/P D ? . NPr🅪Sg/VB+ NSg+ VB/C ? . D NSg/VB/J+ NSg+ NSg/VPt/P-> to refer to the machines rather than their human predecessors . As it became-# P NSg/VB P D NPl/V3+ NPr/R C/P D$+ NSg/VB/J NPl+ . R/C/P NPr/ISg+ VPt+> to refer to the machines rather than their human predecessors . As it became+# P NSg/VB P D NPl/V3+ NPr/R C/P D$+ NSg/J NPl+ . R/C/P NPr/ISg+ VPt> clear that computers could be used for more than just mathematical calculations ,# NSg/VB/J I/C/Ddem NPl+ VXB NSg/VLXB VP/J R/C/P NPr/I/J/R/Dq C/P J/R J+ + .> the field of computer science broadened to study computation in general . In@@ -444,8 +444,8 @@# J N🅪Sg+ . . NSg+ N🅪Sg/VB+ NPl/V3 J/P NPl+ VP/J NPr/J/R/P> design , specification , programming , verification , implementation and testing of# N🅪Sg/VB+ . NSg+ . Nᴹ/Vg/J . N🅪Sg+ . N🅪Sg VB/C Nᴹ/Vg/J P-> human - made computing systems .-# NSg/VB/J . VP Nᴹ/Vg/J+ NPl+ .+> human - made computing systems .+# NSg/J . VP Nᴹ/Vg/J+ NPl+ .>#> Fields@@ -472,8 +472,8 @@# NPr/J/R/P NSg+ P I/Ddem+ NSg+ NPl+ . ? R/C V3 NPrPl/V3+ NSg/I R/C/P Nᴹ+> engineering , artificial intelligence , computer networking and communication ,# Nᴹ/Vg/J+ . J N🅪Sg+ . NSg+ Nᴹ/Vg/J VB/C N🅪Sg+ .-> database systems , parallel computation , distributed computation , human – computer-# NSg/VB+ NPl+ . NSg/VB/J NSg . VP/J NSg . NSg/VB/J . NSg++> database systems , parallel computation , distributed computation , human – computer+# NSg/VB+ NPl+ . NSg/VB/J NSg . VP/J NSg . NSg/J . NSg+> interaction , computer graphics , operating systems , and numerical and symbolic# N🅪Sg+ . NSg+ NSgPl+ . Nᴹ/Vg/J NPl+ . VB/C J VB/C J> computation as being important areas of computer science .@@ -682,16 +682,16 @@# NPl/V3 .>#-> Human – computer interaction-# HeadingStart NSg/VB/J . NSg+ N🅪Sg++> Human – computer interaction+# HeadingStart NSg/J . NSg+ N🅪Sg+>#-> Human – computer interaction ( HCI ) is the field of study and research concerned-# NSg/VB/J . NSg+ N🅪Sg+ . ? . VL3 D NSg/VB P NSg/VB VB/C Nᴹ/VB+ VP/J+> Human – computer interaction ( HCI ) is the field of study and research concerned+# NSg/J . NSg+ N🅪Sg+ . ? . VL3 D NSg/VB P NSg/VB VB/C Nᴹ/VB+ VP/J> with the design and use of computer systems , mainly based on the analysis of the# P D N🅪Sg/VB+ VB/C N🅪Sg/VB P NSg+ NPl+ . R VP/J J/P D N🅪Sg P D> interaction between humans and computer interfaces . HCI has several subfields-# N🅪Sg NSg/P NPl/V3 VB/C NSg+ NPl/V3+ . ? V3 J/Dq NPl+# N🅪Sg NSg/P NPl VB/C NSg+ NPl/V3+ . ? V3 J/Dq NPl> that focus on the relationship between emotions , social behavior and brain# I/C/Ddem N🅪Sg/VB+ J/P D NSg NSg/P NPl+ . NSg/J N🅪Sg/Am VB/C NPr🅪Sg/VB+> activity with computers .@@ -729,7 +729,7 @@> goal - orientated processes such as problem - solving , decision - making ,# NSg/VB+ . VP/J NPl/V3 NSg/I R/C/P NSg/J+ . Nᴹ/Vg/J . NSg/VB+ . Nᴹ/Vg/J .> environmental adaptation , learning , and communication found in humans and-# NSg/J NSg+ . Nᴹ/Vg/J+ . VB/C N🅪Sg+ NSg/VP NPr/J/R/P NPl/V3 VB/C+# NSg/J NSg+ . Nᴹ/Vg/J+ . VB/C N🅪Sg+ NSg/VP NPr/J/R/P NPl VB/C> animals . From its origins in cybernetics and in the Dartmouth Conference ( 1956 ) ,# NPl+ . P ISg/D$+ NPl+ NPr/J/R/P Nᴹ VB/C NPr/J/R/P D NPr+ NSg/VB+ . # . .> artificial intelligence research has been necessarily cross - disciplinary ,@@ -750,10 +750,10 @@# . NPr/VXB NPl+ NSg/VB . . . VB/C D+ NSg/VB+ NPl/V3 R J .> although the Turing test is still used to assess computer output on the scale of# C D NPr NSg/VB+ VL3 NSg/VB/J/R VP/J P VB NSg+ N🅪Sg/VBP+ J/P D N🅪Sg/VB P-> human intelligence . But the automation of evaluative and predictive tasks has-# NSg/VB/J N🅪Sg+ . NSg/C/P D N🅪Sg P J VB/C J NPl/V3+ V3-> been increasingly successful as a substitute for human monitoring and-# VLPp/B R J R/C/P D/P NSg/VB+ R/C/P NSg/VB/J Nᴹ/Vg/J VB/C+> human intelligence . But the automation of evaluative and predictive tasks has+# NSg/J N🅪Sg+ . NSg/C/P D N🅪Sg P J VB/C J NPl/V3+ V3+> been increasingly successful as a substitute for human monitoring and+# VLPp/B R J R/C/P D/P NSg/VB+ R/C/P NSg/J Nᴹ/Vg/J VB/C> intervention in domains of computer application involving complex real - world# NSg+ NPr/J/R/P NPl P NSg+ NSg+ Nᴹ/Vg/J NSg/VB/J NSg/J . NSg/VB+> data .diff --git a/harper-core/tests/text/tagged/Difficult sentences.md b/harper-core/tests/text/tagged/Difficult sentences.mdindex b746bf2e3..989ca3f42 100644--- a/harper-core/tests/text/tagged/Difficult sentences.md+++ b/harper-core/tests/text/tagged/Difficult sentences.md@@ -542,8 +542,8 @@# NPr/ISg+ V3 VLPp/B NSg/VB/J/R P NSg/J .> Finally she was relieved of the burden of caring for her sick husband .# R ISg+ VLPt VP/J P D NSg/VB P Nᴹ/Vg/J R/C/P ISg/D$+ NSg/VB/J+ NSg/VB+ .-> He seemed devoid of human feelings .-# NPr/ISg+ VP/J VB/J P NSg/VB/J+ NPl/V3+ .+> He seemed devoid of human feelings .+# NPr/ISg+ VP/J VB/J P NSg/J+ NPl/V3+ .> The word is believed to be of Japanese origin .# D+ NSg/VB+ VL3 VP/J P NSg/VLXB P NPr🅪Sg/J+ NSg+ .> Jesus of Nazareth@@ -790,8 +790,8 @@# NPr/ISg+ VP/J NPr/ISg+ NSg/I+ P VXB .> I have places to go and people to see .# ISg/#r+ NSg/VXB NPl/V3+ P NSg/VB/J VB/C NPl/VB+ P NSg/VB .-> To err is human .-# P VB VL3 NSg/VB/J .+> To err is human .+# P VB VL3 NSg/J .> Who am I to criticise ? I've done worse things myself .# NPr/I+ NPr/VLB/J ISg/#r+ P VB/Au/Br . K NSg/VPp/J NSg/VB/JC+ NPl+ ISg+ .> Precisely to get away from you was why I did what I did .diff --git a/harper-core/tests/text/tagged/Part-of-speech tagging.md b/harper-core/tests/text/tagged/Part-of-speech tagging.mdindex 8ca659f43..8dc7f199d 100644--- a/harper-core/tests/text/tagged/Part-of-speech tagging.md+++ b/harper-core/tests/text/tagged/Part-of-speech tagging.md@@ -193,7 +193,7 @@> and corrected by hand , and later users sent in errata so that by the late 70 s# VB/C VP/J P NSg/VB+ . VB/C JC NPl+ NSg/VP NPr/J/R/P NSg NSg/I/J/R/C I/C/Ddem+ P D NSg/J # ?> the tagging was nearly perfect ( allowing for some cases on which even human-# D NSg/Vg VLPt R NSg/VB/J . Nᴹ/Vg/J R/C/P I/J/R/Dq NPl/V3+ J/P I/C+ NSg/VB/J/R NSg/VB/J++# D NSg/Vg VLPt R NSg/VB/J . Nᴹ/Vg/J R/C/P I/J/R/Dq NPl/V3+ J/P I/C+ NSg/VB/J/R NSg/J+> speakers might not agree ) .# + Nᴹ/VXB/J NSg/R/C VB . .>@@ -303,7 +303,7 @@> HMMs underlie the functioning of stochastic taggers and are used in various# ? VB D Nᴹ/Vg/J+ P J NPl VB/C VLB VP/J NPr/J/R/P J> algorithms one of the most widely used being the bi - directional inference-# NPl+ NSg/I/J P D NSg/I/J/R/Dq R VP/J N🅪Sg/VLg/J/C D NSg/J . NSg/J NSg++# NPl+ NSg/I/J P D NSg/I/J/R/Dq R VP/J N🅪Sg/VLg/J/C D NSg/J . NSg/J N🅪Sg+> algorithm .# NSg .>@@ -378,8 +378,8 @@# NSg/J+ NPl/V3+ . NSg/VB/C/P . VB . V3 NPr/J/R/P J/R NSg/J+ NPl+ . P J> iteration , similarity classes of words emerge that are remarkably similar to# N🅪Sg . NSg NPl/V3 P NPl/V3+ NSg/VB I/C/Ddem+ VLB R NSg/J P-> those human linguists would expect ; and the differences themselves sometimes-# I/Ddem NSg/VB/J NPl+ VXB VB . VB/C D NPl/VB+ IPl+ R+> those human linguists would expect ; and the differences themselves sometimes+# I/Ddem NSg/J NPl+ VXB VB . VB/C D NPl/VB+ IPl+ R> suggest valuable new insights .# VB NSg/J NSg/J NPl+ .>diff --git a/harper-core/tests/text/tagged/The Great Gatsby.md b/harper-core/tests/text/tagged/The Great Gatsby.mdindex 15870c10e..4619cf412 100644--- a/harper-core/tests/text/tagged/The Great Gatsby.md+++ b/harper-core/tests/text/tagged/The Great Gatsby.md@@ -66,8 +66,8 @@# D+ NPr/J+ NSg/VB/J+ NPr🅪Sg/VB+ ISg/#r+ N🅪Sg/VP/J I/C/Ddem ISg/#r+ VP/J D+ NSg/VB+ P NSg/VLXB NPr/J/R/P NSg/VB/J VB/C NSg/P D/P> sort of moral attention forever ; I wanted no more riotous excursions with# NSg/VB P NSg/VB/J+ NSg+ NSg/J . ISg/#r+ VP/J NSg/Dq/P NPr/I/J/R/Dq J NPl/V3 P-> privileged glimpses into the human heart . Only Gatsby , the man who gives his-# VP/J NPl/V3+ P D NSg/VB/J N🅪Sg/VB+ . J/R/C NPr . D NPr/VB+ NPr/I+ NPl/V3 ISg/D$++> privileged glimpses into the human heart . Only Gatsby , the man who gives his+# VP/J NPl/V3+ P D NSg/J N🅪Sg/VB+ . J/R/C NPr . D NPr/VB+ NPr/I+ NPl/V3 ISg/D$+> name to this book , was exempt from my reaction — Gatsby , who represented# NSg/VB+ P I/Ddem NSg/VB+ . VLPt NSg/VB/J P D$+ N🅪Sg/VB/J+ . NPr . NPr/I+ VP/J> everything for which I have an unaffected scorn . If personality is an unbroken@@ -721,7 +721,7 @@>#> “ You make me feel uncivilized , Daisy , ” I confessed on my second glass of corky-# . ISgPl+ NSg/VB NPr/ISg+ NSg/I/VB VB/J . NPr+ . . ISg/#r+ VP/J J/P D$+ NSg/VB/J NPr🅪Sg/VB+ P J+# . ISgPl+ NSg/VB NPr/ISg+ NSg/I/VB VP/J . NPr+ . . ISg/#r+ VP/J J/P D$+ NSg/VB/J NPr🅪Sg/VB+ P J> but rather impressive claret . “ Can’t you talk about crops or something ? ”# NSg/C/P NPr/R J Nᴹ/VB/J . . VXB ISgPl+ N🅪Sg/VB J/P NPl/V3+ NPr/C NSg/I/J+ . .>@@ -2160,8 +2160,8 @@# I/J/R/Dq NSg/VB/J . NSg/J N🅪Sg/VB+ I/C+ VP/J NPr/ISg+ NSg/VB/J . R/C/P NSg/C P NPl/V3 . P D$+> chair . Yet high over the city our line of yellow windows must have contributed# NSg/VB+ . NSg/VB/C NSg/VB/J/R NSg/J/P D+ NSg+ D$+ NSg/VB P NSg/VB/J+ NPrPl/V3+ NSg/VXB NSg/VXB VP/J-> their share of human secrecy to the casual watcher in the darkening streets , and-# D$+ NSg/VB P NSg/VB/J Nᴹ P D NSg/J NSg+ NPr/J/R/P D Nᴹ/Vg/J NPl/V3+ . VB/C+> their share of human secrecy to the casual watcher in the darkening streets , and+# D$+ NSg/VB P NSg/J Nᴹ P D NSg/J NSg+ NPr/J/R/P D Nᴹ/Vg/J NPl/V3+ . VB/C> I saw him too , looking up and wondering . I was within and without ,# ISg/#r+ NSg/VPt ISg+ R . Nᴹ/Vg/J NSg/VB/J/P VB/C Nᴹ/Vg/J . ISg/#r+ VLPt NSg/J/P VB/C C/P .> simultaneously enchanted and repelled by the inexhaustible variety of life .@@ -4416,8 +4416,8 @@# NSg/J NPl/V3 P NPr🅪Sg/J+ .>#-> “ Finest specimens of human molars , ” he informed me .-# . JS NPl P NSg/VB/J NPl . . NPr/ISg+ VP/J NPr/ISg+ .+> “ Finest specimens of human molars , ” he informed me .+# . JS NPl P NSg/J NPl . . NPr/ISg+ VP/J NPr/ISg+ .>#> “ Well ! ” I inspected them . “ That’s a very interesting idea . ”@@ -5952,8 +5952,8 @@# NSg/I/J/C/Dq+ D+ NPl/V3+ VLPt Nᴹ/Vg/J J/P NPr/J/R/P NPr/VB/J+ N🅪Sg/VB+ NSg/J/R/C . D NSg/J NPl/V3 . NPl+ . Nᴹ/Vg/J .> were plunging home through the rain from New York . It was the hour of a profound# VLPt Nᴹ/Vg/J NSg/VB/J+ J/P D N🅪Sg/VB+ P NSg/J NPr+ . NPr/ISg+ VLPt D NSg P D/P+ NSg/VB/J+-> human change , and excitement was generating on the air .-# NSg/VB/J+ N🅪Sg/VB+ . VB/C NSg+ VLPt Nᴹ/Vg/J J/P D+ N🅪Sg/VB+ .+> human change , and excitement was generating on the air .+# NSg/J+ N🅪Sg/VB+ . VB/C NSg+ VLPt Nᴹ/Vg/J J/P D+ N🅪Sg/VB+ .>#> “ One thing’s sure and nothing’s surer The rich get richer and the poor@@ -6522,8 +6522,8 @@# VB D/P N🅪Sg/VB+ R . .>#-> “ Perhaps you know that lady , ” Gatsby indicated a gorgeous , scarcely human orchid-# . NSg/R ISgPl+ VB I/C/Ddem+ NPr/VB+ . . NPr VP/J D/P J . R NSg/VB/J NSg/J+> “ Perhaps you know that lady , ” Gatsby indicated a gorgeous , scarcely human orchid+# . NSg/R ISgPl+ VB I/C/Ddem+ NPr/VB+ . . NPr VP/J D/P J . R NSg/J NSg/J> of a woman who sat in state under a white - plum tree . Tom and Daisy stared , with# P D/P NSg/VB+ NPr/I+ NSg/VP NPr/J/R/P N🅪Sg/VB+ NSg/J/P D/P NPr🅪Sg/VB/J . N🅪Sg/VB/J+ NSg/VB+ . NPr/VB VB/C NPr+ VP/J . P> that peculiarly unreal feeling that accompanies the recognition of a hitherto@@ -6781,7 +6781,7 @@> When the melody rose her voice broke up sweetly , following it , in a way# NSg/I/C D NPr🅪Sg NPr/VPt/J ISg/D$+ NSg/VB+ NSg/VPt/J NSg/VB/J/P R . N🅪Sg/Vg/J/P NPr/ISg+ . NPr/J/R/P D/P NSg/J+> contralto voices have , and each change tipped out a little of her warm human-# NSg NPl/V3+ NSg/VXB . VB/C Dq N🅪Sg/VB+ VP NSg/VB/J/R/P D/P NPr/I/J/Dq P ISg/D$+ NSg/VB/J NSg/VB/J+# NSg NPl/V3+ NSg/VXB . VB/C Dq N🅪Sg/VB+ VP NSg/VB/J/R/P D/P NPr/I/J/Dq P ISg/D$+ NSg/VB/J NSg/J> magic upon the air .# N🅪Sg/VB/J+ P D N🅪Sg/VB+ .>@@ -8527,7 +8527,7 @@> “ Even that’s a lie , ” said Tom savagely . “ She didn’t know you were alive .# . NSg/VB/J/R K D/P+ NPr/VB+ . . VP/J NPr/VB+ R . . ISg+ VXPt VB ISgPl+ VLPt J .> Why — there’re things between Daisy and me that you’ll never know , things that-# NSg/VB . ? NPl+ NSg/P NPr+ VB/C NPr/ISg+ I/C/Ddem+ K R VB . NPl+ I/C/Ddem++# NSg/VB . K NPl+ NSg/P NPr+ VB/C NPr/ISg+ I/C/Ddem+ K R VB . NPl+ I/C/Ddem+> neither of us can ever forget . ”# I/C P NPr/IPl+ NPr/VXB J/R VB . .>@@ -8756,8 +8756,8 @@# NSg/VB+ . NPr/VB+ VP/J R . Nᴹ/Vg/J VB/C Nᴹ/Vg/J . NSg/C/P ISg/D$+ NSg/VB+ VLPt R/C/P> remote from Jordan and me as the foreign clamor on the sidewalk or the tumult of# NSg/VB/J P NPr+ VB/C NPr/ISg+ R/C/P D NSg/J NSg/VB J/P D NSg+ NPr/C D NSg/VB P-> the elevated overhead . Human sympathy has its limits , and we were content to let-# D VP/J NSg/J/P+ . NSg/VB/J+ NSg+ V3 ISg/D$+ NPl/V3+ . VB/C IPl+ VLPt N🅪Sg/VB/J P NSg/VBP+> the elevated overhead . Human sympathy has its limits , and we were content to let+# D VP/J NSg/J/P+ . NSg/J+ NSg+ V3 ISg/D$+ NPl/V3+ . VB/C IPl+ VLPt N🅪Sg/VB/J P NSg/VBP> all their tragic arguments fade with the city lights behind . Thirty — the promise# NSg/I/J/C/Dq+ D$+ NSg/J+ NPl/V3+ NSg/VB/J P D+ NSg+ NPl/V3+ NSg/J/P . NSg . D NSg/VB> of a decade of loneliness , a thinning list of single men to know , a thinning@@ -8847,7 +8847,7 @@> The “ death car ” as the newspapers called it , didn’t stop ; it came out of the# D . NPr🅪Sg+ NSg+ . R/C/P D+ NPl/V3+ VP/J NPr/ISg+ . VXPt NSg/VB . NPr/ISg+ NSg/VPt/P NSg/VB/J/R/P P D> gathering darkness , wavered tragically for a moment , and then disappeared around-# Nᴹ/Vg/J Nᴹ+ . VP/J R R/C/P D/P NSg+ . VB/C NSg/J/R/C VP/J J/P+# N🅪Sg/Vg/J Nᴹ+ . VP/J R R/C/P D/P NSg+ . VB/C NSg/J/R/C VP/J J/P> the next bend . Mavromichaelis wasn’t even sure of its color — he told the first# D NSg/J/P NPr/VB+ . ? VPt NSg/VB/J/R J P ISg/D$+ N🅪Sg/VB/J/Am+ . NPr/ISg+ VP D NSg/J> policeman that it was light green . The other car , the one going toward New York ,@@ -9155,7 +9155,7 @@> Self - consciously , with his authoritative arms breaking the way , we pushed# NSg/I/VB/J+ . R . P ISg/D$+ J+ NPl/V3+ Nᴹ/Vg/J D+ NSg/J+ . IPl+ VP/J> through the still gathering crowd , passing a hurried doctor , case in hand , who-# J/P D NSg/VB/J/R Nᴹ/Vg/J NSg/VB+ . Nᴹ/Vg/J D/P VP/J NSg/VB . NPr🅪Sg/VB+ NPr/J/R/P NSg/VB+ . NPr/I++# J/P D NSg/VB/J/R N🅪Sg/Vg/J NSg/VB+ . Nᴹ/Vg/J D/P VP/J NSg/VB . NPr🅪Sg/VB+ NPr/J/R/P NSg/VB+ . NPr/I+> had been sent for in wild hope half an hour ago .# VP VLPp/B NSg/VP R/C/P NPr/J/R/P NSg/VB/J NPr🅪Sg/VB N🅪Sg/J/P+ D/P+ NSg+ J/P .>@@ -11626,8 +11626,8 @@# NPr🅪Sg/VB/J NSg/VB P D NSg/J NSg/VB+ . ISg/D$+ VP/J NPl/V3+ . D+ NPl/V3+ I/C/Ddem+ VP VP NSg/J> for Gatsby’s house , had once pandered in whispers to the last and greatest of# R/C/P NPr$ NPr/VB+ . VP NSg/C VP/J NPr/J/R/P NPl/V3 P D NSg/VB/J VB/C JS P-> all human dreams ; for a transitory enchanted moment man must have held his-# NSg/I/J/C/Dq NSg/VB/J NPl/V3+ . R/C/P D/P J VP/J NSg+ NPr/VB+ NSg/VXB NSg/VXB VP ISg/D$++> all human dreams ; for a transitory enchanted moment man must have held his+# NSg/I/J/C/Dq NSg/J NPl/V3+ . R/C/P D/P J VP/J NSg+ NPr/VB+ NSg/VXB NSg/VXB VP ISg/D$+> breath in the presence of this continent , compelled into an esthetic# N🅪Sg/VB/J+ NPr/J/R/P D N🅪Sg/VB P I/Ddem NPr/J+ . VP/J P D/P ?> contemplation he neither understood nor desired , face to face for the last time