Add the comment extractor and the language detector of the English-comments check

tools/english_comments.py reads the comments and docstrings of the languages of
ADR-0010 (the scanner of count_loc.py now returns the comment text), joins the
lines of a block, removes everything that is not a word and judges the block
with langid (ADR-0012). It checks the lines a branch adds, or every tracked
file, honours an ignore marker and an allowed-words file, and prints each
finding as an annotation. The rates of the corpus are tests.

Refs #199
Refs #200
Refs #203
Task: MIL-013#3
Task: MIL-013#4

This commit is contained in:

Tirsvad

2026-10-19 12:34:00 +08:00

parent 7d8cc4522e

commit b8e63d0a29

5 changed files with 682 additions and 3 deletions

tests/requirements.txt

View File

@@ -3,3 +3,5 @@ PyYAML>=6,<7
 coverage>=7,<8
 shellcheck-py==0.10.0.1
 shfmt-py==3.11.0.2
 langid==1.1.6
 numpy==2.1.3