Apache Nutch is an extensible and scalable web crawler
Commits on master
NUTCH-3164 Catch specific exceptions in CrawlDbFilter so plugin errors no longer silently drop URLs
0c4f51d Prakhar Chaube committed 6 months ago
Set up default protection ruleset for default and release branches
0865e1a The Apache Software Foundation committed 6 months ago
NUTCH-3176 URLUtil and urlnormalizer-basic: add support for IDNA2008
84699a6 Sebastian Nagel committed 6 months ago
NUTCH-3176 URLUtil and urlnormalizer-basic: add support for IDNA2008
947cd28 Sebastian Nagel committed 6 months ago
Refactor calls of URLDecoder and pass Charset instead of String (since Java 10)
36cc230 Sebastian Nagel committed 6 months ago
NUTCH-3176 URLUtil and urlnormalizer-basic: add support for IDNA2008
66f55e1 Sebastian Nagel committed 6 months ago
NUTCH-3176 URLUtil and urlnormalizer-basic: add support for IDNA2008
54efa9f Sebastian Nagel committed 6 months ago
NUTCH-3175 Implement integration testing framework for Nutch Protocol plugins using Testcontainers
cbb1d09 lewismc committed 6 months ago
NUTCH-3175 Implement integration testing framework for Nutch Protocol plugins using Testcontainers
9390674 lewismc committed 6 months ago
NUTCH-3163 Integrate Apache Yetus' pre-commit patch testing into Nutch GitHub Continuous Integration (#907)
31c44b2 Lewis John McGibbney committed 7 months ago
parse: fix 'occured' -> 'occurred' typo in ParseStatus FAILED javadoc (#910)
e47cfd5 Sai Asish Y committed 7 months ago
NUTCH-3168 Sandbox Commons JEXL usage in crawl and index pipelines (#909)
df62fa1 Lewis John McGibbney committed 7 months ago
NUTCH-2932 Create OpenAPI specification for Nutch 1.x REST API (#896)
96552ae Lewis John McGibbney committed 7 months ago
NUTCH-3085 Augment CI by adding code coverage and code quality reporting (#902)
eed3445 Lewis John McGibbney committed 8 months ago
NUTCH-3085 Augment CI by adding code coverage and code quality reporting (#901)
f1d3e8a Lewis John McGibbney committed 9 months ago
NUTCH-3085 Augment CI by adding code coverage and code quality reporting (#900)
89e6ec1 Lewis John McGibbney committed 9 months ago
Bump SonarSource/sonarqube-scan-action from 5 to 6 in /.github/workflows (#899)
9f3bb41 dependabot[bot] committed 9 months ago
NUTCH-3085 Augment CI by adding code coverage and code quality reporting (#898)
21fd780 Lewis John McGibbney committed 9 months ago
NUTCH-3085 Augment CI by adding code coverage and code quality reporting (#897)
39cfc61 Lewis John McGibbney committed 9 months ago
NUTCH-3154 Implement integration testing framework for Nutch IndexWriter plugins using Testcontainers (#895)
64ac8b4 Lewis John McGibbney committed 9 months ago
Prepare for new development after release of 1.22 - bump version number -> 1.23-SNAPSHOT - update changelog - update year
674914c Sebastian Nagel committed 9 months ago
NUTCH-3152 Job counters getGroup to use metrics constants
1d25cb8 Sebastian Nagel committed 9 months ago