CI failures in multiple extensions with captcha related errors
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Jakob_WMDE
	Jun 28 2024, 9:23 AM

Description

Examples:

ApiUsageException: Incorrect or missing CAPTCHA.

captcha-edit-fail

in https://integration.wikimedia.org/ci/job/wmf-quibble-vendor-mysql-php74/9774/console

Details

	Subject	Repo	Branch	Lines +/-
	Reset setForceShowCaptcha to false after test	mediawiki/extensions/AbuseFilter	master	+5 -0

Customize query in gerrit

Related Objects

Mentioned Here: T361190: Split PHPUnit test suite for wmf-quibble-vendor-mysql-php74-docker

Event Timeline

Jakob_WMDE created this task.Jun 28 2024, 9:23 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 28 2024, 9:23 AM

Jakob_WMDE triaged this task as Unbreak Now! priority.Jun 28 2024, 9:24 AM

This looks like it might be related to test ordering. From my experiments locally, extensions/WikibaseLexeme/tests/phpunit/mediawiki/Api/EditFormElementsTest.php passes fine when its run alone, and fails if it's run in a suite with extensions/AbuseFilter/tests/phpunit/integration/Hooks/ConfirmEditHandlerTest.php:

<testsuite name="T368705">
    <file>/workspace/src/extensions/AbuseFilter/tests/phpunit/integration/Hooks/ConfirmEditHandlerTest.php</file>
    <file>/workspace/src/extensions/WikibaseLexeme/tests/phpunit/mediawiki/Api/EditFormElementsTest.php</file>
</testsuite>

results in:

Using PHP 8.1.29
Running with MediaWiki settings because there might be integration tests
PHPUnit 9.6.19 by Sebastian Bergmann and contributors.

...........E.EEEEEEEEEEEEEEEE.EEEEEE.                             37 / 37 (100%)

Time: 00:02.469, Memory: 139.00 MB

There were 23 errors:

1) Wikibase\Lexeme\Tests\MediaWiki\Api\EditFormElementsTest::testGivenOtherRepresentations_changesRepresentationsOfForm
ApiUsageException: Incorrect or missing CAPTCHA.
...

Change #1050574 had a related patch set uploaded (by Jakob; author: Jakob):

[mediawiki/extensions/AbuseFilter@master] Reset setForceShowCaptcha to false after test

https://gerrit.wikimedia.org/r/1050574

gerritbot added a project: Patch-For-Review.Jun 28 2024, 9:57 AM

Tagging T361190 here as this is a failure that was surfaced by parallel testing

matmarex subscribed.Jun 28 2024, 10:55 AM

Change #1050574 merged by jenkins-bot:

[mediawiki/extensions/AbuseFilter@master] Reset setForceShowCaptcha to false after test

https://gerrit.wikimedia.org/r/1050574

ReleaseTaggerBot added a project: MW-1.43-notes (1.43.0-wmf.12; 2024-07-02).Jun 28 2024, 11:00 AM

Maintenance_bot removed a project: Patch-For-Review.Jun 28 2024, 11:30 AM

matmarex edited projects, added ci-test-error (WMF-deployed Build Failure), AbuseFilter, ConfirmEdit (CAPTCHA extension); removed ci-test-error.Jun 28 2024, 12:52 PM