Filter
Open, MediumPublicBUG REPORT
Actions

Assigned To

Authored By

	99of9
	Feb 27 2024, 2:52 AM

Description

Steps to replicate the issue (include links if applicable):

Go to https://www.wikifunctions.org/view/en/Z13453, and note that the test fails, even though it should pass.

What happens?:
Built-in implementation of Filter

list with two matches

Error summary:
[Z564/Invalid executor response]
Expected result: ["Z1","HELLO","TODAY"]
Actual result: {"Z1K1":"Z5","Z5K1":"Z564","Z5K2":{"Z1K1":{"Z1K1":"Z7","Z7K1":"Z885","Z885K1":"Z564"},"Z564K1":""}}
Implementation type: BuiltIn
Implementation ID: Z972
Orchestration start time: 3 minutes ago
Orchestration end time: 3 minutes ago
Orchestration duration: 6221 ms
Orchestration CPU usage: 471.603 ms
Orchestration memory usage: 159.5 MiB
Orchestration server: function-orchestrator-main-orchestrator-c549965df-zgrns
Evaluation start time: 3 minutes ago
Evaluation end time: 3 minutes ago
Evaluation duration: 2483 ms
Evaluation CPU usage: 22.762 ms
Evaluation memory usage: 91.81 MiB
Evaluation server: function-evaluator-python-evaluator-6d6db948b7-bzwgk
Execution CPU usage: <50 μs
Execution memory usage: 0.51 MiB
Programming language version: RustPython 0.3.0

What should have happened instead?:
The test should pass

Other information (browser name/version, screenshots, etc.):
Please don't change the title or otherwise edit this test until the bug is tracked down. This kind of error seems to be very fragile, and sometimes if I change the test strings it passes.

Event Timeline

99of9 created this task.Feb 27 2024, 2:52 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 27 2024, 2:52 AM

Maintenance_bot added a project: Abstract Wikipedia team.Feb 27 2024, 3:30 AM

Jdforrester-WMF renamed this task from invalid executor response for test of inbuilt Z972 to List equality throwing a Z564/Invalid executor response for test using Z872/Filter.Feb 29 2024, 5:41 PM

Jdforrester-WMF triaged this task as Medium priority.

Jdforrester-WMF added projects: function-evaluator, function-orchestrator.

Jdforrester-WMF moved this task from To triage to Backlog on the Abstract Wikipedia team board.

Hello! I have tried out this using the provided link, using a string reference as well as string as input and it seems this is no longer an issue. Will move this to 'Verify In Prod' for now~

ecarg moved this task from Backlog to To deploy on the Abstract Wikipedia team board.Mar 20 2024, 5:21 AM

ecarg moved this task from To deploy to Verify in production on the Abstract Wikipedia team board.

Agreed. It passes now. I'll report again if I see a similar problem popping up again.

99of9 closed this task as Resolved.Mar 22 2024, 12:13 AM

99of9 claimed this task.

Now I see the same error on a different test of the same function: https://www.wikifunctions.org/view/en/Z13334

99of9 removed 99of9 as the assignee of this task.Mar 26 2024, 11:06 PM

@ecarg should I move it back out of "verify in production"? Does it go to backlog?

In T358543#9686582, @99of9 wrote:

@ecarg should I move it back out of "verify in production"? Does it go to backlog?

I've moved it into the current milestone for someone to look at.

Jdforrester-WMF moved this task from Incoming to Ready, Bugs on the Abstract Wikipedia team (24Q4 (Apr–Jun)) board.Apr 4 2024, 5:26 PM

Jdforrester-WMF moved this task from 24Q4 (Apr–Jun) to 25Q1 (Jul–Sep) on the Abstract Wikipedia team board.Jun 17 2024, 8:27 PM

Jdforrester-WMF edited projects, added Abstract Wikipedia team (25Q1 (Jul–Sep)); removed Abstract Wikipedia team (24Q4 (Apr–Jun)).

Jdforrester-WMF moved this task from Incoming to Ready, Bugs on the Abstract Wikipedia team (25Q1 (Jul–Sep)) board.Jun 17 2024, 8:31 PM

cmassaro claimed this task.Thu, Jul 25, 3:03 PM

This is now passing on both of the linked tests. The error in the task description points to an executor error, and the empty string after it means that the executor just didn't return anything. Could have been something ephemeral like resource exhaustion or a timeout. Marking as "needs sign-off" for now.

cmassaro moved this task from Ready, Bugs to Needs Sign-off on the Abstract Wikipedia team (25Q1 (Jul–Sep)) board.Thu, Jul 25, 3:08 PM

The unlinked tests are valid too. This error is currently showing on:
https://www.wikifunctions.org/view/en/Z16550
I agree it may be a timeout. If so, is there a way of making the error messages more transparent?

	F56690012: image.png
	Fri, Jul 26, 2:26 AM

List equality throwing a Z564/Invalid executor response for test using Z872/FilterOpen, MediumPublicBUG REPORTActions

Description

Event Timeline

List equality throwing a Z564/Invalid executor response for test using Z872/Filter
Open, MediumPublicBUG REPORT
Actions