[go: nahoru, domu]

Page MenuHomePhabricator

Platform Engineering Code Jam-2021Umbrella
ArchivedPublic

Watchers

  • This project does not have any watchers.
  • View All

Details

Description

Tasks for the Platform Engineering team's Code Jam weeks.

Recent Activity

Wed, Jul 10

Maintenance_bot removed a project from T235901: Implement Lua access to Lexemes, Senses and Forms: Patch-For-Review.
Wed, Jul 10, 11:30 AM · MW-1.39-notes (1.39.0-wmf.17; 2022-06-20), MW-1.38-notes (1.38.0-wmf.6; 2021-10-26), Platform Engineering Code Jam-2021, [DEPRECATED] wdwb-tech, Platform Engineering Roadmap Decision Making, MW-1.35-notes (1.35.0-wmf.11; 2019-12-17), All-and-every-Wiktionary, Wikidata, Wikidata Lexicographical data

Tue, Jul 9

Maintenance_bot removed a project from T337223: Replace usage of VirtualRESTServiceClient in Flow extension: Patch-For-Review.
Tue, Jul 9, 8:00 PM · StructuredDiscussions, MW-1.41-notes (1.41.0-wmf.13; 2023-06-13), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process)

Mon, Jul 8

gerritbot added a comment to T337223: Replace usage of VirtualRESTServiceClient in Flow extension.

Change #927619 abandoned by D3r1ck01:

[mediawiki/extensions/Flow@master] [WIP] Fix failing tests due to Parsoid being enabled & used (by default)

Reason:

https://gerrit.wikimedia.org/r/927619

Mon, Jul 8, 8:51 PM · StructuredDiscussions, MW-1.41-notes (1.41.0-wmf.13; 2023-06-13), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process)

May 22 2024

Krinkle updated subscribers of T221795: Refactor Category::refreshCounts logic to a job and simplify.

Questions from @Bmueller:

  • What are the dependencies (code, and/or people)?
    • "Categories" are a fairly small feature. It builds on general platform concepts like JobQueue, DeferredUpdates, and utility functions, but I don't think this task requires changes to other components or feature behaviours. As such, while not exactly standalone, I'd say it has no code dependencies that we need to be mindful of in this context. In terms of teams, the feature is unowned. The task does not require making behaviour changes besides obvious bug fixes, so no controversial decisions or indirect product impact expected there.
  • What is the impact of this?
    • Sustainability: the current implementation is needlessly complex and redundant and yet still seeems to regularly produce inaccurate counts. It is prune to production errors and load problems. e.g. T352628: Fatal exception of type "Wikimedia\Rdbms\DBTransactionSizeError", per @Ladsgroup above.
    • Product experience: The most prominent use category counts, where the number itself is imporant/sensitive, is Wikipedia maintenance categories, and similar "meta" categories on other wikis. The counts are often used to power templates, gadgets, and bots to know when a particular kind of issue has more than 0 articles affecting it. The problem is often that the category will either be zero when it shouldn't be or above zero when it should be zero. To clarify: The problem is not e.g. when a category containing 100+ items and the number being off by a few, which would not be a big problem in that case. We have ~15 duplicate bug reports about this at the moment, dating back several years.
  • What would it cost to fix? TBD.
May 22 2024, 3:02 PM · MediaWiki-Engineering, Wikimedia-Performance-recommendation, Sustainability (Incident Followup), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, MediaWiki-Categories
Krinkle merged T23230: Category count is incorrect into T221795: Refactor Category::refreshCounts logic to a job and simplify.
May 22 2024, 2:10 PM · MediaWiki-Engineering, Wikimedia-Performance-recommendation, Sustainability (Incident Followup), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, MediaWiki-Categories
Krinkle added a subtask for T221795: Refactor Category::refreshCounts logic to a job and simplify: T299244: Deleted pages are not being removed from links tables, which also messes up category counts.
May 22 2024, 2:09 PM · MediaWiki-Engineering, Wikimedia-Performance-recommendation, Sustainability (Incident Followup), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, MediaWiki-Categories
Krinkle added a subtask for T221795: Refactor Category::refreshCounts logic to a job and simplify: T195397: {{PAGESINCATEGORY}} returns incorrect value on en-wiki Category:Candidates for speedy deletion.
May 22 2024, 2:08 PM · MediaWiki-Engineering, Wikimedia-Performance-recommendation, Sustainability (Incident Followup), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, MediaWiki-Categories
Krinkle merged T85527: Category gives wrong number of pages into T221795: Refactor Category::refreshCounts logic to a job and simplify.
May 22 2024, 2:07 PM · MediaWiki-Engineering, Wikimedia-Performance-recommendation, Sustainability (Incident Followup), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, MediaWiki-Categories
Krinkle merged T117971: Category size count is radically different than actual count. into T221795: Refactor Category::refreshCounts logic to a job and simplify.
May 22 2024, 2:07 PM · MediaWiki-Engineering, Wikimedia-Performance-recommendation, Sustainability (Incident Followup), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, MediaWiki-Categories
Krinkle merged T178489: Incorrect count in category into T221795: Refactor Category::refreshCounts logic to a job and simplify.
May 22 2024, 2:06 PM · MediaWiki-Engineering, Wikimedia-Performance-recommendation, Sustainability (Incident Followup), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, MediaWiki-Categories
Krinkle merged T200402: Category count inaccurate on enwp into T221795: Refactor Category::refreshCounts logic to a job and simplify.
May 22 2024, 2:06 PM · MediaWiki-Engineering, Wikimedia-Performance-recommendation, Sustainability (Incident Followup), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, MediaWiki-Categories
Krinkle merged T202833: Wrong file count for category into T221795: Refactor Category::refreshCounts logic to a job and simplify.
May 22 2024, 2:06 PM · MediaWiki-Engineering, Wikimedia-Performance-recommendation, Sustainability (Incident Followup), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, MediaWiki-Categories
Krinkle merged T221679: API producing inconsistent results on trwiki into T221795: Refactor Category::refreshCounts logic to a job and simplify.
May 22 2024, 2:05 PM · MediaWiki-Engineering, Wikimedia-Performance-recommendation, Sustainability (Incident Followup), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, MediaWiki-Categories
FJoseph-WMF moved T221795: Refactor Category::refreshCounts logic to a job and simplify from Inbox, needs triage to Backlog (revisit in the future) on the MediaWiki-Engineering board.
May 22 2024, 1:49 PM · MediaWiki-Engineering, Wikimedia-Performance-recommendation, Sustainability (Incident Followup), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, MediaWiki-Categories

May 8 2024

Krinkle added a project to T221795: Refactor Category::refreshCounts logic to a job and simplify: MediaWiki-Engineering.
May 8 2024, 6:00 PM · MediaWiki-Engineering, Wikimedia-Performance-recommendation, Sustainability (Incident Followup), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, MediaWiki-Categories

Apr 3 2024

Pppery edited projects for T248172: ServiceContainer: Allow static methods to be used for wiring, added: Patch-Needs-Improvement; removed Patch-For-Review.
Apr 3 2024, 4:35 AM · Patch-Needs-Improvement, Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, MediaWiki-libs-Services

Mar 27 2024

aaron added a comment to T221795: Refactor Category::refreshCounts logic to a job and simplify.

FWIW, this system has caused an incident where several million articles were not editable because this process locked 3M rows in pagelinks. Fixing that would improve our resilience.

Mar 27 2024, 10:24 PM · MediaWiki-Engineering, Wikimedia-Performance-recommendation, Sustainability (Incident Followup), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, MediaWiki-Categories
Ladsgroup added a comment to T221795: Refactor Category::refreshCounts logic to a job and simplify.

FWIW, this system has caused an incident where several million articles were not editable because this process locked 3M rows in pagelinks. Fixing that would improve our resilience.

Mar 27 2024, 4:22 PM · MediaWiki-Engineering, Wikimedia-Performance-recommendation, Sustainability (Incident Followup), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, MediaWiki-Categories

Nov 21 2023

Aklapper placed T261848: Simulate databases for sister sites in phpunit up for grabs.

@daniel: Per emails from Sep18 and Oct20 and https://www.mediawiki.org/wiki/Bug_management/Assignee_cleanup , I am resetting the assignee of this task because there has not been progress lately (please correct me if I am wrong!). Resetting the assignee avoids the impression that somebody is already working on this task. It also allows others to potentially work towards fixing this task. Please claim this task again when you plan to work on it (via Add Action...Assign / Claim in the dropdown menu) - it would be welcome. Thanks for your understanding!

Nov 21 2023, 8:13 AM · Patch-Needs-Improvement, Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, Code-Health, MediaWiki-Core-Tests, Testing-Roadblocks

Nov 10 2023

lbowmaker removed a project from T257583: Run EventBus tests in MediaWiki core CI: Data Engineering and Event Platform Team.
Nov 10 2023, 2:30 PM · Data-Engineering, Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, Release-Engineering-Team (Radar), Continuous-Integration-Config, Analytics-Radar, Platform Engineering, Event-Platform, WMF-JobQueue, ChangeProp

Sep 19 2023

Krinkle closed T274041: Reduce performance impact of HookRunner.php loading 500+ interfaces as Resolved.
Sep 19 2023, 1:50 AM · Wikimedia-Performance-publish, Wikimedia-Performance-recommendation, Performance-Team, Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, Patch-For-Review, MediaWiki-Core-Hooks
Krinkle moved T274041: Reduce performance impact of HookRunner.php loading 500+ interfaces from Untriaged to Ready for write-up on the Wikimedia-Performance-publish board.
Sep 19 2023, 1:50 AM · Wikimedia-Performance-publish, Wikimedia-Performance-recommendation, Performance-Team, Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, Patch-For-Review, MediaWiki-Core-Hooks
Krinkle added a parent task for T274041: Reduce performance impact of HookRunner.php loading 500+ interfaces: T302623: FY2022-2023: Improve Backend Pageview Timing.
Sep 19 2023, 1:50 AM · Wikimedia-Performance-publish, Wikimedia-Performance-recommendation, Performance-Team, Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, Patch-For-Review, MediaWiki-Core-Hooks
gerritbot added a comment to T274041: Reduce performance impact of HookRunner.php loading 500+ interfaces.

Change 777483 abandoned by Krinkle:

[mediawiki/core@master] [WIP] HookRunner: Implement a fast HookRunner for load.php

Reason:

No significant redunction left after the PSR-4 classmap change.

https://gerrit.wikimedia.org/r/777483

Sep 19 2023, 1:49 AM · Wikimedia-Performance-publish, Wikimedia-Performance-recommendation, Performance-Team, Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, Patch-For-Review, MediaWiki-Core-Hooks

Sep 18 2023

Eevans closed T289204: Move service-scaffold-golang & servicelib-golang to Gerrit and document as Resolved.
Sep 18 2023, 5:41 PM · Platform Engineering Code Jam-2021, User-Eevans

Sep 17 2023

Aklapper edited projects for T261848: Simulate databases for sister sites in phpunit, added: Patch-Needs-Improvement; removed Patch-For-Review.
Sep 17 2023, 4:15 PM · Patch-Needs-Improvement, Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, Code-Health, MediaWiki-Core-Tests, Testing-Roadblocks

Sep 4 2023

gerritbot added a comment to T274041: Reduce performance impact of HookRunner.php loading 500+ interfaces.

Change 954630 merged by jenkins-bot:

[mediawiki/core@REL1_39] Include core PSR-4 classes in the generated classmap

https://gerrit.wikimedia.org/r/954630

Sep 4 2023, 1:17 PM · Wikimedia-Performance-publish, Wikimedia-Performance-recommendation, Performance-Team, Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, Patch-For-Review, MediaWiki-Core-Hooks
gerritbot added a comment to T274041: Reduce performance impact of HookRunner.php loading 500+ interfaces.

Change 954630 had a related patch set uploaded (by Reedy; author: TK-999):

[mediawiki/core@REL1_39] Include core PSR-4 classes in the generated classmap

https://gerrit.wikimedia.org/r/954630

Sep 4 2023, 12:21 PM · Wikimedia-Performance-publish, Wikimedia-Performance-recommendation, Performance-Team, Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, Patch-For-Review, MediaWiki-Core-Hooks

Aug 28 2023

Krinkle moved T274041: Reduce performance impact of HookRunner.php loading 500+ interfaces from Untriaged to HookRunner on the MediaWiki-Core-Hooks board.
Aug 28 2023, 2:11 PM · Wikimedia-Performance-publish, Wikimedia-Performance-recommendation, Performance-Team, Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, Patch-For-Review, MediaWiki-Core-Hooks

Aug 24 2023

Nikerabbit closed T339228: Remove VRS code from ContentTranslation, a subtask of T179680: Hard deprecate VirtualRESTService, as Resolved.
Aug 24 2023, 2:44 PM · MW-1.41-notes (1.41.0-wmf.22; 2023-08-15), MW-1.41-release, API Platform (RESTBase Deprecation Roadmap), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process), MediaWiki-General

Aug 18 2023

Krinkle moved T221795: Refactor Category::refreshCounts logic to a job and simplify from Watching to Perf recommendation on the Performance-Team (Radar) board.
Aug 18 2023, 8:05 PM · MediaWiki-Engineering, Wikimedia-Performance-recommendation, Sustainability (Incident Followup), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, MediaWiki-Categories

Aug 12 2023

Aklapper archived Platform Engineering Code Jam-2021.
Aug 12 2023, 12:43 PM
Aklapper renamed Platform Engineering Code Jam-2021 from Platform Engineering Code Jam to Platform Engineering Code Jam-2021.
Aug 12 2023, 12:43 PM

Aug 8 2023

DAlangi_WMF closed T179680: Hard deprecate VirtualRESTService as Resolved.
Aug 8 2023, 5:15 PM · MW-1.41-notes (1.41.0-wmf.22; 2023-08-15), MW-1.41-release, API Platform (RESTBase Deprecation Roadmap), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process), MediaWiki-General
ReleaseTaggerBot added a project to T179680: Hard deprecate VirtualRESTService: MW-1.41-notes (1.41.0-wmf.22; 2023-08-15).
Aug 8 2023, 5:00 PM · MW-1.41-notes (1.41.0-wmf.22; 2023-08-15), MW-1.41-release, API Platform (RESTBase Deprecation Roadmap), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process), MediaWiki-General
Maintenance_bot removed a project from T179680: Hard deprecate VirtualRESTService: Patch-For-Review.
Aug 8 2023, 4:11 PM · MW-1.41-notes (1.41.0-wmf.22; 2023-08-15), MW-1.41-release, API Platform (RESTBase Deprecation Roadmap), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process), MediaWiki-General
gerritbot added a comment to T179680: Hard deprecate VirtualRESTService.

Change 936659 merged by jenkins-bot:

[mediawiki/core@master] virtualrest: Hard deprecate VirtualRESTService & VirtualRESTServiceClient

https://gerrit.wikimedia.org/r/936659

Aug 8 2023, 4:10 PM · MW-1.41-notes (1.41.0-wmf.22; 2023-08-15), MW-1.41-release, API Platform (RESTBase Deprecation Roadmap), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process), MediaWiki-General

Jul 17 2023

Yaron_Koren closed T341131: Replace usage of VRS in non-WMF deployed extensions (case: VEForAll), a subtask of T179680: Hard deprecate VirtualRESTService, as Resolved.
Jul 17 2023, 4:37 PM · MW-1.41-notes (1.41.0-wmf.22; 2023-08-15), MW-1.41-release, API Platform (RESTBase Deprecation Roadmap), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process), MediaWiki-General

Jul 12 2023

Aklapper changed the edit policy for Platform Engineering Code Jam-2021.
Jul 12 2023, 8:45 AM
DAlangi_WMF closed T339227: Remove VRS code from VisualEditor, a subtask of T179680: Hard deprecate VirtualRESTService, as Resolved.
Jul 12 2023, 8:15 AM · MW-1.41-notes (1.41.0-wmf.22; 2023-08-15), MW-1.41-release, API Platform (RESTBase Deprecation Roadmap), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process), MediaWiki-General

Jul 10 2023

DAlangi_WMF changed the status of T339227: Remove VRS code from VisualEditor, a subtask of T179680: Hard deprecate VirtualRESTService, from Open to In Progress.
Jul 10 2023, 10:42 AM · MW-1.41-notes (1.41.0-wmf.22; 2023-08-15), MW-1.41-release, API Platform (RESTBase Deprecation Roadmap), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process), MediaWiki-General
DAlangi_WMF claimed T179680: Hard deprecate VirtualRESTService.
Jul 10 2023, 10:41 AM · MW-1.41-notes (1.41.0-wmf.22; 2023-08-15), MW-1.41-release, API Platform (RESTBase Deprecation Roadmap), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process), MediaWiki-General
gerritbot added a project to T179680: Hard deprecate VirtualRESTService: Patch-For-Review.
Jul 10 2023, 9:58 AM · MW-1.41-notes (1.41.0-wmf.22; 2023-08-15), MW-1.41-release, API Platform (RESTBase Deprecation Roadmap), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process), MediaWiki-General
gerritbot added a comment to T179680: Hard deprecate VirtualRESTService.

Change 936659 had a related patch set uploaded (by D3r1ck01; author: Derick Alangi):

[mediawiki/core@master] virtualrest: Hard deprecate VirtualRESTService

https://gerrit.wikimedia.org/r/936659

Jul 10 2023, 9:58 AM · MW-1.41-notes (1.41.0-wmf.22; 2023-08-15), MW-1.41-release, API Platform (RESTBase Deprecation Roadmap), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process), MediaWiki-General

Jul 5 2023

DAlangi_WMF closed T338643: Replace usage of VirtualRESTService in non-WMF deployed extensions (case: MathSearch) as Resolved.
Jul 5 2023, 12:52 PM · MathSearch, API Platform (RESTBase Deprecation Roadmap), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process), MediaWiki-General
DAlangi_WMF closed T338643: Replace usage of VirtualRESTService in non-WMF deployed extensions (case: MathSearch), a subtask of T179680: Hard deprecate VirtualRESTService, as Resolved.
Jul 5 2023, 12:52 PM · MW-1.41-notes (1.41.0-wmf.22; 2023-08-15), MW-1.41-release, API Platform (RESTBase Deprecation Roadmap), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process), MediaWiki-General
DAlangi_WMF renamed T338643: Replace usage of VirtualRESTService in non-WMF deployed extensions (case: MathSearch) from Replace usage of VirtualRESTService in non-WMF deployed extensions to Replace usage of VirtualRESTService in non-WMF deployed extensions (case: MathSearch).
Jul 5 2023, 12:45 PM · MathSearch, API Platform (RESTBase Deprecation Roadmap), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process), MediaWiki-General

Jul 2 2023

Nikerabbit reopened T339228: Remove VRS code from ContentTranslation, a subtask of T179680: Hard deprecate VirtualRESTService, as Open.
Jul 2 2023, 7:40 PM · MW-1.41-notes (1.41.0-wmf.22; 2023-08-15), MW-1.41-release, API Platform (RESTBase Deprecation Roadmap), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process), MediaWiki-General
Peachey88 edited projects for T337223: Replace usage of VirtualRESTServiceClient in Flow extension, added: StructuredDiscussions; removed MediaWiki-General.
Jul 2 2023, 11:23 AM · StructuredDiscussions, MW-1.41-notes (1.41.0-wmf.13; 2023-06-13), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process)

Jul 1 2023

DAlangi_WMF renamed T179680: Hard deprecate VirtualRESTService from Deprecate VirtualRESTService to Hard deprecate VirtualRESTService.
Jul 1 2023, 6:13 PM · MW-1.41-notes (1.41.0-wmf.22; 2023-08-15), MW-1.41-release, API Platform (RESTBase Deprecation Roadmap), Platform Engineering Code Jam-2021, Platform Engineering Roadmap Decision Making, RESTBase, Technical-Debt (Deprecation process), MediaWiki-General