Page MenuHomePhabricator

WMF-General-or-UnknownComponent
ActivePublic

Details

Description

For all configuration issues and other issues specific to the sites and instrastructure of Wikimedia Foundation (as opposed to relating to any of the software that we develop), including issues specific to the content and configuration of Wikipedia, Wiktionary, Commons, and other Wikimedia projects.

Child projects and most closely related Wikimedia components:

Related groups (sometimes interested in reports here, may be able to act on them or not):

Cross-component related projects (involving both MediaWiki code and Wikimedia):

Note: stats.wikimedia.org reports should be filed under Data-Engineering-Wikistats.

Recent Activity

Yesterday

Ameisenigel added a comment to T381562: Remove non-existing $CHANGEDORCREATED from numerous on-wiki Enotif_body message overrides.

Done for all GS wikis except huwikinews since this wiki is closed and cannot be edited.

Sat, Jan 11, 9:01 AM · WMF-General-or-Unknown
Ameisenigel updated the task description for T381562: Remove non-existing $CHANGEDORCREATED from numerous on-wiki Enotif_body message overrides.
Sat, Jan 11, 8:59 AM · WMF-General-or-Unknown

Fri, Jan 10

Jdlrobson moved T307359: Mobile sites being indexed by Google from Product Backlog to Freezer on the Web-Team board.
Fri, Jan 10, 11:05 PM · Web-Team, MobileFrontend, Mobile, Chinese-Sites, SEO, WMF-General-or-Unknown
Melos updated the task description for T381562: Remove non-existing $CHANGEDORCREATED from numerous on-wiki Enotif_body message overrides.
Fri, Jan 10, 9:26 PM · WMF-General-or-Unknown
Quiddity added a comment to T381562: Remove non-existing $CHANGEDORCREATED from numerous on-wiki Enotif_body message overrides.

+1 to Pppery's comments.
I've tweaked the Description here with those details, and to use checkboxes in case we want it processed here - alternatively it could be copied across to the Global_sysops/requests page for inline strikethroughs.

Fri, Jan 10, 9:02 PM · WMF-General-or-Unknown
Quiddity updated the task description for T381562: Remove non-existing $CHANGEDORCREATED from numerous on-wiki Enotif_body message overrides.
Fri, Jan 10, 9:02 PM · WMF-General-or-Unknown
Ottomata edited projects for T261803: Requests for /static get an invalid WMF-Last-Access cookie for wikipedia.org on non-Wikipedia requests, added: Data-Engineering, Data-Engineering-Icebox; removed Data-Engineering-Icebox-DEPRECATED.
Fri, Jan 10, 2:41 AM · Data-Engineering-Icebox, Data-Engineering, MediaWiki-Platform-Team (Radar), Developer Productivity, Analytics-Radar, Traffic, SRE, WMF-General-or-Unknown

Thu, Jan 9

andrea.denisse added a comment to T187078: Re-consider ` >/dev/null 2>&1` as output of many cron'd MW maintenance scripts.

I think that having a list of the MW maintenance scripts that have this behavior would make it easier to work on them.

Thu, Jan 9, 9:53 PM · Observability-Logging, serviceops, WMF-General-or-Unknown, SRE
Ladsgroup added a comment to T54777: user_properties table bloat.

They are very likely just leftovers from the old times

Thu, Jan 9, 11:41 AM · Wikimedia-maintenance-script-run, Performance Issue, WMF-General-or-Unknown
matmarex added a comment to T54777: user_properties table bloat.

Are they still being stored, or were they being stored once upon a time, and remained behind after the code was fixed? (You could probably check the user_touched of the relevant users to find out.)

Thu, Jan 9, 2:22 AM · Wikimedia-maintenance-script-run, Performance Issue, WMF-General-or-Unknown

Wed, Jan 8

andrea.denisse removed a project from T157850: Interacting with Wikimedia logs should be a pleasant experience: Observability-Logging.
Wed, Jan 8, 3:35 PM · Epic, WMF-General-or-Unknown

Mon, Jan 6

VirginiaPoundstone moved T325663: Audit use of cookies #2 - some cookies are missing the `Secure` flag from TBD to NEEDS DISCUSSION on the Experimentation Lab board.
Mon, Jan 6, 9:41 PM · Experimentation Lab Radar, Experimentation Lab, Patch-For-Review, User-Kizule, Privacy Engineering, WMF-General-or-Unknown
VirginiaPoundstone moved T325663: Audit use of cookies #2 - some cookies are missing the `Secure` flag from NEEDS DISCUSSION to TBD on the Experimentation Lab board.
Mon, Jan 6, 9:39 PM · Experimentation Lab Radar, Experimentation Lab, Patch-For-Review, User-Kizule, Privacy Engineering, WMF-General-or-Unknown
VirginiaPoundstone added a project to T325663: Audit use of cookies #2 - some cookies are missing the `Secure` flag: Experimentation Lab Radar.
Mon, Jan 6, 9:39 PM · Experimentation Lab Radar, Experimentation Lab, Patch-For-Review, User-Kizule, Privacy Engineering, WMF-General-or-Unknown
VirginiaPoundstone moved T325663: Audit use of cookies #2 - some cookies are missing the `Secure` flag from TBD to NEEDS DISCUSSION on the Experimentation Lab board.
Mon, Jan 6, 9:37 PM · Experimentation Lab Radar, Experimentation Lab, Patch-For-Review, User-Kizule, Privacy Engineering, WMF-General-or-Unknown
VirginiaPoundstone moved T325663: Audit use of cookies #2 - some cookies are missing the `Secure` flag from NEEDS DISCUSSION to TBD on the Experimentation Lab board.
Mon, Jan 6, 9:17 PM · Experimentation Lab Radar, Experimentation Lab, Patch-For-Review, User-Kizule, Privacy Engineering, WMF-General-or-Unknown
Ladsgroup added a comment to T54777: user_properties table bloat.
mysql:[email protected] [enwiki]> select up_property, up_value, count(*) from user_properties where up_value = '' group by up_property order by count(*) desc limit 10;
+----------------------------------------+----------+----------+
| up_property                            | up_value | count(*) |
+----------------------------------------+----------+----------+
| echo-subscriptions-web-reverted        |          |  8645xxx |
| nickname                               |          |  1292xxx |
| variant                                |          |  1014xxx |
| gettingstarted-task-toolbar-show-intro |          |   792xxx |
| timecorrection                         |          |   743xxx |
| watchlisttoken                         |          |   434xxx |
| echo-subscriptions-push-ge-newcomer    |          |   270xxx |
| usecodemirror-colorblind               |          |   258xxx |
| twocolconflict                         |          |   241xxx |
| realme-urls                            |          |   149xxx |
+----------------------------------------+----------+----------+
10 rows in set (14 min 8.191 sec)
Mon, Jan 6, 1:32 PM · Wikimedia-maintenance-script-run, Performance Issue, WMF-General-or-Unknown
Ladsgroup added a comment to T54777: user_properties table bloat.

Still we have around 250M rows there, that's 5 per user. Even if we remove all echo rows, it'll be around 100M rows left. Something is quite broken there. One thing that stands out to me is that many default values are still being stored and they are usually the top entry there. e.g. "0" for date is 1.6M rows. Empty string for 'timecorrection' is 740K rows (plus Offset|0 with 1M rows, not sure this is actually default though). Major percentage of the whole table is empty strings or default values.

Mon, Jan 6, 1:09 PM · Wikimedia-maintenance-script-run, Performance Issue, WMF-General-or-Unknown

Thu, Jan 2

Jdlrobson moved T307359: Mobile sites being indexed by Google from Backlog to Team: web on the MobileFrontend board.
Thu, Jan 2, 11:36 PM · Web-Team, MobileFrontend, Mobile, Chinese-Sites, SEO, WMF-General-or-Unknown
Jdlrobson added a project to T307359: Mobile sites being indexed by Google: Web-Team.
Thu, Jan 2, 11:36 PM · Web-Team, MobileFrontend, Mobile, Chinese-Sites, SEO, WMF-General-or-Unknown
Jdlrobson triaged T307359: Mobile sites being indexed by Google as High priority.
Thu, Jan 2, 9:47 PM · Web-Team, MobileFrontend, Mobile, Chinese-Sites, SEO, WMF-General-or-Unknown
Ladsgroup moved T54778: Clean up skin user preferences in user_properties table on Wikimedia wikis from Triage to Done on the DBA board.
Thu, Jan 2, 3:39 PM · DBA, Web-Team, Wikimedia-maintenance-script-run, WMF-General-or-Unknown
Ladsgroup closed T54778: Clean up skin user preferences in user_properties table on Wikimedia wikis, a subtask of T54777: user_properties table bloat, as Resolved.
Thu, Jan 2, 3:39 PM · Wikimedia-maintenance-script-run, Performance Issue, WMF-General-or-Unknown
Ladsgroup closed T54778: Clean up skin user preferences in user_properties table on Wikimedia wikis as Resolved.

Cleaned up the "2" values.

Thu, Jan 2, 3:39 PM · DBA, Web-Team, Wikimedia-maintenance-script-run, WMF-General-or-Unknown

Thu, Dec 19

Pppery added a comment to T381562: Remove non-existing $CHANGEDORCREATED from numerous on-wiki Enotif_body message overrides.

Of those euwiki, frwiktionary, kawiki, and zh_yuewiki are not GS wikis)

Thu, Dec 19, 10:52 PM · WMF-General-or-Unknown
Pppery added a comment to T381562: Remove non-existing $CHANGEDORCREATED from numerous on-wiki Enotif_body message overrides.

(and it only needs a local admin, not an interfaceadmin - interfaceadmin bits are only required for CSS/JS edits)

Thu, Dec 19, 10:49 PM · WMF-General-or-Unknown
Pppery added a comment to T381562: Remove non-existing $CHANGEDORCREATED from numerous on-wiki Enotif_body message overrides.

For the wikis in GS scope you can probably request it as https://meta.wikimedia.org/wiki/Global_sysops/Requests

Thu, Dec 19, 10:48 PM · WMF-General-or-Unknown
Milimetric edited projects for T325663: Audit use of cookies #2 - some cookies are missing the `Secure` flag, added: Experimentation Lab; removed Experimentation Lab (Data Products Sprint 23).
Thu, Dec 19, 5:41 PM · Experimentation Lab Radar, Experimentation Lab, Patch-For-Review, User-Kizule, Privacy Engineering, WMF-General-or-Unknown
Mahabarata73 created T382486: [[Wikimedia:Wikipedia-ios-year-in-review-personalized-saved-subtitle-format/fr]] translation issue.
Thu, Dec 19, 12:54 PM · Wikipedia-iOS-App-Backlog, I18n

Wed, Dec 18

Aklapper closed T304208: bn.wikisource.org loads by default resources from tools-static.wmflabs.org as Resolved.

Fixed in https://bn.wikisource.org/w/index.php?title=ব্যবহারকারী%3ABodhisattwa%2Fcleanup.js&diff=1671961&oldid=1564869

Wed, Dec 18, 5:42 PM · Bengali-Sites, WMF-General-or-Unknown, Privacy Engineering, Privacy
Aklapper updated subscribers of T381562: Remove non-existing $CHANGEDORCREATED from numerous on-wiki Enotif_body message overrides.

@Quiddity: Just wondering if you might have any general idea or recommendations how to gain some traction on such on-wiki cross-wiki needs-special-permissions tasks, or where to bring this up? (Sorry, you're first person coming to my mind, and I sometimes come across such things - feel free to unsub again :)

Wed, Dec 18, 5:36 PM · WMF-General-or-Unknown
Ladsgroup added a comment to T54778: Clean up skin user preferences in user_properties table on Wikimedia wikis.

It's now this:

mysql:[email protected] [enwiki]> select up_value, count(*) from user_properties where up_property = 'skin' group by up_value order by count(*) desc limit 50;
+-------------+----------+
| up_value    | count(*) |
+-------------+----------+
| monobook    |  21986xx |
| vector      |   2548xx |
| cologneblue |    877xx |
| modern      |    859xx |
| vector-2022 |    347xx |
| timeless    |    286xx |
| minerva     |    175xx |
| 2           |     30xx |
+-------------+----------+
8 rows in set (39.426 sec)
Wed, Dec 18, 2:42 PM · DBA, Web-Team, Wikimedia-maintenance-script-run, WMF-General-or-Unknown

Tue, Dec 17

Pppery removed a project from T61814: Page fails to load when sub-page transclusion has recursive redirect: http://sv.wikipedia.org/wiki/Wikipedia:Månadens_nyuppladdade_bilder/2013-09: TestMe.
Tue, Dec 17, 4:24 PM · MediaWiki-Gallery, MediaWiki-Redirects, WMF-General-or-Unknown, MediaWiki-Parser
Ladsgroup added a comment to T54778: Clean up skin user preferences in user_properties table on Wikimedia wikis.
Cleaning up invalid skin values for enwiki
7305884 are there
...
Tue, Dec 17, 3:03 PM · DBA, Web-Team, Wikimedia-maintenance-script-run, WMF-General-or-Unknown
Ladsgroup added a comment to T54778: Clean up skin user preferences in user_properties table on Wikimedia wikis.
echo "Cleaning up invalid skin values"
counts=$(sql $1 -- -ss -e "select count(*) from user_properties where up_property='skin' and up_value in ('','0','1','amethyst','chick','myskin','nostalgia','simple','standard','minervaneue');")
echo "$counts are there"
for i in {0..10000}
do
  echo "Deleting batch $i"
  sql $1 --write -- -e "delete from user_properties where up_property='skin' and up_value in ('','0','1','amethyst','chick','myskin','nostalgia','simple','standard','minervaneue') LIMIT 10000;"
  echo "sleeping...zzz"
  sleep 5
  counts=$(sql $1 -- -ss -e "select count(*) from user_properties where up_property='skin' and up_value in ('','0','1','amethyst','chick','myskin','nostalgia','simple','standard','minervaneue');")
  echo "$counts left for $j"
  if [ "$counts" -eq 0 ]; then
      echo "Done"
      break
  fi
done
Tue, Dec 17, 1:23 PM · DBA, Web-Team, Wikimedia-maintenance-script-run, WMF-General-or-Unknown
Ladsgroup added a comment to T54778: Clean up skin user preferences in user_properties table on Wikimedia wikis.

Running a bash script based on the query above. There are a lot of '' values:

mysql:[email protected] [arwiki]> select up_value, count(*) from user_properties where up_property  = 'skin' group by up_value order by count(*) desc;
+-------------+----------+
| up_value    | count(*) |
+-------------+----------+
|             |   1648xx |
| monobook    |    356xx |
| vector      |     49xx |
| modern      |     25xx |
| vector-2022 |      8xx |
| chick       |      8xx |
| cologneblue |      8xx |
| timeless    |      6xx |
| minerva     |      5xx |
| simple      |      4xx |
| nostalgia   |      4xx |
| myskin      |      3xx |
| 0           |      2xx |
| amethyst    |     tiny |
| 2           |     tiny |
+-------------+----------+
15 rows in set (0.828 sec)
Tue, Dec 17, 1:20 PM · DBA, Web-Team, Wikimedia-maintenance-script-run, WMF-General-or-Unknown
TTO added a project to T61814: Page fails to load when sub-page transclusion has recursive redirect: http://sv.wikipedia.org/wiki/Wikipedia:Månadens_nyuppladdade_bilder/2013-09: MediaWiki-Gallery.

@Pppery added a project: TestMe.

Tue, Dec 17, 9:49 AM · MediaWiki-Gallery, MediaWiki-Redirects, WMF-General-or-Unknown, MediaWiki-Parser
matmarex added a comment to T54778: Clean up skin user preferences in user_properties table on Wikimedia wikis.

If anyone still wants to resolve this, you should basically run the following two queries across all wikis, with appropriate limits and batching etc. – note that there are millions of rows to delete on some wikis:

Tue, Dec 17, 4:47 AM · DBA, Web-Team, Wikimedia-maintenance-script-run, WMF-General-or-Unknown
Pppery added a project to T61814: Page fails to load when sub-page transclusion has recursive redirect: http://sv.wikipedia.org/wiki/Wikipedia:Månadens_nyuppladdade_bilder/2013-09: TestMe.
Tue, Dec 17, 3:00 AM · MediaWiki-Gallery, MediaWiki-Redirects, WMF-General-or-Unknown, MediaWiki-Parser

Fri, Dec 13

AntiCompositeNumber added a parent task for T382108: Pre-generate thumbnails at gallery-default sizes: T266155: Frequent "Error: 429, Too Many Requests" errors on pages with many (>50) thumbnails.
Fri, Dec 13, 2:27 AM · WMF-General-or-Unknown, Thumbor, MediaWiki-File-management, Commons
AntiCompositeNumber created T382108: Pre-generate thumbnails at gallery-default sizes.
Fri, Dec 13, 2:27 AM · WMF-General-or-Unknown, Thumbor, MediaWiki-File-management, Commons

Dec 12 2024

LWyatt added a comment to T381204: Opt Wikimedia sites out of Google Page Annotations feature.

FYI - I've raised this in the context of Partnership checkin meeting with the Google representative. This might be able to address the issue across the whole organisation rather than requiring manual checks for each individual domain etc. I will advise if this gets resolved through that manner.

Dec 12 2024, 7:09 PM · Search-Console-access-request, Privacy, Privacy Engineering, WMF-General-or-Unknown
Ladsgroup added a comment to T54778: Clean up skin user preferences in user_properties table on Wikimedia wikis.

Thanks. It indeed helped. I haven't got to do anything about it though and not sure I will be able to considering the amount of work needed but I'd be more than happy to help anyone else get this passed the finish line.

Dec 12 2024, 2:32 PM · DBA, Web-Team, Wikimedia-maintenance-script-run, WMF-General-or-Unknown
Stashbot added a comment to T54777: user_properties table bloat.

Mentioned in SAL (#wikimedia-operations) [2024-12-12T14:30:08Z] <Amir1> ladsgroup@mwmaint2002:~$ foreachwikiindblist all userOptions.php --delete VectorSkinVersion (T54777)

Dec 12 2024, 2:30 PM · Wikimedia-maintenance-script-run, Performance Issue, WMF-General-or-Unknown

Dec 10 2024

NBaca-WMF reopened T381204: Opt Wikimedia sites out of Google Page Annotations feature as "In Progress".

@Reedy - A good question! I've asked about this and will follow back up here when I hear more. I initially supposed the domain property percolated down but this appears not to be the case. I'll reply back when I get the full list and can update the form. Moving back to "In Progress" for now as I work through this.

Dec 10 2024, 5:58 PM · Search-Console-access-request, Privacy, Privacy Engineering, WMF-General-or-Unknown

Dec 8 2024

ppelberg updated the task description for T381726: Enable people to import Kindle highlights to Wikipedia.
Dec 8 2024, 3:58 PM · WMF-General-or-Unknown
Pppery edited projects for T38833: Allow stewards to create, delete and modify local group permissions on local wikis, added: WMF-General-or-Unknown; removed MediaWiki-extension-requests, Wikimedia-Site-requests.
Dec 8 2024, 7:14 AM · WMF-General-or-Unknown, OKR-Work, Stewards-and-global-tools
Pppery merged T29421: Write and implement bug reporting wizard into T29852: Wikimedia wikis need better issue reporting system.
Dec 8 2024, 7:09 AM · WMF-General-or-Unknown

Dec 7 2024

Pppery added a project to T381726: Enable people to import Kindle highlights to Wikipedia: WMF-General-or-Unknown.
Dec 7 2024, 10:29 PM · WMF-General-or-Unknown

Dec 6 2024

Jdlrobson added a comment to T54778: Clean up skin user preferences in user_properties table on Wikimedia wikis.

@Ladsgroup did James's answer help or should this be declined?

Dec 6 2024, 10:57 PM · DBA, Web-Team, Wikimedia-maintenance-script-run, WMF-General-or-Unknown