VOOZH about

URL: https://phabricator.wikimedia.org/T249724

⇱ ⚓ T249724 Track and remove jessie based container images from production

Maniphest T249724

Track and remove jessie based container images from production
Closed, ResolvedPublic

Description

Per our goal of removing jessie from production, we need to track down, upgrade to stretch or buster the various images that exist and then drop support and remove jessie images from our fleet.

Related Objects

StatusSubtypeAssignedTask
ResolveddancyT302086 Set scap minimum python version to 3.7
ResolvedNoneT247045 Migrate all of production metal and VMs to Buster or later
ResolvedakosiarisT249724 Track and remove jessie based container images from production
ResolvedJdforrester-WMFT224908 Drop jessie testing support
ResolvedJdforrester-WMFT224907 Drop php55 testing support
ResolvedReedyT205039 Release MediaWiki 1.27.6/1.30.2/1.31.2/1.32.2
ResolvedReedyT205041 Tracking bug for 1.27.6/1.30.2/1.31.2/1.32.2 security release
ResolvedBawolffT197279 Direct POST to Special:ChangeEmail will bypass reauth check
ResolvedAnomieT204729 Potential enwiki DOS due to slow WatchedItemStore::countVisitingWatchersMultiple
ResolvedBawolffT207603 CVE-2019-12471: Loading JS from user space where the username is not a registered account is dangerous and should be banned
ResolvedBawolffT208881 CSS using var() to create exponential sized calc() on wiki page will crash visitor's browser
ResolvedLegoktmT199540 Forbid blocking IP ranges as big as /1 and /2, as done on ruwikiquote using the API
Resolved• Lucas_Werkmeister_WMDET212118 API responses for unpatrolled or (not) autopatrolled recent changes require privileges but may be cached publicly
ResolvedBawolffT209794 Need to make a limit of count of attempts to change email address
ResolvedsbassettT222036 Exposed suppressed username or log in Special:EditTags
ResolvedsbassettT222038 Exposed suppressed log in RevisionDelete page
ResolvedJdforrester-WMFT221739 Patch jQuery due to CVE-2019-11358
ResolvedsbassettT25227 Use token when logging out
ResolvedsbassettT221868 Send out wikitech-l post for T25227 ("Use token when logging out")
ResolvedReedyT205042 Write and send release announcements for 1.27.6/1.30.2/1.31.2/1.32.2 security releases
ResolvedReedyT205043 Write and send pre-release Announcements for MediaWiki 1.27.6/1.30.2/1.31.2/1.32.2
ResolvedJdforrester-WMFT205044 Update onwiki release notes for 1.27.6/1.30.2/1.31.2/1.32.2
ResolvedReedyT205046 Update HISTORY in master after 1.27.6/1.30.2/1.31.2/1.32.2
ResolvedReedyT205047 Tag MW 1.27.6/1.30.2/1.31.2/1.32.2
ResolvedReedyT224499 RELEASE-NOTES for 1.27.6/1.30.2/1.31.2/1.32.2
ResolvedJdforrester-WMFT224912 Update MediaWiki.org links and versions
ResolvedJdforrester-WMFT224913 EOL REL1_27 and REL1_30 onwiki
ResolvedReedyT225201 Formally announce EOL of MW 1.27 and 1.30
ResolvedReedyT225149 Update CVEs and publish them
ResolvedReedyT205048 Obtain CVEs for 1.27.6/1.30.2/1.31.2/1.32.2 security releases
ResolvedJdforrester-WMFT224906 Drop php56 testing support
ResolvedhasharT223348 Run wikimedia/fundraising/crm CI jobs on PHP7x, not PHP5x
ResolvedhasharT210287 Migrate wikimedia-fundraising-civicrm to a Docker container
ResolvedJdforrester-WMFT224905 Move wikiba.se tests from php56 to php72
ResolvedhasharT224591 Migrate contint* hosts to Buster
DeclinedMoritzMuehlenhoffT226236 Upload docker-ce 18.06.3 upstream package for Stretch
InvalidthciprianiT239880 Replacement hardware for buster/stretch upgrade of contint1001 and contint2001
Resolved• mmodellT215458 Convert zuul to use scap
ResolvedhasharT240551 Remove Zuul Debian package from WMCS instances
ResolvedJoeT249110 Build and publish a python2 based container to build wheels
ResolvedJMeybohmT249812 Rebuild helm/helm-diff for buster-wikimedia
ResolvedJMeybohmT250479 Rebuild helmfile for buster-wikimedia
DuplicateDzahnT210008 upgrade krypton (webserver_misc_apps) to stretch
DeclinedDzahnT224194 switch webserver_misc_apps to PHP 7.2 (7.1)
ResolvedJdforrester-WMFT211784 Upgrade all CI jobs from node6/npm3 to node10/npm6 across all projects
InvalidJdforrester-WMFT211785 Upgrade the mobileapps CI job from npm3 to npm6
ResolvedMoritzMuehlenhoffT203239 Create Debian packages for Node.js 10 upgrade
ResolvedKrinkleT213944 Jenkins jobs for npm-test fail on project with deps on node-gyp which requires python2.7
ResolvedKrinkleT215562 npm 6 consistently fails with "Z_DATA_ERROR: invalid distance too far back" on some repos
ResolvedhasharT217545 Update selenium-daily-beta-* jobs to node10/npm6
ResolvedJdforrester-WMFT222406 Switch quibble-based CI jobs from node6 to node10
ResolvedJdforrester-WMFT224983 mediawiki-phpunit-coverage-patch-docker fails to install fibers@3.1.1
DeclinedJdforrester-WMFT224997 Update MobileFrontend-npm-run-lint-modules-docker to run node10
DuplicateNoneT224978 WikibaseMediaInfo selenium tests failing when run against beta commons
ResolvedMilimetricT228451 Fix the analytics/mediawiki-storage repo to work on node10
ResolvedMilimetricT228452 Fix the analytics/wikistats2 repo to work on node10
ResolvedLadsgroupT228453 Fix the data-values/value-view repo to work on node10
ResolvedakosiarisT218733 Migrate mobileapps to k8s and node 10
DeclinedNoneT215539 Node.js 10 changes encoding for at least one Georgian character
Resolved• MhollowayT258186 Investigate why mobileapps in k8s "/{domain}/v1/data/css/mobile/site" endpoint takes way longer than on scb to complete
DuplicateNoneT225107 Migrate recommendation-api to node 10
ResolvedNoneT225678 Migrate 3d2png to k8s
ResolvedNoneT267327 Run latest Thumbor on Docker with Buster + Python 3
DeclinedNoneT269215 Blubber "copies" and "builder command" steps should run in the opposite order
ResolvedMSantosT217114 Migrate Proton to k8s and nodejs 10
DuplicateNoneT228907 Migrate the wikimedia-portals-build timed CI job to node10
ResolvedjeenaT213806 Migrate wikimedia-portals-build to Docker container
ResolvedJdforrester-WMFT237479 Update the wikimedia-portals repo's CI/linting code for various security issues
ResolvedJdrewniakT247996 Fix issues with Gulp 4 migration
DuplicateNoneT229276 Fix the data-values/value-view repo to work on node10
ResolvedJdforrester-WMFT230841 Migrate documentation generation to Node 10.15.2 from node 6.11.0
ResolvedJdforrester-WMFT235570 Move the OOUI repo to a new custom docker image for node10 and php72
ResolvedJdforrester-WMFT247536 Migrate mediawiki-core-jsduck-docker-publish off node 6 so it works again

Event Timeline

akosiaris triaged this task as Medium priority.
Comment Actions

Change 587529 had a related patch set uploaded (by Alexandros Kosiaris; owner: Alexandros Kosiaris):
[operations/puppet@production] Remove jessie base images building process

https://gerrit.wikimedia.org/r/587529

Comment Actions

Change 587530 had a related patch set uploaded (by Alexandros Kosiaris; owner: Alexandros Kosiaris):
[operations/puppet@production] profile::docker::builder: Add buster, drop jessie

https://gerrit.wikimedia.org/r/587530

Comment Actions

Change 587530 merged by Alexandros Kosiaris:
[operations/puppet@production] profile::docker::builder: Add buster, drop jessie

https://gerrit.wikimedia.org/r/587530

dancy renamed this task from Trask and remove jessie based container images from production to Track and remove jessie based container images from production.Jun 30 2020, 2:33 PM
hashar subscribed.
Comment Actions

CI stills use Jessie based container from docker-registry.wikimedia.org/wikimedia-jessie . The last remaining task is to have some services migrated out of Jessie/Node6 to Node10 ( T211784 ).

Comment Actions

Change 587529 merged by Alexandros Kosiaris:
[operations/puppet@production] Remove jessie base images building process

https://gerrit.wikimedia.org/r/c/operations/puppet/ /587529

Comment Actions

CI still had some usage of which got removed in July 2020. I have missed the deletion of the image until docker-pkg recently started to try to pull the image and bails out due to its non existence.

I have thus phased out all the CI images based on Jessie. The last uses were for tilerator/karthoterian/3d2png which still had NodeJS 6 / npm 3 based jobs. They should be moved to NodeJS 10 / npm 6 eventually as they get migrated to the Pipeline and k8s. The tasks are:

Those repositories do not have CI jobs anymore. For production, those services do not use Docker images afaik. So I guess this task is completed?

akosiaris claimed this task.
Comment Actions

And with that, I think indeed we can close this task. Production has dropped jessie support for some time now and doesn't depend on any jessie image as well, /me boldy resolving this. Many thanks!

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits