Commit graph

411 commits

Author SHA1 Message Date
Andreas K. Hüttel 7189beaa5b
amd64: move selinux builds to demeter
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-10 19:54:21 +02:00
Andreas K. Hüttel 91376d48df
amd64: move "normal" multilib builds to demeter
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-10 19:28:33 +02:00
Andreas K. Hüttel b891ceb599
amd64: move amd64 hardened-nomultilib to demeter
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-10 19:15:23 +02:00
Andreas K. Hüttel cf6f590d35
amd64: move hardened multilib builds to demeter
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-09 22:00:57 +02:00
Andreas K. Hüttel cf7151f6a9
amd64: move nomultilib builds to demeter
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-08 22:03:36 +02:00
Andreas K. Hüttel bf734239db
amd64: make flat upload directory, no subdirs
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-08 10:25:45 +02:00
Andreas K. Hüttel c603ac1a75
amd64: migrate the x32 stages to demeter, move musl to subdir
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-07 20:25:19 +02:00
Andreas K. Hüttel 7ab4ecfe70
x86: fix admincd filename
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-07 01:02:24 +02:00
Andreas K. Hüttel 942e73d16d
x86: build musl last, works fine now
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-07 01:02:21 +02:00
Andreas K. Hüttel a59843d9bd
x86: delete obsolete catalyst-auto config file
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-06 01:31:13 +02:00
Andreas K. Hüttel 0e939e4cb1
x86: also symlink latest in musl builds dir
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-06 01:21:23 +02:00
Andreas K. Hüttel 1e54abd4ff
x86: Add specs and catalyst-auto job for musl
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-06 00:57:04 +02:00
Andreas K. Hüttel 9f5c1be393
amd64: rename conf file
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-06 00:23:03 +02:00
Andreas K. Hüttel 0422a99519
x86: Move hardened builds from pardalote to demeter
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-04 22:32:28 +02:00
Andreas K. Hüttel 0773a936df
x86: fix e-mail subject
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-04 19:23:59 +02:00
Andreas K. Hüttel 949bc0a212
x86: move i686 builds from demeter to pardalote
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-03 20:46:02 +02:00
Andreas K. Hüttel fc700b0e62
x86: Fix tarball path in c-auto conf
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-02 21:44:51 +02:00
Andreas K. Hüttel 16e795ced4
x86: copy catalyst-auto config for demeter, move i486 there only so far
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-07-02 21:35:06 +02:00
Andreas K. Hüttel 4bedfac795
catalyst-auto: also here, move riscv64 stages back to build-type default
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-06-29 23:11:54 +02:00
Andreas K. Hüttel b4823a0904
riscv: add multilib/systemd stages
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-06-25 21:16:59 +02:00
Andreas K. Hüttel 6abc54887e
riscv: also upload 20.0 multilib
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-06-25 21:07:25 +02:00
Andreas K. Hüttel cc9a2bf23d
riscv: enable multilib autobuild
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-06-23 18:13:43 +02:00
Andreas K. Hüttel 7df0e0824b
riscv: stop 17.0 stage builds now that 20.0 works
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-06-19 15:03:33 +02:00
Andreas K. Hüttel 53d7a6a3ab
riscv: Add 20.0 lp64 (softfloat) builds
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-06-18 00:49:08 +02:00
Andreas K. Hüttel 79129d9161
riscv: skip stage2 everywhere, go stage1 -> stage3
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-06-16 23:28:27 +02:00
Andreas K. Hüttel 5413402d5a
Fix riscv upload instructions
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-06-15 16:18:37 +02:00
Andreas K. Hüttel ca22d0bbc6
Add riscv64-lp64d stages with libdir=lib64 to the autobuilds
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-06-11 18:11:01 +02:00
Georgy Yakovlev 3b9621a436
tools/catalyst-auto-ppc.conf: enable ppc64 hardened musl builds
Signed-off-by: Georgy Yakovlev <gyakovlev@gentoo.org>
2021-05-30 23:18:35 -07:00
Georgy Yakovlev c2cc59941d
tools/catalyst-auto-ppc64le.conf: enable installcd builds
Signed-off-by: Georgy Yakovlev <gyakovlev@gentoo.org>
2021-05-30 14:38:01 -07:00
Andreas K. Hüttel 3ed274bd9c
Fix musl upload logic
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-05-19 21:50:10 +02:00
Georgy Yakovlev 3a593f2872
releases: add ppc64le installcd specs and kconfigs, disabled
add files required to build ppc64le iso

kernel is tested on PowerNV/OpenPower hardware (Talos II, Blackbird)
also known to work on pSeries servers and qemu pSeries emulation.

both 4K and 64K PAGESZ kernels are provided.

Signed-off-by: Georgy Yakovlev <gyakovlev@gentoo.org>
2021-05-13 09:41:03 -07:00
Georgy Yakovlev 9740ac8c55
tools/catalyst-auto-ppc.conf: optionally build musl specs, disabled until tested
Signed-off-by: Georgy Yakovlev <gyakovlev@gentoo.org>
2021-05-12 16:56:15 -07:00
Georgy Yakovlev 23d5c9acbf
tools: adjust ppc basedir
don't cd into default, prepend default/ to each file.

Signed-off-by: Georgy Yakovlev <gyakovlev@gentoo.org>
2021-05-12 16:48:01 -07:00
Andreas K. Hüttel 4087e82ce0
Minor changes amd64/musl: shift path components between variables
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-05-08 15:55:09 +02:00
Andreas K. Hüttel 3be1f70b59
Activate musl-hardened set
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-05-02 04:26:50 +02:00
Andreas K. Hüttel 506c8f79a5
Fix path, again
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-05-01 22:53:29 +02:00
Andreas K. Hüttel 6e6811f188
Fix directory path
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-05-01 22:46:36 +02:00
Andreas K. Hüttel 1151b7a5c0
Add experimental musl catalust-auto config file
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-05-01 22:21:52 +02:00
Andreas K. Hüttel a6601df900
tools/: don't build the hidden riscv-multilib for now, needs manual work
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-04-05 21:34:25 +02:00
Matt Turner 2a8050450c
tools: Readd ARCH/TYPE assignments
These are used in the sourced .env file.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-31 23:03:24 -05:00
Matt Turner 7b51adc752
tools: Simplify nonetwork handling
... and fix the indentation.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-31 18:27:13 -05:00
Matt Turner 174254bbb1
tools: Include post_build.log contents when successful
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-31 18:22:07 -05:00
Matt Turner a309ae36ac
tools: Log non-uploaded stages when they finish
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-31 18:06:09 -05:00
Matt Turner 22d3877eb4
tools: Correct ARM stage names
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-31 18:00:32 -05:00
Matt Turner 7ec486fab4 tools: Consolidate upload() function
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 20:57:12 -05:00
Matt Turner 8f478fe30b tools: Add UPLOAD_DEST
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 20:56:43 -05:00
Matt Turner 33ce8acb57 tools: Use same set of RSYNC_OPTS
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 20:56:43 -05:00
Matt Turner 4de1432aa1 tools: Add RSYNC_OPTS array
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 20:56:43 -05:00
Matt Turner e357bcd867 tools: Add SSH_CMD array
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 20:56:27 -05:00
Matt Turner 3d95cec60b tools: Add UPLOAD_KEY
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 19:01:29 -05:00
Matt Turner 5515e89048 tools: Add UPLOAD_USER variable
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 18:46:08 -05:00
Matt Turner 16b0dfbc2e tools: Remove REPO_DIR assignment
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 18:44:32 -05:00
Matt Turner c157adaf1b tools: Remove some uses of ARCH
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 18:40:03 -05:00
Matt Turner c6404520ed tools: Drop TYPE assignments
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 18:25:39 -05:00
Matt Turner c98c9ff401 tools: Use new ssh key
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 14:25:36 -05:00
Andreas K. Hüttel e87d9d4474
catalyst-auto-qemu-riscv: fix upload filename
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-25 09:17:45 +02:00
Andreas K. Hüttel b8c1579463
Update catalyst-auto-arm.conf from qemu copy
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-19 23:31:28 +02:00
Andreas K. Hüttel e486326b97
catalyst-auto: fix e-mail subject
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-19 22:43:46 +02:00
Andreas K. Hüttel 683c6a1a41
qemu/arm: Build stage3 from stage1
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-17 23:05:01 +02:00
Andreas K. Hüttel b42197cbec
Fix latest symlinking
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-15 21:54:33 +02:00
Andreas K. Hüttel 6c2559e2d4
Fix typo in catalyst-auto config file
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-15 21:51:41 +02:00
Andreas K. Hüttel c9835278cc
Simplify qemu-arm specs directory structure
catalyst-auto seems to have trouble with second level subdirs

Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-13 04:27:45 +02:00
Andreas K. Hüttel bb1e7293ac
Add catalyst-auto conf for qemu arm builds
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-09 01:21:37 +02:00
Andreas K. Hüttel 2799d0c752
Move qemu-based specs into separate dir for the moment
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-08 22:19:56 +02:00
Andreas K. Huettel 0c7067713b
Add catalyst-auto option --nonetwork
Signed-off-by: Andreas K. Huettel <dilfridge@gentoo.org>
2021-01-08 22:09:03 +02:00
Andreas K. Hüttel 1d76d127db
Add ilp32 specs set
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2020-12-21 16:14:06 +02:00
Matt Turner e02f16792b tools: Skip copying nonexistent kconfigs
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-12-17 17:20:31 -05:00
Matt Turner af8ffec8e7 tools/ppc64le: Handle musl-hardened/ directory
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-12-15 18:29:20 -05:00
Andreas K. Hüttel 05a8acdfe0
Add riscv64 systemd stages to autobuild
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2020-12-04 16:46:25 +02:00
Matt Turner 292177ad43 Revert "specs/ppc/ppc64le: Disable musl builds"
This reverts commit 3c5ff69f32.

In catalyst commit 3be3ac84 ("arch/ppc.toml: add CHOST based subarches")
we've added subarches for 'powerpc', 'powerpc64', and 'powerpc64le', so
these stage builds should now work.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-10-21 12:00:28 -07:00
Matt Turner 3c5ff69f32 specs/ppc/ppc64le: Disable musl builds
They don't work with latest catalyst.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-10-15 10:55:26 -07:00
Georgy Yakovlev 8cd33e80e0 specs/ppc/ppc64le: add systemd specs
Closes: https://github.com/gentoo/releng/pull/5
Signed-off-by: Georgy Yakovlev <gyakovlev@gentoo.org>
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-10-14 17:22:52 -07:00
Georgy Yakovlev 1e93058770 specs/ppc/ppc64le: add musl-hardened specs
Closes: https://github.com/gentoo/releng/pull/5
Signed-off-by: Georgy Yakovlev <gyakovlev@gentoo.org>
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-10-14 17:22:43 -07:00
Andreas K. Huettel e2d27f67f5
catalyst-auto: Allow parallel building of spec sets
This assumes that the spec sets are logically independent from each other,
i.e., building different ABIs.

Code shamelessly adapted from locale-gen.

Signed-off-by: Andreas K. Huettel <dilfridge@gentoo.org>
2020-08-29 15:33:37 +03:00
Matt Turner 84660f02fc specs/arm64: Add systemd specs
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-08-17 15:13:53 -07:00
Matt Turner e41e548f4b specs/arm64: Build stage3 from stage1
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-08-17 15:13:53 -07:00
Matt Turner a4866ae215 arm64: Upload xz stages to arm64@
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-08-17 15:13:53 -07:00
Ben Kohler f7891ac366
tools/catalyst-auto-{amd64,x86}.conf: fix update_symlinks globbing
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-08-12 10:43:54 -05:00
Andreas K. Hüttel d850a7c5e0
riscv: no upload -> no dnssec needed for now
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2020-07-28 14:14:42 +03:00
Andreas K. Hüttel bb47dd2aa1
riscv: no e-mails for now
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2020-07-28 13:59:28 +03:00
Andreas K. Hüttel afffdb8273
Add first experimental riscv catalyst-auto-riscv.conf
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2020-07-28 02:13:35 +03:00
Ben Kohler 6fbf103e56
cataylst-auto-amd64.conf: disable stage4 builds
No longer needed, per prometheanfire

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-07-06 16:48:03 -05:00
Ben Kohler 6e5eb93fb3
catalyst-auto-amd64.conf: re-enable selinux builds
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-06-30 05:38:47 -05:00
Mike Frysinger 0d1104d04f catalyst-auto: fix preclean logic after snapshot changes
The snapshot generation logic was moved earlier in the build (before
the cleaning logic) which caused the preclean to nuke the freshly
generated cache.  Move all the preclean logic back up before that.

Signed-off-by: Mike Frysinger <vapier@gentoo.org>
2020-05-31 12:43:59 -04:00
Mike Frysinger cfc55d1712 catalyst-auto: standardize indentation
This file uses tabs in most of it, so migrate the few funcs using
spaces over to tabs.

Signed-off-by: Mike Frysinger <vapier@gentoo.org>
2020-05-31 12:32:02 -04:00
Ben Kohler 5bfe6e81dc
catalyst-auto-x86.conf: add missing -systemd suffix on upload call
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-26 06:45:56 -05:00
Ben Kohler bb01692c4f
catalyst-auto-x86.conf: fix i686-systemd setup
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-25 13:53:27 -05:00
Ben Kohler c0ebcf37c7
catalyst-auto-amd64.conf: missing amd64- in systemd stage3 filenames
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-25 06:09:56 -05:00
Matt Turner dfec6c432d x86: Add systemd specs
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-05-21 18:49:19 -07:00
Matt Turner a24359b95c amd64: Add systemd specs
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-05-21 18:46:51 -07:00
Ben Kohler a1f347da83
catalyst-auto-amd64.conf: disable selinux builds for now
Due to https://bugs.gentoo.org/722108 , selinux stable builds cannot
possibly succeed right now.  We are wasting lots of hours in update_seed
since that part cannot be cached.  We can re-enable them when
https://bugs.gentoo.org/714376 is fixed (stabilization).

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-20 08:52:43 -05:00
Matt Turner 23c58990ce tools: Drop catalyst-auto-*-experimental.conf
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-05-17 15:31:25 -07:00
Matt Turner a09f3dfda4 catalyst-auto: Don't send useless failure email
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-05-17 15:29:53 -07:00
Ben Kohler ef26f9a26f
catalyst-auto-{amd64,x86}*.conf: add info echo to post_build
Added a small debug echo so that post_build.log shows some information
about what's being uploaded.  Might add destination info later.

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-17 10:31:07 -05:00
Ben Kohler 60a1326315
catalyst-auto-{amd64,x86}*.conf: change cmd array to upload function
Use an easier-to-read "upload" function in place of "${cmd[@]}" array
syntax.  Added a helper var UPLOAD_DEST to be set in advance so that
upload function takes only a list of filenames to be uploaded.

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-15 12:34:12 -05:00
Ben Kohler 151b13ac96
catalyst-auto-x86*.conf: explicitly list files to be transferred
Previously when we were copying locally there was no (major) problem
with wildcarding a long list of files to be transferred after every
single spec finishes.  Now that we are transferring to a remote host,
this results in a lot of wasted transfer time & bandwidth.

I have adjusted the post_build function to only transfer the new files
known to be produced by each spec (which has files meant to be
published).

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-15 08:02:33 -05:00
Ben Kohler 915dc435ff
catalyst-auto-amd64*.conf: explicitly list files to be transferred
Previously when we were copying locally there was no (major) problem
with wildcarding a long list of files to be transferred after every
single spec finishes.  Now that we are transferring to a remote host,
this results in a lot of wasted transfer time & bandwidth.

I have adjusted the post_build function to only transfer the new files
known to be produced by each spec (which has files meant to be
published).

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-15 07:40:02 -05:00
Robin H. Johnson 703d2ef0c1
catalyst-auto: print full path to specfile for the email
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2020-05-11 22:47:03 -07:00
Robin H. Johnson 62bfd232bb
catalyst-auto: defer purge until all sets are done
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2020-05-11 22:46:34 -07:00
Robin H. Johnson affe649205
catalyst-auto: no special behavior for nightheron copy anymore
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2020-05-11 22:14:35 -07:00