Commit graph

296 commits

Author SHA1 Message Date
Andreas K. Hüttel 1d76d127db
Add ilp32 specs set
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2020-12-21 16:14:06 +02:00
Matt Turner e02f16792b tools: Skip copying nonexistent kconfigs
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-12-17 17:20:31 -05:00
Matt Turner af8ffec8e7 tools/ppc64le: Handle musl-hardened/ directory
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-12-15 18:29:20 -05:00
Andreas K. Hüttel 05a8acdfe0
Add riscv64 systemd stages to autobuild
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2020-12-04 16:46:25 +02:00
Matt Turner 292177ad43 Revert "specs/ppc/ppc64le: Disable musl builds"
This reverts commit 3c5ff69f32.

In catalyst commit 3be3ac84 ("arch/ppc.toml: add CHOST based subarches")
we've added subarches for 'powerpc', 'powerpc64', and 'powerpc64le', so
these stage builds should now work.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-10-21 12:00:28 -07:00
Matt Turner 3c5ff69f32 specs/ppc/ppc64le: Disable musl builds
They don't work with latest catalyst.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-10-15 10:55:26 -07:00
Georgy Yakovlev 8cd33e80e0 specs/ppc/ppc64le: add systemd specs
Closes: https://github.com/gentoo/releng/pull/5
Signed-off-by: Georgy Yakovlev <gyakovlev@gentoo.org>
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-10-14 17:22:52 -07:00
Georgy Yakovlev 1e93058770 specs/ppc/ppc64le: add musl-hardened specs
Closes: https://github.com/gentoo/releng/pull/5
Signed-off-by: Georgy Yakovlev <gyakovlev@gentoo.org>
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-10-14 17:22:43 -07:00
Andreas K. Huettel e2d27f67f5
catalyst-auto: Allow parallel building of spec sets
This assumes that the spec sets are logically independent from each other,
i.e., building different ABIs.

Code shamelessly adapted from locale-gen.

Signed-off-by: Andreas K. Huettel <dilfridge@gentoo.org>
2020-08-29 15:33:37 +03:00
Matt Turner 84660f02fc specs/arm64: Add systemd specs
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-08-17 15:13:53 -07:00
Matt Turner e41e548f4b specs/arm64: Build stage3 from stage1
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-08-17 15:13:53 -07:00
Matt Turner a4866ae215 arm64: Upload xz stages to arm64@
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-08-17 15:13:53 -07:00
Ben Kohler f7891ac366
tools/catalyst-auto-{amd64,x86}.conf: fix update_symlinks globbing
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-08-12 10:43:54 -05:00
Andreas K. Hüttel d850a7c5e0
riscv: no upload -> no dnssec needed for now
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2020-07-28 14:14:42 +03:00
Andreas K. Hüttel bb47dd2aa1
riscv: no e-mails for now
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2020-07-28 13:59:28 +03:00
Andreas K. Hüttel afffdb8273
Add first experimental riscv catalyst-auto-riscv.conf
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2020-07-28 02:13:35 +03:00
Ben Kohler 6fbf103e56
cataylst-auto-amd64.conf: disable stage4 builds
No longer needed, per prometheanfire

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-07-06 16:48:03 -05:00
Ben Kohler 6e5eb93fb3
catalyst-auto-amd64.conf: re-enable selinux builds
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-06-30 05:38:47 -05:00
Mike Frysinger 0d1104d04f catalyst-auto: fix preclean logic after snapshot changes
The snapshot generation logic was moved earlier in the build (before
the cleaning logic) which caused the preclean to nuke the freshly
generated cache.  Move all the preclean logic back up before that.

Signed-off-by: Mike Frysinger <vapier@gentoo.org>
2020-05-31 12:43:59 -04:00
Mike Frysinger cfc55d1712 catalyst-auto: standardize indentation
This file uses tabs in most of it, so migrate the few funcs using
spaces over to tabs.

Signed-off-by: Mike Frysinger <vapier@gentoo.org>
2020-05-31 12:32:02 -04:00
Ben Kohler 5bfe6e81dc
catalyst-auto-x86.conf: add missing -systemd suffix on upload call
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-26 06:45:56 -05:00
Ben Kohler bb01692c4f
catalyst-auto-x86.conf: fix i686-systemd setup
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-25 13:53:27 -05:00
Ben Kohler c0ebcf37c7
catalyst-auto-amd64.conf: missing amd64- in systemd stage3 filenames
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-25 06:09:56 -05:00
Matt Turner dfec6c432d x86: Add systemd specs
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-05-21 18:49:19 -07:00
Matt Turner a24359b95c amd64: Add systemd specs
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-05-21 18:46:51 -07:00
Ben Kohler a1f347da83
catalyst-auto-amd64.conf: disable selinux builds for now
Due to https://bugs.gentoo.org/722108 , selinux stable builds cannot
possibly succeed right now.  We are wasting lots of hours in update_seed
since that part cannot be cached.  We can re-enable them when
https://bugs.gentoo.org/714376 is fixed (stabilization).

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-20 08:52:43 -05:00
Matt Turner 23c58990ce tools: Drop catalyst-auto-*-experimental.conf
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-05-17 15:31:25 -07:00
Matt Turner a09f3dfda4 catalyst-auto: Don't send useless failure email
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-05-17 15:29:53 -07:00
Ben Kohler ef26f9a26f
catalyst-auto-{amd64,x86}*.conf: add info echo to post_build
Added a small debug echo so that post_build.log shows some information
about what's being uploaded.  Might add destination info later.

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-17 10:31:07 -05:00
Ben Kohler 60a1326315
catalyst-auto-{amd64,x86}*.conf: change cmd array to upload function
Use an easier-to-read "upload" function in place of "${cmd[@]}" array
syntax.  Added a helper var UPLOAD_DEST to be set in advance so that
upload function takes only a list of filenames to be uploaded.

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-15 12:34:12 -05:00
Ben Kohler 151b13ac96
catalyst-auto-x86*.conf: explicitly list files to be transferred
Previously when we were copying locally there was no (major) problem
with wildcarding a long list of files to be transferred after every
single spec finishes.  Now that we are transferring to a remote host,
this results in a lot of wasted transfer time & bandwidth.

I have adjusted the post_build function to only transfer the new files
known to be produced by each spec (which has files meant to be
published).

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-15 08:02:33 -05:00
Ben Kohler 915dc435ff
catalyst-auto-amd64*.conf: explicitly list files to be transferred
Previously when we were copying locally there was no (major) problem
with wildcarding a long list of files to be transferred after every
single spec finishes.  Now that we are transferring to a remote host,
this results in a lot of wasted transfer time & bandwidth.

I have adjusted the post_build function to only transfer the new files
known to be produced by each spec (which has files meant to be
published).

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-15 07:40:02 -05:00
Robin H. Johnson 703d2ef0c1
catalyst-auto: print full path to specfile for the email
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2020-05-11 22:47:03 -07:00
Robin H. Johnson 62bfd232bb
catalyst-auto: defer purge until all sets are done
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2020-05-11 22:46:34 -07:00
Robin H. Johnson affe649205
catalyst-auto: no special behavior for nightheron copy anymore
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2020-05-11 22:14:35 -07:00
Ben Kohler 05592ee0b7
catalyst-auto: set DATESTAMP again
This var is still used by some arches' catalyst-auto configs

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-11 13:53:55 -05:00
Matt Turner 635cc00fa9 tools: Combine arm configs
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-05-09 13:58:42 -07:00
Robin H. Johnson 77b29c8686
tools/catalyst-auto: permit OTHER flags in /etc/resolv.conf
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2020-05-07 21:59:19 -07:00
Matt Turner 51d806875e catalyst-auto: Add fallback for unset storedir
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-30 16:12:56 -07:00
Matt Turner 943e1a7181 catalyst-auto: Support sqfs snapshots
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-29 23:04:59 -07:00
Matt Turner 43aa276417 catalyst-auto: Drop unnecessary spec munging
No longer necessary with @TIMESTAMP@.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-29 12:37:50 -07:00
Matt Turner 369e27e399 catalyst-auto: Drop setting @DATESTAMP@
Not used in any of the spec files.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-28 21:36:06 -07:00
Matt Turner 8407af57f5 Remove weekly directory
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-28 18:18:02 -07:00
Matt Turner e24e331fa3 catalyst-auto: Ensure 'options edns0' is in /etc/resolv.conf
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-25 22:23:48 -07:00
Matt Turner e9ea15ab8b Upload stages to releng-incoming.gentoo.org
Most architecture's build systems are hosted at OSUOSL. The place the
stages need to end up is ultimately masterreleases.gentoo.org, also at
OSUOSL. For some unknown reason, instead of rsync'ing from one system to
another in the same building, we were sending the stages first (slowly,
I might add) to nightheron in France, before sending them back to
OSUOSL.

robbat2 has added a releng-incoming.gentoo.org DNS record that currently
points to nightheron. This will allow us to switch the record in the
future and save the stages from needing to circumnavigate the globe
before reaching the mirrors.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-25 22:18:34 -07:00
Matt Turner 7f9d62eae5 ppc: Use StrictHostKeyChecking=no
We're using UserKnownHostsFile=/dev/null to force ssh to use the
fingerprint from DNSSEC, so StrictHostKeyChecking=no just prevents ssh
from asking us to confirm the fingerprint.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-24 20:54:20 -07:00
Matt Turner df596c4815 ppc: Upload stages to releng-incoming.gentoo.org
See commit 63174346f2 for rationale.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-24 11:31:02 -07:00
Matt Turner 17d89ba378 sparc: Upload stages to releng-incoming.gentoo.org
See commit 63174346f2 for rationale.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-23 23:55:57 -07:00
Matt Turner 8f5cec8809 Revert "Upload stages to releng-incoming.gentoo.org"
This causes an interactive prompt:

    Are you sure you want to continue connecting (yes/no/[fingerprint])?

The plan is to get the SSH fingerprint via DNSSEC, so I'll revert this
change until that is in place and wired up.

This reverts commit 63174346f2.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-23 14:41:13 -07:00
Matt Turner 63174346f2 Upload stages to releng-incoming.gentoo.org
Most architecture's build systems are hosted at OSUOSL. The place the
stages need to end up is ultimately masterreleases.gentoo.org, also at
OSUOSL. For some unknown reason, instead of rsync'ing from one system to
another in the same building, we were sending the stages first (slowly,
I might add) to nightheron in France, before sending them back to
OSUOSL.

robbat2 has added a releng-incoming.gentoo.org DNS record that currently
points to nightheron. This will allow us to switch the record in the
future and save the stages from needing to circumnavigate the globe
before reaching the mirrors.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-23 00:14:11 -07:00