Commit graph

407 commits

Author SHA1 Message Date
Matt Turner c98c9ff401 tools: Use new ssh key
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 14:25:36 -05:00
Andreas K. Hüttel e87d9d4474
catalyst-auto-qemu-riscv: fix upload filename
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-25 09:17:45 +02:00
Andreas K. Hüttel b8c1579463
Update catalyst-auto-arm.conf from qemu copy
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-19 23:31:28 +02:00
Andreas K. Hüttel e486326b97
catalyst-auto: fix e-mail subject
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-19 22:43:46 +02:00
Andreas K. Hüttel 683c6a1a41
qemu/arm: Build stage3 from stage1
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-17 23:05:01 +02:00
Andreas K. Hüttel b42197cbec
Fix latest symlinking
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-15 21:54:33 +02:00
Andreas K. Hüttel 6c2559e2d4
Fix typo in catalyst-auto config file
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-15 21:51:41 +02:00
Andreas K. Hüttel c9835278cc
Simplify qemu-arm specs directory structure
catalyst-auto seems to have trouble with second level subdirs

Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-13 04:27:45 +02:00
Andreas K. Hüttel bb1e7293ac
Add catalyst-auto conf for qemu arm builds
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-09 01:21:37 +02:00
Andreas K. Hüttel 2799d0c752
Move qemu-based specs into separate dir for the moment
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2021-01-08 22:19:56 +02:00
Andreas K. Huettel 0c7067713b
Add catalyst-auto option --nonetwork
Signed-off-by: Andreas K. Huettel <dilfridge@gentoo.org>
2021-01-08 22:09:03 +02:00
Andreas K. Hüttel 1d76d127db
Add ilp32 specs set
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2020-12-21 16:14:06 +02:00
Matt Turner e02f16792b tools: Skip copying nonexistent kconfigs
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-12-17 17:20:31 -05:00
Matt Turner af8ffec8e7 tools/ppc64le: Handle musl-hardened/ directory
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-12-15 18:29:20 -05:00
Andreas K. Hüttel 05a8acdfe0
Add riscv64 systemd stages to autobuild
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2020-12-04 16:46:25 +02:00
Matt Turner 292177ad43 Revert "specs/ppc/ppc64le: Disable musl builds"
This reverts commit 3c5ff69f32.

In catalyst commit 3be3ac84 ("arch/ppc.toml: add CHOST based subarches")
we've added subarches for 'powerpc', 'powerpc64', and 'powerpc64le', so
these stage builds should now work.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-10-21 12:00:28 -07:00
Matt Turner 3c5ff69f32 specs/ppc/ppc64le: Disable musl builds
They don't work with latest catalyst.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-10-15 10:55:26 -07:00
Georgy Yakovlev 8cd33e80e0 specs/ppc/ppc64le: add systemd specs
Closes: https://github.com/gentoo/releng/pull/5
Signed-off-by: Georgy Yakovlev <gyakovlev@gentoo.org>
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-10-14 17:22:52 -07:00
Georgy Yakovlev 1e93058770 specs/ppc/ppc64le: add musl-hardened specs
Closes: https://github.com/gentoo/releng/pull/5
Signed-off-by: Georgy Yakovlev <gyakovlev@gentoo.org>
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-10-14 17:22:43 -07:00
Andreas K. Huettel e2d27f67f5
catalyst-auto: Allow parallel building of spec sets
This assumes that the spec sets are logically independent from each other,
i.e., building different ABIs.

Code shamelessly adapted from locale-gen.

Signed-off-by: Andreas K. Huettel <dilfridge@gentoo.org>
2020-08-29 15:33:37 +03:00
Matt Turner 84660f02fc specs/arm64: Add systemd specs
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-08-17 15:13:53 -07:00
Matt Turner e41e548f4b specs/arm64: Build stage3 from stage1
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-08-17 15:13:53 -07:00
Matt Turner a4866ae215 arm64: Upload xz stages to arm64@
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-08-17 15:13:53 -07:00
Ben Kohler f7891ac366
tools/catalyst-auto-{amd64,x86}.conf: fix update_symlinks globbing
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-08-12 10:43:54 -05:00
Andreas K. Hüttel d850a7c5e0
riscv: no upload -> no dnssec needed for now
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2020-07-28 14:14:42 +03:00
Andreas K. Hüttel bb47dd2aa1
riscv: no e-mails for now
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2020-07-28 13:59:28 +03:00
Andreas K. Hüttel afffdb8273
Add first experimental riscv catalyst-auto-riscv.conf
Signed-off-by: Andreas K. Hüttel <dilfridge@gentoo.org>
2020-07-28 02:13:35 +03:00
Ben Kohler 6fbf103e56
cataylst-auto-amd64.conf: disable stage4 builds
No longer needed, per prometheanfire

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-07-06 16:48:03 -05:00
Ben Kohler 6e5eb93fb3
catalyst-auto-amd64.conf: re-enable selinux builds
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-06-30 05:38:47 -05:00
Mike Frysinger 0d1104d04f catalyst-auto: fix preclean logic after snapshot changes
The snapshot generation logic was moved earlier in the build (before
the cleaning logic) which caused the preclean to nuke the freshly
generated cache.  Move all the preclean logic back up before that.

Signed-off-by: Mike Frysinger <vapier@gentoo.org>
2020-05-31 12:43:59 -04:00
Mike Frysinger cfc55d1712 catalyst-auto: standardize indentation
This file uses tabs in most of it, so migrate the few funcs using
spaces over to tabs.

Signed-off-by: Mike Frysinger <vapier@gentoo.org>
2020-05-31 12:32:02 -04:00
Ben Kohler 5bfe6e81dc
catalyst-auto-x86.conf: add missing -systemd suffix on upload call
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-26 06:45:56 -05:00
Ben Kohler bb01692c4f
catalyst-auto-x86.conf: fix i686-systemd setup
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-25 13:53:27 -05:00
Ben Kohler c0ebcf37c7
catalyst-auto-amd64.conf: missing amd64- in systemd stage3 filenames
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-25 06:09:56 -05:00
Matt Turner dfec6c432d x86: Add systemd specs
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-05-21 18:49:19 -07:00
Matt Turner a24359b95c amd64: Add systemd specs
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-05-21 18:46:51 -07:00
Ben Kohler a1f347da83
catalyst-auto-amd64.conf: disable selinux builds for now
Due to https://bugs.gentoo.org/722108 , selinux stable builds cannot
possibly succeed right now.  We are wasting lots of hours in update_seed
since that part cannot be cached.  We can re-enable them when
https://bugs.gentoo.org/714376 is fixed (stabilization).

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-20 08:52:43 -05:00
Matt Turner 23c58990ce tools: Drop catalyst-auto-*-experimental.conf
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-05-17 15:31:25 -07:00
Matt Turner a09f3dfda4 catalyst-auto: Don't send useless failure email
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-05-17 15:29:53 -07:00
Ben Kohler ef26f9a26f
catalyst-auto-{amd64,x86}*.conf: add info echo to post_build
Added a small debug echo so that post_build.log shows some information
about what's being uploaded.  Might add destination info later.

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-17 10:31:07 -05:00
Ben Kohler 60a1326315
catalyst-auto-{amd64,x86}*.conf: change cmd array to upload function
Use an easier-to-read "upload" function in place of "${cmd[@]}" array
syntax.  Added a helper var UPLOAD_DEST to be set in advance so that
upload function takes only a list of filenames to be uploaded.

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-15 12:34:12 -05:00
Ben Kohler 151b13ac96
catalyst-auto-x86*.conf: explicitly list files to be transferred
Previously when we were copying locally there was no (major) problem
with wildcarding a long list of files to be transferred after every
single spec finishes.  Now that we are transferring to a remote host,
this results in a lot of wasted transfer time & bandwidth.

I have adjusted the post_build function to only transfer the new files
known to be produced by each spec (which has files meant to be
published).

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-15 08:02:33 -05:00
Ben Kohler 915dc435ff
catalyst-auto-amd64*.conf: explicitly list files to be transferred
Previously when we were copying locally there was no (major) problem
with wildcarding a long list of files to be transferred after every
single spec finishes.  Now that we are transferring to a remote host,
this results in a lot of wasted transfer time & bandwidth.

I have adjusted the post_build function to only transfer the new files
known to be produced by each spec (which has files meant to be
published).

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-15 07:40:02 -05:00
Robin H. Johnson 703d2ef0c1
catalyst-auto: print full path to specfile for the email
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2020-05-11 22:47:03 -07:00
Robin H. Johnson 62bfd232bb
catalyst-auto: defer purge until all sets are done
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2020-05-11 22:46:34 -07:00
Robin H. Johnson affe649205
catalyst-auto: no special behavior for nightheron copy anymore
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2020-05-11 22:14:35 -07:00
Ben Kohler 05592ee0b7
catalyst-auto: set DATESTAMP again
This var is still used by some arches' catalyst-auto configs

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-11 13:53:55 -05:00
Matt Turner 635cc00fa9 tools: Combine arm configs
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-05-09 13:58:42 -07:00
Robin H. Johnson 77b29c8686
tools/catalyst-auto: permit OTHER flags in /etc/resolv.conf
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2020-05-07 21:59:19 -07:00
Matt Turner 51d806875e catalyst-auto: Add fallback for unset storedir
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-30 16:12:56 -07:00
Matt Turner 943e1a7181 catalyst-auto: Support sqfs snapshots
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-29 23:04:59 -07:00
Matt Turner 43aa276417 catalyst-auto: Drop unnecessary spec munging
No longer necessary with @TIMESTAMP@.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-29 12:37:50 -07:00
Matt Turner 369e27e399 catalyst-auto: Drop setting @DATESTAMP@
Not used in any of the spec files.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-28 21:36:06 -07:00
Matt Turner 8407af57f5 Remove weekly directory
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-28 18:18:02 -07:00
Matt Turner e24e331fa3 catalyst-auto: Ensure 'options edns0' is in /etc/resolv.conf
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-25 22:23:48 -07:00
Matt Turner e9ea15ab8b Upload stages to releng-incoming.gentoo.org
Most architecture's build systems are hosted at OSUOSL. The place the
stages need to end up is ultimately masterreleases.gentoo.org, also at
OSUOSL. For some unknown reason, instead of rsync'ing from one system to
another in the same building, we were sending the stages first (slowly,
I might add) to nightheron in France, before sending them back to
OSUOSL.

robbat2 has added a releng-incoming.gentoo.org DNS record that currently
points to nightheron. This will allow us to switch the record in the
future and save the stages from needing to circumnavigate the globe
before reaching the mirrors.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-25 22:18:34 -07:00
Matt Turner 7f9d62eae5 ppc: Use StrictHostKeyChecking=no
We're using UserKnownHostsFile=/dev/null to force ssh to use the
fingerprint from DNSSEC, so StrictHostKeyChecking=no just prevents ssh
from asking us to confirm the fingerprint.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-24 20:54:20 -07:00
Matt Turner df596c4815 ppc: Upload stages to releng-incoming.gentoo.org
See commit 63174346f2 for rationale.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-24 11:31:02 -07:00
Matt Turner 17d89ba378 sparc: Upload stages to releng-incoming.gentoo.org
See commit 63174346f2 for rationale.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-23 23:55:57 -07:00
Matt Turner 8f5cec8809 Revert "Upload stages to releng-incoming.gentoo.org"
This causes an interactive prompt:

    Are you sure you want to continue connecting (yes/no/[fingerprint])?

The plan is to get the SSH fingerprint via DNSSEC, so I'll revert this
change until that is in place and wired up.

This reverts commit 63174346f2.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-23 14:41:13 -07:00
Matt Turner 63174346f2 Upload stages to releng-incoming.gentoo.org
Most architecture's build systems are hosted at OSUOSL. The place the
stages need to end up is ultimately masterreleases.gentoo.org, also at
OSUOSL. For some unknown reason, instead of rsync'ing from one system to
another in the same building, we were sending the stages first (slowly,
I might add) to nightheron in France, before sending them back to
OSUOSL.

robbat2 has added a releng-incoming.gentoo.org DNS record that currently
points to nightheron. This will allow us to switch the record in the
future and save the stages from needing to circumnavigate the globe
before reaching the mirrors.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-23 00:14:11 -07:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) cee3787b3f Try to fix the symlink creation for x86 by copying the code form amd64.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2020-02-03 11:02:36 -01:00
Matt Turner 14cc38d97b catalyst-auto: Use xz instead of bz2 for ia64 builds
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2019-10-06 09:26:21 -07:00
Matt Turner dce27f9f28 catalyst-auto: Skip ia64 stage2 builds
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2019-09-05 08:48:26 -07:00
Matt Turner f761d0b717 catalyst-auto: Upload sparc64 systemd stages
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2019-09-02 10:29:59 -07:00
Matt Turner 492aacba77 catalyst-auto: Combine common functions
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2019-09-01 19:04:59 -07:00
Matt Turner 031f5dc976 catalyst-auto: Fix copy-and-paste mistake
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2019-09-01 09:56:43 -07:00
Matt Turner ac2b400659 catalyst-auto: Build sparc systemd stages
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2019-09-01 09:56:30 -07:00
Matt Turner 2779b4af6a catalyst-auto: Update sparc64 conf based on ppc
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2019-08-29 10:39:10 -07:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) ce743c3886 Stop building the admincd for selinux.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2019-06-07 00:37:34 +00:00
Matt Turner 0d88b84262 catalyst-auto: Use xz instead of bz2 for s390 builds
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2019-05-30 14:10:25 -07:00
Matt Turner c02b25b765 catalyst-auto: Skip s390 stage2 builds
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2019-05-30 14:10:25 -07:00
Ben Kohler fff9e2cbc3
catalyst-auto-sparc64.conf: no hardened
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2019-01-11 08:10:59 -06:00
Ben Kohler d8a805cba3
lyst-auto-sparc64.conf: borrow new symlink logic from amd64
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2019-01-09 11:18:48 -06:00
Ben Kohler fe0c440967
catalyst-auto-sparc64.conf: add line wraps
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2019-01-08 20:44:56 -06:00
Ben Kohler 8d05f7d508
catalyst-auto-sparc64.conf: missed some ) in case statement
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2019-01-08 11:34:13 -06:00
Ben Kohler a831d3f149
catalyst-auto-sparc64.conf: redo post_build modeled after ppc
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2019-01-08 11:02:26 -06:00
Ben Kohler 3eb7bc30bc
catalyst-auto-sparc64.conf: only rsync in final post_build call
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2019-01-06 14:38:13 -06:00
Matt Turner bcc0a963dc catalyst-auto-ppc64le.conf: Remove ppc64le subdir
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2019-01-05 15:45:05 -08:00
Matt Turner 12f78e9aa3 catalyst-auto-ppc64le.conf: Move from catalyst-auto-ppc64.conf
catalyst-auto-ppc64.conf is no longer used since ppc and ppc64 builds
are done from catalyst-auto-ppc.conf. Repurpose (and rename) this file
to be used by ppc64le.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2019-01-05 15:01:48 -08:00
Tobias Klausmann 9508b899ce Assorted fixes and changes for Alpha
- Update kconfig for alpha, now including virtio for block/scsi and
  networking, and make all qla drivers modules.
- Add linux-firmware to installer CD.
- Rearrange some variables in tools/catalyst-auto-alpha.conf
- Remove cifs-utils (huge Samba 4 dep)
- Add btrfs-progs
- Remove "static" USE flag, since it causes a USE dep conflict in pam.

Signed-off-by: Tobias Klausmann <klausman@gentoo.org>
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2019-01-05 11:51:59 -08:00
Ben Kohler 52488db7c0
catalyst-auto-sparc64.conf: email to me for now
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2019-01-04 16:50:59 -06:00
Ben Kohler e3ce4e5a48
catalyst-auto-sparc64.conf: path fixups
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2019-01-04 16:49:43 -06:00
Ben Kohler 5ed8b0c8b0
catalyst-auto-sparc64.conf: disable multilib in one more place
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2019-01-04 10:46:35 -06:00
Ben Kohler fecc010220
catalyst-auto-sparc64.conf: fix ARCH
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2019-01-04 10:43:58 -06:00
Ben Kohler d12a8d02cc
catalyst-auto-sparc64.conf: start sourcing build.env
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2019-01-04 10:33:17 -06:00
Ben Kohler fdedd793b6
catalyst-auto-sparc64.conf: stop hardcoding .tar.bz2, no multilib build
As has been done in other arches' specs, allow a list of different
stage3 tarball extensions.  Also disable building of multilib stages.

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2019-01-03 08:30:24 -06:00
Matt Turner 958fe2facf catalyst-auto: Skip alpha stage2 builds 2018-09-17 12:21:14 -07:00
Matt Turner c53e24b4b0 catalyst-auto: Fix more s/ppc/ppc32/ 2018-09-16 20:26:34 -07:00
Matt Turner 53d7357744 catalyst-auto: Build ppc install CD from 32-bit specs 2018-09-16 08:47:10 -07:00
Matt Turner f2398d0b73 catalyst-auto: Build ppc and ppc64 stages from catalyst-auto-ppc.conf 2018-09-16 08:23:26 -07:00
Matt Turner 5c7cf135fe catalyst-auto: Build ppc64 stages from stage{1,3}.spec
Spec files were renamed in commit cf41003f5c ("specs/ppc: Remove
"64ul" from stage names")
2018-09-16 08:11:20 -07:00
Matt Turner 3ee52a24b5 catalyst-auto: Use xz instead of bz2 for powerpc builds 2018-09-16 08:09:38 -07:00
Matt Turner a42ad6e640 catalyst-auto: Build only 64-bit userland on ppc64 and remove '64ul' 2018-09-16 08:08:56 -07:00
Matt Turner 726e5fb33d catalyst-auto: Save powerpc builds in separate directories
Otherwise we write the last_success_file when the first build succeeds
and prevent the second from executing. Both of these sets of builds
should probably be executed from the same catalyst-auto file...
2018-09-16 08:07:10 -07:00
Matt Turner 630f0be613 catalyst-auto: Skip powerpc stage2 builds 2018-09-15 22:47:11 -07:00
Matt Turner 9b75c9336d catalyst-auto: Switch powerpc livecds from ppc64-32ul to ppc 2018-09-15 22:47:11 -07:00
Matt Turner caa080159a catalyst-auto: Don't build ppc64-32ul stages
ppc64-32ul provides nothing that standard 32-bit ppc does not, as far as
I can tell.
2018-09-15 22:47:11 -07:00
Matt Turner d0afafa019 catalyst-auto/hppa: Skip stage2 2018-09-14 11:24:44 -07:00
Matthew Thode b7ec6e6805
remove systemd cruft 2018-03-02 10:19:08 -06:00
Matthew Thode 71795cbe91
Revert "enable systemd stage generation"
This reverts commit 60d2a138de.

using blueness's run-systemd stuff
2018-03-02 09:04:04 -06:00
Matthew Thode dda62ba027
Revert "add systemd to sets"
This reverts commit f249d95649.

using blueness's run-systemd stuff
2018-03-02 09:03:25 -06:00
Matthew Thode f249d95649
add systemd to sets 2018-03-02 06:36:07 -06:00
Matthew Thode 60d2a138de
enable systemd stage generation 2018-03-02 06:32:59 -06:00
Matthew Thode 57a5bfeb2a
Revert "move stage4 build integration stages into a subdir"
This reverts commit 11ccab53f8.
2018-02-04 18:21:25 -06:00
Matthew Thode 11ccab53f8
move stage4 build integration stages into a subdir 2018-02-04 17:06:42 -06:00
Mike Frysinger c63938c5e0 catalyst-auto: run git merge in quiet mode 2018-01-16 11:24:43 -05:00
Mike Frysinger 40ed3e84d7 catalyst-auto: update arch configs after timestamp changes
Commit ed258c751b (change
datestamp->timestamp) broke a lot of builders.  The symlinks
and upload logic were all based on the datestamp.  Update it
to use the new timestamp format.
2018-01-16 02:01:19 -05:00
Mike Frysinger bbca329576 catalyst-auto: log the command in the log file itself
This should make it clear in each log file what is being run, especially
when a phase is run more than once (like post_build).
2018-01-15 22:42:07 -05:00
Mike Frysinger f98bc791e6 catalyst-auto: pass current targets down to post_build
Commit b7e493b4e4 (run trigger_post_build
after every successful spec) broke a lot of builders.  The configs were
written to be called only after everything was done, but by calling it
after the first build (stage1 only), all the other artifacts we expected
did not yet exist.

Change post_build to pass the current set & spec name down so the config
can figure out what is available at that point in time.
2018-01-15 20:52:14 -05:00
Mike Frysinger cb652173f6 catalyst-auto: move remaining configs from pre_build to update_symlinks
All the configs running symlink updates in pre_build can do it in the
update_symlinks callback instead.  Convert them over.
2018-01-15 20:44:31 -05:00
Mike Frysinger 8f6370f8b3 catalyst-auto: run update_symlinks by default in pre_build
All configs defining update_symlinks run it in pre_build, and all the
other configs will want to do the same.  So make it the default in the
pre_build phase.
2018-01-15 20:42:19 -05:00
Mike Frysinger a8e70e1976 catalyst-auto: move git update into main script
All of our config files are doing this already, so move it into the
common code.
2018-01-15 20:17:43 -05:00
Mike Frysinger 04b56eaab3 catalyst-auto: move container logic into a func too
This lets us put it after command line parsing.
2018-01-15 20:13:59 -05:00
Mike Frysinger b291ea4754 catalyst-auto: move all code into functions
Mixing inline funcs and executable code makes it hard to follow and
shuffle ordering of operations.  Put everything other than variables
into functions.

The delta here is large, but it's almost entirely indentation changes.

This also makes updating the script (like `git pull`) more resilient.
2018-01-15 20:11:44 -05:00
Robin H. Johnson 5d73c6b04a
catalyst-auto: add intermediate verbose, that prints the command, but not the output; -vv has old behavior
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-28 21:32:10 -08:00
Robin H. Johnson 731b5886ad
tools: fix typo of DEST_HARDEND
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-28 11:01:26 -08:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 93bc214182 Sync amd64 and x86 base and experimental scripts. Add a few missing popd calls to base scripts.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2017-12-27 01:54:39 -01:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 0c3d971bfb Fix typo.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2017-12-22 11:29:30 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 495425ec6a Drop old set definition.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2017-12-22 11:22:26 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 3190fadba2 Use 2 vars for destinations (one for default and another for hardened).
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2017-12-22 11:02:44 +00:00
Robin H. Johnson af9a181c70
catalyst-auto: fix title.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-15 10:40:07 -08:00
Robin H. Johnson 0292a7e2b5
tools/catalyst-auto-{x86,amd64}: refactor post_build for remote buildhost.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-14 21:48:20 -08:00
Robin H. Johnson bcdd88a2d4
tools/catalyst-auto-sparc64: start common post_build refactor
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-14 21:39:40 -08:00
Robin H. Johnson d9f56a2c95
tools/catalyst-auto-amd64: stage4 builds should be optional.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-14 21:28:22 -08:00
Robin H. Johnson 85bac3a8a2
catalyst-auto: only purge tmpdir+autoresume, not pkgdir.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-14 19:45:09 -08:00
Robin H. Johnson b7e493b4e4
catalyst-auto: run trigger_post_build after every successful spec, to export results sooner.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-14 19:44:41 -08:00
Robin H. Johnson 561af1245f
catalyst-auto/run_cmd: append logs instead of overwrite
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-14 19:44:07 -08:00
Robin H. Johnson a5c5c7faad
catalyst-auto-amd64: verbosely update_symlinks.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-14 19:39:33 -08:00
Robin H. Johnson c19080d5f4
catalyst-auto: tweak timestamp.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-08 00:04:40 -08:00
Robin H. Johnson ed258c751b
tools/catalyst-auto: change datestamp->timestamp
Prepare for doing multiple automated runs in a single day on
newer/faster build systems.

Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-07 23:40:38 -08:00
Robin H. Johnson 44b56bd2f8
catalyst: do not use --purge so we can hit binpkgcache.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-06 23:01:35 -08:00
Robin H. Johnson ad4692b02f
Drop more stage4-cloud.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-03 13:23:35 -08:00
Matthew Thode c65a620930
remove stage4 cloud stages from tools/catalyst-auto-amd64.conf 2017-12-03 15:20:03 -06:00
Matthew Thode 1ce3bc7326
arm64 stage building
this is steev's work
2017-12-01 16:53:39 -06:00
Mike Frysinger 16e8a9fdc4 catalyst-auto: scope ppc upload names
Shouldn't impact current builds, but avoids double uploads when we run
ppc & ppc64 builds on the same system.
2017-03-22 22:16:22 -04:00
Mike Frysinger 1de39bb16d catalyst-auto: use full system hostname by default 2017-03-22 22:14:42 -04:00
Mike Frysinger 9444f99d3d update armin keys to same root path as others 2017-03-22 22:12:54 -04:00
Mike Frysinger e98ae4f69e catalyst-auto: add missing local body in send_email 2016-12-21 20:20:03 -05:00
Mike Frysinger ef83c934a8 catalyst-auto: fix return value passing with run_cmd helper 2016-12-21 20:20:03 -05:00
Mike Frysinger e8186ef489 catalyst-auto: rework run_cmd pass through
Make the logfile the first arg so the rest of the args are the command
to actually run.  This allows us to properly quote arguments.
2016-12-21 20:20:03 -05:00
Mike Frysinger 12b23fa07e catalyst-auto: fix quoting in a number of places 2016-12-21 20:20:03 -05:00
Mike Frysinger 6fd55163c0 catalyst-auto: reject unknown command line arguments 2016-12-21 20:20:03 -05:00
Mike Frysinger d56243723a catalyst-auto: drop unused variables 2016-12-21 20:20:02 -05:00
Robin H. Johnson e243f99edf
catalyst-auto: squelch all pushd/popd
Have some sed magic, including a negative match.

git grep -l -e pushd -e popd \
| xargs sed -i -r \
  -e '/(pushd|popd)/{ /null/! { s,$, >/dev/null,g } }'

Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2016-06-14 18:31:06 -07:00
Robin H. Johnson 3a6d81ff2e
catalyst-auto: do not fail if /usr/bin/time is not present.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2016-05-30 09:13:32 -07:00
Robin H. Johnson 380990612e
catalyst-auto: datestamp tmpdir for ease of debug.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2016-05-27 13:43:08 -07:00
Mike Frysinger bc049160cb stage_build.sh: punt unused script
No one seems to use it or ask about it, so punt it until someone notices.
2016-05-23 22:27:18 -04:00
Mike Frysinger d97b2662fa catalyst-auto: use local in a few more places 2016-05-23 22:02:22 -04:00
Mike Frysinger b86673c791 catalyst-auto: convert echo -e to printf
Makes the code a bit more robust.
2016-05-23 22:00:31 -04:00