Commit graph

87 commits

Author SHA1 Message Date
Matt Turner e357bcd867 tools: Add SSH_CMD array
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 20:56:27 -05:00
Matt Turner 3d95cec60b tools: Add UPLOAD_KEY
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 19:01:29 -05:00
Matt Turner 5515e89048 tools: Add UPLOAD_USER variable
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 18:46:08 -05:00
Matt Turner c157adaf1b tools: Remove some uses of ARCH
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 18:40:03 -05:00
Matt Turner c6404520ed tools: Drop TYPE assignments
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 18:25:39 -05:00
Ben Kohler f7891ac366
tools/catalyst-auto-{amd64,x86}.conf: fix update_symlinks globbing
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-08-12 10:43:54 -05:00
Ben Kohler 6fbf103e56
cataylst-auto-amd64.conf: disable stage4 builds
No longer needed, per prometheanfire

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-07-06 16:48:03 -05:00
Ben Kohler 6e5eb93fb3
catalyst-auto-amd64.conf: re-enable selinux builds
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-06-30 05:38:47 -05:00
Ben Kohler c0ebcf37c7
catalyst-auto-amd64.conf: missing amd64- in systemd stage3 filenames
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-25 06:09:56 -05:00
Matt Turner a24359b95c amd64: Add systemd specs
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-05-21 18:46:51 -07:00
Ben Kohler a1f347da83
catalyst-auto-amd64.conf: disable selinux builds for now
Due to https://bugs.gentoo.org/722108 , selinux stable builds cannot
possibly succeed right now.  We are wasting lots of hours in update_seed
since that part cannot be cached.  We can re-enable them when
https://bugs.gentoo.org/714376 is fixed (stabilization).

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-20 08:52:43 -05:00
Ben Kohler ef26f9a26f
catalyst-auto-{amd64,x86}*.conf: add info echo to post_build
Added a small debug echo so that post_build.log shows some information
about what's being uploaded.  Might add destination info later.

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-17 10:31:07 -05:00
Ben Kohler 60a1326315
catalyst-auto-{amd64,x86}*.conf: change cmd array to upload function
Use an easier-to-read "upload" function in place of "${cmd[@]}" array
syntax.  Added a helper var UPLOAD_DEST to be set in advance so that
upload function takes only a list of filenames to be uploaded.

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-15 12:34:12 -05:00
Ben Kohler 915dc435ff
catalyst-auto-amd64*.conf: explicitly list files to be transferred
Previously when we were copying locally there was no (major) problem
with wildcarding a long list of files to be transferred after every
single spec finishes.  Now that we are transferring to a remote host,
this results in a lot of wasted transfer time & bandwidth.

I have adjusted the post_build function to only transfer the new files
known to be produced by each spec (which has files meant to be
published).

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-15 07:40:02 -05:00
Robin H. Johnson affe649205
catalyst-auto: no special behavior for nightheron copy anymore
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2020-05-11 22:14:35 -07:00
Matt Turner 8407af57f5 Remove weekly directory
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-28 18:18:02 -07:00
Matt Turner e9ea15ab8b Upload stages to releng-incoming.gentoo.org
Most architecture's build systems are hosted at OSUOSL. The place the
stages need to end up is ultimately masterreleases.gentoo.org, also at
OSUOSL. For some unknown reason, instead of rsync'ing from one system to
another in the same building, we were sending the stages first (slowly,
I might add) to nightheron in France, before sending them back to
OSUOSL.

robbat2 has added a releng-incoming.gentoo.org DNS record that currently
points to nightheron. This will allow us to switch the record in the
future and save the stages from needing to circumnavigate the globe
before reaching the mirrors.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-25 22:18:34 -07:00
Matt Turner 8f5cec8809 Revert "Upload stages to releng-incoming.gentoo.org"
This causes an interactive prompt:

    Are you sure you want to continue connecting (yes/no/[fingerprint])?

The plan is to get the SSH fingerprint via DNSSEC, so I'll revert this
change until that is in place and wired up.

This reverts commit 63174346f2.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-23 14:41:13 -07:00
Matt Turner 63174346f2 Upload stages to releng-incoming.gentoo.org
Most architecture's build systems are hosted at OSUOSL. The place the
stages need to end up is ultimately masterreleases.gentoo.org, also at
OSUOSL. For some unknown reason, instead of rsync'ing from one system to
another in the same building, we were sending the stages first (slowly,
I might add) to nightheron in France, before sending them back to
OSUOSL.

robbat2 has added a releng-incoming.gentoo.org DNS record that currently
points to nightheron. This will allow us to switch the record in the
future and save the stages from needing to circumnavigate the globe
before reaching the mirrors.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-23 00:14:11 -07:00
Matt Turner 492aacba77 catalyst-auto: Combine common functions
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2019-09-01 19:04:59 -07:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) ce743c3886 Stop building the admincd for selinux.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2019-06-07 00:37:34 +00:00
Matthew Thode b7ec6e6805
remove systemd cruft 2018-03-02 10:19:08 -06:00
Matthew Thode 71795cbe91
Revert "enable systemd stage generation"
This reverts commit 60d2a138de.

using blueness's run-systemd stuff
2018-03-02 09:04:04 -06:00
Matthew Thode dda62ba027
Revert "add systemd to sets"
This reverts commit f249d95649.

using blueness's run-systemd stuff
2018-03-02 09:03:25 -06:00
Matthew Thode f249d95649
add systemd to sets 2018-03-02 06:36:07 -06:00
Matthew Thode 60d2a138de
enable systemd stage generation 2018-03-02 06:32:59 -06:00
Matthew Thode 57a5bfeb2a
Revert "move stage4 build integration stages into a subdir"
This reverts commit 11ccab53f8.
2018-02-04 18:21:25 -06:00
Matthew Thode 11ccab53f8
move stage4 build integration stages into a subdir 2018-02-04 17:06:42 -06:00
Mike Frysinger 8f6370f8b3 catalyst-auto: run update_symlinks by default in pre_build
All configs defining update_symlinks run it in pre_build, and all the
other configs will want to do the same.  So make it the default in the
pre_build phase.
2018-01-15 20:42:19 -05:00
Mike Frysinger a8e70e1976 catalyst-auto: move git update into main script
All of our config files are doing this already, so move it into the
common code.
2018-01-15 20:17:43 -05:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 93bc214182 Sync amd64 and x86 base and experimental scripts. Add a few missing popd calls to base scripts.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2017-12-27 01:54:39 -01:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 0c3d971bfb Fix typo.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2017-12-22 11:29:30 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 495425ec6a Drop old set definition.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2017-12-22 11:22:26 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 3190fadba2 Use 2 vars for destinations (one for default and another for hardened).
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2017-12-22 11:02:44 +00:00
Robin H. Johnson 0292a7e2b5
tools/catalyst-auto-{x86,amd64}: refactor post_build for remote buildhost.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-14 21:48:20 -08:00
Robin H. Johnson d9f56a2c95
tools/catalyst-auto-amd64: stage4 builds should be optional.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-14 21:28:22 -08:00
Robin H. Johnson a5c5c7faad
catalyst-auto-amd64: verbosely update_symlinks.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-14 19:39:33 -08:00
Robin H. Johnson c19080d5f4
catalyst-auto: tweak timestamp.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-08 00:04:40 -08:00
Robin H. Johnson ed258c751b
tools/catalyst-auto: change datestamp->timestamp
Prepare for doing multiple automated runs in a single day on
newer/faster build systems.

Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-07 23:40:38 -08:00
Matthew Thode c65a620930
remove stage4 cloud stages from tools/catalyst-auto-amd64.conf 2017-12-03 15:20:03 -06:00
Robin H. Johnson e243f99edf
catalyst-auto: squelch all pushd/popd
Have some sed magic, including a negative match.

git grep -l -e pushd -e popd \
| xargs sed -i -r \
  -e '/(pushd|popd)/{ /null/! { s,$, >/dev/null,g } }'

Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2016-06-14 18:31:06 -07:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) bac6e3a2d7 Move the code to update symlinks to a separate function, call it from pre_build and after each set build.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2016-05-05 10:07:20 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 11c84ac57d Whitespace. Stop hardcoding the bz2 extension and sync updates to the scripts to the experimental scripts.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2016-04-26 22:35:19 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 39a3b94b39 Forgot to disable the systemd stage building.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2016-03-13 22:46:14 -01:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 13528ad4e1 Add alternative systemd stages.
I'm going to use this in my build server. The official stages are being built by Anthony.

Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2016-03-13 22:43:20 -01:00
Matthew Thode 06359b3c67
fix typo in catalyst config 2016-01-25 23:49:19 -06:00
Matthew Thode 56eaf4245f
enabling new minimal stage4 specs 2016-01-25 18:44:12 -06:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 656ca16378 Enable selinux stages.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2016-01-13 21:12:39 -01:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) e7ded9f8dd Update catalyst-auto scripts for amd64 / x86 to add support for more targets and improve the detection / copy of stages.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2015-12-27 02:37:12 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) bc954c38f2 Fix another spec name typo.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2015-12-18 02:54:15 +00:00