Commit graph

62 commits

Author SHA1 Message Date
Matt Turner 2a8050450c
tools: Readd ARCH/TYPE assignments
These are used in the sourced .env file.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-31 23:03:24 -05:00
Matt Turner 7ec486fab4 tools: Consolidate upload() function
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 20:57:12 -05:00
Matt Turner 8f478fe30b tools: Add UPLOAD_DEST
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 20:56:43 -05:00
Matt Turner 4de1432aa1 tools: Add RSYNC_OPTS array
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 20:56:43 -05:00
Matt Turner e357bcd867 tools: Add SSH_CMD array
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 20:56:27 -05:00
Matt Turner 3d95cec60b tools: Add UPLOAD_KEY
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 19:01:29 -05:00
Matt Turner 5515e89048 tools: Add UPLOAD_USER variable
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 18:46:08 -05:00
Matt Turner c157adaf1b tools: Remove some uses of ARCH
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 18:40:03 -05:00
Matt Turner c6404520ed tools: Drop TYPE assignments
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2021-01-30 18:25:39 -05:00
Ben Kohler f7891ac366
tools/catalyst-auto-{amd64,x86}.conf: fix update_symlinks globbing
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-08-12 10:43:54 -05:00
Ben Kohler 5bfe6e81dc
catalyst-auto-x86.conf: add missing -systemd suffix on upload call
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-26 06:45:56 -05:00
Ben Kohler bb01692c4f
catalyst-auto-x86.conf: fix i686-systemd setup
Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-25 13:53:27 -05:00
Matt Turner dfec6c432d x86: Add systemd specs
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-05-21 18:49:19 -07:00
Ben Kohler ef26f9a26f
catalyst-auto-{amd64,x86}*.conf: add info echo to post_build
Added a small debug echo so that post_build.log shows some information
about what's being uploaded.  Might add destination info later.

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-17 10:31:07 -05:00
Ben Kohler 60a1326315
catalyst-auto-{amd64,x86}*.conf: change cmd array to upload function
Use an easier-to-read "upload" function in place of "${cmd[@]}" array
syntax.  Added a helper var UPLOAD_DEST to be set in advance so that
upload function takes only a list of filenames to be uploaded.

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-15 12:34:12 -05:00
Ben Kohler 151b13ac96
catalyst-auto-x86*.conf: explicitly list files to be transferred
Previously when we were copying locally there was no (major) problem
with wildcarding a long list of files to be transferred after every
single spec finishes.  Now that we are transferring to a remote host,
this results in a lot of wasted transfer time & bandwidth.

I have adjusted the post_build function to only transfer the new files
known to be produced by each spec (which has files meant to be
published).

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-15 08:02:33 -05:00
Robin H. Johnson affe649205
catalyst-auto: no special behavior for nightheron copy anymore
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2020-05-11 22:14:35 -07:00
Matt Turner 8407af57f5 Remove weekly directory
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-28 18:18:02 -07:00
Matt Turner e9ea15ab8b Upload stages to releng-incoming.gentoo.org
Most architecture's build systems are hosted at OSUOSL. The place the
stages need to end up is ultimately masterreleases.gentoo.org, also at
OSUOSL. For some unknown reason, instead of rsync'ing from one system to
another in the same building, we were sending the stages first (slowly,
I might add) to nightheron in France, before sending them back to
OSUOSL.

robbat2 has added a releng-incoming.gentoo.org DNS record that currently
points to nightheron. This will allow us to switch the record in the
future and save the stages from needing to circumnavigate the globe
before reaching the mirrors.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-25 22:18:34 -07:00
Matt Turner 8f5cec8809 Revert "Upload stages to releng-incoming.gentoo.org"
This causes an interactive prompt:

    Are you sure you want to continue connecting (yes/no/[fingerprint])?

The plan is to get the SSH fingerprint via DNSSEC, so I'll revert this
change until that is in place and wired up.

This reverts commit 63174346f2.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-23 14:41:13 -07:00
Matt Turner 63174346f2 Upload stages to releng-incoming.gentoo.org
Most architecture's build systems are hosted at OSUOSL. The place the
stages need to end up is ultimately masterreleases.gentoo.org, also at
OSUOSL. For some unknown reason, instead of rsync'ing from one system to
another in the same building, we were sending the stages first (slowly,
I might add) to nightheron in France, before sending them back to
OSUOSL.

robbat2 has added a releng-incoming.gentoo.org DNS record that currently
points to nightheron. This will allow us to switch the record in the
future and save the stages from needing to circumnavigate the globe
before reaching the mirrors.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-23 00:14:11 -07:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) cee3787b3f Try to fix the symlink creation for x86 by copying the code form amd64.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2020-02-03 11:02:36 -01:00
Matt Turner 492aacba77 catalyst-auto: Combine common functions
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2019-09-01 19:04:59 -07:00
Mike Frysinger cb652173f6 catalyst-auto: move remaining configs from pre_build to update_symlinks
All the configs running symlink updates in pre_build can do it in the
update_symlinks callback instead.  Convert them over.
2018-01-15 20:44:31 -05:00
Mike Frysinger a8e70e1976 catalyst-auto: move git update into main script
All of our config files are doing this already, so move it into the
common code.
2018-01-15 20:17:43 -05:00
Robin H. Johnson 731b5886ad
tools: fix typo of DEST_HARDEND
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-28 11:01:26 -08:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 93bc214182 Sync amd64 and x86 base and experimental scripts. Add a few missing popd calls to base scripts.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2017-12-27 01:54:39 -01:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 3190fadba2 Use 2 vars for destinations (one for default and another for hardened).
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2017-12-22 11:02:44 +00:00
Robin H. Johnson 0292a7e2b5
tools/catalyst-auto-{x86,amd64}: refactor post_build for remote buildhost.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-14 21:48:20 -08:00
Robin H. Johnson e243f99edf
catalyst-auto: squelch all pushd/popd
Have some sed magic, including a negative match.

git grep -l -e pushd -e popd \
| xargs sed -i -r \
  -e '/(pushd|popd)/{ /null/! { s,$, >/dev/null,g } }'

Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2016-06-14 18:31:06 -07:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 32af29f06e Whitespace.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2016-03-24 03:30:32 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) e7ded9f8dd Update catalyst-auto scripts for amd64 / x86 to add support for more targets and improve the detection / copy of stages.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2015-12-27 02:37:12 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 6dcdad447a Fix the circular latest symlinks by taking them out of the list of stages.
Sync amd64/x86 experimental script with base amd64/x86 script.
2013-08-16 01:23:03 +00:00
Raúl Porcel 585d8d645f Remove apostrophes 2013-08-14 17:23:42 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 5b98494124 Drop the date from the destination dir to avoid the double date directories in the mirrors. 2013-04-28 22:36:56 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) bd55c0c987 Revert unintentional change to amd64 / x86 paths that is causing path weirdness on mirrors. 2013-04-18 08:28:12 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 7b2552f0c8 Update x86 script file to only copy the ISO files if we built the ISO file. 2013-04-18 08:01:16 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 666c0cdbe6 Build parent dirs if needed. 2012-10-14 04:30:56 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) f42a40df9a Move hardcoded paths out of the script files. 2012-10-13 04:06:36 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 8ee2ae6b0f Update config for amd64 / x86 to store stages under {default,hardened}. 2012-10-11 06:13:20 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 1c1dd9bf9e Update email address to skimmer and add nomultilib to the amd64 set. 2012-09-17 20:49:07 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 40a7d8dcce Update tools and config files for skimmer. 2012-09-17 01:21:57 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) e6637d16dc Fix x86 i[46]86 stage test. 2012-08-31 00:25:44 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) c842572bf9 Drop extra '*' on catalyst-auto-x86. 2012-08-29 02:05:56 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 50891e6e07 Fix the catalst-auto-x86.conf file. 2012-07-18 03:59:43 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 25a5c10300 Add more checks and tests in postbuild for amd64 / x86. 2012-07-10 00:38:07 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) bd95b08675 Fix whitespace. 2012-06-27 23:58:05 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) e38dced51f Update catalyst tools to use git for amd64 and x86. 2012-02-13 00:10:01 -01:00
Jorge Manuel B. S. Vicetto 0ad5787ec8 Add a few vars to the start of the script to reduce the hardcoded paths.
svn path=/trunk/; revision=812
2011-09-15 23:17:45 +00:00
Robin H. Johnson b477dc4322 Add new gentoo-releng-autobuilds list as a mail destination.
svn path=/trunk/; revision=771
2011-01-18 04:45:27 +00:00