Commit graph

49 commits

Author SHA1 Message Date
Ben Kohler ef26f9a26f
catalyst-auto-{amd64,x86}*.conf: add info echo to post_build
Added a small debug echo so that post_build.log shows some information
about what's being uploaded.  Might add destination info later.

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-17 10:31:07 -05:00
Ben Kohler 60a1326315
catalyst-auto-{amd64,x86}*.conf: change cmd array to upload function
Use an easier-to-read "upload" function in place of "${cmd[@]}" array
syntax.  Added a helper var UPLOAD_DEST to be set in advance so that
upload function takes only a list of filenames to be uploaded.

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-15 12:34:12 -05:00
Ben Kohler 151b13ac96
catalyst-auto-x86*.conf: explicitly list files to be transferred
Previously when we were copying locally there was no (major) problem
with wildcarding a long list of files to be transferred after every
single spec finishes.  Now that we are transferring to a remote host,
this results in a lot of wasted transfer time & bandwidth.

I have adjusted the post_build function to only transfer the new files
known to be produced by each spec (which has files meant to be
published).

Signed-off-by: Ben Kohler <bkohler@gentoo.org>
2020-05-15 08:02:33 -05:00
Robin H. Johnson affe649205
catalyst-auto: no special behavior for nightheron copy anymore
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2020-05-11 22:14:35 -07:00
Matt Turner 8407af57f5 Remove weekly directory
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-28 18:18:02 -07:00
Matt Turner e9ea15ab8b Upload stages to releng-incoming.gentoo.org
Most architecture's build systems are hosted at OSUOSL. The place the
stages need to end up is ultimately masterreleases.gentoo.org, also at
OSUOSL. For some unknown reason, instead of rsync'ing from one system to
another in the same building, we were sending the stages first (slowly,
I might add) to nightheron in France, before sending them back to
OSUOSL.

robbat2 has added a releng-incoming.gentoo.org DNS record that currently
points to nightheron. This will allow us to switch the record in the
future and save the stages from needing to circumnavigate the globe
before reaching the mirrors.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-25 22:18:34 -07:00
Matt Turner 8f5cec8809 Revert "Upload stages to releng-incoming.gentoo.org"
This causes an interactive prompt:

    Are you sure you want to continue connecting (yes/no/[fingerprint])?

The plan is to get the SSH fingerprint via DNSSEC, so I'll revert this
change until that is in place and wired up.

This reverts commit 63174346f2.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-23 14:41:13 -07:00
Matt Turner 63174346f2 Upload stages to releng-incoming.gentoo.org
Most architecture's build systems are hosted at OSUOSL. The place the
stages need to end up is ultimately masterreleases.gentoo.org, also at
OSUOSL. For some unknown reason, instead of rsync'ing from one system to
another in the same building, we were sending the stages first (slowly,
I might add) to nightheron in France, before sending them back to
OSUOSL.

robbat2 has added a releng-incoming.gentoo.org DNS record that currently
points to nightheron. This will allow us to switch the record in the
future and save the stages from needing to circumnavigate the globe
before reaching the mirrors.

Signed-off-by: Matt Turner <mattst88@gentoo.org>
2020-04-23 00:14:11 -07:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) cee3787b3f Try to fix the symlink creation for x86 by copying the code form amd64.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2020-02-03 11:02:36 -01:00
Matt Turner 492aacba77 catalyst-auto: Combine common functions
Signed-off-by: Matt Turner <mattst88@gentoo.org>
2019-09-01 19:04:59 -07:00
Mike Frysinger cb652173f6 catalyst-auto: move remaining configs from pre_build to update_symlinks
All the configs running symlink updates in pre_build can do it in the
update_symlinks callback instead.  Convert them over.
2018-01-15 20:44:31 -05:00
Mike Frysinger a8e70e1976 catalyst-auto: move git update into main script
All of our config files are doing this already, so move it into the
common code.
2018-01-15 20:17:43 -05:00
Robin H. Johnson 731b5886ad
tools: fix typo of DEST_HARDEND
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-28 11:01:26 -08:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 93bc214182 Sync amd64 and x86 base and experimental scripts. Add a few missing popd calls to base scripts.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2017-12-27 01:54:39 -01:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 3190fadba2 Use 2 vars for destinations (one for default and another for hardened).
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2017-12-22 11:02:44 +00:00
Robin H. Johnson 0292a7e2b5
tools/catalyst-auto-{x86,amd64}: refactor post_build for remote buildhost.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-14 21:48:20 -08:00
Robin H. Johnson e243f99edf
catalyst-auto: squelch all pushd/popd
Have some sed magic, including a negative match.

git grep -l -e pushd -e popd \
| xargs sed -i -r \
  -e '/(pushd|popd)/{ /null/! { s,$, >/dev/null,g } }'

Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2016-06-14 18:31:06 -07:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 32af29f06e Whitespace.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2016-03-24 03:30:32 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) e7ded9f8dd Update catalyst-auto scripts for amd64 / x86 to add support for more targets and improve the detection / copy of stages.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2015-12-27 02:37:12 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 6dcdad447a Fix the circular latest symlinks by taking them out of the list of stages.
Sync amd64/x86 experimental script with base amd64/x86 script.
2013-08-16 01:23:03 +00:00
Raúl Porcel 585d8d645f Remove apostrophes 2013-08-14 17:23:42 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 5b98494124 Drop the date from the destination dir to avoid the double date directories in the mirrors. 2013-04-28 22:36:56 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) bd55c0c987 Revert unintentional change to amd64 / x86 paths that is causing path weirdness on mirrors. 2013-04-18 08:28:12 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 7b2552f0c8 Update x86 script file to only copy the ISO files if we built the ISO file. 2013-04-18 08:01:16 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 666c0cdbe6 Build parent dirs if needed. 2012-10-14 04:30:56 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) f42a40df9a Move hardcoded paths out of the script files. 2012-10-13 04:06:36 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 8ee2ae6b0f Update config for amd64 / x86 to store stages under {default,hardened}. 2012-10-11 06:13:20 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 1c1dd9bf9e Update email address to skimmer and add nomultilib to the amd64 set. 2012-09-17 20:49:07 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 40a7d8dcce Update tools and config files for skimmer. 2012-09-17 01:21:57 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) e6637d16dc Fix x86 i[46]86 stage test. 2012-08-31 00:25:44 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) c842572bf9 Drop extra '*' on catalyst-auto-x86. 2012-08-29 02:05:56 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 50891e6e07 Fix the catalst-auto-x86.conf file. 2012-07-18 03:59:43 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 25a5c10300 Add more checks and tests in postbuild for amd64 / x86. 2012-07-10 00:38:07 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) bd95b08675 Fix whitespace. 2012-06-27 23:58:05 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) e38dced51f Update catalyst tools to use git for amd64 and x86. 2012-02-13 00:10:01 -01:00
Jorge Manuel B. S. Vicetto 0ad5787ec8 Add a few vars to the start of the script to reduce the hardcoded paths.
svn path=/trunk/; revision=812
2011-09-15 23:17:45 +00:00
Robin H. Johnson b477dc4322 Add new gentoo-releng-autobuilds list as a mail destination.
svn path=/trunk/; revision=771
2011-01-18 04:45:27 +00:00
Robin H. Johnson f24ecd86d0 Create a symlink for -latest as seed stage
Create a symlink for the latest name from the available stages3 always,
that is then used as the seed for building the new stages. To ensure
creation, always copy instead of move the stages to the destination
afterwards. In addition to this, we need a cleanup script, as before
only the isos and stages3 were moved, leaving the stage[12] eating up
space behind.

Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
Proposed-by: Jorge Manuel B. S. Vicetto <jmbsvicetto@gentoo.org>
Acked-by: Andrew Gaffney <agaffney@gentoo.org>

svn path=/trunk/; revision=769
2011-01-14 05:53:24 +00:00
Andrew Gaffney bb10ef43bb Add concept of build sets to catalyst-auto
svn path=/trunk/; revision=652
2009-06-27 19:09:30 +00:00
Andrew Gaffney 8ab7c43edb stupid extra .
svn path=/trunk/; revision=650
2009-05-15 22:46:04 +00:00
Andrew Gaffney 20c1433f36 Add i686/stage1.spec to stage list
svn path=/trunk/; revision=646
2009-05-13 12:28:57 +00:00
Andrew Gaffney a25f5db0bb Move x86 hardened build into normal x86 build
svn path=/trunk/; revision=643
2009-05-11 10:35:27 +00:00
Andrew Gaffney 26921879b4 Only sync stage3 tarballs and s/x86/i486/
svn path=/trunk/; revision=613
2009-01-23 16:36:46 +00:00
Andrew Gaffney f5dd5097e0 Change post_build for all arches to only copy stage3/*.iso
svn path=/trunk/; revision=608
2009-01-02 22:27:47 +00:00
Andrew Gaffney fbc5444739 Add post_build() to move builds to /home/buildsync/
svn path=/trunk/; revision=595
2008-12-02 22:46:21 +00:00
Andrew Gaffney feff7ba1fa Add support for OPTIONAL_SPECS and purging
svn path=/trunk/; revision=591
2008-11-29 02:15:02 +00:00
Andrew Gaffney 5c6480d8e6 Add in x86 stage2/3 for minimal CD
svn path=/trunk/; revision=586
2008-10-31 14:38:28 +00:00
Andrew Gaffney 7b39e8aa62 Build i686 stage2/3 instead of x86
svn path=/trunk/; revision=585
2008-10-28 02:49:10 +00:00
Andrew Gaffney daa6f2bb89 Add x86 config and change email to releng@
svn path=/trunk/; revision=584
2008-10-26 16:26:16 +00:00