Commit graph

30 commits

Author SHA1 Message Date
Robin H. Johnson a4b2ec7de2 scripts/copy_buildsync: shellcheck pass
[mattst88]: Small fixes
Signed-off-by: Matt Turner <mattst88@gentoo.org>
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2018-11-21 11:13:05 -08:00
Robin H. Johnson 9fa4c8f32c scripts/copy_buildsync: cleanup excludes of tempfile
Signed-off-by: Matt Turner <mattst88@gentoo.org>
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2018-11-21 11:13:02 -08:00
Matt Turner c9ad265f80 scripts/copy_buildsync: try to exclude rsync tempfile
In-progress uploads are named .<filename>.<rsynctemp> and were
mistakenly recognized by copy_buildsync.sh as targets to sweep to the
mirrors. When it did, it deleted the file causing the in-progress upload
to fail.

Since the script is run by cron every 15 minutes, this would lead to a
large portion of the generated installation media to fail to upload, and
worse there is no pattern to it -- it just happens whenever an upload
spans the 15 minute boundary.

The fix is to ignore hidden files and to tell rsync (via the filter
rules) to exclude them from its sweep to the mirrors.

Closes: https://bugs.gentoo.org/670458
Signed-off-by: Matt Turner <mattst88@gentoo.org>
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2018-11-21 11:07:26 -08:00
Robin H. Johnson ed258c751b
tools/catalyst-auto: change datestamp->timestamp
Prepare for doing multiple automated runs in a single day on
newer/faster build systems.

Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2017-12-07 23:40:38 -08:00
Robin H. Johnson 060a341e10
copy_buildsync: squelch errors.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2016-05-06 11:31:55 -07:00
Mike Frysinger 2736e468eb copy_buildsync.sh: handle netboot artifacts
Make sure we process netboot kernels as releases too.
2016-03-20 19:51:56 -04:00
Mike Frysinger 62f25f4995 copy_buildsync.sh: fix extension handling
The change to use a list of file extensions w/find doesn't actually work:
the [] operators sets up a group of chars to match, and it isn't split by
the comma char.  It's equiv to doing "*[,.2abfgrstxz]".
2016-03-20 19:37:44 -04:00
Mike Frysinger ffa42e7a10 copy_buildsync.sh: simplify the latest-iso symlink checks 2016-03-20 18:29:45 -04:00
Mike Frysinger 7c16ed27d6 copy_buildsync.sh: simplify the latest-stage3 symlink checks
The current code is a bit overwrought when it's a simple string compare.
2016-03-20 18:12:57 -04:00
Mike Frysinger 867545ebd8 copy_buildsync.sh: simplify find clean up
Use find options to process everything rather than running through
grep/sort/tr/xargs.
2016-03-20 17:55:08 -04:00
Mike Frysinger 6325704c08 copy_buildsync.sh: convert input copying logic to a func
Minor clean up ... should not be any real functional changes.
2016-03-20 17:44:59 -04:00
Mike Frysinger 2c172ab248 copy_buildsync.sh: add command line options for verbose/debug mode
This makes it easier to do some debugging on the fly w/out having to
edit the script directly.
2016-03-20 17:18:25 -04:00
Mike Frysinger a1b63fb90e copy_buildsync.sh: convert code to use funcs
This makes the code a bit easier to follow and break up.
2016-03-20 17:10:47 -04:00
Mike Frysinger d14007c774 copy_buildsync.sh: convert code to use arrays
This makes it a bit cleaner to work with arguments.
2016-03-20 16:46:11 -04:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 1a3bf71810 Remove old code, clean-up and cosmetic changes.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2015-10-22 09:59:09 +00:00
Robin H. Johnson 3b8ed31f08
Bail in the variant loop if the variant_path comes out empty, as seen in cron mail from the script.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
2015-10-20 10:30:13 -07:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 260f36c938 Update copy_buildsync.sh script to support stages with other suffixes.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2015-10-02 22:43:36 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) e0189f9b76 Update the script to improve the readbility of the latest-{iso,stage3} for amd64/x86.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2015-02-06 19:11:54 -01:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 9b17aafc0a Sort arches.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2015-02-06 16:33:26 -01:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) b7c90993c1 Disable latest-stage3 for amd64 and x86 to avoid confusion for users when some sets fail to build.
Signed-off-by: Jorge Manuel B. S. Vicetto (jmbsvicetto) <jmbsvicetto@gentoo.org>
2014-03-27 02:07:49 -01:00
Raúl Porcel b7a016e9ca Do not use current-stage3 symlink on arm/hppa/s390/sh since releases are pushed with different datestamp and therefore current-stage3 only links to the latest that was pushed 2013-08-17 19:13:22 +00:00
Raúl Porcel 35ff9cd616 Use the variant function for the generic latest-stage3.txt 2013-08-17 18:58:44 +00:00
Raúl Porcel 6cfdd7f82b Narrow the regex a bit so f.ex stage3-amd64-nomultilib doesn't show up in latest-stage3-amd4.txt 2013-08-17 16:51:54 +00:00
Raúl Porcel 0e32c9e435 To pull a new arch something must be done from infra side, and since m68k isn't automated and its not in a good state, I'll push them to experimental instead 2013-08-05 12:02:44 +00:00
Raúl Porcel 609e096a7d Add m68k 2013-08-04 18:01:17 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 08c9ca74d6 Whitespace. 2013-04-18 08:04:50 +00:00
Raúl Porcel 25a9f33622 Adjust to skimmer's layout, as /release/distfiles is another filesystem and therefore rsync complains when doing the tmp and partial stuff 2013-01-20 07:44:12 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 675bfe9bb2 Update locations of source builds and destination dirs for distfile mirroring. 2012-11-04 12:22:22 -01:00
Raúl Porcel 62d8bf9930 Add a - to fix arm* variants symlink, bug #366123 2012-07-22 17:35:50 +00:00
Jorge Manuel B. S. Vicetto (jmbsvicetto) 498f935c11 Add releng scripts to the repository. 2012-07-09 17:48:44 +00:00