Commit Graph

85 Commits

Author SHA1 Message Date
Matthias Fischer
c22976907e tar: Update to 1.30 (V3)
For details see:
https://www.gnu.org/software/tar/

Since new 'tar' has changes in commandline option parsing,
it was necessary to adjust 'lfs/Config, 'lfs/cdrom' and
'lfs/core-updates' (thanks to Marcel for diffs and Michael for
corrections).

I have tried to make only the most necessary changes.

As always, please check.

Best,
Matthias

Signed-off-by: Matthias Fischer <matthias.fischer@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2018-06-06 14:03:07 +01:00
Arne Fitzenreiter
a4923c7f75 Config: follow symlinks at rootfile check
Signed-off-by: Arne Fitzenreiter <arne_f@ipfire.org>
2018-06-06 11:28:11 +02:00
Michael Tremer
0d1df90f70 Config: Add macro to update automake scripts on aarch64
Some packages ship an older version which does not recognise
aarch64. To overcome this, we just update these scripts when
necessary.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2018-05-31 11:56:28 +01:00
Michael Tremer
65a736981b Don't compress packages three times. Once is enough.
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2018-05-25 18:36:37 +01:00
Michael Tremer
0054a52bd8 tar seems to ignore the XZ_OPT variable sometimes
This caused that the xz command was called without any
extra arguments. This will now create the tar archive
first and then pass the archive through xz with our
command line switches.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2018-05-21 20:59:06 +01:00
Matthias Fischer
27267889aa xz: Performance and compression tuning (V2) - fine tuning
Changes since V1:

- Tuned some more 'tar'-command lines
- Included 'lfs/core-updates'
- Some fine-tuning

Hi,

Current results with V2 (clean builds):

'next':
'packages' => 255 MB
'ipfire-2.19.2gb-ext4.i586-full-core121.img.gz => 319 MB
'ipfire-2.19.i586-full-core121.iso' => 218 MB
Total => 792 MB

'xz-tuning':
'packages' => 228 MB
'ipfire-2.19.2gb-ext4.i586-full-core121.img.gz' => 318 MB
'ipfire-2.19.i586-full-core121.iso' => 207 MB

Total => 753 MB (-39 MB)

It would be nice if someone could review and test these. ;-)

If necessary, I can upload a complete patch.

Best,
Matthias

Signed-off-by: Matthias Fischer <matthias.fischer@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2018-05-21 20:59:06 +01:00
Matthias Fischer
0d7a6f03d4 xz: Performance and compression tuning (V1)
Hi,

as mentioned in the "list", we're trying to make the archives as small as possible
using 'xz'-compression.

In order to achieve this, this patch tests the size of the memory available on the
host system.

It sets the xz-memory-limit (--memory=[N]Mib) to 70% of the available working memory,
a maximum of four xz-'worker threads' (-T4) and a compression rate of '-8' (-8).

These options are written to the 'XZ_OPT=' environment.

For details see:
https://linux.die.net/man/1/xz

I have set the number of available xz-'worker threads' (-T) to four (-T4), because during
the final tests the '-T0' parameter led to error messages snd stopped: 'cannot allocate memory'.
It wouldn't even run with 90%.

Furthermore, testing with '-T0' led to countless messages filling  up '_build.packages.log'.

E.g.:
...
xz: Adjusted the number of threads from 8 to 2 to not exceed the memory usage
limit of 1557 MiB
...

Tests took place on a 32bit-Ubuntu 16.04.4-system with 8 GB RAM and an Intel I7-2600.
Build time was about 04:30 hrs. Perhaps a 64bit-system would perform better (higher
values), but my goal was to make this run on as many systems as possible, so I choosed
these averages.

If minimum requirements (1024 MB RAM) are not met, building stops.

Current results:

'next', untuned:
ipfire-2.19.2gb-ext4.i586-full-core121.img.gz	=> 332951687 Bytes
ipfire-2.19.i586-full-core121.iso		=> 228589568 Bytes

'next', XZ_OPT: -T4 -8, 70% RAM:
ipfire-2.19.2gb-ext4.i586-full-core121.img.gz	=> 329725723 Bytes
ipfire-2.19.i586-full-core121.iso		=> 217055232 Bytes

These two resulting archives are 14760300 Bytes smaller than before.

Best,
Matthias

Signed-off-by: Matthias Fischer <matthias.fischer@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2018-05-21 20:59:06 +01:00
Michael Tremer
c0878e43e1 Config: Set PREFIX either to TOOLS_DIR or /usr
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2018-02-11 20:56:12 +00:00
Michael Tremer
6c4cc7ea1b Move toolchain from /tools to /tools_${arch}
This will allow us to run multiple builds on the same
system at the same time (or at least have them on disk).

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2017-11-23 15:57:28 +00:00
Michael Tremer
f1effdf758 make.sh: Drop option to generate a source ISO
This is a very weird way to distribute sources in 2017.
Let's save the environment and stop using CDs.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2017-11-23 15:55:05 +00:00
Michael Tremer
348ba8e2c5 Revert "Use best XZ compression for smaller images and packages"
This reverts commit 5fd54721c2.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2017-10-18 12:35:19 +01:00
Michael Tremer
9dcfcb0039 Revert "cdrom: Use -8 as compression parameter"
This reverts commit 77ad762c43.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2017-10-18 12:35:04 +01:00
Michael Tremer
77ad762c43 cdrom: Use -8 as compression parameter
This is a better compromise on memory usage and file size

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2017-10-17 21:16:41 +01:00
Michael Tremer
5fd54721c2 Use best XZ compression for smaller images and packages
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2017-10-17 15:23:26 +01:00
Michael Tremer
bc9544929c packages: Compress in parallel
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2017-10-17 14:58:28 +01:00
Michael Tremer
c484679bb3 Download sources via HTTPS
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2017-10-12 15:56:34 +01:00
Michael Tremer
b7093f17d5 stage1: New build script
Creates some basic directories and symlinks in toolchain stage

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2017-05-18 12:04:20 +01:00
Michael Tremer
dc7d6b204d make.sh: Cleanup of polluted environment
The build environment is using a number of variables which
occasionally conflicted with some other build systems.

This patch cleans that up by renaming some variables and
later unexporting them in the lfs files.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2017-05-18 12:02:03 +01:00
Jonatan Schlag
38888b3d92 Add new make macro for installing initscripts
We also move the initscript for also to src/initscripts/packages
and use this new macro to install the initscript
Signed-off-by: Jonatan Schlag <jonatan.schlag@ipfire.org>
2017-02-22 12:25:42 +01:00
Arne Fitzenreiter
8a148bbc5a Config: update sourcecode upload url
Signed-off-by: Arne Fitzenreiter <arne_f@ipfire.org>
2016-03-17 23:04:54 +01:00
Michael Tremer
86b759785b make.sh: Update source upload URL
There is no longer a SSH service on source.ipfire.org.

The usual login on git.ipfire.org should be used instead.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2016-02-24 22:12:53 -08:00
Michael Tremer
1d9be34e2a ccache: Include hash of compiler specs in hashing
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2016-01-09 19:48:48 +00:00
Michael Tremer
1b169a72da Speed up rootfile generation
The old usage of find walked through the entire filesystem tree
and excluded some paths from being printed. The more efficient
solution is to skip walking through excluded directories entirely.

This is a slight speedup of the build process by a few minutes.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2015-12-12 17:06:10 +00:00
Michael Tremer
6f67c28d99 make.sh: Remove KGCC variable.
This has been unused since a long time any way.
2014-05-24 18:22:44 +02:00
Arne Fitzenreiter
b8e2d10888 fifteen: move /var/run to /run. 2014-01-12 12:15:44 +01:00
Arne Fitzenreiter
f83650a136 paks: compress internal tar with xz. 2012-10-26 17:43:29 +02:00
Michael Tremer
f5ad8f59d2 Update linker cache after each package build and toolchain build. 2012-08-20 11:35:26 +02:00
Arne Fitzenreiter
fdf0c7c15d kernel: change selection of config to support more architectures. 2011-10-05 20:20:36 +02:00
Michael Tremer
7273a32238 Merge branch 'arm-port' of ssh://git.ipfire.org/pub/git/people/ms/ipfire-2.x into arm-port 2011-09-22 16:01:58 +02:00
Michael Tremer
5596077b8d ARM: Fix packaging of xen-image and packages. 2011-09-22 16:00:49 +02:00
Michael Tremer
32b6efe8da Remove tons of code from the buildscripts that was not used anymore. 2011-09-18 14:51:23 +02:00
Michael Tremer
56c997b225 Fix wrong varible name when searching for rootfiles. 2011-09-18 13:54:38 +02:00
Michael Tremer
1b453c76b4 Add support for multiarch rootfiles. 2011-09-16 21:14:51 +02:00
Arne Fitzenreiter
45e5371d88 autoupdate kernel version at package install and core update scripts. 2011-07-24 10:29:08 +02:00
Arne Fitzenreiter
e21bd39e12 Fix build logfiles list sometimes files that are not new. 2010-10-13 14:47:39 +02:00
Arne Fitzenreiter
26c1cc7153 Add pae-kernel package. 2010-10-13 11:03:51 +02:00
Christian Schmidt
c0faa0efaf Fixed all those tar --preserve errors present. 2010-02-20 12:41:57 +01:00
Arne Fitzenreiter
d41d425059 Fix linux-xen log generation and update rootfile 2009-04-22 15:16:40 +02:00
Arne Fitzenreiter
0f3c131182 Add files that present in rootfile but not build to log 2009-04-15 10:30:24 +02:00
Arne Fitzenreiter
e95065b3e0 Revert handling of space in filenames. 2009-04-15 03:52:28 +02:00
Arne Fitzenreiter
c9444dcf3b Fix logfile generation if filenames contain + or space 2009-04-14 22:29:56 +02:00
maniacikarus
661d93888b Changed uploadsrc to use ssh instead of ftp upload 2009-03-04 19:35:12 +01:00
Arne Fitzenreiter
e99d32db30 Disabled continue of sourcedownloads 2009-01-28 21:46:53 +01:00
maniacikarus
2b074aea1c Changed download url for sources 2009-01-19 22:29:12 +01:00
Michael Tremer
319d32890a Source can only be downloaded by IPFireSourceGrabber/*. 2008-11-26 23:50:09 +01:00
Arne Fitzenreiter
d12153b083 Use double tar to prevent doubled files also in packages 2008-06-06 00:00:50 +02:00
arne_f
08fc1a19ae buildfix Config / truncated ROOTFILES
add sane (not finished)


git-svn-id: http://svn.ipfire.org/svn/ipfire/branches/2.1/trunk@1246 ea5c0bd1-69bd-2848-81d8-4f18e57aeed8
2008-03-03 16:31:04 +00:00
ms
2cb46e8104 Added kqemu to give the qemu more speed.
This will be delivered with core 9.


git-svn-id: http://svn.ipfire.org/svn/ipfire/branches/2.1/trunk@1244 ea5c0bd1-69bd-2848-81d8-4f18e57aeed8
2008-03-01 19:03:58 +00:00
maniacikarus
b72fd0e404 made some build fixes
git-svn-id: http://svn.ipfire.org/svn/ipfire/branches/2.1/trunk@1165 ea5c0bd1-69bd-2848-81d8-4f18e57aeed8
2008-01-28 17:25:19 +00:00
ms
fc4ac7acab Umfassend am Mailserver gearbeitet:
- Unnuetze Patches aus dem cyrusimapd raus
 - Eine Konfiguration und Datenbank fuer openmailadmin erstellt.
 - Konfiguration von Postfix und Cyrus ein wenig optimiert.
 - 2 Threads des saslauthd muessen reichen fuer kleine Mailserver.
Kleines Problem mit den Dateiberechtigungen in den Pakfire-Paketen gehabt und hoffentlich behoben.


git-svn-id: http://svn.ipfire.org/svn/ipfire/trunk@918 ea5c0bd1-69bd-2848-81d8-4f18e57aeed8
2007-09-23 16:09:22 +00:00