Chapter 10. Testing the Port

poudriere is available in the ports tree in ports-mgmt/poudriere. It can be installed using pkg(8) or from ports:

or

There is also a work-in-progress version of poudriere which will eventually become the next release. It is available in ports-mgmt/poudriere-devel. This development version is used for the official FreeBSD package builds, so it is well tested. It often has newer interesting features. A ports committer will want to use the development version because it is what is used in production, and has all the new features that will make sure everything is exactly right. A contributor will not necessarily need those as the most important fixes are backported to released version. The main reason for the use of the development version to build the official package is because it is faster, in a way that will shorten a full build from 18 hours to 17 hours when using a high end 32 CPU server with 128GB of RAM. Those optimizations will not matter a lot when building ports on a desktop machine.

The port installs a default configuration file, /usr/local/etc/poudriere.conf. Each parameter is documented in the configuration file.

Here is a minimal example config file:

Create the base jails which poudriere will use for building:

Fetch a 13.1-RELEASE for amd64 from the FTP server given by FREEBSD_HOST in poudriere.conf, create the zfs file system tank/poudriere/jails/131Ramd64, mount it on /poudriere/jails/131Ramd64 and extract the 13.1-RELEASE tarballs into this file system.

Create tank/poudriere/jails/12i386, mount it on /poudriere/jails/12i386, then check out the tip of the Git branch of FreeBSD-12-STABLE from GIT_HOST in poudriere.conf or the default git.freebsd.org into /poudriere/jails/12i386/usr/src, then complete a buildworld and install it into /poudriere/jails/12i386.

A list of jails currently known to poudriere can be shown with poudriere jail -l:

Managing updates is very straightforward. The command:

updates the specified jail to the latest version available. For FreeBSD releases, update to the latest patchlevel with freebsd-update(8). For FreeBSD versions built from source, update to the latest git revision in the branch.

There are multiple ways to use ports trees in poudriere. The most straightforward way is to have poudriere create a default ports tree for itself, using Git:

These commands create tank/poudriere/ports/default, mount it on /poudriere/ports/default, and populate it using Git. Afterward it is included in the list of known ports trees:

The best way to deal with local modifications for a ports contributor is to use Git. As with the creation of jails, it is possible to use a different method for creating the ports tree. To add an additional ports tree for testing local modifications and ports development, checking out the tree via git (as described above) is preferable.

Depending on the workflow, it can be extremely helpful to use ports trees which are maintained manually. For instance, if there is a local copy of the ports tree in /work/ports, point poudriere to the location:

This will be listed in the table of known trees:

As straightforward as with jails described earlier:

Will update the given PORTSTREE, one tree given by the output of poudriere -l, to the latest revision available on the official servers.

After jails and ports trees have been set up, the result of a contributor’s modifications to the ports tree can be tested.

For example, local modifications to the www/firefox port located in /work/ports/www/firefox can be tested in the previously created 13.1-RELEASE jail:

This will build all dependencies of Firefox. If a dependency has been built previously and is still up-to-date, the pre-built package is installed. If a dependency has no up-to-date package, one will be built with default options in a jail. Then Firefox itself is built.

The complete build of every port is logged to /poudriere/data/logs/bulk/131Ri386-development/build-time/logs.

The directory name 131Ri386-development is derived from the arguments to -j and -p, respectively. For convenience, a symbolic link /poudriere/data/logs/bulk/131Ri386-development/latest is also maintained. The link points to the latest build-time directory. Also in this directory is an index.html for observing the build process with a web browser.

By default, poudriere cleans up the jails and leaves log files in the directories mentioned above. To ease investigation, jails can be kept running after the build by adding -i to testport:

After the build completes, and regardless of whether it was successful, a shell is provided within the jail. The shell is used to investigate further. poudriere can be told to leave the jail running after the build finishes with -I. poudriere will show the command to run when the jail is no longer needed. It is then possible to jexec(8) into it:

An integral part of the FreeBSD ports build infrastructure is the ability to tweak ports to personal preferences with options. These can be tested with poudriere as well. Adding the -c:

Presents the port configuration dialog before the port is built. The ports given after -o in the format category/portname will use the specified options, all dependencies will use the default options. Testing dependent ports with non-default options can be accomplished using sets, see Using Sets.

For all actions involving builds, a so-called set can be specified using -z setname. A set refers to a fully independent build. This allows, for instance, usage of testport with non-standard options for the dependent ports.

To use sets, poudriere expects an existing directory structure similar to PORT_DBDIR, defaults to /var/db/ports in its configuration directory. This directory is then nullfs(5)-mounted into the jails where the ports and their dependencies are built. Usually a suitable starting point can be obtained by recursively copying the existing PORT_DBDIR to /usr/local/etc/poudriere.d/jailname-portname-setname-options. This is described in detail in poudriere(8). For instance, testing www/firefox in a specific set named devset, add the -z devset parameter to the testport command:

This will look for the existence of these directories in this order:

From this list, poudriere nullfs(5)-mounts the first existing directory tree into the /var/db/ports directory of the build jails. Hence, all custom options are used for all the ports during this run of testport.

After the directory structure for a set is provided, the options for a particular port can be altered. For example:

The configuration dialog for www/firefox is shown, and options can be edited. The selected options are saved to the devset set.

Similar to using sets, poudriere will also use a custom make.conf if it is provided. No special command line argument is necessary. Instead, poudriere looks for existing files matching a name scheme derived from the command line. For instance:

causes poudriere to check for the existence of these files in this order:

Unlike with sets, all of the found files will be appended, in that order, into one make.conf inside the build jails. It is hence possible to have general make variables, intended to affect all builds in /usr/local/etc/poudriere.d/make.conf. Special variables, intended to affect only certain jails or sets can be set in specialised make.conf files, such as /usr/local/etc/poudriere.d/131Ramd64-development-devset-make.conf.

poudriere comes with a built-in mechanism to remove outdated distfiles that are no longer used by any port of a given tree. The command

will scan the distfiles folder, DISTFILES_CACHE in poudriere.conf, versus the ports tree given by the -p portstree argument and prompt for removal of those distfiles. To skip the prompt and remove all unused files unconditionally, the -y argument can be added: