By default only the base meta-package is installed. In our case we need
a few more packages.

If base were a group, we could trivially add those packages to it. Sadly
that's not possible, so we add our own group holo-base for that purpose.

A less hack fix will is to add and optional argument to the yaml, for
such additions. For the time being we can live with the hack.

Signed-off-by: Emil Velikov <emil.velikov@collabora.com>

Quite useful when you're adding extra repositories on top of the
official ones. Since you do not want to (have to) disable package
signing in the pacman.conf

Signed-off-by: Emil Velikov <emil.velikov@collabora.com>

for __file in $(git grep "go.debos" | cut -f1 -d: | sort -u); do
    sed -i "s|github.com/go-debos/|gitlab.collabora.com/archlinux/|g" $__file
done

... also redo the modules

rm go.*
go mod init gitlab.collabora.com/archlinux/debos
go mod tidy
edit the gocpio reference
go mod tidy

Signed-off-by: Emil Velikov <emil.l.velikov@gmail.com>

Signed-off-by: Emil Velikov <emil.l.velikov@gmail.com>

v2 [Emil]
 - Remove all pacman.conf and mirrorlist generation
 - Use drop-in user files for ^^
 - Remove custom flags passed to pacman-key, pacstrap
 - Add Verify hook for validation

Signed-off-by: Arnaud Rebillout <arnaud.rebillout@collabora.com>
Signed-off-by: Emil Velikov <emil.velikov@collabora.com>

Signed-off-by: Arnaud Rebillout <arnaud.rebillout@collabora.com>

v2: [Ed]
- Drop --color never as it is implicit
- Drop --noprogressbar likewise
- Reorder remaining arguments
- Style tweaks

Signed-off-by: Ed Smith <ed.smith@collabora.com>

Fakemachine is subject to panic and causes Debos to exit success due to
the current logic of the exitcode. For example, the fakemachine function
CopyFileTo() panics if the file is missing.

In the case of a panic, the function never returns. Thus, the exitcode
cannot be set to 1 and Debos exits with 0.

This commit reverses the logic of the exitcode: it is initialized to 1
(i.e. failure), and it is set to 0 (i.e. success) only if Debos has
reached the end of the things it has to do (or for the help message).

Co-authored-by: Gaël PORTAY <gael.portay@collabora.com>
Co-authored-by: Santosh Mahto <santosh.mahto@collabora.com>

Signed-off-by: Gaël PORTAY <gael.portay@collabora.com>

If it's not provided by the user, a label is created from the
command or script parameter which in some cases can be quite
long and can make the output more difficult to read.

Instead of using the whole command/script for the autogenerated
label, use only argv[0] of the first command to be ran to
preserve log space.

Test recipe:
```
architecture: amd64
actions:
  - action: run
    command: |
        echo "Testing testing 1234567890"
        echo "Testing testing 0987654321"
```

Log output without patch applied:
```
2021/08/10 12:30:21 ==== run ====
2021/08/10 12:30:21 echo "Testing testing 1234567890"
echo "Testing testing 0987654321"
 | Testing testing 1234567890
2021/08/10 12:30:21 echo "Testing testing 1234567890"
echo "Testing testing 0987654321"
 | Testing testing 0987654321
```

Log output with patch applied:
```
2021/08/10 12:30:45 ==== run ====
2021/08/10 12:30:45 echo | Testing testing 1234567890
2021/08/10 12:30:45 echo | Testing testing 0987654321
```

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

This reverts commit 91af617b.

qemu is no longer in experimental so the container build
will now fail. The required patches for qemu have been
backported into bullseye so let's revert using qemu from
experimental.

Link: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=988174


Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

Running the tests on the host is a good first step; to test Debos
properly we should run inside a Fakemachine. Since GitHub actions
do not support creating nested virtual machines, use the
user-mode-linux backend in Fakemachine to create a user process
to run the tests inside of.

Since Docker autobuild does not support UML the docker-compose
file purposely does not have a suffix of `.test.yml` so that the
test will not be picked up to run on Docker autobuild.

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

UML has some issues in some environments when stdin isn't set to
/dev/null, let's just set stdin to /dev/null for all tests.

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

Currently we assume all of the tests are run without fakemachine;
since we are looking to run the tests with fakemachine as well,
let's allow arguments to be passed to the test script which are
then passed to debos.

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

Add a CI pipeline which tests the following on every push and PR:

 * builds debos docker container
 * runs the debos unit tests inside the container
 * runs the debos test recipes inside the container

Unfortunately GitHub actions do not allow nested virtualization (see
https://github.com/actions/virtual-environments/issues/183

) so as a
first step, the tests are run on the host without fakemachine.

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

The tests are first-class citizens; they should be present in the
directory as such.

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

Currently only the unit-tests under the actions directory are ran. This
patch runs all of the available unit tests in the project.

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

The unit tests require the unzip package to be installed.

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

Local variables should be stylized using camelCase.

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

The variable hasn't been defined yet so ends up producing
a build failure:

    actions/image_partition_action.go:371:2: undefined: ImagePath
    actions/image_partition_action.go:372:26: undefined: ImagePath
    actions/image_partition_action.go:384:34: undefined: ImagePath

Fix the syntax used to initialise this variable.

Fixes: a7afc015

 ("actions/image-partition: Consistently use artifactdir")

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

The "image-partition" action uses artifactdir in the
PostMachineCleanup() step but not during the PreMachine() and
PreNoMachine() steps. Also, other debos actions such as pack, unpack
are relative to the specified "artifactdir" when invoking debos.

Fix this inconsistency by bringing image-partition action to the
fold. Also update the documentation to clarify this.

Signed-off-by: Punit Agrawal <punit1.agrawal@toshiba.co.jp>

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

This patch adds support for XFS, including the ability
to specify the UUID through the fsuuid property of the
image-partition action.

Signed-off-by: Nguyen Thi Huong <huong4.nguyenthi@toshiba.co.jp>
Signed-off-by: Daniel Sangorrin <daniel.sangorrin@toshiba.co.jp>

This patch adds functionality that allows you to specify
the UUID of your file system instead of getting a random one.
Some use cases include reproducible builds and software updates.

Currently, only btrfs, xfs, ext2, ext3, and ext4 are supported.

The uuid library is used for verifying the input value of
the FSUUID property (specified by the user on the
image-partition action). The verification is based on RFC 4122
and DCE 1.1: Authentication and Security Services. Check
https://github.com/google/uuid

 for more details.

Signed-off-by: Nguyen Thi Huong <huong4.nguyenthi@toshiba.co.jp>
Signed-off-by: Daniel Sangorrin <daniel.sangorrin@toshiba.co.jp>

The documentation suggests that offset should be optional; in practice
offset isn't optional and the action will return an error out if unset:

    Action `` failed at stage Run, error: Couldn't parse offset strconv.ParseInt: parsing "": invalid syntax

So set the offset by default to 0 then only attempt to parse the parameter
from the YAML if it is explicitly set.

Fixes: b792b472

 ("Add a raw action")

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

Debian's qemu-user-static package no longer registers binfmts on postinst
when running inside a virtualmachine; dockerhub builds are now built inside
a vm so the binfmts are not generated inside the docker container.

Fixes: 91af617b

 ("docker: Install qemu-user-static 6.0 to fix segfault")

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

There are issues with qemu-user-static 5.2 crashing when attempting
to allocate guest memory when compiled as a proper statically-linked
binary.

From testing, qemu 6.0 fixes the bug but it's not yet clear which
patch fixes the bug. So until the correct patch is backported to
bullseye, let's install qemu from experimental to pickup the bugfix.

See: #245
See: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=988174



Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

Add the git package to the docker image.

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

Expose the environment variables $ARTIFACTDIR and $RECIPEDIR
to the postprocess commands to allow the postprocess commands
to be more flexible.

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

Add the zip package to allow the cration of compressed zip archives.

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

After debootstrap the call of "debos" fails with message "Failed to register machine: Unit machine-root.scope already exists".
With the option "--register=no" this works fine. This change is derived from smcv/flatdeb!6



Signed-off-by: mtt2hi <thomas.mittelstaedt@de.bosch.com>

Since we have the support for the new user-mode-linux backend in the
docker container, Debos defaults to attempting to use that.
Unfortunately that isn't possible to run inside the Docker Hub where the
test suite runs, so let's explicitly disable the fakemachine library
when running the Docker Hub test suite.

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

The fakemachine uml backend uses user-mode-linux and libslirp-helper
packages available from bullseye, let's include those inside the container.

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

The equivs package is used to create dummy Debian packages which can
be useful in development to satisfy dependencies without installing the
real package. Note that this package is not the recommended way of
dealing with broken dependencies: a bug report should be filed instead.

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>

Match the same compression options as unpack and allow to have an uncompressed
tar when removing the `compression` parameter.

Signed-off-by: Corentin Noël <corentin.noel@collabora.com>

The readme got updated, so refresh the man page

Signed-off-by: Christopher Obbard <chris.obbard@collabora.com>