GitLab

Python 3 doesn’t make it easy to do, see https://bugs.python.org/issue18512
for more details.
Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

Profiles have a lot of repetition in their syntax.
The use of Jinja simplifies profiles and makes them more readable.
Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>

lqa: update documentation

See merge request !1

Since LAVAv2 is now used job definitions are expected to be YAML format.
Signed-off-by: Héctor Orón Martínez <hector.oron@collabora.co.uk>

This release is a port of LQA to Python 3.
Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

The safe yaml loader gives error trying to deserialize
the LAVA V2 jobs tests results yaml file.

This commit changes it to the regular/normal yaml loader
which works fine with the tests files.
Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>
Reviewed-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Differential Revision: https://phabricator.collabora.com/D1297

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Luis Araujo <luis.araujo@collabora.co.uk>
Differential Revision: https://phabricator.collabora.co.uk/D1095

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

In some cases it is useful to be able to list or cancel only the jobs
that were submitted by a given user.  The -u / --user option adds a
new filter to make this possible, using the submitter user name with
the queue and cleanqueue commands.
Signed-off-by: Guillaume Tucker <guillaume.tucker@collabora.com>
Reviewed-by: Luis Araujo <luis.araujo@collabora.co.uk>
Differential Revision: https://phabricator.collabora.com/D1295

Signed-off-by: Guillaume Tucker <guillaume.tucker@collabora.com>
Reviewed-by: Luis Araujo <luis.araujo@collabora.co.uk>
Differential Revision: https://phabricator.collabora.com/D1293

This commit extends the lqa_api.test.Test class which
represent a test object to support the LAVA V2 jobs.

It extends the class with the valid properties for the
V2 jobs, and it will return None for those properties
not available for a specific job version.

It also includes a method to check if the test object
belong to a version 2 job.

Reviewed By: Sjoerd Simons <sjoerd.simons@collabora.co.uk>
Differential Revision: https://phabricator.collabora.com/D1289Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit adds a method to expose the value of the self._is_v2
variable, since it is useful to access this value from the API to
check if a Job is V2.

Reviewed By: Sjoerd Simons <sjoerd.simons@collabora.co.uk>
Differential Revision: https://phabricator.collabora.com/D1288Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

The method is named get_testjob_metadata and it is available
from the connection module. It allows to fetch metadata for
LAVA jobs V2, it returns an empty list for V1 jobs.

Reviewed By: Sjoerd Simons <sjoerd.simons@collabora.co.uk>
Differential Revision: https://phabricator.collabora.com/D1287Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This option allows to submit a job and shows its live output
once it starts running.

This option can't be used together with the --wait option or
if more than one job is submitted.

Reviewed By: Sjoerd Simons <sjoerd.simons@collabora.co.uk>
Differential Revision: https://phabricator.collabora.com/D1252Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This class will allow to make use of the feature to fetch logs
both statically and in live mode for LAVA jobs from the lqa API.

Reviewed By: Sjoerd Simons <sjoerd.simons@collabora.co.uk>
Differential Revision: https://phabricator.collabora.com/D1251Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

The 'results' property of a job will choose the correct method
to fetch the results depending on the job version (either v1 or v2).
Reviewed-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Differential Revision: https://phabricator.collabora.com/D1250Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit will return an exit code depending on the job status
in a job queue generated either by the --wait submit option
or the wait subcommand. It will collate all the jobs status results,
will map each status to a specific error code, and it will return
the worst error as an exit code.

Error codes:

EXIT_CODE_CANCELED_JOB   = -1
EXIT_CODE_INCOMPLETE_JOB = -2

Successful (Complete) jobs will use the 0 (SUCCESS) exit code.

Reviewed By: Sjoerd Simons <sjoerd.simons@collabora.co.uk>
Differential Revision: https://phabricator.collabora.co.uk/D1070Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

These new methods allow to fetch the tests results in CSV and YAML
format, and they only seem to work for lava dispatcher v2 jobs.

They map directly to the XMLRPC API methods with the same name.

Reviewed By: Sjoerd Simons <sjoerd.simons@collabora.co.uk>
Differential Revision: https://phabricator.collabora.co.uk/D1058Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

The command is named 'online' and will put the specified device
into online mode. It can be passed an optional flag to skip
the health-check job once the device is online.

Reviewed By: Héctor Orón Martínez <hector.oron@collabora.co.uk>
Reviewed By: Sjoerd Simons <sjoerd.simons@collabora.co.uk>
Differential Revision: https://phabricator.collabora.co.uk/D997Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

The command is named 'maint' and will put the specified device
in maintenance mode (offline). It can be passed an optional email
address to be notified once the current job has finished running.

Reviewed By: Héctor Orón Martínez <hector.oron@collabora.co.uk>
Reviewed By: Sjoerd Simons <sjoerd.simons@collabora.co.uk>
Differential Revision: https://phabricator.collabora.co.uk/D996Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit adds the following methods in the lqa API module
for boards maintenance: put_into_online_mode and
put_into_maintenance_mode , which allow to set boards online
and offline respectively.

These method names map exactly to the methods in the LAVA
XMLRPC API.

Reviewed By: Sjoerd Simons <sjoerd.simons@collabora.co.uk>
Differential Revision: https://phabricator.collabora.co.uk/D979Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This method will allow to fetch further information about
LAVA boards and maps directly to the method of the same name
in the XMLRPC API.

Reviewed By: Sjoerd Simons <sjoerd.simons@collabora.co.uk>
Differential Revision: https://phabricator.collabora.co.uk/D950Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This method will help to get all the test results for a job.

This commit is basically moving the logic from the results
command into its own API method lqa_api.job.Job.results, so
the information can be easily reused by other scripts.

Reviewed By: Sjoerd Simons <sjoerd.simons@collabora.co.uk>
Differential Revision: https://phabricator.collabora.co.uk/D760Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Assume V1 files are suffixed with json and if so pass do the normal
manging, if it's suffixed with .yaml assume a V2 file and only do
template processing.

Reviewed By: Luis Araujo <luis.araujo@collabora.co.uk>
Differential Revision: https://phabricator.collabora.co.uk/D742Signed-off-by: Sjoerd Simons <sjoerd.simons@collabora.co.uk>

Reviewed By: Daniel Stone <daniels@collabora.com>
Reviewed By: Luis Araujo <luis.araujo@collabora.co.uk>
Differential Revision: https://phabricator.collabora.co.uk/D741Signed-off-by: Sjoerd Simons <sjoerd.simons@collabora.co.uk>

Now the --name option for the queue and cleanqueue commands
can be given multiple times. This allows to search for several
job names at once in the queued jobs.
Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit adds the method lqa_api.test.Test.attributes
to fetch the attributes for a specific test from its job bundle.
Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This adds the the --date option in the queue command to filter queued
jobs by date.

This commit also refactors some code so both the queue and
cleanqueue command can reuse common functionality.
Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

The sversion command allows to get the LAVA server version.

This commit also extends the Connection class adding the respective
front end for the XMLRPC API dashboard.version method.

Reviewed By: Héctor Orón Martínez <hector.oron@collabora.co.uk>
Maniphest Tasks: T3526
Differential Revision: https://phabricator.collabora.co.uk/D526Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This command will allow to clean the jobs queue using a set of filter
options, otherwise when no filter option is passed it will clean the
whole queue.

This commit also refactors some of the cancel command code to reuse
some code from it in the new cleanqueue command.

Reviewed By: Héctor Orón Martínez <hector.oron@collabora.co.uk>
Maniphest Tasks: T3485
Differential Revision: https://phabricator.collabora.co.uk/D515Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

The following command line options are added to the queue command
to filter the jobs queue by their respective values: name (job name),
device, hostname and worker-host.

By default the whole jobs queue will be shown if no filter option is
specified.

Reviewed By: Héctor Orón Martínez <hector.oron@collabora.co.uk>
Reviewed By: Sjoerd Simons <sjoerd.simons@collabora.co.uk>
Maniphest Tasks: T3488
Differential Revision: https://phabricator.collabora.co.uk/D510Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>