blob: 36f5a422f6f3fca949566e28687a1950bc16bda3 [file] [log] [blame]
James E. Blaircdd00072012-06-08 19:17:28 -07001:title: Zuul
2
3Zuul
4====
5
6Configuration
7-------------
8
9Zuul has three configuration files:
10
11**zuul.conf**
James E. Blair1f4c2bb2013-04-26 08:40:46 -070012 Connection information for Gerrit and Gearman, locations of the
Łukasz Jernaś048acb42014-03-02 18:49:41 +010013 other config files.
James E. Blaircdd00072012-06-08 19:17:28 -070014**layout.yaml**
Łukasz Jernaś048acb42014-03-02 18:49:41 +010015 Project and pipeline configuration -- what Zuul does.
James E. Blaircdd00072012-06-08 19:17:28 -070016**logging.conf**
Łukasz Jernaś048acb42014-03-02 18:49:41 +010017 Python logging config.
James E. Blaircdd00072012-06-08 19:17:28 -070018
19Examples of each of the three files can be found in the etc/ directory
20of the source distribution.
21
James E. Blair6aea36d2012-12-17 13:03:24 -080022.. _zuulconf:
23
James E. Blaircdd00072012-06-08 19:17:28 -070024zuul.conf
25~~~~~~~~~
26
27Zuul will look for ``/etc/zuul/zuul.conf`` or ``~/zuul.conf`` to
28bootstrap its configuration. Alternately, you may specify ``-c
29/path/to/zuul.conf`` on the command line.
30
James E. Blair1f4c2bb2013-04-26 08:40:46 -070031Gerrit and Gearman connection information are each described in a
32section of zuul.conf. The location of the other two configuration
33files (as well as the location of the PID file when running Zuul as a
34server) are specified in a third section.
James E. Blaircdd00072012-06-08 19:17:28 -070035
Clark Boylan9b670902012-09-28 13:47:56 -070036The three sections of this config and their options are documented below.
37You can also find an example zuul.conf file in the git
38`repository
Andreas Jaegerbcfbf932014-09-29 20:21:44 +020039<https://git.openstack.org/cgit/openstack-infra/zuul/tree/etc/zuul.conf-sample>`_
Clark Boylan9b670902012-09-28 13:47:56 -070040
James E. Blair1f4c2bb2013-04-26 08:40:46 -070041gearman
Clark Boylan9b670902012-09-28 13:47:56 -070042"""""""
43
44**server**
James E. Blair1f4c2bb2013-04-26 08:40:46 -070045 Hostname or IP address of the Gearman server.
46 ``server=gearman.example.com``
Clark Boylan9b670902012-09-28 13:47:56 -070047
James E. Blair1f4c2bb2013-04-26 08:40:46 -070048**port**
Łukasz Jernaś048acb42014-03-02 18:49:41 +010049 Port on which the Gearman server is listening.
James E. Blair1f4c2bb2013-04-26 08:40:46 -070050 ``port=4730``
Clark Boylan9b670902012-09-28 13:47:56 -070051
James E. Blair77cc7b82013-07-15 13:22:37 -070052gearman_server
53""""""""""""""
54
55**start**
56 Whether to start the internal Gearman server (default: False).
57 ``start=true``
58
59**log_config**
60 Path to log config file for internal Gearman server.
61 ``log_config=/etc/zuul/gearman-logging.yaml``
62
Clark Boylan9b670902012-09-28 13:47:56 -070063gerrit
64""""""
65
66**server**
67 FQDN of Gerrit server.
68 ``server=review.example.com``
69
Akihiro Motokic7d28a72014-03-22 09:21:38 +090070**port**
71 Optional: Gerrit server port.
72 ``port=29418``
73
Antoine Musso27475012012-11-26 09:53:01 +010074**baseurl**
75 Optional: path to Gerrit web interface. Defaults to ``https://<value
76 of server>/``. ``baseurl=https://review.example.com/review_site/``
77
Clark Boylan9b670902012-09-28 13:47:56 -070078**user**
79 User name to use when logging into above server via ssh.
James E. Blair1f4c2bb2013-04-26 08:40:46 -070080 ``user=zuul``
Clark Boylan9b670902012-09-28 13:47:56 -070081
82**sshkey**
83 Path to SSH key to use when logging into above server.
James E. Blair1f4c2bb2013-04-26 08:40:46 -070084 ``sshkey=/home/zuul/.ssh/id_rsa``
Clark Boylan9b670902012-09-28 13:47:56 -070085
86zuul
87""""
88
89**layout_config**
James E. Blair4076e2b2014-01-28 12:42:20 -080090 Path to layout config file. Used by zuul-server only.
Clark Boylan9b670902012-09-28 13:47:56 -070091 ``layout_config=/etc/zuul/layout.yaml``
92
93**log_config**
James E. Blaira4430132014-02-17 08:32:07 -080094 Path to log config file. Used by zuul-server only.
Clark Boylan9b670902012-09-28 13:47:56 -070095 ``log_config=/etc/zuul/logging.yaml``
96
97**pidfile**
James E. Blaira4430132014-02-17 08:32:07 -080098 Path to PID lock file. Used by zuul-server only.
Clark Boylan9b670902012-09-28 13:47:56 -070099 ``pidfile=/var/run/zuul/zuul.pid``
100
101**state_dir**
James E. Blair4076e2b2014-01-28 12:42:20 -0800102 Path to directory that Zuul should save state to. Used by all Zuul
103 commands.
Clark Boylan9b670902012-09-28 13:47:56 -0700104 ``state_dir=/var/lib/zuul``
105
James E. Blair4076e2b2014-01-28 12:42:20 -0800106**report_times**
107 Boolean value (``true`` or ``false``) that determines if Zuul should
108 include elapsed times for each job in the textual report. Used by
109 zuul-server only.
110 ``report_times=true``
111
112**status_url**
113 URL that will be posted in Zuul comments made to Gerrit changes when
114 starting jobs for a change. Used by zuul-server only.
115 ``status_url=https://zuul.example.com/status``
116
Clark Boylane0b4bdb2014-06-03 17:01:25 -0700117**status_expiry**
118 Zuul will cache the status.json file for this many seconds. This is an
119 optional value and ``1`` is used by default.
120 ``status_expiry=1``
121
James E. Blair4076e2b2014-01-28 12:42:20 -0800122**url_pattern**
123 If you are storing build logs external to the system that originally
124 ran jobs and wish to link to those logs when Zuul makes comments on
125 Gerrit changes for completed jobs this setting configures what the
126 URLs for those links should be. Used by zuul-server only.
127 ``http://logs.example.com/{change.number}/{change.patchset}/{pipeline.name}/{job.name}/{build.number}``
128
129**job_name_in_report**
130 Boolean value (``true`` or ``false``) that indicates whether the
131 job name should be included in the report (normally only the URL
132 is included). Defaults to ``false``. Used by zuul-server only.
133 ``job_name_in_report=true``
134
135merger
136""""""
137
Clark Boylan9b670902012-09-28 13:47:56 -0700138**git_dir**
139 Directory that Zuul should clone local git repositories to.
140 ``git_dir=/var/lib/zuul/git``
141
Paul Belangerb67aba12013-05-13 19:22:14 -0400142**git_user_email**
143 Optional: Value to pass to `git config user.email`.
144 ``git_user_email=zuul@example.com``
145
146**git_user_name**
147 Optional: Value to pass to `git config user.name`.
148 ``git_user_name=zuul``
149
Arx Cruzb1b010d2013-10-28 19:49:59 -0200150**zuul_url**
James E. Blair4076e2b2014-01-28 12:42:20 -0800151 URL of this merger's git repos, accessible to test workers. Usually
152 "http://zuul.example.com/p" or "http://zuul-merger01.example.com/p"
153 depending on whether the merger is co-located with the Zuul server.
Arx Cruzb1b010d2013-10-28 19:49:59 -0200154
James E. Blaira4430132014-02-17 08:32:07 -0800155**log_config**
156 Path to log config file for the merger process.
157 ``log_config=/etc/zuul/logging.yaml``
158
159**pidfile**
160 Path to PID lock file for the merger process.
161 ``pidfile=/var/run/zuul-merger/merger.pid``
162
Joshua Hesketh5fea8672013-08-19 17:32:01 +1000163smtp
164""""
165
166**server**
167 SMTP server hostname or address to use.
168 ``server=localhost``
169
Akihiro Motokic7d28a72014-03-22 09:21:38 +0900170**port**
171 Optional: SMTP server port.
172 ``port=25``
173
Joshua Hesketh5fea8672013-08-19 17:32:01 +1000174**default_from**
175 Who the email should appear to be sent from when emailing the report.
176 This can be overridden by individual pipelines.
177 ``default_from=zuul@example.com``
178
179**default_to**
180 Who the report should be emailed to by default.
181 This can be overridden by individual pipelines.
182 ``default_to=you@example.com``
183
Joshua Hesketh36c3fa52014-01-22 11:40:52 +1100184.. _swift:
185
186swift
187"""""
188
189To send (optional) swift upload instructions this section must be
Antoine Musso62fa2d42014-06-04 22:55:23 +0200190present. Multiple destinations can be defined in the :ref:`jobs` section
191of the layout.
192
193If you are sending the temp-url-key or fetching the x-storage-url, you
194will need the python-swiftclient module installed.
Joshua Hesketh36c3fa52014-01-22 11:40:52 +1100195
Joshua Heskethc4967502014-05-15 06:39:14 -0700196**X-Account-Meta-Temp-Url-Key** (optional)
197 This is the key used to sign the HMAC message. If you do not set a
198 key Zuul will generate one automatically.
199
200**Send-Temp-Url-Key** (optional)
201 Zuul can send the X-Account-Meta-Temp-Url-Key to swift for you if
202 you have set up the appropriate credentials in ``authurl`` below.
203 This isn't necessary if you know and have set your
204 X-Account-Meta-Temp-Url-Key.
Antoine Musso62fa2d42014-06-04 22:55:23 +0200205 If set, Zuul requires the python-swiftclient module.
Joshua Heskethc4967502014-05-15 06:39:14 -0700206 ``default: true``
207
208**X-Storage-Url** (optional)
209 The storage URL is the destination to upload files into. If you do
210 not set this the ``authurl`` credentials are used to fetch the url
Antoine Musso62fa2d42014-06-04 22:55:23 +0200211 from swift and Zuul will requires the python-swiftclient module.
Joshua Heskethc4967502014-05-15 06:39:14 -0700212
213**authurl** (optional)
214 The (keystone) Auth URL for swift.
Joshua Hesketh36c3fa52014-01-22 11:40:52 +1100215 ``For example, https://identity.api.rackspacecloud.com/v2.0/``
Joshua Heskethc4967502014-05-15 06:39:14 -0700216 This is required if you have Send-Temp-Url-Key set to ``True`` or
217 if you have not supplied the X-Storage-Url.
Joshua Hesketh36c3fa52014-01-22 11:40:52 +1100218
219Any of the `swiftclient connection parameters`_ can also be defined
220here by the same name. Including the os_options by their key name (
221``for example tenant_id``)
222
223.. _swiftclient connection parameters: http://docs.openstack.org/developer/python-swiftclient/swiftclient.html#module-swiftclient.client
224
Joshua Hesketh36c3fa52014-01-22 11:40:52 +1100225**region_name** (optional)
226 The region name holding the swift container
227 ``For example, SYD``
228
229Each destination defined by the :ref:`jobs` will have the following
230default values that it may overwrite.
231
232**default_container** (optional)
233 Container name to place the log into
234 ``For example, logs``
235
236**default_expiry** (optional)
237 How long the signed destination should be available for
238 ``default: 7200 (2hrs)``
239
240**default_max_file_size** (optional)
241 The maximum size of an individual file
242 ``default: 104857600 (100MB)``
243
244**default_max_file_count** (optional)
245 The maximum number of separate files to allow
246 ``default: 10``
247
248**default_logserver_prefix**
249 Provide a URL to the CDN or logserver app so that a worker knows
250 what URL to return. The worker should return the logserver_prefix
251 url and the object path.
252 ``For example: http://logs.example.org/server.app?obj=``
253
James E. Blaircdd00072012-06-08 19:17:28 -0700254layout.yaml
255~~~~~~~~~~~
256
Clark Boylan00635dc2012-09-19 14:03:08 -0700257This is the main configuration file for Zuul, where all of the pipelines
James E. Blaircdd00072012-06-08 19:17:28 -0700258and projects are defined, what tests should be run, and what actions
Clark Boylan00635dc2012-09-19 14:03:08 -0700259Zuul should perform. There are three sections: pipelines, jobs, and
James E. Blaircdd00072012-06-08 19:17:28 -0700260projects.
261
James E. Blaire5a847f2012-07-10 15:29:14 -0700262.. _includes:
263
264Includes
265""""""""
266
267Custom functions to be used in Zuul's configuration may be provided
268using the ``includes`` directive. It accepts a list of files to
269include, and currently supports one type of inclusion, a python file::
270
271 includes:
272 - python-file: local_functions.py
273
274**python-file**
275 The path to a python file. The file will be loaded and objects that
276 it defines will be placed in a special environment which can be
277 referenced in the Zuul configuration. Currently only the
278 parameter-function attribute of a Job uses this feature.
279
Clark Boylan00635dc2012-09-19 14:03:08 -0700280Pipelines
281"""""""""
James E. Blaircdd00072012-06-08 19:17:28 -0700282
Clark Boylan00635dc2012-09-19 14:03:08 -0700283Zuul can have any number of independent pipelines. Whenever a matching
284Gerrit event is found for a pipeline, that event is added to the
285pipeline, and the jobs specified for that pipeline are run. When all
286jobs specified for the pipeline that were triggered by an event are
287completed, Zuul reports back to Gerrit the results.
James E. Blaircdd00072012-06-08 19:17:28 -0700288
Clark Boylan00635dc2012-09-19 14:03:08 -0700289There are no pre-defined pipelines in Zuul, rather you can define
290whatever pipelines you need in the layout file. This is a very flexible
291system that can accommodate many kinds of workflows.
James E. Blaircdd00072012-06-08 19:17:28 -0700292
Clark Boylan00635dc2012-09-19 14:03:08 -0700293Here is a quick example of a pipeline definition followed by an
James E. Blaircdd00072012-06-08 19:17:28 -0700294explanation of each of the parameters::
295
296 - name: check
Clark Boylan00635dc2012-09-19 14:03:08 -0700297 manager: IndependentPipelineManager
James E. Blairc0dedf82014-08-06 09:37:52 -0700298 source: gerrit
James E. Blaircdd00072012-06-08 19:17:28 -0700299 trigger:
James E. Blair6c358e72013-07-29 17:06:47 -0700300 gerrit:
301 - event: patchset-created
James E. Blaircdd00072012-06-08 19:17:28 -0700302 success:
303 verified: 1
304 failure:
305 verified: -1
306
307**name**
308 This is used later in the project definition to indicate what jobs
Clark Boylan00635dc2012-09-19 14:03:08 -0700309 should be run for events in the pipeline.
James E. Blaircdd00072012-06-08 19:17:28 -0700310
James E. Blair8dbd56a2012-12-22 10:55:10 -0800311**description**
312 This is an optional field that may be used to provide a textual
313 description of the pipeline.
314
James E. Blairc0dedf82014-08-06 09:37:52 -0700315**source**
316 A required field that specifies a trigger that provides access to
317 the change objects that this pipeline operates on. Currently only
318 the value ``gerrit`` is supported.
319
James E. Blair56370192013-01-14 15:47:28 -0800320**success-message**
321 An optional field that supplies the introductory text in message
322 reported back to Gerrit when all the voting builds are successful.
323 Defaults to "Build successful."
324
325**failure-message**
326 An optional field that supplies the introductory text in message
327 reported back to Gerrit when at least one voting build fails.
328 Defaults to "Build failed."
329
Joshua Heskethb7179772014-01-30 23:30:46 +1100330**merge-failure-message**
331 An optional field that supplies the introductory text in message
332 reported back to Gerrit when a change fails to merge with the
333 current state of the repository.
334 Defaults to "Merge failed."
335
Joshua Hesketh3979e3e2014-03-04 11:21:10 +1100336**footer-message**
337 An optional field to supply additional information after test results.
338 Useful for adding information about the CI system such as debugging
339 and contact details.
340
James E. Blaircdd00072012-06-08 19:17:28 -0700341**manager**
Clark Boylan00635dc2012-09-19 14:03:08 -0700342 There are currently two schemes for managing pipelines:
James E. Blaircdd00072012-06-08 19:17:28 -0700343
Clark Boylan00635dc2012-09-19 14:03:08 -0700344 *IndependentPipelineManager*
345 Every event in this pipeline should be treated as independent of
346 other events in the pipeline. This is appropriate when the order of
347 events in the pipeline doesn't matter because the results of the
348 actions this pipeline performs can not affect other events in the
349 pipeline. For example, when a change is first uploaded for review,
James E. Blaircdd00072012-06-08 19:17:28 -0700350 you may want to run tests on that change to provide early feedback
351 to reviewers. At the end of the tests, the change is not going to
352 be merged, so it is safe to run these tests in parallel without
Clark Boylan00635dc2012-09-19 14:03:08 -0700353 regard to any other changes in the pipeline. They are independent.
James E. Blaircdd00072012-06-08 19:17:28 -0700354
Clark Boylan00635dc2012-09-19 14:03:08 -0700355 Another type of pipeline that is independent is a post-merge
356 pipeline. In that case, the changes have already merged, so the
357 results can not affect any other events in the pipeline.
James E. Blaircdd00072012-06-08 19:17:28 -0700358
Clark Boylan00635dc2012-09-19 14:03:08 -0700359 *DependentPipelineManager*
360 The dependent pipeline manager is designed for gating. It ensures
James E. Blaircdd00072012-06-08 19:17:28 -0700361 that every change is tested exactly as it is going to be merged
362 into the repository. An ideal gating system would test one change
363 at a time, applied to the tip of the repository, and only if that
364 change passed tests would it be merged. Then the next change in
365 line would be tested the same way. In order to achieve parallel
Clark Boylan00635dc2012-09-19 14:03:08 -0700366 testing of changes, the dependent pipeline manager performs
James E. Blaircdd00072012-06-08 19:17:28 -0700367 speculative execution on changes. It orders changes based on
Clark Boylan00635dc2012-09-19 14:03:08 -0700368 their entry into the pipeline. It begins testing all changes in
369 parallel, assuming that each change ahead in the pipeline will pass
James E. Blaircdd00072012-06-08 19:17:28 -0700370 its tests. If they all succeed, all the changes can be tested and
Clark Boylan00635dc2012-09-19 14:03:08 -0700371 merged in parallel. If a change near the front of the pipeline
372 fails its tests, each change behind it ignores whatever tests have
373 been completed and are tested again without the change in front.
374 This way gate tests may run in parallel but still be tested
375 correctly, exactly as they will appear in the repository when
376 merged.
James E. Blaircdd00072012-06-08 19:17:28 -0700377
Clark Boylan00635dc2012-09-19 14:03:08 -0700378 One important characteristic of the DependentPipelineManager is that
James E. Blaircdd00072012-06-08 19:17:28 -0700379 it analyzes the jobs that are triggered by different projects, and
380 if those projects have jobs in common, it treats those projects as
381 related, and they share a single virtual queue of changes. Thus,
382 if there is a job that performs integration testing on two
383 projects, those two projects will automatically share a virtual
384 change queue. If a third project does not invoke that job, it
Clark Boylan00635dc2012-09-19 14:03:08 -0700385 will be part of a separate virtual change queue, and changes to
386 it will not depend on changes to the first two jobs.
James E. Blaircdd00072012-06-08 19:17:28 -0700387
388 For more detail on the theory and operation of Zuul's
Clark Boylan00635dc2012-09-19 14:03:08 -0700389 DependentPipelineManager, see: :doc:`gating`.
James E. Blaircdd00072012-06-08 19:17:28 -0700390
391**trigger**
James E. Blairc494d542014-08-06 09:23:52 -0700392 At least one trigger source must be supplied for each pipeline.
James E. Blaircdd00072012-06-08 19:17:28 -0700393 Triggers are not exclusive -- matching events may be placed in
James E. Blair6c358e72013-07-29 17:06:47 -0700394 multiple pipelines, and they will behave independently in each of
395 the pipelines they match. You may select from the following:
James E. Blaircdd00072012-06-08 19:17:28 -0700396
James E. Blair6c358e72013-07-29 17:06:47 -0700397 **gerrit**
398 This describes what Gerrit events should be placed in the
399 pipeline. Multiple gerrit triggers may be listed. Further
400 parameters describe the kind of events that match:
James E. Blaircdd00072012-06-08 19:17:28 -0700401
James E. Blair6c358e72013-07-29 17:06:47 -0700402 *event*
403 The event name from gerrit. Examples: ``patchset-created``,
404 ``comment-added``, ``ref-updated``. This field is treated as a
405 regular expression.
James E. Blaircdd00072012-06-08 19:17:28 -0700406
James E. Blair6c358e72013-07-29 17:06:47 -0700407 *branch*
408 The branch associated with the event. Example: ``master``. This
409 field is treated as a regular expression, and multiple branches may
410 be listed.
James E. Blaircdd00072012-06-08 19:17:28 -0700411
James E. Blair6c358e72013-07-29 17:06:47 -0700412 *ref*
413 On ref-updated events, the branch parameter is not used, instead the
414 ref is provided. Currently Gerrit has the somewhat idiosyncratic
415 behavior of specifying bare refs for branch names (e.g., ``master``),
416 but full ref names for other kinds of refs (e.g., ``refs/tags/foo``).
417 Zuul matches what you put here exactly against what Gerrit
418 provides. This field is treated as a regular expression, and
419 multiple refs may be listed.
James E. Blaircdd00072012-06-08 19:17:28 -0700420
James E. Blair6c358e72013-07-29 17:06:47 -0700421 *approval*
422 This is only used for ``comment-added`` events. It only matches if
423 the event has a matching approval associated with it. Example:
424 ``code-review: 2`` matches a ``+2`` vote on the code review category.
425 Multiple approvals may be listed.
Antoine Mussob4e809e2012-12-06 16:58:06 +0100426
James E. Blair1fbfceb2014-06-23 14:42:53 -0700427 *email*
James E. Blair6c358e72013-07-29 17:06:47 -0700428 This is used for any event. It takes a regex applied on the performer
Michael Prokop526926a2013-10-24 16:16:57 +0200429 email, i.e. Gerrit account email address. If you want to specify
James E. Blair6c358e72013-07-29 17:06:47 -0700430 several email filters, you must use a YAML list. Make sure to use non
431 greedy matchers and to escapes dots!
James E. Blair1fbfceb2014-06-23 14:42:53 -0700432 Example: ``email: ^.*?@example\.org$``.
James E. Blair6c358e72013-07-29 17:06:47 -0700433
James E. Blair1fbfceb2014-06-23 14:42:53 -0700434 *email_filter* (deprecated)
435 A deprecated alternate spelling of *email*. Only one of *email* or
436 *email_filter* should be used.
437
438 *username*
Joshua Heskethb8a817e2013-12-27 11:21:38 +1100439 This is used for any event. It takes a regex applied on the performer
440 username, i.e. Gerrit account name. If you want to specify several
441 username filters, you must use a YAML list. Make sure to use non greedy
442 matchers and to escapes dots!
James E. Blair1fbfceb2014-06-23 14:42:53 -0700443 Example: ``username: ^jenkins$``.
Joshua Heskethb8a817e2013-12-27 11:21:38 +1100444
James E. Blair1fbfceb2014-06-23 14:42:53 -0700445 *username_filter* (deprecated)
446 A deprecated alternate spelling of *username*. Only one of *username* or
447 *username_filter* should be used.
448
449 *comment*
James E. Blair6c358e72013-07-29 17:06:47 -0700450 This is only used for ``comment-added`` events. It accepts a list of
451 regexes that are searched for in the comment string. If any of these
452 regexes matches a portion of the comment string the trigger is
James E. Blair1fbfceb2014-06-23 14:42:53 -0700453 matched. ``comment: retrigger`` will match when comments
James E. Blair6c358e72013-07-29 17:06:47 -0700454 containing 'retrigger' somewhere in the comment text are added to a
455 change.
Clark Boylanb9bcb402012-06-29 17:44:05 -0700456
James E. Blair1fbfceb2014-06-23 14:42:53 -0700457 *comment_filter* (deprecated)
458 A deprecated alternate spelling of *comment*. Only one of *comment* or
459 *comment_filter* should be used.
460
James E. Blair9c17dbf2014-06-23 14:21:58 -0700461 *require-approval*
James E. Blairc053d022014-01-22 14:57:33 -0800462 This may be used for any event. It requires that a certain kind
463 of approval be present for the current patchset of the change (the
James E. Blair11041d22014-05-02 14:49:53 -0700464 approval could be added by the event in question). It follows the
Antoine Musso27ab0d52014-10-22 14:20:17 +0200465 same syntax as the :ref:`"approval" pipeline requirement below
466 <pipeline-require-approval>`.
James E. Blairc053d022014-01-22 14:57:33 -0800467
James E. Blair63bb0ef2013-07-29 17:14:51 -0700468 **timer**
469 This trigger will run based on a cron-style time specification.
470 It will enqueue an event into its pipeline for every project
471 defined in the configuration. Any job associated with the
472 pipeline will run in response to that event.
473
474 *time*
475 The time specification in cron syntax. Only the 5 part syntax is
476 supported, not the symbolic names. Example: ``0 0 * * *`` runs
477 at midnight.
478
James E. Blairc494d542014-08-06 09:23:52 -0700479 **zuul**
480 This trigger supplies events generated internally by Zuul.
481 Multiple events may be listed.
482
483 *event*
484 The event name. Currently supported:
485
486 *project-change-merged* when Zuul merges a change to a project,
487 it generates this event for every open change in the project.
488
489 *parent-change-enqueued* when Zuul enqueues a change into any
490 pipeline, it generates this event for every child of that
491 change.
492
493 *pipeline*
494 Only available for ``parent-change-enqueued`` events. This is the
495 name of the pipeline in which the parent change was enqueued.
496
497 *require-approval*
498 This may be used for any event. It requires that a certain kind
499 of approval be present for the current patchset of the change (the
500 approval could be added by the event in question). It follows the
Antoine Musso27ab0d52014-10-22 14:20:17 +0200501 same syntax as the :ref:`"approval" pipeline requirement below
502 <pipeline-require-approval>`.
James E. Blairc494d542014-08-06 09:23:52 -0700503
504
James E. Blair11041d22014-05-02 14:49:53 -0700505**require**
506 If this section is present, it established pre-requisites for any
507 kind of item entering the Pipeline. Regardless of how the item is
508 to be enqueued (via any trigger or automatic dependency resolution),
509 the conditions specified here must be met or the item will not be
510 enqueued.
511
Antoine Musso27ab0d52014-10-22 14:20:17 +0200512.. _pipeline-require-approval:
513
James E. Blair11041d22014-05-02 14:49:53 -0700514 **approval**
515 This requires that a certain kind of approval be present for the
516 current patchset of the change (the approval could be added by the
517 event in question). It takes several sub-parameters, all of which
518 are optional and are combined together so that there must be an
519 approval matching all specified requirements.
520
521 *username*
522 If present, an approval from this username is required.
523
James E. Blair1fbfceb2014-06-23 14:42:53 -0700524 *email*
James E. Blair11041d22014-05-02 14:49:53 -0700525 If present, an approval with this email address is required. It
526 is treated as a regular expression as above.
527
James E. Blair1fbfceb2014-06-23 14:42:53 -0700528 *email-filter* (deprecated)
529 A deprecated alternate spelling of *email*. Only one of *email* or
530 *email_filter* should be used.
531
James E. Blair11041d22014-05-02 14:49:53 -0700532 *older-than*
533 If present, the approval must be older than this amount of time
534 to match. Provide a time interval as a number with a suffix of
535 "w" (weeks), "d" (days), "h" (hours), "m" (minutes), "s"
536 (seconds). Example ``48h`` or ``2d``.
537
538 *newer-than*
539 If present, the approval must be newer than this amount of time
540 to match. Same format as "older-than".
541
542 Any other field is interpreted as a review category and value
543 pair. For example ``verified: 1`` would require that the approval
James E. Blair9c17dbf2014-06-23 14:21:58 -0700544 be for a +1 vote in the "Verified" column. The value may either
545 be a single value or a list: ``verified: [1, 2]`` would match
546 either a +1 or +2 vote.
James E. Blair11041d22014-05-02 14:49:53 -0700547
548 **open**
549 A boolean value (``true`` or ``false``) that indicates whether the change
550 must be open or closed in order to be enqueued.
551
Clark Boylana9702ad2014-05-08 17:17:24 -0700552 **current-patchset**
553 A boolean value (``true`` or ``false``) that indicates whether the change
554 must be the current patchset in order to be enqueued.
555
James E. Blair11041d22014-05-02 14:49:53 -0700556 **status**
557 A string value that corresponds with the status of the change
558 reported by the trigger. For example, when using the Gerrit
559 trigger, status values such as ``NEW`` or ``MERGED`` may be useful.
James E. Blair63bb0ef2013-07-29 17:14:51 -0700560
James E. Blair2fa50962013-01-30 21:50:41 -0800561**dequeue-on-new-patchset**
562 Normally, if a new patchset is uploaded to a change that is in a
563 pipeline, the existing entry in the pipeline will be removed (with
564 jobs canceled and any dependent changes that can no longer merge as
565 well. To suppress this behavior (and allow jobs to continue
566 running), set this to ``false``. Default: ``true``.
567
James E. Blaircdd00072012-06-08 19:17:28 -0700568**success**
Joshua Hesketh1879cf72013-08-19 14:13:15 +1000569 Describes where Zuul should report to if all the jobs complete
570 successfully.
James E. Blaircdd00072012-06-08 19:17:28 -0700571 This section is optional; if it is omitted, Zuul will run jobs and
572 do nothing on success; it will not even report a message to Gerrit.
Joshua Hesketh1879cf72013-08-19 14:13:15 +1000573 If the section is present, the listed reporter plugins will be
574 asked to report on the jobs.
575 Each reporter's value dictionary is handled by the reporter. See
576 reporters for more details.
James E. Blaircdd00072012-06-08 19:17:28 -0700577
Mathieu Gagnéd6d2a642013-06-11 20:59:58 -0400578**failure**
James E. Blaircdd00072012-06-08 19:17:28 -0700579 Uses the same syntax as **success**, but describes what Zuul should
580 do if at least one job fails.
James E. Blairdc253862012-06-13 17:12:42 -0700581
Joshua Heskethb7179772014-01-30 23:30:46 +1100582**merge-failure**
583 Uses the same syntax as **success**, but describes what Zuul should
584 do if it is unable to merge in the patchset. If no merge-failure
585 reporters are listed then the ``failure`` reporters will be used to
586 notify of unsuccessful merges.
587
Mathieu Gagnéd6d2a642013-06-11 20:59:58 -0400588**start**
James E. Blairdc253862012-06-13 17:12:42 -0700589 Uses the same syntax as **success**, but describes what Zuul should
Clark Boylan00635dc2012-09-19 14:03:08 -0700590 do when a change is added to the pipeline manager. This can be used,
James E. Blairdc253862012-06-13 17:12:42 -0700591 for example, to reset the value of the Verified review category.
Mathieu Gagnéd6d2a642013-06-11 20:59:58 -0400592
James E. Blair64ed6f22013-07-10 14:07:23 -0700593**precedence**
594 Indicates how the build scheduler should prioritize jobs for
595 different pipelines. Each pipeline may have one precedence, jobs
596 for pipelines with a higher precedence will be run before ones with
597 lower. The value should be one of ``high``, ``normal``, or ``low``.
598 Default: ``normal``.
599
Clark Boylanc2d19e42014-01-23 14:08:58 -0800600**window**
601 DependentPipelineManagers only. Zuul can rate limit
602 DependentPipelineManagers in a manner similar to TCP flow control.
603 Jobs are only started for changes in the queue if they sit in the
604 actionable window for the pipeline. The initial length of this window
605 is configurable with this value. The value given should be a positive
606 integer value. A value of ``0`` disables rate limiting on the
607 DependentPipelineManager.
608 Default: ``20``.
609
610**window-floor**
611 DependentPipelineManagers only. This is the minimum value for the
612 window described above. Should be a positive non zero integer value.
613 Default: ``3``.
614
615**window-increase-type**
616 DependentPipelineManagers only. This value describes how the window
617 should grow when changes are successfully merged by zuul. A value of
618 ``linear`` indicates that ``window-increase-factor`` should be added
619 to the previous window value. A value of ``exponential`` indicates
620 that ``window-increase-factor`` should be multiplied against the
621 previous window value and the result will become the window size.
622 Default: ``linear``.
623
624**window-increase-factor**
625 DependentPipelineManagers only. The value to be added or mulitplied
626 against the previous window value to determine the new window after
627 successful change merges.
628 Default: ``1``.
629
630**window-decrease-type**
631 DependentPipelineManagers only. This value describes how the window
632 should shrink when changes are not able to be merged by Zuul. A value
633 of ``linear`` indicates that ``window-decrease-factor`` should be
634 subtracted from the previous window value. A value of ``exponential``
635 indicates that ``window-decrease-factor`` should be divided against
636 the previous window value and the result will become the window size.
637 Default: ``exponential``.
638
639**window-decrease-factor**
640 DependentPipelineManagers only. The value to be subtracted or divided
641 against the previous window value to determine the new window after
642 unsuccessful change merges.
643 Default: ``2``.
644
Clark Boylan00635dc2012-09-19 14:03:08 -0700645Some example pipeline configurations are included in the sample layout
646file. The first is called a *check* pipeline::
James E. Blaircdd00072012-06-08 19:17:28 -0700647
648 - name: check
Clark Boylan00635dc2012-09-19 14:03:08 -0700649 manager: IndependentPipelineManager
James E. Blaircdd00072012-06-08 19:17:28 -0700650 trigger:
651 - event: patchset-created
652 success:
Joshua Hesketh1879cf72013-08-19 14:13:15 +1000653 gerrit:
654 verified: 1
James E. Blaircdd00072012-06-08 19:17:28 -0700655 failure:
Joshua Hesketh1879cf72013-08-19 14:13:15 +1000656 gerrit:
657 verified: -1
James E. Blaircdd00072012-06-08 19:17:28 -0700658
659This will trigger jobs each time a new patchset (or change) is
660uploaded to Gerrit, and report +/-1 values to Gerrit in the
661``verified`` review category. ::
662
663 - name: gate
Clark Boylan00635dc2012-09-19 14:03:08 -0700664 manager: DependentPipelineManager
James E. Blaircdd00072012-06-08 19:17:28 -0700665 trigger:
666 - event: comment-added
667 approval:
668 - approved: 1
669 success:
Joshua Hesketh1879cf72013-08-19 14:13:15 +1000670 gerrit:
671 verified: 2
672 submit: true
James E. Blaircdd00072012-06-08 19:17:28 -0700673 failure:
Joshua Hesketh1879cf72013-08-19 14:13:15 +1000674 gerrit:
675 verified: -2
James E. Blaircdd00072012-06-08 19:17:28 -0700676
677This will trigger jobs whenever a reviewer leaves a vote of ``1`` in the
678``approved`` review category in Gerrit (a non-standard category).
679Changes will be tested in such a way as to guarantee that they will be
680merged exactly as tested, though that will happen in parallel by
681creating a virtual queue of dependent changes and performing
682speculative execution of jobs. ::
683
684 - name: post
Clark Boylan00635dc2012-09-19 14:03:08 -0700685 manager: IndependentPipelineManager
James E. Blaircdd00072012-06-08 19:17:28 -0700686 trigger:
687 - event: ref-updated
688 ref: ^(?!refs/).*$
689
690This will trigger jobs whenever a change is merged to a named branch
691(e.g., ``master``). No output will be reported to Gerrit. This is
692useful for side effects such as creating per-commit tarballs. ::
693
694 - name: silent
Clark Boylan00635dc2012-09-19 14:03:08 -0700695 manager: IndependentPipelineManager
James E. Blaircdd00072012-06-08 19:17:28 -0700696 trigger:
697 - event: patchset-created
698
699This also triggers jobs when changes are uploaded to Gerrit, but no
700results are reported to Gerrit. This is useful for jobs that are in
Antoine Mussoce333842012-10-16 14:42:35 +0200701development and not yet ready to be presented to developers. ::
702
703 pipelines:
704 - name: post-merge
705 manager: IndependentPipelineManager
706 trigger:
707 - event: change-merged
708 success:
Joshua Hesketh1879cf72013-08-19 14:13:15 +1000709 gerrit:
710 force-message: True
Antoine Mussoce333842012-10-16 14:42:35 +0200711 failure:
Joshua Hesketh1879cf72013-08-19 14:13:15 +1000712 gerrit:
713 force-message: True
Antoine Mussoce333842012-10-16 14:42:35 +0200714
715The ``change-merged`` events happen when a change has been merged in the git
716repository. The change is thus closed and Gerrit will not accept modifications
717to the review scoring such as ``code-review`` or ``verified``. By using the
718``force-message: True`` parameter, Zuul will pass ``--force-message`` to the
719``gerrit review`` command, thus making sure the message is actually
720sent back to Gerrit regardless of approval scores.
721That kind of pipeline is nice to run regression or performance tests.
722
723.. note::
724 The ``change-merged`` event does not include the commit sha1 which can be
725 hazardous, it would let you report back to Gerrit though. If you were to
Michael Prokop526926a2013-10-24 16:16:57 +0200726 build a tarball for a specific commit, you should consider instead using
Łukasz Jernaś048acb42014-03-02 18:49:41 +0100727 the ``ref-updated`` event which does include the commit sha1 (but lacks the
Antoine Mussoce333842012-10-16 14:42:35 +0200728 Gerrit change number).
James E. Blaircdd00072012-06-08 19:17:28 -0700729
Joshua Hesketh36c3fa52014-01-22 11:40:52 +1100730
731.. _jobs:
732
James E. Blaircdd00072012-06-08 19:17:28 -0700733Jobs
734""""
735
736The jobs section is optional, and can be used to set attributes of
737jobs that are independent of their association with a project. For
738example, if a job should return a customized message on failure, that
739may be specified here. Otherwise, Zuul does not need to be told about
740each job as it builds a list from the project specification.
741
742**name**
743 The name of the job. This field is treated as a regular expression
744 and will be applied to each job that matches.
745
James E. Blairc8a1e052014-02-25 09:29:26 -0800746**queue-name (optional)**
747 Zuul will automatically combine projects that share a job into
748 shared change queues for dependent pipeline managers. In order to
749 report statistics about these queues, it is convenient for them to
750 have names. Zuul can automatically name change queues, however
751 these can grow quite long and are prone to changing as projects in
752 the queue change. If you assign a queue-name to a job, Zuul will
753 use that as the name for the shared change queue that contains that
754 job instead of the automatically generated one. It is an error for
755 a shared change queue to have more than one job with a queue-name if
756 they are not the same.
757
James E. Blaire5a847f2012-07-10 15:29:14 -0700758**failure-message (optional)**
759 The message that should be reported to Gerrit if the job fails.
James E. Blaircdd00072012-06-08 19:17:28 -0700760
James E. Blaire5a847f2012-07-10 15:29:14 -0700761**success-message (optional)**
762 The message that should be reported to Gerrit if the job fails.
James E. Blaircdd00072012-06-08 19:17:28 -0700763
James E. Blair6aea36d2012-12-17 13:03:24 -0800764**failure-pattern (optional)**
765 The URL that should be reported to Gerrit if the job fails.
James E. Blair1f4c2bb2013-04-26 08:40:46 -0700766 Defaults to the build URL or the url_pattern configured in
James E. Blair6aea36d2012-12-17 13:03:24 -0800767 zuul.conf. May be supplied as a string pattern with substitutions
768 as described in url_pattern in :ref:`zuulconf`.
769
770**success-pattern (optional)**
771 The URL that should be reported to Gerrit if the job succeeds.
James E. Blair1f4c2bb2013-04-26 08:40:46 -0700772 Defaults to the build URL or the url_pattern configured in
James E. Blair6aea36d2012-12-17 13:03:24 -0800773 zuul.conf. May be supplied as a string pattern with substitutions
774 as described in url_pattern in :ref:`zuulconf`.
775
James E. Blair222d4982012-07-16 09:31:19 -0700776**hold-following-changes (optional)**
777 This is a boolean that indicates that changes that follow this
Clark Boylan00635dc2012-09-19 14:03:08 -0700778 change in a dependent change pipeline should wait until this job
James E. Blair222d4982012-07-16 09:31:19 -0700779 succeeds before launching. If this is applied to a very short job
780 that can predict whether longer jobs will fail early, this can be
781 used to reduce the number of jobs that Zuul will launch and
782 ultimately have to cancel. In that case, a small amount of
Mathieu Gagnéd6d2a642013-06-11 20:59:58 -0400783 parallelization of jobs is traded for more efficient use of testing
James E. Blair222d4982012-07-16 09:31:19 -0700784 resources. On the other hand, to apply this to a long running job
785 would largely defeat the parallelization of dependent change testing
Mathieu Gagnéd6d2a642013-06-11 20:59:58 -0400786 that is the main feature of Zuul. Default: ``false``.
James E. Blair222d4982012-07-16 09:31:19 -0700787
James E. Blaire5a847f2012-07-10 15:29:14 -0700788**branch (optional)**
James E. Blaircdd00072012-06-08 19:17:28 -0700789 This job should only be run on matching branches. This field is
790 treated as a regular expression and multiple branches may be
791 listed.
792
James E. Blair70c71582013-03-06 08:50:50 -0800793**files (optional)**
794 This job should only be run if at least one of the files involved in
795 the change (added, deleted, or modified) matches at least one of the
796 file patterns listed here. This field is treated as a regular
797 expression and multiple expressions may be listed.
798
Mathieu Gagnéd6d2a642013-06-11 20:59:58 -0400799**voting (optional)**
800 Boolean value (``true`` or ``false``) that indicates whatever
801 a job is voting or not. Default: ``true``.
802
James E. Blaire5a847f2012-07-10 15:29:14 -0700803**parameter-function (optional)**
804 Specifies a function that should be applied to the parameters before
805 the job is launched. The function should be defined in a python file
806 included with the :ref:`includes` directive. The function
807 should have the following signature:
808
James E. Blaird0470972013-07-29 10:05:43 -0700809 .. function:: parameters(item, job, parameters)
James E. Blaire5a847f2012-07-10 15:29:14 -0700810
811 Manipulate the parameters passed to a job before a build is
812 launched. The ``parameters`` dictionary will already contain the
813 standard Zuul job parameters, and is expected to be modified
814 in-place.
815
James E. Blaird78576a2013-07-09 10:39:17 -0700816 :param item: the current queue item
817 :type item: zuul.model.QueueItem
James E. Blaird0470972013-07-29 10:05:43 -0700818 :param job: the job about to be run
819 :type job: zuul.model.Job
James E. Blaire5a847f2012-07-10 15:29:14 -0700820 :param parameters: parameters to be passed to the job
821 :type parameters: dict
822
James E. Blair1f4c2bb2013-04-26 08:40:46 -0700823 If the parameter **ZUUL_NODE** is set by this function, then it will
824 be used to specify on what node (or class of node) the job should be
825 run.
826
Joshua Hesketh36c3fa52014-01-22 11:40:52 +1100827**swift**
828 If :ref:`swift` is configured then each job can define a destination
829 container for the builder to place logs and/or assets into. Multiple
830 containers can be listed for each job by providing a unique ``name``.
831
832 *name*
833 Set an identifying name for the container. This is used in the
834 parameter key sent to the builder. For example if it ``logs`` then
835 one of the parameters sent will be ``SWIFT_logs_CONTAINER``
836 (case-sensitive).
837
838 Each of the defaults defined in :ref:`swift` can be overwritten as:
839
840 *container* (optional)
841 Container name to place the log into
842 ``For example, logs``
843
844 *expiry* (optional)
845 How long the signed destination should be available for
846
James E. Blaird6500232014-06-23 15:05:48 -0700847 *max-file-size** (optional)
Joshua Hesketh36c3fa52014-01-22 11:40:52 +1100848 The maximum size of an individual file
849
James E. Blaird6500232014-06-23 15:05:48 -0700850 *max_file_size** (optional, deprecated)
851 A deprecated alternate spelling of *max-file-size*.
852
853 *max-file-count* (optional)
Joshua Hesketh36c3fa52014-01-22 11:40:52 +1100854 The maximum number of separate files to allow
855
James E. Blaird6500232014-06-23 15:05:48 -0700856 *max_file_count* (optional, deprecated)
857 A deprecated alternate spelling of *max-file-count*.
858
859 *logserver-prefix*
Joshua Hesketh36c3fa52014-01-22 11:40:52 +1100860 Provide a URL to the CDN or logserver app so that a worker knows
861 what URL to return.
862 ``For example: http://logs.example.org/server.app?obj=``
James E. Blaird6500232014-06-23 15:05:48 -0700863 The worker should return the logserver-prefix url and the object
Joshua Hesketh36c3fa52014-01-22 11:40:52 +1100864 path as the URL in the results data packet.
865
James E. Blaird6500232014-06-23 15:05:48 -0700866 *logserver_prefix* (deprecated)
867 A deprecated alternate spelling of *logserver-prefix*.
868
James E. Blaircdd00072012-06-08 19:17:28 -0700869Here is an example of setting the failure message for jobs that check
870whether a change merges cleanly::
871
872 - name: ^.*-merge$
873 failure-message: This change was unable to be automatically merged
874 with the current state of the repository. Please rebase your
875 change and upload a new patchset.
876
877Projects
878""""""""
879
Clark Boylan00635dc2012-09-19 14:03:08 -0700880The projects section indicates what jobs should be run in each pipeline
James E. Blaircdd00072012-06-08 19:17:28 -0700881for events associated with each project. It contains a list of
882projects. Here is an example::
883
884 - name: example/project
885 check:
886 - project-merge:
887 - project-unittest
Clark Boylan00635dc2012-09-19 14:03:08 -0700888 - project-pep8
889 - project-pyflakes
James E. Blaircdd00072012-06-08 19:17:28 -0700890 gate:
891 - project-merge:
892 - project-unittest
Clark Boylan00635dc2012-09-19 14:03:08 -0700893 - project-pep8
894 - project-pyflakes
James E. Blaircdd00072012-06-08 19:17:28 -0700895 post:
896 - project-publish
897
898**name**
899 The name of the project (as known by Gerrit).
900
James E. Blair19deff22013-08-25 13:17:35 -0700901**merge-mode (optional)**
902 An optional value that indicates what strategy should be used to
903 merge changes to this project. Supported values are:
904
905 ** merge-resolve **
906 Equivalent to 'git merge -s resolve'. This corresponds closely to
907 what Gerrit performs (using JGit) for a project if the "Merge if
908 necessary" merge mode is selected and "Automatically resolve
909 conflicts" is checked. This is the default.
910
911 ** merge **
912 Equivalent to 'git merge'.
913
914 ** cherry-pick **
915 Equivalent to 'git cherry-pick'.
916
Clark Boylan00635dc2012-09-19 14:03:08 -0700917This is followed by a section for each of the pipelines defined above.
918Pipelines may be omitted if no jobs should run for this project in a
919given pipeline. Within the pipeline section, the jobs that should be
James E. Blaircdd00072012-06-08 19:17:28 -0700920executed are listed. If a job is entered as a dictionary key, then
921jobs contained within that key are only executed if the key job
922succeeds. In the above example, project-unittest, project-pep8, and
923project-pyflakes are only executed if project-merge succeeds. This
924can help avoid running unnecessary jobs.
925
James E. Blair18c64442014-03-18 10:14:45 -0700926The special job named ``noop`` is internal to Zuul and will always
927return ``SUCCESS`` immediately. This can be useful if you require
928that all changes be processed by a pipeline but a project has no jobs
929that can be run on it.
930
Andreas Jaegerbcfbf932014-09-29 20:21:44 +0200931.. seealso:: The OpenStack Zuul configuration for a comprehensive example: https://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml
James E. Blaircdd00072012-06-08 19:17:28 -0700932
Antoine Musso80edd5a2013-02-13 15:37:53 +0100933Project Templates
934"""""""""""""""""
935
Michael Prokop526926a2013-10-24 16:16:57 +0200936Whenever you have lot of similar projects (such as plugins for a project) you
Antoine Musso80edd5a2013-02-13 15:37:53 +0100937will most probably want to use the same pipeline configurations. The
938project templates let you define pipelines and job name templates to trigger.
939One can then just apply the template on its project which make it easier to
Michael Prokop526926a2013-10-24 16:16:57 +0200940update several similar projects. As an example::
Antoine Musso80edd5a2013-02-13 15:37:53 +0100941
942 project-templates:
943 # Name of the template
944 - name: plugin-triggering
945 # Definition of pipelines just like for a `project`
946 check:
947 - '{jobprefix}-merge':
948 - '{jobprefix}-pep8'
949 - '{jobprefix}-pyflakes'
950 gate:
951 - '{jobprefix}-merge':
952 - '{jobprefix}-unittest'
953 - '{jobprefix}-pep8'
954 - '{jobprefix}-pyflakes'
955
956In your projects definition, you will then apply the template using the template
957key::
958
959 projects:
960 - name: plugin/foobar
961 template:
962 - name: plugin-triggering
963 jobprefix: plugin-foobar
964
James E. Blairaea6cf62013-12-16 15:38:12 -0800965You can pass several parameters to a template. A ``parameter`` value
966will be used for expansion of ``{parameter}`` in the template
967strings. The parameter ``name`` will be automatically provided and
968will contain the short name of the project, that is the portion of the
969project name after the last ``/`` character.
James E. Blaircdd00072012-06-08 19:17:28 -0700970
James E. Blair3e98c022013-12-16 15:25:38 -0800971Multiple templates can be combined in a project, and the jobs from all
972of those templates will be added to the project. Individual jobs may
973also be added::
974
975 projects:
976 - name: plugin/foobar
977 template:
978 - name: plugin-triggering
979 jobprefix: plugin-foobar
980 - name: plugin-extras
981 jobprefix: plugin-foobar
982 check:
983 - foobar-extra-special-job
984
Steven Dake21ef9ad2014-08-25 23:08:14 -0700985Individual jobs may optionally be added to pipelines (e.g. check,
986gate, et cetera) for a project, in addtion to those provided by
987templates.
988
James E. Blair3e98c022013-12-16 15:25:38 -0800989The order of the jobs listed in the project (which only affects the
990order of jobs listed on the report) will be the jobs from each
991template in the order listed, followed by any jobs individually listed
992for the project.
993
994Note that if multiple templates are used for a project and one
995template specifies a job that is also specified in another template,
James E. Blair12a92b12014-03-26 11:54:53 -0700996or specified in the project itself, the configuration defined by
997either the last template or the project itself will take priority.
James E. Blair3e98c022013-12-16 15:25:38 -0800998
James E. Blaircdd00072012-06-08 19:17:28 -0700999logging.conf
1000~~~~~~~~~~~~
1001This file is optional. If provided, it should be a standard
1002:mod:`logging.config` module configuration file. If not present, Zuul will
1003output all log messages of DEBUG level or higher to the console.
1004
1005Starting Zuul
1006-------------
1007
1008To start Zuul, run **zuul-server**::
1009
Antoine Mussob3aa8282013-04-19 15:16:59 +02001010 usage: zuul-server [-h] [-c CONFIG] [-l LAYOUT] [-d] [-t] [--version]
James E. Blaircdd00072012-06-08 19:17:28 -07001011
1012 Project gating system.
1013
1014 optional arguments:
1015 -h, --help show this help message and exit
1016 -c CONFIG specify the config file
Antoine Mussob3aa8282013-04-19 15:16:59 +02001017 -l LAYOUT specify the layout file
James E. Blaircdd00072012-06-08 19:17:28 -07001018 -d do not run as a daemon
Antoine Mussob3aa8282013-04-19 15:16:59 +02001019 -t validate layout file syntax
1020 --version show zuul version
James E. Blaircdd00072012-06-08 19:17:28 -07001021
1022You may want to use the ``-d`` argument while you are initially setting
1023up Zuul so you can detect any configuration errors quickly. Under
1024normal operation, omit ``-d`` and let Zuul run as a daemon.
1025
1026If you send signal 1 (SIGHUP) to the zuul-server process, Zuul will
1027stop executing new jobs, wait until all executing jobs are finished,
1028reload its configuration, and resume. Any values in any of the
1029configuration files may be changed, except the location of Zuul's PID
1030file (a change to that will be ignored until Zuul is restarted).
Clark Boylanf231fa22013-02-08 12:28:53 -08001031
1032If you send a SIGUSR1 to the zuul-server process, Zuul will stop
1033executing new jobs, wait until all executing jobs are finished,
1034then exit. While waiting to exit Zuul will queue Gerrit events and
1035save these events prior to exiting. When Zuul starts again it will
1036read these saved events and act on them.
Jeremy Stanley93e05f42013-03-08 17:29:17 +00001037
Michael Prokop526926a2013-10-24 16:16:57 +02001038If you need to abort Zuul and intend to manually requeue changes for
Jeremy Stanley93e05f42013-03-08 17:29:17 +00001039jobs which were running in its pipelines, prior to terminating you can
1040use the zuul-changes.py tool script to simplify the process. For
1041example, this would give you a list of Gerrit commands to reverify or
1042recheck changes for the gate and check pipelines respectively::
1043
1044 ./tools/zuul-changes.py --review-host=review.openstack.org \
1045 http://zuul.openstack.org/ gate 'reverify no bug'
1046 ./tools/zuul-changes.py --review-host=review.openstack.org \
1047 http://zuul.openstack.org/ check 'recheck no bug'
Clark Boylanfba9b242013-08-20 10:11:17 -07001048
1049If you send a SIGUSR2 to the zuul-server process, Zuul will dump a stack
1050trace for each running thread into its debug log. This is useful for
1051tracking down deadlock or otherwise slow threads.
Antoine Mussod0f06262014-06-04 09:54:24 +02001052
1053When `yappi <https://code.google.com/p/yappi/>`_ (Yet Another Python
1054Profiler) is available, additional functions' and threads' stats are
1055emitted as well. The first SIGUSR2 will enable yappi, on the second
1056SIGUSR2 it dumps the information collected, resets all yappi state and
1057stops profiling. This is to minimize the impact of yappi on a running
1058system.