Add base-config.yaml to define non-environment
variable config for review app deploy. Define
resource requests and limits for all used apps

Add in a job to purge previous release in Review App

Signed-off-by: Takuya Noguchi <takninnovationresearch@gmail.com>

Signed-off-by: Rémy Coutable <remy@rymai.me>

Signed-off-by: Balasankar "Balu" C <balasankar@gitlab.com>

This change was made in EE in MR
https://gitlab.com/gitlab-org/gitlab-ee/merge_requests/14802, but this
was not backported to CE.

This will help identify Sidekiq jobs that invoke excessive number of
filesystem access.

The timing data is stored in `RequestStore`, but this is only active
within the middleware and is not directly accessible to the Sidekiq
logger. However, it is possible for the middleware to modify the job
hash to pass this data along to the logger.

Signed-off-by: Rémy Coutable <remy@rymai.me>

Signed-off-by: Rémy Coutable <remy@rymai.me>

This backport changes made by EE to the files in the scripts/ directory.
This comes with a few changes to some scripts to make them work in the
single codebase setup.

Changes all calls to data_source_exists? to table_exists?
since that is the intent of these calls

This will help diagnose the source of excessive I/O from Rugged
calls. To implement this, we need to obtain the full list of arguments
sent to each request method.

Signed-off-by: Rémy Coutable <remy@rymai.me>

Signed-off-by: Rémy Coutable <remy@rymai.me>

None of this code can be reached any more, so it can all be removed

Signed-off-by: Rémy Coutable <remy@rymai.me>

cc !30979

This adds `rugged_duration_ms` and `rugged_calls` fields to
`api_json.log` and `production_json.log`. This will make it easier to
identify performance issues caused by excessive I/O.

Closes https://gitlab.com/gitlab-org/gitlab-ce/issues/64676

Creates reports for parallel specs and collates them into a single
HTML report and displays results on the merge request.

Peter Leitzen authored 5 years ago and Achilleas Pipinellis committed 5 years ago

Using the old link redirects to
https://docs.gitlab.com/ee/development/documentation/index.html
which does not show the mentioned documentation.

Pin the version of deployed external-dns to `2.y.z`, using SemVer
matching. (`^2.2.1`)

Update the properties for the service account keys per
*Upgrading to 2.0.0* of the `stable/external-dns` README.

Add `aws.batchChangeSize=400` to combat messages about RDATA being
too large.

Closes https://gitlab.com/gitlab-org/gitlab-ce/issues/64356

Log memory stats after running each spec file and compile the report.

Search and replace gitlab-com/gitlab-docs with gitlab-org/gitlab-docs.
For https://gitlab.com/gitlab-com/gitlab-docs/issues/310

Signed-off-by: Rémy Coutable <remy@rymai.me>

Preload the app in `production` env, hit it with a single request, and
gather total gem memory consumption data using `derailed exec perf:mem`
from `derailed_benchmarks`. Present the result as MR metrics.

This reverts merge request !30031

Preload the app in `production` env, hit it with a single request, and
gather total gem memory consumption data using `derailed exec perf:mem`
from `derailed_benchmarks`. Present the result as MR metrics.

Signed-off-by: Rémy Coutable <remy@rymai.me>

Signed-off-by: Rémy Coutable <remy@rymai.me>

This includes several changes:
  - Rename memory-static to generate-gems-size-metrics-static
  - Rename memory-static-objects to generate-gems-memory-metrics-static
  - Change generate-gems-size-metrics-static interface. The script now
    expect `bundle exec derailed bundle:mem` output as its input. The
    script output to stdout, or stderr for error message.
  - Change generate-gems-memory-metrics-static interface. The script now
    expect `bundle exec derailed bundle:objects` output as its input.
    The script output to stdout, or stderr for error message.
  - Generate gem size metrics. Script generate-gems-size-metrics-static
    extract each gem size from `bundle exec derailed bundle:mem` output.
    Save output to metrics file in format: 'gem_size_mb{name="zip"} 0.5'

Signed-off-by: Rémy Coutable <remy@rymai.me>

Two static memory benchmarks will be included in our CI pipeline. It
will load gems from the Gemfile and check the amount of RAM consumed
as well as the number of objects allocated and retained.
Aggregated values will be included as 'metrics' into MRs while full
reports will be downloadable as job artifacts.

Prior to this change, the hooks directory got cleared. That works, but
is not the way to go about it as there's a better way. Setting the env
var this commits sets.

Signed-off-by: Rémy Coutable <remy@rymai.me>

Signed-off-by: Rémy Coutable <remy@rymai.me>