Prometheus metrics endpoint at "/-/metrics" crashes unicorn workers
Enabling Prometheus metrics on gitlab.com causes unicorn
workers to crash and trigger HTTP 502 errors when users tried to log-in. See https://gitlab.com/gitlab-com/infrastructure/issues/2180 for extra details of the outage.
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/prometheus-client-mmap-0.7.0.beta5/lib/prometheus/client/valuetype.rb:128: [BUG] Bus Error at 0x007f6cb2ef7000
ruby 2.3.3p222 (2016-11-21 revision 56859) [x86_64-linux]
-- Control frame information -----------------------------------------------
c:0133 p:---- s:0711 e:000710 CFUNC :[]
c:0132 p:---- s:0709 e:000708 CFUNC :[]
c:0131 p:0117 s:0705 e:000704 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/prometheus-client-mmap-0.7.0.beta5/lib/prometheus/client/valuetype.rb:128 [FINISH]
c:0130 p:---- s:0701 e:000700 CFUNC :new
c:0129 p:0050 s:0697 e:000696 BLOCK /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/prometheus-client-mmap-0.7.0.beta5/lib/prometheus/client/formats/text.rb:46 [FINISH]
c:0128 p:---- s:0691 e:000690 CFUNC :each
c:0127 p:0051 s:0688 e:000687 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/prometheus-client-mmap-0.7.0.beta5/lib/prometheus/client/formats/text.rb:43
c:0126 p:0024 s:0682 e:000681 METHOD /opt/gitlab/embedded/service/gitlab-rails/app/services/metrics_service.rb:11
c:0125 p:0015 s:0679 e:000676 METHOD /opt/gitlab/embedded/service/gitlab-rails/app/services/metrics_service.rb:21
c:0124 p:0012 s:0674 e:000672 METHOD /opt/gitlab/embedded/service/gitlab-rails/app/controllers/metrics_controller.rb:9
c:0123 p:0014 s:0670 e:000669 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal/implicit_render.rb:4
c:0122 p:0014 s:0664 e:000663 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/abstract_controller/base.rb:198
c:0121 p:0035 s:0659 e:000658 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal/rendering.rb:10
c:0120 p:0012 s:0655 e:000654 BLOCK /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/abstract_controller/callbacks.rb:20 [FINISH]
c:0119 p:0041 s:0653 e:000651 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:117
c:0118 p:0018 s:0647 e:000646 BLOCK /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:555 [FINISH]
c:0117 p:0024 s:0644 e:000643 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:505
c:0116 p:0012 s:0639 e:000638 BLOCK /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:498 [FINISH]
c:0115 p:0074 s:0637 e:000636 BLOCK /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:298 [FINISH]
c:0114 p:0014 s:0630 E:002518 BLOCK /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:497 [FINISH]
c:0113 p:0024 s:0627 e:000626 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:505
c:0112 p:0066 s:0622 e:000621 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:92
c:0111 p:0015 s:0615 e:000614 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:778
c:0110 p:0020 s:0611 e:000610 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:81
c:0109 p:0011 s:0606 E:001fc8 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/abstract_controller/callbacks.rb:19
c:0108 p:0012 s:0602 e:000601 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal/rescue.rb:29
c:0107 p:0014 s:0597 e:000596 BLOCK /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal/instrumentation.rb:32
c:0106 p:0014 s:0593 e:000592 BLOCK /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/notifications.rb:164
c:0105 p:0027 s:0591 e:000590 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/notifications/instrumenter.rb:20
c:0104 p:0033 s:0585 e:000584 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/notifications.rb:164
c:0103 p:0108 s:0580 e:000579 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal/instrumentation.rb:30
c:0102 p:0154 s:0575 e:000574 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal/params_wrapper.rb:250
c:0101 p:0029 s:0568 e:000567 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activerecord-4.2.8/lib/active_record/railties/controller_runtime.rb:18
c:0100 p:0075 s:0563 e:000562 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/abstract_controller/base.rb:137
c:0099 p:0065 s:0557 e:000556 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionview-4.2.8/lib/action_view/rendering.rb:30
c:0098 p:0038 s:0552 e:000551 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal.rb:196
c:0097 p:0023 s:0547 e:000546 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal/rack_delegation.rb:13
c:0096 p:0020 s:0542 e:000541 LAMBDA /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal.rb:237 [FINISH]
c:0095 p:0016 s:0539 e:000538 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/routing/route_set.rb:74
c:0094 p:0088 s:0533 e:000532 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/routing/route_set.rb:43
c:0093 p:0137 s:0527 e:000526 BLOCK /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/journey/router.rb:43 [FINISH]
c:0092 p:---- s:0516 e:000515 CFUNC :each
c:0091 p:0014 s:0513 e:000512 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/journey/router.rb:30
c:0090 p:0052 s:0509 e:000508 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/routing/route_set.rb:817
c:0089 p:0082 s:0504 e:000503 METHOD /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/performance_bar/peek_performance_bar_with_rack_body.rb:16
c:0088 p:0208 s:0497 e:000496 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/omniauth-1.4.2/lib/omniauth/strategy.rb:186
c:0087 p:0013 s:0492 e:000491 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/omniauth-1.4.2/lib/omniauth/strategy.rb:164
c:0086 p:0208 s:0488 e:000487 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/omniauth-1.4.2/lib/omniauth/strategy.rb:186
c:0085 p:0013 s:0483 e:000482 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/omniauth-1.4.2/lib/omniauth/strategy.rb:164
c:0084 p:0208 s:0479 e:000478 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/omniauth-1.4.2/lib/omniauth/strategy.rb:186
c:0083 p:0013 s:0474 e:000473 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/omniauth-1.4.2/lib/omniauth/strategy.rb:164
c:0082 p:0208 s:0470 e:000469 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/omniauth-1.4.2/lib/omniauth/strategy.rb:186
c:0081 p:0013 s:0465 e:000464 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/omniauth-1.4.2/lib/omniauth/strategy.rb:164
c:0080 p:0037 s:0461 e:000460 METHOD /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/middleware/multipart.rb:93
c:0079 p:0032 s:0455 e:000454 METHOD /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/request_profiler/middleware.rb:14
c:0078 p:0028 s:0451 e:000450 METHOD /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/rack_middleware.rb:37
c:0077 p:0050 s:0446 e:000445 METHOD /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/middleware/go.rb:16
c:0076 p:0112 s:0441 e:000440 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/flipper-0.10.2/lib/flipper/middleware/memoizer.rb:55
c:0075 p:0059 s:0434 e:000433 METHOD /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/etag_caching/middleware.rb:11
c:0074 p:0092 s:0422 e:000421 METHOD /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/middleware/rails_queue_duration.rb:20
c:0073 p:0012 s:0416 e:000415 BLOCK /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/rack_middleware.rb:29
c:0072 p:0060 s:0414 e:000413 METHOD /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/transaction.rb:49
c:0071 p:0027 s:0411 e:000410 METHOD /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/rack_middleware.rb:29
c:0070 p:0012 s:0404 e:000403 BLOCK /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/warden-1.2.6/lib/warden/manager.rb:35 [FINISH]
c:0069 p:---- s:0402 e:000401 CFUNC :catch
c:0068 p:0073 s:0398 e:000397 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/warden-1.2.6/lib/warden/manager.rb:34
c:0067 p:0216 s:0393 e:000392 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-cors-0.4.0/lib/rack/cors.rb:80
c:0066 p:0140 s:0381 e:000380 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-attack-4.4.1/lib/rack/attack.rb:107
c:0065 p:0012 s:0376 e:000375 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/etag.rb:24
c:0064 p:0058 s:0366 e:000365 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/conditionalget.rb:25
c:0063 p:0012 s:0358 e:000357 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/head.rb:13
c:0062 p:0036 s:0351 e:000350 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/params_parser.rb:27
c:0061 p:0154 s:0346 e:000345 METHOD /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/middleware/readonly_geo.rb:30
c:0060 p:0012 s:0341 e:000340 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/flash.rb:260
c:0059 p:0025 s:0335 e:000334 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/session/abstract/id.rb:225
c:0058 p:0010 s:0327 e:000326 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/session/abstract/id.rb:220
c:0057 p:0012 s:0323 e:000322 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/cookies.rb:560
c:0056 p:0061 s:0315 e:000314 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activerecord-4.2.8/lib/active_record/query_cache.rb:36
c:0055 p:0022 s:0306 e:000305 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activerecord-4.2.8/lib/active_record/connection_adapters/abstract/connection_pool
c:0054 p:0014 s:0300 e:000299 BLOCK /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/callbacks.rb:29
c:0053 p:0021 s:0298 e:000297 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:88
c:0052 p:0015 s:0291 e:000290 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:778
c:0051 p:0020 s:0287 e:000286 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:81
c:0050 p:0016 s:0282 E:000af8 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/callbacks.rb:27
c:0049 p:0034 s:0276 e:000275 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/remote_ip.rb:78
c:0048 p:0012 s:0272 e:000271 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/debug_exceptions.rb:17
c:0047 p:0012 s:0263 e:000262 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/show_exceptions.rb:30
c:0046 p:0083 s:0258 E:001630 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/rack/logger.rb:38
c:0045 p:0012 s:0251 e:000250 BLOCK /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/rack/logger.rb:20
c:0044 p:0007 s:0249 e:000248 BLOCK /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/tagged_logging.rb:68
c:0043 p:0019 s:0247 e:000246 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/tagged_logging.rb:26
c:0042 p:0016 s:0242 e:000241 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/tagged_logging.rb:68
c:0041 p:0049 s:0238 e:000237 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/rack/logger.rb:20
c:0040 p:0050 s:0233 e:000232 METHOD /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/request_context.rb:18
c:0039 p:0025 s:0228 e:000227 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/request_store-1.3.1/lib/request_store/middleware.rb:9
c:0038 p:0035 s:0224 e:000223 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/request_id.rb:21
c:0037 p:0099 s:0220 e:000219 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/methodoverride.rb:22
c:0036 p:0020 s:0215 e:000214 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/runtime.rb:18
c:0035 p:0056 s:0206 e:000205 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/lock.rb:17
c:0034 p:0012 s:0199 e:000198 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/sendfile.rb:113
c:0033 p:0048 s:0188 e:000187 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/sentry-raven-2.4.0/lib/raven/integrations/rack.rb:50
c:0032 p:0066 s:0181 e:000180 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/engine.rb:518
c:0031 p:0042 s:0177 e:000176 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/application.rb:165 [FINISH]
c:0030 p:---- s:0173 e:000172 CFUNC :public_send
c:0029 p:0033 s:0168 e:000167 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/railtie.rb:194
c:0028 p:0170 s:0162 e:000161 BLOCK /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/urlmap.rb:66 [FINISH]
c:0027 p:---- s:0154 e:000153 CFUNC :each
c:0026 p:0067 s:0151 e:000150 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/urlmap.rb:50
c:0025 p:0021 s:0142 e:000141 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/unicorn-5.1.0/lib/unicorn/http_server.rb:562
c:0024 p:0012 s:0133 e:000132 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/unicorn-worker-killer-0.4.4/lib/unicorn/worker_killer.rb:52
c:0023 p:0149 s:0128 E:0019b0 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/unicorn-5.1.0/lib/unicorn/http_server.rb:658
c:0022 p:0113 s:0115 e:000114 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/unicorn-5.1.0/lib/unicorn/http_server.rb:508
c:0021 p:0048 s:0108 e:000107 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/unicorn-5.1.0/lib/unicorn/http_server.rb:519
c:0020 p:0248 s:0104 e:000103 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/unicorn-5.1.0/lib/unicorn/http_server.rb:283
c:0019 p:0216 s:0097 E:0001d0 TOP /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/unicorn-5.1.0/bin/unicorn:126 [FINISH]
c:0018 p:---- s:0091 e:000090 CFUNC :load
c:0017 p:0136 s:0087 e:000086 TOP /opt/gitlab/embedded/bin/unicorn:22 [FINISH]
c:0016 p:---- s:0083 e:000082 CFUNC :load
c:0015 p:0170 s:0079 e:000078 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/cli/exec.rb:74
c:0014 p:0089 s:0070 e:000069 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/cli/exec.rb:27
c:0013 p:0032 s:0066 e:000065 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/cli.rb:332
c:0012 p:0078 s:0062 e:000061 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/vendor/thor/lib/thor/command.rb:27
c:0011 p:0058 s:0055 e:000054 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/vendor/thor/lib/thor/invocation.rb:126
c:0010 p:0291 s:0049 e:000048 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/vendor/thor/lib/thor.rb:359
c:0009 p:0012 s:0037 e:000036 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/cli.rb:20
c:0008 p:0070 s:0033 e:000032 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/vendor/thor/lib/thor/base.rb:440
c:0007 p:0012 s:0027 e:000026 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/cli.rb:11
c:0006 p:0090 s:0022 e:000021 BLOCK /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/exe/bundle:34
c:0005 p:0006 s:0017 e:000016 METHOD /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/friendly_errors.rb:100
c:0004 p:0172 s:0013 E:000298 TOP /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/exe/bundle:26 [FINISH]
c:0003 p:---- s:0010 e:000009 CFUNC :load
c:0002 p:0136 s:0006 E:002090 EVAL /opt/gitlab/embedded/bin/bundle:22 [FINISH]
c:0001 p:0000 s:0002 E:001b50 (none) [FINISH]
-- Ruby level backtrace information ----------------------------------------
/opt/gitlab/embedded/bin/bundle:22:in `<main>'
/opt/gitlab/embedded/bin/bundle:22:in `load'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/exe/bundle:26:in `<top (required)>'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/friendly_errors.rb:100:in `with_friendly_errors'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/exe/bundle:34:in `block in <top (required)>'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/cli.rb:11:in `start'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/vendor/thor/lib/thor/base.rb:440:in `start'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/cli.rb:20:in `dispatch'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/vendor/thor/lib/thor.rb:359:in `dispatch'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/vendor/thor/lib/thor/invocation.rb:126:in `invoke_command'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/vendor/thor/lib/thor/command.rb:27:in `run'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/cli.rb:332:in `exec'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/cli/exec.rb:27:in `run'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/cli/exec.rb:74:in `kernel_load'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.13.7/lib/bundler/cli/exec.rb:74:in `load'
/opt/gitlab/embedded/bin/unicorn:22:in `<top (required)>'
/opt/gitlab/embedded/bin/unicorn:22:in `load'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/unicorn-5.1.0/bin/unicorn:126:in `<top (required)>'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/unicorn-5.1.0/lib/unicorn/http_server.rb:283:in `join'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/unicorn-5.1.0/lib/unicorn/http_server.rb:519:in `maintain_worker_count'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/unicorn-5.1.0/lib/unicorn/http_server.rb:508:in `spawn_missing_workers'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/unicorn-5.1.0/lib/unicorn/http_server.rb:658:in `worker_loop'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/unicorn-worker-killer-0.4.4/lib/unicorn/worker_killer.rb:52:in `process_client'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/unicorn-5.1.0/lib/unicorn/http_server.rb:562:in `process_client'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/urlmap.rb:50:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/urlmap.rb:50:in `each'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/urlmap.rb:66:in `block in call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/railtie.rb:194:in `method_missing'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/railtie.rb:194:in `public_send'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/application.rb:165:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/engine.rb:518:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/sentry-raven-2.4.0/lib/raven/integrations/rack.rb:50:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/sendfile.rb:113:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/lock.rb:17:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/runtime.rb:18:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/methodoverride.rb:22:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/request_id.rb:21:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/request_store-1.3.1/lib/request_store/middleware.rb:9:in `call'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/request_context.rb:18:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/rack/logger.rb:20:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/tagged_logging.rb:68:in `tagged'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/tagged_logging.rb:26:in `tagged'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/tagged_logging.rb:68:in `block in tagged'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/rack/logger.rb:20:in `block in call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/rack/logger.rb:38:in `call_app'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/show_exceptions.rb:30:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/debug_exceptions.rb:17:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/remote_ip.rb:78:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/callbacks.rb:27:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:81:in `run_callbacks'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:778:in `_run_call_callbacks'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:88:in `__run_callbacks__'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/callbacks.rb:29:in `block in call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activerecord-4.2.8/lib/active_record/connection_adapters/abstract/connection_pool.rb:653:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activerecord-4.2.8/lib/active_record/query_cache.rb:36:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/cookies.rb:560:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/session/abstract/id.rb:220:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/session/abstract/id.rb:225:in `context'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/flash.rb:260:in `call'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/middleware/readonly_geo.rb:30:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/middleware/params_parser.rb:27:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/head.rb:13:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/conditionalget.rb:25:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-1.6.5/lib/rack/etag.rb:24:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-attack-4.4.1/lib/rack/attack.rb:107:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/rack-cors-0.4.0/lib/rack/cors.rb:80:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/warden-1.2.6/lib/warden/manager.rb:34:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/warden-1.2.6/lib/warden/manager.rb:34:in `catch'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/warden-1.2.6/lib/warden/manager.rb:35:in `block in call'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/rack_middleware.rb:29:in `call'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/transaction.rb:49:in `run'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/rack_middleware.rb:29:in `block in call'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/middleware/rails_queue_duration.rb:20:in `call'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/etag_caching/middleware.rb:11:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/flipper-0.10.2/lib/flipper/middleware/memoizer.rb:55:in `call'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/middleware/go.rb:16:in `call'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/rack_middleware.rb:37:in `call'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/request_profiler/middleware.rb:14:in `call'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/middleware/multipart.rb:93:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/omniauth-1.4.2/lib/omniauth/strategy.rb:164:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/omniauth-1.4.2/lib/omniauth/strategy.rb:186:in `call!'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/omniauth-1.4.2/lib/omniauth/strategy.rb:164:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/omniauth-1.4.2/lib/omniauth/strategy.rb:186:in `call!'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/omniauth-1.4.2/lib/omniauth/strategy.rb:164:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/omniauth-1.4.2/lib/omniauth/strategy.rb:186:in `call!'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/omniauth-1.4.2/lib/omniauth/strategy.rb:164:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/omniauth-1.4.2/lib/omniauth/strategy.rb:186:in `call!'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/performance_bar/peek_performance_bar_with_rack_body.rb:16:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/routing/route_set.rb:817:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/journey/router.rb:30:in `serve'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/journey/router.rb:30:in `each'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/journey/router.rb:43:in `block in serve'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/routing/route_set.rb:43:in `serve'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_dispatch/routing/route_set.rb:74:in `dispatch'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal.rb:237:in `block in action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal/rack_delegation.rb:13:in `dispatch'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal.rb:196:in `dispatch'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionview-4.2.8/lib/action_view/rendering.rb:30:in `process'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/abstract_controller/base.rb:137:in `process'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activerecord-4.2.8/lib/active_record/railties/controller_runtime.rb:18:in `process_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal/params_wrapper.rb:250:in `process_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal/instrumentation.rb:30:in `process_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/notifications.rb:164:in `instrument'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/notifications/instrumenter.rb:20:in `instrument'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/notifications.rb:164:in `block in instrument'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal/instrumentation.rb:32:in `block in process_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal/rescue.rb:29:in `process_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/abstract_controller/callbacks.rb:19:in `process_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:81:in `run_callbacks'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:778:in `_run_process_action_callbacks'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:92:in `__run_callbacks__'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:505:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:497:in `block in around'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:298:in `block in halting_and_conditional'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:498:in `block (2 levels) in around'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:505:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:555:in `block (2 levels) in compile'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/callbacks.rb:117:in `call'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/abstract_controller/callbacks.rb:20:in `block in process_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal/rendering.rb:10:in `process_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/abstract_controller/base.rb:198:in `process_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/actionpack-4.2.8/lib/action_controller/metal/implicit_render.rb:4:in `send_action'
/opt/gitlab/embedded/service/gitlab-rails/app/controllers/metrics_controller.rb:9:in `index'
/opt/gitlab/embedded/service/gitlab-rails/app/services/metrics_service.rb:21:in `metrics_text'
/opt/gitlab/embedded/service/gitlab-rails/app/services/metrics_service.rb:11:in `prometheus_metrics_text'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/prometheus-client-mmap-0.7.0.beta5/lib/prometheus/client/formats/text.rb:43:in `marshal_multiprocess'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/prometheus-client-mmap-0.7.0.beta5/lib/prometheus/client/formats/text.rb:43:in `each'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/prometheus-client-mmap-0.7.0.beta5/lib/prometheus/client/formats/text.rb:46:in `block in marshal_multiprocess'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/prometheus-client-mmap-0.7.0.beta5/lib/prometheus/client/formats/text.rb:46:in `new'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/prometheus-client-mmap-0.7.0.beta5/lib/prometheus/client/valuetype.rb:128:in `initialize'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/prometheus-client-mmap-0.7.0.beta5/lib/prometheus/client/valuetype.rb:128:in `[]'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/prometheus-client-mmap-0.7.0.beta5/lib/prometheus/client/valuetype.rb:128:in `[]'
-- Machine register context ------------------------------------------------
RIP: 0x00007f6cb4abf005 RBP: 0x00007f6c868f9a40 RSP: 0x00007ffc4f9b1778
RAX: 0x00007f6c868f9a50 RBX: 0x0000000000000004 RCX: 0x00007f6c89aee000
RDX: 0x0000000000000004 RDI: 0x00007f6c868f9a50 RSI: 0x00007f6cb2ef7000
R8: 0x00007ffc4f9b16d8 R9: 0x00007f6cb3c16000 R10: 0x0000000000000090
R11: 0x00007f6cb3c1c000 R12: 0x0000000000000001 R13: 0x00007f6cb2ef7000
R14: 0x00007f6cb3ddfd48 R15: 0x00007f6cb3dda0b0 EFL: 0x0000000000010246
-- C level backtrace information -------------------------------------------
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_vm_bugreport+0x4f3) [0x7f6cb4f27633] vm_dump.c:692
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_bug_context+0xd4) [0x7f6cb4db8014] error.c:435
/opt/gitlab/embedded/lib/libruby.so.2.3(sigbus+0x3e) [0x7f6cb4e95b9e] signal.c:866
/lib/x86_64-linux-gnu/libc.so.6 [0x7f6cb49a64b0]
/lib/x86_64-linux-gnu/libc.so.6 [0x7f6cb4abf005]
/opt/gitlab/embedded/lib/libruby.so.2.3(str_new0+0x66) [0x7f6cb4ea3fc6] /usr/include/x86_64-linux-gnu/bits/string3.h:53
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_str_substr+0x7e) [0x7f6cb4eb659e] string.c:2292
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_str_aref_m+0x107) [0x7f6cb4eb67f7] string.c:3981
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call0_body.constprop.118+0x280) [0x7f6cb4f21d80] vm_eval.c:131
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_call0+0xc7) [0x7f6cb4f22367] vm_eval.c:61
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/mmap2-2.2.7/lib/mmap/mmap.so(mm_aref_m+0x186) [0x7f6c957a0cc6] mmap.c:1985
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_cfunc+0xf0) [0x7f6cb4f104c0] vm_insnhelper.c:1642
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_method_each_type+0x5e) [0x7f6cb4f1fede] vm_insnhelper.c:2026
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_method+0xe3) [0x7f6cb4f20453] vm_insnhelper.c:2176
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec_core+0x32f1) [0x7f6cb4f1b8b1] insns.def:1859
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec+0x86) [0x7f6cb4f1e436] vm.c:1650
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call0_body.constprop.118+0x1b7) [0x7f6cb4f21cb7] vm_eval.c:182
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_call0+0xc7) [0x7f6cb4f22367] vm_eval.c:61
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_class_new_instance+0x21) [0x7f6cb4e20a91] object.c:1856
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_cfunc+0xf0) [0x7f6cb4f104c0] vm_insnhelper.c:1642
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_method_each_type+0x5e) [0x7f6cb4f1fede] vm_insnhelper.c:2026
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_method+0xe3) [0x7f6cb4f20453] vm_insnhelper.c:2176
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec_core+0x1219) [0x7f6cb4f197d9] insns.def:994
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec+0x86) [0x7f6cb4f1e436] vm.c:1650
/opt/gitlab/embedded/lib/libruby.so.2.3(invoke_block_from_c_0+0x2ed) [0x7f6cb4f1f10d] vm.c:921
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_yield+0x5c) [0x7f6cb4f1f37c] vm.c:988
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_ary_each+0x3d) [0x7f6cb4d6b72d] array.c:1815
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_cfunc+0xf0) [0x7f6cb4f104c0] vm_insnhelper.c:1642
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_method_each_type+0x5e) [0x7f6cb4f1fede] vm_insnhelper.c:2026
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_method+0xe3) [0x7f6cb4f20453] vm_insnhelper.c:2176
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec_core+0x1148) [0x7f6cb4f19708] insns.def:963
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec+0x86) [0x7f6cb4f1e436] vm.c:1650
/opt/gitlab/embedded/lib/libruby.so.2.3(invoke_block_from_c_0+0x2ed) [0x7f6cb4f1f10d] vm.c:921
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_invoke_proc+0xc3) [0x7f6cb4f1f1e3] vm.c:996
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_opt_call+0xa4) [0x7f6cb4f1fe04] vm.c:1072
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec_core+0x1219) [0x7f6cb4f197d9] insns.def:994
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec+0x86) [0x7f6cb4f1e436] vm.c:1650
/opt/gitlab/embedded/lib/libruby.so.2.3(invoke_block_from_c_0+0x2ed) [0x7f6cb4f1f10d] vm.c:921
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_invoke_proc+0xc3) [0x7f6cb4f1f1e3] vm.c:996
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_opt_call+0xa4) [0x7f6cb4f1fe04] vm.c:1072
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec_core+0x1219) [0x7f6cb4f197d9] insns.def:994
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec+0x86) [0x7f6cb4f1e436] vm.c:1650
/opt/gitlab/embedded/lib/libruby.so.2.3(invoke_block_from_c_0+0x2ed) [0x7f6cb4f1f10d] vm.c:921
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_invoke_proc+0xc3) [0x7f6cb4f1f1e3] vm.c:996
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_opt_call+0xa4) [0x7f6cb4f1fe04] vm.c:1072
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec_core+0x1219) [0x7f6cb4f197d9] insns.def:994
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec+0x86) [0x7f6cb4f1e436] vm.c:1650
/opt/gitlab/embedded/lib/libruby.so.2.3(invoke_block_from_c_0+0x2ed) [0x7f6cb4f1f10d] vm.c:921
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_invoke_proc+0xc3) [0x7f6cb4f1f1e3] vm.c:996
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_opt_call+0xa4) [0x7f6cb4f1fe04] vm.c:1072
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec_core+0x1148) [0x7f6cb4f19708] insns.def:963
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec+0x86) [0x7f6cb4f1e436] vm.c:1650
/opt/gitlab/embedded/lib/libruby.so.2.3(invoke_block_from_c_0+0x2ed) [0x7f6cb4f1f10d] vm.c:921
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_invoke_proc+0xc3) [0x7f6cb4f1f1e3] vm.c:996
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_opt_call+0xa4) [0x7f6cb4f1fe04] vm.c:1072
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec_core+0x1219) [0x7f6cb4f197d9] insns.def:994
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec+0x86) [0x7f6cb4f1e436] vm.c:1650
/opt/gitlab/embedded/lib/libruby.so.2.3(invoke_block_from_c_0+0x2ed) [0x7f6cb4f1f10d] vm.c:921
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_invoke_proc+0xc3) [0x7f6cb4f1f1e3] vm.c:996
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_opt_call+0xa4) [0x7f6cb4f1fe04] vm.c:1072
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec_core+0x1219) [0x7f6cb4f197d9] insns.def:994
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec+0x86) [0x7f6cb4f1e436] vm.c:1650
/opt/gitlab/embedded/lib/libruby.so.2.3(invoke_block_from_c_0+0x2ed) [0x7f6cb4f1f10d] vm.c:921
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_yield+0x5c) [0x7f6cb4f1f37c] vm.c:988
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_ary_each+0x3d) [0x7f6cb4d6b72d] array.c:1815
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_cfunc+0xf0) [0x7f6cb4f104c0] vm_insnhelper.c:1642
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec_core+0x1148) [0x7f6cb4f19708] insns.def:963
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec+0x86) [0x7f6cb4f1e436] vm.c:1650
/opt/gitlab/embedded/lib/libruby.so.2.3(invoke_block_from_c_0+0x2ed) [0x7f6cb4f1f10d] vm.c:921
/opt/gitlab/embedded/lib/libruby.so.2.3(catch_i+0x54) [0x7f6cb4f1f564] vm.c:988
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_catch_protect+0xaa) [0x7f6cb4f12fba] vm_eval.c:2019
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_catch_obj+0xe) [0x7f6cb4f1309e] vm_eval.c:1998
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_f_catch+0x2e) [0x7f6cb4f1314e] vm_eval.c:1984
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_cfunc+0xf0) [0x7f6cb4f104c0] vm_insnhelper.c:1642
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec_core+0x1148) [0x7f6cb4f19708] insns.def:963
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec+0x86) [0x7f6cb4f1e436] vm.c:1650
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call0_body.constprop.118+0x1b7) [0x7f6cb4f21cb7] vm_eval.c:182
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_call0+0xc7) [0x7f6cb4f22367] vm_eval.c:61
/opt/gitlab/embedded/lib/libruby.so.2.3(send_internal+0xcd) [0x7f6cb4f225ed] vm_eval.c:955
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_cfunc+0xf0) [0x7f6cb4f104c0] vm_insnhelper.c:1642
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec_core+0x1148) [0x7f6cb4f19708] insns.def:963
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec+0x86) [0x7f6cb4f1e436] vm.c:1650
/opt/gitlab/embedded/lib/libruby.so.2.3(invoke_block_from_c_0+0x2ed) [0x7f6cb4f1f10d] vm.c:921
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_yield+0x5c) [0x7f6cb4f1f37c] vm.c:988
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_ary_each+0x3d) [0x7f6cb4d6b72d] array.c:1815
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_cfunc+0xf0) [0x7f6cb4f104c0] vm_insnhelper.c:1642
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec_core+0x1148) [0x7f6cb4f19708] insns.def:963
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec+0x86) [0x7f6cb4f1e436] vm.c:1650
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_load_internal0+0xb9) [0x7f6cb4dc3e69] load.c:619
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_f_load+0x86) [0x7f6cb4dc4526] load.c:649
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_cfunc+0xf0) [0x7f6cb4f104c0] vm_insnhelper.c:1642
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_method_each_type+0x5e) [0x7f6cb4f1fede] vm_insnhelper.c:2026
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_method+0xe3) [0x7f6cb4f20453] vm_insnhelper.c:2176
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec_core+0x1219) [0x7f6cb4f197d9] insns.def:994
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec+0x86) [0x7f6cb4f1e436] vm.c:1650
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_load_internal0+0xb9) [0x7f6cb4dc3e69] load.c:619
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_f_load+0x86) [0x7f6cb4dc4526] load.c:649
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_cfunc+0xf0) [0x7f6cb4f104c0] vm_insnhelper.c:1642
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_method_each_type+0x5e) [0x7f6cb4f1fede] vm_insnhelper.c:2026
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_method+0xe3) [0x7f6cb4f20453] vm_insnhelper.c:2176
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec_core+0x1219) [0x7f6cb4f197d9] insns.def:994
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec+0x86) [0x7f6cb4f1e436] vm.c:1650
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_load_internal0+0xb9) [0x7f6cb4dc3e69] load.c:619
/opt/gitlab/embedded/lib/libruby.so.2.3(rb_f_load+0x86) [0x7f6cb4dc4526] load.c:649
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_cfunc+0xf0) [0x7f6cb4f104c0] vm_insnhelper.c:1642
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_method_each_type+0x5e) [0x7f6cb4f1fede] vm_insnhelper.c:2026
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_call_method+0xe3) [0x7f6cb4f20453] vm_insnhelper.c:2176
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec_core+0x1219) [0x7f6cb4f197d9] insns.def:994
/opt/gitlab/embedded/lib/libruby.so.2.3(vm_exec+0x86) [0x7f6cb4f1e436] vm.c:1650
/opt/gitlab/embedded/lib/libruby.so.2.3(ruby_exec_internal+0xbd) [0x7f6cb4dbe23d] eval.c:245
/opt/gitlab/embedded/lib/libruby.so.2.3(ruby_exec_node+0x1d) [0x7f6cb4dc032d] eval.c:310
/opt/gitlab/embedded/lib/libruby.so.2.3(ruby_run_node+0x1e) [0x7f6cb4dc2cfe] eval.c:302
/opt/gitlab/embedded/bin/ruby(main+0x4b) [0x40086b] main.c:36