NewNoteWorker failing repeatedly with "ArgumentError: wrong number of arguments"
This might be causing https://gitlab.com/gitlab-com/support-forum/issues/851:
2016-07-19_19:44:56.64155 worker8 sidekiq: 2016-07-19T19:44:56.641Z 7282 TID-owihfkqu8 NewNoteWorker JID-5b1bf3945b88f113184022e8 INFO: fail: 3.2 sec
2016-07-19_19:44:56.64170 worker8 sidekiq: 2016-07-19T19:44:56.641Z 7282 TID-owihfkqu8 WARN: {"class":"NewNoteWorker","args":[13108136,{"note":"<REDACTED NOTE>.","noteable_id":"","noteable_type":"Commit","line_code":"78a57be9a71533e1c5df5625737fa2044d65562a_5_5","commit_id":"5cc8c65ad4ce1e65c86dd3535127e510d11ac4b9","type":"DiffNote","position":"{\"old_path\":\"engines/base/index-pagesv1.php\",\"new_path\":\"engines/base/index-pagesv1.php\",\"old_line\":null,\"new_line\":5,\"base_sha\":\"4ead8b3a77f8ee06440a75fa08da826e5a0773b2\",\"start_sha\":\"4ead8b3a77f8ee06440a75fa08da826e5a0773b2\",\"head_sha\":\"5cc8c65ad4ce1e65c86dd3535127e510d11ac4b9\"}"}],"retry":true,"queue":"default","jid":"5b1bf3945b88f113184022e8","created_at":1468627490.7491553,"enqueued_at":1468957490.851524,"error_message":"wrong number of arguments (1 for 0)","error_class":"ArgumentError","failed_at":1468627497.6500316,"retry_count":18,"retried_at":1468957496.6404185}
2016-07-19_19:44:56.64179 worker8 sidekiq: 2016-07-19T19:44:56.641Z 7282 TID-owihfkqu8 WARN: ArgumentError: wrong number of arguments (1 for 0)
2016-07-19_19:44:56.64185 worker8 sidekiq: 2016-07-19T19:44:56.641Z 7282 TID-owihfkqu8 WARN: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/instrumentation.rb:150:in `to_json'
2016-07-19_19:44:56.64190 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/json-1.8.3/lib/json/common.rb:223:in `generate'
2016-07-19_19:44:56.64196 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/json-1.8.3/lib/json/common.rb:223:in `generate'
2016-07-19_19:44:56.64200 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq.rb:180:in `dump_json'
2016-07-19_19:44:56.64205 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/client.rb:196:in `block in atomic_push'
2016-07-19_19:44:56.64209 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/client.rb:194:in `map'
2016-07-19_19:44:56.64213 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/client.rb:194:in `atomic_push'
2016-07-19_19:44:56.64217 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/client.rb:179:in `block (2 levels) in raw_push'
2016-07-19_19:44:56.64222 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-namespace-1.5.2/lib/redis/namespace.rb:417:in `block in namespaced_block'
2016-07-19_19:44:56.64227 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.2.2/lib/redis.rb:2244:in `block in multi'
2016-07-19_19:44:56.64231 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.2.2/lib/redis.rb:57:in `block in synchronize'
2016-07-19_19:44:56.64235 worker8 sidekiq: /opt/gitlab/embedded/lib/ruby/2.1.0/monitor.rb:211:in `mon_synchronize'
2016-07-19_19:44:56.64240 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.2.2/lib/redis.rb:57:in `synchronize'
2016-07-19_19:44:56.64244 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.2.2/lib/redis.rb:2237:in `multi'
2016-07-19_19:44:56.64249 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-namespace-1.5.2/lib/redis/namespace.rb:414:in `namespaced_block'
2016-07-19_19:44:56.64253 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-namespace-1.5.2/lib/redis/namespace.rb:259:in `multi'
2016-07-19_19:44:56.64257 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/client.rb:178:in `block in raw_push'
2016-07-19_19:44:56.64262 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/connection_pool-2.2.0/lib/connection_pool.rb:64:in `block (2 levels) in with'
2016-07-19_19:44:56.64267 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/connection_pool-2.2.0/lib/connection_pool.rb:63:in `handle_interrupt'
2016-07-19_19:44:56.64271 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/connection_pool-2.2.0/lib/connection_pool.rb:63:in `block in with'
2016-07-19_19:44:56.64275 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/connection_pool-2.2.0/lib/connection_pool.rb:60:in `handle_interrupt'
2016-07-19_19:44:56.64281 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/connection_pool-2.2.0/lib/connection_pool.rb:60:in `with'
2016-07-19_19:44:56.64285 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/client.rb:177:in `raw_push'
2016-07-19_19:44:56.64291 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/client.rb:68:in `push'
2016-07-19_19:44:56.64295 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/worker.rb:116:in `client_push'
2016-07-19_19:44:56.64299 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/client.rb:142:in `enqueue'
2016-07-19_19:44:56.64303 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/app/models/service.rb:159:in `async_execute'
2016-07-19_19:44:56.64307 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/app/models/project.rb:877:in `block in execute_services'
2016-07-19_19:44:56.64311 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activerecord-4.2.7/lib/active_record/relation/delegation.rb:46:in `each'
2016-07-19_19:44:56.64317 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activerecord-4.2.7/lib/active_record/relation/delegation.rb:46:in `each'
2016-07-19_19:44:56.64321 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/app/models/project.rb:876:in `execute_services'
2016-07-19_19:44:56.64325 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/app/services/notes/post_process_service.rb:25:in `execute_note_hooks'
2016-07-19_19:44:56.64329 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/instrumentation.rb:152:in `block in execute_note_hooks'
2016-07-19_19:44:56.64333 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/method_call.rb:23:in `measure'
2016-07-19_19:44:56.64337 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/transaction.rb:71:in `measure_method'
2016-07-19_19:44:56.64342 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/instrumentation.rb:152:in `execute_note_hooks'
2016-07-19_19:44:56.64346 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/app/services/notes/post_process_service.rb:14:in `execute'
2016-07-19_19:44:56.64351 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/instrumentation.rb:152:in `block in execute'
2016-07-19_19:44:56.64249 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-namespace-1.5.2/lib/redis/namespace.rb:414:in `namespaced_block'
2016-07-19_19:44:56.64253 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-namespace-1.5.2/lib/redis/namespace.rb:259:in `multi'
2016-07-19_19:44:56.64257 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/client.rb:178:in `block in raw_push'
2016-07-19_19:44:56.64262 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/connection_pool-2.2.0/lib/connection_pool.rb:64:in `block (2 levels) in with'
2016-07-19_19:44:56.64267 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/connection_pool-2.2.0/lib/connection_pool.rb:63:in `handle_interrupt'
2016-07-19_19:44:56.64271 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/connection_pool-2.2.0/lib/connection_pool.rb:63:in `block in with'
2016-07-19_19:44:56.64275 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/connection_pool-2.2.0/lib/connection_pool.rb:60:in `handle_interrupt'
2016-07-19_19:44:56.64281 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/connection_pool-2.2.0/lib/connection_pool.rb:60:in `with'
2016-07-19_19:44:56.64285 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/client.rb:177:in `raw_push'
2016-07-19_19:44:56.64291 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/client.rb:68:in `push'
2016-07-19_19:44:56.64295 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/worker.rb:116:in `client_push'
2016-07-19_19:44:56.64299 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/client.rb:142:in `enqueue'
2016-07-19_19:44:56.64303 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/app/models/service.rb:159:in `async_execute'
2016-07-19_19:44:56.64307 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/app/models/project.rb:877:in `block in execute_services'
2016-07-19_19:44:56.64311 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activerecord-4.2.7/lib/active_record/relation/delegation.rb:46:in `each'
2016-07-19_19:44:56.64317 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activerecord-4.2.7/lib/active_record/relation/delegation.rb:46:in `each'
2016-07-19_19:44:56.64321 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/app/models/project.rb:876:in `execute_services'
2016-07-19_19:44:56.64325 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/app/services/notes/post_process_service.rb:25:in `execute_note_hooks'
2016-07-19_19:44:56.64329 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/instrumentation.rb:152:in `block in execute_note_hooks'
2016-07-19_19:44:56.64333 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/method_call.rb:23:in `measure'
2016-07-19_19:44:56.64337 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/transaction.rb:71:in `measure_method'
2016-07-19_19:44:56.64342 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/instrumentation.rb:152:in `execute_note_hooks'
2016-07-19_19:44:56.64346 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/app/services/notes/post_process_service.rb:14:in `execute'
2016-07-19_19:44:56.64351 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/instrumentation.rb:152:in `block in execute'
2016-07-19_19:44:56.64355 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/method_call.rb:23:in `measure'
2016-07-19_19:44:56.64360 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/transaction.rb:71:in `measure_method'
2016-07-19_19:44:56.64364 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/instrumentation.rb:152:in `execute'
2016-07-19_19:44:56.64368 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/app/workers/new_note_worker.rb:10:in `perform'
2016-07-19_19:44:56.64373 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/processor.rb:152:in `execute_job'
2016-07-19_19:44:56.64378 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/processor.rb:134:in `block (2 levels) in process'
2016-07-19_19:44:56.64383 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/middleware/chain.rb:128:in `block in invoke'
2016-07-19_19:44:56.64387 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/sidekiq_middleware/memory_killer.rb:17:in `call'
2016-07-19_19:44:56.64392 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/middleware/chain.rb:130:in `block in invoke'
2016-07-19_19:44:56.64397 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/sidekiq_middleware/arguments_logger.rb:6:in `call'
2016-07-19_19:44:56.64401 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/middleware/chain.rb:130:in `block in invoke'
2016-07-19_19:44:56.64406 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/sidekiq_middleware.rb:13:in `block in call'
2016-07-19_19:44:56.64410 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/transaction.rb:46:in `run'
2016-07-19_19:44:56.64415 worker8 sidekiq: /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/sidekiq_middleware.rb:13:in `call'
2016-07-19_19:44:56.64419 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/middleware/chain.rb:130:in `block in invoke'
2016-07-19_19:44:56.64423 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/middleware/server/active_record.rb:6:in `call'
2016-07-19_19:44:56.64427 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/middleware/chain.rb:130:in `block in invoke'
2016-07-19_19:44:56.64433 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/middleware/server/retry_jobs.rb:74:in `call'
2016-07-19_19:44:56.64438 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/middleware/chain.rb:130:in `block in invoke'
2016-07-19_19:44:56.64444 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/middleware/server/logging.rb:11:in `block in call'
2016-07-19_19:44:56.64449 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/logging.rb:32:in `with_context'
2016-07-19_19:44:56.64453 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/middleware/server/logging.rb:7:in `call'
2016-07-19_19:44:56.64458 worker8 sidekiq: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-4.1.4/lib/sidekiq/middleware/chain.rb:130:in `block in invoke'