Skip to content
Snippets Groups Projects
Stan Hu (Admin)'s avatar
commented on issue #2951 "Out of memory on Geo testbed" at GitLab.com / infrastructure

yorickpeterse-staging's avatar
commented on issue #2922 "Database goals for October 11th, 2017" at GitLab.com / infrastructure

This is a test comment, please ignore.

Douwe Maan's avatar
closed issue #2725 "Scan repositories for temp git objects with no permissions" at GitLab.com / infrastructure
Ilya Frolov's avatar
commented on issue #2949 "Fix InfluxDB settings in admin settings" at GitLab.com / infrastructure

Thanks for fixing this! What's the difference in how we keep influxdb settings vs, say, recaptcha settings? I mean, if the latter were restored suc...

John Jarvis's avatar
commented on issue #2868 "Increase number of database connections and/or pool size for prod/sync.geo" at GitLab.com / infrastructure

@stanhu gitlab.rb is not on this testbed is not managed so feel free to make manual changes.

Stan Hu's avatar
commented on issue #2951 "Out of memory on Geo testbed" at GitLab.com / infrastructure

Even after lowering to 4 workers, I still see OOM errors that killed both Redis and PostgreSQL:...

Stan Hu's avatar
closed issue #2949 "Fix InfluxDB settings in admin settings" at GitLab.com / infrastructure
Stan Hu's avatar
commented on issue #2949 "Fix InfluxDB settings in admin settings" at GitLab.com / infrastructure

We have been missing data for the last few days. I found the right setting in https://performance.gitlab.net/datasources/edit/8 and added it.

Stan Hu's avatar
commented on issue #2868 "Increase number of database connections and/or pool size for prod/sync.geo" at GitLab.com / infrastructure

@jarv The connection pool is the Rails connection pool (https://devcenter.heroku.com/articles/concurrency-and-database-connections#connection-pool)...

Stan Hu's avatar
commented on issue #2725 "Scan repositories for temp git objects with no permissions" at GitLab.com / infrastructure

Then, in Rails, when we recognise a certain error signature (yet to be decided) AND we're not in a housekeeping operation, we automatically trigge...

Alex Hanselka's avatar
commented on issue #2796 "Wrong admin username in recent virtual machines forces resource recreation" at GitLab.com / infrastructure

@jarv in my testing it did not seem to matter. However, I'll test this and double check on the first one I rebuild just to be certain.

Nick Thomas's avatar
commented on issue #2951 "Out of memory on Geo testbed" at GitLab.com / infrastructure

Sure, I'd imagine we can live with 4-6 workers?...

Stan Hu's avatar
commented on issue #2951 "Out of memory on Geo testbed" at GitLab.com / infrastructure

We should probably change the number of unicorn workers to account for all the extra processes on the Geo secondary....

Stan Hu's avatar
opened issue #2951 "Out of memory on Geo testbed" at GitLab.com / infrastructure
Stan Hu's avatar
closed issue #2950 "Geo testbed downgraded to 10.0.1" at GitLab.com / infrastructure
Stan Hu's avatar
commented on issue #2950 "Geo testbed downgraded to 10.0.1" at GitLab.com / infrastructure

Wrong node, sorry.