Yield current batch and total count when indexing

When indexing large repos, there's no indication of progress in the logs, there's only start and finish events, which could give an indication of a stuck progress. With this change we can show that there's something happening.

Isn't it expensive?

I don't think so.

I don't think so.

Ah, sure, it does not do anything with data. This just call inexpensive blocks on every iteration. OK

mentioned in commit 298a2486

Status changed to merged

Are you going to use it somewhere?

Yes, in bin/elastic_repo_indexer to have something like:

timings = Benchmark.measure do
  processed = 0
  repo.index_commits(params) do |batch, total_count|
    processed += batch.length
    LOGGER.info("Indexed #{processed}/#{total_count} commits")
  end
end

@vsizov Would you please release a new version with this change? Thanks :).

Please add a changelog item

Mentioned in issue gitlab-com/infrastructure#295 (closed)