Initial implementation of an elasticsearch indexer in Go (!1) · Merge requests · GitLab.org / gitlab-elasticsearch-indexer

An error occurred while fetching this tab.

Merged Nick Thomas requested to merge 1-initial-implementation into master 7 years ago

Apr 03, 2017
- Avoid conflicts between tests on the same ES cluster · 86bf5779
  Nick Thomas authored 7 years ago
  
  86bf5779
- Improve (non-integration) test coverage in elastic · 6057d2de
  Nick Thomas authored 7 years ago
  
  6057d2de
- elasticsearch: Test AWS signing · 39b434b0
  Nick Thomas authored 7 years ago
  
  39b434b0
Mar 31, 2017
- Add some more tests to git/repository_test.go · c7185297
  Nick Thomas authored 7 years ago
  
  c7185297
- fixup! SHA ranges are x..y - add tests and emulate this with go-git · a31aabc8
  Nick Thomas authored 7 years ago
  
  a31aabc8
- SHA ranges are x..y - add tests and emulate this with go-git · e0206373
  Nick Thomas authored 7 years ago
  
  e0206373
- Add full-length indexer tests · e0c6200b
  Nick Thomas authored 7 years ago
  
  e0c6200b
- Remove a now-inaccurate comment · 0e358db2
  Nick Thomas authored 7 years ago
  
  0e358db2
- Add indexer commit tests · 25900bf0
  Nick Thomas authored 7 years ago
  
  25900bf0
- Test blob indexing · abfc5ef0
  Nick Thomas authored 7 years ago
  
  abfc5ef0
- Fix a bug in langauge detection by filename · ba45ea9a
  Nick Thomas authored 7 years ago
  
  ba45ea9a
- Return BuildBlob() to function from method · 15732fa0
  Nick Thomas authored 7 years ago
  
  15732fa0
Mar 29, 2017
- Add an initial set of tests for git.Repository · d854d074
  Nick Thomas authored 7 years ago
  
  d854d074
- Fork icu to fix error handling · 3fb9011c
  Nick Thomas authored 7 years ago
  
  3fb9011c
- Add integration tests for charset conversions · 79e50fee
  Nick Thomas authored 7 years ago
  
  79e50fee
- Fix blob removal · 25e9cafe
  Nick Thomas authored 7 years ago
  
  25e9cafe
Mar 28, 2017
- Add an integration case for timezone preservation · 29a2bf4f
  Nick Thomas authored 7 years ago
  
  29a2bf4f
- Rename Repo to Repository · 977c0195
  Nick Thomas authored 7 years ago
  
  977c0195
- Introduce our own types into the git package · 258774eb
  Nick Thomas authored 7 years ago
  
  258774eb
- Fill out the first integration test · e7f1644c
  Nick Thomas authored 7 years ago
  
  e7f1644c
- Ignore submodules for now · 74586dda
  Nick Thomas authored 7 years ago
  
  74586dda
- update dependencies · 214889b7
  Nick Thomas authored 7 years ago
  
  214889b7
Mar 27, 2017
- Remove CGO_ENABLED:=0 from the Makefile · b9b3176b
  Nick Thomas authored 7 years ago
  
  b9b3176b
- Initial README · 4a23e6b7
  Nick Thomas authored 7 years ago
  
  4a23e6b7
- Fix elasticsearch index · bab3c56a
  Nick Thomas authored 7 years ago
  
  bab3c56a
- Add analysers to the Elasticsearch index · 6f149bec
  Nick Thomas authored 7 years ago
  
  6f149bec
Mar 24, 2017
- Merge branch '1-initial-icu' into '1-initial-implementation' · e9abdd57
  Nick Thomas authored 7 years ago
  
  Use icu4c for encoding to UTF-8 See merge request !3
  e9abdd57
- run `make` before `make test` so integration tests will run · 038f1a77
  Nick Thomas authored 7 years ago
  
  038f1a77
- Finish the gitlab-ci run by building the binary · c6ed3c57
  Nick Thomas authored 7 years ago
  
  c6ed3c57
- Add libicu-dev to the .gitlab-ci.yml · c50e3925
  Nick Thomas authored 7 years ago
  
  c50e3925
- Use icu4c for encoding to UTF-8 · 96c0fde1
  Nick Thomas authored 7 years ago
  
  96c0fde1
- Initial encode-to-UTF8 support · f04f4f3e
  Nick Thomas authored 7 years ago
  
  f04f4f3e
- Committers actually go in a correctly-spelled subdocument · 9a572119
  Nick Thomas authored 7 years ago
  
  9a572119
- Commits and blobs go in a subdocument · 5d4c8267
  Nick Thomas authored 7 years ago
  
  5d4c8267
Mar 23, 2017
- Initial support for language detection · e57f8fe3
  Nick Thomas authored 7 years ago
  
  e57f8fe3
Mar 22, 2017
- Implement the 1MiB text-only blob indexing limits · ec2d0762
  Nick Thomas authored 7 years ago
  
  This involves some refactoring to make the error handling clearer
  ec2d0762
- Tag errors coming out of WalkCommitHistory to aid debugging · 84370c64
  Nick Thomas authored 7 years ago
  
  84370c64
- Commits should not index their id · b4706f27
  Nick Thomas authored 7 years ago
  
  b4706f27
- Fix elasticsearch date format · 14cb59a5
  Nick Thomas authored 7 years ago
  
  14cb59a5
- Pass commit dates to elastisearch · d125b96c
  Nick Thomas authored 7 years ago
  
  d125b96c
- Increase the number of bulk workers from 2 to 10 · 69a85e50
  Nick Thomas authored 7 years ago
  
  69a85e50
- Skip too-large blobs · 3a2127a4
  Nick Thomas authored 7 years ago
  
  3a2127a4
- go-git has problems with concurrent use of git.Repo, so avoid it · 2f35c7f8
  Nick Thomas authored 7 years ago
  
  2f35c7f8
- First attempt at actually indexing blobs and commits · 5d02dc60
  Nick Thomas authored 7 years ago
  
  5d02dc60
- Add types and interfaces for blobs · 60ca8cb8
  Nick Thomas authored 7 years ago
  
  60ca8cb8
- Move indexer.Person to its own file · ae645523
  Nick Thomas authored 7 years ago
  
  ae645523
- Add types and interfaces for commits · 05c4a49b
  Nick Thomas authored 7 years ago
  
  05c4a49b
- Move CreateIndex() and DeleteIndex() out of the Indexer · f0a3b562
  Nick Thomas authored 7 years ago
  
  f0a3b562
- Remove support for Go < v1.7 · 6d9542bd
  Nick Thomas authored 7 years ago
  
  6d9542bd
- Numerous changes to get the first integration test ready · eecba7d6
  Nick Thomas authored 7 years ago
  
  eecba7d6
- Add the index name to the indexer · 64244977
  Nick Thomas authored 7 years ago
  
  64244977
- Indexer should refer blobs, not files · f27c5260
  Nick Thomas authored 7 years ago
  
  f27c5260
- Remove two unused structs · 88a7459f
  Nick Thomas authored 7 years ago
  
  88a7459f
- go fmt · 4d4ea305
  Nick Thomas authored 7 years ago
  
  4d4ea305
- Import Cloudflare Makefile · ff5856a7
  Nick Thomas authored 7 years ago
  
  ff5856a7
- Fix listing changed files · 415dc9ea
  Nick Thomas authored 7 years ago
  
  415dc9ea
- Vendor in the elasticsearch dependencies · 8fe01d9b
  Nick Thomas authored 7 years ago
  
  8fe01d9b
- Introduce an explicit indexer · 90393cc7
  Nick Thomas authored 7 years ago
  
  90393cc7
- Exit with a non-zero error code if communicating with elasticsearch fails · 4986d042
  Nick Thomas authored 7 years ago
  
  4986d042
- Makefile: add coverage · 25346fb7
  Nick Thomas authored 7 years ago
  
  25346fb7
- .gitlab-ci.yml: Put es-git-go into $GOPATH · 0c57274e
  Nick Thomas authored 7 years ago
  
  0c57274e
- Introduce an elasticsearch client · c41f8d09
  Nick Thomas authored 7 years ago
  
  c41f8d09
- Add .gitignore · 00e99e32
  Nick Thomas authored 7 years ago
  
  00e99e32
- Start CI configuration · 217bf97d
  Nick Thomas authored 7 years ago
  
  217bf97d
- Add a simple Makefile · cdbf89c7
  Nick Thomas authored 7 years ago
  
  cdbf89c7
- Reorganise code into two subpackages · 4b7a937a
  Nick Thomas authored 7 years ago
  
  4b7a937a
- Initial blob-reading and json-encoding stubs · 1b218c84
  Nick Thomas authored 8 years ago
  
  1b218c84
- Initial vendoring · ad4c9c9b
  Nick Thomas authored 8 years ago
  
  ad4c9c9b
- Starting point: list all changes and commits that need indexing · 6214ea34
  Nick Thomas authored 8 years ago
  
  6214ea34

Admin message

Admin message

Initial implementation of an elasticsearch indexer in Go

Merge request reports

Activity