buffer: simplify code

This refactors some code for simplicity. It also removes a call indirection used in the buffers custom inspect function.

Checklist

• make -j4 test (UNIX), or vcbuild test (Windows) passes
• tests and/or benchmarks are included
• documentation is changed or added
• commit message follows commit guidelines