Use pager only when necessary

Set your git pager config to

git config --global core.pager 'less -XFR'

to get less to not paginate if the command output has less lines than the height of your terminal.