Shell oneliners (updated from time to time)

Watch unix socket communication (GitLab example)

strace -f -t -s 2014 -p $(ps -C gitlab-workhors --no-headers -o '%p') -e trace=read,write

Delete orphaned local Git branch

git fetch --prune &&
git branch -d $(git branch -v | sed -rne'/\[gone\]/s/^\*?\s+(\S+)\s.*$/\1/p')

Pagenated REST api in one go (GitLab API projects storage stats example)

TOKEN=Your-Personal-Token URL=https://your.gitlab.server n=1
while :
  do \
    x=$(curl -sH "PRIVATE-TOKEN: ${TOKEN}" "${URL}/api/v4/projects?statistics=true&per_page=100&page=$n")
    if [[ "$x" == "[]" ]]; then \
      unset TOKEN
      break
    fi
    echo $x | jq -c '.[] | {path: .path_with_namespace, stats: .statistics}'
    n=$((n+1))
  done

streamed version

TOKEN=Your-Personal-Token URL=https://your.gitlab.server n=1; while :; do x=$(curl -sH "PRIVATE-TOKEN: ${TOKEN}" "${URL}/api/v4/projects?statistics=true&per_page=100&page=$n"); if [[ "$x" == "[]" ]]; then unset TOKEN; break; fi; echo $x | jq -c '.[] | {path: .path_with_namespace, stats: .statistics}'; n=$((n+1)); done

to output in csv

Replace the line starting echo $x | with below

echo $x | jq -cr '.[] | [.path_with_namespace, .statistics.commit_count, .statistics.storage_size, .statistics.repository_size, .statistics.wiki_size, .statistics.lfs_objects_size, .statistics.job_artifacts_size, .statistics.snippets_size, .statistics.packages_size] | @csv'

Download Redmine project's issue PDFs in one go

curl -sH 'X-Redmine-API-Key:<Redmine API Key goes here>' https://redmine.example.com/projects/project_path/issues.csv?encoding=UTF-8 \
  | sed -rne's/^([0-9]*),.+$/\1/p' \
  | xargs -I {} -n 1 curl -sOJH 'X-Redmine-API-Key:<Redmine API Key goes here>' https://redmine.example.com/issues/{}.pdf

Count text file lines and chars in a git repository

find -type d -name .git -prune \
  -o -type f -exec sh -c "file -b {} | grep -Pq 'JSON|text'" \;
  -exec cat {} \; | wc

Search multiple archived logs and append file names each line of the output

ls *.log.1.gz | \
  xargs -n 1 -I {} sh -c '
    zcat -f {} | \
    sed -re"s/^/{}: /" \
  ' | \
  grep -iP '<search pattern>' | \
  less -I

View json log with jq formatted and with color

zcat whatever-json.log.1.gz | \
  grep -iP '<search pattern>' | \
  jq -C . | \
  less -RI