极狐gitlab runner 使用 cache 实例
参考官方文档：
- Docker Machine Executor autoscale configuration | GitLab
- Caching in GitLab CI/CD | GitLab
- Speed up job execution | GitLabn
使用 cache 功能缓存项目依赖包，可以大大的减少极狐gitlab 中项目 ci 任务构建时间，本文以 兼容 s3 接口的 minio 为例。
1. 安装 minio
下载 minio server
wget https://dl.min.io/server/minio/release/linux-amd64/minio
chmod +x minio
mv minio /usr/local/bin/minio
minio -v
minio version RELEASE.2022-02-26T02-54-46Z
下载 minio client
wget https://dl.min.io/client/mc/release/linux-amd64/mc
chmod +x mc
mv mc /usr/local/bin/mc
mc -v
mc version RELEASE.2022-02-26T03-58-31Z
配置 minio 数据目录
mkdir -p /opt/minio/data
mkdir -p /opt/minio/logs
创建 start_minio_server.sh 启动脚本
#!/bin/bash
export MINIO_ROOT_USER=minio
export MINIO_ROOT_PASSWORD=minio123456
nohup minio server /opt/minio/data > /opt/minio/logs/minio.log 2>&1 &
启动 minio server
chmod +x start_minio_server.sh
./start_minio_server.sh
- 默认对外服务端口 9000
为客户端设置别名
mc alias set myminio http://10.10.10.60:9000 minio minio123456
配置存储桶
mc mb myminio/gitlab-cache
2. 配置 runner
config.toml 增加以下 cache 配置：
concurrent = 10
check_interval = 0
[session_server]
session_timeout = 1800
[[runners]]
name = "docker runner"
url = "https://gitlab.leffss.cn"
token = "xdfVPzdySQQNPCVgBxK1"
executor = "docker"
[runners.cache]
type = "s3"
Shared = true
[runners.cache.s3]
ServerAddress = "10.10.10.60:9000"
AccessKey = "minio"
SecretKey = "minio123456"
BucketName = "gitlab-cache"
Insecure = true
重启 runner 生效
3. 使用 cache
3.1 python
.gitlab-ci.yml 参考
image: python:3.9.7
stages:
- test
variables:
PIP_CACHE_DIR: "$CI_PROJECT_DIR/.cache/pip"
cache:
paths:
- .cache/pip/
# 已项目 id 区分 cache，如果不区分，就是全局 cache
key: $CI_PROJECT_ID
job1:
stage: test
script:
- pip install ansible==2.9.2
or
image: python:3.9.7
stages:
- test
cache:
paths:
- pip-cache
# 已项目 id 区分 cache，如果不区分，就是全局 cache
key: $CI_PROJECT_ID
before_script:
- export PIP_CACHE_DIR="pip-cache"
- mkdir -p pip-cache
job1:
stage: test
script:
- pip install ansible==2.9.2
3.2 nodejs
.gitlab-ci.yml 参考
variables:
NPM_CONFIG_CACHE: npm_cache
NPM_CONFIG_REGISTRY: https://registry.npm.taobao.org
default:
cache:
paths:
- ${NPM_CONFIG_CACHE}
build:
stage: build
image: node:14-alpine
script:
- node -v
- npm -v
- npm ci
- npm run build
artifacts:
name: "build-package"
paths:
- dist
expire_in: 1 day
3.3 java maven
.gitlab-ci.yml 参考
build:
image: maven:3.8.5-jdk-11
stage: build
variables:
MAVEN_CLI_OPTS: "-s .m2/settings.xml --batch-mode"
MAVEN_OPTS: "-Dmaven.repo.local=.m2/repository"
cache:
paths:
- .m2/repository/
- target/
key: $CI_PROJECT_ID
script:
- mvn package
- ls -l target/*