Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: automate release #120

Merged
merged 50 commits into from
Feb 17, 2022
Merged
Show file tree
Hide file tree
Changes from 40 commits
Commits
Show all changes
50 commits
Select commit Hold shift + click to select a range
5c44888
wip
eunjae-lee Feb 2, 2022
1675bf8
use dotenv
eunjae-lee Feb 2, 2022
af8170e
push after pull
eunjae-lee Feb 2, 2022
e263c91
checking working directory
eunjae-lee Feb 2, 2022
59065d1
fix github info
eunjae-lee Feb 2, 2022
afe00ca
update pr description
eunjae-lee Feb 2, 2022
a46ddc6
setup github action
eunjae-lee Feb 2, 2022
a603301
update script in package.json
eunjae-lee Feb 2, 2022
fc0f186
change pr desc
eunjae-lee Feb 2, 2022
eea302e
get pull-request number from action
eunjae-lee Feb 2, 2022
8dbb6d4
use issue instead of pr
eunjae-lee Feb 3, 2022
e0c7bb7
check released tag
eunjae-lee Feb 3, 2022
741cf26
check released tag
eunjae-lee Feb 3, 2022
49c74c3
update gh action condition
eunjae-lee Feb 3, 2022
8652040
fix
eunjae-lee Feb 3, 2022
c74b2de
.
eunjae-lee Feb 3, 2022
60c3cc4
another fix
eunjae-lee Feb 3, 2022
3712cfc
.
eunjae-lee Feb 3, 2022
fd76229
fail when not approved
eunjae-lee Feb 3, 2022
b60b1ef
commit versions
eunjae-lee Feb 3, 2022
3b119d1
change config
eunjae-lee Feb 3, 2022
28d1198
update git config
eunjae-lee Feb 3, 2022
0b9931e
update git config
eunjae-lee Feb 3, 2022
1160d7b
update command
eunjae-lee Feb 3, 2022
703d47f
clean up
eunjae-lee Feb 3, 2022
cdd385c
chore: update versions
Feb 3, 2022
2d33b1a
prepend changelog
Feb 3, 2022
8bdb9ed
commit changelog
Feb 3, 2022
f09b622
Revert "chore: update versions"
Feb 3, 2022
acb8492
clean up
Feb 9, 2022
3aa36a8
Merge branch 'main' into main
eunjae-lee Feb 9, 2022
e167e52
Merge branch 'main' into main
eunjae-lee Feb 9, 2022
8b77ef1
Merge branch 'main' into main
eunjae-lee Feb 10, 2022
968719b
Merge branch 'main' into main
eunjae-lee Feb 10, 2022
f1f8f7c
Update scripts/release/process-release.js
eunjae-lee Feb 11, 2022
6a34b36
chore: clean up common
eunjae-lee Feb 11, 2022
3d25889
chore: throw instead of exit
eunjae-lee Feb 11, 2022
ed5a9f5
chore: return early when env var does not exist
eunjae-lee Feb 11, 2022
7971ac9
chore: clean up texts
eunjae-lee Feb 15, 2022
4b9acfd
Merge branch 'main' into main
eunjae-lee Feb 15, 2022
5ce225f
chore: convert to TS
eunjae-lee Feb 16, 2022
d097db7
Merge branch 'main' of github.com:eunjae-lee/api-clients-automation
eunjae-lee Feb 16, 2022
f6c367b
chore: import instead of read json
eunjae-lee Feb 16, 2022
ba9017d
chore: remove unused dotenv from the root level
eunjae-lee Feb 16, 2022
98f6706
Merge branch 'main' into main
eunjae-lee Feb 16, 2022
1d83f15
chore: rename config.json to release.config.json
eunjae-lee Feb 17, 2022
47a2307
chore: pin devDependencies
eunjae-lee Feb 17, 2022
b9e765d
chore: remove shebang
eunjae-lee Feb 17, 2022
5c1fdc6
chore: use trim instead of arbitrary number
eunjae-lee Feb 17, 2022
5bb53d9
Merge branch 'main' into main
eunjae-lee Feb 17, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 23 additions & 0 deletions .github/workflows/process-release.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
name: Process release
on:
issues:
types:
- closed
jobs:
build:
name: Release
runs-on: ubuntu-20.04
if: "startsWith(github.event.issue.title, 'chore: release')"
steps:
- uses: actions/checkout@v2
with:
fetch-depth: 0

- name: Setup
id: setup
uses: ./.github/actions/setup

- run: ./scripts/release/process-release.js
env:
EVENT_NUMBER: ${{ github.event.issue.number }}
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
8 changes: 8 additions & 0 deletions config.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
{
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we put it at the root of the repository we could maybe have a more descriptive name, wdyt?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we release this actual repo or just the one generated ?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We don't release it, it's just publicly available but we already have a few configs everywhere

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we put it at the root of the repository we could maybe have a more descriptive name, wdyt?

I actually wrapped it with the key "release" for the reason. What do you think? Should we have a separate "release.config.json"?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If you think of user use cases of this config, it's fine to keep it like that, otherwise yep it would make sense to have a release.config.json file only

"release": {
"releasedTag": "released",
"mainBranch": "main",
"owner": "algolia",
"repo": "api-clients-automation"
}
}
Empty file added doc/changelogs/java.md
Empty file.
Empty file added doc/changelogs/javascript.md
Empty file.
Empty file added doc/changelogs/php.md
Empty file.
7 changes: 6 additions & 1 deletion package.json
Original file line number Diff line number Diff line change
Expand Up @@ -27,14 +27,17 @@
"playground": "./scripts/multiplexer.sh ${2:-nonverbose} ./scripts/playground.sh ${0:-javascript} ${1:-search}",
"specs:fix": "eslint --ext=yml specs/ --fix",
"specs:lint": "eslint --ext=yml specs/$0",
"github-actions:lint": "eslint --ext=yml .github/"
"github-actions:lint": "eslint --ext=yml .github/",
"release": "./scripts/release/create-release-issue.js"
},
"devDependencies": {
"@octokit/rest": "18.12.0",
"@openapitools/openapi-generator-cli": "2.4.26",
"@redocly/openapi-cli": "1.0.0-beta.79",
"@typescript-eslint/eslint-plugin": "5.5.0",
"@typescript-eslint/parser": "5.5.0",
"babel-eslint": "10.1.0",
"dotenv": "14.3.2",
"eslint": "8.6.0",
"eslint-config-algolia": "20.0.0",
"eslint-config-prettier": "8.3.0",
Expand All @@ -45,10 +48,12 @@
"eslint-plugin-prettier": "4.0.0",
"eslint-plugin-unused-imports": "2.0.0",
"eslint-plugin-yml": "0.12.0",
"execa": "5.1.1",
"json": "11.0.0",
"mustache": "4.2.0",
"prettier": "2.5.1",
"prettier-plugin-java": "1.6.0",
"semver": "7.3.5",
"typescript": "4.5.4"
},
"engines": {
Expand Down
36 changes: 36 additions & 0 deletions scripts/release/common.js
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
/* eslint-disable @typescript-eslint/no-var-requires */
/* eslint-disable import/no-commonjs */
const execa = require('execa'); // https://github.com/sindresorhus/execa/tree/v5.1.1
const config = require('../../config.json');
const openapitools = require('../../openapitools.json');

function run(command, { errorMessage = undefined } = {}) {
let result;
try {
result = execa.commandSync(command);
} catch (err) {
if (errorMessage) {
throw new Error(`[ERROR] ${errorMessage}`);
} else {
throw err;
}
}
return result.stdout;
}

const LANGS = [
...new Set(
Object.keys(openapitools['generator-cli'].generators).map(
(key) => key.split('-')[0]
)
),
];

module.exports = {
RELEASED_TAG: config.release.releasedTag,
MAIN_BRANCH: config.release.mainBranch,
OWNER: config.release.owner,
REPO: config.release.repo,
LANGS,
run,
};
218 changes: 218 additions & 0 deletions scripts/release/create-release-issue.js
Original file line number Diff line number Diff line change
@@ -0,0 +1,218 @@
#!/usr/bin/env node
/* eslint-disable no-console */
/* eslint-disable import/no-commonjs */
/* eslint-disable @typescript-eslint/no-var-requires */
const fs = require('fs');

const { Octokit } = require('@octokit/rest');
const dotenv = require('dotenv');
const semver = require('semver');

const {
RELEASED_TAG,
MAIN_BRANCH,
OWNER,
REPO,
LANGS,
run,
} = require('./common');

dotenv.config();

const TEXT = require('./text');

function readVersions() {
const versions = {};

const generators = JSON.parse(
fs.readFileSync('openapitools.json').toString()
)['generator-cli'].generators;

Object.keys(generators).forEach((generator) => {
const lang = generator.split('-')[0];
if (!versions[lang]) {
versions[lang] = {
current: generators[generator].additionalProperties.packageVersion,
langName: lang,
next: undefined,
};
}
});
return versions;
}

if (!process.env.GITHUB_TOKEN) {
throw new Error('Environment variable `GITHUB_TOKEN` does not exist.');
}

if (run('git rev-parse --abbrev-ref HEAD') !== MAIN_BRANCH) {
throw new Error(
`You can run this script only from \`${MAIN_BRANCH}\` branch.`
);
}

if (run('git status --porcelain')) {
throw new Error(
'Working directory is not clean. Commit all the changes first.'
);
}

run(`git rev-parse --verify refs/tags/${RELEASED_TAG}`, {
errorMessage: '`released` tag is missing in this repository.',
});

// Reading versions from `openapitools.json`
const versions = readVersions();

console.log('Pulling from origin...');
run(`git pull origin ${MAIN_BRANCH}`);

console.log('Pushing to origin...');
run(`git push origin ${MAIN_BRANCH}`);

const commitsWithoutScope = [];
const commitsWithNonLanguageScope = [];
// Reading commits since last release
const latestCommits = run(`git log --oneline ${RELEASED_TAG}..${MAIN_BRANCH}`)
.split('\n')
.filter(Boolean)
.map((commit) => {
const hash = commit.slice(0, 7);
let message = commit.slice(8);
let type = message.slice(0, message.indexOf(':'));
const matchResult = type.match(/(.+)\((.+)\)/);
if (!matchResult) {
commitsWithoutScope.push(commit);
return undefined;
}
message = message.slice(message.indexOf(':') + 2);
type = matchResult[1];
const lang = matchResult[2];

if (!LANGS.includes(lang)) {
commitsWithNonLanguageScope.push(commit);
return undefined;
}

return {
hash,
type, // `fix` | `feat` | `chore` | ...
lang, // `javascript` | `php` | `java` | ...
message,
raw: commit,
};
})
.filter(Boolean);

console.log('[INFO] Skipping these commits due to lack of language scope:');
console.log(commitsWithoutScope.map((commit) => ` ${commit}`).join('\n'));

console.log('');
console.log('[INFO] Skipping these commits due to wrong scopes:');
console.log(
commitsWithNonLanguageScope.map((commit) => ` ${commit}`).join('\n')
);

LANGS.forEach((lang) => {
const commits = latestCommits.filter(
(lastestCommit) => lastestCommit.lang === lang
);
const currentVersion = versions[lang].current;

if (commits.length === 0) {
versions[lang].next = currentVersion;
versions[lang].noCommit = true;
return;
}

if (semver.prerelease(currentVersion)) {
// if version is like 0.1.2-beta.1, it increases to 0.1.2-beta.2, even if there's a breaking change.
versions[lang].next = semver.inc(currentVersion, 'prerelease');
return;
}

if (commits.some((commit) => commit.message.includes('BREAKING CHANGE'))) {
versions[lang].next = semver.inc(currentVersion, 'major');
return;
}

const commitTypes = new Set(commits.map(({ type }) => type));
if (commitTypes.has('feat')) {
versions[lang].next = semver.inc(currentVersion, 'minor');
return;
}

versions[lang].next = semver.inc(currentVersion, 'patch');
if (!commitTypes.has('fix')) {
versions[lang].skipRelease = true;
}
});

const versionChanges = LANGS.map((lang) => {
const { current, next, noCommit, skipRelease, langName } = versions[lang];

if (noCommit) {
return `- ~${langName}: v${current} (${TEXT.noCommit})~`;
}

if (!current) {
return `- ~${langName}: (${TEXT.currentVersionNotFound})~`;
}

const checked = skipRelease ? ' ' : 'x';
return [
`- [${checked}] ${langName}: v${current} -> v${next}`,
skipRelease && TEXT.descriptionForSkippedLang(langName),
]
.filter(Boolean)
.join('\n');
}).join('\n');

const changelogs = LANGS.filter(
(lang) => !versions[lang].noCommit && versions[lang].current
)
.flatMap((lang) => {
if (versions[lang].noCommit) {
return [];
}

return [
`### ${versions[lang].langName}`,
...latestCommits
.filter((commit) => commit.lang === lang)
.map((commit) => `- ${commit.raw}`),
];
})
.join('\n');

const body = [
TEXT.header,
TEXT.versionChangeHeader,
versionChanges,
TEXT.changelogHeader,
TEXT.changelogDescription,
changelogs,
TEXT.approvalHeader,
TEXT.approval,
].join('\n\n');

const octokit = new Octokit({
auth: `token ${process.env.GITHUB_TOKEN}`,
});

octokit.rest.issues
.create({
owner: OWNER,
repo: REPO,
title: `chore: release ${new Date().toISOString().split('T')[0]}`,
body,
})
.then((result) => {
const {
data: { number, html_url: url },
} = result;

console.log('');
console.log(`Release issue #${number} is ready for review.`);
console.log(` > ${url}`);
});
Loading