Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 1.0.0 #63

Merged
merged 117 commits into from
Oct 17, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
117 commits
Select commit Hold shift + click to select a range
8e4253c
initial commit
fbdtemme Jun 12, 2023
7a9b0c5
syncronize with pixelator 0.11.0 release
fbdtemme Jun 13, 2023
f9af04c
use nf-validation for samplesheet
fbdtemme Jun 13, 2023
2ee0d64
refactor and sync with pixelator dev
fbdtemme Jun 23, 2023
b510391
chore: remove report files
fbdtemme Jun 23, 2023
47f4559
chore: add CODEOWNERS file
fbdtemme Jun 23, 2023
578912e
style: reformat
fbdtemme Jun 23, 2023
01a54f2
feat: add params-file template
fbdtemme Jun 23, 2023
b8c37f6
style: fix formatting
fbdtemme Jun 23, 2023
7ffc1db
docs: update usage
fbdtemme Jun 23, 2023
3d7729c
feat: set test profile data to public s3 datasets
fbdtemme Jun 23, 2023
46d0c3b
docs: update README
fbdtemme Jun 23, 2023
1f64f56
fix: add missing label to metromap
fbdtemme Jun 23, 2023
d412f16
fix: update used container
fbdtemme Jun 23, 2023
d46ee97
feat: fix container override
fbdtemme Jun 26, 2023
dc60078
feat: bump container versions
fbdtemme Jun 26, 2023
4055280
support panel and panel_file
fbdtemme Jun 28, 2023
f006e55
fix: use pr-444 pixelator container
fbdtemme Jun 28, 2023
0447887
docs: fixed in output.md
fbdtemme Jun 28, 2023
1810835
docs: update output.md
fbdtemme Jun 29, 2023
81080a7
docs: fix pipeline overview bullet list order
fbdtemme Jun 29, 2023
4d9596e
Clarifications in README
johandahlberg Jun 29, 2023
5267363
docs: update output.md
fbdtemme Jun 29, 2023
07454a4
docs: remove todo
fbdtemme Jun 29, 2023
7077233
docs: more output.md tweaks
fbdtemme Jun 29, 2023
881d8b7
Update output docs
johandahlberg Jun 29, 2023
962c44b
Merge branch 'dev' into reading-the-output-docs
johandahlberg Jun 29, 2023
71d233c
docs: fix unmatched backticks
fbdtemme Jun 29, 2023
5c2924b
docs: remove reference to --panel-file input
fbdtemme Jun 29, 2023
05a8313
docs: add backticks
fbdtemme Jun 29, 2023
737633c
Merge pull request #53 from PixelgenTechnologies/reading-the-docs
fbdtemme Jun 29, 2023
bba317b
docs: fix missing space in CITATIONS.md
fbdtemme Jun 29, 2023
bfb2014
docs: fix missing space in CITATIONS.md
fbdtemme Jun 29, 2023
4f5aed8
feat: pin pixelator to dev branch
fbdtemme Jun 29, 2023
a6176b3
docs: update usage.md
fbdtemme Jun 29, 2023
aab1fd8
chore: fix pixelator to 0.12.0
fbdtemme Jun 30, 2023
ccaabed
chore: remove stray file
fbdtemme Jun 30, 2023
421c414
fix: remove cell calling parameters, fix defaults
fbdtemme Jun 30, 2023
2537ef8
fix: set slackreport.json author_name
fbdtemme Jun 30, 2023
7e00772
fix: remove stray file
fbdtemme Jun 30, 2023
fb2d434
fix: set homePage to https://nf-co.re/pixelator
fbdtemme Jun 30, 2023
f7f49c1
revert: remove CODEOWNERS
fbdtemme Jun 30, 2023
785a2c0
docs: fix markdown links
fbdtemme Jun 30, 2023
f982c0a
fix: update manifest.homePage
fbdtemme Jun 30, 2023
a1e4213
fix: add missing summary_params, fix indentation
fbdtemme Jun 30, 2023
a3d94af
Template update for nf-core/tools version 2.10.dev0
fbdtemme Jul 31, 2023
3d03356
Merge branch 'TEMPLATE' into dev
fbdtemme Jul 31, 2023
54d6b06
fix: resolve TEMPLATE sync issues
fbdtemme Jul 31, 2023
37e0ffa
feat: rename pixelator sc concatenate to amplicon
fbdtemme Jul 31, 2023
3c92b14
fix: remove png output channel
fbdtemme Jul 31, 2023
074a0e0
fix: resolve issue with relative path files and http samplesheet
fbdtemme Jul 31, 2023
f598fd9
feat: add sync hook for schema en nf-params.yml
fbdtemme Jul 31, 2023
696160f
fix: use nf-core as repo
fbdtemme Jul 31, 2023
6fe628f
docs: fix typo
fbdtemme Jul 31, 2023
3884f64
feat: update default containers
fbdtemme Jul 31, 2023
5349eb2
chore: add zenodo doi TODO
fbdtemme Jul 31, 2023
8e50ba4
style: remove empty lines
fbdtemme Jul 31, 2023
ea2b508
feat: improve channel handling for report
fbdtemme Jul 31, 2023
b9f3597
style: remove commented block
fbdtemme Jul 31, 2023
e296f63
fix: use proper code of conduct for 2.9
fbdtemme Jul 31, 2023
bfc4cf6
feat: use latest dev container
fbdtemme Aug 3, 2023
c4de1a6
fix: make singularity_pull_docker_container process scope option
fbdtemme Aug 3, 2023
56e507b
ci: authenticate with ghcr.io
fbdtemme Aug 3, 2023
e9cbb60
chore: remove create-params-template.py
fbdtemme Aug 9, 2023
bbdc3c6
fix: remove redundant params.input check
fbdtemme Aug 9, 2023
7611bac
fix: sync with renamed parameter in pixelator
fbdtemme Aug 9, 2023
502aeec
docs: fix duplicated part of pipeline summary
fbdtemme Aug 9, 2023
abdcbe7
fix: do not auto-format generated nf-params.yml
fbdtemme Aug 9, 2023
37a2aad
style: fix alignment
fbdtemme Aug 9, 2023
21f2d57
chore: remove node_modules gitignore entry
fbdtemme Aug 9, 2023
bd3aedc
style: fix formatting
fbdtemme Aug 9, 2023
b91a271
chore: add todo's for conda channel update
fbdtemme Aug 9, 2023
6f75bd6
fix: use specific commit instead of moving dev
fbdtemme Aug 9, 2023
2ca26ae
chore: remove unneeded todo
fbdtemme Aug 9, 2023
8bc5302
fix: remove outdir from test profile
fbdtemme Aug 10, 2023
5354b30
style: module reformatting
fbdtemme Aug 10, 2023
c645fd6
refactor: remove unused pbs arguments
fbdtemme Aug 10, 2023
91c5db8
refactor: replace null checks in modules.conf for integer options
fbdtemme Aug 10, 2023
f177cf7
refactor: split out pixelator dependency in CHECK_SAMPLESHEET
fbdtemme Aug 9, 2023
baeb639
fix: fix process name in COLLECT_METADATA versions.yml
fbdtemme Aug 10, 2023
a043d2b
refactor: improve panel/panel_file passing, rename collect metadata
fbdtemme Aug 10, 2023
1cc3116
refactor: rework samplesheet validation
fbdtemme Aug 16, 2023
b5443dc
feat: use pixelator 0.13.0 containers
fbdtemme Sep 13, 2023
2a16cce
feat: add `--input_basedir` to for relative samplesheet paths
fbdtemme Sep 18, 2023
407d909
chore: switch testdata to nf-core/test-datasets
fbdtemme Sep 18, 2023
a088fde
chore: update custom/dumpsoftwareversions
fbdtemme Sep 18, 2023
9a8554d
chore: update pixelator source to bioconda/biocontainers
fbdtemme Sep 18, 2023
2590a2e
fix: relative path resolving with remote paths without trailing slash
fbdtemme Sep 19, 2023
dcce5e4
fix: use nf-core/test-datasets for test.config
fbdtemme Sep 19, 2023
3f6097c
fix: use proper biocontainer tags
fbdtemme Sep 19, 2023
4175875
chore: remove some TODO's, add CI status badges, update pixelgen.com …
fbdtemme Sep 19, 2023
c3f5c31
chore: remove TODOs
fbdtemme Sep 19, 2023
36b1c9e
chore: add mimetype to input
fbdtemme Sep 19, 2023
772489d
chore: remove unused multiqc config file
fbdtemme Sep 19, 2023
979b3e5
Merge pull request #61 from nf-core/fix/relative-path-resolving
fbdtemme Sep 19, 2023
35b7f9f
fix: add pixelator report log output
fbdtemme Oct 3, 2023
131d1c3
fix: add missing params scope
fbdtemme Oct 3, 2023
e91c27f
Template update for nf-core/tools version 2.10
nf-core-bot Sep 25, 2023
b0daa69
chore: sync code of conduct with template
fbdtemme Oct 3, 2023
a9dc80f
feat: update to pixelator 0.14.0
fbdtemme Oct 9, 2023
626f936
feat: support remote dump_parameters path
fbdtemme Oct 9, 2023
b078dff
fix: allow mail without multiqc report
fbdtemme Oct 11, 2023
6515891
add reports to tower.yml
fbdtemme Oct 12, 2023
8a2320d
fix remote outdir in NfCoreTemplate.groovy
fbdtemme Oct 16, 2023
04f286f
update metromap
fbdtemme Oct 16, 2023
29ed89e
documentation tweaks
fbdtemme Oct 16, 2023
2b66553
update pixelator version to 0.15.0
fbdtemme Oct 17, 2023
2b20b04
update example samplesheet
fbdtemme Oct 17, 2023
c80fa77
usage doc tweaks
fbdtemme Oct 17, 2023
c46c2c2
use published nf-core instead of dev version
fbdtemme Oct 17, 2023
f86eb83
remove old TODOs
fbdtemme Oct 17, 2023
8d1c23a
bump version, add changelog
fbdtemme Oct 17, 2023
a985aa1
Update nextflow.config
maxulysse Oct 17, 2023
073a9b9
remove unneeded docker login action for ghcr.io
fbdtemme Oct 17, 2023
08d5be6
fix typo in container directive breaking singularity pulls
fbdtemme Oct 17, 2023
6bf0935
add native singularity image for pixelator
fbdtemme Oct 17, 2023
3e66dda
enable writable tmpfs for singularity/apptainer
fbdtemme Oct 17, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .devcontainer/devcontainer.json
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@
"name": "nfcore",
"image": "nfcore/gitpod:latest",
"remoteUser": "gitpod",
"runArgs": ["--privileged"],

// Configure tool-specific properties.
"customizations": {
Expand Down
5 changes: 3 additions & 2 deletions .github/CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,9 @@ Please use the pre-filled template to save time.
However, don't be put off by this template - other more general issues and suggestions are welcome!
Contributions to the code are even more welcome ;)

> If you need help using or modifying nf-core/pixelator then the best place to ask is on the nf-core Slack [#pixelator](https://nfcore.slack.com/channels/pixelator) channel ([join our Slack here](https://nf-co.re/join/slack)).
:::info
If you need help using or modifying nf-core/pixelator then the best place to ask is on the nf-core Slack [#pixelator](https://nfcore.slack.com/channels/pixelator) channel ([join our Slack here](https://nf-co.re/join/slack)).
:::

## Contribution workflow

Expand Down Expand Up @@ -116,4 +118,3 @@ To get started:
Devcontainer specs:

- [DevContainer config](.devcontainer/devcontainer.json)
- [Dockerfile](.devcontainer/Dockerfile)
2 changes: 1 addition & 1 deletion .github/ISSUE_TEMPLATE/bug_report.yml
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ body:
attributes:
label: System information
description: |
* Nextflow version _(eg. 22.10.1)_
* Nextflow version _(eg. 23.04.0)_
* Hardware _(eg. HPC, Desktop, Cloud)_
* Executor _(eg. slurm, local, awsbatch)_
* Container engine: _(e.g. Docker, Singularity, Conda, Podman, Shifter, Charliecloud, or Apptainer)_
Expand Down
14 changes: 8 additions & 6 deletions .github/workflows/awsfulltest.yml
Original file line number Diff line number Diff line change
Expand Up @@ -14,21 +14,23 @@ jobs:
runs-on: ubuntu-latest
steps:
- name: Launch workflow via tower
uses: seqeralabs/action-tower-launch@v1
# TODO nf-core: You can customise AWS full pipeline tests as required
# Add full size test data (but still relatively small datasets for few samples)
# on the `test_full.config` test runs with only one set of parameters
uses: seqeralabs/action-tower-launch@v2
with:
workspace_id: ${{ secrets.TOWER_WORKSPACE_ID }}
access_token: ${{ secrets.TOWER_ACCESS_TOKEN }}
compute_env: ${{ secrets.TOWER_COMPUTE_ENV }}
revision: ${{ github.sha }}
workdir: s3://${{ secrets.AWS_S3_BUCKET }}/work/pixelator/work-${{ github.sha }}
parameters: |
{
"hook_url": "${{ secrets.MEGATESTS_ALERTS_SLACK_HOOK_URL }}",
"outdir": "s3://${{ secrets.AWS_S3_BUCKET }}/pixelator/results-${{ github.sha }}"
}
profiles: test_full,aws_tower
profiles: test_full

- uses: actions/upload-artifact@v3
with:
name: Tower debug log file
path: tower_action_*.log
path: |
tower_action_*.log
tower_action_*.json
10 changes: 7 additions & 3 deletions .github/workflows/awstest.yml
Original file line number Diff line number Diff line change
Expand Up @@ -12,18 +12,22 @@ jobs:
steps:
# Launch workflow using Tower CLI tool action
- name: Launch workflow via tower
uses: seqeralabs/action-tower-launch@v1
uses: seqeralabs/action-tower-launch@v2
with:
workspace_id: ${{ secrets.TOWER_WORKSPACE_ID }}
access_token: ${{ secrets.TOWER_ACCESS_TOKEN }}
compute_env: ${{ secrets.TOWER_COMPUTE_ENV }}
revision: ${{ github.sha }}
workdir: s3://${{ secrets.AWS_S3_BUCKET }}/work/pixelator/work-${{ github.sha }}
parameters: |
{
"outdir": "s3://${{ secrets.AWS_S3_BUCKET }}/pixelator/results-test-${{ github.sha }}"
}
profiles: test,aws_tower
profiles: test

- uses: actions/upload-artifact@v3
with:
name: Tower debug log file
path: tower_action_*.log
path: |
tower_action_*.log
tower_action_*.json
5 changes: 1 addition & 4 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ jobs:
strategy:
matrix:
NXF_VER:
- "22.10.1"
- "23.04.0"
- "latest-everything"
steps:
- name: Check out pipeline code
Expand All @@ -36,8 +36,5 @@ jobs:
version: "${{ matrix.NXF_VER }}"

- name: Run pipeline with test data
# TODO nf-core: You can customise CI pipeline run tests as required
# For example: adding multiple test runs with different parameters
# Remember that you can parallelise this by using strategy.matrix
run: |
nextflow run ${GITHUB_WORKSPACE} -profile test,docker --outdir ./results
2 changes: 1 addition & 1 deletion .github/workflows/linting.yml
Original file line number Diff line number Diff line change
Expand Up @@ -78,7 +78,7 @@ jobs:

- uses: actions/setup-python@v4
with:
python-version: "3.8"
python-version: "3.11"
architecture: "x64"

- name: Install dependencies
Expand Down
68 changes: 68 additions & 0 deletions .github/workflows/release-announcments.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,68 @@
name: release-announcements
# Automatic release toot and tweet anouncements
on:
release:
types: [published]
workflow_dispatch:

jobs:
toot:
runs-on: ubuntu-latest
steps:
- uses: rzr/fediverse-action@master
with:
access-token: ${{ secrets.MASTODON_ACCESS_TOKEN }}
host: "mstdn.science" # custom host if not "mastodon.social" (default)
# GitHub event payload
# https://docs.github.com/en/developers/webhooks-and-events/webhooks/webhook-events-and-payloads#release
message: |
Pipeline release! ${{ github.repository }} v${{ github.event.release.tag_name }} - ${{ github.event.release.name }}!

Please see the changelog: ${{ github.event.release.html_url }}

send-tweet:
runs-on: ubuntu-latest

steps:
- uses: actions/setup-python@v4
with:
python-version: "3.10"
- name: Install dependencies
run: pip install tweepy==4.14.0
- name: Send tweet
shell: python
run: |
import os
import tweepy

client = tweepy.Client(
access_token=os.getenv("TWITTER_ACCESS_TOKEN"),
access_token_secret=os.getenv("TWITTER_ACCESS_TOKEN_SECRET"),
consumer_key=os.getenv("TWITTER_CONSUMER_KEY"),
consumer_secret=os.getenv("TWITTER_CONSUMER_SECRET"),
)
tweet = os.getenv("TWEET")
client.create_tweet(text=tweet)
env:
TWEET: |
Pipeline release! ${{ github.repository }} v${{ github.event.release.tag_name }} - ${{ github.event.release.name }}!

Please see the changelog: ${{ github.event.release.html_url }}
TWITTER_CONSUMER_KEY: ${{ secrets.TWITTER_CONSUMER_KEY }}
TWITTER_CONSUMER_SECRET: ${{ secrets.TWITTER_CONSUMER_SECRET }}
TWITTER_ACCESS_TOKEN: ${{ secrets.TWITTER_ACCESS_TOKEN }}
TWITTER_ACCESS_TOKEN_SECRET: ${{ secrets.TWITTER_ACCESS_TOKEN_SECRET }}

bsky-post:
runs-on: ubuntu-latest
steps:
- uses: zentered/bluesky-post-action@v0.0.2
with:
post: |
Pipeline release! ${{ github.repository }} v${{ github.event.release.tag_name }} - ${{ github.event.release.name }}!

Please see the changelog: ${{ github.event.release.html_url }}
env:
BSKY_IDENTIFIER: ${{ secrets.BSKY_IDENTIFIER }}
BSKY_PASSWORD: ${{ secrets.BSKY_PASSWORD }}
#
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -6,3 +6,5 @@ results/
testing/
testing*
*.pyc
.idea
.vscode
5 changes: 5 additions & 0 deletions .gitpod.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,9 @@
image: nfcore/gitpod:latest
tasks:
- name: Update Nextflow and setup pre-commit
command: |
pre-commit install --install-hooks
nextflow self-update

vscode:
extensions: # based on nf-core.nf-core-extensionpack
Expand Down
8 changes: 8 additions & 0 deletions .nf-core.yml
Original file line number Diff line number Diff line change
@@ -1 +1,9 @@
repository_type: pipeline
lint:
# No multiqc support for now
multiqc_config: false
files_exist:
- assets/multiqc_config.yml
- conf/igenomes.config
files_unchanged:
- lib/NfcoreTemplate.groovy
19 changes: 18 additions & 1 deletion .pre-commit-config.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,22 @@
repos:
- repo: https://github.com/pre-commit/mirrors-prettier
rev: "v2.7.1"
rev: "v3.0.0-alpha.9-for-vscode"
hooks:
- id: prettier

- repo: https://github.com/psf/black
rev: 23.3.0
hooks:
- id: black

- repo: local
hooks:
- id: nf-core/tools parameters.yaml
name: Update nf-params.yml file with schema
language: python
additional_dependencies:
- nf-core
entry: nf-core
args: [create-params-file, --output, assets/nf-params.yml, "--force", "."]
pass_filenames: false
files: ^nextflow_schema.json$
1 change: 1 addition & 0 deletions .prettierignore
Original file line number Diff line number Diff line change
Expand Up @@ -10,3 +10,4 @@ testing/
testing*
*.pyc
bin/
assets/nf-params.yml
12 changes: 2 additions & 10 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,14 +3,6 @@
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/)
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).

## v1.0.0dev - [date]
## 1.0.0 - [2023-10-17]

Initial release of nf-core/pixelator, created with the [nf-core](https://nf-co.re/) template.

### `Added`

### `Fixed`

### `Dependencies`

### `Deprecated`
Initial release of nf-core/pixelator.
16 changes: 13 additions & 3 deletions CITATIONS.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,10 +10,17 @@

## Pipeline tools

- [FastQC](https://www.bioinformatics.babraham.ac.uk/projects/fastqc/)
- [pixelator](https://doi.org/10.1101/2023.06.05.543770)

- [MultiQC](https://pubmed.ncbi.nlm.nih.gov/27312411/)
> Ewels P, Magnusson M, Lundin S, Käller M. MultiQC: summarize analysis results for multiple tools and samples in a single report. Bioinformatics. 2016 Oct 1;32(19):3047-8. doi: 10.1093/bioinformatics/btw354. Epub 2016 Jun 16. PubMed PMID: 27312411; PubMed Central PMCID: PMC5039924.
> Karlsson, Filip, Tomasz Kallas, Divya Thiagarajan, Max Karlsson, Maud Schweitzer, Jose Fernandez Navarro, Louise Leijonancker, et al. “Molecular Pixelation: Single Cell Spatial Proteomics by Sequencing.” bioRxiv, June 8, 2023. https://doi.org/10.1101/2023.06.05.543770.

- [cutadapt](http://dx.doi.org/10.14806/ej.17.1.200)

> Martin, Marcel. “Cutadapt Removes Adapter Sequences from High-Throughput Sequencing Reads.” EMBnet.Journal 17, no. 1 (May 2, 2011): 10–12. https://doi.org/10.14806/ej.17.1.200.

- [fastp](https://doi.org/10.1002/imt2.107)

> Chen, Shifu. “Ultrafast One-Pass FASTQ Data Preprocessing, Quality Control, and Deduplication Using Fastp.” IMeta 2, no. 2 (2023): e107. https://doi.org/10.1002/imt2.107.

## Software packaging/containerisation tools

Expand All @@ -31,5 +38,8 @@

- [Docker](https://dl.acm.org/doi/10.5555/2600239.2600241)

> Merkel, D. (2014). Docker: lightweight linux containers for consistent development and deployment. Linux Journal, 2014(239), 2. doi: 10.5555/2600239.2600241.

- [Singularity](https://pubmed.ncbi.nlm.nih.gov/28494014/)

> Kurtzer GM, Sochat V, Bauer MW. Singularity: Scientific containers for mobility of compute. PLoS One. 2017 May 11;12(5):e0177459. doi: 10.1371/journal.pone.0177459. eCollection 2017. PubMed PMID: 28494014; PubMed Central PMCID: PMC5426675.
Loading