Skip to content
This repository has been archived by the owner on Jun 21, 2023. It is now read-only.

Part1 Freec as default : Cnv consensus update #987

Closed
wants to merge 40 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
40 commits
Select commit Hold shift + click to select a range
9c5da41
add freec as default
kgaonkar6 Apr 2, 2021
4277301
re-run
kgaonkar6 Apr 6, 2021
949b26b
Delete --configfile
kgaonkar6 Apr 6, 2021
69909b6
Delete --restart-times
kgaonkar6 Apr 6, 2021
6b05123
Delete -s
kgaonkar6 Apr 6, 2021
47a13d9
Delete -j
kgaonkar6 Apr 6, 2021
8920cfb
re-run with freec update
kgaonkar6 Apr 6, 2021
c5476ac
re-run after mem fix
kgaonkar6 Apr 7, 2021
88f4a3b
updated with freec as deafult
kgaonkar6 Apr 7, 2021
75dbabc
chrom plot update with freec default
kgaonkar6 Apr 7, 2021
1fded09
chrom plot per histology
kgaonkar6 Apr 7, 2021
1781c68
copynumber neutral 3
kgaonkar6 Apr 19, 2021
c9fde8c
Merge branch 'cnv-consensus-update' of https://github.com/kgaonkar6/O…
kgaonkar6 Apr 19, 2021
e9e693e
Merge branch 'cnv-consensus-update' of https://github.com/kgaonkar6/O…
kgaonkar6 Apr 19, 2021
ecf0553
rerun without 02,03
kgaonkar6 Apr 19, 2021
6096f54
neutral as NA
Apr 21, 2021
f14edda
Merge branch 'cnv-consensus-update' into focal-cn-update
Apr 21, 2021
d41965e
neutral as NA focal calls
Apr 22, 2021
1d07c67
Merge branch 'master' into cnv-consensus-update
kgaonkar6 Apr 22, 2021
8a267b9
Merge branch 'focal-cn-update' into oncoprint
Apr 22, 2021
c20e905
update oncoprint with neutral NA
Apr 22, 2021
f2eb8e3
Merge branch 'oncoprint' into chrom_plot
Apr 22, 2021
8e81765
update neutral as NA
Apr 22, 2021
eb69de5
remove change log
kgaonkar6 Apr 22, 2021
1a8e0c8
Merge branch 'master' into cnv-consensus-update
Apr 23, 2021
364c37b
Merge branch 'master' into cnv-consensus-update
kgaonkar6 May 4, 2021
1ecf82b
Merge branch 'master' into cnv-consensus-update
kgaonkar6 May 5, 2021
86ebece
Merge pull request #4 from kgaonkar6/chrom_plot
kgaonkar6 May 7, 2021
d28c648
Merge pull request #3 from kgaonkar6/oncoprint
kgaonkar6 May 7, 2021
0f1d2a8
Merge pull request #2 from kgaonkar6/focal-cn-update
kgaonkar6 May 7, 2021
90db7f2
Merge branch 'master' into cnv-consensus-update
kgaonkar6 May 7, 2021
ecdb77d
Update README.md
kgaonkar6 May 11, 2021
ed0a92a
Update README.md
kgaonkar6 May 11, 2021
b0883f9
Update README.md
kgaonkar6 May 11, 2021
486b9a2
Merge branch 'master' into cnv-consensus-update
May 11, 2021
36d38cc
adding changes from #1009
kgaonkar6 May 11, 2021
8d2d498
adding changes from #1009
kgaonkar6 May 11, 2021
008e8ef
checkout master oncoprint-landscape
kgaonkar6 May 11, 2021
937d437
Merge branch 'master' into cnv-consensus-update
kgaonkar6 May 11, 2021
f3a2a39
adding color_palette
kgaonkar6 May 11, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion analyses/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ Note that _nearly all_ modules use the harmonized clinical data file (`pbta-hist
| [`collapse-rnaseq`](https://github.com/AlexsLemonade/OpenPBTA-analysis/tree/master/analyses/collapse-rnaseq) | `pbta-gene-expression-rsem-fpkm.polya.rds` <br> `pbta-gene-expression-rsem-fpkm.stranded.rds` <br> `gencode.v27.primary_assembly.annotation.gtf.gz` | Collapses RSEM FPKM matrices such that gene symbols are de-duplicated. | `results/pbta-gene-expression-rsem-fpkm-collapsed.polya.rds` (included in data download; too large for tracking via GitHub) <br> `results/pbta-gene-expression-rsem-fpkm-collapsed.stranded.rds` (included in data download; too large for tracking via GitHub)
| [`comparative-RNASeq-analysis`](https://github.com/AlexsLemonade/OpenPBTA-analysis/tree/master/analyses/comparative-RNASeq-analysis) | `pbta-gene-expression-rsem-tpm.polya.rds` <br> `pbta-gene-expression-rsem-tpm.stranded.rds` <br> `pbta-histologies.tsv` <br> `pbta-mend-qc-manifest.tsv` <br> `pbta-mend-qc-results.tar.gz` | *In progress*; will produce expression outlier profiles per [#229](https://github.com/AlexsLemonade/OpenPBTA-analysis/issues/229) | N/A |
| [`compare-gistic`](https://github.com/AlexsLemonade/OpenPBTA-analysis/tree/master/analyses/compare-gistic) | `analyses/run-gistic/results/pbta-cnv-consensus-gistic.zip` <br> `analyses/run-gistic/results/pbta-cnv-consensus-hgat-gistic.zip` <br> `analyses/run-gistic/results/pbta-cnv-consensus-lgat-gistic.zip` <br> `analyses/run-gistic/results/pbta-cnv-consensus-medulloblastoma-gistic.zip` | Comparison of the GISTIC results of the entire cohort with the GISTIC results of three individual histolgies, namely, LGAT, HGAT and medulloblastoma ([#547](https://github.com/AlexsLemonade/OpenPBTA-analysis/issues/547) | N/A
| [`copy_number_consensus_call`](https://github.com/AlexsLemonade/OpenPBTA-analysis/tree/master/analyses/copy_number_consensus_call) | `pbta-cnv-cnvkit.seg.gz` <br> `pbta-cnv-controlfreec.tsv.gz` <br> `pbta-sv-manta.tsv.gz` | Produces consensus copy number calls per [#128](https://github.com/AlexsLemonade/OpenPBTA-analysis/issues/128) and a set of excluded regions where CNV calls are not made | `results/cnv_consensus.tsv` <br> `results/pbta-cnv-consensus.seg.gz` (included in data download) <br> `ref/cnv_excluded_regions.bed` <br> `ref/cnv_callable.bed`
| [`copy_number_consensus_call`](https://github.com/AlexsLemonade/OpenPBTA-analysis/tree/master/analyses/copy_number_consensus_call) | `pbta-cnv-cnvkit.seg.gz` <br> `pbta-cnv-controlfreec.tsv.gz` <br> `pbta-sv-manta.tsv.gz` | Produces consensus copy number calls per [#128](https://github.com/AlexsLemonade/OpenPBTA-analysis/issues/128) and a set of excluded regions where CNV calls are not made as per [#1010](https://github.com/AlexsLemonade/OpenPBTA-analysis/issues/1010) | `results/cnv_consensus.tsv` <br> `results/pbta-cnv-consensus.seg.gz` (included in data download) <br> `ref/cnv_excluded_regions.bed` <br> `ref/cnv_callable.bed`
| [`create-subset-files`](https://github.com/AlexsLemonade/OpenPBTA-analysis/tree/master/analyses/create-subset-files) | All files | This module contains the code to create the subset files used in continuous integration | All subset files for continuous integration
| [`focal-cn-file-preparation`](https://github.com/AlexsLemonade/OpenPBTA-analysis/tree/master/analyses/focal-cn-file-preparation) | `pbta-cnv-cnvkit.seg.gz` <br> `pbta-cnv-controlfreec.tsv.gz` <br> `pbta-gene-expression-rsem-fpkm-collapsed.polya.rds` <br> `pbta-gene-expression-rsem-fpkm-collapsed.stranded.rds` <br> `analyses/copy_number_consensus_call/results/pbta-cnv-consensus.seg.gz` | Maps from copy number variant caller segments to gene identifiers; will be updated to take into account changes that affect entire cytobands, chromosome arms ([#186](https://github.com/AlexsLemonade/OpenPBTA-analysis/issues/186))| `results/cnvkit_annotated_cn_autosomes.tsv.gz` <br> `results/cnvkit_annotated_cn_x_and_y.tsv.gz` <br> `results/controlfreec_annotated_cn_autosomes.tsv.gz` <br> `results/controlfreec_annotated_cn_x_and_y.tsv.gz` <br> `results/consensus_seg_annotated_cn_autosomes.tsv.gz` (included in data download) <br> `results/consensus_seg_annotated_cn_x_and_y.tsv.gz` (included in data download)
| [`fusion_filtering`](https://github.com/AlexsLemonade/OpenPBTA-analysis/tree/master/analyses/fusion_filtering) | `pbta-fusion-arriba.tsv.gz` <br> `pbta-fusion-starfusion.tsv.gz` | Standardizes, filters, and prioritizes fusion calls | `results/pbta-fusion-putative-oncogenic.tsv`(included in data download) <br> `results/pbta-fusion-recurrent-fusion-byhistology.tsv` (included in data download) <br> `results/pbta-fusion-recurrent-fusion-bysample.tsv` (included in data download)
Expand Down
2,764 changes: 14 additions & 2,750 deletions analyses/cnv-chrom-plot/cn_status_heatmap.nb.html

Large diffs are not rendered by default.

491 changes: 361 additions & 130 deletions analyses/cnv-chrom-plot/gistic_plot.nb.html

Large diffs are not rendered by default.

Binary file modified analyses/cnv-chrom-plot/plots/ATRT_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified analyses/cnv-chrom-plot/plots/Adenoma_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added analyses/cnv-chrom-plot/plots/CNS RMS_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified analyses/cnv-chrom-plot/plots/CNS lymphoma_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added analyses/cnv-chrom-plot/plots/Cavernoma_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified analyses/cnv-chrom-plot/plots/Chordoma_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified analyses/cnv-chrom-plot/plots/Choroid plexus tumor_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified analyses/cnv-chrom-plot/plots/Craniopharyngioma_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified analyses/cnv-chrom-plot/plots/DNET_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified analyses/cnv-chrom-plot/plots/Dysplasia_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified analyses/cnv-chrom-plot/plots/ETMR_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added analyses/cnv-chrom-plot/plots/EWS_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified analyses/cnv-chrom-plot/plots/Embryonal Tumor_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified analyses/cnv-chrom-plot/plots/Ependymoma_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified analyses/cnv-chrom-plot/plots/Ganglioglioma_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified analyses/cnv-chrom-plot/plots/Germinoma_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified analyses/cnv-chrom-plot/plots/Glial-neuronal tumor NOS_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified analyses/cnv-chrom-plot/plots/HGAT_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified analyses/cnv-chrom-plot/plots/Hemangioblastoma_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added analyses/cnv-chrom-plot/plots/JXG_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified analyses/cnv-chrom-plot/plots/LGAT_plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified analyses/cnv-chrom-plot/plots/MPNST_plot.png
Binary file modified analyses/cnv-chrom-plot/plots/Medulloblastoma_plot.png
Binary file modified analyses/cnv-chrom-plot/plots/Meningioma_plot.png
Binary file added analyses/cnv-chrom-plot/plots/Metastases_plot.png
Binary file modified analyses/cnv-chrom-plot/plots/Neurofibroma_plot.png
Binary file modified analyses/cnv-chrom-plot/plots/Oligodendroglioma_plot.png
Binary file modified analyses/cnv-chrom-plot/plots/Other_plot.png
Binary file modified analyses/cnv-chrom-plot/plots/Pineoblastoma_plot.png
Binary file added analyses/cnv-chrom-plot/plots/SEGA_plot.png
Binary file added analyses/cnv-chrom-plot/plots/Sarcoma_plot.png
Binary file modified analyses/cnv-chrom-plot/plots/Schwannoma_plot.png
Binary file modified analyses/cnv-chrom-plot/plots/Teratoma_plot.png
Binary file modified analyses/cnv-chrom-plot/plots/cn_status_heatmap.png
Binary file modified analyses/cnv-chrom-plot/plots/gistic_plot.png
4 changes: 2 additions & 2 deletions analyses/copy_number_consensus_call/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -66,10 +66,10 @@ Since there are 3 callers, there were 3 comparisons: `manta-cnvkit`, `manta-free
14) The `results/cnv_consensus.tsv` is translated into a `results/pbta-cnv-consensus.seg` file in the same format as `pbta-cnv-cnvkit.seg.gz`, including all samples where at least two callers passed quality filtering.
When a consensus segment is derived from multiple source segments, we take the mean of the CNVkit `seg.mean` values from the source segments, weighted by segment length.
If no CNVkit variant was included, the value for this column is NA.
The `copy.num` column is the weighted median of CNVkit segment values where they exist, or Control-FREEC values in the absence of CNVkit data.
The `copy.num` column is the weighted median of Control-FREEC segment values where they exist, or CNVkit values in the absence of Control-FREEC data.
Because some software (notably GISTIC) requires all samples to have the same regions called, the copy number variants from `cnv_consensus.tsv` are supplementented with "neutral" segments where no call was made.
These include all non-variant regions present in `ref/cnv_callable.bed`
The neutral regions are assigned copy.num 2, except on chrX and chrY, where the copy number is left NA.
The neutral regions are assigned copy.num NA.

## Example Output File

Expand Down
Binary file not shown.
Empty file modified analyses/copy_number_consensus_call/run_consensus_call.sh
100644 → 100755
Empty file.
6 changes: 3 additions & 3 deletions analyses/copy_number_consensus_call/scripts/bed_to_segfile.R
Original file line number Diff line number Diff line change
Expand Up @@ -123,8 +123,8 @@ cnvs <- cnvs %>%
segmean = purrr::map_dbl(cnvkit_df, segmean_function),
cnvkit_cn = purrr::map_dbl(cnvkit_df, copies_wmedian),
freec_cn = purrr::map_dbl(freec_df, copies_wmedian),
copynum = ifelse(is.finite(cnvkit_cn), # use cnvkit if available
cnvkit_cn, freec_cn), #otherwise use freec
copynum = ifelse(is.finite(freec_cn), # use freec if available
freec_cn, cnvkit_cn), #otherwise use cnvkit
num.mark = NA)


Expand Down Expand Up @@ -155,7 +155,7 @@ out_neutral <- neutral %>%
loc.end = end) %>%
dplyr::mutate(num.mark = NA,
seg.mean = NA,
copy.num = 2)
copy.num = NA)
# unset X and Y copy numbers
out_neutral$copy.num[out_neutral$chrom %in% c("chrX", "chrY")] <- NA

Expand Down

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

157 changes: 84 additions & 73 deletions analyses/focal-cn-file-preparation/06-find-recurrent-calls.nb.html

Large diffs are not rendered by default.

Binary file not shown.
Binary file not shown.
Original file line number Diff line number Diff line change
@@ -1,23 +1,24 @@
gene
BANCR
C22orf39
CDC45
CLDN5
FAM122A
FXN
GNB1L
HIRA
LINC01506
MIR130B
MIR301B
PGM5
PIEZO2
PIP5K1B
PPIL2
PRKACG
TJP2
TMEM252
TMEM252-DT
UBE2L3
UFD1
YPEL1
PARP12
TBXAS1
TTC26
UBN2
ZC3HAV1
ADCK2
BRAF
CLEC2L
DENND2A
FMC1
FMC1-LUC7L2
HIPK2
KDM7A
KDM7A-DT
KIAA1549
KLRG2
LUC7L2
MKRN1
NDUFB2
NDUFB2-AS1
RAB19
SLC37A3
ZC3HAV1L
Binary file not shown.
Loading