Hello guest, if you read this it means you are not registered. Click here to register in a few simple steps, you will enjoy all features of our Forum.

Check for new replies
Release: BAM to plink
#1
So I have had questions over the years about creating datasets and here I present a new program called aDNA to dataset (AKA make-myself-redundant)

There are both Linux and Windows versions available. The instructions are very simple so I would like to get feedback from anyone interested in creating their own datasets from BAMs.

Notice: Windows version includes all the files necessary to run except references. For Linux you need to have samtools and pileupCaller in your path.

pileupCaller can be downloaded from here and for samtools I assume you know how to use apt, pacman, yum etc.

https://github.com/stschiff/sequenceTools

Main page:

https://github.com/teepean/adna_to_dataset

Download:

https://github.com/teepean/adna_to_datas.../v.0.2.zip

PileupCaller uses default settings and if you want to modify them you have to edit the .bat or .sh.

EDIT: the program supports only hs37d5 and hg19 as references as those are the most commonly used in aDNA papers. hg38/T2T support can be added if AADR starts supporting those references.
fj-blanco, ionix, kolompar And 19 others like this post
Reply
#2
Brilliant work. Thank you for your contributions teepean.
JMcB, AimSmall, teepean like this post
Reply
#3
New release that includes a reference downloader.

https://github.com/teepean/adna_to_datas.../v.0.3.zip
Qrts, AimSmall, crashdoc And 2 others like this post
Reply
#4
(03-16-2024, 05:37 PM)teepean Wrote: So I have had questions over the years about creating datasets and here I present a new program called aDNA to dataset (AKA make-myself-redundant)

There are both Linux and Windows versions available. The instructions are very simple so I would like to get feedback from anyone interested in creating their own datasets from BAMs.

Notice: Windows version includes all the files necessary to run except references. For Linux you need to have samtools and pileupCaller in your path.

EDIT: the program supports only hs37d5 and hg19 as references as those are the most commonly used in aDNA papers. hg38/T2T support can be added if AADR starts supporting those references.

Sorry for n00b question but what is the main purpose of creating own datasets from BAMs?
Regarding references download etc. may I ask if this could be installed together with WGSExtract so that big (reference) files/paths can be shared?
Reply
#5
(03-16-2024, 05:37 PM)teepean Wrote: So I have had questions over the years about creating datasets and here I present a new program called aDNA to dataset (AKA make-myself-redundant)

There are both Linux and Windows versions available. The instructions are very simple so I would like to get feedback from anyone interested in creating their own datasets from BAMs.

Notice: Windows version includes all the files necessary to run except references. For Linux you need to have samtools and pileupCaller in your path.

pileupCaller can be downloaded from here and for samtools I assume you know how to use apt, pacman, yum etc.

https://github.com/stschiff/sequenceTools

Main page:

https://github.com/teepean/adna_to_dataset

Download:

https://github.com/teepean/adna_to_datas.../v.0.2.zip

PileupCaller uses default settings and if you want to modify them you have to edit the .bat or .sh.

EDIT: the program supports only hs37d5 and hg19 as references as those are the most commonly used in aDNA papers. hg38/T2T support can be added if AADR starts supporting those references.

Do you think it could be possible a T2T CHM13 liftover of AADR data? Plink 2 can work perfectly with CHM13 reference and many low coverage ancient DNA raw data detects more SNPs with CHM13 reference alignment
TanTin and Qrts like this post
Reply
#6
(03-17-2024, 12:57 PM)ChrisR Wrote: Sorry for n00b question but what is the main purpose of creating own datasets from BAMs?
Regarding references download etc. may I ask if this could be installed together with WGSExtract so that big (reference) files/paths can be shared?

The idea is that more people could create datasets. As for the references it is possible to edit the code to point to a different location.

..\winbin\samtools mpileup -B -q 30 -Q 30 -l ../positions/v42.4.1240K.pos -f ../reference/hs37d5.fa
JMcB, miquirumba, Qrts And 1 others like this post
Reply
#7
Excellent! This sounds very useful. Quick question, about how much RAM does this program utilize on Windows, and is it compatible with 32-bit OS?
Qrts likes this post
Reply
#8
ok

Technical question from a noob :
I am running the program from Windows. The download for the references starts without any issues. Then, I encounter the question "enter population name". Which population does this refer to?
Reply
#9
(03-17-2024, 05:05 PM)Fabrice E Wrote: ok

Technical question from a noob :
I am running the program from Windows. The download for the references starts without any issues. Then, I encounter the question "enter population name". Which population does this refer to?

The outcome is a PLINK packedped consisting of 3 files (.bed, .bim, .fam) that will be created in the target subdirectory. The .fam indicates for each individual a Population Name and an Individual Name. These are what the program asks you to choose.
ChrisR, Fabrice E, teepean And 1 others like this post
MyHeritage:
North and West European 55.8%
English 28.5%
Baltic 11.5%
Finnish 4.2%
GENETIC GROUPS Scotland (Aberdeen and Aberdeenshire)

Papertrail (4 generations): Normandy, Orkney, Bergum, Emden, Oulu
Reply
#10
Can someone convert these 2 files to plink please?

GRC13292545.chrY.bam
GRC13292546.chrY.bam

https://evolbio.ut.ee/chrY/

These are Y chromosomes of A00 used by Karmin et al. (2015) .
Reply
#11
In addition , these BAM files are hg18 ( not hg19) .

##reference=file:///cvmfs/data.galaxyproject.org/byhand/hg18/sam_index/hg18.fa
The snp positions POS ID are not the same as hg19.
Reply
#12
(03-18-2024, 01:57 PM)TanTin Wrote: Can someone convert these 2 files to plink please?

GRC13292545.chrY.bam
GRC13292546.chrY.bam

https://evolbio.ut.ee/chrY/

These are Y chromosomes of A00 used by Karmin et al. (2015) .

This program should not be used for Y-DNA.
Reply
#13
New version released with reference auto-detection:

https://github.com/teepean/adna_to_datas.../v.0.5.zip
Fabrice E, ESPLover, Qrts And 2 others like this post
Reply

Check for new replies

Forum Jump:


Users browsing this thread: 1 Guest(s)