Assistance needed for running 10,500 Salmonella genomes through fastANI without running into a time out error. #142
Description
I am attempting to run ~10,500 Salmonella genomes on the Texas A&M HPRC, but running into an issue where the job timed out at 21 days. Per the outfile, only about 2,300 genomes were run through fastANI taking on average between 700-800 seconds each. Another student ran 8,000 Bacteroides genomes on the same partition on the same cluster and was able to complete the run in nine days where each genome took on average between 200-300 seconds to run. I was wondering if anyone had any recommendations for how to run my 10,500 genomes to completion, preferably in less than 21 days. The only difference between my script and the other script is that I allotted 200gb of memory and she allotted 350gb. Any help would be much appreciated. I can be reached at [email protected]. Thank you!