-
Notifications
You must be signed in to change notification settings - Fork 248
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fastq-dump/fasterq-dump: can't open JTFH01xxxxxx as a RefSeq or as a WGS #946
Comments
What is the output of the following? |
Here is a subset of the output (let me know if you want the whole thing): JTFH01000001,chrUn_JTFH01000001v1_decoy,false,remote |
What is the output of the following? |
|
What is the output of the following? |
Thank you for taking the time to help! |
Do all other files in SRR22287940 directory have the same permissions as JTFH01? ('Others' cannot read it) |
Yes, that is correct.
|
What is the full output of the following? |
|
Run Then run again |
|
Try to run fasterq-dump or fastq-dump of /cluster/projects/hopegroup/dbGap/prj_35579/SRR22287940 again. |
Still fails with fasterq-dump.
|
I will need to debug it on Monday. |
What ngc file did you use to prefetch SRR22287940? |
The ngc file was downloaded from the dbGap repository that is specific to our groups data request application. It was the same file used to download the other accessions. I am not sure if I can share the file. |
Don't share it. What is project's number? |
project # 35579 |
How many files do you have in SRR22287940/ directory? |
There are 592 files in total. |
What is the output of the following? |
I get 1552 back. |
What is the output of the following? |
|
It is a bug, thank you for finding it, we will fix it in our following release. Currently run Use |
Awesome, thank you! |
I am currently running sratoolkit 3.1.1 and have run into the following error:
fasterq-dump:
fasterq-dump --split-files path/SRR22287940 -e 6 --outdir test
2024-07-13T01:17:07 fasterq-dump.3.1.1 warn: directory not found while opening manager within virtual file system module - can't open JTFH01000001 as a RefSeq or as a $2024-07-13T01:17:07 fasterq-dump.3.1.1 err: sorter.c producer_thread_func: rec.read.len = 0
2024-07-13T01:17:08 fasterq-dump.3.1.1 err: sorter.c run_producer_pool().join_and_release_threads -> RC(rcVDB,rcNoTarg,rcWriting,rcFormat,rcNull)
2024-07-13T01:17:08 fasterq-dump.3.1.1 err: sorter.c execute_lookup_production() -> RC(rcVDB,rcNoTarg,rcWriting,rcFormat,rcNull)
2024-07-13T01:17:08 fasterq-dump.3.1.1 err: fasterq-dump.c produce_lookup_files() -> RC(rcVDB,rcNoTarg,rcWriting,rcFormat,rcNull)
fastq-dump:
fastq-dump --gzip --skip-technical --split-files path/SRR22287940
2024-07-13T01:42:02 fastq-dump.3.1.1 warn: timeout exhausted while creating file within network system module - can't open JTFH01000001 as a RefSeq or as a WGS
2024-07-13T01:45:03 fastq-dump.3.1.1 warn: timeout exhausted while creating file within network system module - can't open JTFH01000013 as a RefSeq or as a WGS
2024-07-13T01:48:05 fastq-dump.3.1.1 warn: timeout exhausted while creating file within network system module - can't open JTFH01000015 as a RefSeq or as a WGS
2024-07-13T01:51:06 fastq-dump.3.1.1 warn: timeout exhausted while creating file within network system module - can't open JTFH01000017 as a RefSeq or as a WGS
2024-07-13T01:54:08 fastq-dump.3.1.1 warn: timeout exhausted while creating file within network system module - can't open JTFH01000018 as a RefSeq or as a WGS
2024-07-13T01:57:10 fastq-dump.3.1.1 warn: timeout exhausted while creating file within network system module - can't open JTFH01000022 as a RefSeq or as a WGS
etc....
This error occurs in only a subset of the SRA accessions, specially WGS samples. The accessions were downloaded using prefetch and are unfortunately restricted as they are samples from a clinical study. As you can see from the files within the accession folder, the JTFH01 reference files are located within the folder so I am not sure why it is trying to download/create the files again. Also, our compute cluster is restricted from the internet so attempts to fetch any reference files via fastq-dump/fasterq-dump is denied.
JTFH01 KN707668.1 KN707750.1 KN707845.1 KN707912.1 NC_000005.10 NT_167218.1 NT_187387.1 NT_187443.1 NT_187508.1 NT_187545.1 NT_187582.1 NT_187619.1 NT_187656.1 NT_187693.1 NW_003315958.1 KN707607.1 KN707669.1 KN707753.1 KN707850.1 KN707913.1 NC_000006.12 NT_167219.1 NT_187388.1 NT_187444.1 NT_187509.1 NT_187546.1 NT_187583.1 ... NW_004166862.2 KN707661.1 KN707744.1 KN707835.1 KN707904.1 NC_000002.12 NT_167213.1 NT_187384.1 NT_187438.1 NT_187505.1 NT_187542.1 NT_187579.1 NT_187616.1 NT_187653.1 NT_187690.1 NW_003315955.1 NW_004504305.1 KN707662.1 KN707746.1 KN707840.1 KN707905.1 NC_000003.12 NT_167214.1 NT_187385.1 NT_187439.1 NT_187506.1 NT_187543.1 NT_187580.1 NT_187617.1 NT_187654.1 NT_187691.1 NW_003315956.1 SRR22287940.sra KN707664.1 KN707749.1 KN707844.1 KN707906.1 NC_000004.12 NT_167215.1 NT_187386.1 NT_187442.1 NT_187507.1 NT_187544.1 NT_187581.1 NT_187618.1 NT_187655.1 NT_187692.1 NW_003315957.1
I have been stuck on this problem for days now and can't find any resources to help with this issue. So, any help is much appreciated.
Thank you.
The text was updated successfully, but these errors were encountered: