-
Notifications
You must be signed in to change notification settings - Fork 334
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Up to 16 threads? #211
Comments
I/O is and will be limiting. That's probably why you see only a handful cores actually working. |
same issue. I am using a cluster with client servers that each have 48 cores with hyperthreading up to 192 and want to trim PE fastq files that have ~ 400 million reads. I am reading from a dedicated raid 0 striped server which mitigates the I/O issue, but this tool ends up taking way longer than Trimmomatic, simply due to the time that it is taking to read the files and limiting its use to 16 threads. |
I just hit this too using a 96 core machine on AWS. It would be nice if it were a warning but then attempted to use all the cores. |
So is this limited to 16 threads or not? Because I also get this warning |
Same issue..Why limit it to 16 threads only? |
Since using >16 threads cannot make fastp faster. The bottleneck is I/O when thread number > 8. |
Actually it uses only 4-6 cores in real datasets no matter how many threads I assigned. Why limiting it to 16 cores only? How can I use 128 threads on my linux server.
The text was updated successfully, but these errors were encountered: