[go: nahoru, domu]

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Processing data with higher resolution #16

Closed
Vro1234 opened this issue Jan 18, 2023 · 2 comments
Closed

Processing data with higher resolution #16

Vro1234 opened this issue Jan 18, 2023 · 2 comments

Comments

@Vro1234
Copy link
Vro1234 commented Jan 18, 2023

Hi,
I'd like to process a PlanetScope image (resolution of 3x3m). However, I cannot calculate alpha and beta diversity.
For alpha, it starts mapping but after a while the
Error cannot allocate vector of size 10.9 Gb occurs.

Is there a way to process PlanetScope data other than processing little parts of it?

Thank you!

@jbferet
Copy link
Owner
jbferet commented Jan 18, 2023

Hi @Vro1234,
biodivMapR is supposed to handle very large datasets, including mosaics of Sentinel-2 tiles and airborne imaging spectroscopy. Then you should be able to process Planet data

Here are a few suggestions which may help :

  • First, make sure that you are using the latest version (currently v1.10.1), as I rewrote multiple functions very recently to better deal with large images and manage RAM when distributing the computation on multiple cores.
  • also make sure that the input parameters of the different functions are still correct if you are using scripts from a previous biodivMapR version on this latest version. A few parameters changed, as I tried to make it more simple. I will check if the tutorial is correctly updated.
  • the MaxRAM parameter does not actually correspond to the maximum RAM allowed to allocate. This is the maximum chunk size read by a core/CPU at once (I should rename it because this is counter intuitive). Then it inflates with successive computations. Therefore, I recommend starting with default value (MaxRAM = 0.25) to make sure the processing will not require unreasonable amount of RAM.
  • if the problem still occurs, then you may want to set MaxRAM = 0.1. But this is surprising...

Can you please provide more information on your case?

  • how many spectral bands are you processing, and what are your image dimensions?
  • did you provide a proper header file (.hdr) including your image metadata?
  • what is the configuration of your computer?

If you still have this problem, I would need a screenshot of all the messages printed by biodivMapR during the process, as well as your R script. Then I can check if something is obviously wrong in the parameterization. Let me know if you can provide this via email. if you still have this problem, a full dataset including script and an image subset allowing reproducing the bug may be needed.

Cheers,
jb

@Vro1234
Copy link
Author
Vro1234 commented Jan 18, 2023

Thanks a lot, setting MaxRAM to 0.25 instead of 0.5 solved the issue.

@Vro1234 Vro1234 closed this as completed Jan 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants