Skip to content

fix the neon downloading pipeline #11

@Ritesh313

Description

@Ritesh313

Problem: the current processing code has all the required parts, but it doesn't work end to end (from shp files to copped and curated crowns)
Specific Issues:

  1. Currently it's restricted to curating only the ones that are available for all 3 modalities
  2. there's no good verbose feature to see some statistics about the shp files like: total crowns, crown dimensions range/stats, corresponding tile availability (per modality)

Required flow of the pipelines: (double check this to make sure it has all the required steps for verification and aligning crowns and tiles, using an agent before implementing)

  1. report initial statistics: total crowns, crown dimensions range/stats, what geographical regions are covered (is this info is producible easily)
  2. create a csv with coordinates and other info for crown cropping later (have an option of also maintaining labels at this step, in case labels are available for all/some crops)
  3. coordinate type/format verification. need to make sure coordinate format in all files is aligned with neon tiles.
  4. do a dry run to find the tiles and report: (a) total available tiles or not available (out of total crowns), (b) estimated download size and time.
  5. Maybe a decision choice for user at this point (controllable by a flag if needed to be run end-to-end)
  6. download all tiles and report: final tile availability stats
  7. preprocess and convert the hsi to the right format
  8. run crown cropping using the csv made in step 2

Ideas/Applications:

  1. can be prepared with deepforest crown cropping to download corresponding rgb and hsi modalities
  2. Should be able to download all modalities available for a certain crown.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions