-
Notifications
You must be signed in to change notification settings - Fork 778
Multi-channel Image Dataloaders #976
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
aasthajh
commented
Oct 10, 2022
Would it help to use a MONAI model instead of pytorch ResNext? I had used MONAI ViT with the same dataloaders so I can swap out the model if that helps
ericspod
commented
Oct 11, 2022
I think the key contribution here is the dataset class demonstrating how to combine multichannel images. This can be recast using MONAI components (LoadImage) to load files instead of using PIL directly and use our models and other components in the training process which is pretty straight forward. You could use our engine classes as well instead of the regular training loop if you wanted to reduce total code in the notebook.
aasthajh
commented
Oct 11, 2022
Thanks Eric, I can replace the non-MONAI components with the MONAI equivalent. Could you please direct me to the engine classes you referred to and any examples for using the same?
ericspod
commented
Oct 11, 2022
Thanks Eric, I can replace the non-MONAI components with the MONAI equivalent. Could you please direct me to the engine classes you referred to and any examples for using the same?
The classes are in the monai.engine module. This tutorial and others in the Tutorials repo and in the Model Zoo help explain their use: https://github.com/Project-MONAI/tutorials/blob/main/acceleration/distributed_training/unet_training_workflows.py
nvahmadi
commented
Sep 8, 2023
I just saw that this PR is still open. It should be noted that in the meantime I worked with @aasthajh to create a multi-channel microscopy tutorial (already merged, see notebook). This tutorial covers the topics proposed in this notebook PR, but is more MONAI native (e.g. using ConcatItemsd transform and DenseNet169 network). Perhaps it makes sense to close this PR, since it is not really necessary anymore? What do you think @aasthajh?
Fixes # .
Description
This is an example highlighting the use of custom dataloaders for multi channel images. Multi channel images are very commonly used in healthcare, this example shows one such use case in microscopy.
Checks