PyTorch Patterns

Expert patterns for custom Dataset/DataLoader, nn.Module design, model surgery, custom autograd, and profiling.

Pattern 1: Custom Dataset with Transforms

Production Dataset with augmentation pipeline and weighted sampling.

import torch
from torch.utils.data import Dataset, DataLoader, WeightedRandomSampler
import pandas as pd
import numpy as np
from pathlib import Path
from PIL import Image
import albumentations as A
from albumentations.pytorch import ToTensorV2