There are three experiments involved:
- Modern risk curve for DL:
risk_curve.pyandrisk_curve_evaluate_model.py - Measure intrinsic dimensions:
intrinsic_dimensions.pyandintrinsic_dimensions_measurement.py - Measure re-initialization and re-randomization robustness of layers:
layer_equality.py
See blog post "Are Deep Neural Networks Dramatically Overfitted?" for more details.