Awesome list for Neural Network Optimization methods.

Stochastic gradient descent with model building

[Neurips 2022] "Deep Architecture Connectivity Matters for Its Convergence: A Fine-Grained Analysis" by Wuyang Chen*, Wei Huang*, Xinyu Gong, Boris Hanin, Zhangyang Wang

Implementation and comparison of zero order vs first order method on the AdaMM (aka AMSGrad) optimizer: analysis of convergence rates and minima shape

A Python math package for numerical analysis: root finding, iterative solvers & other algorithms. Bisection, Newton, Euler, RK2, RK4, Adams-Bashforth-Moulton, etc. Uses Python, NumPy, SymPy, pytest.

Some VASP processing and convergence-testing shell scripts.

Worth-reading papers and related awesome resources on deep learning optimization algorithms. 值得一读的深度学习优化器论文与相关资源。

Collection of methods for numerical analysis and scientific computing, including numerical root-finders, numerical integration, linear algebra, and data visualization. Created for APPM4600 at CU Boulder.

Official implementation of "Unraveling the Hessian: A Key to Smooth Convergence in Loss Function Landscapes"

[EE580: Network System - Modelling & Analysis] This repo contains all the assignment of EE580 offered at IIT Mandi by Dr.Sreelakshmi Manjunath during Fall Session 2023.

Toy models for Cauchy-Characteristic Extraction (CCE) and Matching (CCM)

This project investigates convergence for solving linear systems. It implements Jacobi and SOR methods, explores convergence, optimizes performance via ω, and analyzes spectral radius/determinant. It aims to enhance iterative method efficiency for linear systems.

Alpha Belief Propagation

Implementation and evaluation of the Ant Colony Optimization algorithm on the bin-packing problem

Special Project - CA classification (2019 Fall)

Record of Gachon Convergence Research Assistant

Official code repository for "Penalized MLE of multi-layer Gaussian Graphical Models"

Analysis of simulation data obtained with the ParMooN finite element package.

Bayesian inference tools, allowing to execute Gibbs sampling and run some diagnostics on results.

StoMADS algorithm for stochastic blackbox optimization