#

optimizers

Here are 83 public repositories matching this topic...

annotated_deep_learning_paper_implementations

labmlai / annotated_deep_learning_paper_implementations

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

machine-learning reinforcement-learning deep-learning transformers pytorch transformer gan neural-networks literate-programming attention lora deep-learning-tutorial optimizers

Updated Aug 24, 2024
Python

lucidrains / lion-pytorch

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

deep-learning artificial-intelligence optimizers evolutionary-search

Updated Nov 22, 2024
Python

elixir-nx / axon

Nx-powered Neural Networks

elixir deep-learning neural-networks nx optimizers

Updated Nov 13, 2024
Elixir

gugarosa / opytimizer

🐦 Opytimizer is a Python library consisting of meta-heuristic optimization algorithms.

python optimization artificial-intelligence meta-heuristic optimizers bioinspired meta-heuristic-optimization

Updated Oct 22, 2024
Python

Yonghongwei / Gradient-Centralization

A New Optimization Technique for Deep Neural Networks

deep-neural-networks optimizers optimization-technique gradient-centralization

Updated Jan 13, 2022
Python

CyberZHG / keras-radam

RAdam implemented in Keras & TensorFlow

tensorflow keras adam optimizers radam rectified-adam

Updated Jan 22, 2022
Python

OverLordGoldDragon / keras-adamw

Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers

tensorflow keras sgd adamw adamwr nadam optimizers learning-rate-multipliers warm-restarts

Updated Jan 6, 2022
Python

clovaai / frostnet

FrostNet: Towards Quantization-Aware Network Architecture Search

computer-vision deep-learning pytorch style-transfer classification object-detection quantization network-architecture semantic-segmentation optimizers quantization-aware-training int8-quantization post-quantization quantization-efficient-network

Updated May 3, 2024
Python

Gradient-Centralization-TensorFlow

Rishit-dagli / Gradient-Centralization-TensorFlow

Instantly improve your training performance of TensorFlow models with just 2 lines of code!

python machine-learning deep-neural-networks deep-learning neural-network tensorflow python3 pip python-package tensorflow2 optimizers optimization-technique gradient-centralization

Updated Feb 9, 2022
Python

DL4S

palle-k / DL4S

Accelerated tensor operations and dynamic neural networks based on reverse mode automatic differentiation for every device that can run Swift - from watchOS to Linux

swift machine-learning deep-neural-networks deep-learning automatic-differentiation autograd recurrent-neural-networks recurrent-networks neural-networks derivatives convolutional-neural-networks tensor gradient-descent swift-machine-learning optimizers

Updated Nov 5, 2023
Swift

usef-kh / fer

Code for the paper "Facial Emotion Recognition: State of the Art Performance on FER2013"

architecture tuning vggnet loss fer schedulers fer2013 saliency-maps optimizers facial-emotions

Updated May 7, 2023
Jupyter Notebook

lucidrains / adam-atan2-pytorch

Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch

deep-learning artificial-intelligence stability adam optimizers

Updated Nov 22, 2024
Python

decile-team / submodlib

Summarize Massive Datasets using Submodular Optimization

greedy-algorithms combinatorial-optimization submodular-optimization data-summarization optimizers submodular-functions submodular submodular-information-measures

Updated Sep 12, 2024
Jupyter Notebook

hfxunlp / transformer

Neutron: A pytorch based implementation of Transformer and its variants.

natural-language-processing python3 pytorch transformer seq2seq ensemble beam-search neural-machine-translation multi-gpu attention-is-all-you-need multilingual-nmt average-attention-network dynamic-sentence-sampling robust-neural-machine-translation average-models optimizers sentential-context context-aware-nmt relative-position dynamic-batch-size

Updated Aug 10, 2023
Python

warner-benjamin / optimi

Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers

deep-learning pytorch optimizers

Updated Jul 15, 2024
Python

CyberZHG / keras-lookahead

Lookahead mechanism for optimizers in Keras.

keras lookahead optimizers

Updated Jun 24, 2021
Python

ProudElm / solaredgeoptimizers

Intergration to get optimizers information from the SolarEdge portal

python solaredge-api optimizers

Updated Jul 26, 2024
Python

ivallesp / awesome-optimizers

Neural Network optimizers implemented from scratch in numpy (Adam, Adadelta, RMSProp, SGD, etc.)

deep-learning gradient-descent optimizers

Updated Mar 21, 2020
Jupyter Notebook

shreyansh26 / ML-Optimizers-JAX

Toy implementations of some popular ML optimizers using Python/JAX

machine-learning momentum gradient-descent optimization-algorithms adam adam-optimizer jax optimizers

Updated Jun 20, 2021
Python

ShivamShrirao / dnn_from_scratch

A high level deep learning library for Convolutional Neural Networks,GANs and more, made from scratch(numpy/cupy implementation).

python machine-learning library deep-neural-networks computer-vision deep-learning neural-network numpy keras cnn generative-adversarial-network gan mnist convolutional-neural-networks cifar cnn-from-scratch backpropagate ml-from-scratch optimizers

Updated Jun 19, 2021
Python

Improve this page

Add a description, image, and links to the optimizers topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the optimizers topic, visit your repo's landing page and select "manage topics."