Skip to content

NUS HPC-AI Lab

[Homepage] [Twitter]
We are the High-Performance Computing for Artificial Intelligence (HPC-AI) Lab at the National University of Singapore (NUS)!

Pinned

  1. LARS-ImageNet-PyTorch LARS-ImageNet-PyTorch Public

    Accuracy 77%. Large batch deep learning optimizer LARS for ImageNet with PyTorch and ResNet, using Horovod for distribution. Optional accumulated gradient and NVIDIA DALI dataloader.

    Python 37 7

  2. pytorch-lamb pytorch-lamb Public

    PyTorch implementation of LAMB for ImageNet/ResNet-50 training

    Python 13 2

  3. InfoBatch InfoBatch Public

    Lossless Training Speed Up by Unbiased Dynamic Data Pruning

    Python 292 15

  4. Neural-Network-Parameter-Diffusion Neural-Network-Parameter-Diffusion Public

    We introduce a novel approach for parameter generation, named neural network parameter diffusion (p-diff), which employs a standard latent diffusion model to synthesize a new set of parameters

    Python 772 38

  5. OpenDiT OpenDiT Public

    OpenDiT: An Easy, Fast and Memory-Efficient System for DiT Training and Inference

    Python 1k 59

Repositories

Showing 10 of 19 repositories
  • InfoGrowth Public

    Efficient and Online Dataset Growth Algorithm (with cleanness and diversity awareness) to deal with growing web data

    4 0 0 0 Updated May 29, 2024
  • GEOM Public

    Pytorch implementation of ICML-2024 "Navigating Complexity: Toward Lossless Graph Condensation via Expanding Window Matching"

    Python 19 MIT 0 0 0 Updated May 28, 2024
  • Neural-Network-Parameter-Diffusion Public

    We introduce a novel approach for parameter generation, named neural network parameter diffusion (p-diff), which employs a standard latent diffusion model to synthesize a new set of parameters

    Python 772 38 6 1 Updated May 26, 2024
  • DATM Public

    ICLR 2024, Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching

    Python 75 5 0 0 Updated May 23, 2024
  • InfoBatch Public

    Lossless Training Speed Up by Unbiased Dynamic Data Pruning

    Python 292 15 7 0 Updated Apr 17, 2024
  • OpenDiT Public

    OpenDiT: An Easy, Fast and Memory-Efficient System for DiT Training and Inference

    Python 1,035 Apache-2.0 59 23 2 Updated Mar 25, 2024
  • Dynamic-Tuning Public

    The official implementation of "2024Arxiv Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation"

    Python 22 0 0 0 Updated Mar 23, 2024
  • Helen Public

    The official implementation of "Helen: Optimizing CTR Prediction Models with Frequency-wise Hessian Eigenvalue Regularization"

    Python 13 1 0 0 Updated Mar 14, 2024
  • CTRL Public

    Pytorch implementation of "Two Trades is not Baffled: Condensing Graph via Crafting Rational Gradient Matching"

    Python 4 MIT 0 0 0 Updated Feb 9, 2024
  • .github Public
    0 0 0 0 Updated Oct 19, 2023

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…