LiyuanLucasLiu
Follow
Stars
An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention & RFT)
A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
Puzzles for learning Triton, play it with minimal environment configuration!
Stochastic Automatic Differentiation library for PyTorch.
Videos of deep learning optimizers moving on 3D problem-landscapes
Official implementation of Vector-ICL: In-context Learning with Continuous Vector Representations
Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of GPT-Fast, a simple, PyTorch-native generation codebase.
Repository hosting code for "Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations" (https://arxiv.org/abs/2402.17152).
Official implementation of MetaTree: Learning a Decision Tree Algorithm with Transformers
local handling for Tuya devices
Official eufy-security-ws Home Assistant add-on repository
Sparse Backpropagation for Mixture-of-Expert Training
Home Assistant integration to manage Eufy Security devices as cameras, home base stations, doorbells, motion and contact sensors.
AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
Example models using DeepSpeed
A new markup-based typesetting system that is powerful and easy to learn.
Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
Chrome Extension that Integrates ChatGPT (Unofficial) into Google Search
Code and Data release for "Improving Multilingual Translation by Representation and Gradient Regularization" (Yang et al. EMNLP 2021), and "Language-Informed Beam Search Decoding for Multilingual M…