Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and vision-language capabilities
-
Updated
Feb 7, 2025 - Python
#
decoder-only
Here are 6 public repositories matching this topic...
Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment
multilingual evaluation embeddings evaluation-metrics cross-lingual multilingual-nlp large-language-models decoder-only
-
Updated
Oct 10, 2024 - Python
Code for paper "Modality Plug-and-Play: Elastic Modality Adaptation in Multimodal LLMs for Embodied AI"
-
Updated
Jan 19, 2024 - Python
使用Decoder-only的Transformer进行时序预测，包含SwiGLU和RoPE(Rotary Positional Embedding)，Time series prediction using Decoder-only Transformer, Including SwiGLU and RoPE(Rotary Positional Embedding)
time-series pytorch transformer rope time-series-prediction decoder-only rotary-positional-embedding swiglu
-
Updated
Jan 25, 2024 - Python
Auto regressive text generation application using decoder transformer
-
Updated
Feb 4, 2024 - Python
A decoder only approach for image reconstruction inspired by adversarial machine learning implemented in keras/tensorflow2
-
Updated
Aug 2, 2024 - Jupyter Notebook
Improve this page
Add a description, image, and links to the decoder-only topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the decoder-only topic, visit your repo's landing page and select "manage topics."