cluster llama Attention-UNet
cluster based PyTorch implementation for weights intelligence.
- Input
- 800-dim embedding
- Encoder
- 24 x Attention-UNet with 20 heads
- Output
- auc-roc projection
Training config
optimizer=Adadelta, lr=0.836, scheduler=plateau, warmup=735