JAX/Flax implementation of "VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning". ICLR 2022. https://arxiv.org/abs/2105.04906
-
Updated
Jan 29, 2023 - Jupyter Notebook
JAX/Flax implementation of "VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning". ICLR 2022. https://arxiv.org/abs/2105.04906
We address the task of learning contextualized word, sentence and document representations with a hierarchical language model by stacking Transformer-based encoders on a sentence level and subsequently on a document level and performing masked token prediction.
Code for reproducing results in Representation Learning in Sequence to Sequence Tasks: Multi-filter Gaussian Mixture Autoencoder.
Implementation of Power Law Graph Transformer for Machine Translation and Representation Learning.
Deep metric learning repository
Implementation of modulated sigmoid pairwise contrastive loss for self-supervised learning on images
Self-supervised Video Representation learning
Results from application of RatVec to protein sequences
Simple algorithm for generating graph nodes embeddings
📚 Paper Notes (Computer vision)
The application of representation learning for semantic associated heterogeneous networks in creating android app embedding layers.
Representation Learning Basics and Feature Extraction in Text
Drug Repurposing framed as link prediction problem, solved with Knowledge Graph Embedding (KGE). University project.
published at AAAI 2022
Pytorch implementation of the NLP experiment described in the original contrastive predictive coding paper (2018)
Source code for the BMVC-2021 paper "SimReg: Regression as a Simple Yet Effective Tool for Self-supervised Knowledge Distillation".
Representational Learning of Single-Lead Electrocardiogram Signals using Beta-TCVAE
Generative modeling and representation learning through reconstruction
Add a description, image, and links to the representation-learning topic page so that developers can more easily learn about it.
To associate your repository with the representation-learning topic, visit your repo's landing page and select "manage topics."