A concise but complete full-attention transformer with a set of promising experimental features from various papers
copied from cf-staging / x-transformersA concise but fully-featured transformer, complete with a set of promising experimental features from various papers.