FlexiTransformers

Package Modules

  • flexit
FlexiTransformers
  • Overview: module code

All modules for which code is available

  • flexit.attention.multi_head
  • flexit.attention.positional
    • flexit.attention.positional.absolute
    • flexit.attention.positional.alibi
    • flexit.attention.positional.base
    • flexit.attention.positional.relative
    • flexit.attention.positional.rotary
  • flexit.blocks.causal_decoder
  • flexit.blocks.cross_decoder
  • flexit.blocks.encoder
  • flexit.config.model_config
  • flexit.config.training_config
  • flexit.core.embeddings
  • flexit.core.feedforward
  • flexit.core.generator
  • flexit.core.normalization
  • flexit.factory.model_factory
  • flexit.inference.decoding
  • flexit.inference.sampling
  • flexit.layers.causal_decoder_layer
  • flexit.layers.cross_decoder_layer
  • flexit.layers.encoder_layer
  • flexit.layers.sublayer
  • flexit.models.base
  • flexit.models.decoder_only
  • flexit.models.encoder_decoder
  • flexit.models.encoder_only
  • flexit.models.flexi
  • flexit.models.heads.classification
  • flexit.models.heads.lm_head
  • flexit.models.heads.token_classification
  • flexit.training.batch
  • flexit.training.callbacks
  • flexit.training.loss
  • flexit.training.schedulers
  • flexit.training.state
  • flexit.training.trainer
  • flexit.utils.helpers
  • flexit.utils.initialization
  • flexit.utils.masks

© Copyright 2025, Ahmed Elshahawy.

Built with Sphinx using a theme provided by Read the Docs.