Issues

• Why is the model size in Evo2 set to 40.3 B parameters? Is it because of the 9.3 T tokens of training data?

  togethercomputer/stripedhyena#24 · Filter by author endNone opened on Jun 5, 2025

• Any thoughts on a GRPO version?

  togethercomputer/stripedhyena#23 · Filter by author sydneyrenee opened on Feb 11, 2025

• gradient checkpointing is not implement

  togethercomputer/stripedhyena#22 · Filter by author xiyang-aads-lilly opened on Oct 15, 2024

• evo and stripedhyena crash the server when doing a simple inference

  togethercomputer/stripedhyena#21 · Filter by author sun-qibo opened on Aug 28, 2024
  1

• flash attention not compatible?

  togethercomputer/stripedhyena#20 · Filter by author oxPJ opened on Aug 25, 2024
  1

• Limiting attention radius and extracting embeddings

  togethercomputer/stripedhyena#19 · Filter by author george-henderson opened on May 15, 2024
  1

• tokenizer.model file in addition to tokenizer.json

  togethercomputer/stripedhyena#14 · Filter by author kenneth-miura opened on Feb 22, 2024

• Apple Silicon support

  togethercomputer/stripedhyena#5 · Filter by author amrohendawi opened on Jan 20, 2024
  2

• Pretrain

  togethercomputer/stripedhyena#1 · Filter by author mietekrmd opened on Dec 8, 2023
  3