-
Notifications
You must be signed in to change notification settings - Fork 1.5k
Issues
is:issue state:open
is:issue state:open
Issue creation is restricted in this repository
Search results
No checkpoints saved during pretraining in Google Colab despite log.log_model and save_interval set.
bugSomething isn't workingSomething isn't workingStatus: Open.#2223 In Lightning-AI/litgpt;mask_cachein kv-cache path seems to forceattn_mask, preventing flash attentionquestionFurther information is requestedFurther information is requestedStatus: Open.#2220 In Lightning-AI/litgpt;Gradient Clipping Doesn't Work in Finetuning
questionFurther information is requestedFurther information is requestedStatus: Open.#2191 In Lightning-AI/litgpt;- Status: Open.#2190 In Lightning-AI/litgpt;
- Status: Open.#2189 In Lightning-AI/litgpt;
Feature: Support for Multimodality
enhancementNew feature or requestNew feature or requestStatus: Open.#2173 In Lightning-AI/litgpt;Request to support MedGemma and MedSigLip
enhancementNew feature or requestNew feature or requestStatus: Open.#2172 In Lightning-AI/litgpt;difference during inference with or without kvcache
bugSomething isn't workingSomething isn't workingStatus: Open.#2165 In Lightning-AI/litgpt;Cut cross entropy for pretraining and finetuning
enhancementNew feature or requestNew feature or requestStatus: Open.#2163 In Lightning-AI/litgpt;Support for SSM models (Mamba, Mamba2)
enhancementNew feature or requestNew feature or requestStatus: Open.#2158 In Lightning-AI/litgpt;- Status: Open.#2150 In Lightning-AI/litgpt;
Request to support OLMoE
enhancementNew feature or requestNew feature or requestStatus: Open.#2133 In Lightning-AI/litgpt;