Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: bigscience-workshop/Megatron-DeepSpeed
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: main
Choose a base ref
...
head repository: bigscience-workshop/Megatron-DeepSpeed
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: lumi_eval
Choose a head ref
Checking mergeability… Don’t worry, you can still create the pull request.
  • 8 commits
  • 14 files changed
  • 4 contributors

Commits on Oct 7, 2022

  1. Squash 3 commits to 1 

    Patch HIP-support to fused kernels from Microsoft/Megatron-DeepSpeed-fork

Path HIP-support to fused kernels from Microsoft/Megatron-DeepSpeed-fork

remove some local files
    @luukkonenr
    luukkonenr committed Oct 7, 2022
    Configuration menu
    Copy the full SHA
    ebb79c8 View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2022

  1. Add --no-layer-norm-fusion argument

    @spyysalo
    spyysalo committed Oct 21, 2022
    Configuration menu
    Copy the full SHA
    21c90de View commit details
    Browse the repository at this point in the history

  2. Add --no-optimizer-fusion argument

    @spyysalo
    spyysalo committed Oct 21, 2022
    Configuration menu
    Copy the full SHA
    e048713 View commit details
    Browse the repository at this point in the history

  3. Bugfix (thanks to Thomas Wang for catching this)

    @spyysalo
    spyysalo committed Oct 21, 2022
    Configuration menu
    Copy the full SHA
    18e2c65 View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2022

  1. Fix the bug of FusedLayerNorm on ROCm (#96)

    @hubertlu-tw @spyysalo
    hubertlu-tw authored and spyysalo committed Nov 18, 2022
    Configuration menu
    Copy the full SHA
    9b7cd05 View commit details
    Browse the repository at this point in the history

  2. Revert cherry-picked changes to .py

    @spyysalo
    spyysalo committed Nov 18, 2022
    Configuration menu
    Copy the full SHA
    277e1d3 View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2022

  1. Add LUMI eval compat

    @Muennighoff
    Muennighoff committed Nov 22, 2022
    Configuration menu
    Copy the full SHA
    2963cae View commit details
    Browse the repository at this point in the history

  2. Update tasks

    @Muennighoff
    Muennighoff committed Nov 22, 2022
    Configuration menu
    Copy the full SHA
    32f039c View commit details
    Browse the repository at this point in the history
Loading