V2 Performance Signal Detected by TorchBench CI on '2.6.0.dev20240918+cu124'

[xuzhao9]

TorchBench CI has detected a performance signal.

Base PyTorch version: 2.4.0.dev20240606+cu121

Base PyTorch commit: ffaea656b5d8ff6518669494cc8f664b94f8e8b1

Affected PyTorch version: 2.6.0.dev20240918+cu124

Affected PyTorch commit: 48d18fbd4cf785e1f69a6555d97a39023a5d199e

Affected Tests:

• test_train[Super_SloMo-cuda-eager]: +14.61260%
• test_eval[Super_SloMo-cuda-eager]: +11.06704%
• test_train[Super_SloMo-cuda-jit]: +14.74181%
• test_eval[Super_SloMo-cuda-jit]: +11.21563%
• test_eval[alexnet-cuda-eager]: +10.33117%
• test_eval[alexnet-cuda-jit]: +13.69378%
• test_train[dcgan-cuda-eager]: +63.62368%
• test_train[dcgan-cuda-jit]: +63.61366%
• test_eval[pyhpc_equation_of_state-cpu-jit]: +15.99175%
• test_eval[pytorch_stargan-cpu-eager]: -11.83703%
• test_eval[shufflenet_v2_x1_0-cpu-eager]: +10.94334%
• test_eval[shufflenet_v2_x1_0-cuda-jit]: -27.58940%
• test_eval[timm_regnet-cuda-eager]: +170.00818%
• test_eval[timm_regnet-cuda-jit]: +355.25202%
• test_train[yolov3-cuda-eager]: -9.95197%

cc @xuzhao9

Result json:

{
  "start": "ffaea656b5d8ff6518669494cc8f664b94f8e8b1",
  "end": "48d18fbd4cf785e1f69a6555d97a39023a5d199e",
  "threshold": 7,
  "timeout": 120,
  "torchbench_branch": "v2.0",
  "result": [
    {
      "commit1": "5f7d9563620",
      "commit1_time": "2024-09-09 18:24:21 +0000",
      "commit1_digest": {
        "test_eval[pytorch_stargan-cpu-eager]": 0.2655519244261086
      },
      "commit2": "2032f107d7e",
      "commit2_time": "2024-09-09 19:07:48 +0000",
      "commit2_digest": {
        "test_eval[pytorch_stargan-cpu-eager]": 0.2415499879978597
      }
    }
  ]
}

Bisection workflow link: https://github.com/pytorch/benchmark/actions/runs/10928523124