…70228)

Summary:

Similar to the OG impls, but heavily simplified. Introduces Memoizer and PersistentMemoizer classes.

Memoizer supports record, replay, and memoize functionality. Record simply caches the result of a function call. Replay checks for cached function call results and returns the cached result on hit, otherwise the function is called directly. Memoize is a combination of record and replay.

Memoizer is supported by an underlying _InMemoryCacheImpl instance.

PersistentMemoizer is nearly identical to Memoizer, other than also having an underlying _OnDiskCacheImpl instance such that cached results persist across program boundaries.

Test Plan: ```buck test fbcode//mode/opt caffe2/test/inductor:caching```

Differential Revision: D88979804

…h#170236)

Summary:

tldr; added a method to dump Memoizer's memory to disk in JSON format at program exit

in addition, we now include the encoded params in the cache entry (since the keys are hashes they don't provide much clues as to the origin of the entry by themself, hence why the params are now included)

note: the testing for the new dump method is actually included in the subsequent diff

Test Plan: ```buck test fbcode//mode/opt caffe2/test/inductor:caching```

Differential Revision: D88984165

Summary:

the reverse of dump

Test Plan: ```buck test fbcode//mode/opt caffe2/test/inductor:caching```

Differential Revision: D88984164

…ch#170256)

Summary:

Similar to D85684098, but using the new PersistentMemoizer, one readable, and less constrictive keys (since _should_pad was refactored)

```
{
  "cache_entries": {
    "should_pad": {
      "d05c99fdf8e1a35e43ba573d1a1acfa5": {
        "params": {
          "mat1": {
            "shape": [
              4096,
              4096
            ],
            "stride": [
              4096,
              1
            ],
            "dtype": "torch.bfloat16"
          },
          "mat2": {
            "shape": [
              4096,
              4096
            ],
            "stride": [
              4096,
              1
            ],
            "dtype": "torch.bfloat16"
          },
          "op": "aten.mm",
          "input": null,
          "mat1_exclude_padding_time": false,
          "mat2_exclude_padding_time": false
        },
        "result": false
      }
    }
  },
  "cache_size": 1
}
```

Test Plan: ```buck test fbcode//mode/opt caffe2/test/inductor:caching```

Reviewed By: v0i0

Differential Revision: D88999540