Search results

How to reproduce the result of infinite-length inputs?

Status: Open.

#47 In FMInference/H2O;

· shuhao02 opened on Dec 3, 2024

For model generation，I fail with ERROR:KeyError: 'Cache only has 0 layers, attempted to access layer with index 0'

Status: Open.

#45 In FMInference/H2O;

· liyanboSustech opened on Aug 29, 2024

For HELM testing, is an API, like togetherApiKey, necessary?

Status: Open.

#44 In FMInference/H2O;

· DOG-wooooof opened on Aug 19, 2024

TypeError: forward() got an unexpected keyword argument 'cache_position'

Status: Open.

#42 In FMInference/H2O;

· benja-matic opened on Jul 25, 2024

ModuleNotFoundError: No module named 'streaming_llm'

Status: Open.

#40 In FMInference/H2O;

· benja-matic opened on Jul 25, 2024

Undefined functions

Status: Open.

#39 In FMInference/H2O;

· XdertodX opened on Jul 24, 2024

Current transformers version v4.40 is not supported

Status: Open.

#38 In FMInference/H2O;

· maxjeblick opened on Jul 16, 2024

Evaluation on discrimative datasets with short prompt.

Status: Open.

#37 In FMInference/H2O;

· yinwangsong opened on Jun 24, 2024

Question about the reproduction of COPA results

Status: Open.

#36 In FMInference/H2O;

· hyeseongshin opened on Jun 19, 2024

Recent Budget Simulation is incorrect

Status: Open.

#35 In FMInference/H2O;

· gopikrishnajha opened on Jun 13, 2024

Eviction doesn't happen at all if recent_budget=0

Status: Open.

#33 In FMInference/H2O;

· foreverpiano opened on Jun 12, 2024

No support of GQA of Llama in real_drop

Status: Open.

#32 In FMInference/H2O;

· Tomorrowdawn opened on May 27, 2024