Introduced a new function get_cached_response to query a session cache using a provided key, and added the necessary import for the cozo_query decorator.

Sweep Found These Issues

• The function get_cached_response does not handle the case where the key is not found in the session_cache, which could lead to unexpected behavior or errors.

julep/agents-api/agents_api/models/session/get_cached_response.py

Lines 5 to 11 in 0529b48

	def get_cached_response(key: str) -> tuple[str, dict]:
	query = """
	input[key] <- [[$key]]
	?[key, value] := input[key], *session_cache{key, value}
	"""
	return (query, {"key": key})


View Diff

Introduced a new function set_cached_response to cache key-value pairs in a session_cache.

Sweep Found These Issues

• The function does not handle potential exceptions that may occur during the query execution, which could lead to unhandled errors.

julep/agents-api/agents_api/models/session/set_cached_response.py

Lines 5 to 16 in 0529b48

	def set_cached_response(key: str, value: dict) -> tuple[str, dict]:
	query = """
	?[key, value] <- [[$key, $value]]
	:insert session_cache {
	key => value
	}
	:returning
	"""
	return (query, {"key": key, "value": value})


View Diff

The changes introduce a caching mechanism using the xxhash library and new functions to store and retrieve cached responses, applied to the generate method of the BaseSession class.

The changes introduce a new migration script to create and remove a "session_cache" table with key-value pairs.

Sweep Found These Issues

• The SQL command for creating the "session_cache" table uses a non-standard syntax with :create and ::remove, which may not be recognized by the database engine.

julep/agents-api/migrations/migrate_1716013793_session_cache.py

Lines 9 to 16 in 0529b48

	:create session_cache {
	key: String,
	=>
	value: Json,
	}
	""",
	down="""
	::remove session_cache


View Diff