Sohail Zia sohailziahh

🎯

Focusing

AI Engineer

sohailziahh / acegpt.py

Last active April 30, 2024 19:51

leap ai oss deployment

	from transformers import AutoModelForCausalLM, AutoTokenizer
	import torch
	import time
	import uvicorn
	from fastapi import FastAPI, Query
	from fastapi.responses import JSONResponse
	from fastapi.middleware.cors import CORSMiddleware
	import re

	app = FastAPI()