Releases: sozercan/aikit
Releases · sozercan/aikit
v0.15.0
Notable Changes
- 🍎 Apple Silicon GPU acceleration through Podman Desktop for Mac!
- 🍏 Pre-made models for Llama 3.2 and 3.1, Phi 3.5, and Gemma 2 with Apple Silicon support
- ✨ Update to LocalAI v2.23.0
- 🦥 Update Unsloth to Sept 2024 release
Features
- apple silicon support (#433) #433 (Sertaç Özercan)
Bug Fixes
- set config file env (#401) #401 (Sertaç Özercan)
- fix llama 3.1 70b (#402) #402 (Sertaç Özercan)
- bump grpcio to 1.68.0 (#437) #437 (Sertaç Özercan)
Documentation
- update apple silicon docs (#436) #436 (Sertaç Özercan)
Continuous Integration
- allow hf.co in update models (#400) #400 (Sertaç Özercan)
- bump precommit (#421) #421 (Sertaç Özercan)
- fix podman test (#435) #435 (Sertaç Özercan)
Chores
- Prepare v0.14.0 release (#399) #399 (github-actions[bot])
- deps: Bump golang from
1a5326b
todba79eb
(#404) #404 (dependabot[bot]) - deps: Bump the actions-all group with 3 updates (#405) #405 (dependabot[bot])
- bump unsloth to sept-2024 (#403) #403 (Sertaç Özercan)
- deps: Bump google.golang.org/grpc from 1.67.0 to 1.67.1 (#406) #406 (dependabot[bot])
- deps: Bump the actions-all group with 6 updates (#407) #407 (dependabot[bot])
- deps: Bump golang from
dba79eb
to18d2f94
(#408) #408 (dependabot[bot]) - deps: Bump golang from
18d2f94
to2341ddf
(#410) #410 (dependabot[bot]) - deps: Bump the actions-all group across 1 directory with 4 updates (#411) #411 (dependabot[bot])
- bump localai v2.22.1 (#412) #412 (Sertaç Özercan)
- deps: Bump kubectl from v1.31.1 to v1.31.2 in /charts/aikit (#415) #415 (dependabot[bot])
- deps: Bump the actions-all group with 6 updates (#414) #414 (dependabot[bot])
- deps: Bump http-proxy-middleware from 2.0.6 to 2.0.7 in /website in the npm_and_yarn group across 1 directory (#413) #413 (dependabot[bot])
- update base image chisel to 1.0.0 and use the new manifest (#417) #417 (Sertaç Özercan)
- deps: Bump the actions-all group with 2 updates (#420) #420 (dependabot[bot])
- deps: Bump github.com/moby/buildkit from 0.16.0 to 0.17.0 (#419) #419 (dependabot[bot])
- deps: Bump golang from
2341ddf
to0e3377d
(#422) #422 (dependabot[bot]) - deps: Bump golang.org/x/sync from 0.8.0 to 0.9.0 (#424) #424 (dependabot[bot])
- deps: Bump github/codeql-action from 3.27.0 to 3.27.4 in the actions-all group across 1 directory (#427) #427 (dependabot[bot])
- deps: Bump cross-spawn from 7.0.3 to 7.0.6 in /website in the npm_and_yarn group across 1 directory (#428) #428 (dependabot[bot])
- deps: Bump github.com/moby/buildkit from 0.17.0 to 0.17.1 (#425) #425 (dependabot[bot])
- deps: Bump google.golang.org/grpc from 1.67.1 to 1.68.0 (#423) #423 (dependabot[bot])
- deps: Bump github.com/moby/buildkit from 0.17.1 to 0.17.2 (#430) #430 (dependabot[bot])
- deps: Bump golang from
0e3377d
to3f3b9da
(#431) #431 (dependabot[bot]) - deps: Bump kubectl from v1.31.2 to v1.31.3 in /charts/aikit (#429) #429 (dependabot[bot])
- deps: Bump the actions-all group with 4 updates (#432) #432 (dependabot[bot])
- Prepare v0.15.0 release (#438) #438 (github-actions[bot])
v0.14.0
Notable Changes
- 🦙 Llama 3.2 1B and 3B are available in pre-made images!
Features
- add llama 3.2 (#395) #395 (Sertaç Özercan)
Documentation
- update flux emoji (#377) #377 (Sertaç Özercan)
- add search (#386) #386 (Sertaç Özercan)
Continuous Integration
- fix flux release (#378) #378 (Sertaç Özercan)
- fix flux release (#379) #379 (Sertaç Özercan)
- update allowlist (#380) #380 (Sertaç Özercan)
- update allowlist (#381) #381 (Sertaç Özercan)
Chores
- Prepare v0.13.0 release (#376) #376 (github-actions[bot])
- deps: Bump golang from
31dc846
to1a5326b
(#384) #384 (dependabot[bot]) - deps: Bump peter-evans/create-pull-request from 6.1.0 to 7.0.1 in the actions-all group (#383) #383 (dependabot[bot])
- deps: Bump the npm_and_yarn group across 1 directory with 4 updates (#385) #385 (dependabot[bot])
- deps: Bump kubectl from v1.31.0 to v1.31.1 in /charts/aikit (#388) #388 (dependabot[bot])
- deps: Bump the actions-all group with 3 updates (#391) #391 (dependabot[bot])
- deps: Bump google.golang.org/grpc from 1.66.0 to 1.67.0 (#393) #393 (dependabot[bot])
- deps: Bump the actions-all group with 3 updates (#392) #392 (dependabot[bot])
- deps: Bump github.com/moby/buildkit from 0.15.2 to 0.16.0 (#389) #389 (dependabot[bot])
- remove deprecated exllama (#396) #396 (Sertaç Özercan)
- update update-models script (#397) #397 (Sertaç Özercan)
- Prepare v0.14.0 release (#398) #398 (github-actions[bot])
v0.13.0
Notable Changes
- 🤗 Added huggingface
diffusers
backend - 📸 Flux-1 Dev is available in pre-made images!
🅿️ Phi 3.5 Mini Instruct is available in pre-made images!
Features
- add gemma2 2b (#355) #355 (Sertaç Özercan)
- diffusers backend (#373) #373 (Sertaç Özercan)
- add phi3.5 model (#374) #374 (Sertaç Özercan)
Documentation
- update for llama3.1 (#349) #349 (Sertaç Özercan)
Continuous Integration
- add ubuntu to allow list (#348) #348 (Sertaç Özercan)
- fix patch models (#358) #358 (Sertaç Özercan)
Chores
- Prepare v0.12.0 release (#347) #347 (github-actions[bot])
- deps: Bump github.com/moby/buildkit from 0.15.0 to 0.15.1 (#351) #351 (dependabot[bot])
- deps: Bump golang from
6c27802
toaf9b40f
(#352) #352 (dependabot[bot]) - deps: Bump the actions-all group with 6 updates (#350) #350 (dependabot[bot])
- bump localai v2.19.4 (#343) #343 (Sertaç Özercan)
- deps: Bump the actions-all group with 3 updates (#360) #360 (dependabot[bot])
- deps: Bump golang.org/x/sync from 0.7.0 to 0.8.0 (#359) #359 (dependabot[bot])
- deps: Bump the actions-all group with 5 updates (#361) #361 (dependabot[bot])
- deps: Bump golang from
af9b40f
to39b7e6e
(#362) #362 (dependabot[bot]) - deps: Bump golang from 1.22-bookworm to 1.23-bookworm (#364) #364 (dependabot[bot])
- deps: Bump the actions-all group with 2 updates (#366) #366 (dependabot[bot])
- deps: Bump github.com/moby/buildkit from 0.15.1 to 0.15.2 (#367) #367 (dependabot[bot])
- deps: Bump kubectl from v1.30.3 to v1.31.0 in /charts/aikit (#365) #365 (dependabot[bot])
- deps: Bump github/codeql-action from 3.26.2 to 3.26.5 in the actions-all group (#368) #368 (dependabot[bot])
- deps: Bump the npm_and_yarn group across 1 directory with 2 updates (#370) #370 (dependabot[bot])
- update localai to v2.20.1 (#369) #369 (Sertaç Özercan)
- deps: Bump the actions-all group with 2 updates (#372) #372 (dependabot[bot])
- deps: Bump google.golang.org/grpc from 1.65.0 to 1.66.0 (#371) #371 (dependabot[bot])
- Prepare v0.13.0 release (#375) #375 (github-actions[bot])
v0.12.2
Notable Changes
- 🔠 Gemma 2 2B is available in pre-made images!
Chores
- cherry-pick #355 (#356) #356 (Sertaç Özercan)
- Prepare v0.12.2 release (#357) #357 (github-actions[bot])
v0.12.1
Notable Changes
- 🆕 Update to LocalAI v2.19.4.
Chores
- cherry pick #343 (#353) #353 (Sertaç Özercan)
- Prepare v0.12.1 release (#354) #354 (github-actions[bot])
v0.12.0
Notable Changes
- 🦙 Llama 3.1 8B and 70B are available in pre-made images!
- 🆕 Update to LocalAI v2.19.1.
Deprecation
- 🪦 Deprecated older Lllama 2 and 3 pre-made images. They'll be available in the registry but will not be updated.
Features
- add llama 3.1 8b and 70b (#344) #344 (Sertaç Özercan)
Bug Fixes
- drop gguf from ollama artifacts model name (#309) #309 (Sertaç Özercan)
Documentation
- update demos (#322) #322 (Sertaç Özercan)
- add architecture (#323) #323 (Sertaç Özercan)
- update sidebar (#324) #324 (Sertaç Özercan)
Tests
- fix llama cuda test (#318) #318 (Sertaç Özercan)
Continuous Integration
- release base (#333) #333 (Sertaç Özercan)
- fix base file (#334) #334 (Sertaç Özercan)
- fix source branch (#338) #338 (Sertaç Özercan)
- fix github repo for args test (#339) #339 (Sertaç Özercan)
Chores
- Prepare v0.11.0 release (#308) #308 (github-actions[bot])
- move codestral to self hosted update models (#312) #312 (Sertaç Özercan)
- deps: Bump the actions-all group with 2 updates (#313) #313 (dependabot[bot])
- deps: Bump ws from 7.5.9 to 7.5.10 in /website in the npm_and_yarn group across 1 directory (#315) #315 (dependabot[bot])
- deps: Bump golang from
aec4784
to9678844
(#314) #314 (dependabot[bot]) - deps: Bump github.com/moby/buildkit from 0.14.0 to 0.14.1 (#321) #321 (dependabot[bot])
- deps: Bump the actions-all group with 2 updates (#320) #320 (dependabot[bot])
- deps: Bump the actions-all group with 2 updates (#326) #326 (dependabot[bot])
- deps: Bump golang from
9678844
to6c27802
(#328) #328 (dependabot[bot]) - deps: Bump google.golang.org/grpc from 1.64.0 to 1.65.0 (#330) #330 (dependabot[bot])
- deps: Bump the actions-all group with 4 updates (#331) #331 (dependabot[bot])
- deps: Bump the actions-all group across 1 directory with 6 updates (#332) #332 (dependabot[bot])
- deps: Bump github.com/containerd/containerd from 1.7.18 to 1.7.19 (#329) #329 (dependabot[bot])
- deps: Bump the actions-all group with 2 updates (#336) #336 (dependabot[bot])
- bump localai v2.18.1 (#317) #317 (Sertaç Özercan)
- deps: Bump github.com/moby/buildkit from 0.14.1 to 0.15.0 (#335) #335 (dependabot[bot])
- update localai to v2.19.1 (#340) #340 (Sertaç Özercan)
- deps: Bump kubectl from v1.30.2 to v1.30.3 in /charts/aikit (#341) #341 (dependabot[bot])
- deps: Bump the actions-all group with 3 updates (#342) #342 (dependabot[bot])
- Prepare v0.12.0 release (#346) #346 (github-actions[bot])
v0.11.1
Notable Changes
- 💪 Multi-platform images with ARM64 support! All pre-made models include both AMD64 and ARM64 platform support.
- 📦 Support for models from OCI Artifacts. For example, use models from ollama by simply running:
docker buildx build -t my-model --load \
--build-arg="model=oci://registry.ollama.ai/library/llama3:8b" \
"https://raw.githubusercontent.com/sozercan/aikit/main/models/aikitfile.yaml"
docker run -d --rm -p 8080:8080 my-model
curl http://localhost:8080/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "llama3",
"messages": [
{
"role": "user",
"content": "Hello!"
}
]
}'
- ⎈ Helm chart security hardening with
restricted
pod security admission
Chores
- Prepare v0.11.1 release (#311) #311 (github-actions[bot])
Commits
v0.11.0
Notable Changes
- 💪 Multi-platform images with ARM64 support! All pre-made models include both AMD64 and ARM64 platform support.
- 📦 Support for models from OCI Artifacts. For example, use models from ollama by simply running:
docker buildx build -t my-model --load \
--build-arg="model=oci://registry.ollama.ai/library/llama3:8b" \
"https://raw.githubusercontent.com/sozercan/aikit/main/models/aikitfile.yaml"
docker run -d --rm -p 8080:8080 my-model
curl http://localhost:8080/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "llama3",
"messages": [
{
"role": "user",
"content": "Hello!"
}
]
}'
- ⎈ Helm chart security hardening with
restricted
pod security admission
Features
- arm64 support (#290) #290 (Sertaç Özercan)
- support for models from oci artifacts (#296) #296 (Sertaç Özercan)
- update helm pod security (#299) #299 (Sertaç Özercan)
Documentation
- supply chain security (#283) #283 (Sertaç Özercan)
- update readme links (#285) #285 (Sertaç Özercan)
- arm64 docs (#298) #298 (Sertaç Özercan)
- webui quick start (#300) #300 (Sertaç Özercan)
Continuous Integration
- fix release-pr push new version (#276) #276 (Sertaç Özercan)
Chores
- Prepare v0.10 release (#275) #275 (github-actions[bot])
- update website logo (#278) #278 (Sertaç Özercan)
- update website logo size (#279) #279 (Sertaç Özercan)
- update website logo size (#280) #280 (Sertaç Özercan)
- update demo-magic.sh (#281) #281 (Ikko Eltociear Ashimine)
- update llama3 sha256 (#284) #284 (Sertaç Özercan)
- update llama3 templates (#287) #287 (Sertaç Özercan)
- update prompt templates (#288) #288 (Sertaç Özercan)
- update codestral hash (#289) #289 (Sertaç Özercan)
- deps: Bump golang from
5c56bd4
toaec4784
(#291) #291 (dependabot[bot]) - deps: Bump the actions-all group with 3 updates (#293) #293 (dependabot[bot])
- deps: Bump github.com/containerd/containerd from 1.7.17 to 1.7.18 (#292) #292 (dependabot[bot])
- remove lobechat from helm (#282) #282 (Sertaç Özercan)
- use cdn (#295) #295 (Sertaç Özercan)
- deps: Bump braces from 3.0.2 to 3.0.3 in /website in the npm_and_yarn group across 1 directory (#301) #301 (dependabot[bot])
- update unsloth to june2024 (#302) #302 (Sertaç Özercan)
- Update dependencies (#286) #286 (Rene Leonhardt)
- deps: Bump kubectl from v1.30.1 to v1.30.2 in /charts/aikit (#304) #304 (dependabot[bot])
- deps: Bump the actions-all group with 2 updates (#306) #306 (dependabot[bot])
- deps: Bump github.com/moby/buildkit from 0.13.2 to 0.14.0 (#305) #305 (dependabot[bot])
- Prepare v0.11.0 release (#307) #307 (github-actions[bot])
v0.10.0
Notable changes
⚡️ Quick start to create custom images using models from Hugging Face 🤗 without creating an aikitfile
Example:
docker buildx build -t my-model --load \
--build-arg="model=huggingface://TheBloke/Llama-2-7B-Chat-GGUF/llama-2-7b-chat.Q4_K_M.gguf" \
"https://raw.githubusercontent.com/sozercan/aikit/main/models/aikitfile.yaml"
Features
- parse build args and handle http/git contexts (#268) #268 (Sertaç Özercan)
Bug Fixes
- unsloth custom config (#266) #266 (Sertaç Özercan)
Documentation
- update release (#255) #255 (Sertaç Özercan)
- update baseUrl due to helm chart (#259) #259 (Sertaç Özercan)
- helm repo (#260) #260 (Sertaç Özercan)
- gemma and codestral models (#262) #262 (Sertaç Özercan)
- fix broken links (#265) #265 (Sertaç Özercan)
Tests
- update args test (#270) #270 (Sertaç Özercan)
Continuous Integration
- allow helm.sh for release (#257) #257 (Sertaç Özercan)
- update model name parsing (#263) #263 (Sertaç Özercan)
- remove push event from release-pr (#271) #271 (Sertaç Özercan)
- update release-pr push logic (#273) #273 (Sertaç Özercan)
Chores
- update phi3 sha (#261) #261 (Sertaç Özercan)
- deps: Bump the actions-all group with 2 updates (#267) #267 (dependabot[bot])
- Prepare v0.10.0 release (#274) #274 (github-actions[bot])
v0.9.0
Notable Changes
- 🕵️ Auto runtime detection: AIKit will now automatically check your CPU and GPU capabilities, and automatically choose the most optimized runtime. With this change, there is no differentiation for runtimes
avx
,avx2
, andavx512
. They can still be used to skip installing thecuda
runtime libraries for slimmer images. - 💿 Pre-made models will now include CUDA libraries by default, and CUDA specific images will not be updated anymore. Thanks to auto runtime detection if a compatible GPU is not found, it will fallback to the most optimized CPU runtime.
- ⎈ Helm chart for Kubernetes is now available!
- 🚀 New pre-made models are now available:
Gemma 1.1 2B Instruct
andCodestral 22B
. - ✨ Updated LocalAI to v2.16.0.
- 🦥 Updated Unsloth to May 2024 release.
Features
- add phi3 model (#210) #210 (Sertaç Özercan)
- helm chart (#240) #240 (Sertaç Özercan)
- add codestral (#253) #253 (Sertaç Özercan)
Bug Fixes
- allow list api.scorecard.dev (#229) #229 (Sertaç Özercan)
- gpu detect (#238) #238 (Sertaç Özercan)
- release pr workflow (#243) #243 (Sertaç Özercan)
- chart appversion (#245) #245 (Sertaç Özercan)
Documentation
- doc deprecated models (#212) #212 (Sertaç Özercan)
- fix new row in table (#215) #215 (Sertaç Özercan)
- add model name (#217) #217 (Sertaç Özercan)
- new logo (#218) #218 (Sertaç Özercan)
- update helm chart (#247) #247 (Sertaç Özercan)
- helm chart (#248) #248 (Sertaç Özercan)
- update llama.cpp (#252) #252 (Sertaç Özercan)
Continuous Integration
- allow helm.sh for release (#258) #258 (Sertaç Özercan)
Chores
- deps: Bump golang from
b03f3ba
tod0902ba
(#221) #221 (dependabot[bot]) - deps: Bump github.com/containerd/containerd from 1.7.15 to 1.7.16 (#222) #222 (dependabot[bot])
- deps: Bump the actions-all group with 5 updates (#224) #224 (dependabot[bot])
- deps: Bump github.com/moby/buildkit from 0.13.1 to 0.13.2 (#223) #223 (dependabot[bot])
- deps: Bump the actions-all group with 4 updates (#226) #226 (dependabot[bot])
- deps: Bump the actions-all group with 4 updates (#228) #228 (dependabot[bot])
- deps: Bump golang from
d0902ba
to6d71b7c
(#227) #227 (dependabot[bot]) - deps: Bump golang from
6d71b7c
to5c56bd4
(#233) #233 (dependabot[bot]) - deps: Bump google.golang.org/grpc from 1.63.2 to 1.64.0 (#231) #231 (dependabot[bot])
- deps: Bump the actions-all group with 2 updates (#230) #230 (dependabot[bot])
- deps: Bump github.com/containerd/containerd from 1.7.16 to 1.7.17 (#232) #232 (dependabot[bot])
- update to localai v2.16.0 (#225) #225 (Sertaç Özercan)
- remove runtime (#237) #237 (Sertaç Özercan)
- update unsloth to may 2024 release (#239) #239 (Sertaç Özercan)
- add gemma 1.1 model (#149) #149 (Sertaç Özercan)
- deps: Bump the actions-all group with 4 updates (#251) #251 (dependabot[bot])
- Prepare v0.9.0 release (#254) #256,#254 (github-actions[bot])
Reverts
- runtime removal (#249) #249 (Sertaç Özercan)