⚠️This is an Experimental Project and might not run in all the browsers.⚠️
This project brings starcoder.cpp to browser with power of WebAssembly
The framework provides support for loading any of the starcoder series model on browser.
Model has to be quantized in GGML format and pre-loaded into main.data file. You can find instructions on how to quantize a model in this project's Github repository.
In this demo, tiny_starcoder_py model (154) is first downloaded & loaded into the browser through WASM.
Once the model has been loaded successfully, then you can paste in Python Code snippet for auto-completion.