SLM as a Service: On-Device Small Language Model