Python Developer (SLM:Small Language Model Specialist)
Backend Dev | Islamabad, Pakistan | Full Time
Job Description
Location: Islamabad, PK
Work Model: On-Site
Summary
We are seeking a skilled Python Developer with 2-3 years of experience in training Small Language Models (SLM) for mobile devices & utilizing and integrating OpenAI and Azure OpenAI Services. The ideal candidate will have hands-on experience in dataset creation, data preprocessing, Named Entity Recognition (NER) using SpaCy, synthetic data generation, and working with OpenAI APIs.
Key Responsibilities:
- Design and develop robust datasets (including JSON) for training and fine-tuning SLMs.
- Perform data preprocessing and cleaning to enhance model accuracy.
- Implement Named Entity Recognition (NER) using SpaCy and other NLP techniques.
- Generate and manage synthetic data for model training and validation.
- Integrate and utilize OpenAI APIs for model development and deployment.
- Strong knowledge of Azure OpenAI services and their integration into applications.
- Fine-tune SLMs using SKLearn, TensorFlow, and PEFT frameworks.
- Implement and optimize LoRA (Low-Rank Adaptation) for efficient SLM fine-tuning.
- Apply machine learning classification techniques for various NLP tasks.
- Format and deploy SLM models in TFLite for lightweight and efficient inference.
Requirements:
- 2-3 years of experience in Python development with a focus on NLP and ML.
- Proficiency in dataset creation and data preprocessing techniques.
- Hands-on experience with Named Entity Recognition (NER) using SpaCy.
- Experience in synthetic data generation for model enhancement.
- Strong knowledge of OpenAI APIs and their integration into applications.
- Expertise in SLM fine-tuning using SKLearn, TensorFlow, or PEFT.
- Practical knowledge of LoRA for model optimization.
- Understanding of machine learning classification techniques.
- Experience with SLM formatting, particularly in TFLite.
- Familiarity with cloud platforms and deployment strategies (AWS, GCP, or Azure is a plus).
What We Have For You:
Great compensation package, medical benefit for you and your family, free lunch, Bi-annual performance-tied increments & performance recognition awards and a great lean and agile work culture!
Convo endorses a culture of diversity in all aspects and aims to build a diverse team of amazing individuals!