Li Jiayin
Senior Software Engineer
Osaka, JP.About
Highly experienced AI/ML Engineer with over a decade of expertise in backend systems and applied AI, specializing in transformer-based NLP and end-to-end GenAI pipelines. Proven track record in deploying Large Language Models (LLMs) to production, building scalable APIs, and delivering intelligent automation tools. Adept at optimizing data pipelines and integrating GenAI into real-time applications, leveraging deep understanding of cloud-native tools and human-in-the-loop ML workflows to drive significant impact.
Work
→
Summary
Led the development and deployment of advanced GenAI and NLP solutions, focusing on transformer-based models and scalable microservices for production environments.
Highlights
Led development of multilingual NLP pipelines using HuggingFace Transformers for complex NER, classification, and summarization tasks.
Engineered scalable FastAPI microservices, deploying them efficiently via Docker and AWS ECS to support high-performance AI applications.
Integrated Large Language Models (LLMs) into QA workflows with human-in-the-loop tools, boosting annotation accuracy by 30%.
Optimized model serving by deploying transformer models via Triton Inference Server with ONNX, significantly improving inference performance.
Orchestrated high-volume asynchronous workloads using Celery and Redis, successfully supporting over 1 million monthly API requests.
→
Summary
Designed and implemented robust backend services and AI applications, focusing on data pipelines, real-time monitoring, and production model integration for enterprise clients.
Highlights
Designed robust backend services for enterprise AI applications, leveraging Python and FastAPI for high-performance and scalability.
Developed critical predictive maintenance tools and document understanding pipelines, delivering specialized solutions for government and finance clients.
Deployed real-time monitoring dashboards and data APIs using PostgreSQL and Redis, enhancing operational visibility and data accessibility.
Integrated Scikit-learn and XGBoost models into production-grade services, ensuring reliable performance via REST and gRPC APIs.
Led the successful rollout of containerization and CI/CD pipelines using GitHub Actions and Docker on AWS, significantly streamlining deployment processes.
→
Summary
Developed educational backend systems and introduced modern software development practices while instructing undergraduate students in computer science.
Highlights
Developed Flask-based backend systems to automate student progress tracking and grading, improving administrative efficiency for faculty.
Introduced Git-based project workflows and DevOps practices into the Computer Science curriculum, enhancing student development methodologies.
Engineered Firebase Auth-based portals with role-based multilingual content delivery, expanding access and usability for diverse student populations.
Delivered comprehensive instruction in data science, algorithms, and practical Python programming to undergraduate students, fostering foundational skills.
→
Summary
Engineered educational technology tools and digitized administrative processes while teaching mathematics and leading curriculum modernization initiatives.
Highlights
Developed educational tools using C++ and Python to facilitate computational math and problem-solving skills for students.
Digitized key administrative workflows through custom SQL-backed internal tools, enhancing operational efficiency and data management.
Designed assistive learning modules and UI components tailored for special education use cases, improving accessibility and engagement.
Led a successful university-wide initiative to integrate Python, Git, and data science into engineering programs, modernizing the curriculum.
Skills
Cloud & Backend
AWS (Lambda, ECS, API Gateway, S3), Firebase, PostgreSQL, Firestore.
DevOps & Tools
Docker, GitHub Actions, Celery, Redis, WebSockets, Git, Postman, Figma, JIRA.
Languages
Python, JavaScript (TypeScript), Dart, SQL, C++.
AI/NLP & GenAI
HuggingFace Transformers, OpenAI API, LangChain, spaCy, Triton Inference Server, ONNX.
Frameworks
FastAPI, Flask, Node.js, React, Next.js, Flutter.
Protocols & APIs
REST, GraphQL, OAuth2, JWT, Microservices, CI/CD.