AI Platform Engineer

About the company: We are in the tech industry, specializing in cutting-edge AI solutions and advanced platform development. With a mission to empower businesses through intelligent automation and data-driven insights, we foster a collaborative and forward-thinking environment where creativity and technical excellence thrive. Job responsibilities: - Own the end-to-end build of an AI model service platform, starting from zero, engineered to grow into a system that can reliably serve user bases in the hundreds of thousands to millions. - Architect and continuously scale a unified layer of model API interfaces, overseeing how requests are routed across models, how load gets balanced, and how the service expands over time — all while keeping AI-driven services running reliably for connected hardware. - Deep working knowledge of today's leading AI models and their APIs - Solid backend development skills, with experience in cloud deployment, microservices, and inference frameworks, and the ability to iteratively scale and improve systems in production. - Business-savvy and outcome-driven, comfortable partnering across Agent teams, hardware teams, and other functions to keep the platform's direction tied to broader company goals. Requirements: - Bachelor's degree in Computer Science, Software Engineering, or a related field - Strong backend development experience (Java, Go, Python, or similar) - Hands-on experience with cloud platforms (AWS, Azure, GCP, or Alibaba Cloud) - Experience with microservices architecture and API design - Familiarity with AI/LLM APIs (OpenAI, Anthropic, Qwen, etc.) and inference frameworks (e.g., vLLM, Triton, TGI) - Experience building systems that scale to high user volumes - Understanding of load balancing, service routing, and distributed systems - Good communication skills; able to work with cross-functional teams (Agent, hardware, product)